2024-09-21T03:02:19.755 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T03:02:19.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T03:02:19.874 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913454 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913454' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: fs: - name: a - name: b session_timeout: 300 cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_shutdown_timeout: 120 global: ms die on skipped message: false mds: mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 filestore flush min: 0 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - overall HEALTH_ - \(MON_DOWN\) - SLOW_OPS - slow request sha1: 1843221895adccfb3b692060251dd6a0183bc410 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: cephfs_name: a client.1: cephfs_name: b install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: cephfs_name: a client.1: cephfs_name: b syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi090.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNT15L25I2uVUEhhXMUEr1r8CCalGoCRCBV1PrWYswhBDS7I3EBnSpRV3bGE0umVm5hiXAO9SQD7X+0QoxvOorI= smithi149.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBODHpOtvhb41YA9KZ5QGi0DWt9cjOoth9cagTCh/u3fgGOr1sBw9cHL5o2Nor9Pj5JjCudI9/x/UsNe7sBgiBrM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T03:02:19.874 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T03:02:19.875 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T03:02:19.875 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T03:02:19.876 INFO:teuthology.task.internal:Checking packages... 2024-09-21T03:02:19.899 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T03:02:19.899 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T03:02:19.899 INFO:teuthology.packaging:ref: None 2024-09-21T03:02:19.899 INFO:teuthology.packaging:tag: None 2024-09-21T03:02:19.899 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T03:02:19.899 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:02:19.900 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T03:02:20.050 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T03:02:20.052 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T03:02:20.060 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T03:02:20.060 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T03:02:20.098 INFO:teuthology.task.internal:Saving configuration 2024-09-21T03:02:20.120 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T03:02:20.128 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T03:02:20.152 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913454', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 02:56:32.330486', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNT15L25I2uVUEhhXMUEr1r8CCalGoCRCBV1PrWYswhBDS7I3EBnSpRV3bGE0umVm5hiXAO9SQD7X+0QoxvOorI='} 2024-09-21T03:02:20.172 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913454', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 02:56:32.329032', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBODHpOtvhb41YA9KZ5QGi0DWt9cjOoth9cagTCh/u3fgGOr1sBw9cHL5o2Nor9Pj5JjCudI9/x/UsNe7sBgiBrM='} 2024-09-21T03:02:20.172 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T03:02:20.189 INFO:teuthology.task.internal:roles: ubuntu@smithi090.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-09-21T03:02:20.189 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-09-21T03:02:20.189 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T03:02:20.340 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3a075f4160>, signals=[15]) 2024-09-21T03:02:20.340 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T03:02:20.347 INFO:teuthology.task.internal:Opening connections... 2024-09-21T03:02:20.347 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T03:02:20.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:02:20.426 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T03:02:20.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:02:20.500 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T03:02:20.507 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2024-09-21T03:02:20.525 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2024-09-21T03:02:20.526 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2024-09-21T03:02:20.584 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2024-09-21T03:02:20.584 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9" 2024-09-21T03:02:20.584 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2024-09-21T03:02:20.584 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2024-09-21T03:02:20.584 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9" 2024-09-21T03:02:20.584 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9" 2024-09-21T03:02:20.584 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T03:02:20.584 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2024-09-21T03:02:20.584 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon" 2024-09-21T03:02:20.585 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T03:02:20.585 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2024-09-21T03:02:20.585 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T03:02:20.585 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T03:02:20.585 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T03:02:20.585 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2024-09-21T03:02:20.610 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2024-09-21T03:02:20.628 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2024-09-21T03:02:20.629 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-09-21T03:02:20.686 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-09-21T03:02:20.686 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9" 2024-09-21T03:02:20.687 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-09-21T03:02:20.687 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-09-21T03:02:20.687 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9" 2024-09-21T03:02:20.687 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9" 2024-09-21T03:02:20.687 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T03:02:20.687 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-09-21T03:02:20.687 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon" 2024-09-21T03:02:20.687 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T03:02:20.687 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-09-21T03:02:20.687 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T03:02:20.687 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T03:02:20.687 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T03:02:20.688 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-09-21T03:02:20.710 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T03:02:20.721 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T03:02:20.749 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T03:02:20.749 DEBUG:teuthology.orchestra.run.smithi090:> test '!' -e /home/ubuntu/cephtest 2024-09-21T03:02:20.752 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2024-09-21T03:02:20.768 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T03:02:20.775 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T03:02:20.776 DEBUG:teuthology.orchestra.run.smithi090:> test -z $(ls -A /var/lib/ceph) 2024-09-21T03:02:20.810 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2024-09-21T03:02:20.899 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T03:02:20.957 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T03:02:20.976 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T03:02:20.976 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2024-09-21T03:02:20.977 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-21T03:02:20.977 DEBUG:teuthology.orchestra.run.smithi090:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T03:02:20.977 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T03:02:20.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:02:20.995 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-21T03:02:20.998 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:02:20.998 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-21T03:02:21.162 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T03:02:21.162 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-21T03:02:21.162 DEBUG:teuthology.orchestra.run.smithi090:> uname -r 2024-09-21T03:02:21.171 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T03:02:21.171 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-21T03:02:21.171 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-09-21T03:02:21.180 INFO:teuthology.orchestra.run.smithi090.stdout:5.14.0-503.el9.x86_64 2024-09-21T03:02:21.180 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T03:02:21.181 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-21T03:02:21.181 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum upgrade -y linux-firmware 2024-09-21T03:02:21.190 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-503.el9.x86_64 2024-09-21T03:02:21.191 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T03:02:21.191 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-21T03:02:21.191 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum upgrade -y linux-firmware 2024-09-21T03:02:24.809 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.3 MB 00:01 2024-09-21T03:02:26.468 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.3 MB 00:02 2024-09-21T03:02:28.380 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-21T03:02:32.890 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 6.5 MB 00:00 2024-09-21T03:02:34.308 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - Extras packages 100 kB/s | 19 kB 00:00 2024-09-21T03:02:35.562 INFO:teuthology.orchestra.run.smithi090.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-21T03:02:40.944 INFO:teuthology.orchestra.run.smithi090.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-21T03:02:42.943 INFO:teuthology.orchestra.run.smithi090.stdout:Dependencies resolved. 2024-09-21T03:02:42.956 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-09-21T03:02:42.956 INFO:teuthology.orchestra.run.smithi090.stdout: Package Architecture Version Repository Size 2024-09-21T03:02:42.956 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-09-21T03:02:42.956 INFO:teuthology.orchestra.run.smithi090.stdout:Upgrading: 2024-09-21T03:02:42.956 INFO:teuthology.orchestra.run.smithi090.stdout: linux-firmware noarch 20240905-146.el9 baseos 388 M 2024-09-21T03:02:42.956 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:02:42.956 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction Summary 2024-09-21T03:02:42.956 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-09-21T03:02:42.956 INFO:teuthology.orchestra.run.smithi090.stdout:Upgrade 1 Package 2024-09-21T03:02:42.956 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:02:42.957 INFO:teuthology.orchestra.run.smithi090.stdout:Total download size: 388 M 2024-09-21T03:02:42.957 INFO:teuthology.orchestra.run.smithi090.stdout:Downloading Packages: 2024-09-21T03:02:45.915 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 20 MB 00:20 2024-09-21T03:02:50.199 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-21T03:02:51.691 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 19 kB 00:00 2024-09-21T03:02:52.704 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-21T03:02:58.168 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-21T03:03:00.116 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T03:03:00.120 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T03:03:00.121 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-09-21T03:03:00.121 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T03:03:00.121 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2024-09-21T03:03:00.121 INFO:teuthology.orchestra.run.smithi149.stdout: linux-firmware noarch 20240905-146.el9 baseos 388 M 2024-09-21T03:03:00.121 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:03:00.121 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T03:03:00.121 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T03:03:00.121 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 1 Package 2024-09-21T03:03:00.121 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:03:00.121 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 388 M 2024-09-21T03:03:00.122 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T03:03:03.156 INFO:teuthology.orchestra.run.smithi090.stdout:linux-firmware-20240905-146.el9.noarch.rpm 19 MB/s | 388 MB 00:20 2024-09-21T03:03:03.156 INFO:teuthology.orchestra.run.smithi090.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:03:03.156 INFO:teuthology.orchestra.run.smithi090.stdout:Total 19 MB/s | 388 MB 00:20 2024-09-21T03:03:06.276 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction check 2024-09-21T03:03:06.400 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction check succeeded. 2024-09-21T03:03:06.400 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction test 2024-09-21T03:03:07.977 INFO:teuthology.orchestra.run.smithi149.stdout:linux-firmware-20240905-146.el9.noarch.rpm 50 MB/s | 388 MB 00:07 2024-09-21T03:03:07.978 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:03:07.978 INFO:teuthology.orchestra.run.smithi149.stdout:Total 49 MB/s | 388 MB 00:07 2024-09-21T03:03:09.637 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction test succeeded. 2024-09-21T03:03:09.637 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction 2024-09-21T03:03:11.098 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T03:03:11.206 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T03:03:11.206 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T03:03:14.491 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T03:03:14.492 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T03:03:21.071 INFO:teuthology.orchestra.run.smithi090.stdout: Preparing : 1/1 2024-09-21T03:03:21.238 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-21T03:03:21.319 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T03:03:21.816 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T03:03:21.816 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-21T03:03:22.609 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T03:03:22.609 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:03:22.609 INFO:teuthology.orchestra.run.smithi090.stdout:Upgraded: 2024-09-21T03:03:22.609 INFO:teuthology.orchestra.run.smithi090.stdout: linux-firmware-20240905-146.el9.noarch 2024-09-21T03:03:22.610 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:03:22.610 INFO:teuthology.orchestra.run.smithi090.stdout:Complete! 2024-09-21T03:03:23.031 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-21T03:03:23.032 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T03:03:23.182 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-21T03:03:23.182 DEBUG:teuthology.orchestra.run.smithi090:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-21T03:03:23.185 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi090.front.sepia.ceph.com to complete... 2024-09-21T03:03:23.836 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T03:03:24.420 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-21T03:03:24.492 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T03:03:25.248 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T03:03:25.248 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-21T03:03:25.987 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T03:03:25.987 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:03:25.987 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2024-09-21T03:03:25.987 INFO:teuthology.orchestra.run.smithi149.stdout: linux-firmware-20240905-146.el9.noarch 2024-09-21T03:03:25.987 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:03:25.987 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T03:03:26.349 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-21T03:03:26.349 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T03:03:26.495 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-21T03:03:26.495 DEBUG:teuthology.orchestra.run.smithi149:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-21T03:03:26.498 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi149.front.sepia.ceph.com to complete... 2024-09-21T03:03:31.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21 03:03:31 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-21T03:03:31.349 INFO:teuthology.orchestra.run.smithi090.stderr:FINISHED --2024-09-21 03:03:31-- 2024-09-21T03:03:31.349 INFO:teuthology.orchestra.run.smithi090.stderr:Total wall clock time: 8.1s 2024-09-21T03:03:31.349 INFO:teuthology.orchestra.run.smithi090.stderr:Downloaded: 1 files, 343M in 7.9s (43.7 MB/s) 2024-09-21T03:03:31.352 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-21T03:03:31.352 DEBUG:teuthology.orchestra.run.smithi090:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-21T03:03:33.406 INFO:teuthology.orchestra.run.smithi090.stdout:Verifying... ######################################## 2024-09-21T03:03:33.463 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing... ######################################## 2024-09-21T03:03:33.522 INFO:teuthology.orchestra.run.smithi090.stdout:Updating / installing... 2024-09-21T03:03:35.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21 03:03:35 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-21T03:03:35.462 INFO:teuthology.orchestra.run.smithi149.stderr:FINISHED --2024-09-21 03:03:35-- 2024-09-21T03:03:35.462 INFO:teuthology.orchestra.run.smithi149.stderr:Total wall clock time: 8.9s 2024-09-21T03:03:35.462 INFO:teuthology.orchestra.run.smithi149.stderr:Downloaded: 1 files, 343M in 8.5s (40.2 MB/s) 2024-09-21T03:03:35.465 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-21T03:03:35.465 DEBUG:teuthology.orchestra.run.smithi149:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-21T03:03:37.531 INFO:teuthology.orchestra.run.smithi149.stdout:Verifying... ######################################## 2024-09-21T03:03:37.601 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing... ######################################## 2024-09-21T03:03:37.661 INFO:teuthology.orchestra.run.smithi149.stdout:Updating / installing... 2024-09-21T03:03:41.471 INFO:teuthology.orchestra.run.smithi090.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-21T03:03:45.690 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-21T03:04:22.934 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi149.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-21T03:04:22.935 DEBUG:teuthology.orchestra.run.smithi149:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-21T03:04:23.012 INFO:teuthology.orchestra.run.smithi149.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:04:23.012 INFO:teuthology.orchestra.run.smithi149.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:04:23.012 INFO:teuthology.orchestra.run.smithi149.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:04:23.012 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:04:23.012 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-21T03:04:23.012 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-21T03:04:23.012 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-21T03:04:23.012 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-21T03:04:23.012 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-21T03:04:23.012 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-21T03:04:23.012 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-21T03:04:23.012 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-21T03:04:23.013 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-21T03:04:23.013 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-21T03:04:23.013 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-21T03:04:23.013 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-21T03:04:23.013 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-21T03:04:23.013 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-21T03:04:23.013 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-21T03:04:23.013 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-21T03:04:23.013 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-21T03:04:23.013 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-21T03:04:23.013 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-21T03:04:23.013 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-21T03:04:23.013 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-21T03:04:23.013 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-21T03:04:23.013 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-21T03:04:23.014 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-21T03:04:23.014 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-21T03:04:23.014 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-21T03:04:23.014 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-21T03:04:23.014 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-21T03:04:23.014 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-21T03:04:23.014 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-21T03:04:23.014 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-21T03:04:23.014 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-21T03:04:23.014 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-21T03:04:23.014 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-21T03:04:23.014 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-21T03:04:23.014 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-21T03:04:23.014 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-21T03:04:23.015 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-21T03:04:23.015 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-21T03:04:23.015 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-21T03:04:23.015 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-21T03:04:23.015 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-21T03:04:23.015 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-21T03:04:23.015 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-21T03:04:23.015 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-21T03:04:23.015 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-21T03:04:23.015 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-21T03:04:23.015 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-21T03:04:23.015 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-21T03:04:23.015 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-21T03:04:23.015 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-21T03:04:23.015 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-21T03:04:23.016 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-21T03:04:23.016 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-21T03:04:23.016 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-21T03:04:23.016 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-21T03:04:23.016 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-21T03:04:23.016 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-21T03:04:23.016 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-21T03:04:23.016 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-21T03:04:23.016 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-21T03:04:23.016 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-21T03:04:23.016 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-21T03:04:23.016 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-21T03:04:23.016 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-21T03:04:23.016 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-21T03:04:23.016 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-21T03:04:23.017 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-21T03:04:23.017 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-21T03:04:23.017 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-21T03:04:23.017 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-21T03:04:23.017 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-21T03:04:23.017 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-21T03:04:23.017 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-21T03:04:23.017 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-21T03:04:23.017 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-21T03:04:23.017 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-21T03:04:23.017 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-21T03:04:23.017 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-21T03:04:23.017 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-21T03:04:23.017 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-21T03:04:23.017 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-21T03:04:23.017 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-21T03:04:23.018 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-21T03:04:23.018 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-21T03:04:23.018 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-21T03:04:23.018 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-21T03:04:23.018 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-21T03:04:23.018 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-21T03:04:23.018 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-21T03:04:23.018 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-21T03:04:23.018 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-21T03:04:23.018 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-21T03:04:23.018 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-21T03:04:23.018 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-21T03:04:23.018 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-21T03:04:23.018 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-21T03:04:23.018 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-21T03:04:23.019 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-21T03:04:23.019 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-21T03:04:23.019 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-21T03:04:23.019 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-21T03:04:23.019 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-21T03:04:23.019 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-21T03:04:23.019 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-21T03:04:23.019 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-21T03:04:23.019 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-21T03:04:23.019 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-21T03:04:23.019 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-21T03:04:23.019 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-21T03:04:23.019 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-21T03:04:23.019 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-21T03:04:23.019 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-21T03:04:23.020 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-21T03:04:23.020 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-21T03:04:23.020 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-21T03:04:23.020 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-21T03:04:23.020 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-21T03:04:23.020 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-21T03:04:23.020 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-21T03:04:23.020 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-21T03:04:23.020 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-21T03:04:23.020 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-21T03:04:23.020 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-21T03:04:23.020 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-21T03:04:23.020 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-21T03:04:23.020 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-21T03:04:23.020 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-21T03:04:23.020 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-21T03:04:23.021 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-21T03:04:23.021 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-21T03:04:23.021 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-21T03:04:23.021 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-21T03:04:23.021 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-21T03:04:23.021 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-21T03:04:23.021 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-21T03:04:23.021 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-21T03:04:23.021 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-21T03:04:23.021 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-21T03:04:23.021 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-21T03:04:23.021 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-21T03:04:23.021 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-21T03:04:23.021 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-21T03:04:23.021 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-21T03:04:23.021 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-21T03:04:23.022 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-21T03:04:23.022 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-21T03:04:23.022 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-21T03:04:23.022 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-21T03:04:23.022 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-21T03:04:23.022 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-21T03:04:23.022 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-21T03:04:23.022 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-21T03:04:23.022 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-21T03:04:23.022 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-21T03:04:23.022 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-21T03:04:23.022 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-21T03:04:23.022 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-21T03:04:23.022 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-21T03:04:23.023 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-21T03:04:23.023 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-21T03:04:23.023 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-21T03:04:23.023 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-21T03:04:23.023 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-21T03:04:23.023 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-21T03:04:23.023 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-21T03:04:23.023 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-21T03:04:23.023 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-21T03:04:23.023 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-21T03:04:23.023 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-21T03:04:23.023 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-21T03:04:23.023 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-21T03:04:23.023 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-21T03:04:23.023 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-21T03:04:23.024 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-21T03:04:23.024 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-21T03:04:23.024 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-21T03:04:23.024 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-21T03:04:23.024 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-21T03:04:23.024 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-21T03:04:23.024 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-21T03:04:23.024 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-21T03:04:23.024 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-21T03:04:23.024 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-21T03:04:23.024 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-21T03:04:23.024 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-21T03:04:23.024 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-21T03:04:23.024 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-21T03:04:23.024 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-21T03:04:23.024 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-21T03:04:23.025 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-21T03:04:23.025 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-21T03:04:23.025 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-21T03:04:23.025 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-21T03:04:23.025 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-21T03:04:23.025 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-21T03:04:23.025 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-21T03:04:23.025 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-21T03:04:23.025 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-21T03:04:23.025 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-21T03:04:23.025 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-21T03:04:23.025 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-21T03:04:23.025 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-21T03:04:23.025 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-21T03:04:23.025 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-21T03:04:23.025 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-21T03:04:23.026 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-21T03:04:23.026 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-21T03:04:23.026 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-21T03:04:23.026 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-21T03:04:23.026 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-21T03:04:23.026 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-21T03:04:23.026 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-21T03:04:23.026 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-21T03:04:23.026 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-21T03:04:23.026 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-21T03:04:23.026 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-21T03:04:23.026 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-21T03:04:23.026 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-21T03:04:23.026 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-21T03:04:23.026 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-21T03:04:23.027 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-21T03:04:23.027 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-21T03:04:23.027 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-21T03:04:23.027 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-21T03:04:23.027 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-21T03:04:23.027 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-21T03:04:23.027 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-21T03:04:23.027 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-21T03:04:23.027 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-21T03:04:23.027 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-21T03:04:23.027 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-21T03:04:23.027 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-21T03:04:23.027 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-21T03:04:23.027 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-21T03:04:23.027 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-21T03:04:23.028 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-21T03:04:23.028 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-21T03:04:23.028 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-21T03:04:23.028 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-21T03:04:23.028 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-21T03:04:23.028 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-21T03:04:23.028 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-21T03:04:23.028 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-21T03:04:23.028 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-21T03:04:23.028 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-21T03:04:23.028 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-21T03:04:23.028 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-21T03:04:23.028 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-21T03:04:23.028 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-21T03:04:23.028 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-21T03:04:23.028 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-21T03:04:23.029 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-21T03:04:23.029 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-21T03:04:23.029 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-21T03:04:23.029 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-21T03:04:23.029 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-21T03:04:23.029 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-21T03:04:23.029 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-21T03:04:23.029 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-21T03:04:23.029 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-21T03:04:23.029 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-21T03:04:23.029 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-21T03:04:23.029 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-21T03:04:23.029 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-21T03:04:23.029 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-21T03:04:23.029 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-21T03:04:23.029 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-21T03:04:23.030 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-21T03:04:23.030 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-21T03:04:23.030 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-21T03:04:23.030 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-21T03:04:23.030 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-21T03:04:23.030 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-21T03:04:23.030 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-21T03:04:23.030 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-21T03:04:23.030 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-21T03:04:23.030 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-21T03:04:23.030 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-21T03:04:23.030 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-21T03:04:23.030 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-21T03:04:23.031 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-21T03:04:23.031 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-21T03:04:23.031 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-21T03:04:23.031 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-21T03:04:23.031 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-21T03:04:23.031 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-21T03:04:23.031 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-21T03:04:23.031 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-21T03:04:23.031 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-21T03:04:23.031 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-21T03:04:23.031 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-21T03:04:23.031 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-21T03:04:23.031 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-21T03:04:23.031 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-21T03:04:23.031 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-21T03:04:23.032 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-21T03:04:23.032 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-21T03:04:23.032 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-21T03:04:23.032 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-21T03:04:23.032 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-21T03:04:23.032 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-21T03:04:23.032 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-21T03:04:23.032 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-21T03:04:23.032 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-21T03:04:23.032 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-21T03:04:23.032 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-21T03:04:23.032 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-21T03:04:23.032 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-21T03:04:23.032 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-21T03:04:23.032 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-21T03:04:23.032 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-21T03:04:23.033 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-21T03:04:23.033 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-21T03:04:23.033 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-21T03:04:23.033 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-21T03:04:23.033 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-21T03:04:23.033 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-21T03:04:23.033 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-21T03:04:23.033 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-21T03:04:23.033 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-21T03:04:23.033 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-21T03:04:23.033 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-21T03:04:23.033 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-21T03:04:23.033 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-21T03:04:23.033 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-21T03:04:23.033 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-21T03:04:23.033 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-21T03:04:23.034 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-21T03:04:23.034 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-21T03:04:23.034 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-21T03:04:23.034 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-21T03:04:23.034 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-21T03:04:23.034 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-21T03:04:23.034 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-21T03:04:23.034 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-21T03:04:23.034 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-21T03:04:23.034 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-21T03:04:23.034 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-21T03:04:23.034 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-21T03:04:23.034 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-21T03:04:23.034 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-21T03:04:23.034 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-21T03:04:23.035 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-21T03:04:23.035 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-21T03:04:23.035 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-21T03:04:23.035 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-21T03:04:23.035 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-21T03:04:23.035 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-21T03:04:23.035 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-21T03:04:23.035 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-21T03:04:23.035 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-21T03:04:23.035 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-21T03:04:23.035 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-21T03:04:23.035 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-21T03:04:23.035 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-21T03:04:23.035 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-21T03:04:23.035 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-21T03:04:23.036 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-21T03:04:23.036 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-21T03:04:23.036 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-21T03:04:23.036 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-21T03:04:23.036 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-21T03:04:23.036 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-21T03:04:23.036 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-21T03:04:23.036 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-21T03:04:23.036 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-21T03:04:23.036 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-21T03:04:23.036 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-21T03:04:23.036 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-21T03:04:23.036 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-21T03:04:23.036 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-21T03:04:23.036 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-21T03:04:23.036 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-21T03:04:23.037 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-21T03:04:23.037 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-21T03:04:23.037 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-21T03:04:23.037 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-21T03:04:23.037 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-21T03:04:23.037 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-21T03:04:23.037 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-21T03:04:23.037 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-21T03:04:23.037 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-21T03:04:23.037 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-21T03:04:23.037 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-21T03:04:23.037 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-21T03:04:23.037 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-21T03:04:23.037 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-21T03:04:23.037 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-21T03:04:23.037 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-21T03:04:23.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-21T03:04:23.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-21T03:04:23.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-21T03:04:23.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-21T03:04:23.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-21T03:04:23.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-21T03:04:23.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-21T03:04:23.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-21T03:04:23.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-21T03:04:23.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-21T03:04:23.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-21T03:04:23.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-21T03:04:23.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-21T03:04:23.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-21T03:04:23.038 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-21T03:04:23.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-21T03:04:23.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-21T03:04:23.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-21T03:04:23.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-21T03:04:23.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-21T03:04:23.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-21T03:04:23.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-21T03:04:23.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-21T03:04:23.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-21T03:04:23.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-21T03:04:23.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-21T03:04:23.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-21T03:04:23.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-21T03:04:23.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-21T03:04:23.039 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-21T03:04:23.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-21T03:04:23.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-21T03:04:23.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-21T03:04:23.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-21T03:04:23.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-21T03:04:23.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-21T03:04:23.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-21T03:04:23.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-21T03:04:23.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-21T03:04:23.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-21T03:04:23.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-21T03:04:23.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-21T03:04:23.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-21T03:04:23.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-21T03:04:23.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-21T03:04:23.040 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-21T03:04:23.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-21T03:04:23.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-21T03:04:23.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-21T03:04:23.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-21T03:04:23.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-21T03:04:23.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-21T03:04:23.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-21T03:04:23.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-21T03:04:23.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-21T03:04:23.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-21T03:04:23.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-21T03:04:23.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-21T03:04:23.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-21T03:04:23.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-21T03:04:23.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-21T03:04:23.041 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-21T03:04:23.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-21T03:04:23.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-21T03:04:23.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-21T03:04:23.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-21T03:04:23.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-21T03:04:23.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-21T03:04:23.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-21T03:04:23.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-21T03:04:23.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-21T03:04:23.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-21T03:04:23.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-21T03:04:23.042 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-21T03:04:23.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-21T03:04:23.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-21T03:04:23.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-21T03:04:23.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-21T03:04:23.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-21T03:04:23.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-21T03:04:23.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-21T03:04:23.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-21T03:04:23.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-21T03:04:23.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-21T03:04:23.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-21T03:04:23.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-21T03:04:23.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-21T03:04:23.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-21T03:04:23.043 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-21T03:04:23.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-21T03:04:23.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-21T03:04:23.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-21T03:04:23.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-21T03:04:23.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-21T03:04:23.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-21T03:04:23.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-21T03:04:23.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-21T03:04:23.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-21T03:04:23.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-21T03:04:23.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-21T03:04:23.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-21T03:04:23.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-21T03:04:23.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-21T03:04:23.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-21T03:04:23.044 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-21T03:04:23.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-21T03:04:23.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-21T03:04:23.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-21T03:04:23.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-21T03:04:23.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-21T03:04:23.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-21T03:04:23.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-21T03:04:23.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-21T03:04:23.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-21T03:04:23.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-21T03:04:23.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-21T03:04:23.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-21T03:04:23.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-21T03:04:23.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-21T03:04:23.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-21T03:04:23.045 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-21T03:04:23.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-21T03:04:23.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-21T03:04:23.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-21T03:04:23.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-21T03:04:23.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-21T03:04:23.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-21T03:04:23.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-21T03:04:23.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-21T03:04:23.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-21T03:04:23.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-21T03:04:23.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-21T03:04:23.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-21T03:04:23.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-21T03:04:23.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-21T03:04:23.046 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-21T03:04:23.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-21T03:04:23.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-21T03:04:23.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-21T03:04:23.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-21T03:04:23.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-21T03:04:23.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-21T03:04:23.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-21T03:04:23.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-21T03:04:23.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-21T03:04:23.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-21T03:04:23.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-21T03:04:23.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-21T03:04:23.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-21T03:04:23.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-21T03:04:23.047 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-21T03:04:23.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-21T03:04:23.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-21T03:04:23.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-21T03:04:23.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-21T03:04:23.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-21T03:04:23.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-21T03:04:23.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-21T03:04:23.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-21T03:04:23.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-21T03:04:23.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-21T03:04:23.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-21T03:04:23.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-21T03:04:23.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-21T03:04:23.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-21T03:04:23.048 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-21T03:04:23.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-21T03:04:23.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-21T03:04:23.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-21T03:04:23.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-21T03:04:23.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-21T03:04:23.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-21T03:04:23.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-21T03:04:23.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-21T03:04:23.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-21T03:04:23.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-21T03:04:23.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-21T03:04:23.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-21T03:04:23.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-21T03:04:23.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-21T03:04:23.049 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-21T03:04:23.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-21T03:04:23.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-21T03:04:23.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-21T03:04:23.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-21T03:04:23.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-21T03:04:23.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-21T03:04:23.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-21T03:04:23.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-21T03:04:23.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-21T03:04:23.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-21T03:04:23.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-21T03:04:23.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-21T03:04:23.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-21T03:04:23.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-21T03:04:23.050 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-21T03:04:23.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-21T03:04:23.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-21T03:04:23.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-21T03:04:23.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-21T03:04:23.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-21T03:04:23.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-21T03:04:23.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-21T03:04:23.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-21T03:04:23.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-21T03:04:23.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-21T03:04:23.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-21T03:04:23.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-21T03:04:23.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-21T03:04:23.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-21T03:04:23.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-21T03:04:23.051 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-21T03:04:23.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-21T03:04:23.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-21T03:04:23.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-21T03:04:23.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-21T03:04:23.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-21T03:04:23.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-21T03:04:23.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-21T03:04:23.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-21T03:04:23.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-21T03:04:23.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-21T03:04:23.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-21T03:04:23.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-21T03:04:23.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-21T03:04:23.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-21T03:04:23.052 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-21T03:04:23.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-21T03:04:23.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-21T03:04:23.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-21T03:04:23.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-21T03:04:23.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-21T03:04:23.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-21T03:04:23.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-21T03:04:23.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-21T03:04:23.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-21T03:04:23.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-21T03:04:23.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-21T03:04:23.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-21T03:04:23.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-21T03:04:23.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-21T03:04:23.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-21T03:04:23.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-21T03:04:23.053 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-21T03:04:23.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-21T03:04:23.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-21T03:04:23.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-21T03:04:23.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-21T03:04:23.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-21T03:04:23.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-21T03:04:23.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-21T03:04:23.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-21T03:04:23.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-21T03:04:23.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-21T03:04:23.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-21T03:04:23.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-21T03:04:23.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-21T03:04:23.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-21T03:04:23.054 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-21T03:04:23.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-21T03:04:23.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-21T03:04:23.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-21T03:04:23.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-21T03:04:23.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-21T03:04:23.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-21T03:04:23.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-21T03:04:23.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-21T03:04:23.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-21T03:04:23.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-21T03:04:23.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-21T03:04:23.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-21T03:04:23.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-21T03:04:23.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-21T03:04:23.055 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-21T03:04:23.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-21T03:04:23.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-21T03:04:23.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-21T03:04:23.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-21T03:04:23.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-21T03:04:23.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-21T03:04:23.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-21T03:04:23.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-21T03:04:23.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-21T03:04:23.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-21T03:04:23.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-21T03:04:23.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-21T03:04:23.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-21T03:04:23.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-21T03:04:23.056 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-21T03:04:23.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-21T03:04:23.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-21T03:04:23.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-21T03:04:23.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-21T03:04:23.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-21T03:04:23.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-21T03:04:23.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-21T03:04:23.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-21T03:04:23.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-21T03:04:23.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-21T03:04:23.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-21T03:04:23.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-21T03:04:23.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-21T03:04:23.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-21T03:04:23.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-21T03:04:23.057 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-21T03:04:23.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-21T03:04:23.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-21T03:04:23.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-21T03:04:23.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-21T03:04:23.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-21T03:04:23.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-21T03:04:23.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-21T03:04:23.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-21T03:04:23.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-21T03:04:23.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-21T03:04:23.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-21T03:04:23.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-21T03:04:23.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-21T03:04:23.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-21T03:04:23.058 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-21T03:04:23.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-21T03:04:23.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-21T03:04:23.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-21T03:04:23.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-21T03:04:23.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-21T03:04:23.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-21T03:04:23.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-21T03:04:23.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-21T03:04:23.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-21T03:04:23.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-21T03:04:23.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-21T03:04:23.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-21T03:04:23.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-21T03:04:23.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-21T03:04:23.059 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-21T03:04:23.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-21T03:04:23.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-21T03:04:23.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-21T03:04:23.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-21T03:04:23.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-21T03:04:23.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-21T03:04:23.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-21T03:04:23.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-21T03:04:23.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-21T03:04:23.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-21T03:04:23.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-21T03:04:23.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-21T03:04:23.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-21T03:04:23.060 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-21T03:04:23.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-21T03:04:23.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-21T03:04:23.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-21T03:04:23.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-21T03:04:23.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-21T03:04:23.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-21T03:04:23.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-21T03:04:23.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-21T03:04:23.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-21T03:04:23.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-21T03:04:23.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-21T03:04:23.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-21T03:04:23.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-21T03:04:23.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-21T03:04:23.061 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-21T03:04:23.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-21T03:04:23.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-21T03:04:23.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-21T03:04:23.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-21T03:04:23.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-21T03:04:23.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-21T03:04:23.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-21T03:04:23.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-21T03:04:23.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-21T03:04:23.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-21T03:04:23.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-21T03:04:23.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-21T03:04:23.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-21T03:04:23.062 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-21T03:04:23.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-21T03:04:23.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-21T03:04:23.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-21T03:04:23.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-21T03:04:23.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-21T03:04:23.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-21T03:04:23.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-21T03:04:23.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-21T03:04:23.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-21T03:04:23.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-21T03:04:23.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-21T03:04:23.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-21T03:04:23.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-21T03:04:23.063 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-21T03:04:23.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-21T03:04:23.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-21T03:04:23.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-21T03:04:23.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-21T03:04:23.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-21T03:04:23.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-21T03:04:23.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-21T03:04:23.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-21T03:04:23.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-21T03:04:23.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-21T03:04:23.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-21T03:04:23.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-21T03:04:23.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-21T03:04:23.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-21T03:04:23.064 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-21T03:04:23.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-21T03:04:23.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-21T03:04:23.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-21T03:04:23.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-21T03:04:23.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-21T03:04:23.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-21T03:04:23.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-21T03:04:23.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-21T03:04:23.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-21T03:04:23.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-21T03:04:23.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-21T03:04:23.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-21T03:04:23.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-21T03:04:23.065 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-21T03:04:23.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-21T03:04:23.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-21T03:04:23.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-21T03:04:23.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-21T03:04:23.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-21T03:04:23.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-21T03:04:23.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-21T03:04:23.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-21T03:04:23.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-21T03:04:23.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-21T03:04:23.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-21T03:04:23.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-21T03:04:23.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-21T03:04:23.066 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-21T03:04:23.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-21T03:04:23.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-21T03:04:23.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-21T03:04:23.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-21T03:04:23.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-21T03:04:23.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-21T03:04:23.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-21T03:04:23.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-21T03:04:23.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-21T03:04:23.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-21T03:04:23.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-21T03:04:23.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-21T03:04:23.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-21T03:04:23.067 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-21T03:04:23.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-21T03:04:23.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-21T03:04:23.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-21T03:04:23.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-21T03:04:23.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-21T03:04:23.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-21T03:04:23.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-21T03:04:23.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-21T03:04:23.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-21T03:04:23.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-21T03:04:23.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-21T03:04:23.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-21T03:04:23.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-21T03:04:23.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-21T03:04:23.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-21T03:04:23.068 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-21T03:04:23.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-21T03:04:23.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-21T03:04:23.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-21T03:04:23.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-21T03:04:23.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-21T03:04:23.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-21T03:04:23.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-21T03:04:23.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-21T03:04:23.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-21T03:04:23.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-21T03:04:23.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-21T03:04:23.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-21T03:04:23.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-21T03:04:23.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-21T03:04:23.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-21T03:04:23.069 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-21T03:04:23.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-21T03:04:23.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-21T03:04:23.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-21T03:04:23.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-21T03:04:23.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-21T03:04:23.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-21T03:04:23.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-21T03:04:23.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-21T03:04:23.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-21T03:04:23.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-21T03:04:23.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-21T03:04:23.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-21T03:04:23.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-21T03:04:23.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-21T03:04:23.070 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-21T03:04:23.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-21T03:04:23.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-21T03:04:23.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-21T03:04:23.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-21T03:04:23.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-21T03:04:23.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-21T03:04:23.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-21T03:04:23.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-21T03:04:23.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-21T03:04:23.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-21T03:04:23.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-21T03:04:23.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-21T03:04:23.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-21T03:04:23.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-21T03:04:23.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-21T03:04:23.071 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-21T03:04:23.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-21T03:04:23.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-21T03:04:23.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-21T03:04:23.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-21T03:04:23.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-21T03:04:23.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-21T03:04:23.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-21T03:04:23.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-21T03:04:23.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-21T03:04:23.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-21T03:04:23.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-21T03:04:23.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-21T03:04:23.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-21T03:04:23.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-21T03:04:23.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-21T03:04:23.072 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-21T03:04:23.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-21T03:04:23.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-21T03:04:23.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-21T03:04:23.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-21T03:04:23.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-21T03:04:23.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-21T03:04:23.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-21T03:04:23.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-21T03:04:23.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-21T03:04:23.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-21T03:04:23.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-21T03:04:23.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-21T03:04:23.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-21T03:04:23.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-21T03:04:23.073 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-21T03:04:23.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-21T03:04:23.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-21T03:04:23.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-21T03:04:23.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-21T03:04:23.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-21T03:04:23.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-21T03:04:23.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-21T03:04:23.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-21T03:04:23.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-21T03:04:23.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-21T03:04:23.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-21T03:04:23.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-21T03:04:23.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-21T03:04:23.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-21T03:04:23.074 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-21T03:04:23.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-21T03:04:23.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-21T03:04:23.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-21T03:04:23.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-21T03:04:23.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-21T03:04:23.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-21T03:04:23.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-21T03:04:23.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-21T03:04:23.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-21T03:04:23.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-21T03:04:23.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-21T03:04:23.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-21T03:04:23.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-21T03:04:23.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-21T03:04:23.075 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-21T03:04:23.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-21T03:04:23.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-21T03:04:23.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-21T03:04:23.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-21T03:04:23.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-21T03:04:23.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-21T03:04:23.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-21T03:04:23.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-21T03:04:23.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-21T03:04:23.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-21T03:04:23.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-21T03:04:23.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-21T03:04:23.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-21T03:04:23.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-21T03:04:23.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-21T03:04:23.076 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-21T03:04:23.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-21T03:04:23.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-21T03:04:23.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-21T03:04:23.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-21T03:04:23.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-21T03:04:23.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-21T03:04:23.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-21T03:04:23.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-21T03:04:23.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-21T03:04:23.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-21T03:04:23.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-21T03:04:23.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-21T03:04:23.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-21T03:04:23.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-21T03:04:23.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-21T03:04:23.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-21T03:04:23.077 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-21T03:04:23.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-21T03:04:23.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-21T03:04:23.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-21T03:04:23.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-21T03:04:23.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-21T03:04:23.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-21T03:04:23.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-21T03:04:23.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-21T03:04:23.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-21T03:04:23.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-21T03:04:23.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-21T03:04:23.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-21T03:04:23.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-21T03:04:23.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-21T03:04:23.078 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-21T03:04:23.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-21T03:04:23.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-21T03:04:23.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-21T03:04:23.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-21T03:04:23.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-21T03:04:23.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-21T03:04:23.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-21T03:04:23.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-21T03:04:23.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-21T03:04:23.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-21T03:04:23.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-21T03:04:23.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-21T03:04:23.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-21T03:04:23.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-21T03:04:23.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-21T03:04:23.079 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-21T03:04:23.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-21T03:04:23.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-21T03:04:23.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-21T03:04:23.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-21T03:04:23.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-21T03:04:23.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-21T03:04:23.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-21T03:04:23.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-21T03:04:23.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-21T03:04:23.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-21T03:04:23.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-21T03:04:23.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-21T03:04:23.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-21T03:04:23.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-21T03:04:23.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-21T03:04:23.080 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-21T03:04:23.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-21T03:04:23.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-21T03:04:23.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-21T03:04:23.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-21T03:04:23.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-21T03:04:23.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-21T03:04:23.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-21T03:04:23.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-21T03:04:23.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-21T03:04:23.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-21T03:04:23.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-21T03:04:23.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-21T03:04:23.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-21T03:04:23.081 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-21T03:04:23.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-21T03:04:23.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-21T03:04:23.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-21T03:04:23.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-21T03:04:23.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-21T03:04:23.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-21T03:04:23.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-21T03:04:23.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-21T03:04:23.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-21T03:04:23.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-21T03:04:23.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-21T03:04:23.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-21T03:04:23.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-21T03:04:23.082 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-21T03:04:23.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-21T03:04:23.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-21T03:04:23.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-21T03:04:23.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-21T03:04:23.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-21T03:04:23.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-21T03:04:23.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-21T03:04:23.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-21T03:04:23.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-21T03:04:23.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-21T03:04:23.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-21T03:04:23.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-21T03:04:23.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-21T03:04:23.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-21T03:04:23.083 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-21T03:04:23.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-21T03:04:23.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-21T03:04:23.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-21T03:04:23.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-21T03:04:23.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-21T03:04:23.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-21T03:04:23.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-21T03:04:23.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-21T03:04:23.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-21T03:04:23.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-21T03:04:23.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-21T03:04:23.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-21T03:04:23.084 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-21T03:04:23.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-21T03:04:23.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-21T03:04:23.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-21T03:04:23.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-21T03:04:23.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-21T03:04:23.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-21T03:04:23.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-21T03:04:23.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-21T03:04:23.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-21T03:04:23.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-21T03:04:23.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-21T03:04:23.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-21T03:04:23.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-21T03:04:23.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-21T03:04:23.085 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-21T03:04:23.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-21T03:04:23.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-21T03:04:23.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-21T03:04:23.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-21T03:04:23.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-21T03:04:23.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-21T03:04:23.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-21T03:04:23.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-21T03:04:23.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-21T03:04:23.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-21T03:04:23.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-21T03:04:23.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-21T03:04:23.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-21T03:04:23.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-21T03:04:23.086 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-21T03:04:23.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-21T03:04:23.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-21T03:04:23.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-21T03:04:23.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-21T03:04:23.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-21T03:04:23.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-21T03:04:23.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-21T03:04:23.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-21T03:04:23.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-21T03:04:23.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-21T03:04:23.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-21T03:04:23.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-21T03:04:23.087 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-21T03:04:23.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-21T03:04:23.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-21T03:04:23.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-21T03:04:23.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-21T03:04:23.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-21T03:04:23.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-21T03:04:23.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-21T03:04:23.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-21T03:04:23.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-21T03:04:23.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-21T03:04:23.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-21T03:04:23.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-21T03:04:23.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-21T03:04:23.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-21T03:04:23.088 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-21T03:04:23.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-21T03:04:23.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-21T03:04:23.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-21T03:04:23.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-21T03:04:23.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-21T03:04:23.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-21T03:04:23.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-21T03:04:23.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-21T03:04:23.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-21T03:04:23.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-21T03:04:23.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-21T03:04:23.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-21T03:04:23.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-21T03:04:23.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-21T03:04:23.089 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-21T03:04:23.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-21T03:04:23.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-21T03:04:23.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-21T03:04:23.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-21T03:04:23.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-21T03:04:23.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-21T03:04:23.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-21T03:04:23.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-21T03:04:23.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-21T03:04:23.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-21T03:04:23.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-21T03:04:23.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-21T03:04:23.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-21T03:04:23.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-21T03:04:23.090 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-21T03:04:23.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-21T03:04:23.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-21T03:04:23.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-21T03:04:23.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-21T03:04:23.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-21T03:04:23.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-21T03:04:23.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-21T03:04:23.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-21T03:04:23.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-21T03:04:23.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-21T03:04:23.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-21T03:04:23.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-21T03:04:23.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-21T03:04:23.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-21T03:04:23.091 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-21T03:04:23.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-21T03:04:23.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-21T03:04:23.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-21T03:04:23.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-21T03:04:23.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-21T03:04:23.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-21T03:04:23.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-21T03:04:23.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-21T03:04:23.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-21T03:04:23.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-21T03:04:23.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-21T03:04:23.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-21T03:04:23.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-21T03:04:23.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-21T03:04:23.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-21T03:04:23.092 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-21T03:04:23.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-21T03:04:23.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-21T03:04:23.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-21T03:04:23.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-21T03:04:23.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-21T03:04:23.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-21T03:04:23.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-21T03:04:23.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-21T03:04:23.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-21T03:04:23.093 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-21T03:04:23.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-21T03:04:23.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-21T03:04:23.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-21T03:04:23.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-21T03:04:23.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-21T03:04:23.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-21T03:04:23.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-21T03:04:23.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-21T03:04:23.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-21T03:04:23.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-21T03:04:23.094 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-21T03:04:23.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-21T03:04:23.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-21T03:04:23.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-21T03:04:23.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-21T03:04:23.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-21T03:04:23.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-21T03:04:23.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-21T03:04:23.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-21T03:04:23.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-21T03:04:23.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-21T03:04:23.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-21T03:04:23.095 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-21T03:04:23.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-21T03:04:23.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-21T03:04:23.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-21T03:04:23.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-21T03:04:23.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-21T03:04:23.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-21T03:04:23.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-21T03:04:23.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-21T03:04:23.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-21T03:04:23.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-21T03:04:23.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-21T03:04:23.096 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-21T03:04:23.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-21T03:04:23.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-21T03:04:23.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-21T03:04:23.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-21T03:04:23.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-21T03:04:23.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-21T03:04:23.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-21T03:04:23.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-21T03:04:23.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-21T03:04:23.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-21T03:04:23.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-21T03:04:23.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-21T03:04:23.097 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-21T03:04:23.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-21T03:04:23.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-21T03:04:23.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-21T03:04:23.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-21T03:04:23.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-21T03:04:23.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-21T03:04:23.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-21T03:04:23.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-21T03:04:23.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-21T03:04:23.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-21T03:04:23.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-21T03:04:23.098 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-21T03:04:23.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-21T03:04:23.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-21T03:04:23.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-21T03:04:23.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-21T03:04:23.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-21T03:04:23.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-21T03:04:23.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-21T03:04:23.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-21T03:04:23.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-21T03:04:23.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-21T03:04:23.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-21T03:04:23.099 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-21T03:04:23.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-21T03:04:23.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-21T03:04:23.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-21T03:04:23.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-21T03:04:23.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-21T03:04:23.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-21T03:04:23.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-21T03:04:23.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-21T03:04:23.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-21T03:04:23.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-21T03:04:23.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-21T03:04:23.100 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-21T03:04:23.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-21T03:04:23.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-21T03:04:23.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-21T03:04:23.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-21T03:04:23.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-21T03:04:23.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-21T03:04:23.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-21T03:04:23.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-21T03:04:23.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-21T03:04:23.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-21T03:04:23.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-21T03:04:23.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-21T03:04:23.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-21T03:04:23.101 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-21T03:04:23.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-21T03:04:23.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-21T03:04:23.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-21T03:04:23.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-21T03:04:23.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-21T03:04:23.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-21T03:04:23.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-21T03:04:23.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-21T03:04:23.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-21T03:04:23.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-21T03:04:23.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-21T03:04:23.102 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-21T03:04:23.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-21T03:04:23.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-21T03:04:23.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-21T03:04:23.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-21T03:04:23.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-21T03:04:23.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-21T03:04:23.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-21T03:04:23.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-21T03:04:23.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-21T03:04:23.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-21T03:04:23.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-21T03:04:23.103 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-21T03:04:23.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-21T03:04:23.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-21T03:04:23.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-21T03:04:23.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-21T03:04:23.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-21T03:04:23.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-21T03:04:23.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-21T03:04:23.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-21T03:04:23.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-21T03:04:23.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-21T03:04:23.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-21T03:04:23.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-21T03:04:23.104 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-21T03:04:23.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-21T03:04:23.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-21T03:04:23.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-21T03:04:23.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-21T03:04:23.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-21T03:04:23.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-21T03:04:23.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-21T03:04:23.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-21T03:04:23.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-21T03:04:23.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-21T03:04:23.105 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-21T03:04:23.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-21T03:04:23.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-21T03:04:23.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-21T03:04:23.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-21T03:04:23.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-21T03:04:23.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-21T03:04:23.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-21T03:04:23.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-21T03:04:23.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-21T03:04:23.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-21T03:04:23.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-21T03:04:23.106 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-21T03:04:23.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-21T03:04:23.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-21T03:04:23.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-21T03:04:23.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-21T03:04:23.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-21T03:04:23.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-21T03:04:23.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-21T03:04:23.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-21T03:04:23.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-21T03:04:23.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-21T03:04:23.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-21T03:04:23.107 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-21T03:04:23.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-21T03:04:23.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-21T03:04:23.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-21T03:04:23.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-21T03:04:23.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-21T03:04:23.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-21T03:04:23.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-21T03:04:23.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-21T03:04:23.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-21T03:04:23.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-21T03:04:23.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-21T03:04:23.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-21T03:04:23.108 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-21T03:04:23.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-21T03:04:23.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-21T03:04:23.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-21T03:04:23.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-21T03:04:23.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-21T03:04:23.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-21T03:04:23.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-21T03:04:23.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-21T03:04:23.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-21T03:04:23.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-21T03:04:23.109 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-21T03:04:23.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-21T03:04:23.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-21T03:04:23.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-21T03:04:23.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-21T03:04:23.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-21T03:04:23.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-21T03:04:23.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-21T03:04:23.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-21T03:04:23.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-21T03:04:23.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-21T03:04:23.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-21T03:04:23.110 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-21T03:04:23.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-21T03:04:23.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-21T03:04:23.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-21T03:04:23.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-21T03:04:23.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-21T03:04:23.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-21T03:04:23.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-21T03:04:23.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-21T03:04:23.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-21T03:04:23.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-21T03:04:23.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-21T03:04:23.111 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-21T03:04:23.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-21T03:04:23.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-21T03:04:23.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-21T03:04:23.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-21T03:04:23.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-21T03:04:23.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-21T03:04:23.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-21T03:04:23.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-21T03:04:23.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-21T03:04:23.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-21T03:04:23.112 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-21T03:04:23.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-21T03:04:23.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-21T03:04:23.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-21T03:04:23.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-21T03:04:23.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-21T03:04:23.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-21T03:04:23.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-21T03:04:23.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-21T03:04:23.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-21T03:04:23.113 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-21T03:04:23.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-21T03:04:23.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-21T03:04:23.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-21T03:04:23.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-21T03:04:23.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-21T03:04:23.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-21T03:04:23.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-21T03:04:23.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-21T03:04:23.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-21T03:04:23.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-21T03:04:23.114 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-21T03:04:23.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-21T03:04:23.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-21T03:04:23.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-21T03:04:23.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-21T03:04:23.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-21T03:04:23.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-21T03:04:23.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-21T03:04:23.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-21T03:04:23.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-21T03:04:23.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-21T03:04:23.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-21T03:04:23.115 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-21T03:04:23.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-21T03:04:23.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-21T03:04:23.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-21T03:04:23.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-21T03:04:23.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-21T03:04:23.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-21T03:04:23.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-21T03:04:23.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-21T03:04:23.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-21T03:04:23.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-21T03:04:23.116 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-21T03:04:23.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-21T03:04:23.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-21T03:04:23.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-21T03:04:23.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-21T03:04:23.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-21T03:04:23.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-21T03:04:23.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-21T03:04:23.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-21T03:04:23.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-21T03:04:23.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-21T03:04:23.117 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-21T03:04:23.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-21T03:04:23.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-21T03:04:23.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-21T03:04:23.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-21T03:04:23.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-21T03:04:23.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-21T03:04:23.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-21T03:04:23.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-21T03:04:23.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-21T03:04:23.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-21T03:04:23.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-21T03:04:23.118 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-21T03:04:23.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-21T03:04:23.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-21T03:04:23.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-21T03:04:23.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-21T03:04:23.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-21T03:04:23.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-21T03:04:23.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-21T03:04:23.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-21T03:04:23.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-21T03:04:23.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-21T03:04:23.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-21T03:04:23.119 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-21T03:04:23.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-21T03:04:23.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-21T03:04:23.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-21T03:04:23.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-21T03:04:23.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-21T03:04:23.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-21T03:04:23.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-21T03:04:23.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-21T03:04:23.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-21T03:04:23.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-21T03:04:23.120 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-21T03:04:23.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-21T03:04:23.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-21T03:04:23.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-21T03:04:23.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-21T03:04:23.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-21T03:04:23.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-21T03:04:23.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-21T03:04:23.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-21T03:04:23.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-21T03:04:23.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-21T03:04:23.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-21T03:04:23.121 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-21T03:04:23.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-21T03:04:23.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-21T03:04:23.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-21T03:04:23.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-21T03:04:23.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-21T03:04:23.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-21T03:04:23.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-21T03:04:23.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-21T03:04:23.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-21T03:04:23.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-21T03:04:23.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-21T03:04:23.122 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-21T03:04:23.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-21T03:04:23.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-21T03:04:23.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-21T03:04:23.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-21T03:04:23.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-21T03:04:23.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-21T03:04:23.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-21T03:04:23.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-21T03:04:23.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-21T03:04:23.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-21T03:04:23.123 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-21T03:04:23.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-21T03:04:23.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-21T03:04:23.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-21T03:04:23.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-21T03:04:23.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-21T03:04:23.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-21T03:04:23.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-21T03:04:23.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-21T03:04:23.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-21T03:04:23.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-21T03:04:23.124 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-21T03:04:23.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-21T03:04:23.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-21T03:04:23.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-21T03:04:23.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-21T03:04:23.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-21T03:04:23.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-21T03:04:23.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-21T03:04:23.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-21T03:04:23.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-21T03:04:23.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-21T03:04:23.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-21T03:04:23.125 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-21T03:04:23.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-21T03:04:23.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-21T03:04:23.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-21T03:04:23.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-21T03:04:23.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-21T03:04:23.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-21T03:04:23.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-21T03:04:23.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-21T03:04:23.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-21T03:04:23.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-21T03:04:23.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-21T03:04:23.126 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-21T03:04:23.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-21T03:04:23.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-21T03:04:23.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-21T03:04:23.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-21T03:04:23.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-21T03:04:23.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-21T03:04:23.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-21T03:04:23.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-21T03:04:23.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-21T03:04:23.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-21T03:04:23.127 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-21T03:04:23.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-21T03:04:23.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-21T03:04:23.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-21T03:04:23.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-21T03:04:23.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-21T03:04:23.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-21T03:04:23.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-21T03:04:23.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-21T03:04:23.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-21T03:04:23.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-21T03:04:23.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-21T03:04:23.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-21T03:04:23.128 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-21T03:04:23.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-21T03:04:23.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-21T03:04:23.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-21T03:04:23.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-21T03:04:23.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-21T03:04:23.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-21T03:04:23.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-21T03:04:23.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-21T03:04:23.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-21T03:04:23.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-21T03:04:23.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-21T03:04:23.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-21T03:04:23.129 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-21T03:04:23.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-21T03:04:23.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-21T03:04:23.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-21T03:04:23.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-21T03:04:23.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-21T03:04:23.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-21T03:04:23.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-21T03:04:23.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-21T03:04:23.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-21T03:04:23.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-21T03:04:23.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-21T03:04:23.130 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-21T03:04:23.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-21T03:04:23.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-21T03:04:23.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-21T03:04:23.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-21T03:04:23.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-21T03:04:23.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-21T03:04:23.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-21T03:04:23.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-21T03:04:23.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-21T03:04:23.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-21T03:04:23.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-21T03:04:23.131 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-21T03:04:23.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-21T03:04:23.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-21T03:04:23.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-21T03:04:23.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-21T03:04:23.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-21T03:04:23.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-21T03:04:23.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-21T03:04:23.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-21T03:04:23.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-21T03:04:23.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-21T03:04:23.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-21T03:04:23.132 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-21T03:04:23.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-21T03:04:23.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-21T03:04:23.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-21T03:04:23.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-21T03:04:23.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-21T03:04:23.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-21T03:04:23.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-21T03:04:23.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-21T03:04:23.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-21T03:04:23.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-21T03:04:23.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-21T03:04:23.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-21T03:04:23.133 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-21T03:04:23.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-21T03:04:23.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-21T03:04:23.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-21T03:04:23.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-21T03:04:23.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-21T03:04:23.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-21T03:04:23.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-21T03:04:23.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-21T03:04:23.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-21T03:04:23.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-21T03:04:23.134 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-21T03:04:23.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-21T03:04:23.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-21T03:04:23.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-21T03:04:23.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-21T03:04:23.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-21T03:04:23.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-21T03:04:23.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-21T03:04:23.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-21T03:04:23.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-21T03:04:23.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-21T03:04:23.135 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-21T03:04:23.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-21T03:04:23.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-21T03:04:23.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-21T03:04:23.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-21T03:04:23.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-21T03:04:23.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-21T03:04:23.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-21T03:04:23.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-21T03:04:23.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-21T03:04:23.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-21T03:04:23.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-21T03:04:23.136 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-21T03:04:23.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-21T03:04:23.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-21T03:04:23.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-21T03:04:23.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-21T03:04:23.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-21T03:04:23.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-21T03:04:23.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-21T03:04:23.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-21T03:04:23.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-21T03:04:23.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-21T03:04:23.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-21T03:04:23.137 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-21T03:04:23.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-21T03:04:23.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-21T03:04:23.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-21T03:04:23.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-21T03:04:23.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-21T03:04:23.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-21T03:04:23.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-21T03:04:23.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-21T03:04:23.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-21T03:04:23.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-21T03:04:23.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-21T03:04:23.138 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-21T03:04:23.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-21T03:04:23.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-21T03:04:23.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-21T03:04:23.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-21T03:04:23.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-21T03:04:23.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-21T03:04:23.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-21T03:04:23.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-21T03:04:23.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-21T03:04:23.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-21T03:04:23.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-21T03:04:23.139 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-21T03:04:23.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-21T03:04:23.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-21T03:04:23.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-21T03:04:23.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-21T03:04:23.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-21T03:04:23.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-21T03:04:23.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-21T03:04:23.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-21T03:04:23.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-21T03:04:23.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-21T03:04:23.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-21T03:04:23.140 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-21T03:04:23.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-21T03:04:23.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-21T03:04:23.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-21T03:04:23.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-21T03:04:23.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-21T03:04:23.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-21T03:04:23.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-21T03:04:23.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-21T03:04:23.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-21T03:04:23.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-21T03:04:23.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-21T03:04:23.141 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-21T03:04:23.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-21T03:04:23.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-21T03:04:23.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-21T03:04:23.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-21T03:04:23.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-21T03:04:23.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-21T03:04:23.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-21T03:04:23.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-21T03:04:23.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-21T03:04:23.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-21T03:04:23.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-21T03:04:23.142 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-21T03:04:23.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-21T03:04:23.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-21T03:04:23.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-21T03:04:23.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-21T03:04:23.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-21T03:04:23.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-21T03:04:23.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-21T03:04:23.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-21T03:04:23.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-21T03:04:23.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-21T03:04:23.143 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-21T03:04:23.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-21T03:04:23.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-21T03:04:23.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-21T03:04:23.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-21T03:04:23.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-21T03:04:23.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-21T03:04:23.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-21T03:04:23.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-21T03:04:23.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-21T03:04:23.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-21T03:04:23.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-21T03:04:23.144 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-21T03:04:23.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-21T03:04:23.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-21T03:04:23.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-21T03:04:23.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-21T03:04:23.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-21T03:04:23.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-21T03:04:23.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-21T03:04:23.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-21T03:04:23.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-21T03:04:23.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-21T03:04:23.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-21T03:04:23.145 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-21T03:04:23.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-21T03:04:23.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-21T03:04:23.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-21T03:04:23.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-21T03:04:23.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-21T03:04:23.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-21T03:04:23.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-21T03:04:23.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-21T03:04:23.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-21T03:04:23.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-21T03:04:23.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-21T03:04:23.146 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-21T03:04:23.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-21T03:04:23.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-21T03:04:23.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-21T03:04:23.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-21T03:04:23.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-21T03:04:23.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-21T03:04:23.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-21T03:04:23.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-21T03:04:23.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-21T03:04:23.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-21T03:04:23.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-21T03:04:23.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-21T03:04:23.147 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-21T03:04:23.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-21T03:04:23.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-21T03:04:23.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-21T03:04:23.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-21T03:04:23.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-21T03:04:23.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-21T03:04:23.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-21T03:04:23.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-21T03:04:23.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-21T03:04:23.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-21T03:04:23.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-21T03:04:23.148 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-21T03:04:23.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-21T03:04:23.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-21T03:04:23.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-21T03:04:23.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-21T03:04:23.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-21T03:04:23.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-21T03:04:23.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-21T03:04:23.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-21T03:04:23.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-21T03:04:23.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-21T03:04:23.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-21T03:04:23.149 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-21T03:04:23.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-21T03:04:23.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-21T03:04:23.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-21T03:04:23.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-21T03:04:23.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-21T03:04:23.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-21T03:04:23.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-21T03:04:23.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-21T03:04:23.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-21T03:04:23.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-21T03:04:23.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-21T03:04:23.150 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-21T03:04:23.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-21T03:04:23.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-21T03:04:23.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-21T03:04:23.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-21T03:04:23.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-21T03:04:23.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-21T03:04:23.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-21T03:04:23.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-21T03:04:23.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-21T03:04:23.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-21T03:04:23.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-21T03:04:23.151 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-21T03:04:23.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-21T03:04:23.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-21T03:04:23.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-21T03:04:23.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-21T03:04:23.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-21T03:04:23.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-21T03:04:23.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-21T03:04:23.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-21T03:04:23.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-21T03:04:23.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-21T03:04:23.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-21T03:04:23.152 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-21T03:04:23.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-21T03:04:23.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-21T03:04:23.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-21T03:04:23.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-21T03:04:23.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-21T03:04:23.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-21T03:04:23.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-21T03:04:23.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-21T03:04:23.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-21T03:04:23.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-21T03:04:23.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-21T03:04:23.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-21T03:04:23.153 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-21T03:04:23.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-21T03:04:23.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-21T03:04:23.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-21T03:04:23.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-21T03:04:23.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-21T03:04:23.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-21T03:04:23.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-21T03:04:23.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-21T03:04:23.154 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-21T03:04:23.158 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:04:23.158 DEBUG:teuthology.orchestra.run.smithi149:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-21T03:04:23.182 INFO:teuthology.orchestra.run.smithi149.stdout:postinstall scriptlet (using /bin/sh): 2024-09-21T03:04:23.182 INFO:teuthology.orchestra.run.smithi149.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-21T03:04:23.183 INFO:teuthology.orchestra.run.smithi149.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-21T03:04:23.183 INFO:teuthology.orchestra.run.smithi149.stdout:fi 2024-09-21T03:04:23.183 INFO:teuthology.orchestra.run.smithi149.stdout:for file in vmlinuz System.map config; do 2024-09-21T03:04:23.183 INFO:teuthology.orchestra.run.smithi149.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-21T03:04:23.183 INFO:teuthology.orchestra.run.smithi149.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T03:04:23.183 INFO:teuthology.orchestra.run.smithi149.stdout: fi 2024-09-21T03:04:23.183 INFO:teuthology.orchestra.run.smithi149.stdout:done 2024-09-21T03:04:23.183 INFO:teuthology.orchestra.run.smithi149.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-21T03:04:23.183 INFO:teuthology.orchestra.run.smithi149.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-21T03:04:23.183 INFO:teuthology.orchestra.run.smithi149.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T03:04:23.183 INFO:teuthology.orchestra.run.smithi149.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T03:04:23.184 INFO:teuthology.orchestra.run.smithi149.stdout:fi 2024-09-21T03:04:23.184 INFO:teuthology.orchestra.run.smithi149.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-21T03:04:23.184 INFO:teuthology.orchestra.run.smithi149.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:04:23.184 INFO:teuthology.orchestra.run.smithi149.stdout:fi 2024-09-21T03:04:23.184 INFO:teuthology.orchestra.run.smithi149.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-21T03:04:23.184 INFO:teuthology.orchestra.run.smithi149.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-21T03:04:23.184 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:04:23.184 INFO:teuthology.orchestra.run.smithi149.stdout:fi 2024-09-21T03:04:23.185 DEBUG:teuthology.orchestra.run.smithi149:> sudo rpm -qi grub2-tools 2024-09-21T03:04:23.267 INFO:teuthology.orchestra.run.smithi149.stdout:Name : grub2-tools 2024-09-21T03:04:23.267 INFO:teuthology.orchestra.run.smithi149.stdout:Epoch : 1 2024-09-21T03:04:23.267 INFO:teuthology.orchestra.run.smithi149.stdout:Version : 2.06 2024-09-21T03:04:23.267 INFO:teuthology.orchestra.run.smithi149.stdout:Release : 82.el9 2024-09-21T03:04:23.267 INFO:teuthology.orchestra.run.smithi149.stdout:Architecture: x86_64 2024-09-21T03:04:23.267 INFO:teuthology.orchestra.run.smithi149.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T03:04:23.267 INFO:teuthology.orchestra.run.smithi149.stdout:Group : Unspecified 2024-09-21T03:04:23.267 INFO:teuthology.orchestra.run.smithi149.stdout:Size : 8274670 2024-09-21T03:04:23.268 INFO:teuthology.orchestra.run.smithi149.stdout:License : GPLv3+ 2024-09-21T03:04:23.268 INFO:teuthology.orchestra.run.smithi149.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T03:04:23.268 INFO:teuthology.orchestra.run.smithi149.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T03:04:23.268 INFO:teuthology.orchestra.run.smithi149.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T03:04:23.268 INFO:teuthology.orchestra.run.smithi149.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T03:04:23.268 INFO:teuthology.orchestra.run.smithi149.stdout:Packager : builder@centos.org 2024-09-21T03:04:23.268 INFO:teuthology.orchestra.run.smithi149.stdout:Vendor : CentOS 2024-09-21T03:04:23.268 INFO:teuthology.orchestra.run.smithi149.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T03:04:23.268 INFO:teuthology.orchestra.run.smithi149.stdout:Summary : Support tools for GRUB. 2024-09-21T03:04:23.268 INFO:teuthology.orchestra.run.smithi149.stdout:Description : 2024-09-21T03:04:23.268 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:04:23.268 INFO:teuthology.orchestra.run.smithi149.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T03:04:23.269 INFO:teuthology.orchestra.run.smithi149.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T03:04:23.269 INFO:teuthology.orchestra.run.smithi149.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T03:04:23.269 INFO:teuthology.orchestra.run.smithi149.stdout:hardware devices. 2024-09-21T03:04:23.269 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:04:23.269 INFO:teuthology.orchestra.run.smithi149.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T03:04:23.270 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T03:04:23.270 INFO:teuthology.task.kernel:Updating grub on smithi149 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:04:23.270 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T03:04:23.895 INFO:teuthology.orchestra.run.smithi149.stderr:Generating grub configuration file ... 2024-09-21T03:04:25.409 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[30264]) leaked on vgs invocation. Parent PID 15163: grub2-probe 2024-09-21T03:04:25.409 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[37048]) leaked on vgs invocation. Parent PID 15163: grub2-probe 2024-09-21T03:04:25.443 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[30264]) leaked on vgs invocation. Parent PID 15163: grub2-probe 2024-09-21T03:04:25.443 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[37048]) leaked on vgs invocation. Parent PID 15163: grub2-probe 2024-09-21T03:04:25.701 INFO:teuthology.orchestra.run.smithi149.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T03:04:25.716 INFO:teuthology.orchestra.run.smithi149.stderr:done 2024-09-21T03:04:25.718 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-09-21T03:04:25.774 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.VJuRy6dRLH 2024-09-21T03:04:25.774 DEBUG:teuthology.orchestra.run.smithi149:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.VJuRy6dRLH 2024-09-21T03:04:25.845 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.VJuRy6dRLH 2024-09-21T03:04:25.980 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.VJuRy6dRLH is 6KB 2024-09-21T03:04:26.028 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.VJuRy6dRLH 2024-09-21T03:04:26.043 DEBUG:teuthology.orchestra.run.smithi149:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T03:04:26.105 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T03:04:26.105 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T03:04:26.105 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T03:04:26.105 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-21T03:04:26.107 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:04:26.259 DEBUG:teuthology.orchestra.run.smithi149:> sudo shutdown -r now 2024-09-21T03:04:27.986 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi090.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-21T03:04:27.989 DEBUG:teuthology.orchestra.run.smithi090:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-21T03:04:28.079 INFO:teuthology.orchestra.run.smithi090.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:04:28.079 INFO:teuthology.orchestra.run.smithi090.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:04:28.079 INFO:teuthology.orchestra.run.smithi090.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:04:28.080 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:04:28.080 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-21T03:04:28.080 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-21T03:04:28.080 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-21T03:04:28.080 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-21T03:04:28.080 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-21T03:04:28.080 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-21T03:04:28.080 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-21T03:04:28.080 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-21T03:04:28.080 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-21T03:04:28.080 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-21T03:04:28.080 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-21T03:04:28.080 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-21T03:04:28.080 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-21T03:04:28.081 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-21T03:04:28.081 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-21T03:04:28.081 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-21T03:04:28.081 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-21T03:04:28.081 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-21T03:04:28.081 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-21T03:04:28.081 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-21T03:04:28.081 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-21T03:04:28.081 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-21T03:04:28.081 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-21T03:04:28.081 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-21T03:04:28.081 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-21T03:04:28.081 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-21T03:04:28.081 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-21T03:04:28.081 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-21T03:04:28.082 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-21T03:04:28.082 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-21T03:04:28.082 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-21T03:04:28.082 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-21T03:04:28.082 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-21T03:04:28.082 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-21T03:04:28.082 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-21T03:04:28.082 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-21T03:04:28.082 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-21T03:04:28.082 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-21T03:04:28.082 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-21T03:04:28.082 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-21T03:04:28.082 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-21T03:04:28.082 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-21T03:04:28.083 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-21T03:04:28.083 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-21T03:04:28.083 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-21T03:04:28.083 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-21T03:04:28.083 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-21T03:04:28.083 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-21T03:04:28.083 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-21T03:04:28.083 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-21T03:04:28.083 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-21T03:04:28.083 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-21T03:04:28.083 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-21T03:04:28.083 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-21T03:04:28.083 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-21T03:04:28.083 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-21T03:04:28.084 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-21T03:04:28.084 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-21T03:04:28.084 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-21T03:04:28.084 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-21T03:04:28.084 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-21T03:04:28.084 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-21T03:04:28.084 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-21T03:04:28.084 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-21T03:04:28.084 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-21T03:04:28.084 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-21T03:04:28.084 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-21T03:04:28.084 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-21T03:04:28.084 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-21T03:04:28.084 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-21T03:04:28.084 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-21T03:04:28.085 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-21T03:04:28.085 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-21T03:04:28.085 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-21T03:04:28.085 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-21T03:04:28.085 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-21T03:04:28.085 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-21T03:04:28.085 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-21T03:04:28.085 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-21T03:04:28.085 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-21T03:04:28.085 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-21T03:04:28.085 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-21T03:04:28.085 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-21T03:04:28.085 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-21T03:04:28.085 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-21T03:04:28.085 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-21T03:04:28.086 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-21T03:04:28.086 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-21T03:04:28.086 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-21T03:04:28.086 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-21T03:04:28.086 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-21T03:04:28.086 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-21T03:04:28.086 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-21T03:04:28.086 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-21T03:04:28.086 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-21T03:04:28.086 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-21T03:04:28.086 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-21T03:04:28.086 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-21T03:04:28.086 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-21T03:04:28.087 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-21T03:04:28.087 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-21T03:04:28.087 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-21T03:04:28.087 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-21T03:04:28.087 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-21T03:04:28.087 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-21T03:04:28.087 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-21T03:04:28.087 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-21T03:04:28.087 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-21T03:04:28.087 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-21T03:04:28.087 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-21T03:04:28.087 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-21T03:04:28.087 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-21T03:04:28.087 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-21T03:04:28.087 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-21T03:04:28.087 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-21T03:04:28.088 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-21T03:04:28.088 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-21T03:04:28.088 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-21T03:04:28.088 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-21T03:04:28.088 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-21T03:04:28.088 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-21T03:04:28.088 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-21T03:04:28.088 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-21T03:04:28.088 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-21T03:04:28.088 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-21T03:04:28.088 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-21T03:04:28.088 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-21T03:04:28.088 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-21T03:04:28.088 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-21T03:04:28.089 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-21T03:04:28.089 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-21T03:04:28.089 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-21T03:04:28.089 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-21T03:04:28.089 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-21T03:04:28.089 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-21T03:04:28.089 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-21T03:04:28.089 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-21T03:04:28.089 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-21T03:04:28.089 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-21T03:04:28.089 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-21T03:04:28.089 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-21T03:04:28.089 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-21T03:04:28.089 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-21T03:04:28.089 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-21T03:04:28.090 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-21T03:04:28.090 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-21T03:04:28.090 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-21T03:04:28.090 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-21T03:04:28.090 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-21T03:04:28.090 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-21T03:04:28.090 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-21T03:04:28.090 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-21T03:04:28.090 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-21T03:04:28.090 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-21T03:04:28.090 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-21T03:04:28.090 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-21T03:04:28.090 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-21T03:04:28.090 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-21T03:04:28.091 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-21T03:04:28.091 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-21T03:04:28.091 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-21T03:04:28.091 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-21T03:04:28.091 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-21T03:04:28.091 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-21T03:04:28.091 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-21T03:04:28.091 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-21T03:04:28.091 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-21T03:04:28.091 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-21T03:04:28.091 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-21T03:04:28.091 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-21T03:04:28.091 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-21T03:04:28.091 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-21T03:04:28.091 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-21T03:04:28.091 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-21T03:04:28.092 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-21T03:04:28.092 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-21T03:04:28.092 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-21T03:04:28.092 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-21T03:04:28.092 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-21T03:04:28.092 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-21T03:04:28.092 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-21T03:04:28.092 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-21T03:04:28.092 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-21T03:04:28.092 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-21T03:04:28.092 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-21T03:04:28.092 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-21T03:04:28.092 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-21T03:04:28.092 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-21T03:04:28.093 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-21T03:04:28.093 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-21T03:04:28.093 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-21T03:04:28.093 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-21T03:04:28.093 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-21T03:04:28.093 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-21T03:04:28.093 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-21T03:04:28.093 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-21T03:04:28.093 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-21T03:04:28.093 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-21T03:04:28.093 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-21T03:04:28.093 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-21T03:04:28.093 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-21T03:04:28.093 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-21T03:04:28.093 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-21T03:04:28.094 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-21T03:04:28.094 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-21T03:04:28.094 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-21T03:04:28.094 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-21T03:04:28.094 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-21T03:04:28.094 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-21T03:04:28.094 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-21T03:04:28.094 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-21T03:04:28.094 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-21T03:04:28.094 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-21T03:04:28.094 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-21T03:04:28.094 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-21T03:04:28.094 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-21T03:04:28.094 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-21T03:04:28.095 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-21T03:04:28.095 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-21T03:04:28.095 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-21T03:04:28.095 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-21T03:04:28.095 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-21T03:04:28.095 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-21T03:04:28.095 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-21T03:04:28.095 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-21T03:04:28.095 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-21T03:04:28.095 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-21T03:04:28.095 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-21T03:04:28.095 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-21T03:04:28.095 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-21T03:04:28.096 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-21T03:04:28.096 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-21T03:04:28.096 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-21T03:04:28.096 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-21T03:04:28.096 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-21T03:04:28.096 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-21T03:04:28.096 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-21T03:04:28.096 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-21T03:04:28.096 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-21T03:04:28.096 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-21T03:04:28.096 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-21T03:04:28.096 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-21T03:04:28.096 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-21T03:04:28.096 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-21T03:04:28.096 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-21T03:04:28.097 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-21T03:04:28.097 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-21T03:04:28.097 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-21T03:04:28.097 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-21T03:04:28.097 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-21T03:04:28.097 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-21T03:04:28.097 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-21T03:04:28.097 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-21T03:04:28.097 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-21T03:04:28.097 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-21T03:04:28.097 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-21T03:04:28.097 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-21T03:04:28.097 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-21T03:04:28.097 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-21T03:04:28.097 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-21T03:04:28.098 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-21T03:04:28.098 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-21T03:04:28.098 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-21T03:04:28.098 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-21T03:04:28.098 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-21T03:04:28.098 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-21T03:04:28.098 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-21T03:04:28.098 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-21T03:04:28.098 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-21T03:04:28.098 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-21T03:04:28.098 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-21T03:04:28.098 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-21T03:04:28.098 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-21T03:04:28.098 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-21T03:04:28.098 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-21T03:04:28.099 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-21T03:04:28.099 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-21T03:04:28.099 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-21T03:04:28.099 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-21T03:04:28.099 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-21T03:04:28.099 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-21T03:04:28.099 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-21T03:04:28.099 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-21T03:04:28.099 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-21T03:04:28.099 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-21T03:04:28.099 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-21T03:04:28.099 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-21T03:04:28.099 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-21T03:04:28.099 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-21T03:04:28.099 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-21T03:04:28.100 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-21T03:04:28.100 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-21T03:04:28.100 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-21T03:04:28.100 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-21T03:04:28.100 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-21T03:04:28.100 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-21T03:04:28.100 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-21T03:04:28.100 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-21T03:04:28.100 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-21T03:04:28.100 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-21T03:04:28.100 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-21T03:04:28.100 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-21T03:04:28.100 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-21T03:04:28.100 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-21T03:04:28.100 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-21T03:04:28.101 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-21T03:04:28.101 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-21T03:04:28.101 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-21T03:04:28.101 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-21T03:04:28.101 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-21T03:04:28.101 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-21T03:04:28.101 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-21T03:04:28.101 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-21T03:04:28.101 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-21T03:04:28.101 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-21T03:04:28.101 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-21T03:04:28.101 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-21T03:04:28.101 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-21T03:04:28.101 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-21T03:04:28.101 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-21T03:04:28.101 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-21T03:04:28.102 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-21T03:04:28.102 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-21T03:04:28.102 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-21T03:04:28.102 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-21T03:04:28.102 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-21T03:04:28.102 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-21T03:04:28.102 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-21T03:04:28.102 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-21T03:04:28.102 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-21T03:04:28.102 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-21T03:04:28.102 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-21T03:04:28.102 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-21T03:04:28.102 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-21T03:04:28.102 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-21T03:04:28.102 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-21T03:04:28.103 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-21T03:04:28.103 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-21T03:04:28.103 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-21T03:04:28.103 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-21T03:04:28.103 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-21T03:04:28.103 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-21T03:04:28.103 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-21T03:04:28.103 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-21T03:04:28.103 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-21T03:04:28.103 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-21T03:04:28.103 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-21T03:04:28.103 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-21T03:04:28.103 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-21T03:04:28.103 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-21T03:04:28.104 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-21T03:04:28.104 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-21T03:04:28.104 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-21T03:04:28.104 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-21T03:04:28.104 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-21T03:04:28.104 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-21T03:04:28.104 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-21T03:04:28.104 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-21T03:04:28.104 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-21T03:04:28.104 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-21T03:04:28.104 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-21T03:04:28.104 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-21T03:04:28.104 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-21T03:04:28.104 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-21T03:04:28.104 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-21T03:04:28.105 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-21T03:04:28.105 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-21T03:04:28.105 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-21T03:04:28.105 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-21T03:04:28.105 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-21T03:04:28.105 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-21T03:04:28.105 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-21T03:04:28.105 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-21T03:04:28.105 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-21T03:04:28.105 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-21T03:04:28.105 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-21T03:04:28.105 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-21T03:04:28.105 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-21T03:04:28.106 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-21T03:04:28.106 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-21T03:04:28.106 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-21T03:04:28.106 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-21T03:04:28.106 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-21T03:04:28.106 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-21T03:04:28.106 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-21T03:04:28.106 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-21T03:04:28.106 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-21T03:04:28.106 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-21T03:04:28.106 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-21T03:04:28.106 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-21T03:04:28.106 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-21T03:04:28.107 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-21T03:04:28.107 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-21T03:04:28.107 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-21T03:04:28.107 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-21T03:04:28.107 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-21T03:04:28.107 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-21T03:04:28.107 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-21T03:04:28.107 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-21T03:04:28.107 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-21T03:04:28.107 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-21T03:04:28.107 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-21T03:04:28.107 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-21T03:04:28.107 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-21T03:04:28.108 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-21T03:04:28.108 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-21T03:04:28.108 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-21T03:04:28.108 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-21T03:04:28.108 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-21T03:04:28.108 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-21T03:04:28.108 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-21T03:04:28.108 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-21T03:04:28.108 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-21T03:04:28.108 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-21T03:04:28.108 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-21T03:04:28.108 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-21T03:04:28.108 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-21T03:04:28.108 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-21T03:04:28.109 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-21T03:04:28.109 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-21T03:04:28.109 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-21T03:04:28.109 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-21T03:04:28.109 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-21T03:04:28.109 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-21T03:04:28.109 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-21T03:04:28.109 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-21T03:04:28.109 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-21T03:04:28.109 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-21T03:04:28.109 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-21T03:04:28.109 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-21T03:04:28.109 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-21T03:04:28.109 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-21T03:04:28.109 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-21T03:04:28.110 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-21T03:04:28.110 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-21T03:04:28.110 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-21T03:04:28.110 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-21T03:04:28.110 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-21T03:04:28.110 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-21T03:04:28.110 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-21T03:04:28.110 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-21T03:04:28.110 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-21T03:04:28.110 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-21T03:04:28.110 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-21T03:04:28.110 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-21T03:04:28.110 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-21T03:04:28.111 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-21T03:04:28.111 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-21T03:04:28.111 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-21T03:04:28.111 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-21T03:04:28.111 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-21T03:04:28.111 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-21T03:04:28.111 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-21T03:04:28.111 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-21T03:04:28.111 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-21T03:04:28.111 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-21T03:04:28.111 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-21T03:04:28.111 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-21T03:04:28.111 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-21T03:04:28.111 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-21T03:04:28.111 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-21T03:04:28.112 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-21T03:04:28.112 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-21T03:04:28.112 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-21T03:04:28.112 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-21T03:04:28.112 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-21T03:04:28.112 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-21T03:04:28.112 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-21T03:04:28.112 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-21T03:04:28.112 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-21T03:04:28.112 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-21T03:04:28.112 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-21T03:04:28.112 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-21T03:04:28.112 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-21T03:04:28.112 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-21T03:04:28.113 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-21T03:04:28.113 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-21T03:04:28.113 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-21T03:04:28.113 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-21T03:04:28.113 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-21T03:04:28.113 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-21T03:04:28.113 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-21T03:04:28.113 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-21T03:04:28.113 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-21T03:04:28.113 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-21T03:04:28.113 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-21T03:04:28.113 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-21T03:04:28.113 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-21T03:04:28.113 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-21T03:04:28.113 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-21T03:04:28.114 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-21T03:04:28.114 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-21T03:04:28.114 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-21T03:04:28.114 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-21T03:04:28.114 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-21T03:04:28.114 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-21T03:04:28.114 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-21T03:04:28.114 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-21T03:04:28.114 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-21T03:04:28.114 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-21T03:04:28.114 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-21T03:04:28.114 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-21T03:04:28.114 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-21T03:04:28.114 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-21T03:04:28.115 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-21T03:04:28.115 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-21T03:04:28.115 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-21T03:04:28.115 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-21T03:04:28.115 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-21T03:04:28.115 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-21T03:04:28.115 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-21T03:04:28.115 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-21T03:04:28.115 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-21T03:04:28.115 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-21T03:04:28.115 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-21T03:04:28.115 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-21T03:04:28.115 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-21T03:04:28.115 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-21T03:04:28.116 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-21T03:04:28.116 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-21T03:04:28.116 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-21T03:04:28.116 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-21T03:04:28.116 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-21T03:04:28.116 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-21T03:04:28.116 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-21T03:04:28.116 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-21T03:04:28.116 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-21T03:04:28.116 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-21T03:04:28.116 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-21T03:04:28.116 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-21T03:04:28.116 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-21T03:04:28.116 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-21T03:04:28.117 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-21T03:04:28.117 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-21T03:04:28.117 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-21T03:04:28.117 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-21T03:04:28.117 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-21T03:04:28.117 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-21T03:04:28.117 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-21T03:04:28.117 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-21T03:04:28.117 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-21T03:04:28.117 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-21T03:04:28.117 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-21T03:04:28.117 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-21T03:04:28.117 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-21T03:04:28.117 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-21T03:04:28.117 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-21T03:04:28.117 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-21T03:04:28.118 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-21T03:04:28.118 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-21T03:04:28.118 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-21T03:04:28.118 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-21T03:04:28.118 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-21T03:04:28.118 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-21T03:04:28.118 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-21T03:04:28.118 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-21T03:04:28.118 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-21T03:04:28.118 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-21T03:04:28.118 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-21T03:04:28.118 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-21T03:04:28.118 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-21T03:04:28.118 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-21T03:04:28.119 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-21T03:04:28.119 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-21T03:04:28.119 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-21T03:04:28.119 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-21T03:04:28.119 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-21T03:04:28.119 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-21T03:04:28.119 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-21T03:04:28.119 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-21T03:04:28.119 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-21T03:04:28.119 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-21T03:04:28.119 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-21T03:04:28.119 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-21T03:04:28.119 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-21T03:04:28.119 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-21T03:04:28.120 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-21T03:04:28.120 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-21T03:04:28.120 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-21T03:04:28.120 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-21T03:04:28.120 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-21T03:04:28.120 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-21T03:04:28.120 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-21T03:04:28.120 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-21T03:04:28.120 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-21T03:04:28.120 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-21T03:04:28.120 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-21T03:04:28.120 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-21T03:04:28.120 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-21T03:04:28.120 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-21T03:04:28.121 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-21T03:04:28.121 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-21T03:04:28.121 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-21T03:04:28.121 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-21T03:04:28.121 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-21T03:04:28.121 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-21T03:04:28.121 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-21T03:04:28.121 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-21T03:04:28.121 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-21T03:04:28.121 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-21T03:04:28.121 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-21T03:04:28.121 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-21T03:04:28.121 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-21T03:04:28.121 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-21T03:04:28.121 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-21T03:04:28.122 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-21T03:04:28.122 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-21T03:04:28.122 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-21T03:04:28.122 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-21T03:04:28.122 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-21T03:04:28.122 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-21T03:04:28.122 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-21T03:04:28.122 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-21T03:04:28.122 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-21T03:04:28.122 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-21T03:04:28.122 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-21T03:04:28.122 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-21T03:04:28.122 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-21T03:04:28.122 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-21T03:04:28.122 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-21T03:04:28.123 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-21T03:04:28.123 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-21T03:04:28.123 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-21T03:04:28.123 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-21T03:04:28.123 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-21T03:04:28.123 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-21T03:04:28.123 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-21T03:04:28.123 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-21T03:04:28.123 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-21T03:04:28.123 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-21T03:04:28.123 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-21T03:04:28.123 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-21T03:04:28.123 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-21T03:04:28.123 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-21T03:04:28.123 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-21T03:04:28.124 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-21T03:04:28.124 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-21T03:04:28.124 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-21T03:04:28.124 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-21T03:04:28.124 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-21T03:04:28.124 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-21T03:04:28.124 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-21T03:04:28.124 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-21T03:04:28.124 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-21T03:04:28.124 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-21T03:04:28.124 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-21T03:04:28.124 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-21T03:04:28.124 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-21T03:04:28.124 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-21T03:04:28.124 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-21T03:04:28.125 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-21T03:04:28.125 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-21T03:04:28.125 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-21T03:04:28.125 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-21T03:04:28.125 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-21T03:04:28.125 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-21T03:04:28.125 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-21T03:04:28.125 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-21T03:04:28.125 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-21T03:04:28.125 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-21T03:04:28.125 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-21T03:04:28.125 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-21T03:04:28.125 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-21T03:04:28.125 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-21T03:04:28.126 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-21T03:04:28.126 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-21T03:04:28.126 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-21T03:04:28.126 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-21T03:04:28.126 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-21T03:04:28.126 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-21T03:04:28.126 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-21T03:04:28.126 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-21T03:04:28.126 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-21T03:04:28.126 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-21T03:04:28.126 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-21T03:04:28.126 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-21T03:04:28.126 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-21T03:04:28.126 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-21T03:04:28.126 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-21T03:04:28.127 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-21T03:04:28.127 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-21T03:04:28.127 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-21T03:04:28.127 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-21T03:04:28.127 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-21T03:04:28.127 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-21T03:04:28.127 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-21T03:04:28.127 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-21T03:04:28.127 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-21T03:04:28.127 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-21T03:04:28.127 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-21T03:04:28.127 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-21T03:04:28.127 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-21T03:04:28.128 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-21T03:04:28.128 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-21T03:04:28.128 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-21T03:04:28.128 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-21T03:04:28.128 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-21T03:04:28.128 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-21T03:04:28.128 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-21T03:04:28.128 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-21T03:04:28.128 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-21T03:04:28.128 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-21T03:04:28.128 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-21T03:04:28.128 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-21T03:04:28.128 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-21T03:04:28.128 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-21T03:04:28.128 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-21T03:04:28.128 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-21T03:04:28.129 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-21T03:04:28.129 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-21T03:04:28.129 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-21T03:04:28.129 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-21T03:04:28.129 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-21T03:04:28.129 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-21T03:04:28.129 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-21T03:04:28.129 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-21T03:04:28.129 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-21T03:04:28.129 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-21T03:04:28.129 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-21T03:04:28.129 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-21T03:04:28.129 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-21T03:04:28.129 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-21T03:04:28.129 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-21T03:04:28.130 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-21T03:04:28.130 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-21T03:04:28.130 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-21T03:04:28.130 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-21T03:04:28.130 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-21T03:04:28.130 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-21T03:04:28.130 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-21T03:04:28.130 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-21T03:04:28.130 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-21T03:04:28.130 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-21T03:04:28.130 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-21T03:04:28.130 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-21T03:04:28.130 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-21T03:04:28.130 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-21T03:04:28.131 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-21T03:04:28.131 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-21T03:04:28.131 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-21T03:04:28.131 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-21T03:04:28.131 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-21T03:04:28.131 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-21T03:04:28.131 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-21T03:04:28.131 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-21T03:04:28.131 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-21T03:04:28.131 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-21T03:04:28.131 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-21T03:04:28.131 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-21T03:04:28.131 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-21T03:04:28.131 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-21T03:04:28.131 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-21T03:04:28.131 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-21T03:04:28.132 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-21T03:04:28.132 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-21T03:04:28.132 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-21T03:04:28.132 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-21T03:04:28.132 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-21T03:04:28.132 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-21T03:04:28.132 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-21T03:04:28.132 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-21T03:04:28.132 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-21T03:04:28.132 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-21T03:04:28.132 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-21T03:04:28.132 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-21T03:04:28.132 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-21T03:04:28.132 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-21T03:04:28.132 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-21T03:04:28.133 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-21T03:04:28.133 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-21T03:04:28.133 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-21T03:04:28.133 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-21T03:04:28.133 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-21T03:04:28.133 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-21T03:04:28.133 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-21T03:04:28.133 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-21T03:04:28.133 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-21T03:04:28.133 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-21T03:04:28.133 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-21T03:04:28.133 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-21T03:04:28.133 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-21T03:04:28.133 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-21T03:04:28.133 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-21T03:04:28.133 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-21T03:04:28.133 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-21T03:04:28.134 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-21T03:04:28.134 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-21T03:04:28.134 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-21T03:04:28.134 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-21T03:04:28.134 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-21T03:04:28.134 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-21T03:04:28.134 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-21T03:04:28.134 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-21T03:04:28.134 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-21T03:04:28.134 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-21T03:04:28.134 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-21T03:04:28.134 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-21T03:04:28.134 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-21T03:04:28.134 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-21T03:04:28.134 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-21T03:04:28.135 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-21T03:04:28.135 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-21T03:04:28.135 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-21T03:04:28.135 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-21T03:04:28.135 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-21T03:04:28.135 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-21T03:04:28.135 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-21T03:04:28.135 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-21T03:04:28.135 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-21T03:04:28.135 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-21T03:04:28.135 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-21T03:04:28.135 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-21T03:04:28.135 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-21T03:04:28.135 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-21T03:04:28.135 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-21T03:04:28.135 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-21T03:04:28.136 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-21T03:04:28.136 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-21T03:04:28.136 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-21T03:04:28.136 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-21T03:04:28.136 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-21T03:04:28.136 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-21T03:04:28.136 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-21T03:04:28.136 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-21T03:04:28.136 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-21T03:04:28.136 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-21T03:04:28.136 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-21T03:04:28.136 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-21T03:04:28.136 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-21T03:04:28.136 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-21T03:04:28.136 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-21T03:04:28.136 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-21T03:04:28.137 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-21T03:04:28.137 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-21T03:04:28.137 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-21T03:04:28.137 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-21T03:04:28.137 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-21T03:04:28.137 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-21T03:04:28.137 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-21T03:04:28.137 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-21T03:04:28.137 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-21T03:04:28.137 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-21T03:04:28.137 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-21T03:04:28.137 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-21T03:04:28.137 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-21T03:04:28.137 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-21T03:04:28.137 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-21T03:04:28.137 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-21T03:04:28.138 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-21T03:04:28.138 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-21T03:04:28.138 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-21T03:04:28.138 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-21T03:04:28.138 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-21T03:04:28.138 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-21T03:04:28.138 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-21T03:04:28.138 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-21T03:04:28.138 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-21T03:04:28.138 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-21T03:04:28.138 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-21T03:04:28.138 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-21T03:04:28.138 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-21T03:04:28.138 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-21T03:04:28.138 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-21T03:04:28.138 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-21T03:04:28.139 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-21T03:04:28.139 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-21T03:04:28.139 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-21T03:04:28.139 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-21T03:04:28.139 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-21T03:04:28.139 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-21T03:04:28.139 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-21T03:04:28.139 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-21T03:04:28.139 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-21T03:04:28.139 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-21T03:04:28.139 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-21T03:04:28.139 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-21T03:04:28.139 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-21T03:04:28.139 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-21T03:04:28.139 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-21T03:04:28.139 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-21T03:04:28.140 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-21T03:04:28.140 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-21T03:04:28.140 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-21T03:04:28.140 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-21T03:04:28.140 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-21T03:04:28.140 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-21T03:04:28.140 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-21T03:04:28.140 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-21T03:04:28.140 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-21T03:04:28.140 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-21T03:04:28.140 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-21T03:04:28.140 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-21T03:04:28.140 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-21T03:04:28.140 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-21T03:04:28.140 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-21T03:04:28.140 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-21T03:04:28.140 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-21T03:04:28.141 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-21T03:04:28.141 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-21T03:04:28.141 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-21T03:04:28.141 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-21T03:04:28.141 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-21T03:04:28.141 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-21T03:04:28.141 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-21T03:04:28.141 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-21T03:04:28.141 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-21T03:04:28.141 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-21T03:04:28.141 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-21T03:04:28.141 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-21T03:04:28.141 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-21T03:04:28.141 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-21T03:04:28.141 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-21T03:04:28.141 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-21T03:04:28.142 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-21T03:04:28.142 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-21T03:04:28.142 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-21T03:04:28.142 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-21T03:04:28.142 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-21T03:04:28.142 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-21T03:04:28.142 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-21T03:04:28.142 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-21T03:04:28.142 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-21T03:04:28.142 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-21T03:04:28.142 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-21T03:04:28.142 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-21T03:04:28.142 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-21T03:04:28.142 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-21T03:04:28.142 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-21T03:04:28.143 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-21T03:04:28.143 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-21T03:04:28.143 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-21T03:04:28.143 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-21T03:04:28.143 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-21T03:04:28.143 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-21T03:04:28.143 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-21T03:04:28.143 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-21T03:04:28.143 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-21T03:04:28.143 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-21T03:04:28.143 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-21T03:04:28.143 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-21T03:04:28.143 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-21T03:04:28.143 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-21T03:04:28.143 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-21T03:04:28.144 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-21T03:04:28.144 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-21T03:04:28.144 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-21T03:04:28.144 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-21T03:04:28.144 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-21T03:04:28.144 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-21T03:04:28.144 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-21T03:04:28.144 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-21T03:04:28.144 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-21T03:04:28.144 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-21T03:04:28.144 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-21T03:04:28.144 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-21T03:04:28.144 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-21T03:04:28.144 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-21T03:04:28.144 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-21T03:04:28.144 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-21T03:04:28.145 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-21T03:04:28.145 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-21T03:04:28.145 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-21T03:04:28.145 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-21T03:04:28.145 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-21T03:04:28.145 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-21T03:04:28.145 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-21T03:04:28.145 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-21T03:04:28.145 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-21T03:04:28.145 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-21T03:04:28.145 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-21T03:04:28.145 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-21T03:04:28.145 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-21T03:04:28.145 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-21T03:04:28.145 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-21T03:04:28.146 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-21T03:04:28.146 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-21T03:04:28.146 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-21T03:04:28.146 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-21T03:04:28.146 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-21T03:04:28.146 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-21T03:04:28.146 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-21T03:04:28.146 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-21T03:04:28.146 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-21T03:04:28.146 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-21T03:04:28.146 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-21T03:04:28.146 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-21T03:04:28.146 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-21T03:04:28.146 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-21T03:04:28.146 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-21T03:04:28.146 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-21T03:04:28.147 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-21T03:04:28.147 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-21T03:04:28.147 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-21T03:04:28.147 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-21T03:04:28.147 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-21T03:04:28.147 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-21T03:04:28.147 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-21T03:04:28.147 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-21T03:04:28.147 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-21T03:04:28.147 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-21T03:04:28.147 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-21T03:04:28.147 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-21T03:04:28.147 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-21T03:04:28.147 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-21T03:04:28.147 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-21T03:04:28.147 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-21T03:04:28.148 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-21T03:04:28.148 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-21T03:04:28.148 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-21T03:04:28.148 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-21T03:04:28.148 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-21T03:04:28.148 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-21T03:04:28.148 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-21T03:04:28.148 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-21T03:04:28.148 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-21T03:04:28.148 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-21T03:04:28.148 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-21T03:04:28.148 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-21T03:04:28.148 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-21T03:04:28.148 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-21T03:04:28.148 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-21T03:04:28.148 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-21T03:04:28.149 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-21T03:04:28.149 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-21T03:04:28.149 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-21T03:04:28.149 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-21T03:04:28.149 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-21T03:04:28.149 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-21T03:04:28.149 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-21T03:04:28.149 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-21T03:04:28.149 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-21T03:04:28.149 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-21T03:04:28.149 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-21T03:04:28.149 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-21T03:04:28.149 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-21T03:04:28.149 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-21T03:04:28.149 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-21T03:04:28.150 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-21T03:04:28.150 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-21T03:04:28.150 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-21T03:04:28.150 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-21T03:04:28.150 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-21T03:04:28.150 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-21T03:04:28.150 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-21T03:04:28.150 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-21T03:04:28.150 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-21T03:04:28.150 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-21T03:04:28.150 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-21T03:04:28.150 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-21T03:04:28.150 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-21T03:04:28.150 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-21T03:04:28.150 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-21T03:04:28.151 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-21T03:04:28.151 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-21T03:04:28.151 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-21T03:04:28.151 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-21T03:04:28.151 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-21T03:04:28.151 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-21T03:04:28.151 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-21T03:04:28.151 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-21T03:04:28.151 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-21T03:04:28.151 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-21T03:04:28.151 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-21T03:04:28.151 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-21T03:04:28.152 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-21T03:04:28.152 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-21T03:04:28.152 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-21T03:04:28.152 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-21T03:04:28.152 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-21T03:04:28.152 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-21T03:04:28.152 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-21T03:04:28.152 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-21T03:04:28.152 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-21T03:04:28.152 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-21T03:04:28.152 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-21T03:04:28.152 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-21T03:04:28.152 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-21T03:04:28.152 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-21T03:04:28.152 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-21T03:04:28.153 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-21T03:04:28.153 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-21T03:04:28.153 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-21T03:04:28.153 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-21T03:04:28.153 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-21T03:04:28.153 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-21T03:04:28.153 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-21T03:04:28.153 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-21T03:04:28.153 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-21T03:04:28.153 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-21T03:04:28.153 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-21T03:04:28.153 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-21T03:04:28.153 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-21T03:04:28.153 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-21T03:04:28.153 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-21T03:04:28.154 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-21T03:04:28.154 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-21T03:04:28.154 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-21T03:04:28.154 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-21T03:04:28.154 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-21T03:04:28.154 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-21T03:04:28.154 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-21T03:04:28.154 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-21T03:04:28.154 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-21T03:04:28.154 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-21T03:04:28.154 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-21T03:04:28.154 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-21T03:04:28.154 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-21T03:04:28.154 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-21T03:04:28.155 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-21T03:04:28.155 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-21T03:04:28.155 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-21T03:04:28.155 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-21T03:04:28.155 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-21T03:04:28.155 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-21T03:04:28.155 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-21T03:04:28.155 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-21T03:04:28.155 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-21T03:04:28.155 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-21T03:04:28.155 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-21T03:04:28.155 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-21T03:04:28.155 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-21T03:04:28.156 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-21T03:04:28.156 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-21T03:04:28.156 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-21T03:04:28.156 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-21T03:04:28.156 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-21T03:04:28.156 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-21T03:04:28.156 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-21T03:04:28.156 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-21T03:04:28.156 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-21T03:04:28.156 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-21T03:04:28.156 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-21T03:04:28.156 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-21T03:04:28.156 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-21T03:04:28.157 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-21T03:04:28.157 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-21T03:04:28.157 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-21T03:04:28.157 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-21T03:04:28.157 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-21T03:04:28.157 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-21T03:04:28.157 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-21T03:04:28.157 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-21T03:04:28.157 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-21T03:04:28.157 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-21T03:04:28.157 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-21T03:04:28.157 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-21T03:04:28.157 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-21T03:04:28.157 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-21T03:04:28.157 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-21T03:04:28.157 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-21T03:04:28.158 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-21T03:04:28.158 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-21T03:04:28.158 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-21T03:04:28.158 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-21T03:04:28.158 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-21T03:04:28.158 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-21T03:04:28.158 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-21T03:04:28.158 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-21T03:04:28.158 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-21T03:04:28.158 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-21T03:04:28.158 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-21T03:04:28.158 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-21T03:04:28.158 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-21T03:04:28.158 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-21T03:04:28.158 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-21T03:04:28.159 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-21T03:04:28.159 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-21T03:04:28.159 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-21T03:04:28.159 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-21T03:04:28.159 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-21T03:04:28.159 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-21T03:04:28.159 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-21T03:04:28.159 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-21T03:04:28.159 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-21T03:04:28.159 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-21T03:04:28.159 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-21T03:04:28.159 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-21T03:04:28.159 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-21T03:04:28.159 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-21T03:04:28.159 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-21T03:04:28.159 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-21T03:04:28.160 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-21T03:04:28.160 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-21T03:04:28.160 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-21T03:04:28.160 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-21T03:04:28.160 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-21T03:04:28.160 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-21T03:04:28.160 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-21T03:04:28.160 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-21T03:04:28.160 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-21T03:04:28.160 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-21T03:04:28.160 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-21T03:04:28.160 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-21T03:04:28.160 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-21T03:04:28.160 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-21T03:04:28.160 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-21T03:04:28.161 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-21T03:04:28.161 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-21T03:04:28.161 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-21T03:04:28.161 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-21T03:04:28.161 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-21T03:04:28.161 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-21T03:04:28.161 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-21T03:04:28.161 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-21T03:04:28.161 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-21T03:04:28.161 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-21T03:04:28.161 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-21T03:04:28.161 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-21T03:04:28.161 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-21T03:04:28.161 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-21T03:04:28.161 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-21T03:04:28.161 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-21T03:04:28.162 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-21T03:04:28.162 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-21T03:04:28.162 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-21T03:04:28.162 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-21T03:04:28.162 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-21T03:04:28.162 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-21T03:04:28.162 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-21T03:04:28.162 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-21T03:04:28.162 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-21T03:04:28.162 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-21T03:04:28.162 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-21T03:04:28.162 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-21T03:04:28.162 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-21T03:04:28.162 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-21T03:04:28.162 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-21T03:04:28.163 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-21T03:04:28.163 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-21T03:04:28.163 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-21T03:04:28.163 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-21T03:04:28.163 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-21T03:04:28.163 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-21T03:04:28.163 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-21T03:04:28.163 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-21T03:04:28.163 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-21T03:04:28.163 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-21T03:04:28.163 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-21T03:04:28.163 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-21T03:04:28.163 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-21T03:04:28.163 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-21T03:04:28.163 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-21T03:04:28.163 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-21T03:04:28.164 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-21T03:04:28.164 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-21T03:04:28.164 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-21T03:04:28.164 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-21T03:04:28.164 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-21T03:04:28.164 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-21T03:04:28.164 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-21T03:04:28.164 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-21T03:04:28.164 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-21T03:04:28.164 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-21T03:04:28.164 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-21T03:04:28.164 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-21T03:04:28.164 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-21T03:04:28.164 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-21T03:04:28.164 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-21T03:04:28.164 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-21T03:04:28.165 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-21T03:04:28.165 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-21T03:04:28.165 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-21T03:04:28.165 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-21T03:04:28.165 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-21T03:04:28.165 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-21T03:04:28.165 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-21T03:04:28.165 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-21T03:04:28.165 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-21T03:04:28.165 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-21T03:04:28.165 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-21T03:04:28.165 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-21T03:04:28.165 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-21T03:04:28.165 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-21T03:04:28.165 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-21T03:04:28.166 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-21T03:04:28.166 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-21T03:04:28.166 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-21T03:04:28.166 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-21T03:04:28.166 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-21T03:04:28.166 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-21T03:04:28.166 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-21T03:04:28.166 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-21T03:04:28.166 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-21T03:04:28.166 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-21T03:04:28.166 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-21T03:04:28.166 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-21T03:04:28.166 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-21T03:04:28.166 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-21T03:04:28.166 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-21T03:04:28.166 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-21T03:04:28.167 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-21T03:04:28.167 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-21T03:04:28.167 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-21T03:04:28.167 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-21T03:04:28.167 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-21T03:04:28.167 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-21T03:04:28.167 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-21T03:04:28.167 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-21T03:04:28.167 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-21T03:04:28.167 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-21T03:04:28.167 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-21T03:04:28.167 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-21T03:04:28.167 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-21T03:04:28.167 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-21T03:04:28.167 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-21T03:04:28.168 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-21T03:04:28.168 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-21T03:04:28.168 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-21T03:04:28.168 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-21T03:04:28.168 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-21T03:04:28.168 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-21T03:04:28.168 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-21T03:04:28.168 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-21T03:04:28.168 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-21T03:04:28.168 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-21T03:04:28.168 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-21T03:04:28.168 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-21T03:04:28.168 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-21T03:04:28.168 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-21T03:04:28.168 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-21T03:04:28.168 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-21T03:04:28.169 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-21T03:04:28.169 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-21T03:04:28.169 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-21T03:04:28.169 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-21T03:04:28.169 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-21T03:04:28.169 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-21T03:04:28.169 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-21T03:04:28.169 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-21T03:04:28.169 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-21T03:04:28.169 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-21T03:04:28.169 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-21T03:04:28.169 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-21T03:04:28.169 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-21T03:04:28.169 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-21T03:04:28.169 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-21T03:04:28.169 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-21T03:04:28.169 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-21T03:04:28.170 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-21T03:04:28.170 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-21T03:04:28.170 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-21T03:04:28.170 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-21T03:04:28.170 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-21T03:04:28.170 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-21T03:04:28.170 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-21T03:04:28.170 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-21T03:04:28.170 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-21T03:04:28.170 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-21T03:04:28.170 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-21T03:04:28.170 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-21T03:04:28.170 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-21T03:04:28.170 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-21T03:04:28.170 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-21T03:04:28.170 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-21T03:04:28.171 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-21T03:04:28.171 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-21T03:04:28.171 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-21T03:04:28.171 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-21T03:04:28.171 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-21T03:04:28.171 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-21T03:04:28.171 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-21T03:04:28.171 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-21T03:04:28.171 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-21T03:04:28.171 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-21T03:04:28.171 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-21T03:04:28.171 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-21T03:04:28.171 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-21T03:04:28.171 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-21T03:04:28.171 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-21T03:04:28.171 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-21T03:04:28.172 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-21T03:04:28.172 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-21T03:04:28.172 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-21T03:04:28.172 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-21T03:04:28.172 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-21T03:04:28.172 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-21T03:04:28.172 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-21T03:04:28.172 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-21T03:04:28.172 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-21T03:04:28.172 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-21T03:04:28.172 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-21T03:04:28.172 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-21T03:04:28.172 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-21T03:04:28.172 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-21T03:04:28.172 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-21T03:04:28.172 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-21T03:04:28.172 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-21T03:04:28.173 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-21T03:04:28.173 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-21T03:04:28.173 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-21T03:04:28.173 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-21T03:04:28.173 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-21T03:04:28.173 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-21T03:04:28.173 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-21T03:04:28.173 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-21T03:04:28.173 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-21T03:04:28.173 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-21T03:04:28.173 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-21T03:04:28.173 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-21T03:04:28.173 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-21T03:04:28.173 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-21T03:04:28.173 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-21T03:04:28.173 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-21T03:04:28.174 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-21T03:04:28.174 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-21T03:04:28.174 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-21T03:04:28.174 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-21T03:04:28.174 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-21T03:04:28.174 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-21T03:04:28.174 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-21T03:04:28.174 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-21T03:04:28.174 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-21T03:04:28.174 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-21T03:04:28.174 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-21T03:04:28.174 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-21T03:04:28.174 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-21T03:04:28.174 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-21T03:04:28.175 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-21T03:04:28.175 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-21T03:04:28.175 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-21T03:04:28.175 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-21T03:04:28.175 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-21T03:04:28.175 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-21T03:04:28.175 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-21T03:04:28.175 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-21T03:04:28.175 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-21T03:04:28.175 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-21T03:04:28.175 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-21T03:04:28.175 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-21T03:04:28.175 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-21T03:04:28.175 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-21T03:04:28.176 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-21T03:04:28.176 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-21T03:04:28.176 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-21T03:04:28.176 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-21T03:04:28.176 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-21T03:04:28.176 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-21T03:04:28.176 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-21T03:04:28.176 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-21T03:04:28.176 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-21T03:04:28.176 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-21T03:04:28.176 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-21T03:04:28.176 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-21T03:04:28.176 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-21T03:04:28.176 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-21T03:04:28.176 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-21T03:04:28.176 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-21T03:04:28.177 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-21T03:04:28.177 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-21T03:04:28.177 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-21T03:04:28.177 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-21T03:04:28.177 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-21T03:04:28.177 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-21T03:04:28.177 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-21T03:04:28.177 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-21T03:04:28.177 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-21T03:04:28.177 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-21T03:04:28.177 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-21T03:04:28.177 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-21T03:04:28.177 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-21T03:04:28.177 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-21T03:04:28.177 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-21T03:04:28.177 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-21T03:04:28.178 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-21T03:04:28.178 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-21T03:04:28.178 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-21T03:04:28.178 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-21T03:04:28.178 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-21T03:04:28.178 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-21T03:04:28.178 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-21T03:04:28.178 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-21T03:04:28.178 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-21T03:04:28.178 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-21T03:04:28.178 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-21T03:04:28.178 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-21T03:04:28.178 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-21T03:04:28.178 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-21T03:04:28.178 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-21T03:04:28.179 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-21T03:04:28.179 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-21T03:04:28.179 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-21T03:04:28.179 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-21T03:04:28.179 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-21T03:04:28.179 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-21T03:04:28.179 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-21T03:04:28.179 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-21T03:04:28.179 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-21T03:04:28.179 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-21T03:04:28.179 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-21T03:04:28.179 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-21T03:04:28.179 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-21T03:04:28.179 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-21T03:04:28.180 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-21T03:04:28.180 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-21T03:04:28.180 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-21T03:04:28.180 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-21T03:04:28.180 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-21T03:04:28.180 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-21T03:04:28.180 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-21T03:04:28.180 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-21T03:04:28.180 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-21T03:04:28.180 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-21T03:04:28.180 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-21T03:04:28.180 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-21T03:04:28.180 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-21T03:04:28.180 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-21T03:04:28.181 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-21T03:04:28.181 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-21T03:04:28.181 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-21T03:04:28.181 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-21T03:04:28.181 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-21T03:04:28.181 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-21T03:04:28.181 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-21T03:04:28.181 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-21T03:04:28.181 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-21T03:04:28.181 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-21T03:04:28.181 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-21T03:04:28.181 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-21T03:04:28.181 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-21T03:04:28.181 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-21T03:04:28.182 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-21T03:04:28.182 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-21T03:04:28.182 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-21T03:04:28.182 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-21T03:04:28.182 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-21T03:04:28.182 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-21T03:04:28.182 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-21T03:04:28.182 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-21T03:04:28.182 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-21T03:04:28.182 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-21T03:04:28.182 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-21T03:04:28.182 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-21T03:04:28.182 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-21T03:04:28.182 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-21T03:04:28.182 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-21T03:04:28.183 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-21T03:04:28.183 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-21T03:04:28.183 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-21T03:04:28.183 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-21T03:04:28.183 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-21T03:04:28.183 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-21T03:04:28.183 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-21T03:04:28.183 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-21T03:04:28.183 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-21T03:04:28.183 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-21T03:04:28.183 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-21T03:04:28.183 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-21T03:04:28.183 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-21T03:04:28.183 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-21T03:04:28.184 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-21T03:04:28.184 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-21T03:04:28.184 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-21T03:04:28.184 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-21T03:04:28.184 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-21T03:04:28.184 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-21T03:04:28.184 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-21T03:04:28.184 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-21T03:04:28.184 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-21T03:04:28.184 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-21T03:04:28.184 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-21T03:04:28.184 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-21T03:04:28.184 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-21T03:04:28.184 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-21T03:04:28.184 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-21T03:04:28.185 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-21T03:04:28.185 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-21T03:04:28.185 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-21T03:04:28.185 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-21T03:04:28.185 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-21T03:04:28.185 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-21T03:04:28.185 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-21T03:04:28.185 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-21T03:04:28.185 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-21T03:04:28.185 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-21T03:04:28.185 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-21T03:04:28.185 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-21T03:04:28.185 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-21T03:04:28.185 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-21T03:04:28.186 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-21T03:04:28.186 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-21T03:04:28.186 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-21T03:04:28.186 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-21T03:04:28.186 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-21T03:04:28.186 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-21T03:04:28.186 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-21T03:04:28.186 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-21T03:04:28.186 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-21T03:04:28.186 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-21T03:04:28.186 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-21T03:04:28.186 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-21T03:04:28.186 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-21T03:04:28.186 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-21T03:04:28.187 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-21T03:04:28.187 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-21T03:04:28.187 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-21T03:04:28.187 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-21T03:04:28.187 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-21T03:04:28.187 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-21T03:04:28.187 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-21T03:04:28.187 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-21T03:04:28.187 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-21T03:04:28.187 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-21T03:04:28.187 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-21T03:04:28.187 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-21T03:04:28.187 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-21T03:04:28.187 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-21T03:04:28.187 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-21T03:04:28.188 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-21T03:04:28.188 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-21T03:04:28.188 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-21T03:04:28.188 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-21T03:04:28.188 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-21T03:04:28.188 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-21T03:04:28.188 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-21T03:04:28.188 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-21T03:04:28.188 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-21T03:04:28.188 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-21T03:04:28.188 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-21T03:04:28.188 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-21T03:04:28.188 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-21T03:04:28.188 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-21T03:04:28.188 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-21T03:04:28.189 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-21T03:04:28.189 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-21T03:04:28.189 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-21T03:04:28.189 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-21T03:04:28.189 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-21T03:04:28.189 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-21T03:04:28.189 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-21T03:04:28.189 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-21T03:04:28.189 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-21T03:04:28.189 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-21T03:04:28.189 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-21T03:04:28.189 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-21T03:04:28.189 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-21T03:04:28.189 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-21T03:04:28.189 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-21T03:04:28.189 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-21T03:04:28.190 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-21T03:04:28.190 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-21T03:04:28.190 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-21T03:04:28.190 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-21T03:04:28.190 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-21T03:04:28.190 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-21T03:04:28.190 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-21T03:04:28.190 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-21T03:04:28.190 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-21T03:04:28.190 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-21T03:04:28.190 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-21T03:04:28.190 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-21T03:04:28.190 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-21T03:04:28.190 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-21T03:04:28.191 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-21T03:04:28.191 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-21T03:04:28.191 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-21T03:04:28.191 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-21T03:04:28.191 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-21T03:04:28.191 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-21T03:04:28.191 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-21T03:04:28.191 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-21T03:04:28.191 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-21T03:04:28.191 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-21T03:04:28.191 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-21T03:04:28.191 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-21T03:04:28.191 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-21T03:04:28.191 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-21T03:04:28.191 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-21T03:04:28.192 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-21T03:04:28.192 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-21T03:04:28.192 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-21T03:04:28.193 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-21T03:04:28.193 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-21T03:04:28.193 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-21T03:04:28.193 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-21T03:04:28.193 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-21T03:04:28.193 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-21T03:04:28.193 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-21T03:04:28.193 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-21T03:04:28.193 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-21T03:04:28.194 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-21T03:04:28.194 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-21T03:04:28.194 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-21T03:04:28.194 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-21T03:04:28.194 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-21T03:04:28.194 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-21T03:04:28.194 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-21T03:04:28.194 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-21T03:04:28.194 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-21T03:04:28.194 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-21T03:04:28.194 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-21T03:04:28.194 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-21T03:04:28.194 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-21T03:04:28.194 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-21T03:04:28.195 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-21T03:04:28.195 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-21T03:04:28.195 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-21T03:04:28.195 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-21T03:04:28.195 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-21T03:04:28.195 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-21T03:04:28.195 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-21T03:04:28.195 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-21T03:04:28.195 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-21T03:04:28.195 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-21T03:04:28.195 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-21T03:04:28.195 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-21T03:04:28.195 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-21T03:04:28.195 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-21T03:04:28.195 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-21T03:04:28.195 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-21T03:04:28.196 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-21T03:04:28.196 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-21T03:04:28.196 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-21T03:04:28.196 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-21T03:04:28.196 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-21T03:04:28.196 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-21T03:04:28.196 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-21T03:04:28.196 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-21T03:04:28.196 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-21T03:04:28.196 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-21T03:04:28.196 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-21T03:04:28.196 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-21T03:04:28.196 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-21T03:04:28.196 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-21T03:04:28.196 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-21T03:04:28.196 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-21T03:04:28.197 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-21T03:04:28.197 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-21T03:04:28.197 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-21T03:04:28.197 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-21T03:04:28.197 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-21T03:04:28.197 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-21T03:04:28.197 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-21T03:04:28.197 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-21T03:04:28.197 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-21T03:04:28.197 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-21T03:04:28.197 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-21T03:04:28.197 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-21T03:04:28.197 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-21T03:04:28.197 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-21T03:04:28.198 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-21T03:04:28.198 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-21T03:04:28.198 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-21T03:04:28.198 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-21T03:04:28.198 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-21T03:04:28.198 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-21T03:04:28.198 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-21T03:04:28.198 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-21T03:04:28.198 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-21T03:04:28.198 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-21T03:04:28.198 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-21T03:04:28.198 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-21T03:04:28.198 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-21T03:04:28.198 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-21T03:04:28.198 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-21T03:04:28.199 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-21T03:04:28.199 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-21T03:04:28.199 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-21T03:04:28.199 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-21T03:04:28.199 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-21T03:04:28.199 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-21T03:04:28.199 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-21T03:04:28.199 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-21T03:04:28.199 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-21T03:04:28.199 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-21T03:04:28.199 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-21T03:04:28.199 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-21T03:04:28.199 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-21T03:04:28.199 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-21T03:04:28.199 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-21T03:04:28.199 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-21T03:04:28.200 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-21T03:04:28.200 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-21T03:04:28.200 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-21T03:04:28.200 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-21T03:04:28.200 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-21T03:04:28.200 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-21T03:04:28.200 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-21T03:04:28.200 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-21T03:04:28.200 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-21T03:04:28.200 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-21T03:04:28.200 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-21T03:04:28.200 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-21T03:04:28.200 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-21T03:04:28.200 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-21T03:04:28.200 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-21T03:04:28.200 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-21T03:04:28.201 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-21T03:04:28.201 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-21T03:04:28.201 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-21T03:04:28.201 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-21T03:04:28.201 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-21T03:04:28.201 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-21T03:04:28.201 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-21T03:04:28.201 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-21T03:04:28.201 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-21T03:04:28.201 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-21T03:04:28.201 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-21T03:04:28.201 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-21T03:04:28.202 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-21T03:04:28.202 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-21T03:04:28.202 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-21T03:04:28.202 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-21T03:04:28.202 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-21T03:04:28.202 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-21T03:04:28.202 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-21T03:04:28.202 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-21T03:04:28.202 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-21T03:04:28.202 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-21T03:04:28.202 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-21T03:04:28.202 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-21T03:04:28.202 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-21T03:04:28.202 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-21T03:04:28.202 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-21T03:04:28.203 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-21T03:04:28.203 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-21T03:04:28.203 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-21T03:04:28.203 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-21T03:04:28.203 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-21T03:04:28.203 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-21T03:04:28.203 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-21T03:04:28.203 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-21T03:04:28.203 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-21T03:04:28.203 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-21T03:04:28.203 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-21T03:04:28.203 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-21T03:04:28.203 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-21T03:04:28.203 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-21T03:04:28.204 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-21T03:04:28.204 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-21T03:04:28.204 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-21T03:04:28.204 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-21T03:04:28.204 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-21T03:04:28.204 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-21T03:04:28.204 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-21T03:04:28.204 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-21T03:04:28.204 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-21T03:04:28.204 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-21T03:04:28.204 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-21T03:04:28.204 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-21T03:04:28.204 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-21T03:04:28.204 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-21T03:04:28.204 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-21T03:04:28.205 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-21T03:04:28.205 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-21T03:04:28.205 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-21T03:04:28.205 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-21T03:04:28.205 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-21T03:04:28.205 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-21T03:04:28.205 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-21T03:04:28.205 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-21T03:04:28.205 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-21T03:04:28.205 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-21T03:04:28.205 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-21T03:04:28.205 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-21T03:04:28.205 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-21T03:04:28.205 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-21T03:04:28.205 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-21T03:04:28.206 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-21T03:04:28.206 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-21T03:04:28.206 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-21T03:04:28.206 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-21T03:04:28.206 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-21T03:04:28.206 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-21T03:04:28.206 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-21T03:04:28.206 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-21T03:04:28.206 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-21T03:04:28.206 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-21T03:04:28.206 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-21T03:04:28.206 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-21T03:04:28.206 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-21T03:04:28.206 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-21T03:04:28.207 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-21T03:04:28.207 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-21T03:04:28.207 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-21T03:04:28.207 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-21T03:04:28.207 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-21T03:04:28.207 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-21T03:04:28.207 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-21T03:04:28.207 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-21T03:04:28.207 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-21T03:04:28.207 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-21T03:04:28.207 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-21T03:04:28.207 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-21T03:04:28.207 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-21T03:04:28.207 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-21T03:04:28.208 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-21T03:04:28.208 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-21T03:04:28.208 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-21T03:04:28.208 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-21T03:04:28.208 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-21T03:04:28.208 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-21T03:04:28.208 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-21T03:04:28.208 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-21T03:04:28.208 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-21T03:04:28.208 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-21T03:04:28.208 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-21T03:04:28.208 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-21T03:04:28.208 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-21T03:04:28.208 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-21T03:04:28.208 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-21T03:04:28.208 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-21T03:04:28.209 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-21T03:04:28.209 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-21T03:04:28.209 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-21T03:04:28.209 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-21T03:04:28.209 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-21T03:04:28.209 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-21T03:04:28.209 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-21T03:04:28.209 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-21T03:04:28.209 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-21T03:04:28.209 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-21T03:04:28.209 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-21T03:04:28.209 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-21T03:04:28.209 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-21T03:04:28.209 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-21T03:04:28.209 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-21T03:04:28.209 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-21T03:04:28.210 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-21T03:04:28.210 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-21T03:04:28.210 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-21T03:04:28.210 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-21T03:04:28.210 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-21T03:04:28.210 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-21T03:04:28.210 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-21T03:04:28.210 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-21T03:04:28.210 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-21T03:04:28.210 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-21T03:04:28.210 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-21T03:04:28.210 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-21T03:04:28.210 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-21T03:04:28.210 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-21T03:04:28.210 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-21T03:04:28.211 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-21T03:04:28.211 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-21T03:04:28.211 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-21T03:04:28.211 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-21T03:04:28.211 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-21T03:04:28.211 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-21T03:04:28.211 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-21T03:04:28.211 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-21T03:04:28.211 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-21T03:04:28.211 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-21T03:04:28.211 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-21T03:04:28.211 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-21T03:04:28.211 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-21T03:04:28.211 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-21T03:04:28.211 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-21T03:04:28.211 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-21T03:04:28.212 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-21T03:04:28.212 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-21T03:04:28.212 INFO:teuthology.orchestra.run.smithi090.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-21T03:04:28.215 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:04:28.215 DEBUG:teuthology.orchestra.run.smithi090:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-21T03:04:28.239 INFO:teuthology.orchestra.run.smithi090.stdout:postinstall scriptlet (using /bin/sh): 2024-09-21T03:04:28.239 INFO:teuthology.orchestra.run.smithi090.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-21T03:04:28.239 INFO:teuthology.orchestra.run.smithi090.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-21T03:04:28.239 INFO:teuthology.orchestra.run.smithi090.stdout:fi 2024-09-21T03:04:28.239 INFO:teuthology.orchestra.run.smithi090.stdout:for file in vmlinuz System.map config; do 2024-09-21T03:04:28.239 INFO:teuthology.orchestra.run.smithi090.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-21T03:04:28.240 INFO:teuthology.orchestra.run.smithi090.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T03:04:28.240 INFO:teuthology.orchestra.run.smithi090.stdout: fi 2024-09-21T03:04:28.240 INFO:teuthology.orchestra.run.smithi090.stdout:done 2024-09-21T03:04:28.240 INFO:teuthology.orchestra.run.smithi090.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-21T03:04:28.240 INFO:teuthology.orchestra.run.smithi090.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-21T03:04:28.240 INFO:teuthology.orchestra.run.smithi090.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T03:04:28.240 INFO:teuthology.orchestra.run.smithi090.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T03:04:28.240 INFO:teuthology.orchestra.run.smithi090.stdout:fi 2024-09-21T03:04:28.240 INFO:teuthology.orchestra.run.smithi090.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-21T03:04:28.240 INFO:teuthology.orchestra.run.smithi090.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:04:28.240 INFO:teuthology.orchestra.run.smithi090.stdout:fi 2024-09-21T03:04:28.240 INFO:teuthology.orchestra.run.smithi090.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-21T03:04:28.240 INFO:teuthology.orchestra.run.smithi090.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-21T03:04:28.240 INFO:teuthology.orchestra.run.smithi090.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:04:28.240 INFO:teuthology.orchestra.run.smithi090.stdout:fi 2024-09-21T03:04:28.241 DEBUG:teuthology.orchestra.run.smithi090:> sudo rpm -qi grub2-tools 2024-09-21T03:04:28.315 INFO:teuthology.orchestra.run.smithi090.stdout:Name : grub2-tools 2024-09-21T03:04:28.315 INFO:teuthology.orchestra.run.smithi090.stdout:Epoch : 1 2024-09-21T03:04:28.315 INFO:teuthology.orchestra.run.smithi090.stdout:Version : 2.06 2024-09-21T03:04:28.315 INFO:teuthology.orchestra.run.smithi090.stdout:Release : 82.el9 2024-09-21T03:04:28.315 INFO:teuthology.orchestra.run.smithi090.stdout:Architecture: x86_64 2024-09-21T03:04:28.315 INFO:teuthology.orchestra.run.smithi090.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T03:04:28.315 INFO:teuthology.orchestra.run.smithi090.stdout:Group : Unspecified 2024-09-21T03:04:28.315 INFO:teuthology.orchestra.run.smithi090.stdout:Size : 8274670 2024-09-21T03:04:28.316 INFO:teuthology.orchestra.run.smithi090.stdout:License : GPLv3+ 2024-09-21T03:04:28.316 INFO:teuthology.orchestra.run.smithi090.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T03:04:28.316 INFO:teuthology.orchestra.run.smithi090.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T03:04:28.316 INFO:teuthology.orchestra.run.smithi090.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T03:04:28.316 INFO:teuthology.orchestra.run.smithi090.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T03:04:28.316 INFO:teuthology.orchestra.run.smithi090.stdout:Packager : builder@centos.org 2024-09-21T03:04:28.316 INFO:teuthology.orchestra.run.smithi090.stdout:Vendor : CentOS 2024-09-21T03:04:28.316 INFO:teuthology.orchestra.run.smithi090.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T03:04:28.316 INFO:teuthology.orchestra.run.smithi090.stdout:Summary : Support tools for GRUB. 2024-09-21T03:04:28.316 INFO:teuthology.orchestra.run.smithi090.stdout:Description : 2024-09-21T03:04:28.316 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:04:28.316 INFO:teuthology.orchestra.run.smithi090.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T03:04:28.316 INFO:teuthology.orchestra.run.smithi090.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T03:04:28.316 INFO:teuthology.orchestra.run.smithi090.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T03:04:28.316 INFO:teuthology.orchestra.run.smithi090.stdout:hardware devices. 2024-09-21T03:04:28.317 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:04:28.317 INFO:teuthology.orchestra.run.smithi090.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T03:04:28.317 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T03:04:28.317 INFO:teuthology.task.kernel:Updating grub on smithi090 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:04:28.317 DEBUG:teuthology.orchestra.run.smithi090:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T03:04:28.886 INFO:teuthology.orchestra.run.smithi090.stderr:Generating grub configuration file ... 2024-09-21T03:04:30.660 INFO:teuthology.orchestra.run.smithi090.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T03:04:30.678 INFO:teuthology.orchestra.run.smithi090.stderr:done 2024-09-21T03:04:30.680 DEBUG:teuthology.orchestra.run.smithi090:> mktemp 2024-09-21T03:04:30.703 INFO:teuthology.orchestra.run.smithi090.stdout:/tmp/tmp.dDAadAZb33 2024-09-21T03:04:30.704 DEBUG:teuthology.orchestra.run.smithi090:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dDAadAZb33 2024-09-21T03:04:30.770 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0666 /tmp/tmp.dDAadAZb33 2024-09-21T03:04:30.915 DEBUG:teuthology.orchestra.remote:smithi090:/tmp/tmp.dDAadAZb33 is 6KB 2024-09-21T03:04:30.962 DEBUG:teuthology.orchestra.run.smithi090:> rm -fr /tmp/tmp.dDAadAZb33 2024-09-21T03:04:30.977 DEBUG:teuthology.orchestra.run.smithi090:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T03:04:31.049 INFO:teuthology.orchestra.run.smithi090.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T03:04:31.049 INFO:teuthology.orchestra.run.smithi090.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T03:04:31.049 INFO:teuthology.orchestra.run.smithi090.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T03:04:31.049 INFO:teuthology.orchestra.run.smithi090.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-21T03:04:31.051 DEBUG:teuthology.orchestra.run.smithi090:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:04:31.238 DEBUG:teuthology.orchestra.run.smithi090:> sudo shutdown -r now 2024-09-21T03:04:56.286 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-21T03:04:56.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T03:04:56.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:05:01.246 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T03:05:01.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-21T03:05:01.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:05:14.735 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-21T03:05:19.598 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-09-21T03:05:23.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T03:05:23.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:05:26.799 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-21T03:05:28.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-21T03:05:28.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:05:31.662 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-09-21T03:05:38.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T03:05:38.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:05:43.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-21T03:05:43.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:05:46.735 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-09-21T03:05:57.233 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-21T03:06:01.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-21T03:06:01.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:06:12.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T03:06:12.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:06:12.572 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-09-21T03:06:13.109 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T03:06:13.109 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-21T03:06:13.109 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-09-21T03:06:13.143 INFO:teuthology.orchestra.run.smithi149.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:06:13.143 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:06:13.143 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T03:06:13.143 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T03:06:14.146 DEBUG:teuthology.parallel:result is None 2024-09-21T03:06:20.270 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-09-21T03:06:38.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-21T03:06:38.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:06:39.030 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-09-21T03:06:40.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-21T03:06:40.108 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-21T03:06:40.108 DEBUG:teuthology.orchestra.run.smithi090:> uname -r 2024-09-21T03:06:40.143 INFO:teuthology.orchestra.run.smithi090.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:06:40.143 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T03:06:40.143 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T03:06:40.143 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T03:06:41.144 DEBUG:teuthology.parallel:result is None 2024-09-21T03:06:41.144 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T03:06:41.151 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T03:06:41.151 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T03:06:41.155 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T03:06:41.197 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T03:06:41.203 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T03:06:41.232 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T03:06:41.233 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T03:06:41.236 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T03:06:41.311 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T03:06:41.317 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T03:06:41.317 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T03:06:41.321 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T03:06:41.457 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:06:41.488 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:06:41.605 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:06:41.632 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:06:41.636 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T03:06:41.642 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T03:06:41.643 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T03:06:41.647 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T03:06:41.704 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T03:06:41.712 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T03:06:41.712 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T03:06:41.717 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T03:06:41.751 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:06:41.854 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:06:41.966 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:06:42.024 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:06:42.101 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:06:42.102 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T03:06:42.157 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:06:42.217 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:06:42.299 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:06:42.360 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:06:42.432 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:06:42.432 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T03:06:42.486 DEBUG:teuthology.orchestra.run.smithi090:> sudo service rsyslog restart 2024-09-21T03:06:42.490 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2024-09-21T03:06:42.609 INFO:teuthology.orchestra.run.smithi090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:06:42.617 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:06:43.041 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T03:06:43.049 INFO:teuthology.task.internal:Starting timer... 2024-09-21T03:06:43.049 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T03:06:43.134 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T03:06:43.184 DEBUG:teuthology.orchestra.run.smithi090:> sudo service auditd rotate 2024-09-21T03:06:43.313 INFO:teuthology.orchestra.run.smithi090.stdout:Rotating logs: 2024-09-21T03:06:43.316 DEBUG:teuthology.orchestra.run.smithi149:> sudo service auditd rotate 2024-09-21T03:06:43.409 INFO:teuthology.orchestra.run.smithi149.stdout:Rotating logs: 2024-09-21T03:06:43.413 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T03:06:43.413 DEBUG:teuthology.orchestra.run.smithi090:> /usr/sbin/getenforce 2024-09-21T03:06:43.451 INFO:teuthology.orchestra.run.smithi090.stdout:Permissive 2024-09-21T03:06:43.451 DEBUG:teuthology.orchestra.run.smithi149:> /usr/sbin/getenforce 2024-09-21T03:06:43.517 INFO:teuthology.orchestra.run.smithi149.stdout:Permissive 2024-09-21T03:06:43.517 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi090.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi149.front.sepia.ceph.com': 'permissive'} 2024-09-21T03:06:43.517 DEBUG:teuthology.orchestra.run.smithi090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T03:06:43.576 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:06:43.576 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T03:06:43.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:06:43.638 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T03:06:43.638 DEBUG:teuthology.orchestra.run.smithi090:> sudo /usr/sbin/setenforce permissive 2024-09-21T03:06:43.717 DEBUG:teuthology.orchestra.run.smithi149:> sudo /usr/sbin/setenforce permissive 2024-09-21T03:06:43.778 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T03:06:43.789 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T03:06:43.791 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T03:06:43.906 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T03:06:43.916 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T03:06:43.916 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi090.front.sepia.ceph.com,smithi149.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T03:11:36.400 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi090.front.sepia.ceph.com'), Remote(name='ubuntu@smithi149.front.sepia.ceph.com')] 2024-09-21T03:11:36.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-21T03:11:36.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:11:36.490 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-09-21T03:11:36.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-21T03:11:36.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T03:11:36.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:11:36.700 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-09-21T03:11:36.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T03:11:36.805 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T03:11:36.827 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T03:11:36.828 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T03:11:36.828 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:11:36.832 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T03:11:36.833 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:11:36.896 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T03:11:36.907 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T03:11:36.927 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T03:11:36.936 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T03:11:36.980 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: ntpd: command not found 2024-09-21T03:11:36.987 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: ntpd: command not found 2024-09-21T03:11:37.004 INFO:teuthology.orchestra.run.smithi090.stdout:506 Cannot talk to daemon 2024-09-21T03:11:37.011 INFO:teuthology.orchestra.run.smithi149.stdout:506 Cannot talk to daemon 2024-09-21T03:11:37.034 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T03:11:37.040 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T03:11:37.063 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T03:11:37.070 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T03:11:37.162 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:11:37.167 INFO:teuthology.orchestra.run.smithi090.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:11:37.169 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:11:37.169 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-09-21T03:11:37.169 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:11:37.169 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:11:37.169 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:11:37.170 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:11:37.174 INFO:teuthology.orchestra.run.smithi090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:11:37.174 INFO:teuthology.orchestra.run.smithi090.stdout:=============================================================================== 2024-09-21T03:11:37.174 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:11:37.174 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:11:37.174 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:11:37.174 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:11:37.175 INFO:teuthology.run_tasks:Running task install... 2024-09-21T03:11:37.185 DEBUG:teuthology.task.install:project ceph 2024-09-21T03:11:37.185 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T03:11:37.185 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T03:11:37.185 INFO:teuthology.task.install:Using flavor: default 2024-09-21T03:11:37.191 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T03:11:37.191 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T03:11:37.191 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T03:11:37.191 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:11:37.193 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T03:11:37.193 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:11:37.344 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T03:11:37.344 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T03:11:37.351 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T03:11:37.351 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T03:11:37.455 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T03:11:37.455 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:11:37.455 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T03:11:37.462 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T03:11:37.462 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:11:37.462 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T03:11:37.511 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T03:11:37.511 DEBUG:teuthology.orchestra.run.smithi090:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T03:11:37.519 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T03:11:37.519 DEBUG:teuthology.orchestra.run.smithi149:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T03:11:37.608 DEBUG:teuthology.orchestra.run.smithi090:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T03:11:37.616 DEBUG:teuthology.orchestra.run.smithi149:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T03:11:37.686 DEBUG:teuthology.orchestra.run.smithi090:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T03:11:37.694 DEBUG:teuthology.orchestra.run.smithi149:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T03:11:37.741 INFO:teuthology.orchestra.run.smithi090.stdout:check_obsoletes = 1 2024-09-21T03:11:37.744 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum clean all 2024-09-21T03:11:37.748 INFO:teuthology.orchestra.run.smithi149.stdout:check_obsoletes = 1 2024-09-21T03:11:37.752 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum clean all 2024-09-21T03:11:38.018 INFO:teuthology.orchestra.run.smithi090.stdout:45 files removed 2024-09-21T03:11:38.032 INFO:teuthology.orchestra.run.smithi149.stdout:45 files removed 2024-09-21T03:11:38.051 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T03:11:38.065 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T03:11:38.729 INFO:teuthology.orchestra.run.smithi090.stdout:ceph packages for x86_64 292 kB/s | 84 kB 00:00 2024-09-21T03:11:38.769 INFO:teuthology.orchestra.run.smithi149.stdout:ceph packages for x86_64 279 kB/s | 84 kB 00:00 2024-09-21T03:11:39.066 INFO:teuthology.orchestra.run.smithi090.stdout:ceph noarch packages 83 kB/s | 24 kB 00:00 2024-09-21T03:11:39.070 INFO:teuthology.orchestra.run.smithi149.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-21T03:11:39.347 INFO:teuthology.orchestra.run.smithi090.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-21T03:11:39.353 INFO:teuthology.orchestra.run.smithi149.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-21T03:11:39.806 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.3 MB 00:00 2024-09-21T03:11:39.970 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-21T03:11:41.899 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-21T03:11:43.371 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 8.9 MB/s | 20 MB 00:02 2024-09-21T03:11:47.518 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.5 MB 00:01 2024-09-21T03:11:49.161 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 19 kB 00:00 2024-09-21T03:11:50.058 INFO:teuthology.orchestra.run.smithi090.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-21T03:11:50.197 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 6.5 MB 00:02 2024-09-21T03:11:51.772 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 19 kB 00:00 2024-09-21T03:11:53.061 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-21T03:11:56.381 INFO:teuthology.orchestra.run.smithi090.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-09-21T03:11:58.782 INFO:teuthology.orchestra.run.smithi090.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:11:58.783 INFO:teuthology.orchestra.run.smithi090.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:11:58.796 INFO:teuthology.orchestra.run.smithi090.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T03:11:58.797 INFO:teuthology.orchestra.run.smithi090.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T03:11:58.799 INFO:teuthology.orchestra.run.smithi090.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T03:11:58.800 INFO:teuthology.orchestra.run.smithi090.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T03:11:58.802 INFO:teuthology.orchestra.run.smithi090.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T03:11:58.804 INFO:teuthology.orchestra.run.smithi090.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T03:11:58.806 INFO:teuthology.orchestra.run.smithi090.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T03:11:58.870 INFO:teuthology.orchestra.run.smithi090.stdout:Dependencies resolved. 2024-09-21T03:11:58.894 INFO:teuthology.orchestra.run.smithi090.stdout:======================================================================================= 2024-09-21T03:11:58.894 INFO:teuthology.orchestra.run.smithi090.stdout: Package Arch Version Repository Size 2024-09-21T03:11:58.894 INFO:teuthology.orchestra.run.smithi090.stdout:======================================================================================= 2024-09-21T03:11:58.894 INFO:teuthology.orchestra.run.smithi090.stdout:Installing: 2024-09-21T03:11:58.894 INFO:teuthology.orchestra.run.smithi090.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T03:11:58.894 INFO:teuthology.orchestra.run.smithi090.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T03:11:58.894 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T03:11:58.894 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T03:11:58.894 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:11:58.894 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T03:11:58.894 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T03:11:58.894 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T03:11:58.894 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T03:11:58.895 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T03:11:58.895 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T03:11:58.895 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T03:11:58.895 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T03:11:58.895 INFO:teuthology.orchestra.run.smithi090.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T03:11:58.895 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T03:11:58.895 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T03:11:58.895 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T03:11:58.895 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T03:11:58.895 INFO:teuthology.orchestra.run.smithi090.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T03:11:58.895 INFO:teuthology.orchestra.run.smithi090.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T03:11:58.895 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T03:11:58.895 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T03:11:58.895 INFO:teuthology.orchestra.run.smithi090.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T03:11:58.896 INFO:teuthology.orchestra.run.smithi090.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T03:11:58.896 INFO:teuthology.orchestra.run.smithi090.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T03:11:58.896 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T03:11:58.896 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T03:11:58.896 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T03:11:58.896 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T03:11:58.896 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T03:11:58.896 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T03:11:58.896 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T03:11:58.896 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T03:11:58.896 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T03:11:58.896 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T03:11:58.896 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T03:11:58.896 INFO:teuthology.orchestra.run.smithi090.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T03:11:58.896 INFO:teuthology.orchestra.run.smithi090.stdout:Upgrading: 2024-09-21T03:11:58.897 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T03:11:58.897 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T03:11:58.897 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T03:11:58.897 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T03:11:58.897 INFO:teuthology.orchestra.run.smithi090.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T03:11:58.897 INFO:teuthology.orchestra.run.smithi090.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T03:11:58.897 INFO:teuthology.orchestra.run.smithi090.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T03:11:58.897 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T03:11:58.897 INFO:teuthology.orchestra.run.smithi090.stdout:Installing dependencies: 2024-09-21T03:11:58.897 INFO:teuthology.orchestra.run.smithi090.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T03:11:58.897 INFO:teuthology.orchestra.run.smithi090.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T03:11:58.897 INFO:teuthology.orchestra.run.smithi090.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T03:11:58.897 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T03:11:58.897 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T03:11:58.898 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T03:11:58.898 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T03:11:58.898 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T03:11:58.898 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T03:11:58.898 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T03:11:58.898 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T03:11:58.898 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T03:11:58.898 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T03:11:58.898 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T03:11:58.898 INFO:teuthology.orchestra.run.smithi090.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T03:11:58.898 INFO:teuthology.orchestra.run.smithi090.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T03:11:58.898 INFO:teuthology.orchestra.run.smithi090.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T03:11:58.898 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T03:11:58.899 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T03:11:58.899 INFO:teuthology.orchestra.run.smithi090.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T03:11:58.899 INFO:teuthology.orchestra.run.smithi090.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T03:11:58.899 INFO:teuthology.orchestra.run.smithi090.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T03:11:58.899 INFO:teuthology.orchestra.run.smithi090.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T03:11:58.899 INFO:teuthology.orchestra.run.smithi090.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T03:11:58.899 INFO:teuthology.orchestra.run.smithi090.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T03:11:58.899 INFO:teuthology.orchestra.run.smithi090.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T03:11:58.899 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T03:11:58.899 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T03:11:58.899 INFO:teuthology.orchestra.run.smithi090.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T03:11:58.899 INFO:teuthology.orchestra.run.smithi090.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T03:11:58.899 INFO:teuthology.orchestra.run.smithi090.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T03:11:58.899 INFO:teuthology.orchestra.run.smithi090.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T03:11:58.899 INFO:teuthology.orchestra.run.smithi090.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T03:11:58.900 INFO:teuthology.orchestra.run.smithi090.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T03:11:58.900 INFO:teuthology.orchestra.run.smithi090.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T03:11:58.900 INFO:teuthology.orchestra.run.smithi090.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T03:11:58.900 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T03:11:58.900 INFO:teuthology.orchestra.run.smithi090.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T03:11:58.900 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T03:11:58.900 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T03:11:58.900 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T03:11:58.900 INFO:teuthology.orchestra.run.smithi090.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T03:11:58.900 INFO:teuthology.orchestra.run.smithi090.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T03:11:58.900 INFO:teuthology.orchestra.run.smithi090.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T03:11:58.900 INFO:teuthology.orchestra.run.smithi090.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T03:11:58.900 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T03:11:58.901 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T03:11:58.901 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:11:58.901 INFO:teuthology.orchestra.run.smithi090.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T03:11:58.901 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T03:11:58.901 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T03:11:58.901 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T03:11:58.901 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T03:11:58.901 INFO:teuthology.orchestra.run.smithi090.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T03:11:58.901 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T03:11:58.901 INFO:teuthology.orchestra.run.smithi090.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T03:11:58.901 INFO:teuthology.orchestra.run.smithi090.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T03:11:58.901 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T03:11:58.901 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T03:11:58.901 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T03:11:58.901 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T03:11:58.901 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T03:11:58.902 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T03:11:58.902 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T03:11:58.902 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T03:11:58.902 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T03:11:58.902 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T03:11:58.902 INFO:teuthology.orchestra.run.smithi090.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T03:11:58.902 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T03:11:58.902 INFO:teuthology.orchestra.run.smithi090.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T03:11:58.902 INFO:teuthology.orchestra.run.smithi090.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T03:11:58.902 INFO:teuthology.orchestra.run.smithi090.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T03:11:58.902 INFO:teuthology.orchestra.run.smithi090.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T03:11:58.902 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T03:11:58.902 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T03:11:58.902 INFO:teuthology.orchestra.run.smithi090.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T03:11:58.902 INFO:teuthology.orchestra.run.smithi090.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T03:11:58.903 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T03:11:58.903 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T03:11:58.903 INFO:teuthology.orchestra.run.smithi090.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T03:11:58.903 INFO:teuthology.orchestra.run.smithi090.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T03:11:58.903 INFO:teuthology.orchestra.run.smithi090.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T03:11:58.903 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T03:11:58.903 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T03:11:58.903 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T03:11:58.903 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T03:11:58.903 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T03:11:58.903 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T03:11:58.903 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T03:11:58.903 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T03:11:58.903 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T03:11:58.903 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T03:11:58.903 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T03:11:58.904 INFO:teuthology.orchestra.run.smithi090.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T03:11:58.904 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T03:11:58.904 INFO:teuthology.orchestra.run.smithi090.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T03:11:58.904 INFO:teuthology.orchestra.run.smithi090.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T03:11:58.904 INFO:teuthology.orchestra.run.smithi090.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T03:11:58.904 INFO:teuthology.orchestra.run.smithi090.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T03:11:58.904 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T03:11:58.904 INFO:teuthology.orchestra.run.smithi090.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T03:11:58.904 INFO:teuthology.orchestra.run.smithi090.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T03:11:58.904 INFO:teuthology.orchestra.run.smithi090.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T03:11:58.904 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T03:11:58.904 INFO:teuthology.orchestra.run.smithi090.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T03:11:58.904 INFO:teuthology.orchestra.run.smithi090.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T03:11:58.904 INFO:teuthology.orchestra.run.smithi090.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T03:11:58.904 INFO:teuthology.orchestra.run.smithi090.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T03:11:58.904 INFO:teuthology.orchestra.run.smithi090.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T03:11:58.905 INFO:teuthology.orchestra.run.smithi090.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T03:11:58.905 INFO:teuthology.orchestra.run.smithi090.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T03:11:58.905 INFO:teuthology.orchestra.run.smithi090.stdout:Installing weak dependencies: 2024-09-21T03:11:58.905 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T03:11:58.905 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:11:58.905 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction Summary 2024-09-21T03:11:58.905 INFO:teuthology.orchestra.run.smithi090.stdout:======================================================================================= 2024-09-21T03:11:58.905 INFO:teuthology.orchestra.run.smithi090.stdout:Install 149 Packages 2024-09-21T03:11:58.905 INFO:teuthology.orchestra.run.smithi090.stdout:Upgrade 8 Packages 2024-09-21T03:11:58.905 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:11:58.906 INFO:teuthology.orchestra.run.smithi090.stdout:Total download size: 228 M 2024-09-21T03:11:58.906 INFO:teuthology.orchestra.run.smithi090.stdout:Downloading Packages: 2024-09-21T03:11:59.409 INFO:teuthology.orchestra.run.smithi090.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 51 kB/s | 6.6 kB 00:00 2024-09-21T03:11:59.457 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-21T03:11:59.592 INFO:teuthology.orchestra.run.smithi090.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.7 MB/s | 873 kB 00:00 2024-09-21T03:11:59.684 INFO:teuthology.orchestra.run.smithi090.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.6 MB/s | 148 kB 00:00 2024-09-21T03:11:59.776 INFO:teuthology.orchestra.run.smithi090.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T03:11:59.909 INFO:teuthology.orchestra.run.smithi090.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-21T03:11:59.960 INFO:teuthology.orchestra.run.smithi090.stdout:(6/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 8.3 MB/s | 2.3 MB 00:00 2024-09-21T03:12:00.469 INFO:teuthology.orchestra.run.smithi090.stdout:(7/157): ceph-common-19.3.0-5120.g18432218.el9. 17 MB/s | 20 MB 00:01 2024-09-21T03:12:00.544 INFO:teuthology.orchestra.run.smithi090.stdout:(8/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 7.8 MB/s | 5.0 MB 00:00 2024-09-21T03:12:00.603 INFO:teuthology.orchestra.run.smithi090.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 433 kB/s | 25 kB 00:00 2024-09-21T03:12:00.988 INFO:teuthology.orchestra.run.smithi090.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 20 MB/s | 10 MB 00:00 2024-09-21T03:12:01.047 INFO:teuthology.orchestra.run.smithi090.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.8 MB/s | 226 kB 00:00 2024-09-21T03:12:01.105 INFO:teuthology.orchestra.run.smithi090.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 466 kB/s | 27 kB 00:00 2024-09-21T03:12:01.180 INFO:teuthology.orchestra.run.smithi090.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 425 kB/s | 32 kB 00:00 2024-09-21T03:12:01.431 INFO:teuthology.orchestra.run.smithi090.stdout:(14/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 12 MB/s | 18 MB 00:01 2024-09-21T03:12:01.473 INFO:teuthology.orchestra.run.smithi090.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 2.6 MB/s | 766 kB 00:00 2024-09-21T03:12:01.506 INFO:teuthology.orchestra.run.smithi090.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.1 MB/s | 158 kB 00:00 2024-09-21T03:12:01.532 INFO:teuthology.orchestra.run.smithi090.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.1 MB/s | 127 kB 00:00 2024-09-21T03:12:01.583 INFO:teuthology.orchestra.run.smithi090.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 6.6 MB/s | 507 kB 00:00 2024-09-21T03:12:01.708 INFO:teuthology.orchestra.run.smithi090.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 361 kB/s | 45 kB 00:00 2024-09-21T03:12:01.778 INFO:teuthology.orchestra.run.smithi149.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:12:01.779 INFO:teuthology.orchestra.run.smithi149.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:12:01.790 INFO:teuthology.orchestra.run.smithi149.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T03:12:01.791 INFO:teuthology.orchestra.run.smithi149.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T03:12:01.792 INFO:teuthology.orchestra.run.smithi149.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T03:12:01.792 INFO:teuthology.orchestra.run.smithi149.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T03:12:01.794 INFO:teuthology.orchestra.run.smithi149.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T03:12:01.797 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T03:12:01.797 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T03:12:01.842 INFO:teuthology.orchestra.run.smithi090.stdout:(20/157): librgw2-19.3.0-5120.g18432218.el9.x86 17 MB/s | 5.3 MB 00:00 2024-09-21T03:12:01.863 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T03:12:01.875 INFO:teuthology.orchestra.run.smithi090.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 891 kB/s | 148 kB 00:00 2024-09-21T03:12:01.889 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================= 2024-09-21T03:12:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T03:12:01.889 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================= 2024-09-21T03:12:01.889 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T03:12:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T03:12:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T03:12:01.889 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T03:12:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T03:12:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:12:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T03:12:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T03:12:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T03:12:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T03:12:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T03:12:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T03:12:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T03:12:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T03:12:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T03:12:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T03:12:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T03:12:01.890 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T03:12:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T03:12:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T03:12:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T03:12:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T03:12:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T03:12:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T03:12:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T03:12:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T03:12:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T03:12:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T03:12:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T03:12:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T03:12:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T03:12:01.891 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T03:12:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T03:12:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T03:12:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T03:12:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T03:12:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T03:12:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T03:12:01.892 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2024-09-21T03:12:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T03:12:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T03:12:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T03:12:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T03:12:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T03:12:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T03:12:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T03:12:01.892 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T03:12:01.892 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-21T03:12:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T03:12:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T03:12:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T03:12:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T03:12:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T03:12:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T03:12:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T03:12:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T03:12:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T03:12:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T03:12:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T03:12:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T03:12:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T03:12:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T03:12:01.893 INFO:teuthology.orchestra.run.smithi149.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T03:12:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T03:12:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T03:12:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T03:12:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T03:12:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T03:12:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T03:12:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T03:12:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T03:12:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T03:12:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T03:12:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T03:12:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T03:12:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T03:12:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T03:12:01.894 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T03:12:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T03:12:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T03:12:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T03:12:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T03:12:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T03:12:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T03:12:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T03:12:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T03:12:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T03:12:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T03:12:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T03:12:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T03:12:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T03:12:01.895 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T03:12:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T03:12:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T03:12:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T03:12:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:12:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T03:12:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T03:12:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T03:12:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T03:12:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T03:12:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T03:12:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T03:12:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T03:12:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T03:12:01.896 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T03:12:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T03:12:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T03:12:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T03:12:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T03:12:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T03:12:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T03:12:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T03:12:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T03:12:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T03:12:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T03:12:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T03:12:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T03:12:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T03:12:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T03:12:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T03:12:01.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T03:12:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T03:12:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T03:12:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T03:12:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T03:12:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T03:12:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T03:12:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T03:12:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T03:12:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T03:12:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T03:12:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T03:12:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T03:12:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T03:12:01.898 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T03:12:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T03:12:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T03:12:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T03:12:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T03:12:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T03:12:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T03:12:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T03:12:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T03:12:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T03:12:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T03:12:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T03:12:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T03:12:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T03:12:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T03:12:01.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T03:12:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T03:12:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T03:12:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T03:12:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T03:12:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T03:12:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T03:12:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T03:12:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T03:12:01.900 INFO:teuthology.orchestra.run.smithi149.stdout:Installing weak dependencies: 2024-09-21T03:12:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T03:12:01.900 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:12:01.900 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T03:12:01.900 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================= 2024-09-21T03:12:01.900 INFO:teuthology.orchestra.run.smithi149.stdout:Install 149 Packages 2024-09-21T03:12:01.900 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 8 Packages 2024-09-21T03:12:01.901 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:12:01.901 INFO:teuthology.orchestra.run.smithi090.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 2.7 MB/s | 161 kB 00:00 2024-09-21T03:12:01.901 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 228 M 2024-09-21T03:12:01.901 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T03:12:01.925 INFO:teuthology.orchestra.run.smithi090.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 6.2 MB/s | 321 kB 00:00 2024-09-21T03:12:01.959 INFO:teuthology.orchestra.run.smithi090.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T03:12:01.985 INFO:teuthology.orchestra.run.smithi090.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T03:12:02.010 INFO:teuthology.orchestra.run.smithi090.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T03:12:02.069 INFO:teuthology.orchestra.run.smithi090.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.9 MB/s | 170 kB 00:00 2024-09-21T03:12:02.152 INFO:teuthology.orchestra.run.smithi090.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 412 kB/s | 34 kB 00:00 2024-09-21T03:12:02.220 INFO:teuthology.orchestra.run.smithi090.stdout:(29/157): rbd-mirror-19.3.0-5120.g18432218.el9. 13 MB/s | 3.1 MB 00:00 2024-09-21T03:12:02.245 INFO:teuthology.orchestra.run.smithi090.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.6 MB/s | 154 kB 00:00 2024-09-21T03:12:02.650 INFO:teuthology.orchestra.run.smithi149.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 43 kB/s | 6.6 kB 00:00 2024-09-21T03:12:02.746 INFO:teuthology.orchestra.run.smithi090.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 19 MB/s | 40 MB 00:02 2024-09-21T03:12:02.796 INFO:teuthology.orchestra.run.smithi090.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 5.8 MB/s | 292 kB 00:00 2024-09-21T03:12:02.859 INFO:teuthology.orchestra.run.smithi149.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.1 MB/s | 873 kB 00:00 2024-09-21T03:12:02.906 INFO:teuthology.orchestra.run.smithi090.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 451 kB/s | 49 kB 00:00 2024-09-21T03:12:02.998 INFO:teuthology.orchestra.run.smithi090.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 180 kB/s | 16 kB 00:00 2024-09-21T03:12:03.185 INFO:teuthology.orchestra.run.smithi149.stdout:(3/157): ceph-base-19.3.0-5120.g18432218.el9.x8 8.0 MB/s | 5.5 MB 00:00 2024-09-21T03:12:03.186 INFO:teuthology.orchestra.run.smithi090.stdout:(35/157): ceph-mgr-diskprediction-local-19.3.0- 7.8 MB/s | 7.4 MB 00:00 2024-09-21T03:12:03.215 INFO:teuthology.orchestra.run.smithi090.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 1.3 MB/s | 285 kB 00:00 2024-09-21T03:12:03.218 INFO:teuthology.orchestra.run.smithi149.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 414 kB/s | 148 kB 00:00 2024-09-21T03:12:03.265 INFO:teuthology.orchestra.run.smithi090.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 9.8 MB/s | 784 kB 00:00 2024-09-21T03:12:03.290 INFO:teuthology.orchestra.run.smithi090.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 245 kB/s | 18 kB 00:00 2024-09-21T03:12:03.399 INFO:teuthology.orchestra.run.smithi090.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 598 kB/s | 80 kB 00:00 2024-09-21T03:12:03.408 INFO:teuthology.orchestra.run.smithi149.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 10 MB/s | 2.3 MB 00:00 2024-09-21T03:12:03.460 INFO:teuthology.orchestra.run.smithi149.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 6.3 MB/s | 1.5 MB 00:00 2024-09-21T03:12:03.475 INFO:teuthology.orchestra.run.smithi090.stdout:(40/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-21T03:12:03.502 INFO:teuthology.orchestra.run.smithi090.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2024-09-21T03:12:03.685 INFO:teuthology.orchestra.run.smithi149.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 18 MB/s | 5.0 MB 00:00 2024-09-21T03:12:03.709 INFO:teuthology.orchestra.run.smithi090.stdout:(42/157): ceph-mgr-dashboard-19.3.0-5120.g18432 9.5 MB/s | 14 MB 00:01 2024-09-21T03:12:03.742 INFO:teuthology.orchestra.run.smithi090.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 948 kB/s | 253 kB 00:00 2024-09-21T03:12:03.784 INFO:teuthology.orchestra.run.smithi090.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 4.3 MB/s | 1.2 MB 00:00 2024-09-21T03:12:03.826 INFO:teuthology.orchestra.run.smithi090.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-21T03:12:03.868 INFO:teuthology.orchestra.run.smithi090.stdout:(46/157): python3-ply-3.11-14.el9.noarch.rpm 671 kB/s | 106 kB 00:00 2024-09-21T03:12:03.894 INFO:teuthology.orchestra.run.smithi090.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-21T03:12:03.894 INFO:teuthology.orchestra.run.smithi149.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 14 MB/s | 20 MB 00:01 2024-09-21T03:12:03.919 INFO:teuthology.orchestra.run.smithi090.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-21T03:12:03.944 INFO:teuthology.orchestra.run.smithi149.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 506 kB/s | 25 kB 00:00 2024-09-21T03:12:04.028 INFO:teuthology.orchestra.run.smithi090.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 987 kB/s | 107 kB 00:00 2024-09-21T03:12:04.086 INFO:teuthology.orchestra.run.smithi090.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-09-21T03:12:04.111 INFO:teuthology.orchestra.run.smithi090.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 260 kB/s | 22 kB 00:00 2024-09-21T03:12:04.145 INFO:teuthology.orchestra.run.smithi090.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-09-21T03:12:04.171 INFO:teuthology.orchestra.run.smithi090.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 557 kB/s | 33 kB 00:00 2024-09-21T03:12:04.196 INFO:teuthology.orchestra.run.smithi090.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-21T03:12:04.230 INFO:teuthology.orchestra.run.smithi090.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 310 kB/s | 18 kB 00:00 2024-09-21T03:12:04.247 INFO:teuthology.orchestra.run.smithi090.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-21T03:12:04.273 INFO:teuthology.orchestra.run.smithi090.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.9 MB/s | 171 kB 00:00 2024-09-21T03:12:04.309 INFO:teuthology.orchestra.run.smithi149.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 17 MB/s | 10 MB 00:00 2024-09-21T03:12:04.349 INFO:teuthology.orchestra.run.smithi090.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-09-21T03:12:04.369 INFO:teuthology.orchestra.run.smithi149.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.7 MB/s | 226 kB 00:00 2024-09-21T03:12:04.374 INFO:teuthology.orchestra.run.smithi090.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-21T03:12:04.391 INFO:teuthology.orchestra.run.smithi090.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 386 kB/s | 45 kB 00:00 2024-09-21T03:12:04.433 INFO:teuthology.orchestra.run.smithi090.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-21T03:12:04.436 INFO:teuthology.orchestra.run.smithi149.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 407 kB/s | 27 kB 00:00 2024-09-21T03:12:04.506 INFO:teuthology.orchestra.run.smithi090.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 214 kB/s | 24 kB 00:00 2024-09-21T03:12:04.520 INFO:teuthology.orchestra.run.smithi149.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 382 kB/s | 32 kB 00:00 2024-09-21T03:12:04.534 INFO:teuthology.orchestra.run.smithi090.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 474 kB/s | 47 kB 00:00 2024-09-21T03:12:04.567 INFO:teuthology.orchestra.run.smithi090.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 292 kB 00:00 2024-09-21T03:12:04.592 INFO:teuthology.orchestra.run.smithi090.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-21T03:12:04.603 INFO:teuthology.orchestra.run.smithi149.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 9.0 MB/s | 766 kB 00:00 2024-09-21T03:12:04.626 INFO:teuthology.orchestra.run.smithi090.stdout:(66/157): libtool-2.4.6-46.el9.x86_64.rpm 2.4 MB/s | 581 kB 00:00 2024-09-21T03:12:04.651 INFO:teuthology.orchestra.run.smithi090.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 461 kB/s | 38 kB 00:00 2024-09-21T03:12:04.671 INFO:teuthology.orchestra.run.smithi149.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T03:12:04.738 INFO:teuthology.orchestra.run.smithi149.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 1.9 MB/s | 127 kB 00:00 2024-09-21T03:12:04.794 INFO:teuthology.orchestra.run.smithi090.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 25 MB/s | 4.9 MB 00:00 2024-09-21T03:12:04.813 INFO:teuthology.orchestra.run.smithi149.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 6.6 MB/s | 507 kB 00:00 2024-09-21T03:12:04.913 INFO:teuthology.orchestra.run.smithi090.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-21T03:12:04.961 INFO:teuthology.orchestra.run.smithi090.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 5.1 MB/s | 1.6 MB 00:00 2024-09-21T03:12:04.986 INFO:teuthology.orchestra.run.smithi090.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-21T03:12:05.028 INFO:teuthology.orchestra.run.smithi090.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 3.8 MB/s | 910 kB 00:00 2024-09-21T03:12:05.072 INFO:teuthology.orchestra.run.smithi149.stdout:(18/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 11 MB/s | 18 MB 00:01 2024-09-21T03:12:05.079 INFO:teuthology.orchestra.run.smithi090.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-09-21T03:12:05.112 INFO:teuthology.orchestra.run.smithi090.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-21T03:12:05.122 INFO:teuthology.orchestra.run.smithi149.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 900 kB/s | 45 kB 00:00 2024-09-21T03:12:05.163 INFO:teuthology.orchestra.run.smithi090.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T03:12:05.206 INFO:teuthology.orchestra.run.smithi149.stdout:(20/157): librgw2-19.3.0-5120.g18432218.el9.x86 13 MB/s | 5.3 MB 00:00 2024-09-21T03:12:05.221 INFO:teuthology.orchestra.run.smithi090.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-21T03:12:05.231 INFO:teuthology.orchestra.run.smithi149.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 1.3 MB/s | 148 kB 00:00 2024-09-21T03:12:05.248 INFO:teuthology.orchestra.run.smithi149.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 3.8 MB/s | 161 kB 00:00 2024-09-21T03:12:05.282 INFO:teuthology.orchestra.run.smithi149.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 6.2 MB/s | 321 kB 00:00 2024-09-21T03:12:05.307 INFO:teuthology.orchestra.run.smithi149.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T03:12:05.324 INFO:teuthology.orchestra.run.smithi149.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 2.3 MB/s | 99 kB 00:00 2024-09-21T03:12:05.357 INFO:teuthology.orchestra.run.smithi149.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T03:12:05.360 INFO:teuthology.orchestra.run.smithi090.stdout:(77/157): postgresql-server-13.16-1.el9.x86_64. 14 MB/s | 5.8 MB 00:00 2024-09-21T03:12:05.389 INFO:teuthology.orchestra.run.smithi090.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-09-21T03:12:05.408 INFO:teuthology.orchestra.run.smithi149.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T03:12:05.414 INFO:teuthology.orchestra.run.smithi090.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 486 kB/s | 26 kB 00:00 2024-09-21T03:12:05.439 INFO:teuthology.orchestra.run.smithi090.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-21T03:12:05.464 INFO:teuthology.orchestra.run.smithi090.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-21T03:12:05.466 INFO:teuthology.orchestra.run.smithi149.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 589 kB/s | 34 kB 00:00 2024-09-21T03:12:05.491 INFO:teuthology.orchestra.run.smithi090.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 676 kB/s | 35 kB 00:00 2024-09-21T03:12:05.583 INFO:teuthology.orchestra.run.smithi090.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-21T03:12:05.588 INFO:teuthology.orchestra.run.smithi149.stdout:(29/157): rbd-mirror-19.3.0-5120.g18432218.el9. 12 MB/s | 3.1 MB 00:00 2024-09-21T03:12:05.608 INFO:teuthology.orchestra.run.smithi090.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-21T03:12:05.617 INFO:teuthology.orchestra.run.smithi149.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.0 MB/s | 154 kB 00:00 2024-09-21T03:12:05.633 INFO:teuthology.orchestra.run.smithi090.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-21T03:12:05.667 INFO:teuthology.orchestra.run.smithi090.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-21T03:12:05.693 INFO:teuthology.orchestra.run.smithi090.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 720 kB/s | 42 kB 00:00 2024-09-21T03:12:05.718 INFO:teuthology.orchestra.run.smithi090.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-21T03:12:05.777 INFO:teuthology.orchestra.run.smithi090.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-09-21T03:12:05.802 INFO:teuthology.orchestra.run.smithi090.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-09-21T03:12:05.827 INFO:teuthology.orchestra.run.smithi090.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T03:12:05.853 INFO:teuthology.orchestra.run.smithi090.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T03:12:05.953 INFO:teuthology.orchestra.run.smithi090.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 10 MB/s | 5.1 MB 00:00 2024-09-21T03:12:05.979 INFO:teuthology.orchestra.run.smithi090.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 332 kB/s | 42 kB 00:00 2024-09-21T03:12:05.992 INFO:teuthology.orchestra.run.smithi149.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 19 MB/s | 40 MB 00:02 2024-09-21T03:12:06.004 INFO:teuthology.orchestra.run.smithi090.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 878 kB/s | 44 kB 00:00 2024-09-21T03:12:06.037 INFO:teuthology.orchestra.run.smithi090.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-21T03:12:06.042 INFO:teuthology.orchestra.run.smithi149.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 5.7 MB/s | 292 kB 00:00 2024-09-21T03:12:06.063 INFO:teuthology.orchestra.run.smithi090.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 616 kB/s | 36 kB 00:00 2024-09-21T03:12:06.088 INFO:teuthology.orchestra.run.smithi090.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 940 kB/s | 47 kB 00:00 2024-09-21T03:12:06.093 INFO:teuthology.orchestra.run.smithi149.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 996 kB/s | 49 kB 00:00 2024-09-21T03:12:06.113 INFO:teuthology.orchestra.run.smithi090.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-21T03:12:06.139 INFO:teuthology.orchestra.run.smithi090.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T03:12:06.189 INFO:teuthology.orchestra.run.smithi090.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-09-21T03:12:06.210 INFO:teuthology.orchestra.run.smithi149.stdout:(34/157): ceph-mgr-diskprediction-local-19.3.0- 12 MB/s | 7.4 MB 00:00 2024-09-21T03:12:06.214 INFO:teuthology.orchestra.run.smithi090.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 847 kB/s | 64 kB 00:00 2024-09-21T03:12:06.235 INFO:teuthology.orchestra.run.smithi149.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 116 kB/s | 16 kB 00:00 2024-09-21T03:12:06.240 INFO:teuthology.orchestra.run.smithi090.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-21T03:12:06.260 INFO:teuthology.orchestra.run.smithi149.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T03:12:06.310 INFO:teuthology.orchestra.run.smithi149.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 10 MB/s | 784 kB 00:00 2024-09-21T03:12:06.315 INFO:teuthology.orchestra.run.smithi090.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-09-21T03:12:06.327 INFO:teuthology.orchestra.run.smithi149.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 276 kB/s | 18 kB 00:00 2024-09-21T03:12:06.382 INFO:teuthology.orchestra.run.smithi090.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-21T03:12:06.416 INFO:teuthology.orchestra.run.smithi090.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T03:12:06.451 INFO:teuthology.orchestra.run.smithi090.stdout:(107/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.0 MB/s | 863 kB 00:00 2024-09-21T03:12:06.476 INFO:teuthology.orchestra.run.smithi090.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 324 kB/s | 19 kB 00:00 2024-09-21T03:12:06.527 INFO:teuthology.orchestra.run.smithi090.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 519 kB/s | 26 kB 00:00 2024-09-21T03:12:06.552 INFO:teuthology.orchestra.run.smithi090.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T03:12:06.623 INFO:teuthology.orchestra.run.smithi090.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 959 kB/s | 67 kB 00:00 2024-09-21T03:12:06.636 INFO:teuthology.orchestra.run.smithi149.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 14 MB/s | 14 MB 00:01 2024-09-21T03:12:06.653 INFO:teuthology.orchestra.run.smithi090.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.0 MB/s | 151 kB 00:00 2024-09-21T03:12:06.803 INFO:teuthology.orchestra.run.smithi149.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 162 kB/s | 80 kB 00:00 2024-09-21T03:12:06.861 INFO:teuthology.orchestra.run.smithi090.stdout:(113/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:01 2024-09-21T03:12:06.920 INFO:teuthology.orchestra.run.smithi090.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.1 MB/s | 839 kB 00:00 2024-09-21T03:12:06.945 INFO:teuthology.orchestra.run.smithi090.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T03:12:06.970 INFO:teuthology.orchestra.run.smithi090.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T03:12:06.996 INFO:teuthology.orchestra.run.smithi090.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-21T03:12:07.046 INFO:teuthology.orchestra.run.smithi090.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-21T03:12:07.080 INFO:teuthology.orchestra.run.smithi090.stdout:(119/157): python3-asyncssh-2.13.2-5.el9.noarch 2.5 MB/s | 548 kB 00:00 2024-09-21T03:12:07.122 INFO:teuthology.orchestra.run.smithi090.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 7.1 MB/s | 303 kB 00:00 2024-09-21T03:12:07.147 INFO:teuthology.orchestra.run.smithi090.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-09-21T03:12:07.161 INFO:teuthology.orchestra.run.smithi149.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 961 kB/s | 801 kB 00:00 2024-09-21T03:12:07.181 INFO:teuthology.orchestra.run.smithi090.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-21T03:12:07.187 INFO:teuthology.orchestra.run.smithi149.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 660 kB/s | 253 kB 00:00 2024-09-21T03:12:07.215 INFO:teuthology.orchestra.run.smithi090.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T03:12:07.240 INFO:teuthology.orchestra.run.smithi090.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-21T03:12:07.265 INFO:teuthology.orchestra.run.smithi090.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-21T03:12:07.278 INFO:teuthology.orchestra.run.smithi149.stdout:(43/157): libquadmath-11.5.0-2.el9.x86_64.rpm 298 kB/s | 191 kB 00:00 2024-09-21T03:12:07.299 INFO:teuthology.orchestra.run.smithi090.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 695 kB/s | 23 kB 00:00 2024-09-21T03:12:07.312 INFO:teuthology.orchestra.run.smithi149.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 851 kB/s | 106 kB 00:00 2024-09-21T03:12:07.333 INFO:teuthology.orchestra.run.smithi090.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 584 kB/s | 19 kB 00:00 2024-09-21T03:12:07.358 INFO:teuthology.orchestra.run.smithi090.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 783 kB/s | 20 kB 00:00 2024-09-21T03:12:07.413 INFO:teuthology.orchestra.run.smithi149.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 135 kB 00:00 2024-09-21T03:12:07.438 INFO:teuthology.orchestra.run.smithi149.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 995 kB/s | 125 kB 00:00 2024-09-21T03:12:07.478 INFO:teuthology.orchestra.run.smithi090.stdout:(129/157): libarrow-9.0.0-11.el9.x86_64.rpm 4.3 MB/s | 4.4 MB 00:01 2024-09-21T03:12:07.488 INFO:teuthology.orchestra.run.smithi149.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 3.8 MB/s | 1.2 MB 00:00 2024-09-21T03:12:07.511 INFO:teuthology.orchestra.run.smithi090.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-21T03:12:07.539 INFO:teuthology.orchestra.run.smithi149.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.7 MB/s | 215 kB 00:00 2024-09-21T03:12:07.544 INFO:teuthology.orchestra.run.smithi090.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-21T03:12:07.578 INFO:teuthology.orchestra.run.smithi090.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-21T03:12:07.614 INFO:teuthology.orchestra.run.smithi149.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 7.3 MB/s | 943 kB 00:00 2024-09-21T03:12:07.620 INFO:teuthology.orchestra.run.smithi090.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 3.9 MB/s | 1.0 MB 00:00 2024-09-21T03:12:07.647 INFO:teuthology.orchestra.run.smithi149.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-09-21T03:12:07.673 INFO:teuthology.orchestra.run.smithi149.stdout:(51/157): boost-program-options-1.75.0-8.el9.x8 799 kB/s | 107 kB 00:00 2024-09-21T03:12:07.679 INFO:teuthology.orchestra.run.smithi090.stdout:(134/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-09-21T03:12:07.704 INFO:teuthology.orchestra.run.smithi090.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2024-09-21T03:12:07.723 INFO:teuthology.orchestra.run.smithi149.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 199 kB/s | 22 kB 00:00 2024-09-21T03:12:07.738 INFO:teuthology.orchestra.run.smithi090.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 854 kB/s | 28 kB 00:00 2024-09-21T03:12:07.763 INFO:teuthology.orchestra.run.smithi090.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-21T03:12:07.765 INFO:teuthology.orchestra.run.smithi149.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-21T03:12:07.788 INFO:teuthology.orchestra.run.smithi090.stdout:(138/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2024-09-21T03:12:07.790 INFO:teuthology.orchestra.run.smithi149.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 279 kB/s | 33 kB 00:00 2024-09-21T03:12:07.814 INFO:teuthology.orchestra.run.smithi090.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-09-21T03:12:07.839 INFO:teuthology.orchestra.run.smithi090.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-21T03:12:07.864 INFO:teuthology.orchestra.run.smithi090.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-21T03:12:07.882 INFO:teuthology.orchestra.run.smithi149.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 156 kB/s | 18 kB 00:00 2024-09-21T03:12:07.908 INFO:teuthology.orchestra.run.smithi149.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 95 kB/s | 11 kB 00:00 2024-09-21T03:12:07.923 INFO:teuthology.orchestra.run.smithi090.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-21T03:12:07.948 INFO:teuthology.orchestra.run.smithi090.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 685 kB/s | 74 kB 00:00 2024-09-21T03:12:07.966 INFO:teuthology.orchestra.run.smithi149.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-09-21T03:12:07.973 INFO:teuthology.orchestra.run.smithi090.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T03:12:07.999 INFO:teuthology.orchestra.run.smithi090.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-21T03:12:08.000 INFO:teuthology.orchestra.run.smithi149.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2024-09-21T03:12:08.024 INFO:teuthology.orchestra.run.smithi090.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 396 kB/s | 20 kB 00:00 2024-09-21T03:12:08.025 INFO:teuthology.orchestra.run.smithi149.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-21T03:12:08.050 INFO:teuthology.orchestra.run.smithi090.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T03:12:08.075 INFO:teuthology.orchestra.run.smithi149.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 416 kB/s | 45 kB 00:00 2024-09-21T03:12:08.083 INFO:teuthology.orchestra.run.smithi090.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-21T03:12:08.126 INFO:teuthology.orchestra.run.smithi149.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-21T03:12:08.142 INFO:teuthology.orchestra.run.smithi090.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-21T03:12:08.184 INFO:teuthology.orchestra.run.smithi149.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 225 kB/s | 24 kB 00:00 2024-09-21T03:12:08.226 INFO:teuthology.orchestra.run.smithi149.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 2.8 MB/s | 581 kB 00:00 2024-09-21T03:12:08.251 INFO:teuthology.orchestra.run.smithi149.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 378 kB/s | 47 kB 00:00 2024-09-21T03:12:08.302 INFO:teuthology.orchestra.run.smithi149.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-21T03:12:08.335 INFO:teuthology.orchestra.run.smithi149.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-21T03:12:08.359 INFO:teuthology.orchestra.run.smithi090.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 11 MB/s | 3.4 MB 00:00 2024-09-21T03:12:08.361 INFO:teuthology.orchestra.run.smithi149.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 353 kB/s | 38 kB 00:00 2024-09-21T03:12:08.419 INFO:teuthology.orchestra.run.smithi090.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 8.7 MB/s | 2.3 MB 00:00 2024-09-21T03:12:08.494 INFO:teuthology.orchestra.run.smithi090.stdout:(152/157): NetworkManager-libnm-1.51.0-1.el9.x8 13 MB/s | 1.8 MB 00:00 2024-09-21T03:12:08.519 INFO:teuthology.orchestra.run.smithi090.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 408 kB/s | 41 kB 00:00 2024-09-21T03:12:08.561 INFO:teuthology.orchestra.run.smithi149.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 19 MB/s | 4.9 MB 00:00 2024-09-21T03:12:08.587 INFO:teuthology.orchestra.run.smithi090.stdout:(154/157): librbd1-19.3.0-5120.g18432218.el9.x8 6.3 MB/s | 3.2 MB 00:00 2024-09-21T03:12:08.603 INFO:teuthology.orchestra.run.smithi149.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 6.6 MB/s | 1.6 MB 00:00 2024-09-21T03:12:08.620 INFO:teuthology.orchestra.run.smithi090.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.9 MB/s | 249 kB 00:00 2024-09-21T03:12:08.687 INFO:teuthology.orchestra.run.smithi090.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 8.1 MB/s | 1.4 MB 00:00 2024-09-21T03:12:08.711 INFO:teuthology.orchestra.run.smithi149.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-21T03:12:08.737 INFO:teuthology.orchestra.run.smithi149.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.0 MB/s | 137 kB 00:00 2024-09-21T03:12:08.779 INFO:teuthology.orchestra.run.smithi149.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 4.1 MB/s | 910 kB 00:00 2024-09-21T03:12:08.795 INFO:teuthology.orchestra.run.smithi090.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-21T03:12:08.802 INFO:teuthology.orchestra.run.smithi090.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:12:08.802 INFO:teuthology.orchestra.run.smithi090.stdout:Total 23 MB/s | 228 MB 00:09 2024-09-21T03:12:08.871 INFO:teuthology.orchestra.run.smithi149.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-09-21T03:12:08.921 INFO:teuthology.orchestra.run.smithi149.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 616 kB/s | 87 kB 00:00 2024-09-21T03:12:09.030 INFO:teuthology.orchestra.run.smithi149.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 565 kB/s | 61 kB 00:00 2024-09-21T03:12:09.104 INFO:teuthology.orchestra.run.smithi149.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 15 MB/s | 5.8 MB 00:00 2024-09-21T03:12:09.147 INFO:teuthology.orchestra.run.smithi149.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-21T03:12:09.222 INFO:teuthology.orchestra.run.smithi149.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-21T03:12:09.256 INFO:teuthology.orchestra.run.smithi149.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-09-21T03:12:09.406 INFO:teuthology.orchestra.run.smithi149.stdout:(80/157): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-09-21T03:12:09.431 INFO:teuthology.orchestra.run.smithi149.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 92 kB/s | 19 kB 00:00 2024-09-21T03:12:09.456 INFO:teuthology.orchestra.run.smithi149.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 858 kB/s | 172 kB 00:00 2024-09-21T03:12:09.515 INFO:teuthology.orchestra.run.smithi149.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 320 kB/s | 35 kB 00:00 2024-09-21T03:12:09.574 INFO:teuthology.orchestra.run.smithi149.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-21T03:12:09.632 INFO:teuthology.orchestra.run.smithi149.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-21T03:12:09.708 INFO:teuthology.orchestra.run.smithi149.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-09-21T03:12:09.733 INFO:teuthology.orchestra.run.smithi149.stdout:(87/157): python3-packaging-20.9-5.el9.noarch.r 486 kB/s | 77 kB 00:00 2024-09-21T03:12:09.758 INFO:teuthology.orchestra.run.smithi149.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 337 kB/s | 42 kB 00:00 2024-09-21T03:12:09.825 INFO:teuthology.orchestra.run.smithi149.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 2.2 MB/s | 269 kB 00:00 2024-09-21T03:12:09.851 INFO:teuthology.orchestra.run.smithi149.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-21T03:12:09.876 INFO:teuthology.orchestra.run.smithi149.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-21T03:12:09.934 INFO:teuthology.orchestra.run.smithi149.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 469 kB/s | 51 kB 00:00 2024-09-21T03:12:09.960 INFO:teuthology.orchestra.run.smithi149.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 494 kB/s | 54 kB 00:00 2024-09-21T03:12:10.065 INFO:teuthology.orchestra.run.smithi149.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 318 kB/s | 42 kB 00:00 2024-09-21T03:12:10.093 INFO:teuthology.orchestra.run.smithi149.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 330 kB/s | 44 kB 00:00 2024-09-21T03:12:10.185 INFO:teuthology.orchestra.run.smithi149.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-21T03:12:10.211 INFO:teuthology.orchestra.run.smithi149.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 307 kB/s | 36 kB 00:00 2024-09-21T03:12:10.302 INFO:teuthology.orchestra.run.smithi149.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 406 kB/s | 47 kB 00:00 2024-09-21T03:12:10.328 INFO:teuthology.orchestra.run.smithi149.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-21T03:12:10.420 INFO:teuthology.orchestra.run.smithi149.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 495 kB/s | 58 kB 00:00 2024-09-21T03:12:10.445 INFO:teuthology.orchestra.run.smithi149.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 818 kB/s | 96 kB 00:00 2024-09-21T03:12:10.537 INFO:teuthology.orchestra.run.smithi149.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 545 kB/s | 64 kB 00:00 2024-09-21T03:12:10.562 INFO:teuthology.orchestra.run.smithi149.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 384 kB/s | 45 kB 00:00 2024-09-21T03:12:10.654 INFO:teuthology.orchestra.run.smithi149.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-09-21T03:12:10.713 INFO:teuthology.orchestra.run.smithi149.stdout:(105/157): protobuf-compiler-3.14.0-13.el9.x86_ 5.6 MB/s | 863 kB 00:00 2024-09-21T03:12:10.763 INFO:teuthology.orchestra.run.smithi149.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.0 MB/s | 548 kB 00:00 2024-09-21T03:12:10.789 INFO:teuthology.orchestra.run.smithi149.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 824 kB/s | 19 kB 00:00 2024-09-21T03:12:10.822 INFO:teuthology.orchestra.run.smithi149.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-21T03:12:10.847 INFO:teuthology.orchestra.run.smithi149.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T03:12:10.873 INFO:teuthology.orchestra.run.smithi149.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T03:12:10.875 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction check 2024-09-21T03:12:10.890 INFO:teuthology.orchestra.run.smithi149.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 4.0 MB/s | 67 kB 00:00 2024-09-21T03:12:10.924 INFO:teuthology.orchestra.run.smithi149.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-21T03:12:10.974 INFO:teuthology.orchestra.run.smithi149.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 17 MB/s | 839 kB 00:00 2024-09-21T03:12:11.055 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction check succeeded. 2024-09-21T03:12:11.056 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction test 2024-09-21T03:12:11.160 INFO:teuthology.orchestra.run.smithi149.stdout:(114/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-09-21T03:12:11.208 INFO:teuthology.orchestra.run.smithi149.stdout:(115/157): python3-asyncssh-2.13.2-5.el9.noarch 2.3 MB/s | 548 kB 00:00 2024-09-21T03:12:11.225 INFO:teuthology.orchestra.run.smithi149.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 2.1 MB/s | 32 kB 00:00 2024-09-21T03:12:11.241 INFO:teuthology.orchestra.run.smithi149.stdout:(117/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 538 kB/s | 43 kB 00:00 2024-09-21T03:12:11.258 INFO:teuthology.orchestra.run.smithi149.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 423 kB/s | 14 kB 00:00 2024-09-21T03:12:11.284 INFO:teuthology.orchestra.run.smithi149.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-21T03:12:11.309 INFO:teuthology.orchestra.run.smithi149.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T03:12:11.343 INFO:teuthology.orchestra.run.smithi149.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-21T03:12:11.378 INFO:teuthology.orchestra.run.smithi149.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.2 MB/s | 220 kB 00:00 2024-09-21T03:12:11.410 INFO:teuthology.orchestra.run.smithi149.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T03:12:11.435 INFO:teuthology.orchestra.run.smithi149.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-21T03:12:11.460 INFO:teuthology.orchestra.run.smithi149.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-21T03:12:11.486 INFO:teuthology.orchestra.run.smithi149.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 921 kB/s | 23 kB 00:00 2024-09-21T03:12:11.544 INFO:teuthology.orchestra.run.smithi149.stdout:(127/157): libarrow-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 4.4 MB 00:00 2024-09-21T03:12:11.570 INFO:teuthology.orchestra.run.smithi149.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 233 kB/s | 19 kB 00:00 2024-09-21T03:12:11.595 INFO:teuthology.orchestra.run.smithi149.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-21T03:12:11.620 INFO:teuthology.orchestra.run.smithi149.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T03:12:11.654 INFO:teuthology.orchestra.run.smithi149.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-21T03:12:11.679 INFO:teuthology.orchestra.run.smithi149.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T03:12:11.721 INFO:teuthology.orchestra.run.smithi149.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-21T03:12:11.747 INFO:teuthology.orchestra.run.smithi149.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-21T03:12:11.797 INFO:teuthology.orchestra.run.smithi149.stdout:(135/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.5 MB/s | 2.0 MB 00:00 2024-09-21T03:12:11.839 INFO:teuthology.orchestra.run.smithi149.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-21T03:12:11.864 INFO:teuthology.orchestra.run.smithi149.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 766 kB/s | 90 kB 00:00 2024-09-21T03:12:11.889 INFO:teuthology.orchestra.run.smithi149.stdout:(138/157): python3-pyperclip-1.8.2-2.el9.noarch 306 kB/s | 28 kB 00:00 2024-09-21T03:12:11.915 INFO:teuthology.orchestra.run.smithi149.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-09-21T03:12:11.940 INFO:teuthology.orchestra.run.smithi149.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-21T03:12:11.959 INFO:teuthology.orchestra.run.smithi149.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 808 kB/s | 36 kB 00:00 2024-09-21T03:12:11.984 INFO:teuthology.orchestra.run.smithi149.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-21T03:12:12.011 INFO:teuthology.orchestra.run.smithi149.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 1.0 MB/s | 74 kB 00:00 2024-09-21T03:12:12.035 INFO:teuthology.orchestra.run.smithi149.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T03:12:12.069 INFO:teuthology.orchestra.run.smithi149.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-21T03:12:12.085 INFO:teuthology.orchestra.run.smithi149.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-21T03:12:12.111 INFO:teuthology.orchestra.run.smithi149.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-21T03:12:12.136 INFO:teuthology.orchestra.run.smithi149.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-21T03:12:12.195 INFO:teuthology.orchestra.run.smithi149.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T03:12:12.395 INFO:teuthology.orchestra.run.smithi149.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 12 MB/s | 3.4 MB 00:00 2024-09-21T03:12:12.471 INFO:teuthology.orchestra.run.smithi149.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 9.5 MB/s | 3.2 MB 00:00 2024-09-21T03:12:12.579 INFO:teuthology.orchestra.run.smithi149.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 378 kB/s | 41 kB 00:00 2024-09-21T03:12:12.646 INFO:teuthology.orchestra.run.smithi149.stdout:(153/157): NetworkManager-1.51.0-1.el9.x86_64.r 5.1 MB/s | 2.3 MB 00:00 2024-09-21T03:12:12.788 INFO:teuthology.orchestra.run.smithi149.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 9.6 MB/s | 1.4 MB 00:00 2024-09-21T03:12:12.813 INFO:teuthology.orchestra.run.smithi149.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.0 MB/s | 249 kB 00:00 2024-09-21T03:12:12.847 INFO:teuthology.orchestra.run.smithi149.stdout:(156/157): NetworkManager-libnm-1.51.0-1.el9.x8 4.0 MB/s | 1.8 MB 00:00 2024-09-21T03:12:12.997 INFO:teuthology.orchestra.run.smithi149.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-21T03:12:13.001 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:12:13.001 INFO:teuthology.orchestra.run.smithi149.stdout:Total 21 MB/s | 228 MB 00:11 2024-09-21T03:12:13.502 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction test succeeded. 2024-09-21T03:12:13.515 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction 2024-09-21T03:12:15.092 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T03:12:15.275 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T03:12:15.276 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T03:12:17.622 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T03:12:17.629 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T03:12:20.280 INFO:teuthology.orchestra.run.smithi090.stdout: Preparing : 1/1 2024-09-21T03:12:20.469 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T03:12:20.519 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T03:12:20.592 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T03:12:20.630 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T03:12:20.945 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T03:12:21.008 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T03:12:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T03:12:21.514 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:12:21.674 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:12:21.707 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:12:21.837 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:12:21.876 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:12:21.920 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T03:12:22.136 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T03:12:22.229 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T03:12:22.256 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:12:22.376 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:12:22.408 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:12:22.489 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:12:22.525 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:12:22.569 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:12:22.786 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:12:22.982 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:12:23.235 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T03:12:23.397 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:12:23.553 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:12:23.830 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:12:23.992 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T03:12:24.034 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T03:12:24.080 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T03:12:24.170 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T03:12:24.225 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T03:12:24.299 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T03:12:24.337 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T03:12:24.351 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T03:12:24.408 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T03:12:24.441 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T03:12:24.503 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T03:12:24.528 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T03:12:24.593 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T03:12:24.609 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T03:12:24.631 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T03:12:24.675 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T03:12:24.727 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T03:12:24.771 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T03:12:24.787 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T03:12:24.803 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T03:12:24.834 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T03:12:24.869 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T03:12:24.886 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T03:12:24.922 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T03:12:25.013 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T03:12:25.067 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T03:12:25.204 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T03:12:25.258 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T03:12:25.373 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T03:12:25.395 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:12:25.436 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T03:12:25.530 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:12:25.571 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:12:25.675 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:12:25.710 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:12:25.751 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T03:12:25.970 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T03:12:26.033 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T03:12:26.060 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:12:26.060 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T03:12:26.171 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T03:12:26.180 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:12:26.211 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:12:26.218 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T03:12:26.265 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T03:12:26.299 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:12:26.316 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T03:12:26.328 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:12:26.367 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:12:26.372 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T03:12:26.605 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:12:26.606 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T03:12:26.688 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T03:12:26.800 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T03:12:26.835 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:12:26.914 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T03:12:27.000 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T03:12:27.027 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T03:12:27.049 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T03:12:27.094 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T03:12:27.143 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:12:27.151 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T03:12:27.193 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T03:12:27.239 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T03:12:27.253 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:12:27.315 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T03:12:27.483 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T03:12:27.529 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:12:27.536 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T03:12:27.579 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T03:12:27.662 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T03:12:27.697 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T03:12:27.704 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T03:12:27.747 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T03:12:27.770 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T03:12:27.805 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T03:12:27.844 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T03:12:27.860 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T03:12:27.877 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T03:12:27.915 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T03:12:27.954 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T03:12:28.009 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T03:12:28.009 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T03:12:28.047 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T03:12:28.089 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T03:12:28.173 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T03:12:28.179 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T03:12:28.220 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T03:12:28.242 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T03:12:28.257 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T03:12:28.277 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T03:12:28.292 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T03:12:28.323 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T03:12:28.420 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T03:12:28.456 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T03:12:28.467 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T03:12:28.501 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T03:12:28.527 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T03:12:28.623 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T03:12:28.688 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T03:12:28.779 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T03:12:28.881 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T03:12:28.918 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T03:12:28.956 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T03:12:28.962 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T03:12:28.995 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T03:12:29.025 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T03:12:29.038 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T03:12:29.072 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T03:12:29.171 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T03:12:29.230 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T03:12:29.276 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T03:12:29.395 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T03:12:29.472 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T03:12:29.674 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T03:12:29.775 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T03:12:29.820 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T03:12:30.335 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T03:12:30.419 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T03:12:30.461 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T03:12:30.469 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T03:12:30.528 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T03:12:30.582 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T03:12:30.583 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T03:12:30.644 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T03:12:30.705 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T03:12:30.762 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T03:12:30.808 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T03:12:30.855 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T03:12:30.857 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T03:12:30.960 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T03:12:31.042 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T03:12:31.126 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T03:12:31.165 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T03:12:31.201 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T03:12:31.226 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T03:12:31.262 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T03:12:31.285 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T03:12:31.334 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T03:12:31.363 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T03:12:31.387 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T03:12:31.439 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T03:12:31.610 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T03:12:31.654 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T03:12:31.698 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T03:12:31.821 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T03:12:31.858 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T03:12:31.909 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T03:12:31.939 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T03:12:31.964 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T03:12:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T03:12:32.178 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T03:12:32.241 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T03:12:32.288 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T03:12:32.321 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T03:12:32.325 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T03:12:32.359 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T03:12:32.444 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T03:12:32.489 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T03:12:32.527 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T03:12:32.562 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T03:12:32.595 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T03:12:32.638 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T03:12:32.670 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T03:12:32.771 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T03:12:32.830 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T03:12:32.866 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T03:12:32.986 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T03:12:33.053 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T03:12:33.880 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T03:12:33.940 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T03:12:33.988 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T03:12:34.000 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T03:12:34.028 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T03:12:34.034 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T03:12:34.061 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T03:12:34.158 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T03:12:34.227 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T03:12:34.279 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T03:12:34.378 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T03:12:34.428 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T03:12:34.429 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T03:12:34.473 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:12:34.611 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:12:34.646 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T03:12:34.668 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T03:12:34.695 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T03:12:34.708 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T03:12:34.802 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T03:12:35.237 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T03:12:35.277 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:12:35.368 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:12:35.421 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T03:12:35.612 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T03:12:35.747 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T03:12:37.346 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T03:12:37.439 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T03:12:37.475 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T03:12:37.525 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T03:12:37.883 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T03:12:37.918 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:12:37.944 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:12:37.961 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:12:38.066 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:12:38.101 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T03:12:38.149 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T03:12:38.622 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:12:38.675 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:12:38.699 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T03:12:38.739 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:12:38.831 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:12:38.846 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:12:38.846 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T03:12:38.846 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T03:12:38.846 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:12:38.858 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T03:12:38.884 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:12:41.331 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:12:41.364 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:12:42.025 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:12:42.068 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:12:42.187 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:12:42.188 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T03:12:42.188 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T03:12:42.188 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:12:42.228 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:12:52.364 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:12:52.365 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /sys 2024-09-21T03:12:52.365 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /proc 2024-09-21T03:12:52.365 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /mnt 2024-09-21T03:12:52.365 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /var/tmp 2024-09-21T03:12:52.365 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /home 2024-09-21T03:12:52.365 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /root 2024-09-21T03:12:52.365 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /tmp 2024-09-21T03:12:52.365 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:12:52.594 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:12:52.629 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:12:52.630 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:12:52.630 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T03:12:52.630 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:12:54.384 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:12:54.443 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:12:54.444 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:12:54.444 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T03:12:54.444 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:12:54.444 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:12:54.444 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:12:54.693 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:12:54.744 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:12:54.744 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:12:54.744 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T03:12:54.744 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:12:54.744 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:12:54.744 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:12:54.984 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:12:54.985 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /sys 2024-09-21T03:12:54.985 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /proc 2024-09-21T03:12:54.985 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /mnt 2024-09-21T03:12:54.985 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /var/tmp 2024-09-21T03:12:54.985 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /home 2024-09-21T03:12:54.985 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /root 2024-09-21T03:12:54.985 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /tmp 2024-09-21T03:12:54.985 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:12:55.181 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:12:55.216 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:12:55.216 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:12:55.216 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T03:12:55.216 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:12:55.252 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:12:55.303 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:12:55.303 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:12:55.303 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T03:12:55.303 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:12:55.303 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:12:55.303 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:12:55.437 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T03:12:55.531 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T03:12:55.603 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T03:12:55.828 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T03:12:55.928 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T03:12:56.019 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T03:12:56.129 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T03:12:56.299 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T03:12:56.360 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T03:12:56.400 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T03:12:56.435 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T03:12:56.973 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:12:56.985 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:12:57.018 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:12:57.043 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:12:57.043 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:12:57.043 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T03:12:57.044 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:12:57.044 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:12:57.044 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:12:57.060 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T03:12:57.142 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T03:12:57.184 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:12:57.294 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:12:57.345 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:12:57.345 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:12:57.345 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T03:12:57.345 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:12:57.345 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:12:57.345 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:12:57.870 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:12:57.922 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:12:57.922 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:12:57.922 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T03:12:57.922 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:12:57.922 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:12:57.923 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:12:58.053 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T03:12:58.114 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T03:12:58.186 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T03:12:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T03:12:58.482 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T03:12:58.568 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T03:12:58.669 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T03:12:58.844 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T03:12:58.899 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T03:12:58.938 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T03:12:58.964 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T03:12:59.545 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:12:59.581 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:12:59.622 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T03:12:59.704 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T03:12:59.736 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:13:00.789 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:13:00.851 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:13:01.930 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:13:01.960 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:13:02.111 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:13:02.322 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T03:13:02.354 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:13:02.406 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:13:02.406 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:13:02.406 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T03:13:02.406 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:13:02.406 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:13:02.406 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:02.463 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:13:02.490 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:13:02.598 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T03:13:02.668 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T03:13:03.397 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:13:03.467 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:13:03.742 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T03:13:03.783 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:13:03.836 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:13:03.836 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:13:03.836 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T03:13:03.836 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:13:03.836 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:13:03.837 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:03.894 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:13:03.943 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:13:03.943 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:13:03.944 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T03:13:03.944 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:04.003 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:13:04.054 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:13:04.054 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:13:04.054 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T03:13:04.054 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:13:04.054 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:13:04.054 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:04.421 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:13:04.472 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:13:04.472 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:13:04.472 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T03:13:04.472 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:13:04.472 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:13:04.472 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:04.565 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:13:04.592 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:13:04.746 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:13:04.946 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T03:13:04.986 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:13:05.039 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:13:05.039 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:13:05.039 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T03:13:05.040 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:13:05.040 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:13:05.040 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:05.095 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:13:05.122 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:13:05.231 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T03:13:05.300 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T03:13:06.355 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T03:13:06.390 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:13:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:13:06.442 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:13:06.442 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T03:13:06.442 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:13:06.442 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:13:06.442 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:06.498 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:13:06.549 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:13:06.549 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:13:06.549 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T03:13:06.549 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:06.599 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:13:06.651 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:13:06.651 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:13:06.651 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T03:13:06.651 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:13:06.651 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:13:06.651 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:07.017 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:13:07.069 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:13:07.069 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:13:07.069 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T03:13:07.069 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:13:07.069 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:13:07.069 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:08.857 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T03:13:08.903 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T03:13:08.946 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T03:13:08.984 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T03:13:09.020 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T03:13:09.296 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T03:13:09.352 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T03:13:09.381 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T03:13:09.421 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T03:13:09.474 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T03:13:10.210 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:13:10.266 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:13:10.307 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:13:11.447 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T03:13:11.497 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T03:13:11.540 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T03:13:11.577 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T03:13:11.585 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T03:13:11.613 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T03:13:11.695 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T03:13:11.812 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T03:13:11.881 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T03:13:11.927 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T03:13:11.934 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T03:13:11.964 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T03:13:11.965 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T03:13:11.995 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T03:13:11.998 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T03:13:12.035 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T03:13:12.035 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:13:12.064 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T03:13:12.144 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:13:12.144 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:13:12.270 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:13:12.303 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T03:13:12.318 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:13:12.318 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:13:12.564 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:13:12.564 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:13:12.674 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:13:12.755 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:13:12.859 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:13:12.912 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:13:12.954 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:13:12.959 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:13:12.959 INFO:teuthology.orchestra.run.smithi090.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-21T03:13:12.959 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:14.244 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T03:13:14.354 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T03:13:14.404 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T03:13:14.517 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T03:13:14.556 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T03:13:14.589 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T03:13:14.655 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T03:13:14.655 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:13:14.759 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:13:14.759 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:13:14.876 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:13:14.901 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T03:13:14.916 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:13:14.916 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:13:15.162 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:13:15.162 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:13:15.255 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:13:15.327 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:13:15.524 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:13:15.524 INFO:teuthology.orchestra.run.smithi149.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-21T03:13:15.524 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:20.800 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T03:13:20.800 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T03:13:20.800 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T03:13:20.801 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T03:13:20.801 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T03:13:20.801 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T03:13:20.801 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T03:13:20.801 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:13:20.813 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:13:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:13:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T03:13:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T03:13:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T03:13:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:13:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T03:13:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T03:13:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T03:13:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T03:13:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T03:13:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T03:13:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T03:13:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T03:13:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T03:13:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T03:13:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T03:13:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T03:13:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T03:13:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T03:13:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T03:13:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T03:13:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T03:13:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T03:13:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T03:13:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T03:13:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T03:13:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T03:13:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T03:13:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T03:13:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T03:13:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T03:13:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T03:13:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T03:13:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T03:13:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T03:13:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T03:13:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T03:13:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T03:13:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T03:13:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T03:13:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T03:13:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T03:13:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T03:13:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T03:13:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T03:13:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T03:13:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T03:13:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T03:13:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T03:13:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T03:13:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T03:13:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T03:13:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T03:13:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T03:13:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T03:13:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T03:13:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T03:13:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T03:13:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T03:13:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T03:13:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T03:13:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T03:13:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T03:13:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T03:13:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T03:13:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T03:13:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T03:13:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T03:13:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T03:13:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T03:13:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T03:13:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T03:13:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T03:13:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T03:13:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T03:13:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T03:13:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T03:13:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T03:13:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T03:13:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T03:13:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T03:13:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T03:13:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T03:13:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T03:13:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T03:13:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T03:13:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T03:13:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T03:13:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T03:13:20.821 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T03:13:20.821 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T03:13:20.821 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T03:13:20.821 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T03:13:20.821 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T03:13:20.821 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T03:13:20.821 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T03:13:20.821 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T03:13:20.821 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T03:13:20.821 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T03:13:20.821 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T03:13:20.821 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T03:13:20.821 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T03:13:20.821 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T03:13:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T03:13:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T03:13:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T03:13:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T03:13:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T03:13:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T03:13:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T03:13:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T03:13:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T03:13:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T03:13:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T03:13:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T03:13:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T03:13:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T03:13:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T03:13:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T03:13:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T03:13:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T03:13:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T03:13:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T03:13:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T03:13:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T03:13:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T03:13:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T03:13:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T03:13:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T03:13:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T03:13:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T03:13:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T03:13:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T03:13:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T03:13:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T03:13:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T03:13:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T03:13:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T03:13:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T03:13:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T03:13:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T03:13:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T03:13:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T03:13:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T03:13:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T03:13:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T03:13:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T03:13:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T03:13:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T03:13:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T03:13:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T03:13:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T03:13:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T03:13:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T03:13:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T03:13:21.785 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T03:13:21.785 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T03:13:21.785 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T03:13:21.785 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T03:13:21.785 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T03:13:21.785 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T03:13:21.785 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T03:13:21.785 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:13:21.785 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:13:21.785 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:13:21.785 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T03:13:21.785 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T03:13:21.786 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T03:13:21.786 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:13:21.786 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T03:13:21.786 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T03:13:21.786 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T03:13:21.786 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T03:13:21.786 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T03:13:21.786 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T03:13:21.786 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T03:13:21.786 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T03:13:21.786 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T03:13:21.786 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T03:13:21.786 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T03:13:21.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T03:13:21.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T03:13:21.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T03:13:21.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T03:13:21.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T03:13:21.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T03:13:21.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T03:13:21.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T03:13:21.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T03:13:21.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T03:13:21.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T03:13:21.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T03:13:21.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T03:13:21.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T03:13:21.788 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T03:13:21.788 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T03:13:21.788 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T03:13:21.788 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T03:13:21.788 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T03:13:21.788 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T03:13:21.788 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T03:13:21.788 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T03:13:21.788 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T03:13:21.788 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T03:13:21.788 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T03:13:21.788 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T03:13:21.788 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T03:13:21.788 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T03:13:21.789 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T03:13:21.789 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T03:13:21.789 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T03:13:21.789 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T03:13:21.789 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T03:13:21.789 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T03:13:21.789 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T03:13:21.789 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T03:13:21.789 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T03:13:21.789 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T03:13:21.789 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T03:13:21.789 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T03:13:21.789 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T03:13:21.789 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T03:13:21.790 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T03:13:21.790 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T03:13:21.790 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T03:13:21.790 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T03:13:21.790 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T03:13:21.790 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T03:13:21.790 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T03:13:21.790 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T03:13:21.790 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T03:13:21.790 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T03:13:21.790 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T03:13:21.790 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T03:13:21.790 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T03:13:21.790 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T03:13:21.791 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T03:13:21.791 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T03:13:21.791 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T03:13:21.791 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T03:13:21.791 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T03:13:21.791 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T03:13:21.791 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T03:13:21.791 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T03:13:21.791 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T03:13:21.791 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T03:13:21.791 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T03:13:21.791 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T03:13:21.791 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T03:13:21.791 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T03:13:21.791 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T03:13:21.792 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T03:13:21.792 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T03:13:21.792 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T03:13:21.792 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T03:13:21.792 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T03:13:21.792 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T03:13:21.792 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T03:13:21.792 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T03:13:21.792 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T03:13:21.792 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T03:13:21.792 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T03:13:21.792 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T03:13:21.792 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T03:13:21.792 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T03:13:21.792 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T03:13:21.793 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T03:13:21.793 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T03:13:21.793 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T03:13:21.793 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T03:13:21.793 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T03:13:21.793 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T03:13:21.793 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T03:13:21.793 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T03:13:21.793 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T03:13:21.793 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T03:13:21.793 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T03:13:21.793 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T03:13:21.793 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T03:13:21.793 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T03:13:21.793 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T03:13:21.794 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T03:13:21.794 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T03:13:21.794 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T03:13:21.794 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T03:13:21.794 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T03:13:21.794 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T03:13:21.794 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T03:13:21.794 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T03:13:21.794 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T03:13:21.794 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T03:13:21.794 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T03:13:21.794 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T03:13:21.794 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T03:13:21.794 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T03:13:21.794 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T03:13:21.795 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T03:13:21.795 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T03:13:21.795 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T03:13:21.795 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T03:13:21.795 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T03:13:21.795 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T03:13:21.795 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T03:13:21.795 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T03:13:21.795 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T03:13:21.795 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T03:13:21.795 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T03:13:21.795 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T03:13:21.795 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T03:13:21.795 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T03:13:21.795 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T03:13:21.796 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T03:13:21.796 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T03:13:21.796 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T03:13:21.796 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T03:13:21.796 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T03:13:21.796 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T03:13:21.796 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T03:13:21.796 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T03:13:23.131 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:13:23.131 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:23.131 INFO:teuthology.orchestra.run.smithi090.stdout:Upgraded: 2024-09-21T03:13:23.132 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T03:13:23.132 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T03:13:23.132 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T03:13:23.132 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T03:13:23.132 INFO:teuthology.orchestra.run.smithi090.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.132 INFO:teuthology.orchestra.run.smithi090.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.132 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T03:13:23.132 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T03:13:23.132 INFO:teuthology.orchestra.run.smithi090.stdout:Installed: 2024-09-21T03:13:23.132 INFO:teuthology.orchestra.run.smithi090.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T03:13:23.132 INFO:teuthology.orchestra.run.smithi090.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T03:13:23.132 INFO:teuthology.orchestra.run.smithi090.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T03:13:23.132 INFO:teuthology.orchestra.run.smithi090.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T03:13:23.132 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.133 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.133 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.133 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.133 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:13:23.133 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.133 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.133 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.133 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:13:23.133 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:13:23.133 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:13:23.133 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:13:23.133 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:13:23.133 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.133 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.133 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:13:23.133 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.134 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.134 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.134 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:13:23.134 INFO:teuthology.orchestra.run.smithi090.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:13:23.134 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.134 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.134 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:13:23.134 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T03:13:23.134 INFO:teuthology.orchestra.run.smithi090.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T03:13:23.134 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T03:13:23.134 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T03:13:23.134 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T03:13:23.134 INFO:teuthology.orchestra.run.smithi090.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T03:13:23.134 INFO:teuthology.orchestra.run.smithi090.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T03:13:23.135 INFO:teuthology.orchestra.run.smithi090.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T03:13:23.135 INFO:teuthology.orchestra.run.smithi090.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T03:13:23.135 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T03:13:23.135 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T03:13:23.135 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.135 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.135 INFO:teuthology.orchestra.run.smithi090.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.135 INFO:teuthology.orchestra.run.smithi090.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T03:13:23.135 INFO:teuthology.orchestra.run.smithi090.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T03:13:23.135 INFO:teuthology.orchestra.run.smithi090.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T03:13:23.135 INFO:teuthology.orchestra.run.smithi090.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T03:13:23.135 INFO:teuthology.orchestra.run.smithi090.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T03:13:23.135 INFO:teuthology.orchestra.run.smithi090.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T03:13:23.135 INFO:teuthology.orchestra.run.smithi090.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.135 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.136 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T03:13:23.136 INFO:teuthology.orchestra.run.smithi090.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.136 INFO:teuthology.orchestra.run.smithi090.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T03:13:23.136 INFO:teuthology.orchestra.run.smithi090.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T03:13:23.136 INFO:teuthology.orchestra.run.smithi090.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T03:13:23.136 INFO:teuthology.orchestra.run.smithi090.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T03:13:23.136 INFO:teuthology.orchestra.run.smithi090.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T03:13:23.136 INFO:teuthology.orchestra.run.smithi090.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T03:13:23.136 INFO:teuthology.orchestra.run.smithi090.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T03:13:23.136 INFO:teuthology.orchestra.run.smithi090.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T03:13:23.136 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T03:13:23.136 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T03:13:23.136 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T03:13:23.136 INFO:teuthology.orchestra.run.smithi090.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T03:13:23.136 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T03:13:23.137 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T03:13:23.137 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T03:13:23.137 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T03:13:23.137 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T03:13:23.137 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T03:13:23.137 INFO:teuthology.orchestra.run.smithi090.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T03:13:23.137 INFO:teuthology.orchestra.run.smithi090.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T03:13:23.137 INFO:teuthology.orchestra.run.smithi090.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T03:13:23.137 INFO:teuthology.orchestra.run.smithi090.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T03:13:23.137 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T03:13:23.137 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.137 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.137 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.137 INFO:teuthology.orchestra.run.smithi090.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T03:13:23.137 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T03:13:23.138 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T03:13:23.138 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T03:13:23.138 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T03:13:23.138 INFO:teuthology.orchestra.run.smithi090.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T03:13:23.138 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T03:13:23.138 INFO:teuthology.orchestra.run.smithi090.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T03:13:23.138 INFO:teuthology.orchestra.run.smithi090.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T03:13:23.138 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T03:13:23.138 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T03:13:23.138 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T03:13:23.138 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T03:13:23.138 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T03:13:23.138 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T03:13:23.138 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T03:13:23.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T03:13:23.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T03:13:23.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T03:13:23.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T03:13:23.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T03:13:23.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T03:13:23.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T03:13:23.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T03:13:23.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T03:13:23.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T03:13:23.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T03:13:23.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T03:13:23.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T03:13:23.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T03:13:23.140 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T03:13:23.140 INFO:teuthology.orchestra.run.smithi090.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T03:13:23.140 INFO:teuthology.orchestra.run.smithi090.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T03:13:23.140 INFO:teuthology.orchestra.run.smithi090.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T03:13:23.140 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T03:13:23.140 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T03:13:23.140 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T03:13:23.140 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T03:13:23.140 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T03:13:23.140 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T03:13:23.140 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.140 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.140 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T03:13:23.140 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T03:13:23.140 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T03:13:23.141 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.141 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T03:13:23.141 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T03:13:23.141 INFO:teuthology.orchestra.run.smithi090.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T03:13:23.141 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T03:13:23.141 INFO:teuthology.orchestra.run.smithi090.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T03:13:23.141 INFO:teuthology.orchestra.run.smithi090.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T03:13:23.141 INFO:teuthology.orchestra.run.smithi090.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T03:13:23.141 INFO:teuthology.orchestra.run.smithi090.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T03:13:23.141 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T03:13:23.141 INFO:teuthology.orchestra.run.smithi090.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T03:13:23.141 INFO:teuthology.orchestra.run.smithi090.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T03:13:23.141 INFO:teuthology.orchestra.run.smithi090.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T03:13:23.141 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T03:13:23.142 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T03:13:23.142 INFO:teuthology.orchestra.run.smithi090.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T03:13:23.142 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.142 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.142 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:23.142 INFO:teuthology.orchestra.run.smithi090.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T03:13:23.142 INFO:teuthology.orchestra.run.smithi090.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T03:13:23.142 INFO:teuthology.orchestra.run.smithi090.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T03:13:23.142 INFO:teuthology.orchestra.run.smithi090.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T03:13:23.142 INFO:teuthology.orchestra.run.smithi090.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T03:13:23.142 INFO:teuthology.orchestra.run.smithi090.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T03:13:23.143 INFO:teuthology.orchestra.run.smithi090.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T03:13:23.143 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:23.143 INFO:teuthology.orchestra.run.smithi090.stdout:Complete! 2024-09-21T03:13:23.858 DEBUG:teuthology.parallel:result is None 2024-09-21T03:13:24.017 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:13:24.017 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:24.017 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2024-09-21T03:13:24.017 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T03:13:24.017 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T03:13:24.017 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T03:13:24.017 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T03:13:24.017 INFO:teuthology.orchestra.run.smithi149.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.018 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.018 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T03:13:24.018 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T03:13:24.018 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T03:13:24.018 INFO:teuthology.orchestra.run.smithi149.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T03:13:24.018 INFO:teuthology.orchestra.run.smithi149.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T03:13:24.018 INFO:teuthology.orchestra.run.smithi149.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T03:13:24.018 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T03:13:24.018 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.018 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.018 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.018 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.018 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:13:24.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:13:24.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:13:24.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:13:24.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:13:24.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:13:24.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:13:24.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.020 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.020 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:13:24.020 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:13:24.020 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.020 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.020 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:13:24.020 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T03:13:24.020 INFO:teuthology.orchestra.run.smithi149.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T03:13:24.020 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T03:13:24.020 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T03:13:24.020 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T03:13:24.020 INFO:teuthology.orchestra.run.smithi149.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T03:13:24.021 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T03:13:24.021 INFO:teuthology.orchestra.run.smithi149.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T03:13:24.021 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T03:13:24.021 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T03:13:24.021 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T03:13:24.021 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.021 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.021 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.021 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T03:13:24.021 INFO:teuthology.orchestra.run.smithi149.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T03:13:24.021 INFO:teuthology.orchestra.run.smithi149.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T03:13:24.021 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T03:13:24.021 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T03:13:24.022 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T03:13:24.022 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.022 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.022 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T03:13:24.022 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.022 INFO:teuthology.orchestra.run.smithi149.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T03:13:24.022 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T03:13:24.022 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T03:13:24.022 INFO:teuthology.orchestra.run.smithi149.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T03:13:24.022 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T03:13:24.022 INFO:teuthology.orchestra.run.smithi149.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T03:13:24.022 INFO:teuthology.orchestra.run.smithi149.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T03:13:24.023 INFO:teuthology.orchestra.run.smithi149.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T03:13:24.023 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T03:13:24.023 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T03:13:24.023 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T03:13:24.023 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T03:13:24.023 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T03:13:24.023 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T03:13:24.023 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T03:13:24.023 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T03:13:24.023 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T03:13:24.023 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T03:13:24.023 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T03:13:24.023 INFO:teuthology.orchestra.run.smithi149.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T03:13:24.024 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T03:13:24.024 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T03:13:24.024 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T03:13:24.024 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.024 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.024 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.024 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T03:13:24.024 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T03:13:24.024 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T03:13:24.024 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T03:13:24.024 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T03:13:24.024 INFO:teuthology.orchestra.run.smithi149.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T03:13:24.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T03:13:24.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T03:13:24.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T03:13:24.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T03:13:24.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T03:13:24.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T03:13:24.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T03:13:24.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T03:13:24.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T03:13:24.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T03:13:24.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T03:13:24.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T03:13:24.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T03:13:24.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T03:13:24.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T03:13:24.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T03:13:24.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T03:13:24.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T03:13:24.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T03:13:24.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T03:13:24.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T03:13:24.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T03:13:24.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T03:13:24.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T03:13:24.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T03:13:24.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T03:13:24.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T03:13:24.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T03:13:24.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T03:13:24.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T03:13:24.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T03:13:24.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T03:13:24.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T03:13:24.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T03:13:24.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T03:13:24.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T03:13:24.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T03:13:24.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T03:13:24.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T03:13:24.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T03:13:24.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T03:13:24.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T03:13:24.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T03:13:24.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T03:13:24.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T03:13:24.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T03:13:24.029 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T03:13:24.029 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T03:13:24.029 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T03:13:24.029 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T03:13:24.029 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T03:13:24.029 INFO:teuthology.orchestra.run.smithi149.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T03:13:24.029 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.029 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.029 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:13:24.029 INFO:teuthology.orchestra.run.smithi149.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T03:13:24.029 INFO:teuthology.orchestra.run.smithi149.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T03:13:24.029 INFO:teuthology.orchestra.run.smithi149.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T03:13:24.029 INFO:teuthology.orchestra.run.smithi149.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T03:13:24.029 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T03:13:24.030 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T03:13:24.030 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T03:13:24.030 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:24.030 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T03:13:24.716 DEBUG:teuthology.parallel:result is None 2024-09-21T03:13:24.716 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:13:24.861 DEBUG:teuthology.orchestra.run.smithi090:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T03:13:24.910 INFO:teuthology.orchestra.run.smithi090.stdout:19.3.0-5120.g18432218.el9 2024-09-21T03:13:24.910 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T03:13:24.910 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T03:13:24.912 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:13:25.053 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T03:13:25.100 INFO:teuthology.orchestra.run.smithi149.stdout:19.3.0-5120.g18432218.el9 2024-09-21T03:13:25.100 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T03:13:25.100 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T03:13:25.102 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T03:13:25.102 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:13:25.102 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T03:13:25.164 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:13:25.164 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T03:13:25.223 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T03:13:25.223 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:13:25.223 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T03:13:25.288 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T03:13:25.387 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:13:25.387 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T03:13:25.443 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T03:13:25.540 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T03:13:25.541 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:13:25.541 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T03:13:25.598 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T03:13:25.698 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:13:25.698 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T03:13:25.754 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T03:13:25.853 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T03:13:25.853 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:13:25.853 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T03:13:25.910 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T03:13:26.004 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:13:26.051 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T03:13:26.110 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T03:13:26.212 INFO:teuthology.run_tasks:Running task ceph... 2024-09-21T03:13:26.297 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-21T03:13:26.297 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 777 /var/log/ceph 2024-09-21T03:13:26.301 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /var/log/ceph 2024-09-21T03:13:26.360 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-21T03:13:26.360 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T03:13:26.364 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T03:13:26.423 INFO:tasks.ceph:Creating extra log directories... 2024-09-21T03:13:26.424 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T03:13:26.427 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T03:13:26.493 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-21T03:13:26.494 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-21T03:13:26.494 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-21T03:13:26.494 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:13:26.494 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-21T03:13:26.528 DEBUG:teuthology.orchestra.run.smithi090:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-21T03:13:26.697 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-21T03:13:26.752 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:13:26.752 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-21T03:13:26.788 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-21T03:13:26.963 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-21T03:13:27.025 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-21T03:13:27.025 INFO:tasks.ceph:config {'conf': {'client': {'client_shutdown_timeout': 120}, 'global': {'ms die on skipped message': False}, 'mds': {'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-21T03:13:27.025 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913454', 'branch': 'wip-pdonnell-testing-20240920.212106-debug', 'description': 'fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7913454', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240920.212106-debug'}, 'ceph': {'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_shutdown_timeout': 120}, 'global': {'ms die on skipped message': False}, 'mds': {'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, 'kclient': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}, 'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240920.212106-debug', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 7864, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'sleep_before_teardown': 0, 'subset': '67/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240920.212106-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi090.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNT15L25I2uVUEhhXMUEr1r8CCalGoCRCBV1PrWYswhBDS7I3EBnSpRV3bGE0umVm5hiXAO9SQD7X+0QoxvOorI=', 'smithi149.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBODHpOtvhb41YA9KZ5QGi0DWt9cjOoth9cagTCh/u3fgGOr1sBw9cHL5o2Nor9Pj5JjCudI9/x/UsNe7sBgiBrM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_shutdown_timeout': 120}, 'global': {'ms die on skipped message': False}, 'mds': {'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'cluster': 'ceph'}}, {'kclient': None}, {'mon_thrash': {'check_mds_failover': True, 'revive_delay': 20, 'thrash_delay': 10}}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-20_23:48:22', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-21T03:13:27.026 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T03:13:27.030 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T03:13:27.065 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T03:13:27.107 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T03:13:27.162 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:13:27.162 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T03:13:27.197 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T03:13:27.197 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_1 2024-09-21T03:13:27.272 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T03:13:27.272 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:13:27.272 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 6h/6d Inode: 638 Links: 1 2024-09-21T03:13:27.272 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:13:27.272 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:13:27.272 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-21 03:13:13.357361453 +0000 2024-09-21T03:13:27.273 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-21 03:11:02.800452861 +0000 2024-09-21T03:13:27.273 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-21 03:11:02.800452861 +0000 2024-09-21T03:13:27.273 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-21 03:11:02.800452861 +0000 2024-09-21T03:13:27.273 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T03:13:27.365 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-21T03:13:27.365 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-21T03:13:27.365 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000328823 s, 1.6 MB/s 2024-09-21T03:13:27.367 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T03:13:27.404 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_2 2024-09-21T03:13:27.480 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T03:13:27.480 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:13:27.480 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 6h/6d Inode: 659 Links: 1 2024-09-21T03:13:27.480 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:13:27.480 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:13:27.480 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-21 03:13:13.358361437 +0000 2024-09-21T03:13:27.480 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-21 03:11:03.298444879 +0000 2024-09-21T03:13:27.480 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-21 03:11:03.298444879 +0000 2024-09-21T03:13:27.481 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-21 03:11:03.298444879 +0000 2024-09-21T03:13:27.481 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T03:13:27.573 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-21T03:13:27.573 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-21T03:13:27.573 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000267768 s, 1.9 MB/s 2024-09-21T03:13:27.575 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T03:13:27.611 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_3 2024-09-21T03:13:27.686 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T03:13:27.686 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:13:27.686 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 6h/6d Inode: 676 Links: 1 2024-09-21T03:13:27.686 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:13:27.686 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:13:27.686 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-21 03:13:13.358361437 +0000 2024-09-21T03:13:27.686 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-21 03:11:03.751437617 +0000 2024-09-21T03:13:27.687 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-21 03:11:03.751437617 +0000 2024-09-21T03:13:27.687 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-21 03:11:03.751437617 +0000 2024-09-21T03:13:27.687 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T03:13:27.778 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-21T03:13:27.778 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-21T03:13:27.779 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000259771 s, 2.0 MB/s 2024-09-21T03:13:27.781 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T03:13:27.817 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_4 2024-09-21T03:13:27.892 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T03:13:27.892 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:13:27.892 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 6h/6d Inode: 696 Links: 1 2024-09-21T03:13:27.892 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:13:27.893 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:13:27.893 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-21 03:13:13.359361420 +0000 2024-09-21T03:13:27.893 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-21 03:11:04.209430274 +0000 2024-09-21T03:13:27.893 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-21 03:11:04.210430258 +0000 2024-09-21T03:13:27.893 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-21 03:11:04.209430274 +0000 2024-09-21T03:13:27.893 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T03:13:27.984 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-21T03:13:27.984 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-21T03:13:27.984 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000293903 s, 1.7 MB/s 2024-09-21T03:13:27.987 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T03:13:28.023 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T03:13:28.023 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:13:28.023 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T03:13:28.059 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T03:13:28.059 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2024-09-21T03:13:28.134 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T03:13:28.134 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:13:28.134 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 764 Links: 1 2024-09-21T03:13:28.134 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:13:28.134 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:13:28.134 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-21 03:13:15.915539426 +0000 2024-09-21T03:13:28.134 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-21 03:11:11.827795302 +0000 2024-09-21T03:13:28.135 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-21 03:11:11.827795302 +0000 2024-09-21T03:13:28.135 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-21 03:11:11.827795302 +0000 2024-09-21T03:13:28.135 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T03:13:28.227 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-21T03:13:28.227 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-21T03:13:28.227 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000353282 s, 1.4 MB/s 2024-09-21T03:13:28.230 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T03:13:28.267 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2024-09-21T03:13:28.343 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T03:13:28.343 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:13:28.344 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 783 Links: 1 2024-09-21T03:13:28.344 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:13:28.344 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:13:28.344 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-21 03:13:15.916539405 +0000 2024-09-21T03:13:28.344 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-21 03:11:12.301785657 +0000 2024-09-21T03:13:28.344 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-21 03:11:12.301785657 +0000 2024-09-21T03:13:28.344 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-21 03:11:12.301785657 +0000 2024-09-21T03:13:28.344 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T03:13:28.437 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-21T03:13:28.437 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-21T03:13:28.437 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000322156 s, 1.6 MB/s 2024-09-21T03:13:28.439 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T03:13:28.475 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2024-09-21T03:13:28.552 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T03:13:28.552 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:13:28.552 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 805 Links: 1 2024-09-21T03:13:28.552 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:13:28.552 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:13:28.552 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-21 03:13:15.916539405 +0000 2024-09-21T03:13:28.552 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-21 03:11:12.752776482 +0000 2024-09-21T03:13:28.552 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-21 03:11:12.752776482 +0000 2024-09-21T03:13:28.552 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-21 03:11:12.752776482 +0000 2024-09-21T03:13:28.553 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T03:13:28.644 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-21T03:13:28.644 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-21T03:13:28.644 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000307595 s, 1.7 MB/s 2024-09-21T03:13:28.646 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T03:13:28.682 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2024-09-21T03:13:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T03:13:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:13:28.757 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 821 Links: 1 2024-09-21T03:13:28.757 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:13:28.757 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:13:28.757 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-21 03:13:15.918539364 +0000 2024-09-21T03:13:28.757 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-21 03:11:13.252766308 +0000 2024-09-21T03:13:28.757 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-21 03:11:13.252766308 +0000 2024-09-21T03:13:28.757 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-21 03:11:13.252766308 +0000 2024-09-21T03:13:28.758 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T03:13:28.850 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-21T03:13:28.850 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-21T03:13:28.850 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000322391 s, 1.6 MB/s 2024-09-21T03:13:28.852 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T03:13:28.889 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T03:13:28.889 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi090.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T03:13:28.889 INFO:tasks.ceph:Generating config... 2024-09-21T03:13:28.890 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-09-21T03:13:28.890 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-21T03:13:28.890 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-09-21T03:13:28.890 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-09-21T03:13:28.890 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-09-21T03:13:28.890 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-09-21T03:13:28.890 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-09-21T03:13:28.891 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-21T03:13:28.891 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-21T03:13:28.891 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-21T03:13:28.891 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-21T03:13:28.891 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-21T03:13:28.891 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-21T03:13:28.891 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-21T03:13:28.891 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-21T03:13:28.891 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-21T03:13:28.891 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-21T03:13:28.891 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-21T03:13:28.891 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-21T03:13:28.891 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-21T03:13:28.891 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-21T03:13:28.891 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-21T03:13:28.892 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-21T03:13:28.892 INFO:tasks.ceph:[osd] filestore flush min = 0 2024-09-21T03:13:28.892 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-09-21T03:13:28.892 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-21T03:13:28.892 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-21T03:13:28.892 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-21T03:13:28.892 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-09-21T03:13:28.892 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-09-21T03:13:28.892 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-09-21T03:13:28.892 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-09-21T03:13:28.892 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-21T03:13:28.892 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-21T03:13:28.892 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-21T03:13:28.892 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-21T03:13:28.893 INFO:tasks.ceph:Setting up mon.a... 2024-09-21T03:13:28.893 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-21T03:13:29.066 INFO:teuthology.orchestra.run.smithi090.stdout:creating /etc/ceph/ceph.keyring 2024-09-21T03:13:29.079 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-21T03:13:29.230 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T03:13:29.285 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.90'), ('mon.b', '172.21.15.149'), ('mon.c', '[v2:172.21.15.149:3301,v1:172.21.15.149:6790]')] 2024-09-21T03:13:29.286 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.90,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client_shutdown_timeout': 120}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500}} 2024-09-21T03:13:29.286 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:13:29.286 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T03:13:29.321 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.90 --add b 172.21.15.149 --addv c '[v2:172.21.15.149:3301,v1:172.21.15.149:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:13:29.501 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:13:29.501 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: generated fsid 03c7e55f-7aae-4606-9d16-02ae95467377 2024-09-21T03:13:29.501 INFO:teuthology.orchestra.run.smithi090.stdout:setting min_mon_release = quincy 2024-09-21T03:13:29.501 INFO:teuthology.orchestra.run.smithi090.stdout:epoch 0 2024-09-21T03:13:29.501 INFO:teuthology.orchestra.run.smithi090.stdout:fsid 03c7e55f-7aae-4606-9d16-02ae95467377 2024-09-21T03:13:29.501 INFO:teuthology.orchestra.run.smithi090.stdout:last_changed 2024-09-21T03:13:29.500858+0000 2024-09-21T03:13:29.502 INFO:teuthology.orchestra.run.smithi090.stdout:created 2024-09-21T03:13:29.500858+0000 2024-09-21T03:13:29.502 INFO:teuthology.orchestra.run.smithi090.stdout:min_mon_release 17 (quincy) 2024-09-21T03:13:29.502 INFO:teuthology.orchestra.run.smithi090.stdout:election_strategy: 1 2024-09-21T03:13:29.502 INFO:teuthology.orchestra.run.smithi090.stdout:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-09-21T03:13:29.502 INFO:teuthology.orchestra.run.smithi090.stdout:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-21T03:13:29.502 INFO:teuthology.orchestra.run.smithi090.stdout:2: [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] mon.c 2024-09-21T03:13:29.502 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-21T03:13:29.510 DEBUG:teuthology.orchestra.run.smithi090:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T03:13:29.544 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 03c7e55f-7aae-4606-9d16-02ae95467377... 2024-09-21T03:13:29.544 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T03:13:29.589 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T03:13:29.682 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2024-09-21T03:13:29.682 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2024-09-21T03:13:29.682 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T03:13:29.682 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2024-09-21T03:13:29.682 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.682 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2024-09-21T03:13:29.682 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.682 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2024-09-21T03:13:29.682 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.682 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2024-09-21T03:13:29.683 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2024-09-21T03:13:29.683 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.683 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2024-09-21T03:13:29.683 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2024-09-21T03:13:29.683 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.683 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T03:13:29.683 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2024-09-21T03:13:29.683 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.683 INFO:teuthology.orchestra.run.smithi090.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T03:13:29.683 INFO:teuthology.orchestra.run.smithi090.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T03:13:29.683 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.683 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2024-09-21T03:13:29.683 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.683 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2024-09-21T03:13:29.684 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2024-09-21T03:13:29.684 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2024-09-21T03:13:29.684 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2024-09-21T03:13:29.684 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2024-09-21T03:13:29.684 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2024-09-21T03:13:29.684 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2024-09-21T03:13:29.684 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T03:13:29.684 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T03:13:29.684 INFO:teuthology.orchestra.run.smithi090.stdout: mon_allow_pool_size_one = true 2024-09-21T03:13:29.684 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.684 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T03:13:29.684 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.684 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2024-09-21T03:13:29.685 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.685 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2024-09-21T03:13:29.685 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.685 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2024-09-21T03:13:29.685 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2024-09-21T03:13:29.685 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2024-09-21T03:13:29.685 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.90,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]" 2024-09-21T03:13:29.685 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on skipped message = False 2024-09-21T03:13:29.685 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = 03c7e55f-7aae-4606-9d16-02ae95467377 2024-09-21T03:13:29.685 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.685 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2024-09-21T03:13:29.685 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2024-09-21T03:13:29.685 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.685 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2024-09-21T03:13:29.685 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2024-09-21T03:13:29.686 INFO:teuthology.orchestra.run.smithi090.stdout: osd mclock profile = high_recovery_ops 2024-09-21T03:13:29.686 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.686 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2024-09-21T03:13:29.686 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2024-09-21T03:13:29.686 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.686 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2024-09-21T03:13:29.686 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2024-09-21T03:13:29.686 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2024-09-21T03:13:29.686 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug trim objects = true 2024-09-21T03:13:29.686 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.686 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2024-09-21T03:13:29.686 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2024-09-21T03:13:29.686 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.687 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2024-09-21T03:13:29.687 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.687 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2024-09-21T03:13:29.687 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.687 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2024-09-21T03:13:29.687 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.687 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2024-09-21T03:13:29.687 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2024-09-21T03:13:29.687 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.687 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2024-09-21T03:13:29.687 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2024-09-21T03:13:29.687 INFO:teuthology.orchestra.run.smithi090.stdout: bdev async discard = True 2024-09-21T03:13:29.687 INFO:teuthology.orchestra.run.smithi090.stdout: bdev enable discard = True 2024-09-21T03:13:29.688 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore allocator = bitmap 2024-09-21T03:13:29.688 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2024-09-21T03:13:29.688 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2024-09-21T03:13:29.688 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 1/20 2024-09-21T03:13:29.688 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 1/20 2024-09-21T03:13:29.688 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-21T03:13:29.688 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2024-09-21T03:13:29.688 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 4/10 2024-09-21T03:13:29.688 INFO:teuthology.orchestra.run.smithi090.stdout: filestore flush min = 0 2024-09-21T03:13:29.688 INFO:teuthology.orchestra.run.smithi090.stdout: mon client directed command retry = 5 2024-09-21T03:13:29.688 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T03:13:29.688 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2024-09-21T03:13:29.688 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2024-09-21T03:13:29.688 INFO:teuthology.orchestra.run.smithi090.stdout: ms inject delay max = 1 2024-09-21T03:13:29.688 INFO:teuthology.orchestra.run.smithi090.stdout: ms inject delay probability = 0.005 2024-09-21T03:13:29.689 INFO:teuthology.orchestra.run.smithi090.stdout: ms inject delay type = client mds 2024-09-21T03:13:29.689 INFO:teuthology.orchestra.run.smithi090.stdout: ms inject socket failures = 2500 2024-09-21T03:13:29.689 INFO:teuthology.orchestra.run.smithi090.stdout: osd blocked scrub grace period = 3600 2024-09-21T03:13:29.689 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2024-09-21T03:13:29.689 INFO:teuthology.orchestra.run.smithi090.stdout: osd max markdown count = 1000 2024-09-21T03:13:29.689 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2024-09-21T03:13:29.689 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.689 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2024-09-21T03:13:29.689 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-21T03:13:29.689 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2024-09-21T03:13:29.689 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-21T03:13:29.689 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-21T03:13:29.689 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-21T03:13:29.689 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-21T03:13:29.689 INFO:teuthology.orchestra.run.smithi090.stdout: mgr/telemetry/nag = false 2024-09-21T03:13:29.690 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.690 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2024-09-21T03:13:29.690 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-21T03:13:29.690 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-21T03:13:29.690 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2024-09-21T03:13:29.690 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-21T03:13:29.690 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2024-09-21T03:13:29.690 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2024-09-21T03:13:29.690 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-21T03:13:29.690 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2024-09-21T03:13:29.690 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2024-09-21T03:13:29.690 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-21T03:13:29.690 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.690 INFO:teuthology.orchestra.run.smithi090.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T03:13:29.691 INFO:teuthology.orchestra.run.smithi090.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T03:13:29.691 INFO:teuthology.orchestra.run.smithi090.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T03:13:29.691 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.691 INFO:teuthology.orchestra.run.smithi090.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T03:13:29.691 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T03:13:29.691 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T03:13:29.691 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.691 INFO:teuthology.orchestra.run.smithi090.stdout: # 1m isn't quite enough 2024-09-21T03:13:29.691 INFO:teuthology.orchestra.run.smithi090.stdout: mon_down_mkfs_grace = 2m 2024-09-21T03:13:29.691 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.691 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_filestore_osds = false 2024-09-21T03:13:29.691 INFO:teuthology.orchestra.run.smithi090.stdout: mon down mkfs grace = 300 2024-09-21T03:13:29.691 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:13:29.691 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2024-09-21T03:13:29.692 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2024-09-21T03:13:29.692 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2024-09-21T03:13:29.692 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2024-09-21T03:13:29.692 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T03:13:29.692 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T03:13:29.692 INFO:teuthology.orchestra.run.smithi090.stdout: client_shutdown_timeout = 120 2024-09-21T03:13:29.692 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2024-09-21T03:13:29.692 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2024-09-21T03:13:29.692 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2024-09-21T03:13:29.692 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2024-09-21T03:13:29.692 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2024-09-21T03:13:29.692 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2024-09-21T03:13:29.692 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2024-09-21T03:13:29.693 INFO:teuthology.orchestra.run.smithi090.stdout:[mds] 2024-09-21T03:13:29.693 INFO:teuthology.orchestra.run.smithi090.stdout: mon client directed command retry = 5 2024-09-21T03:13:29.693 INFO:teuthology.orchestra.run.smithi090.stdout: ms inject delay max = 1 2024-09-21T03:13:29.693 INFO:teuthology.orchestra.run.smithi090.stdout: ms inject delay probability = 0.005 2024-09-21T03:13:29.693 INFO:teuthology.orchestra.run.smithi090.stdout: ms inject delay type = client mds osd 2024-09-21T03:13:29.693 INFO:teuthology.orchestra.run.smithi090.stdout: ms inject socket failures = 2500 2024-09-21T03:13:29.693 INFO:teuthology.orchestra.run.smithi149.stdout:[global] 2024-09-21T03:13:29.693 INFO:teuthology.orchestra.run.smithi149.stdout: chdir = "" 2024-09-21T03:13:29.694 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T03:13:29.694 INFO:teuthology.orchestra.run.smithi149.stdout: auth supported = cephx 2024-09-21T03:13:29.694 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.694 INFO:teuthology.orchestra.run.smithi149.stdout: filestore xattr use omap = true 2024-09-21T03:13:29.694 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.694 INFO:teuthology.orchestra.run.smithi149.stdout: mon clock drift allowed = 1.000 2024-09-21T03:13:29.694 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.694 INFO:teuthology.orchestra.run.smithi149.stdout: osd crush chooseleaf type = 0 2024-09-21T03:13:29.694 INFO:teuthology.orchestra.run.smithi149.stdout: auth debug = true 2024-09-21T03:13:29.694 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.694 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on old message = true 2024-09-21T03:13:29.694 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on bug = true 2024-09-21T03:13:29.695 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.695 INFO:teuthology.orchestra.run.smithi149.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T03:13:29.695 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn max object skew = 0 2024-09-21T03:13:29.695 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.695 INFO:teuthology.orchestra.run.smithi149.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T03:13:29.695 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T03:13:29.695 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.695 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default size = 2 2024-09-21T03:13:29.695 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.695 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow primary affinity = true 2024-09-21T03:13:29.695 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow pg remap = true 2024-09-21T03:13:29.695 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on legacy crush tunables = false 2024-09-21T03:13:29.696 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on crush straw calc version zero = false 2024-09-21T03:13:29.696 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on no sortbitwise = false 2024-09-21T03:13:29.696 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on osd down out interval zero = false 2024-09-21T03:13:29.696 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on too few osds = false 2024-09-21T03:13:29.696 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T03:13:29.696 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T03:13:29.696 INFO:teuthology.orchestra.run.smithi149.stdout: mon_allow_pool_size_one = true 2024-09-21T03:13:29.696 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.696 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T03:13:29.696 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.696 INFO:teuthology.orchestra.run.smithi149.stdout: osd default data pool replay window = 5 2024-09-21T03:13:29.696 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.696 INFO:teuthology.orchestra.run.smithi149.stdout: mon allow pool delete = true 2024-09-21T03:13:29.696 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.697 INFO:teuthology.orchestra.run.smithi149.stdout: mon cluster log file level = debug 2024-09-21T03:13:29.697 INFO:teuthology.orchestra.run.smithi149.stdout: debug asserts on shutdown = true 2024-09-21T03:13:29.697 INFO:teuthology.orchestra.run.smithi149.stdout: mon health detail to clog = false 2024-09-21T03:13:29.697 INFO:teuthology.orchestra.run.smithi149.stdout: mon host = "172.21.15.90,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]" 2024-09-21T03:13:29.697 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on skipped message = False 2024-09-21T03:13:29.697 INFO:teuthology.orchestra.run.smithi149.stdout: fsid = 03c7e55f-7aae-4606-9d16-02ae95467377 2024-09-21T03:13:29.697 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.697 INFO:teuthology.orchestra.run.smithi149.stdout:[osd] 2024-09-21T03:13:29.697 INFO:teuthology.orchestra.run.smithi149.stdout: osd journal size = 100 2024-09-21T03:13:29.697 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.697 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub load threshold = 5.0 2024-09-21T03:13:29.697 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub max interval = 600 2024-09-21T03:13:29.697 INFO:teuthology.orchestra.run.smithi149.stdout: osd mclock profile = high_recovery_ops 2024-09-21T03:13:29.697 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.698 INFO:teuthology.orchestra.run.smithi149.stdout: osd recover clone overlap = true 2024-09-21T03:13:29.698 INFO:teuthology.orchestra.run.smithi149.stdout: osd recovery max chunk = 1048576 2024-09-21T03:13:29.698 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.698 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug shutdown = true 2024-09-21T03:13:29.698 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug op order = true 2024-09-21T03:13:29.698 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify stray on activate = true 2024-09-21T03:13:29.698 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug trim objects = true 2024-09-21T03:13:29.698 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.698 INFO:teuthology.orchestra.run.smithi149.stdout: osd open classes on start = true 2024-09-21T03:13:29.698 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug pg log writeout = true 2024-09-21T03:13:29.698 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.698 INFO:teuthology.orchestra.run.smithi149.stdout: osd deep scrub update digest min age = 30 2024-09-21T03:13:29.699 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.699 INFO:teuthology.orchestra.run.smithi149.stdout: osd map max advance = 10 2024-09-21T03:13:29.699 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.699 INFO:teuthology.orchestra.run.smithi149.stdout: journal zero on create = true 2024-09-21T03:13:29.699 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.699 INFO:teuthology.orchestra.run.smithi149.stdout: filestore ondisk finisher threads = 3 2024-09-21T03:13:29.699 INFO:teuthology.orchestra.run.smithi149.stdout: filestore apply finisher threads = 3 2024-09-21T03:13:29.699 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.699 INFO:teuthology.orchestra.run.smithi149.stdout: bdev debug aio = true 2024-09-21T03:13:29.699 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug misdirected ops = true 2024-09-21T03:13:29.699 INFO:teuthology.orchestra.run.smithi149.stdout: bdev async discard = True 2024-09-21T03:13:29.699 INFO:teuthology.orchestra.run.smithi149.stdout: bdev enable discard = True 2024-09-21T03:13:29.700 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore allocator = bitmap 2024-09-21T03:13:29.700 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore block size = 96636764160 2024-09-21T03:13:29.700 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore fsck on mount = True 2024-09-21T03:13:29.700 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluefs = 1/20 2024-09-21T03:13:29.700 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluestore = 1/20 2024-09-21T03:13:29.700 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-09-21T03:13:29.700 INFO:teuthology.orchestra.run.smithi149.stdout: debug osd = 20 2024-09-21T03:13:29.700 INFO:teuthology.orchestra.run.smithi149.stdout: debug rocksdb = 4/10 2024-09-21T03:13:29.700 INFO:teuthology.orchestra.run.smithi149.stdout: filestore flush min = 0 2024-09-21T03:13:29.700 INFO:teuthology.orchestra.run.smithi149.stdout: mon client directed command retry = 5 2024-09-21T03:13:29.700 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T03:13:29.700 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd full ratio = 0.9 2024-09-21T03:13:29.701 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd nearfull ratio = 0.8 2024-09-21T03:13:29.701 INFO:teuthology.orchestra.run.smithi149.stdout: ms inject delay max = 1 2024-09-21T03:13:29.701 INFO:teuthology.orchestra.run.smithi149.stdout: ms inject delay probability = 0.005 2024-09-21T03:13:29.701 INFO:teuthology.orchestra.run.smithi149.stdout: ms inject delay type = client mds 2024-09-21T03:13:29.701 INFO:teuthology.orchestra.run.smithi149.stdout: ms inject socket failures = 2500 2024-09-21T03:13:29.701 INFO:teuthology.orchestra.run.smithi149.stdout: osd blocked scrub grace period = 3600 2024-09-21T03:13:29.701 INFO:teuthology.orchestra.run.smithi149.stdout: osd failsafe full ratio = 0.95 2024-09-21T03:13:29.701 INFO:teuthology.orchestra.run.smithi149.stdout: osd max markdown count = 1000 2024-09-21T03:13:29.701 INFO:teuthology.orchestra.run.smithi149.stdout: osd objectstore = bluestore 2024-09-21T03:13:29.701 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.701 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr] 2024-09-21T03:13:29.701 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-09-21T03:13:29.701 INFO:teuthology.orchestra.run.smithi149.stdout: debug mgr = 20 2024-09-21T03:13:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2024-09-21T03:13:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2024-09-21T03:13:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2024-09-21T03:13:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2024-09-21T03:13:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: mgr/telemetry/nag = false 2024-09-21T03:13:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.702 INFO:teuthology.orchestra.run.smithi149.stdout:[mon] 2024-09-21T03:13:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-09-21T03:13:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2024-09-21T03:13:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: debug paxos = 20 2024-09-21T03:13:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2024-09-21T03:13:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: mon data avail warn = 5 2024-09-21T03:13:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: mon mgr mkfs grace = 240 2024-09-21T03:13:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2024-09-21T03:13:29.702 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd reporter subtree level = osd 2024-09-21T03:13:29.703 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd prime pg temp = true 2024-09-21T03:13:29.703 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2024-09-21T03:13:29.703 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.703 INFO:teuthology.orchestra.run.smithi149.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T03:13:29.703 INFO:teuthology.orchestra.run.smithi149.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T03:13:29.703 INFO:teuthology.orchestra.run.smithi149.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T03:13:29.703 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.703 INFO:teuthology.orchestra.run.smithi149.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T03:13:29.703 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T03:13:29.703 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T03:13:29.703 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.703 INFO:teuthology.orchestra.run.smithi149.stdout: # 1m isn't quite enough 2024-09-21T03:13:29.703 INFO:teuthology.orchestra.run.smithi149.stdout: mon_down_mkfs_grace = 2m 2024-09-21T03:13:29.703 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.703 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_filestore_osds = false 2024-09-21T03:13:29.703 INFO:teuthology.orchestra.run.smithi149.stdout: mon down mkfs grace = 300 2024-09-21T03:13:29.704 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T03:13:29.704 INFO:teuthology.orchestra.run.smithi149.stdout:[client] 2024-09-21T03:13:29.704 INFO:teuthology.orchestra.run.smithi149.stdout: rgw cache enabled = true 2024-09-21T03:13:29.704 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable ops log = true 2024-09-21T03:13:29.704 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable usage log = true 2024-09-21T03:13:29.704 INFO:teuthology.orchestra.run.smithi149.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T03:13:29.704 INFO:teuthology.orchestra.run.smithi149.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T03:13:29.704 INFO:teuthology.orchestra.run.smithi149.stdout: client_shutdown_timeout = 120 2024-09-21T03:13:29.704 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.a] 2024-09-21T03:13:29.704 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.b] 2024-09-21T03:13:29.704 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.c] 2024-09-21T03:13:29.704 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2024-09-21T03:13:29.704 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2024-09-21T03:13:29.704 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2024-09-21T03:13:29.704 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2024-09-21T03:13:29.705 INFO:teuthology.orchestra.run.smithi149.stdout:[mds] 2024-09-21T03:13:29.705 INFO:teuthology.orchestra.run.smithi149.stdout: mon client directed command retry = 5 2024-09-21T03:13:29.705 INFO:teuthology.orchestra.run.smithi149.stdout: ms inject delay max = 1 2024-09-21T03:13:29.705 INFO:teuthology.orchestra.run.smithi149.stdout: ms inject delay probability = 0.005 2024-09-21T03:13:29.705 INFO:teuthology.orchestra.run.smithi149.stdout: ms inject delay type = client mds osd 2024-09-21T03:13:29.705 INFO:teuthology.orchestra.run.smithi149.stdout: ms inject socket failures = 2500 2024-09-21T03:13:29.715 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-21T03:13:29.715 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-21T03:13:29.880 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-21T03:13:29.880 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:13:29.880 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-21T03:13:29.915 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:13:29.915 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-21T03:13:29.990 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T03:13:29.990 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:13:29.990 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T03:13:29.990 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T03:13:30.106 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:13:30.106 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:13:30.182 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T03:13:30.182 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:13:30.182 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T03:13:30.182 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T03:13:30.260 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:13:30.260 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:13:30.335 INFO:tasks.ceph:Setting up mon nodes... 2024-09-21T03:13:30.335 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-21T03:13:30.335 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T03:13:30.503 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T03:13:30.515 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T03:13:30.687 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T03:13:30.700 INFO:tasks.ceph:Setting up mds nodes... 2024-09-21T03:13:30.700 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-21T03:13:30.865 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-21T03:13:30.876 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-21T03:13:30.931 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-21T03:13:31.096 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-21T03:13:31.107 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-21T03:13:31.162 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-21T03:13:31.330 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-21T03:13:31.341 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-21T03:13:31.397 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-21T03:13:31.561 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-21T03:13:31.572 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-21T03:13:31.627 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-21T03:13:31.627 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T03:13:31.770 INFO:teuthology.orchestra.run.smithi090.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-21T03:13:31.804 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T03:13:31.947 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-21T03:13:31.981 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-21T03:13:31.981 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi090.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T03:13:31.981 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-21T03:13:32.036 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T03:13:32.036 INFO:tasks.ceph:role: osd.0 2024-09-21T03:13:32.036 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T03:13:32.037 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T03:13:32.099 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T03:13:32.099 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T03:13:32.099 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T03:13:32.099 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T03:13:32.100 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T03:13:32.100 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-09-21T03:13:32.100 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T03:13:32.100 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T03:13:32.100 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T03:13:32.100 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T03:13:32.503 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-09-21T03:13:32.507 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-09-21T03:13:32.507 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-21T03:13:32.648 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-21T03:13:32.712 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-21T03:13:32.768 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T03:13:32.768 INFO:tasks.ceph:role: osd.1 2024-09-21T03:13:32.768 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T03:13:32.769 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T03:13:32.831 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T03:13:32.831 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T03:13:32.831 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T03:13:32.831 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T03:13:32.831 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T03:13:32.831 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-09-21T03:13:32.831 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T03:13:32.831 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T03:13:32.831 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T03:13:32.831 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T03:13:33.188 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-09-21T03:13:33.192 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-09-21T03:13:33.192 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-21T03:13:33.278 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-21T03:13:33.339 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-21T03:13:33.395 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T03:13:33.395 INFO:tasks.ceph:role: osd.2 2024-09-21T03:13:33.395 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T03:13:33.395 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T03:13:33.457 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T03:13:33.457 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T03:13:33.457 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T03:13:33.457 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T03:13:33.457 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T03:13:33.457 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-09-21T03:13:33.457 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T03:13:33.458 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T03:13:33.458 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T03:13:33.458 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T03:13:33.856 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-09-21T03:13:33.860 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-09-21T03:13:33.860 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-21T03:13:33.958 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-21T03:13:34.019 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-21T03:13:34.073 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T03:13:34.073 INFO:tasks.ceph:role: osd.3 2024-09-21T03:13:34.073 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T03:13:34.073 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T03:13:34.136 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T03:13:34.136 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T03:13:34.136 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T03:13:34.136 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T03:13:34.136 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T03:13:34.136 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-09-21T03:13:34.136 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T03:13:34.137 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T03:13:34.137 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T03:13:34.137 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T03:13:34.559 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-09-21T03:13:34.564 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-09-21T03:13:34.564 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-21T03:13:34.707 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-21T03:13:34.772 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:13:34.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:13:34.935+0000 7fbd563db640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-21T03:13:34.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:13:34.936+0000 7fbd563db640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-21T03:13:34.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:13:34.936+0000 7fbd563db640 -1 bdev(0x55ab734c1900 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-21T03:13:34.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:13:34.937+0000 7fbd563db640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-21T03:13:37.990 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T03:13:38.046 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:13:38.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:13:38.199+0000 7fe7fe7d7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-21T03:13:38.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:13:38.200+0000 7fe7fe7d7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-21T03:13:38.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:13:38.200+0000 7fe7fe7d7640 -1 bdev(0x55751af97900 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-21T03:13:38.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:13:38.200+0000 7fe7fe7d7640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-21T03:13:41.256 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T03:13:41.312 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:13:41.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:13:41.466+0000 7f41e021a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-21T03:13:41.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:13:41.466+0000 7f41e021a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-21T03:13:41.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:13:41.466+0000 7f41e021a640 -1 bdev(0x56384ba99900 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-21T03:13:41.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:13:41.466+0000 7f41e021a640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-21T03:13:44.701 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T03:13:44.759 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:13:44.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:13:44.912+0000 7f22de610640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-21T03:13:44.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:13:44.913+0000 7f22de610640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-21T03:13:44.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:13:44.913+0000 7f22de610640 -1 bdev(0x55e75ee29900 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-21T03:13:44.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:13:44.913+0000 7f22de610640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-21T03:13:47.928 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T03:13:47.985 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-21T03:13:48.047 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T03:13:48.047 INFO:tasks.ceph:role: osd.4 2024-09-21T03:13:48.047 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T03:13:48.048 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T03:13:48.112 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T03:13:48.112 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T03:13:48.112 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T03:13:48.112 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T03:13:48.112 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T03:13:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-09-21T03:13:48.113 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T03:13:48.113 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T03:13:48.113 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T03:13:48.113 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T03:13:48.520 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-09-21T03:13:48.525 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-09-21T03:13:48.525 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-21T03:13:48.645 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-21T03:13:48.708 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-21T03:13:48.764 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T03:13:48.764 INFO:tasks.ceph:role: osd.5 2024-09-21T03:13:48.764 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T03:13:48.764 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T03:13:48.828 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T03:13:48.828 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T03:13:48.828 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T03:13:48.828 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T03:13:48.828 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T03:13:48.828 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-09-21T03:13:48.828 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T03:13:48.828 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T03:13:48.828 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T03:13:48.828 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T03:13:49.195 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-09-21T03:13:49.199 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-09-21T03:13:49.199 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-21T03:13:49.286 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-21T03:13:49.348 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-21T03:13:49.405 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T03:13:49.405 INFO:tasks.ceph:role: osd.6 2024-09-21T03:13:49.405 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T03:13:49.405 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T03:13:49.468 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T03:13:49.468 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T03:13:49.468 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T03:13:49.468 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T03:13:49.468 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T03:13:49.468 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-09-21T03:13:49.468 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T03:13:49.469 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T03:13:49.469 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T03:13:49.469 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T03:13:49.867 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-09-21T03:13:49.870 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-09-21T03:13:49.870 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-21T03:13:49.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-21T03:13:50.033 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-21T03:13:50.089 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T03:13:50.089 INFO:tasks.ceph:role: osd.7 2024-09-21T03:13:50.089 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T03:13:50.089 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T03:13:50.151 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T03:13:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T03:13:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T03:13:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T03:13:50.151 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T03:13:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-09-21T03:13:50.151 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T03:13:50.151 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T03:13:50.151 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T03:13:50.151 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T03:13:50.581 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-09-21T03:13:50.585 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-09-21T03:13:50.585 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-21T03:13:50.713 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-21T03:13:50.778 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:13:50.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:13:50.946+0000 7f1614341640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-21T03:13:50.954 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:13:50.951+0000 7f1614341640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-21T03:13:50.954 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:13:50.952+0000 7f1614341640 -1 bdev(0x55c0a2861900 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-21T03:13:50.954 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:13:50.952+0000 7f1614341640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-21T03:13:54.015 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T03:13:54.074 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:13:54.230 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:13:54.228+0000 7f5c71e0b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-21T03:13:54.231 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:13:54.228+0000 7f5c71e0b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-21T03:13:54.231 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:13:54.228+0000 7f5c71e0b640 -1 bdev(0x56118fcdd900 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-21T03:13:54.231 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:13:54.229+0000 7f5c71e0b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-21T03:13:57.027 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:13:57.032 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:13:57.292 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T03:13:57.349 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:13:57.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:13:57.502+0000 7fbc43211640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-21T03:13:57.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:13:57.503+0000 7fbc43211640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-21T03:13:57.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:13:57.503+0000 7fbc43211640 -1 bdev(0x55e193d6f900 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-21T03:13:57.505 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:13:57.503+0000 7fbc43211640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-21T03:14:00.523 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-21T03:14:00.581 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:14:00.737 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:00.735+0000 7f5dab3bb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-21T03:14:00.737 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:00.736+0000 7f5dab3bb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-21T03:14:00.738 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:00.736+0000 7f5dab3bb640 -1 bdev(0x55b139eef900 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-21T03:14:00.738 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:00.737+0000 7f5dab3bb640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-21T03:14:03.752 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-21T03:14:03.810 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-21T03:14:03.810 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:14:03.810 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-21T03:14:03.872 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:14:03.872 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-21T03:14:03.969 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:14:03.969 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-21T03:14:04.065 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:14:04.065 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-21T03:14:04.160 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:14:04.160 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-21T03:14:04.255 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:14:04.255 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-21T03:14:04.351 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:14:04.351 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-21T03:14:04.445 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:14:04.445 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-21T03:14:04.505 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:14:04.506 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-21T03:14:04.604 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:14:04.604 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-21T03:14:04.701 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:14:04.701 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-21T03:14:04.796 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:14:04.796 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-21T03:14:04.892 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:14:04.892 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-21T03:14:04.987 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:14:04.987 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-21T03:14:05.082 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:14:05.082 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-21T03:14:05.118 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:14:05.118 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-21T03:14:05.156 INFO:tasks.ceph:Adding keys to all mons... 2024-09-21T03:14:05.157 DEBUG:teuthology.orchestra.run.smithi090:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T03:14:05.162 DEBUG:teuthology.orchestra.run.smithi149:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T03:14:05.211 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr.y] 2024-09-21T03:14:05.211 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDaOe5mQzf4HRAAWAAWdIwNB9B9reOEq5w1xQ== 2024-09-21T03:14:05.211 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2024-09-21T03:14:05.211 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDaOe5mhbGHMxAAR7mauznYmHuiT6zQowgIew== 2024-09-21T03:14:05.211 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2024-09-21T03:14:05.211 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDbOe5mjG69BRAAgHFxer8e05/awt9seXS0Lg== 2024-09-21T03:14:05.211 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.0] 2024-09-21T03:14:05.211 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDeOe5muNTQNxAAWBPMaPdQc/2hCXgH89qpag== 2024-09-21T03:14:05.211 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.1] 2024-09-21T03:14:05.211 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDiOe5mVHH4CxAAUSfQIOu4hvS7fQB46TneXQ== 2024-09-21T03:14:05.211 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.2] 2024-09-21T03:14:05.211 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDlOe5mobrZGxAABwITrLglhxaLwsNePqE3Zw== 2024-09-21T03:14:05.211 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.3] 2024-09-21T03:14:05.211 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDoOe5mXc90NhAAz/XGag8r436mBQydtmcJ3Q== 2024-09-21T03:14:05.212 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr.x] 2024-09-21T03:14:05.212 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDaOe5mkjjqKBAArbIegSBppBnfipUD4Jq0ow== 2024-09-21T03:14:05.212 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2024-09-21T03:14:05.212 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDbOe5mb+CuExAALk0JhhAe068as7nClRn6DQ== 2024-09-21T03:14:05.212 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2024-09-21T03:14:05.212 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDbOe5ma+lpIRAAc3e02vPw6e5D3x2ekK3czQ== 2024-09-21T03:14:05.212 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.4] 2024-09-21T03:14:05.212 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDuOe5mG3GFOBAA27/QdL7III2W/G9e1I7xVw== 2024-09-21T03:14:05.212 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.5] 2024-09-21T03:14:05.212 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDyOe5mL8OxDRAA79JA1PJmUQxQ5pEEYVuGxg== 2024-09-21T03:14:05.212 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.6] 2024-09-21T03:14:05.212 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQD1Oe5mJCYTHhAAalzV0BrrEWzeNyy7T5ASIg== 2024-09-21T03:14:05.212 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.7] 2024-09-21T03:14:05.212 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQD4Oe5mOS7nKxAAHaqKGu+bNE92ywChZVHqpg== 2024-09-21T03:14:05.212 INFO:teuthology.orchestra.run.smithi090.stdout:[client.0] 2024-09-21T03:14:05.212 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDbOe5m97HsLRAAs8CfFj8NR3LdXi+fHZtgRA== 2024-09-21T03:14:05.213 INFO:teuthology.orchestra.run.smithi090.stdout:[client.1] 2024-09-21T03:14:05.213 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDbOe5mE6p2OBAAd1Yavh1fmUfuvUUrWyL91A== 2024-09-21T03:14:05.249 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.y] 2024-09-21T03:14:05.249 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDaOe5mQzf4HRAAWAAWdIwNB9B9reOEq5w1xQ== 2024-09-21T03:14:05.250 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2024-09-21T03:14:05.250 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDaOe5mhbGHMxAAR7mauznYmHuiT6zQowgIew== 2024-09-21T03:14:05.250 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2024-09-21T03:14:05.250 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDbOe5mjG69BRAAgHFxer8e05/awt9seXS0Lg== 2024-09-21T03:14:05.250 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.0] 2024-09-21T03:14:05.250 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDeOe5muNTQNxAAWBPMaPdQc/2hCXgH89qpag== 2024-09-21T03:14:05.250 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.1] 2024-09-21T03:14:05.250 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDiOe5mVHH4CxAAUSfQIOu4hvS7fQB46TneXQ== 2024-09-21T03:14:05.250 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.2] 2024-09-21T03:14:05.250 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDlOe5mobrZGxAABwITrLglhxaLwsNePqE3Zw== 2024-09-21T03:14:05.250 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.3] 2024-09-21T03:14:05.250 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDoOe5mXc90NhAAz/XGag8r436mBQydtmcJ3Q== 2024-09-21T03:14:05.250 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.x] 2024-09-21T03:14:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDaOe5mkjjqKBAArbIegSBppBnfipUD4Jq0ow== 2024-09-21T03:14:05.251 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2024-09-21T03:14:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDbOe5mb+CuExAALk0JhhAe068as7nClRn6DQ== 2024-09-21T03:14:05.251 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2024-09-21T03:14:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDbOe5ma+lpIRAAc3e02vPw6e5D3x2ekK3czQ== 2024-09-21T03:14:05.251 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.4] 2024-09-21T03:14:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDuOe5mG3GFOBAA27/QdL7III2W/G9e1I7xVw== 2024-09-21T03:14:05.251 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.5] 2024-09-21T03:14:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDyOe5mL8OxDRAA79JA1PJmUQxQ5pEEYVuGxg== 2024-09-21T03:14:05.251 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.6] 2024-09-21T03:14:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQD1Oe5mJCYTHhAAalzV0BrrEWzeNyy7T5ASIg== 2024-09-21T03:14:05.251 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.7] 2024-09-21T03:14:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQD4Oe5mOS7nKxAAHaqKGu+bNE92ywChZVHqpg== 2024-09-21T03:14:05.251 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2024-09-21T03:14:05.251 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDbOe5m97HsLRAAs8CfFj8NR3LdXi+fHZtgRA== 2024-09-21T03:14:05.252 INFO:teuthology.orchestra.run.smithi149.stdout:[client.1] 2024-09-21T03:14:05.252 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDbOe5mE6p2OBAAd1Yavh1fmUfuvUUrWyL91A== 2024-09-21T03:14:05.252 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T03:14:05.258 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T03:14:05.456 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T03:14:05.460 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T03:14:05.625 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T03:14:05.629 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T03:14:05.795 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:14:05.800 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:14:05.963 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:14:05.966 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:14:06.129 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:14:06.133 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:14:06.296 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:14:06.300 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:14:06.462 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T03:14:06.466 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T03:14:06.627 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T03:14:06.631 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T03:14:06.796 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T03:14:06.799 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T03:14:06.965 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:14:06.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:14:07.223 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:14:07.227 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:14:07.389 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:14:07.393 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:14:07.555 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:14:07.560 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:14:07.722 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T03:14:07.726 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T03:14:07.889 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T03:14:07.893 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T03:14:08.057 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-21T03:14:08.057 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-21T03:14:08.111 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T03:14:08.288 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-21T03:14:08.344 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-21T03:14:08.401 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T03:14:08.579 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-21T03:14:08.635 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-21T03:14:08.691 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T03:14:08.866 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-21T03:14:08.922 DEBUG:teuthology.orchestra.run.smithi090:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:14:08.926 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:14:08.960 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-21T03:14:08.961 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-21T03:14:08.961 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-21T03:14:09.002 INFO:tasks.ceph.mon.a:Started 2024-09-21T03:14:09.003 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-21T03:14:09.003 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-21T03:14:09.007 INFO:tasks.ceph.mon.b:Started 2024-09-21T03:14:09.007 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-21T03:14:09.007 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-21T03:14:09.010 INFO:tasks.ceph.mon.c:Started 2024-09-21T03:14:09.011 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-21T03:14:09.011 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-21T03:14:09.011 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-21T03:14:09.015 INFO:tasks.ceph.mgr.y:Started 2024-09-21T03:14:09.016 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-21T03:14:09.016 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-21T03:14:09.019 INFO:tasks.ceph.mgr.x:Started 2024-09-21T03:14:09.020 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-21T03:14:09.020 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-21T03:14:09.024 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-21T03:14:09.024 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-21T03:14:09.070 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-21T03:14:09.070 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-21T03:14:09.114 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-21T03:14:09.115 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-21T03:14:09.160 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-21T03:14:09.160 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-21T03:14:09.206 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-21T03:14:09.207 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-21T03:14:09.256 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-21T03:14:09.257 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-21T03:14:09.305 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-21T03:14:09.305 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-21T03:14:09.353 INFO:tasks.ceph:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T03:14:09.353 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T03:14:09.401 INFO:tasks.ceph:setting config [mds] mds_bal_merge_size = 5 2024-09-21T03:14:09.401 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-21T03:14:09.451 INFO:tasks.ceph:setting config [mds] mds_bal_split_bits = 3 2024-09-21T03:14:09.451 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds mds_bal_split_bits 3 2024-09-21T03:14:09.502 INFO:tasks.ceph:setting config [mds] mds_bal_split_size = 100 2024-09-21T03:14:09.503 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds mds_bal_split_size 100 2024-09-21T03:14:09.552 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-21T03:14:09.552 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-21T03:14:09.605 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-21T03:14:09.605 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-21T03:14:09.663 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-21T03:14:09.664 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-21T03:14:09.715 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-21T03:14:09.715 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-21T03:14:09.774 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-21T03:14:09.774 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-21T03:14:09.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.787+0000 7f4cf8c00640 1 -- 172.21.15.90:0/23830599 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4cfc09e070 con 0x7f4cf416f1f0 2024-09-21T03:14:09.809 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T03:14:09.809 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-21T03:14:09.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.793+0000 7f978a000640 1 -- 172.21.15.90:0/2145579094 <== mon.1 v2:172.21.15.149:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v3)=0 v3) ==== 109+0+0 (secure 0 0 0) 0x7f978c006140 con 0x7f9794073a90 2024-09-21T03:14:09.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.800+0000 7f9793200640 1 -- 172.21.15.90:0/2145579094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9794073a90 msgr2=0x7f97940ab9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:09.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.800+0000 7f9793200640 1 --2- 172.21.15.90:0/2145579094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9794073a90 0x7f97940ab9f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f978c00c670 tx=0x7f978c00cb30 comp rx=0 tx=0).stop 2024-09-21T03:14:09.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.807+0000 7f9793200640 1 -- 172.21.15.90:0/2145579094 shutdown_connections 2024-09-21T03:14:09.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.807+0000 7f9793200640 1 --2- 172.21.15.90:0/2145579094 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f979415ac20 0x7f979413e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.807+0000 7f9793200640 1 --2- 172.21.15.90:0/2145579094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97941576e0 0x7f9794152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.807+0000 7f9793200640 1 --2- 172.21.15.90:0/2145579094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9794073a90 0x7f97940ab9f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.807+0000 7f9793200640 1 -- 172.21.15.90:0/2145579094 >> 172.21.15.90:0/2145579094 conn(0x7f97940c80a0 msgr2=0x7f979406e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:09.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.812+0000 7f0872a00640 1 -- 172.21.15.90:0/267234544 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f08800c2eb0 con 0x7f08800c2aa0 2024-09-21T03:14:09.831 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T03:14:09.831 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-21T03:14:09.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.821+0000 7f9fd2400640 1 -- 172.21.15.90:0/1726151082 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f9fa0005100 con 0x7f9fcc14fef0 2024-09-21T03:14:09.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.815+0000 7f9793200640 1 -- 172.21.15.90:0/2145579094 shutdown_connections 2024-09-21T03:14:09.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.815+0000 7f9793200640 1 -- 172.21.15.90:0/2145579094 wait complete. 2024-09-21T03:14:09.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.826+0000 7fb902000640 1 -- 172.21.15.90:0/3458278747 <== mon.0 v2:172.21.15.90:3300/0 8 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7fb904033aa0 con 0x7fb90c14b720 2024-09-21T03:14:09.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.825+0000 7f8cbfe00640 1 -- 172.21.15.90:0/4236058589 <== mon.0 v2:172.21.15.90:3300/0 8 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f8cb801ac00 con 0x7f8cc80c1b50 2024-09-21T03:14:09.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.827+0000 7f087d600640 1 -- 172.21.15.90:0/267234544 <== mon.0 v2:172.21.15.90:3300/0 9 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v4)=0 v4) ==== 123+0+0 (secure 0 0 0) 0x7f08740039a0 con 0x7f08800c2aa0 2024-09-21T03:14:09.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.827+0000 7f087d600640 1 -- 172.21.15.90:0/267234544 <== mon.0 v2:172.21.15.90:3300/0 10 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f0874003d10 con 0x7f08800c2aa0 2024-09-21T03:14:09.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.832+0000 7f4cf8c00640 1 -- 172.21.15.90:0/23830599 <== mon.1 v2:172.21.15.149:3300/0 8 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f4cfc097510 con 0x7f4cf416f1f0 2024-09-21T03:14:09.849 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-21T03:14:09.849 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-21T03:14:09.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.833+0000 7f9fc8c00640 1 -- 172.21.15.90:0/1726151082 <== mon.0 v2:172.21.15.90:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f9fbc003b60 con 0x7f9fcc14fef0 2024-09-21T03:14:09.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.841+0000 7f9fc8c00640 1 -- 172.21.15.90:0/1726151082 <== mon.0 v2:172.21.15.90:3300/0 10 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7f9fbc0116c0 con 0x7f9fcc14fef0 2024-09-21T03:14:09.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.838+0000 7f0872a00640 1 -- 172.21.15.90:0/267234544 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08800c2aa0 msgr2=0x7f0880158940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:09.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.839+0000 7f0872a00640 1 --2- 172.21.15.90:0/267234544 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08800c2aa0 0x7f0880158940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0874031000 tx=0x7f08740046c0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.840+0000 7f0872a00640 1 -- 172.21.15.90:0/267234544 shutdown_connections 2024-09-21T03:14:09.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.840+0000 7f0872a00640 1 --2- 172.21.15.90:0/267234544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08801575b0 0x7f0880150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.840+0000 7f0872a00640 1 --2- 172.21.15.90:0/267234544 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08800c2aa0 0x7f0880158940 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.840+0000 7f0872a00640 1 --2- 172.21.15.90:0/267234544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08800741c0 0x7f088014ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.840+0000 7f0872a00640 1 -- 172.21.15.90:0/267234544 >> 172.21.15.90:0/267234544 conn(0x7f08800c80a0 msgr2=0x7f08800c14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:09.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.840+0000 7f0872a00640 1 -- 172.21.15.90:0/267234544 shutdown_connections 2024-09-21T03:14:09.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.840+0000 7f0872a00640 1 -- 172.21.15.90:0/267234544 wait complete. 2024-09-21T03:14:09.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.846+0000 7f8cbfe00640 1 -- 172.21.15.90:0/4236058589 <== mon.0 v2:172.21.15.90:3300/0 9 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f8cb801ac00 con 0x7f8cc80c1b50 2024-09-21T03:14:09.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.844+0000 7f4cf8c00640 1 -- 172.21.15.90:0/23830599 <== mon.1 v2:172.21.15.149:3300/0 9 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f4cfc0977b0 con 0x7f4cf416f1f0 2024-09-21T03:14:09.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.848+0000 7f9fc8c00640 1 -- 172.21.15.90:0/1726151082 <== mon.0 v2:172.21.15.90:3300/0 11 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f9fbc0119f0 con 0x7f9fcc14fef0 2024-09-21T03:14:09.870 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-21T03:14:09.870 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-21T03:14:09.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.853+0000 7f9fd2400640 1 -- 172.21.15.90:0/1726151082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fcc14fef0 msgr2=0x7f9fcc1ee280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:09.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.853+0000 7f9fd2400640 1 --2- 172.21.15.90:0/1726151082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fcc14fef0 0x7f9fcc1ee280 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc06eb50 tx=0x7f9fbc00edf0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.853+0000 7fb902000640 1 -- 172.21.15.90:0/3458278747 <== mon.0 v2:172.21.15.90:3300/0 9 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fb904033ca0 con 0x7fb90c14b720 2024-09-21T03:14:09.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.855+0000 7f9fd2400640 1 -- 172.21.15.90:0/1726151082 shutdown_connections 2024-09-21T03:14:09.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.855+0000 7f9fd2400640 1 --2- 172.21.15.90:0/1726151082 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fcc153710 0x7f9fcc147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.855+0000 7f9fd2400640 1 --2- 172.21.15.90:0/1726151082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fcc14fef0 0x7f9fcc1ee280 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.855+0000 7f9fd2400640 1 --2- 172.21.15.90:0/1726151082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc0adf60 0x7f9fcc14c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.855+0000 7f9fd2400640 1 -- 172.21.15.90:0/1726151082 >> 172.21.15.90:0/1726151082 conn(0x7f9fcc0c8490 msgr2=0x7f9fcc0c3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:09.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.856+0000 7f9fd2400640 1 -- 172.21.15.90:0/1726151082 shutdown_connections 2024-09-21T03:14:09.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.856+0000 7f9fd2400640 1 -- 172.21.15.90:0/1726151082 wait complete. 2024-09-21T03:14:09.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.868+0000 7f5cc3800640 1 -- 172.21.15.90:0/2339096035 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cb40d6d90 msgr2=0x7f5cb40498d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:09.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.869+0000 7f5cc3800640 1 --2- 172.21.15.90:0/2339096035 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cb40d6d90 0x7f5cb40498d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8009830 tx=0x7f5ca802a3f0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.873+0000 7f5cc3800640 1 -- 172.21.15.90:0/2339096035 shutdown_connections 2024-09-21T03:14:09.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.873+0000 7f5cc3800640 1 --2- 172.21.15.90:0/2339096035 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cb40d6d90 0x7f5cb40498d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.889 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-21T03:14:09.890 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-21T03:14:09.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.873+0000 7f5cc3800640 1 --2- 172.21.15.90:0/2339096035 >> v2:172.21.15.149:3300/0 conn(0x7f5cb4030d20 0x7f5cb4046b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.877+0000 7f5cc3800640 1 -- 172.21.15.90:0/2339096035 >> 172.21.15.90:0/2339096035 conn(0x7f5cb4048460 msgr2=0x7f5cb4048870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:09.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.877+0000 7f5cc3800640 1 -- 172.21.15.90:0/2339096035 shutdown_connections 2024-09-21T03:14:09.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.877+0000 7f5cc3800640 1 -- 172.21.15.90:0/2339096035 wait complete. 2024-09-21T03:14:09.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.897+0000 7fb8f7400640 1 -- 172.21.15.90:0/3458278747 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fb8e0005310 con 0x7fb90c14b720 2024-09-21T03:14:09.906 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-21T03:14:09.906 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-21T03:14:09.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.898+0000 7f5cc3800640 1 Processor -- start 2024-09-21T03:14:09.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.898+0000 7f5cc3800640 1 -- start start 2024-09-21T03:14:09.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.908+0000 7f5cc3800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cb4030d20 0x7f5cb402ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:09.923 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T03:14:09.924 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T03:14:09.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.920+0000 7f4cf8c00640 1 -- 172.21.15.90:0/23830599 <== mon.1 v2:172.21.15.149:3300/0 10 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cfc0a25d0 con 0x7f4cf416f1f0 2024-09-21T03:14:09.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.908+0000 7f5cc3800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cb4049e10 0x7f5cb40d8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:09.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.908+0000 7f5cc3800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cb40d6d90 0x7f5cb40412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:09.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.909+0000 7f5cc3800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb4046350 con 0x7f5cb40d6d90 2024-09-21T03:14:09.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.909+0000 7f5cc3800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb40466c0 con 0x7f5cb4049e10 2024-09-21T03:14:09.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.909+0000 7f5cc3800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5cb4047ce0 con 0x7f5cb4030d20 2024-09-21T03:14:09.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.909+0000 7f5cc2200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cb40d6d90 0x7f5cb40412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:09.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.910+0000 7f5cc2200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cb40d6d90 0x7f5cb40412e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52884/0 (socket says 172.21.15.90:52884) 2024-09-21T03:14:09.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.910+0000 7f5cc2200640 1 -- 172.21.15.90:0/1166457735 learned_addr learned my addr 172.21.15.90:0/1166457735 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:09.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.916+0000 7f5cbbe00640 1 --2- 172.21.15.90:0/1166457735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cb4049e10 0x7f5cb40d8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:09.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.916+0000 7f5cc0e00640 1 --2- 172.21.15.90:0/1166457735 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cb4030d20 0x7f5cb402ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:09.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.918+0000 7f5cc2200640 1 -- 172.21.15.90:0/1166457735 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cb4030d20 msgr2=0x7f5cb402ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:09.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.918+0000 7f5cc2200640 1 --2- 172.21.15.90:0/1166457735 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cb4030d20 0x7f5cb402ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.918+0000 7f5cc2200640 1 -- 172.21.15.90:0/1166457735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cb4049e10 msgr2=0x7f5cb40d8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:09.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.918+0000 7f5cc2200640 1 --2- 172.21.15.90:0/1166457735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cb4049e10 0x7f5cb40d8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.918+0000 7f5cc2200640 1 -- 172.21.15.90:0/1166457735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb402cf60 con 0x7f5cb40d6d90 2024-09-21T03:14:09.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.919+0000 7f5cc2200640 1 --2- 172.21.15.90:0/1166457735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cb40d6d90 0x7f5cb40412e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc0666e0 tx=0x7f5cbc06a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:09.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.924+0000 7fb902000640 1 -- 172.21.15.90:0/3458278747 <== mon.0 v2:172.21.15.90:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fb90404d030 con 0x7fb90c14b720 2024-09-21T03:14:09.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.924+0000 7fb902000640 1 -- 172.21.15.90:0/3458278747 <== mon.0 v2:172.21.15.90:3300/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb904033ca0 con 0x7fb90c14b720 2024-09-21T03:14:09.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.926+0000 7f8cbfe00640 1 -- 172.21.15.90:0/4236058589 <== mon.0 v2:172.21.15.90:3300/0 10 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cb801ac00 con 0x7f8cc80c1b50 2024-09-21T03:14:09.949 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-21T03:14:09.949 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-21T03:14:09.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.937+0000 7f5cb8c00640 1 -- 172.21.15.90:0/1166457735 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc076920 con 0x7f5cb40d6d90 2024-09-21T03:14:09.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.938+0000 7f5cc3800640 1 -- 172.21.15.90:0/1166457735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cb416f220 con 0x7f5cb40d6d90 2024-09-21T03:14:09.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.938+0000 7f5cb8c00640 1 -- 172.21.15.90:0/1166457735 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5cbc076bb0 con 0x7f5cb40d6d90 2024-09-21T03:14:09.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.938+0000 7f5cb8c00640 1 -- 172.21.15.90:0/1166457735 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc076920 con 0x7f5cb40d6d90 2024-09-21T03:14:09.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.940+0000 7f5cc3800640 1 -- 172.21.15.90:0/1166457735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cb402b270 con 0x7f5cb40d6d90 2024-09-21T03:14:09.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.942+0000 7f5cc3800640 1 -- 172.21.15.90:0/1166457735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cb40d71a0 con 0x7f5cb40d6d90 2024-09-21T03:14:09.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.954+0000 7fb8f7400640 1 -- 172.21.15.90:0/3458278747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb90c14b720 msgr2=0x7fb90c1f1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:09.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.954+0000 7fb8f7400640 1 --2- 172.21.15.90:0/3458278747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb90c14b720 0x7fb90c1f1630 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb90400a3c0 tx=0x7fb904001e90 comp rx=0 tx=0).stop 2024-09-21T03:14:09.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.954+0000 7fb8f7400640 1 -- 172.21.15.90:0/3458278747 shutdown_connections 2024-09-21T03:14:09.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.954+0000 7fb8f7400640 1 --2- 172.21.15.90:0/3458278747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb90c14b720 0x7fb90c1f1630 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.954+0000 7fb8f7400640 1 --2- 172.21.15.90:0/3458278747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb90c074980 0x7fb90c0c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.954+0000 7fb8f7400640 1 --2- 172.21.15.90:0/3458278747 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb90c074570 0x7fb90c144cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.954+0000 7fb8f7400640 1 -- 172.21.15.90:0/3458278747 >> 172.21.15.90:0/3458278747 conn(0x7fb90c06eec0 msgr2=0x7fb90c154530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:09.969 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-21T03:14:09.969 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-21T03:14:09.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.965+0000 7fb8f7400640 1 -- 172.21.15.90:0/3458278747 shutdown_connections 2024-09-21T03:14:09.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.965+0000 7fb8f7400640 1 -- 172.21.15.90:0/3458278747 wait complete. 2024-09-21T03:14:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.966+0000 7f5cb8c00640 1 -- 172.21.15.90:0/1166457735 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5cbc076d60 con 0x7f5cb40d6d90 2024-09-21T03:14:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.966+0000 7f5cb8c00640 1 -- 172.21.15.90:0/1166457735 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5cbc09d3f0 con 0x7f5cb40d6d90 2024-09-21T03:14:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.966+0000 7f5cb8c00640 1 -- 172.21.15.90:0/1166457735 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5cbc090030 con 0x7f5cb40d6d90 2024-09-21T03:14:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.959+0000 7f4076c00640 1 -- 172.21.15.90:0/2956293240 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40700adf60 msgr2=0x7f40700c2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.959+0000 7f4076c00640 1 --2- 172.21.15.90:0/2956293240 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40700adf60 0x7f40700c2e30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4070072960 tx=0x7f405c02b7a0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.973+0000 7f4076c00640 1 -- 172.21.15.90:0/2956293240 shutdown_connections 2024-09-21T03:14:09.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.973+0000 7f4076c00640 1 --2- 172.21.15.90:0/2956293240 >> v2:172.21.15.149:3300/0 conn(0x7f407006f2e0 0x7f407006f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.973+0000 7f4076c00640 1 --2- 172.21.15.90:0/2956293240 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40700adf60 0x7f40700c2e30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:09.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.973+0000 7f4076c00640 1 -- 172.21.15.90:0/2956293240 >> 172.21.15.90:0/2956293240 conn(0x7f40700c8490 msgr2=0x7f40700c88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:09.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.973+0000 7f4076c00640 1 -- 172.21.15.90:0/2956293240 shutdown_connections 2024-09-21T03:14:09.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.973+0000 7f4076c00640 1 -- 172.21.15.90:0/2956293240 wait complete. 2024-09-21T03:14:09.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.984+0000 7f4076c00640 1 Processor -- start 2024-09-21T03:14:10.001 DEBUG:tasks.ceph:set 26 configs 2024-09-21T03:14:10.001 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi090') 2024-09-21T03:14:10.001 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi090') 2024-09-21T03:14:10.001 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi090') 2024-09-21T03:14:10.001 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi090') 2024-09-21T03:14:10.001 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi090') 2024-09-21T03:14:10.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.991+0000 7f4076c00640 1 -- start start 2024-09-21T03:14:10.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.993+0000 7f4076c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f407006f2e0 0x7f4070156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.993+0000 7f4076c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f40700adf60 0x7f407014cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:09.993+0000 7f4076c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f407014fef0 0x7f40700c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.002+0000 7f4075800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f407006f2e0 0x7f4070156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.002+0000 7f4075800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f407006f2e0 0x7f4070156130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52906/0 (socket says 172.21.15.90:52906) 2024-09-21T03:14:10.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.002+0000 7f4075800640 1 -- 172.21.15.90:0/98644287 learned_addr learned my addr 172.21.15.90:0/98644287 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:10.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.003+0000 7f4076c00640 1 -- 172.21.15.90:0/98644287 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4070150300 con 0x7f407006f2e0 2024-09-21T03:14:10.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.003+0000 7f4076c00640 1 -- 172.21.15.90:0/98644287 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f40701538e0 con 0x7f407014fef0 2024-09-21T03:14:10.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.003+0000 7f4076c00640 1 -- 172.21.15.90:0/98644287 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f40700707b0 con 0x7f40700adf60 2024-09-21T03:14:10.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.011+0000 7f4076200640 1 --2- 172.21.15.90:0/98644287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f407014fef0 0x7f40700c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.012+0000 7f4075800640 1 -- 172.21.15.90:0/98644287 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f40700adf60 msgr2=0x7f407014cc60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:14:10.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.012+0000 7f4075800640 1 --2- 172.21.15.90:0/98644287 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f40700adf60 0x7f407014cc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.012+0000 7f4075800640 1 -- 172.21.15.90:0/98644287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f407014fef0 msgr2=0x7f40700c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.012+0000 7f4075800640 1 --2- 172.21.15.90:0/98644287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f407014fef0 0x7f40700c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.012+0000 7f4075800640 1 -- 172.21.15.90:0/98644287 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40701f20f0 con 0x7f407006f2e0 2024-09-21T03:14:10.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.019+0000 7f4075800640 1 --2- 172.21.15.90:0/98644287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f407006f2e0 0x7f4070156130 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f405c009430 tx=0x7f405c032650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:10.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.027+0000 7f406d600640 1 -- 172.21.15.90:0/98644287 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c041030 con 0x7f407006f2e0 2024-09-21T03:14:10.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.027+0000 7f406d600640 1 -- 172.21.15.90:0/98644287 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f405c032840 con 0x7f407006f2e0 2024-09-21T03:14:10.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.027+0000 7f406d600640 1 -- 172.21.15.90:0/98644287 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c032a90 con 0x7f407006f2e0 2024-09-21T03:14:10.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.027+0000 7f4076c00640 1 -- 172.21.15.90:0/98644287 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40701f23d0 con 0x7f407006f2e0 2024-09-21T03:14:10.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.027+0000 7f4076c00640 1 -- 172.21.15.90:0/98644287 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40701dde10 con 0x7f407006f2e0 2024-09-21T03:14:10.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.036+0000 7f406d600640 1 -- 172.21.15.90:0/98644287 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f405c044070 con 0x7f407006f2e0 2024-09-21T03:14:10.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.036+0000 7f406d600640 1 -- 172.21.15.90:0/98644287 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f405c0055f0 con 0x7f407006f2e0 2024-09-21T03:14:10.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.053+0000 7f4076c00640 1 -- 172.21.15.90:0/98644287 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4070153de0 con 0x7f407006f2e0 2024-09-21T03:14:10.068 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi090') 2024-09-21T03:14:10.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.076+0000 7f406d600640 1 -- 172.21.15.90:0/98644287 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4070153de0 con 0x7f407006f2e0 2024-09-21T03:14:10.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.137+0000 7f6ce7800640 1 -- 172.21.15.90:0/3950261301 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ce00c8600 msgr2=0x7f6ce00c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.137+0000 7f6ce7800640 1 --2- 172.21.15.90:0/3950261301 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ce00c8600 0x7f6ce00c8a10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8009f60 tx=0x7f6cd802a860 comp rx=0 tx=0).stop 2024-09-21T03:14:10.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.137+0000 7f6ce7800640 1 -- 172.21.15.90:0/3950261301 shutdown_connections 2024-09-21T03:14:10.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.137+0000 7f6ce7800640 1 --2- 172.21.15.90:0/3950261301 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ce00c8600 0x7f6ce00c8a10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.137+0000 7f6ce7800640 1 --2- 172.21.15.90:0/3950261301 >> v2:172.21.15.90:3300/0 conn(0x7f6ce014cc00 0x7f6ce01561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.138+0000 7f6ce7800640 1 -- 172.21.15.90:0/3950261301 >> 172.21.15.90:0/3950261301 conn(0x7f6ce006ead0 msgr2=0x7f6ce006eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.138+0000 7f6ce7800640 1 -- 172.21.15.90:0/3950261301 shutdown_connections 2024-09-21T03:14:10.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.138+0000 7f6ce7800640 1 -- 172.21.15.90:0/3950261301 wait complete. 2024-09-21T03:14:10.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.146+0000 7f6ce7800640 1 Processor -- start 2024-09-21T03:14:10.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.146+0000 7f6ce7800640 1 -- start start 2024-09-21T03:14:10.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.153+0000 7f6ce7800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ce00ad370 0x7f6ce014e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.153+0000 7f6ce7800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ce00c8600 0x7f6ce01fca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.154+0000 7f6ce4e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ce00ad370 0x7f6ce014e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.154+0000 7f6ce4e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ce00ad370 0x7f6ce014e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:41372/0 (socket says 172.21.15.90:41372) 2024-09-21T03:14:10.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.154+0000 7f6cdfe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ce00c8600 0x7f6ce01fca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.154+0000 7f6cdfe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ce00c8600 0x7f6ce01fca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:45022/0 (socket says 172.21.15.90:45022) 2024-09-21T03:14:10.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.154+0000 7f6ce7800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ce014cc00 0x7f6ce01f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.155+0000 7f6ce7800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce00ab750 con 0x7f6ce014cc00 2024-09-21T03:14:10.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.155+0000 7f6ce7800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce00ab470 con 0x7f6ce00c8600 2024-09-21T03:14:10.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.155+0000 7f6ce7800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6ce014d010 con 0x7f6ce00ad370 2024-09-21T03:14:10.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.156+0000 7f6ce4e00640 1 -- 172.21.15.90:0/3785146736 learned_addr learned my addr 172.21.15.90:0/3785146736 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:10.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.160+0000 7f6ce6200640 1 --2- 172.21.15.90:0/3785146736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ce014cc00 0x7f6ce01f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.161+0000 7f6ce4e00640 1 -- 172.21.15.90:0/3785146736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ce00c8600 msgr2=0x7f6ce01fca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.161+0000 7f6ce4e00640 1 --2- 172.21.15.90:0/3785146736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ce00c8600 0x7f6ce01fca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.161+0000 7f6ce4e00640 1 -- 172.21.15.90:0/3785146736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ce014cc00 msgr2=0x7f6ce01f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.161+0000 7f6ce4e00640 1 --2- 172.21.15.90:0/3785146736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ce014cc00 0x7f6ce01f6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.161+0000 7f6ce4e00640 1 -- 172.21.15.90:0/3785146736 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce014ed20 con 0x7f6ce00ad370 2024-09-21T03:14:10.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.162+0000 7f6ce4e00640 1 --2- 172.21.15.90:0/3785146736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ce00ad370 0x7f6ce014e7e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6cd400c730 tx=0x7f6cd400cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:10.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.162+0000 7f6cdcc00640 1 -- 172.21.15.90:0/3785146736 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4016020 con 0x7f6ce00ad370 2024-09-21T03:14:10.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.166+0000 7f6cdcc00640 1 -- 172.21.15.90:0/3785146736 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cd400a950 con 0x7f6ce00ad370 2024-09-21T03:14:10.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.166+0000 7f6ce7800640 1 -- 172.21.15.90:0/3785146736 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ce014d320 con 0x7f6ce00ad370 2024-09-21T03:14:10.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.167+0000 7f6cdcc00640 1 -- 172.21.15.90:0/3785146736 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd400ada0 con 0x7f6ce00ad370 2024-09-21T03:14:10.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.168+0000 7f6ce7800640 1 -- 172.21.15.90:0/3785146736 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ce0156190 con 0x7f6ce00ad370 2024-09-21T03:14:10.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.168+0000 7f6cdcc00640 1 -- 172.21.15.90:0/3785146736 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6cd4019020 con 0x7f6ce00ad370 2024-09-21T03:14:10.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.169+0000 7f8ccec00640 1 -- 172.21.15.90:0/4236058589 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f8c9c0052f0 con 0x7f8cc80c1b50 2024-09-21T03:14:10.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.175+0000 7f6cdcc00640 1 -- 172.21.15.90:0/3785146736 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6cd4012420 con 0x7f6ce00ad370 2024-09-21T03:14:10.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.183+0000 7f6cd2000640 1 -- 172.21.15.90:0/3785146736 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ce014d520 con 0x7f6ce00ad370 2024-09-21T03:14:10.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.191+0000 7f8cbfe00640 1 -- 172.21.15.90:0/4236058589 <== mon.0 v2:172.21.15.90:3300/0 11 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7f8cb8010960 con 0x7f8cc80c1b50 2024-09-21T03:14:10.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.207+0000 7f6cdcc00640 1 -- 172.21.15.90:0/3785146736 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6ce014d520 con 0x7f6ce00ad370 2024-09-21T03:14:10.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.216+0000 7f8ccec00640 1 -- 172.21.15.90:0/4236058589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cc80c1b50 msgr2=0x7f8cc813d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.216+0000 7f8ccec00640 1 --2- 172.21.15.90:0/4236058589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cc80c1b50 0x7f8cc813d5c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8001340 tx=0x7f8cb8001800 comp rx=0 tx=0).stop 2024-09-21T03:14:10.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.216+0000 7f8ccec00640 1 -- 172.21.15.90:0/4236058589 shutdown_connections 2024-09-21T03:14:10.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.216+0000 7f8ccec00640 1 --2- 172.21.15.90:0/4236058589 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8cc815aa90 0x7f8cc813ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.216+0000 7f8ccec00640 1 --2- 172.21.15.90:0/4236058589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cc80c4460 0x7f8cc80ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.216+0000 7f8ccec00640 1 --2- 172.21.15.90:0/4236058589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cc80c1b50 0x7f8cc813d5c0 secure :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8001340 tx=0x7f8cb8001800 comp rx=0 tx=0).stop 2024-09-21T03:14:10.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.216+0000 7f8ccec00640 1 -- 172.21.15.90:0/4236058589 >> 172.21.15.90:0/4236058589 conn(0x7f8cc80c81b0 msgr2=0x7f8cc813f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.220+0000 7f8ccec00640 1 -- 172.21.15.90:0/4236058589 shutdown_connections 2024-09-21T03:14:10.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.220+0000 7f8ccec00640 1 -- 172.21.15.90:0/4236058589 wait complete. 2024-09-21T03:14:10.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.221+0000 7f4cee000640 1 -- 172.21.15.90:0/23830599 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f4cd0004360 con 0x7f4cf416f1f0 2024-09-21T03:14:10.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.245+0000 7f4cf8c00640 1 -- 172.21.15.90:0/23830599 <== mon.1 v2:172.21.15.149:3300/0 11 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f4cf416c060 con 0x7f4cf416f1f0 2024-09-21T03:14:10.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.259+0000 7f4cee000640 1 -- 172.21.15.90:0/23830599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cf416f1f0 msgr2=0x7f4cf40cc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.259+0000 7f4cee000640 1 --2- 172.21.15.90:0/23830599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cf416f1f0 0x7f4cf40cc460 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc066830 tx=0x7f4cfc075560 comp rx=0 tx=0).stop 2024-09-21T03:14:10.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.260+0000 7f4cee000640 1 -- 172.21.15.90:0/23830599 shutdown_connections 2024-09-21T03:14:10.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.260+0000 7f4cee000640 1 --2- 172.21.15.90:0/23830599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cf416f1f0 0x7f4cf40cc460 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.260+0000 7f4cee000640 1 --2- 172.21.15.90:0/23830599 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4cf40d3620 0x7f4cf416ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.260+0000 7f4cee000640 1 --2- 172.21.15.90:0/23830599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ce4003a50 0x7f4cf402bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.260+0000 7f4cee000640 1 -- 172.21.15.90:0/23830599 >> 172.21.15.90:0/23830599 conn(0x7f4cf4048480 msgr2=0x7f4cf40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.265+0000 7f4cee000640 1 -- 172.21.15.90:0/23830599 shutdown_connections 2024-09-21T03:14:10.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.268+0000 7f4cee000640 1 -- 172.21.15.90:0/23830599 wait complete. 2024-09-21T03:14:10.354 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi090') 2024-09-21T03:14:10.354 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi090') 2024-09-21T03:14:10.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.399+0000 7fbd16800640 1 -- 172.21.15.90:0/2628072488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd080499d0 msgr2=0x7fbd08049de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.399+0000 7fbd16800640 1 --2- 172.21.15.90:0/2628072488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd080499d0 0x7fbd08049de0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbd1006ca30 tx=0x7fbd100a7650 comp rx=0 tx=0).stop 2024-09-21T03:14:10.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.399+0000 7fbd16800640 1 -- 172.21.15.90:0/2628072488 shutdown_connections 2024-09-21T03:14:10.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.399+0000 7fbd16800640 1 --2- 172.21.15.90:0/2628072488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd080499d0 0x7fbd08049de0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.399+0000 7fbd16800640 1 -- 172.21.15.90:0/2628072488 >> 172.21.15.90:0/2628072488 conn(0x7fbd08048480 msgr2=0x7fbd0802cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.403+0000 7fbd16800640 1 -- 172.21.15.90:0/2628072488 shutdown_connections 2024-09-21T03:14:10.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.403+0000 7fbd16800640 1 -- 172.21.15.90:0/2628072488 wait complete. 2024-09-21T03:14:10.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.411+0000 7f5cc3800640 1 -- 172.21.15.90:0/1166457735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f5cb4008be0 con 0x7f5cb40d6d90 2024-09-21T03:14:10.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.427+0000 7fbd16800640 1 Processor -- start 2024-09-21T03:14:10.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.427+0000 7fbd16800640 1 -- start start 2024-09-21T03:14:10.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.430+0000 7f5cb8c00640 1 -- 172.21.15.90:0/1166457735 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7f5cbc094400 con 0x7f5cb40d6d90 2024-09-21T03:14:10.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.431+0000 7f5cc3800640 1 -- 172.21.15.90:0/1166457735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cb40d6d90 msgr2=0x7f5cb40412e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.431+0000 7f5cc3800640 1 --2- 172.21.15.90:0/1166457735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cb40d6d90 0x7f5cb40412e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc0666e0 tx=0x7f5cbc06a1d0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.432+0000 7f5cc3800640 1 -- 172.21.15.90:0/1166457735 shutdown_connections 2024-09-21T03:14:10.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.432+0000 7f5cc3800640 1 --2- 172.21.15.90:0/1166457735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cb40d6d90 0x7f5cb40412e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.432+0000 7f5cc3800640 1 --2- 172.21.15.90:0/1166457735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cb4049e10 0x7f5cb40d8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.432+0000 7f5cc3800640 1 --2- 172.21.15.90:0/1166457735 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cb4030d20 0x7f5cb402ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.432+0000 7f5cc3800640 1 -- 172.21.15.90:0/1166457735 >> 172.21.15.90:0/1166457735 conn(0x7f5cb4048460 msgr2=0x7f5cb4004bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.429+0000 7fbd16800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd08030cd0 0x7fbd080cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.436+0000 7fbd16800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd080476d0 0x7fbd0803e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.432+0000 7f5cc3800640 1 -- 172.21.15.90:0/1166457735 shutdown_connections 2024-09-21T03:14:10.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.434+0000 7f5cc3800640 1 -- 172.21.15.90:0/1166457735 wait complete. 2024-09-21T03:14:10.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.439+0000 7f4076c00640 1 -- 172.21.15.90:0/98644287 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f407014d760 con 0x7f407006f2e0 2024-09-21T03:14:10.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.436+0000 7fbd15400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd08030cd0 0x7fbd080cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.444+0000 7fbd15400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd08030cd0 0x7fbd080cc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:41378/0 (socket says 172.21.15.90:41378) 2024-09-21T03:14:10.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.444+0000 7fbd15400640 1 -- 172.21.15.90:0/3726923620 learned_addr learned my addr 172.21.15.90:0/3726923620 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:10.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.444+0000 7fbd14a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd080476d0 0x7fbd0803e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.444+0000 7fbd16800640 1 --2- 172.21.15.90:0/3726923620 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd080499d0 0x7fbd08044190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.444+0000 7fbd16800640 1 -- 172.21.15.90:0/3726923620 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbd080d6f60 con 0x7fbd080499d0 2024-09-21T03:14:10.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.444+0000 7fbd16800640 1 -- 172.21.15.90:0/3726923620 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbd080da110 con 0x7fbd080476d0 2024-09-21T03:14:10.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.445+0000 7fbd16800640 1 -- 172.21.15.90:0/3726923620 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbd080d70e0 con 0x7fbd08030cd0 2024-09-21T03:14:10.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.446+0000 7fbd14a00640 1 -- 172.21.15.90:0/3726923620 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd08030cd0 msgr2=0x7fbd080cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.446+0000 7fbd14a00640 1 --2- 172.21.15.90:0/3726923620 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd08030cd0 0x7fbd080cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.446+0000 7fbd14a00640 1 -- 172.21.15.90:0/3726923620 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd080499d0 msgr2=0x7fbd08044190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.446+0000 7fbd14a00640 1 --2- 172.21.15.90:0/3726923620 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd080499d0 0x7fbd08044190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.446+0000 7fbd14a00640 1 -- 172.21.15.90:0/3726923620 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd0816d2d0 con 0x7fbd080476d0 2024-09-21T03:14:10.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.447+0000 7fbd15400640 1 --2- 172.21.15.90:0/3726923620 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd08030cd0 0x7fbd080cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:14:10.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.447+0000 7f406d600640 1 -- 172.21.15.90:0/98644287 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v10)=0 v10) ==== 127+0+0 (secure 0 0 0) 0x7f407014d760 con 0x7f407006f2e0 2024-09-21T03:14:10.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.447+0000 7fbd14a00640 1 --2- 172.21.15.90:0/3726923620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd080476d0 0x7fbd0803e850 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc00c310 tx=0x7fbcfc00c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:10.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.455+0000 7fbd0d600640 1 -- 172.21.15.90:0/3726923620 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc017070 con 0x7fbd080476d0 2024-09-21T03:14:10.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.456+0000 7fbd0d600640 1 -- 172.21.15.90:0/3726923620 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcfc0053c0 con 0x7fbd080476d0 2024-09-21T03:14:10.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.456+0000 7fbd0d600640 1 -- 172.21.15.90:0/3726923620 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc003850 con 0x7fbd080476d0 2024-09-21T03:14:10.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.464+0000 7f4062a00640 1 -- 172.21.15.90:0/98644287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f407006f2e0 msgr2=0x7f4070156130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.464+0000 7f4062a00640 1 --2- 172.21.15.90:0/98644287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f407006f2e0 0x7f4070156130 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f405c009430 tx=0x7f405c032650 comp rx=0 tx=0).stop 2024-09-21T03:14:10.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.464+0000 7f4062a00640 1 -- 172.21.15.90:0/98644287 shutdown_connections 2024-09-21T03:14:10.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.464+0000 7f4062a00640 1 --2- 172.21.15.90:0/98644287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f407014fef0 0x7f40700c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.464+0000 7f4062a00640 1 --2- 172.21.15.90:0/98644287 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f40700adf60 0x7f407014cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.464+0000 7f4062a00640 1 --2- 172.21.15.90:0/98644287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f407006f2e0 0x7f4070156130 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.464+0000 7f4062a00640 1 -- 172.21.15.90:0/98644287 >> 172.21.15.90:0/98644287 conn(0x7f40700c8490 msgr2=0x7f40700763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.465+0000 7f4062a00640 1 -- 172.21.15.90:0/98644287 shutdown_connections 2024-09-21T03:14:10.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.465+0000 7f4062a00640 1 -- 172.21.15.90:0/98644287 wait complete. 2024-09-21T03:14:10.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.472+0000 7fbd16800640 1 -- 172.21.15.90:0/3726923620 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd081622d0 con 0x7fbd080476d0 2024-09-21T03:14:10.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.472+0000 7fbd16800640 1 -- 172.21.15.90:0/3726923620 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd08045110 con 0x7fbd080476d0 2024-09-21T03:14:10.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.473+0000 7fbd0d600640 1 -- 172.21.15.90:0/3726923620 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbcfc01a070 con 0x7fbd080476d0 2024-09-21T03:14:10.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.473+0000 7fbd0d600640 1 -- 172.21.15.90:0/3726923620 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbcfc01c780 con 0x7fbd080476d0 2024-09-21T03:14:10.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.492+0000 7fbd02a00640 1 -- 172.21.15.90:0/3726923620 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce4005290 con 0x7fbd080476d0 2024-09-21T03:14:10.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.524+0000 7fbd0d600640 1 -- 172.21.15.90:0/3726923620 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fbcfc021080 con 0x7fbd080476d0 2024-09-21T03:14:10.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.558+0000 7f4acfe00640 1 -- 172.21.15.90:0/150356593 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ad0072970 msgr2=0x7f4ad01541d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.559+0000 7f4acfe00640 1 --2- 172.21.15.90:0/150356593 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ad0072970 0x7f4ad01541d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00c5bf0 tx=0x7f4abc02a510 comp rx=0 tx=0).stop 2024-09-21T03:14:10.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.559+0000 7f4acfe00640 1 -- 172.21.15.90:0/150356593 shutdown_connections 2024-09-21T03:14:10.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.559+0000 7f4acfe00640 1 --2- 172.21.15.90:0/150356593 >> v2:172.21.15.90:3300/0 conn(0x7f4ad006e810 0x7f4ad0150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.559+0000 7f4acfe00640 1 --2- 172.21.15.90:0/150356593 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ad0151060 0x7f4ad00c3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.559+0000 7f4acfe00640 1 --2- 172.21.15.90:0/150356593 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ad0072970 0x7f4ad01541d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.559+0000 7f4acfe00640 1 -- 172.21.15.90:0/150356593 >> 172.21.15.90:0/150356593 conn(0x7f4ad00c80a0 msgr2=0x7f4ad00c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.567 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi090') 2024-09-21T03:14:10.575 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi090') 2024-09-21T03:14:10.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.587+0000 7f4acfe00640 1 -- 172.21.15.90:0/150356593 shutdown_connections 2024-09-21T03:14:10.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.587+0000 7f4acfe00640 1 -- 172.21.15.90:0/150356593 wait complete. 2024-09-21T03:14:10.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.594+0000 7f4acfe00640 1 Processor -- start 2024-09-21T03:14:10.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.594+0000 7f4acfe00640 1 -- start start 2024-09-21T03:14:10.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.605+0000 7f4acfe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ad0072970 0x7f4ad00bee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.605+0000 7f4acfe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ad0151060 0x7f4ad01ed3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.606+0000 7f4acfe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ad00c1590 0x7f4ad0143100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.606+0000 7f4acea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ad0072970 0x7f4ad00bee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.606+0000 7f4acea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ad0072970 0x7f4ad00bee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:41418/0 (socket says 172.21.15.90:41418) 2024-09-21T03:14:10.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.606+0000 7f4ace000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ad0151060 0x7f4ad01ed3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.606+0000 7f4ace000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ad0151060 0x7f4ad01ed3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:45066/0 (socket says 172.21.15.90:45066) 2024-09-21T03:14:10.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.606+0000 7f4ace000640 1 -- 172.21.15.90:0/830435865 learned_addr learned my addr 172.21.15.90:0/830435865 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:10.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.606+0000 7f4acfe00640 1 -- 172.21.15.90:0/830435865 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad006ec20 con 0x7f4ad00c1590 2024-09-21T03:14:10.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.607+0000 7f4acfe00640 1 -- 172.21.15.90:0/830435865 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad00c2c20 con 0x7f4ad0151060 2024-09-21T03:14:10.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.607+0000 7f4acfe00640 1 -- 172.21.15.90:0/830435865 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad006eda0 con 0x7f4ad0072970 2024-09-21T03:14:10.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.607+0000 7f4acf400640 1 --2- 172.21.15.90:0/830435865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ad00c1590 0x7f4ad0143100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.610+0000 7f4acf400640 1 -- 172.21.15.90:0/830435865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ad0072970 msgr2=0x7f4ad00bee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.610+0000 7f4acf400640 1 --2- 172.21.15.90:0/830435865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ad0072970 0x7f4ad00bee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.610+0000 7f4acf400640 1 -- 172.21.15.90:0/830435865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ad0151060 msgr2=0x7f4ad01ed3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.610+0000 7f4acf400640 1 --2- 172.21.15.90:0/830435865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ad0151060 0x7f4ad01ed3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.610+0000 7f4acf400640 1 -- 172.21.15.90:0/830435865 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad014e4b0 con 0x7f4ad00c1590 2024-09-21T03:14:10.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.610+0000 7f6ac5a00640 1 -- 172.21.15.90:0/2400104900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ac00c4570 msgr2=0x7f6aa4003a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.611+0000 7f4ace000640 1 --2- 172.21.15.90:0/830435865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ad0151060 0x7f4ad01ed3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:10.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.611+0000 7f6ac5a00640 1 --2- 172.21.15.90:0/2400104900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ac00c4570 0x7f6aa4003a00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0003fd0 tx=0x7f6aa4005830 comp rx=0 tx=0).stop 2024-09-21T03:14:10.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.611+0000 7f4acea00640 1 --2- 172.21.15.90:0/830435865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ad0072970 0x7f4ad00bee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:10.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.611+0000 7f4acf400640 1 --2- 172.21.15.90:0/830435865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ad00c1590 0x7f4ad0143100 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000b3e0 tx=0x7f4ac000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:10.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.611+0000 7f6ac5000640 1 -- 172.21.15.90:0/2400104900 reap_dead start 2024-09-21T03:14:10.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.612+0000 7f6ac5a00640 1 -- 172.21.15.90:0/2400104900 shutdown_connections 2024-09-21T03:14:10.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.612+0000 7f6ac5a00640 1 -- 172.21.15.90:0/2400104900 >> 172.21.15.90:0/2400104900 conn(0x7f6ac00c8490 msgr2=0x7f6ac00c88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.613+0000 7f6ac5a00640 1 -- 172.21.15.90:0/2400104900 shutdown_connections 2024-09-21T03:14:10.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.613+0000 7f6ac5a00640 1 -- 172.21.15.90:0/2400104900 wait complete. 2024-09-21T03:14:10.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.615+0000 7f4ac6a00640 1 -- 172.21.15.90:0/830435865 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0015020 con 0x7f4ad00c1590 2024-09-21T03:14:10.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.616+0000 7f4ac6a00640 1 -- 172.21.15.90:0/830435865 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ac0011940 con 0x7f4ad00c1590 2024-09-21T03:14:10.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.619+0000 7f4acfe00640 1 -- 172.21.15.90:0/830435865 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad00be620 con 0x7f4ad00c1590 2024-09-21T03:14:10.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.619+0000 7f4acfe00640 1 -- 172.21.15.90:0/830435865 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad00c20a0 con 0x7f4ad00c1590 2024-09-21T03:14:10.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.622+0000 7f5a7ae00640 1 -- 172.21.15.90:0/2375194106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a5c0053b0 msgr2=0x7f5a5c00fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.622+0000 7f5a7ae00640 1 --2- 172.21.15.90:0/2375194106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a5c0053b0 0x7f5a5c00fe50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5a60006fa0 tx=0x7f5a5c005830 comp rx=0 tx=0).stop 2024-09-21T03:14:10.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.622+0000 7f5a79800640 1 -- 172.21.15.90:0/2375194106 reap_dead start 2024-09-21T03:14:10.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.624+0000 7f6ac5a00640 1 Processor -- start 2024-09-21T03:14:10.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.625+0000 7f6ac5a00640 1 -- start start 2024-09-21T03:14:10.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.627+0000 7f4ac6a00640 1 -- 172.21.15.90:0/830435865 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0011d90 con 0x7f4ad00c1590 2024-09-21T03:14:10.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.627+0000 7f4ac6a00640 1 -- 172.21.15.90:0/830435865 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4ac0018020 con 0x7f4ad00c1590 2024-09-21T03:14:10.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.628+0000 7f5a7ae00640 1 -- 172.21.15.90:0/2375194106 shutdown_connections 2024-09-21T03:14:10.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.628+0000 7f5a7ae00640 1 -- 172.21.15.90:0/2375194106 >> 172.21.15.90:0/2375194106 conn(0x7f5a7406ecb0 msgr2=0x7f5a7406f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.628+0000 7f4ac6a00640 1 -- 172.21.15.90:0/830435865 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4ac0019900 con 0x7f4ad00c1590 2024-09-21T03:14:10.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.628+0000 7f6ac5a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ac00c4570 0x7f6ac0156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.629+0000 7f6ac5a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ac01ebc10 0x7f6ac01ec020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.629+0000 7f6ac5a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ac01555d0 0x7f6ac01559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.629+0000 7f6ac5a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac00c35a0 con 0x7f6ac00c4570 2024-09-21T03:14:10.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.629+0000 7f6ac5a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac00c3940 con 0x7f6ac01555d0 2024-09-21T03:14:10.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.629+0000 7f6ac5a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac006f250 con 0x7f6ac01ebc10 2024-09-21T03:14:10.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.630+0000 7f5a7ae00640 1 -- 172.21.15.90:0/2375194106 shutdown_connections 2024-09-21T03:14:10.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.633+0000 7f4acfe00640 1 -- 172.21.15.90:0/830435865 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aa8005290 con 0x7f4ad00c1590 2024-09-21T03:14:10.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.630+0000 7f6ac5000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ac01555d0 0x7f6ac01559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.630+0000 7f6ac5000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ac01555d0 0x7f6ac01559e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:45068/0 (socket says 172.21.15.90:45068) 2024-09-21T03:14:10.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.630+0000 7f6ac5000640 1 -- 172.21.15.90:0/2002095091 learned_addr learned my addr 172.21.15.90:0/2002095091 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:10.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.630+0000 7f6abfe00640 1 --2- 172.21.15.90:0/2002095091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ac00c4570 0x7f6ac0156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.631+0000 7f6abf400640 1 --2- 172.21.15.90:0/2002095091 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ac01ebc10 0x7f6ac01ec020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.632+0000 7f6ac5000640 1 -- 172.21.15.90:0/2002095091 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ac01ebc10 msgr2=0x7f6ac01ec020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.632+0000 7f6ac5000640 1 --2- 172.21.15.90:0/2002095091 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ac01ebc10 0x7f6ac01ec020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.632+0000 7f6ac5000640 1 -- 172.21.15.90:0/2002095091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ac00c4570 msgr2=0x7f6ac0156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.632+0000 7f6ac5000640 1 --2- 172.21.15.90:0/2002095091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ac00c4570 0x7f6ac0156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.633+0000 7f6ac5000640 1 -- 172.21.15.90:0/2002095091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac0153f00 con 0x7f6ac01555d0 2024-09-21T03:14:10.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.630+0000 7f5a7ae00640 1 -- 172.21.15.90:0/2375194106 wait complete. 2024-09-21T03:14:10.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.633+0000 7f6abf400640 1 --2- 172.21.15.90:0/2002095091 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ac01ebc10 0x7f6ac01ec020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:14:10.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.637+0000 7f6abfe00640 1 --2- 172.21.15.90:0/2002095091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ac00c4570 0x7f6ac0156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:14:10.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.638+0000 7f6ac5000640 1 --2- 172.21.15.90:0/2002095091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ac01555d0 0x7f6ac01559e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6ac00c3de0 tx=0x7f6ab8009b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:10.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.639+0000 7f6ab7e00640 1 -- 172.21.15.90:0/2002095091 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8015070 con 0x7f6ac01555d0 2024-09-21T03:14:10.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.639+0000 7f6ab7e00640 1 -- 172.21.15.90:0/2002095091 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ab8010990 con 0x7f6ac01555d0 2024-09-21T03:14:10.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.639+0000 7f6ab7e00640 1 -- 172.21.15.90:0/2002095091 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8015070 con 0x7f6ac01555d0 2024-09-21T03:14:10.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.639+0000 7f6ac5a00640 1 -- 172.21.15.90:0/2002095091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac00c7980 con 0x7f6ac01555d0 2024-09-21T03:14:10.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.641+0000 7f6ac5a00640 1 -- 172.21.15.90:0/2002095091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac0154af0 con 0x7f6ac01555d0 2024-09-21T03:14:10.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.644+0000 7f6ab7e00640 1 -- 172.21.15.90:0/2002095091 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6ab8018070 con 0x7f6ac01555d0 2024-09-21T03:14:10.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.644+0000 7f6ab7e00640 1 -- 172.21.15.90:0/2002095091 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6ab801a7f0 con 0x7f6ac01555d0 2024-09-21T03:14:10.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.646+0000 7f6ac5a00640 1 -- 172.21.15.90:0/2002095091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac0069b80 con 0x7f6ac01555d0 2024-09-21T03:14:10.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.646+0000 7f2254a00640 1 -- 172.21.15.90:0/2670555317 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2244035c30 con 0x7f22500d9850 2024-09-21T03:14:10.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.647+0000 7f225ce00640 1 -- 172.21.15.90:0/2670555317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22500d9850 msgr2=0x7f22500d9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.647+0000 7f225ce00640 1 --2- 172.21.15.90:0/2670555317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22500d9850 0x7f22500d9c60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2244010b10 tx=0x7f224402e690 comp rx=0 tx=0).stop 2024-09-21T03:14:10.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.647+0000 7f225ce00640 1 -- 172.21.15.90:0/2670555317 shutdown_connections 2024-09-21T03:14:10.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.647+0000 7f225ce00640 1 --2- 172.21.15.90:0/2670555317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22500d9850 0x7f22500d9c60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.647+0000 7f225ce00640 1 --2- 172.21.15.90:0/2670555317 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f225000ae90 0x7f225000b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.647+0000 7f225ce00640 1 -- 172.21.15.90:0/2670555317 >> 172.21.15.90:0/2670555317 conn(0x7f2250048490 msgr2=0x7f22500488a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.648+0000 7f225ce00640 1 -- 172.21.15.90:0/2670555317 shutdown_connections 2024-09-21T03:14:10.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.648+0000 7f225ce00640 1 -- 172.21.15.90:0/2670555317 wait complete. 2024-09-21T03:14:10.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.646+0000 7f5a7ae00640 1 Processor -- start 2024-09-21T03:14:10.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.647+0000 7f5a7ae00640 1 -- start start 2024-09-21T03:14:10.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.650+0000 7f6ab7e00640 1 -- 172.21.15.90:0/2002095091 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6ac0069b80 con 0x7f6ac01555d0 2024-09-21T03:14:10.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.655+0000 7f4ac6a00640 1 -- 172.21.15.90:0/830435865 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4ac001f020 con 0x7f4ad00c1590 2024-09-21T03:14:10.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.654+0000 7f5a7ae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a5c0053b0 0x7f5a741eb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.654+0000 7f5a7ae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a7414de30 0x7f5a741522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.654+0000 7f5a73e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a5c0053b0 0x7f5a741eb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.654+0000 7f5a73e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a5c0053b0 0x7f5a741eb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:45074/0 (socket says 172.21.15.90:45074) 2024-09-21T03:14:10.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.655+0000 7f5a73e00640 1 -- 172.21.15.90:0/442901268 learned_addr learned my addr 172.21.15.90:0/442901268 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:10.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.655+0000 7f5a7ae00640 1 --2- 172.21.15.90:0/442901268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a74149900 0x7f5a74149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.655+0000 7f5a73400640 1 --2- 172.21.15.90:0/442901268 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a7414de30 0x7f5a741522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.655+0000 7f5a7ae00640 1 -- 172.21.15.90:0/442901268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5a74070770 con 0x7f5a74149900 2024-09-21T03:14:10.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.655+0000 7f5a7ae00640 1 -- 172.21.15.90:0/442901268 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5a740705f0 con 0x7f5a5c0053b0 2024-09-21T03:14:10.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.656+0000 7f5a7ae00640 1 -- 172.21.15.90:0/442901268 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5a740ab8c0 con 0x7f5a7414de30 2024-09-21T03:14:10.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.656+0000 7f225ce00640 1 Processor -- start 2024-09-21T03:14:10.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.656+0000 7f225ce00640 1 -- start start 2024-09-21T03:14:10.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.657+0000 7f5a79800640 1 --2- 172.21.15.90:0/442901268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a74149900 0x7f5a74149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.660+0000 7f5a73400640 1 -- 172.21.15.90:0/442901268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a5c0053b0 msgr2=0x7f5a741eb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.660+0000 7f5a73400640 1 --2- 172.21.15.90:0/442901268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a5c0053b0 0x7f5a741eb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.660+0000 7f5a73400640 1 -- 172.21.15.90:0/442901268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a74149900 msgr2=0x7f5a74149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.660+0000 7f5a73400640 1 --2- 172.21.15.90:0/442901268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a74149900 0x7f5a74149d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.660+0000 7f5a73400640 1 -- 172.21.15.90:0/442901268 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7414d600 con 0x7f5a7414de30 2024-09-21T03:14:10.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.660+0000 7f5a79800640 1 --2- 172.21.15.90:0/442901268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a74149900 0x7f5a74149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:10.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.661+0000 7f5a73400640 1 --2- 172.21.15.90:0/442901268 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a7414de30 0x7f5a741522c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5a74150a90 tx=0x7f5a6800b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:10.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.661+0000 7f5a67e00640 1 -- 172.21.15.90:0/442901268 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68015020 con 0x7f5a7414de30 2024-09-21T03:14:10.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.662+0000 7f5a67e00640 1 -- 172.21.15.90:0/442901268 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a68011920 con 0x7f5a7414de30 2024-09-21T03:14:10.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.662+0000 7f5a7ae00640 1 -- 172.21.15.90:0/442901268 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7414a250 con 0x7f5a7414de30 2024-09-21T03:14:10.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.662+0000 7f5a7ae00640 1 -- 172.21.15.90:0/442901268 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7414d320 con 0x7f5a7414de30 2024-09-21T03:14:10.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.662+0000 7f5a67e00640 1 -- 172.21.15.90:0/442901268 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68011db0 con 0x7f5a7414de30 2024-09-21T03:14:10.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.664+0000 7f225ce00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2250005de0 0x7f2250162130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.664+0000 7f225ce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f225000ae90 0x7f225002cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.664+0000 7f2255400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2250005de0 0x7f2250162130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.665+0000 7f2255400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2250005de0 0x7f2250162130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:45086/0 (socket says 172.21.15.90:45086) 2024-09-21T03:14:10.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.665+0000 7f225ce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22500429a0 0x7f225002c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.665+0000 7f225ce00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2250046db0 con 0x7f225000ae90 2024-09-21T03:14:10.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.665+0000 7f225ce00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f22500da1a0 con 0x7f2250005de0 2024-09-21T03:14:10.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.665+0000 7f2255400640 1 -- 172.21.15.90:0/922957450 learned_addr learned my addr 172.21.15.90:0/922957450 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:10.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.665+0000 7f225ce00640 1 -- 172.21.15.90:0/922957450 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f225004a740 con 0x7f22500429a0 2024-09-21T03:14:10.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.665+0000 7f2255e00640 1 --2- 172.21.15.90:0/922957450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22500429a0 0x7f225002c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.665+0000 7f2257200640 1 --2- 172.21.15.90:0/922957450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f225000ae90 0x7f225002cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.665+0000 7f2255e00640 1 -- 172.21.15.90:0/922957450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2250005de0 msgr2=0x7f2250162130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.666+0000 7f2255e00640 1 --2- 172.21.15.90:0/922957450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2250005de0 0x7f2250162130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.666+0000 7f2255e00640 1 -- 172.21.15.90:0/922957450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f225000ae90 msgr2=0x7f225002cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.667+0000 7f5a65600640 1 -- 172.21.15.90:0/442901268 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a48005290 con 0x7f5a7414de30 2024-09-21T03:14:10.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.667+0000 7f5a67e00640 1 -- 172.21.15.90:0/442901268 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5a68018020 con 0x7f5a7414de30 2024-09-21T03:14:10.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.667+0000 7f5a67e00640 1 -- 172.21.15.90:0/442901268 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5a6801a540 con 0x7f5a7414de30 2024-09-21T03:14:10.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.670+0000 7f5a67e00640 1 -- 172.21.15.90:0/442901268 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5a6801f070 con 0x7f5a7414de30 2024-09-21T03:14:10.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.666+0000 7f2255e00640 1 --2- 172.21.15.90:0/922957450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f225000ae90 0x7f225002cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.666+0000 7f2255e00640 1 -- 172.21.15.90:0/922957450 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225002d4a0 con 0x7f22500429a0 2024-09-21T03:14:10.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.666+0000 7f2255e00640 1 --2- 172.21.15.90:0/922957450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22500429a0 0x7f225002c680 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f225806a520 tx=0x7f225806a1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:10.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.666+0000 7f224e000640 1 -- 172.21.15.90:0/922957450 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2258076920 con 0x7f22500429a0 2024-09-21T03:14:10.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.666+0000 7f2257200640 1 --2- 172.21.15.90:0/922957450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f225000ae90 0x7f225002cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:10.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.666+0000 7f224e000640 1 -- 172.21.15.90:0/922957450 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2258076bb0 con 0x7f22500429a0 2024-09-21T03:14:10.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.666+0000 7f224e000640 1 -- 172.21.15.90:0/922957450 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2258076920 con 0x7f22500429a0 2024-09-21T03:14:10.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.669+0000 7f225ce00640 1 -- 172.21.15.90:0/922957450 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225002b0c0 con 0x7f22500429a0 2024-09-21T03:14:10.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.669+0000 7f225ce00640 1 -- 172.21.15.90:0/922957450 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f225016a020 con 0x7f22500429a0 2024-09-21T03:14:10.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.674+0000 7f225ce00640 1 -- 172.21.15.90:0/922957450 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f225002e410 con 0x7f22500429a0 2024-09-21T03:14:10.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.685+0000 7f6cd2000640 1 -- 172.21.15.90:0/3785146736 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f6ce01568a0 con 0x7f6ce00ad370 2024-09-21T03:14:10.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.684+0000 7f224e000640 1 -- 172.21.15.90:0/922957450 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2258076dc0 con 0x7f22500429a0 2024-09-21T03:14:10.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.696+0000 7f224e000640 1 -- 172.21.15.90:0/922957450 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f225809e3f0 con 0x7f22500429a0 2024-09-21T03:14:10.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.701+0000 7f6cdcc00640 1 -- 172.21.15.90:0/3785146736 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v11)=0 v11) ==== 116+0+0 (secure 0 0 0) 0x7f6ce00aba30 con 0x7f6ce00ad370 2024-09-21T03:14:10.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.703+0000 7f224e000640 1 -- 172.21.15.90:0/922957450 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f22580a3080 con 0x7f22500429a0 2024-09-21T03:14:10.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.706+0000 7f6cd2000640 1 -- 172.21.15.90:0/3785146736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ce00ad370 msgr2=0x7f6ce014e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.706+0000 7f6cd2000640 1 --2- 172.21.15.90:0/3785146736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ce00ad370 0x7f6ce014e7e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6cd400c730 tx=0x7f6cd400cbf0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.706+0000 7f6cd2000640 1 -- 172.21.15.90:0/3785146736 shutdown_connections 2024-09-21T03:14:10.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.709+0000 7f6cd2000640 1 --2- 172.21.15.90:0/3785146736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ce014cc00 0x7f6ce01f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.709+0000 7f6cd2000640 1 --2- 172.21.15.90:0/3785146736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ce00c8600 0x7f6ce01fca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.709+0000 7f6cd2000640 1 --2- 172.21.15.90:0/3785146736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ce00ad370 0x7f6ce014e7e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.709+0000 7f6cd2000640 1 -- 172.21.15.90:0/3785146736 >> 172.21.15.90:0/3785146736 conn(0x7f6ce006ead0 msgr2=0x7f6ce00c4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.709+0000 7f6cd2000640 1 -- 172.21.15.90:0/3785146736 shutdown_connections 2024-09-21T03:14:10.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.709+0000 7f6cd2000640 1 -- 172.21.15.90:0/3785146736 wait complete. 2024-09-21T03:14:10.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.717+0000 7fc324000640 1 -- 172.21.15.90:0/1888961128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc31404aa10 msgr2=0x7fc31402d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.717+0000 7fc324000640 1 --2- 172.21.15.90:0/1888961128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc31404aa10 0x7fc31402d7e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc31c06ca30 tx=0x7fc31c0a7570 comp rx=0 tx=0).stop 2024-09-21T03:14:10.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.739+0000 7fc324000640 1 -- 172.21.15.90:0/1888961128 shutdown_connections 2024-09-21T03:14:10.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.739+0000 7fc324000640 1 --2- 172.21.15.90:0/1888961128 >> v2:172.21.15.90:3300/0 conn(0x7fc3140dda50 0x7fc3140dde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.739+0000 7fc324000640 1 --2- 172.21.15.90:0/1888961128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc31404aa10 0x7fc31402d7e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.739+0000 7fc324000640 1 -- 172.21.15.90:0/1888961128 >> 172.21.15.90:0/1888961128 conn(0x7fc3140484b0 msgr2=0x7fc31402cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.742+0000 7fc324000640 1 -- 172.21.15.90:0/1888961128 shutdown_connections 2024-09-21T03:14:10.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.747+0000 7fc324000640 1 -- 172.21.15.90:0/1888961128 wait complete. 2024-09-21T03:14:10.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.758+0000 7fc324000640 1 Processor -- start 2024-09-21T03:14:10.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.758+0000 7fc324000640 1 -- start start 2024-09-21T03:14:10.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.765+0000 7fc324000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc31404aa10 0x7fc3140dfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.766+0000 7fc324000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3140dda50 0x7fc314180790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.766+0000 7fc324000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3140de3a0 0x7fc314040ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.767+0000 7fc324000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc314046b70 con 0x7fc3140de3a0 2024-09-21T03:14:10.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.767+0000 7fc324000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc3140469f0 con 0x7fc3140dda50 2024-09-21T03:14:10.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.767+0000 7fc322000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3140de3a0 0x7fc314040ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.767+0000 7fc322000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3140de3a0 0x7fc314040ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53004/0 (socket says 172.21.15.90:53004) 2024-09-21T03:14:10.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.767+0000 7fc322000640 1 -- 172.21.15.90:0/3059465972 learned_addr learned my addr 172.21.15.90:0/3059465972 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:10.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.767+0000 7fc324000640 1 -- 172.21.15.90:0/3059465972 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc31404a460 con 0x7fc31404aa10 2024-09-21T03:14:10.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.770+0000 7fc320c00640 1 --2- 172.21.15.90:0/3059465972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3140dda50 0x7fc314180790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.770+0000 7fe007200640 1 -- 172.21.15.90:0/2850370464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe008073a20 msgr2=0x7fe008153490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.771+0000 7fe007200640 1 --2- 172.21.15.90:0/2850370464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe008073a20 0x7fe008153490 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe000005fd0 tx=0x7fe000009260 comp rx=0 tx=0).stop 2024-09-21T03:14:10.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.772+0000 7fe007200640 1 -- 172.21.15.90:0/2850370464 shutdown_connections 2024-09-21T03:14:10.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.772+0000 7fe007200640 1 --2- 172.21.15.90:0/2850370464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe008073a20 0x7fe008153490 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.773+0000 7fc320c00640 1 -- 172.21.15.90:0/3059465972 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc31404aa10 msgr2=0x7fc3140dfa50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:14:10.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.773+0000 7fc320c00640 1 --2- 172.21.15.90:0/3059465972 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc31404aa10 0x7fc3140dfa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.772+0000 7fe007200640 1 --2- 172.21.15.90:0/2850370464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0080730e0 0x7fe00814ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.773+0000 7fe007200640 1 -- 172.21.15.90:0/2850370464 >> 172.21.15.90:0/2850370464 conn(0x7fe0080c80a0 msgr2=0x7fe0080c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.773+0000 7fc320c00640 1 -- 172.21.15.90:0/3059465972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3140de3a0 msgr2=0x7fc314040ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.773+0000 7fc320c00640 1 --2- 172.21.15.90:0/3059465972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3140de3a0 0x7fc314040ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.774+0000 7fc320c00640 1 -- 172.21.15.90:0/3059465972 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc314181060 con 0x7fc3140dda50 2024-09-21T03:14:10.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.774+0000 7fe007200640 1 -- 172.21.15.90:0/2850370464 shutdown_connections 2024-09-21T03:14:10.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.775+0000 7fe007200640 1 -- 172.21.15.90:0/2850370464 wait complete. 2024-09-21T03:14:10.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.775+0000 7fc322000640 1 --2- 172.21.15.90:0/3059465972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3140de3a0 0x7fc314040ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:14:10.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.783+0000 7fc320c00640 1 --2- 172.21.15.90:0/3059465972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3140dda50 0x7fc314180790 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc31000e9c0 tx=0x7fc31000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:10.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.784+0000 7fe007200640 1 Processor -- start 2024-09-21T03:14:10.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.786+0000 7f2721c00640 1 -- 172.21.15.90:0/1191403650 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f271c0adf00 msgr2=0x7f271c06e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.785+0000 7fe007200640 1 -- start start 2024-09-21T03:14:10.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.788+0000 7f271aa00640 1 -- 172.21.15.90:0/1191403650 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2714036070 con 0x7f271c0adf00 2024-09-21T03:14:10.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.788+0000 7f2721c00640 1 --2- 172.21.15.90:0/1191403650 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f271c0adf00 0x7f271c06e5d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2714005fd0 tx=0x7f271402a6e0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.789+0000 7f2721c00640 1 -- 172.21.15.90:0/1191403650 shutdown_connections 2024-09-21T03:14:10.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.789+0000 7f2721c00640 1 --2- 172.21.15.90:0/1191403650 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f271c0adf00 0x7f271c06e5d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.789+0000 7f2721c00640 1 --2- 172.21.15.90:0/1191403650 >> v2:172.21.15.149:3300/0 conn(0x7f271c155640 0x7f271c154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.789+0000 7f2721c00640 1 -- 172.21.15.90:0/1191403650 >> 172.21.15.90:0/1191403650 conn(0x7f271c0c80a0 msgr2=0x7f271c0c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.790+0000 7f2721c00640 1 -- 172.21.15.90:0/1191403650 shutdown_connections 2024-09-21T03:14:10.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.790+0000 7f2721c00640 1 -- 172.21.15.90:0/1191403650 wait complete. 2024-09-21T03:14:10.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.790+0000 7fe007200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0080730e0 0x7fe0080c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.791+0000 7fe005e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0080730e0 0x7fe0080c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.791+0000 7fe005e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0080730e0 0x7fe0080c71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53020/0 (socket says 172.21.15.90:53020) 2024-09-21T03:14:10.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.791+0000 7fe005e00640 1 -- 172.21.15.90:0/3300014727 learned_addr learned my addr 172.21.15.90:0/3300014727 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:10.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.791+0000 7fe007200640 1 --2- 172.21.15.90:0/3300014727 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe008073610 0x7fe0081dc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.791+0000 7fe007200640 1 --2- 172.21.15.90:0/3300014727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe008073a20 0x7fe0081ddcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.791+0000 7fe005400640 1 --2- 172.21.15.90:0/3300014727 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe008073610 0x7fe0081dc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.792+0000 7fe007200640 1 -- 172.21.15.90:0/3300014727 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe0081539d0 con 0x7fe0080730e0 2024-09-21T03:14:10.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.792+0000 7fe006800640 1 --2- 172.21.15.90:0/3300014727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe008073a20 0x7fe0081ddcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.792+0000 7fe007200640 1 -- 172.21.15.90:0/3300014727 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe0080c3850 con 0x7fe008073a20 2024-09-21T03:14:10.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.792+0000 7fe007200640 1 -- 172.21.15.90:0/3300014727 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe00806f530 con 0x7fe008073610 2024-09-21T03:14:10.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.793+0000 7fe005e00640 1 -- 172.21.15.90:0/3300014727 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe008073610 msgr2=0x7fe0081dc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.793+0000 7fe005e00640 1 --2- 172.21.15.90:0/3300014727 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe008073610 0x7fe0081dc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.793+0000 7fe005e00640 1 -- 172.21.15.90:0/3300014727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe008073a20 msgr2=0x7fe0081ddcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.793+0000 7fe005e00640 1 --2- 172.21.15.90:0/3300014727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe008073a20 0x7fe0081ddcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.793+0000 7fe005e00640 1 -- 172.21.15.90:0/3300014727 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0081dd260 con 0x7fe0080730e0 2024-09-21T03:14:10.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.794+0000 7fc319600640 1 -- 172.21.15.90:0/3059465972 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31000ccc0 con 0x7fc3140dda50 2024-09-21T03:14:10.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.794+0000 7fc319600640 1 -- 172.21.15.90:0/3059465972 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc31000ce60 con 0x7fc3140dda50 2024-09-21T03:14:10.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.794+0000 7fc324000640 1 -- 172.21.15.90:0/3059465972 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3140dff90 con 0x7fc3140dda50 2024-09-21T03:14:10.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.797+0000 7fe005e00640 1 --2- 172.21.15.90:0/3300014727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0080730e0 0x7fe0080c71f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdff80077e0 tx=0x7fdff8007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:10.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.798+0000 7fdffe000640 1 -- 172.21.15.90:0/3300014727 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff8004220 con 0x7fe0080730e0 2024-09-21T03:14:10.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.798+0000 7fe007200640 1 -- 172.21.15.90:0/3300014727 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0081ec840 con 0x7fe0080730e0 2024-09-21T03:14:10.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.799+0000 7fdffe000640 1 -- 172.21.15.90:0/3300014727 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdff80043c0 con 0x7fe0080730e0 2024-09-21T03:14:10.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.799+0000 7fdffe000640 1 -- 172.21.15.90:0/3300014727 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff8004220 con 0x7fe0080730e0 2024-09-21T03:14:10.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.799+0000 7fdffe000640 1 -- 172.21.15.90:0/3300014727 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdff801e020 con 0x7fe0080730e0 2024-09-21T03:14:10.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.799+0000 7fe007200640 1 -- 172.21.15.90:0/3300014727 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0080c5310 con 0x7fe0080730e0 2024-09-21T03:14:10.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.800+0000 7fc319600640 1 -- 172.21.15.90:0/3059465972 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc310004260 con 0x7fc3140dda50 2024-09-21T03:14:10.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.800+0000 7fdffe000640 1 -- 172.21.15.90:0/3300014727 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdff80051b0 con 0x7fe0080730e0 2024-09-21T03:14:10.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.800+0000 7fc324000640 1 -- 172.21.15.90:0/3059465972 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3140ded80 con 0x7fc3140dda50 2024-09-21T03:14:10.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.806+0000 7f559be00640 1 -- 172.21.15.90:0/2303239688 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f559c0c8dc0 msgr2=0x7f559c154010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.806+0000 7f559be00640 1 --2- 172.21.15.90:0/2303239688 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f559c0c8dc0 0x7f559c154010 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5584009830 tx=0x7f558402a420 comp rx=0 tx=0).stop 2024-09-21T03:14:10.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.808+0000 7f559be00640 1 -- 172.21.15.90:0/2303239688 shutdown_connections 2024-09-21T03:14:10.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.808+0000 7f559be00640 1 --2- 172.21.15.90:0/2303239688 >> v2:172.21.15.149:3300/0 conn(0x7f559c0c91d0 0x7f559c154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.808+0000 7f559be00640 1 --2- 172.21.15.90:0/2303239688 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f559c0c8dc0 0x7f559c154010 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.808+0000 7f559be00640 1 -- 172.21.15.90:0/2303239688 >> 172.21.15.90:0/2303239688 conn(0x7f559c0add20 msgr2=0x7f559c0ae130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.809+0000 7fc319600640 1 -- 172.21.15.90:0/3059465972 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc310003980 con 0x7fc3140dda50 2024-09-21T03:14:10.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.809+0000 7fc319600640 1 -- 172.21.15.90:0/3059465972 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc310010770 con 0x7fc3140dda50 2024-09-21T03:14:10.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.810+0000 7fc324000640 1 -- 172.21.15.90:0/3059465972 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3140d9c50 con 0x7fc3140dda50 2024-09-21T03:14:10.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.810+0000 7fe007200640 1 -- 172.21.15.90:0/3300014727 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfe0005290 con 0x7fe0080730e0 2024-09-21T03:14:10.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.809+0000 7f559be00640 1 -- 172.21.15.90:0/2303239688 shutdown_connections 2024-09-21T03:14:10.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.811+0000 7f559be00640 1 -- 172.21.15.90:0/2303239688 wait complete. 2024-09-21T03:14:10.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.814+0000 7fc319600640 1 -- 172.21.15.90:0/3059465972 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc3140d9c50 con 0x7fc3140dda50 2024-09-21T03:14:10.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.818+0000 7f2721c00640 1 Processor -- start 2024-09-21T03:14:10.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.818+0000 7f2721c00640 1 -- start start 2024-09-21T03:14:10.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.822+0000 7f559be00640 1 Processor -- start 2024-09-21T03:14:10.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.824+0000 7fdffe000640 1 -- 172.21.15.90:0/3300014727 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fdff8025070 con 0x7fe0080730e0 2024-09-21T03:14:10.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.824+0000 7f559be00640 1 -- start start 2024-09-21T03:14:10.830 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi090') 2024-09-21T03:14:10.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.831+0000 7f2721c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f271c0abc40 0x7f271c14d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.831+0000 7f2721c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f271c0adf00 0x7f271c14daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.832+0000 7f559be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f559c0c7560 0x7f559c15a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.836+0000 7f559be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f559c0c8dc0 0x7f559c14e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.836+0000 7f559be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f559c15ad40 0x7f559c1500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.837+0000 7f559aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f559c0c7560 0x7f559c15a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.837+0000 7f559aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f559c0c7560 0x7f559c15a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:45118/0 (socket says 172.21.15.90:45118) 2024-09-21T03:14:10.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.837+0000 7f559a000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f559c0c8dc0 0x7f559c14e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.837+0000 7f559a000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f559c0c8dc0 0x7f559c14e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53024/0 (socket says 172.21.15.90:53024) 2024-09-21T03:14:10.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.838+0000 7f559aa00640 1 -- 172.21.15.90:0/21465973 learned_addr learned my addr 172.21.15.90:0/21465973 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:10.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.838+0000 7f559b400640 1 --2- 172.21.15.90:0/21465973 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f559c15ad40 0x7f559c1500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.838+0000 7f559be00640 1 -- 172.21.15.90:0/21465973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f559c0ca790 con 0x7f559c0c8dc0 2024-09-21T03:14:10.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.838+0000 7f559be00640 1 -- 172.21.15.90:0/21465973 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f559c0ca610 con 0x7f559c0c7560 2024-09-21T03:14:10.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.838+0000 7f559be00640 1 -- 172.21.15.90:0/21465973 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f559c0ca910 con 0x7f559c15ad40 2024-09-21T03:14:10.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.832+0000 7f271be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f271c0abc40 0x7f271c14d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.840+0000 7f271b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f271c0adf00 0x7f271c14daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.840+0000 7f271b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f271c0adf00 0x7f271c14daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53022/0 (socket says 172.21.15.90:53022) 2024-09-21T03:14:10.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.840+0000 7f271b400640 1 -- 172.21.15.90:0/3292846945 learned_addr learned my addr 172.21.15.90:0/3292846945 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:10.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.840+0000 7f2721c00640 1 --2- 172.21.15.90:0/3292846945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f271c155640 0x7f271c1ee650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.840+0000 7f2721c00640 1 -- 172.21.15.90:0/3292846945 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f271c0ab1c0 con 0x7f271c0adf00 2024-09-21T03:14:10.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.840+0000 7f2721c00640 1 -- 172.21.15.90:0/3292846945 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f271c158140 con 0x7f271c155640 2024-09-21T03:14:10.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.840+0000 7f2721c00640 1 -- 172.21.15.90:0/3292846945 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f271c0ab340 con 0x7f271c0abc40 2024-09-21T03:14:10.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.840+0000 7f2721200640 1 --2- 172.21.15.90:0/3292846945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f271c155640 0x7f271c1ee650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.841+0000 7f559a000640 1 -- 172.21.15.90:0/21465973 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f559c15ad40 msgr2=0x7f559c1500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.842+0000 7f559a000640 1 --2- 172.21.15.90:0/21465973 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f559c15ad40 0x7f559c1500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.842+0000 7f559a000640 1 -- 172.21.15.90:0/21465973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f559c0c7560 msgr2=0x7f559c15a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.842+0000 7f559a000640 1 --2- 172.21.15.90:0/21465973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f559c0c7560 0x7f559c15a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.842+0000 7f559a000640 1 -- 172.21.15.90:0/21465973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559c149d70 con 0x7f559c0c8dc0 2024-09-21T03:14:10.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.842+0000 7f2721200640 1 -- 172.21.15.90:0/3292846945 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f271c0abc40 msgr2=0x7f271c14d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.844+0000 7f2721200640 1 --2- 172.21.15.90:0/3292846945 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f271c0abc40 0x7f271c14d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.844+0000 7f2721200640 1 -- 172.21.15.90:0/3292846945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f271c0adf00 msgr2=0x7f271c14daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.844+0000 7f2721200640 1 --2- 172.21.15.90:0/3292846945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f271c0adf00 0x7f271c14daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.846+0000 7f2721200640 1 -- 172.21.15.90:0/3292846945 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271c0c1ac0 con 0x7f271c155640 2024-09-21T03:14:10.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.846+0000 7fbd02a00640 1 -- 172.21.15.90:0/3726923620 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fbce4005580 con 0x7fbd080476d0 2024-09-21T03:14:10.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.848+0000 7f271b400640 1 --2- 172.21.15.90:0/3292846945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f271c0adf00 0x7f271c14daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:14:10.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.849+0000 7f271be00640 1 --2- 172.21.15.90:0/3292846945 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f271c0abc40 0x7f271c14d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:14:10.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.851+0000 7f2721200640 1 --2- 172.21.15.90:0/3292846945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f271c155640 0x7f271c1ee650 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2714009000 tx=0x7f2714004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:10.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.852+0000 7f2713e00640 1 -- 172.21.15.90:0/3292846945 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2714041020 con 0x7f271c155640 2024-09-21T03:14:10.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.852+0000 7f559a000640 1 --2- 172.21.15.90:0/21465973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f559c0c8dc0 0x7f559c14e2e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5584031000 tx=0x7f5584033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:10.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.854+0000 7f2713e00640 1 -- 172.21.15.90:0/3292846945 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2714004460 con 0x7f271c155640 2024-09-21T03:14:10.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.854+0000 7f2713e00640 1 -- 172.21.15.90:0/3292846945 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2714036040 con 0x7f271c155640 2024-09-21T03:14:10.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.855+0000 7f2721c00640 1 -- 172.21.15.90:0/3292846945 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f271c0c1d80 con 0x7f271c155640 2024-09-21T03:14:10.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.855+0000 7f5592a00640 1 -- 172.21.15.90:0/21465973 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584031d60 con 0x7f559c0c8dc0 2024-09-21T03:14:10.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.856+0000 7f5592a00640 1 -- 172.21.15.90:0/21465973 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5584033e10 con 0x7f559c0c8dc0 2024-09-21T03:14:10.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.856+0000 7f5592a00640 1 -- 172.21.15.90:0/21465973 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584033330 con 0x7f559c0c8dc0 2024-09-21T03:14:10.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.857+0000 7fa3eb200640 1 -- 172.21.15.90:0/963449642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3e404ab80 msgr2=0x7fa3e4031bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.857+0000 7fa3e8a00640 1 -- 172.21.15.90:0/963449642 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8035020 con 0x7fa3e404ab80 2024-09-21T03:14:10.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.857+0000 7fa3eb200640 1 --2- 172.21.15.90:0/963449642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3e404ab80 0x7fa3e4031bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8005fd0 tx=0x7fa3d802a4a0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.857+0000 7fa3eb200640 1 -- 172.21.15.90:0/963449642 shutdown_connections 2024-09-21T03:14:10.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.857+0000 7fa3eb200640 1 --2- 172.21.15.90:0/963449642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3e404ab80 0x7fa3e4031bd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.858+0000 7fa3eb200640 1 -- 172.21.15.90:0/963449642 >> 172.21.15.90:0/963449642 conn(0x7fa3e404c8a0 msgr2=0x7fa3e40312e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.858+0000 7f2721c00640 1 -- 172.21.15.90:0/3292846945 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f271c0bd710 con 0x7f271c155640 2024-09-21T03:14:10.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.860+0000 7f2713e00640 1 -- 172.21.15.90:0/3292846945 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2714044020 con 0x7f271c155640 2024-09-21T03:14:10.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.863+0000 7f559be00640 1 -- 172.21.15.90:0/21465973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f559c1ed160 con 0x7f559c0c8dc0 2024-09-21T03:14:10.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.862+0000 7fa3eb200640 1 -- 172.21.15.90:0/963449642 shutdown_connections 2024-09-21T03:14:10.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.863+0000 7fbd0d600640 1 -- 172.21.15.90:0/3726923620 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v12)=0 v12) ==== 116+0+0 (secure 0 0 0) 0x7fbcfc011d10 con 0x7fbd080476d0 2024-09-21T03:14:10.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.862+0000 7f4acfe00640 1 -- 172.21.15.90:0/830435865 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f4aa8005580 con 0x7f4ad00c1590 2024-09-21T03:14:10.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.864+0000 7f559be00640 1 -- 172.21.15.90:0/21465973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f559c1ece30 con 0x7f559c0c8dc0 2024-09-21T03:14:10.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.864+0000 7f5592a00640 1 -- 172.21.15.90:0/21465973 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f55840334d0 con 0x7f559c0c8dc0 2024-09-21T03:14:10.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.865+0000 7f5592a00640 1 -- 172.21.15.90:0/21465973 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f558403b7f0 con 0x7f559c0c8dc0 2024-09-21T03:14:10.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.865+0000 7fbd02a00640 1 -- 172.21.15.90:0/3726923620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd080476d0 msgr2=0x7fbd0803e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.865+0000 7fbd02a00640 1 --2- 172.21.15.90:0/3726923620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd080476d0 0x7fbd0803e850 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc00c310 tx=0x7fbcfc00c7d0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.865+0000 7fbd02a00640 1 -- 172.21.15.90:0/3726923620 shutdown_connections 2024-09-21T03:14:10.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.865+0000 7fbd02a00640 1 --2- 172.21.15.90:0/3726923620 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd080499d0 0x7fbd08044190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.865+0000 7fbd02a00640 1 --2- 172.21.15.90:0/3726923620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd080476d0 0x7fbd0803e850 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.865+0000 7fbd02a00640 1 --2- 172.21.15.90:0/3726923620 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd08030cd0 0x7fbd080cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.865+0000 7fbd02a00640 1 -- 172.21.15.90:0/3726923620 >> 172.21.15.90:0/3726923620 conn(0x7fbd08048480 msgr2=0x7fbd080d3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.866+0000 7fa3eb200640 1 -- 172.21.15.90:0/963449642 wait complete. 2024-09-21T03:14:10.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.868+0000 7f2711600640 1 -- 172.21.15.90:0/3292846945 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f0005290 con 0x7f271c155640 2024-09-21T03:14:10.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.868+0000 7fbd02a00640 1 -- 172.21.15.90:0/3726923620 shutdown_connections 2024-09-21T03:14:10.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.868+0000 7fbd02a00640 1 -- 172.21.15.90:0/3726923620 wait complete. 2024-09-21T03:14:10.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.872+0000 7f559be00640 1 -- 172.21.15.90:0/21465973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f559c0c91d0 con 0x7f559c0c8dc0 2024-09-21T03:14:10.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.874+0000 7f2713e00640 1 -- 172.21.15.90:0/3292846945 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f271403d770 con 0x7f271c155640 2024-09-21T03:14:10.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.877+0000 7fa3eb200640 1 Processor -- start 2024-09-21T03:14:10.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.877+0000 7fa3eb200640 1 -- start start 2024-09-21T03:14:10.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.882+0000 7f2713e00640 1 -- 172.21.15.90:0/3292846945 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f271404b030 con 0x7f271c155640 2024-09-21T03:14:10.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.882+0000 7f4ac6a00640 1 -- 172.21.15.90:0/830435865 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v13)=0 v13) ==== 118+0+0 (secure 0 0 0) 0x7f4ac0019b50 con 0x7f4ad00c1590 2024-09-21T03:14:10.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.884+0000 7f6ac5a00640 1 -- 172.21.15.90:0/2002095091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f6ac0070e40 con 0x7f6ac01555d0 2024-09-21T03:14:10.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.885+0000 7f5592a00640 1 -- 172.21.15.90:0/21465973 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5584063860 con 0x7f559c0c8dc0 2024-09-21T03:14:10.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.885+0000 7fa3eb200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3e404ab80 0x7fa3e40d5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.886+0000 7fa3e9e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3e404ab80 0x7fa3e40d5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.886+0000 7fa3e9e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3e404ab80 0x7fa3e40d5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53028/0 (socket says 172.21.15.90:53028) 2024-09-21T03:14:10.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.886+0000 7fa3e9e00640 1 -- 172.21.15.90:0/824790077 learned_addr learned my addr 172.21.15.90:0/824790077 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:10.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.886+0000 7fa3eb200640 1 --2- 172.21.15.90:0/824790077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3e40d3110 0x7fa3e4177ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.887+0000 7fa3eb200640 1 --2- 172.21.15.90:0/824790077 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3e40cd0b0 0x7fa3e40cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.887+0000 7fa3eb200640 1 -- 172.21.15.90:0/824790077 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e404e7d0 con 0x7fa3e404ab80 2024-09-21T03:14:10.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.887+0000 7fa3ea800640 1 --2- 172.21.15.90:0/824790077 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3e40cd0b0 0x7fa3e40cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.887+0000 7fa3eb200640 1 -- 172.21.15.90:0/824790077 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e404a740 con 0x7fa3e40d3110 2024-09-21T03:14:10.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.887+0000 7fa3eb200640 1 -- 172.21.15.90:0/824790077 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e404e950 con 0x7fa3e40cd0b0 2024-09-21T03:14:10.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.888+0000 7f33a2400640 1 -- 172.21.15.90:0/2493621189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f339c15c400 msgr2=0x7f339c15e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.888+0000 7f33a2400640 1 --2- 172.21.15.90:0/2493621189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f339c15c400 0x7f339c15e820 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f339c073ca0 tx=0x7f339402a8b0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.889+0000 7fa3e9e00640 1 -- 172.21.15.90:0/824790077 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3e40cd0b0 msgr2=0x7fa3e40cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.889+0000 7fa3e9e00640 1 --2- 172.21.15.90:0/824790077 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3e40cd0b0 0x7fa3e40cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.889+0000 7fa3e9e00640 1 -- 172.21.15.90:0/824790077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3e40d3110 msgr2=0x7fa3e4177ee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:14:10.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.889+0000 7fa3e9e00640 1 --2- 172.21.15.90:0/824790077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3e40d3110 0x7fa3e4177ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.889+0000 7fa3e9e00640 1 -- 172.21.15.90:0/824790077 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e4031400 con 0x7fa3e404ab80 2024-09-21T03:14:10.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.890+0000 7f4acfe00640 1 -- 172.21.15.90:0/830435865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ad00c1590 msgr2=0x7f4ad0143100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.890+0000 7f4acfe00640 1 --2- 172.21.15.90:0/830435865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ad00c1590 0x7f4ad0143100 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000b3e0 tx=0x7f4ac000b8a0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.889+0000 7f33a2400640 1 -- 172.21.15.90:0/2493621189 shutdown_connections 2024-09-21T03:14:10.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.890+0000 7f33a2400640 1 --2- 172.21.15.90:0/2493621189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f339c15c400 0x7f339c15e820 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.890+0000 7f33a2400640 1 -- 172.21.15.90:0/2493621189 >> 172.21.15.90:0/2493621189 conn(0x7f339c0c80a0 msgr2=0x7f339c0c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.891+0000 7f4acfe00640 1 -- 172.21.15.90:0/830435865 shutdown_connections 2024-09-21T03:14:10.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.891+0000 7f4acfe00640 1 --2- 172.21.15.90:0/830435865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ad00c1590 0x7f4ad0143100 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.891+0000 7f4acfe00640 1 --2- 172.21.15.90:0/830435865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ad0151060 0x7f4ad01ed3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.891+0000 7f4acfe00640 1 --2- 172.21.15.90:0/830435865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4ad0072970 0x7f4ad00bee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.891+0000 7f4acfe00640 1 -- 172.21.15.90:0/830435865 >> 172.21.15.90:0/830435865 conn(0x7f4ad00c80a0 msgr2=0x7f4ad00ac390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.891+0000 7f4acfe00640 1 -- 172.21.15.90:0/830435865 shutdown_connections 2024-09-21T03:14:10.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.891+0000 7f4acfe00640 1 -- 172.21.15.90:0/830435865 wait complete. 2024-09-21T03:14:10.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.893+0000 7fa3e9e00640 1 --2- 172.21.15.90:0/824790077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3e404ab80 0x7fa3e40d5240 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009850 tx=0x7fa3d8004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:10.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.894+0000 7f096f200640 1 -- 172.21.15.90:0/4194335291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0970152d80 msgr2=0x7f0970153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.894+0000 7f096f200640 1 --2- 172.21.15.90:0/4194335291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0970152d80 0x7f0970153190 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f096800afd0 tx=0x7f096802b570 comp rx=0 tx=0).stop 2024-09-21T03:14:10.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.894+0000 7f096f200640 1 -- 172.21.15.90:0/4194335291 shutdown_connections 2024-09-21T03:14:10.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.895+0000 7f096f200640 1 --2- 172.21.15.90:0/4194335291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0970152d80 0x7f0970153190 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.895+0000 7f096f200640 1 --2- 172.21.15.90:0/4194335291 >> v2:172.21.15.149:3300/0 conn(0x7f0970073610 0x7f0970073a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.895+0000 7f096f200640 1 -- 172.21.15.90:0/4194335291 >> 172.21.15.90:0/4194335291 conn(0x7f09700c80a0 msgr2=0x7f09700c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.895+0000 7f096f200640 1 -- 172.21.15.90:0/4194335291 shutdown_connections 2024-09-21T03:14:10.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.895+0000 7f096f200640 1 -- 172.21.15.90:0/4194335291 wait complete. 2024-09-21T03:14:10.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.899+0000 7f6ab7e00640 1 -- 172.21.15.90:0/2002095091 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v14)=0 v14) ==== 115+0+0 (secure 0 0 0) 0x7f6ac0069b80 con 0x7f6ac01555d0 2024-09-21T03:14:10.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.901+0000 7f6ac5a00640 1 -- 172.21.15.90:0/2002095091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ac01555d0 msgr2=0x7f6ac01559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.901+0000 7f6ac5a00640 1 --2- 172.21.15.90:0/2002095091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ac01555d0 0x7f6ac01559e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6ac00c3de0 tx=0x7f6ab8009b00 comp rx=0 tx=0).stop 2024-09-21T03:14:10.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.901+0000 7f6ac5a00640 1 -- 172.21.15.90:0/2002095091 shutdown_connections 2024-09-21T03:14:10.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.901+0000 7f6ac5a00640 1 --2- 172.21.15.90:0/2002095091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ac01555d0 0x7f6ac01559e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.901+0000 7f6ac5a00640 1 --2- 172.21.15.90:0/2002095091 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ac01ebc10 0x7f6ac01ec020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.901+0000 7f6ac5a00640 1 --2- 172.21.15.90:0/2002095091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ac00c4570 0x7f6ac0156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.901+0000 7f6ac5a00640 1 -- 172.21.15.90:0/2002095091 >> 172.21.15.90:0/2002095091 conn(0x7f6ac00c8490 msgr2=0x7f6ac014f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.901+0000 7f6ac5a00640 1 -- 172.21.15.90:0/2002095091 shutdown_connections 2024-09-21T03:14:10.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.901+0000 7f6ac5a00640 1 -- 172.21.15.90:0/2002095091 wait complete. 2024-09-21T03:14:10.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.903+0000 7fa3e2000640 1 -- 172.21.15.90:0/824790077 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d803e030 con 0x7fa3e404ab80 2024-09-21T03:14:10.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.897+0000 7f33a2400640 1 -- 172.21.15.90:0/2493621189 shutdown_connections 2024-09-21T03:14:10.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.904+0000 7fa3e2000640 1 -- 172.21.15.90:0/824790077 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3d80055f0 con 0x7fa3e404ab80 2024-09-21T03:14:10.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.904+0000 7f096f200640 1 Processor -- start 2024-09-21T03:14:10.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.904+0000 7fa3eb200640 1 -- 172.21.15.90:0/824790077 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e40d4d40 con 0x7fa3e404ab80 2024-09-21T03:14:10.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.904+0000 7fa3eb200640 1 -- 172.21.15.90:0/824790077 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e41789f0 con 0x7fa3e404ab80 2024-09-21T03:14:10.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.905+0000 7f096f200640 1 -- start start 2024-09-21T03:14:10.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.907+0000 7fa3eb200640 1 -- 172.21.15.90:0/824790077 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e40d13e0 con 0x7fa3e404ab80 2024-09-21T03:14:10.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.914+0000 7f096f200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09700730e0 0x7f097014bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.914+0000 7f096f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0970073610 0x7f09701497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.913+0000 7fa3e2000640 1 -- 172.21.15.90:0/824790077 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8035040 con 0x7fa3e404ab80 2024-09-21T03:14:10.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.915+0000 7fa3e2000640 1 -- 172.21.15.90:0/824790077 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa3d8041030 con 0x7fa3e404ab80 2024-09-21T03:14:10.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.914+0000 7f096f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0970152d80 0x7f0970145b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.914+0000 7f096f200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f09700c4760 con 0x7f09700730e0 2024-09-21T03:14:10.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.915+0000 7f096f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f097006f530 con 0x7f0970073610 2024-09-21T03:14:10.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.915+0000 7f096f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f09700c48e0 con 0x7f0970152d80 2024-09-21T03:14:10.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.915+0000 7f096d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0970073610 0x7f09701497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.915+0000 7f096d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0970073610 0x7f09701497b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:45170/0 (socket says 172.21.15.90:45170) 2024-09-21T03:14:10.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.915+0000 7f096d400640 1 -- 172.21.15.90:0/3614724976 learned_addr learned my addr 172.21.15.90:0/3614724976 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:10.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.916+0000 7f096de00640 1 --2- 172.21.15.90:0/3614724976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09700730e0 0x7f097014bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.918+0000 7f096de00640 1 -- 172.21.15.90:0/3614724976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0970152d80 msgr2=0x7f0970145b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.918+0000 7f096de00640 1 --2- 172.21.15.90:0/3614724976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0970152d80 0x7f0970145b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.918+0000 7f096de00640 1 -- 172.21.15.90:0/3614724976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0970073610 msgr2=0x7f09701497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.918+0000 7f096de00640 1 --2- 172.21.15.90:0/3614724976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0970073610 0x7f09701497b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.918+0000 7f096de00640 1 -- 172.21.15.90:0/3614724976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09700c6880 con 0x7f09700730e0 2024-09-21T03:14:10.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.918+0000 7fa3e2000640 1 -- 172.21.15.90:0/824790077 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa3d804c840 con 0x7fa3e404ab80 2024-09-21T03:14:10.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.919+0000 7f096de00640 1 --2- 172.21.15.90:0/3614724976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09700730e0 0x7f097014bcf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f096000c340 tx=0x7f096000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:10.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.920+0000 7fa3e2000640 1 -- 172.21.15.90:0/824790077 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa3d8048030 con 0x7fa3e404ab80 2024-09-21T03:14:10.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.922+0000 7f0966000640 1 -- 172.21.15.90:0/3614724976 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0960017070 con 0x7f09700730e0 2024-09-21T03:14:10.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.922+0000 7f096f200640 1 -- 172.21.15.90:0/3614724976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0970146810 con 0x7f09700730e0 2024-09-21T03:14:10.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.922+0000 7f096f200640 1 -- 172.21.15.90:0/3614724976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09700c7aa0 con 0x7f09700730e0 2024-09-21T03:14:10.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.924+0000 7f0966000640 1 -- 172.21.15.90:0/3614724976 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09600053c0 con 0x7f09700730e0 2024-09-21T03:14:10.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.928+0000 7f0966000640 1 -- 172.21.15.90:0/3614724976 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09600118b0 con 0x7f09700730e0 2024-09-21T03:14:10.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.928+0000 7f0966000640 1 -- 172.21.15.90:0/3614724976 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f096001a070 con 0x7f09700730e0 2024-09-21T03:14:10.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.928+0000 7f0966000640 1 -- 172.21.15.90:0/3614724976 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f096001c780 con 0x7f09700730e0 2024-09-21T03:14:10.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.929+0000 7f095b400640 1 -- 172.21.15.90:0/3614724976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0948005290 con 0x7f09700730e0 2024-09-21T03:14:10.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.908+0000 7f33a2400640 1 -- 172.21.15.90:0/2493621189 wait complete. 2024-09-21T03:14:10.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.936+0000 7f0966000640 1 -- 172.21.15.90:0/3614724976 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0960021020 con 0x7f09700730e0 2024-09-21T03:14:10.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.940+0000 7f33a2400640 1 Processor -- start 2024-09-21T03:14:10.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.940+0000 7f33a2400640 1 -- start start 2024-09-21T03:14:10.949 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi090') 2024-09-21T03:14:10.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.947+0000 7f33a2400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f339c14fe60 0x7f339c156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.947+0000 7f33a2400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f339c152a80 0x7f339c0bd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.948+0000 7f33a2400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f339c15c400 0x7f339c157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:10.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.948+0000 7f33a2400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f339c073060 con 0x7f339c15c400 2024-09-21T03:14:10.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.952+0000 7f33a2400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f339c150630 con 0x7f339c152a80 2024-09-21T03:14:10.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.952+0000 7f33a2400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f339c0731e0 con 0x7f339c14fe60 2024-09-21T03:14:10.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.952+0000 7f339be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f339c15c400 0x7f339c157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:10.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.952+0000 7f339be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f339c15c400 0x7f339c157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53048/0 (socket says 172.21.15.90:53048) 2024-09-21T03:14:10.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.952+0000 7f339be00640 1 -- 172.21.15.90:0/838922283 learned_addr learned my addr 172.21.15.90:0/838922283 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:10.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.953+0000 7f339be00640 1 -- 172.21.15.90:0/838922283 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f339c14fe60 msgr2=0x7f339c156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.953+0000 7f339be00640 1 --2- 172.21.15.90:0/838922283 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f339c14fe60 0x7f339c156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.954+0000 7f339be00640 1 -- 172.21.15.90:0/838922283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f339c152a80 msgr2=0x7f339c0bd940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:14:10.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.954+0000 7f339be00640 1 --2- 172.21.15.90:0/838922283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f339c152a80 0x7f339c0bd940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.954+0000 7f339be00640 1 -- 172.21.15.90:0/838922283 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339c1589f0 con 0x7f339c15c400 2024-09-21T03:14:10.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.955+0000 7f339be00640 1 --2- 172.21.15.90:0/838922283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f339c15c400 0x7f339c157530 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f339402aea0 tx=0x7f3394003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:10.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.959+0000 7f3393400640 1 -- 172.21.15.90:0/838922283 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394031b90 con 0x7f339c15c400 2024-09-21T03:14:10.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.959+0000 7f3393400640 1 -- 172.21.15.90:0/838922283 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3394031e20 con 0x7f339c15c400 2024-09-21T03:14:10.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.959+0000 7f33a2400640 1 -- 172.21.15.90:0/838922283 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f339c158cd0 con 0x7f339c15c400 2024-09-21T03:14:10.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.959+0000 7f33a2400640 1 -- 172.21.15.90:0/838922283 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f339c157f90 con 0x7f339c15c400 2024-09-21T03:14:10.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.960+0000 7f3393400640 1 -- 172.21.15.90:0/838922283 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394033310 con 0x7f339c15c400 2024-09-21T03:14:10.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.965+0000 7f5a65600640 1 -- 172.21.15.90:0/442901268 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f5a48005850 con 0x7f5a7414de30 2024-09-21T03:14:10.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.965+0000 7f33a2400640 1 -- 172.21.15.90:0/838922283 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3374005290 con 0x7f339c15c400 2024-09-21T03:14:10.972 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi090') 2024-09-21T03:14:10.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.974+0000 7f3393400640 1 -- 172.21.15.90:0/838922283 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3394031680 con 0x7f339c15c400 2024-09-21T03:14:10.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.974+0000 7f3393400640 1 -- 172.21.15.90:0/838922283 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f339403b750 con 0x7f339c15c400 2024-09-21T03:14:10.985 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi090') 2024-09-21T03:14:10.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.979+0000 7f3393400640 1 -- 172.21.15.90:0/838922283 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3394051020 con 0x7f339c15c400 2024-09-21T03:14:10.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.981+0000 7fd843200640 1 -- 172.21.15.90:0/2277156546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8280042e0 msgr2=0x7fd828004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.982+0000 7fd843200640 1 --2- 172.21.15.90:0/2277156546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8280042e0 0x7fd828004800 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd8340012a0 tx=0x7fd828005830 comp rx=0 tx=0).stop 2024-09-21T03:14:10.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.983+0000 7fd843200640 1 -- 172.21.15.90:0/2277156546 shutdown_connections 2024-09-21T03:14:10.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.983+0000 7fd843200640 1 --2- 172.21.15.90:0/2277156546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8280042e0 0x7fd828004800 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.983+0000 7fd843200640 1 -- 172.21.15.90:0/2277156546 >> 172.21.15.90:0/2277156546 conn(0x7fd83c048450 msgr2=0x7fd83c048860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.983+0000 7fd843200640 1 -- 172.21.15.90:0/2277156546 shutdown_connections 2024-09-21T03:14:10.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.983+0000 7fd843200640 1 -- 172.21.15.90:0/2277156546 wait complete. 2024-09-21T03:14:10.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.987+0000 7f5a67e00640 1 -- 172.21.15.90:0/442901268 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7f5a6801f070 con 0x7f5a7414de30 2024-09-21T03:14:10.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.987+0000 7fe756200640 1 -- 172.21.15.90:0/109310410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe748049740 msgr2=0x7fe748046940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.987+0000 7fe756200640 1 --2- 172.21.15.90:0/109310410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe748049740 0x7fe748046940 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe744005fd0 tx=0x7fe74402b0a0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.988+0000 7fe756200640 1 -- 172.21.15.90:0/109310410 shutdown_connections 2024-09-21T03:14:10.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.988+0000 7f5a65600640 1 -- 172.21.15.90:0/442901268 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a7414de30 msgr2=0x7f5a741522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.988+0000 7f5a65600640 1 --2- 172.21.15.90:0/442901268 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a7414de30 0x7f5a741522c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5a74150a90 tx=0x7f5a6800b870 comp rx=0 tx=0).stop 2024-09-21T03:14:10.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.988+0000 7fe756200640 1 --2- 172.21.15.90:0/109310410 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe74802d7c0 0x7fe7480d37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.988+0000 7fe756200640 1 --2- 172.21.15.90:0/109310410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe748049740 0x7fe748046940 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.988+0000 7fe756200640 1 -- 172.21.15.90:0/109310410 >> 172.21.15.90:0/109310410 conn(0x7fe748048650 msgr2=0x7fe74802ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.989+0000 7f5a65600640 1 -- 172.21.15.90:0/442901268 shutdown_connections 2024-09-21T03:14:10.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.989+0000 7fe756200640 1 -- 172.21.15.90:0/109310410 shutdown_connections 2024-09-21T03:14:10.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.989+0000 7f5a65600640 1 --2- 172.21.15.90:0/442901268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a74149900 0x7f5a74149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.989+0000 7f5a65600640 1 --2- 172.21.15.90:0/442901268 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a7414de30 0x7f5a741522c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.989+0000 7f5a65600640 1 --2- 172.21.15.90:0/442901268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a5c0053b0 0x7f5a741eb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.989+0000 7fe756200640 1 -- 172.21.15.90:0/109310410 wait complete. 2024-09-21T03:14:10.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.989+0000 7f5a65600640 1 -- 172.21.15.90:0/442901268 >> 172.21.15.90:0/442901268 conn(0x7f5a7406ecb0 msgr2=0x7f5a7406f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.989+0000 7f5a65600640 1 -- 172.21.15.90:0/442901268 shutdown_connections 2024-09-21T03:14:10.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.989+0000 7f5a65600640 1 -- 172.21.15.90:0/442901268 wait complete. 2024-09-21T03:14:10.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.995+0000 7f60ea400640 1 -- 172.21.15.90:0/1285809474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60e41576e0 msgr2=0x7f60e415ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:10.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.995+0000 7f60ea400640 1 --2- 172.21.15.90:0/1285809474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60e41576e0 0x7f60e415ac20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009830 tx=0x7f60d402a5f0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.995+0000 7f60ea400640 1 -- 172.21.15.90:0/1285809474 shutdown_connections 2024-09-21T03:14:10.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.995+0000 7f60ea400640 1 --2- 172.21.15.90:0/1285809474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60e41576e0 0x7f60e415ac20 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009830 tx=0x7f60d402a5f0 comp rx=0 tx=0).stop 2024-09-21T03:14:10.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.995+0000 7f60ea400640 1 -- 172.21.15.90:0/1285809474 >> 172.21.15.90:0/1285809474 conn(0x7f60e40c80a0 msgr2=0x7f60e40c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:10.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.996+0000 7f60ea400640 1 -- 172.21.15.90:0/1285809474 shutdown_connections 2024-09-21T03:14:10.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.996+0000 7f60ea400640 1 -- 172.21.15.90:0/1285809474 wait complete. 2024-09-21T03:14:10.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:10.997+0000 7fd843200640 1 Processor -- start 2024-09-21T03:14:11.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.000+0000 7f60ea400640 1 Processor -- start 2024-09-21T03:14:11.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.000+0000 7f60ea400640 1 -- start start 2024-09-21T03:14:11.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.001+0000 7fd843200640 1 -- start start 2024-09-21T03:14:11.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.002+0000 7fe756200640 1 Processor -- start 2024-09-21T03:14:11.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.002+0000 7fe756200640 1 -- start start 2024-09-21T03:14:11.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.004+0000 7f60ea400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60e406e5d0 0x7f60e40ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:11.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.003+0000 7fd843200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8280042e0 0x7fd83c02bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:11.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.003+0000 7fd843200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd83c0454b0 0x7fd83c0415e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:11.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.003+0000 7fd843200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd83c02c180 0x7fd83c041b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:11.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.005+0000 7f60e9000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60e406e5d0 0x7f60e40ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:11.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.005+0000 7f60e9000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60e406e5d0 0x7f60e40ad190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53074/0 (socket says 172.21.15.90:53074) 2024-09-21T03:14:11.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.005+0000 7f60e9000640 1 -- 172.21.15.90:0/3777067501 learned_addr learned my addr 172.21.15.90:0/3777067501 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:11.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.006+0000 7f60ea400640 1 --2- 172.21.15.90:0/3777067501 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60e4073a90 0x7f60e40abe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:11.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.003+0000 7fd843200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c0466b0 con 0x7fd83c0454b0 2024-09-21T03:14:11.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.006+0000 7f60ea400640 1 --2- 172.21.15.90:0/3777067501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40ada50 0x7f60e413b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:11.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.006+0000 7f225ce00640 1 -- 172.21.15.90:0/922957450 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f2250049910 con 0x7f22500429a0 2024-09-21T03:14:11.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.003+0000 7fd843200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c0da7f0 con 0x7fd8280042e0 2024-09-21T03:14:11.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.006+0000 7f60ea400640 1 -- 172.21.15.90:0/3777067501 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f60e406eb60 con 0x7f60e406e5d0 2024-09-21T03:14:11.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.006+0000 7f60ea400640 1 -- 172.21.15.90:0/3777067501 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f60e406e9e0 con 0x7f60e40ada50 2024-09-21T03:14:11.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.006+0000 7f60ea400640 1 -- 172.21.15.90:0/3777067501 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f60e4073ea0 con 0x7f60e4073a90 2024-09-21T03:14:11.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.006+0000 7f60e3e00640 1 --2- 172.21.15.90:0/3777067501 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60e4073a90 0x7f60e40abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:11.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.003+0000 7fd843200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd83c047cd0 con 0x7fd83c02c180 2024-09-21T03:14:11.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.004+0000 7fd841e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8280042e0 0x7fd83c02bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:11.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.004+0000 7fd841e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8280042e0 0x7fd83c02bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:45210/0 (socket says 172.21.15.90:45210) 2024-09-21T03:14:11.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.004+0000 7fd841e00640 1 -- 172.21.15.90:0/156349228 learned_addr learned my addr 172.21.15.90:0/156349228 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:11.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.004+0000 7fd848a00640 1 --2- 172.21.15.90:0/156349228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd83c02c180 0x7fd83c041b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:11.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.005+0000 7fd848a00640 1 -- 172.21.15.90:0/156349228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8280042e0 msgr2=0x7fd83c02bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.005+0000 7fd848a00640 1 --2- 172.21.15.90:0/156349228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8280042e0 0x7fd83c02bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.005+0000 7fd848a00640 1 -- 172.21.15.90:0/156349228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd83c0454b0 msgr2=0x7fd83c0415e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:14:11.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.005+0000 7fd848a00640 1 --2- 172.21.15.90:0/156349228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd83c0454b0 0x7fd83c0415e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.005+0000 7fd848a00640 1 -- 172.21.15.90:0/156349228 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83c16fed0 con 0x7fd83c02c180 2024-09-21T03:14:11.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.007+0000 7f60e9000640 1 -- 172.21.15.90:0/3777067501 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60e4073a90 msgr2=0x7f60e40abe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.007+0000 7f60e9000640 1 --2- 172.21.15.90:0/3777067501 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60e4073a90 0x7f60e40abe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.008+0000 7f60e9000640 1 -- 172.21.15.90:0/3777067501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40ada50 msgr2=0x7f60e413b500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:14:11.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.008+0000 7f60e9000640 1 --2- 172.21.15.90:0/3777067501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40ada50 0x7f60e413b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.008+0000 7f60e9000640 1 -- 172.21.15.90:0/3777067501 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e40ab1c0 con 0x7f60e406e5d0 2024-09-21T03:14:11.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.008+0000 7fd848a00640 1 --2- 172.21.15.90:0/156349228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd83c02c180 0x7fd83c041b20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd84406c380 tx=0x7fd844069e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:11.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.009+0000 7f60e9000640 1 --2- 172.21.15.90:0/3777067501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60e406e5d0 0x7f60e40ad190 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009950 tx=0x7f60d4032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:11.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.009+0000 7fd83a000640 1 -- 172.21.15.90:0/156349228 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd844074820 con 0x7fd83c02c180 2024-09-21T03:14:11.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.009+0000 7fd83a000640 1 -- 172.21.15.90:0/156349228 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd844074af0 con 0x7fd83c02c180 2024-09-21T03:14:11.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.009+0000 7fd83a000640 1 -- 172.21.15.90:0/156349228 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8440943f0 con 0x7fd83c02c180 2024-09-21T03:14:11.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.010+0000 7fe756200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe74802d7c0 0x7fe748041b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:11.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.010+0000 7fe756200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe74802dbd0 0x7fe74816f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:11.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.010+0000 7fe74f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe74802d7c0 0x7fe748041b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:11.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.011+0000 7fe756200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe748049740 0x7fe7480cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:11.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.011+0000 7fe74ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe74802dbd0 0x7fe74816f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:11.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.011+0000 7fe74f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe74802d7c0 0x7fe748041b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:41630/0 (socket says 172.21.15.90:41630) 2024-09-21T03:14:11.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.011+0000 7fe74fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe748049740 0x7fe7480cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:11.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.011+0000 7fe74fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe748049740 0x7fe7480cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53106/0 (socket says 172.21.15.90:53106) 2024-09-21T03:14:11.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.011+0000 7fe756200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe7480d3ce0 con 0x7fe748049740 2024-09-21T03:14:11.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.011+0000 7fe74fe00640 1 -- 172.21.15.90:0/2123532059 learned_addr learned my addr 172.21.15.90:0/2123532059 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:11.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.011+0000 7fe756200640 1 -- 172.21.15.90:0/2123532059 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe74800baf0 con 0x7fe74802dbd0 2024-09-21T03:14:11.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.011+0000 7fe756200640 1 -- 172.21.15.90:0/2123532059 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe7480d3e60 con 0x7fe74802d7c0 2024-09-21T03:14:11.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.012+0000 7f60e0c00640 1 -- 172.21.15.90:0/3777067501 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d4041030 con 0x7f60e406e5d0 2024-09-21T03:14:11.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.014+0000 7fe74fe00640 1 -- 172.21.15.90:0/2123532059 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe74802d7c0 msgr2=0x7fe748041b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.014+0000 7fe74fe00640 1 --2- 172.21.15.90:0/2123532059 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe74802d7c0 0x7fe748041b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.015+0000 7fe74fe00640 1 -- 172.21.15.90:0/2123532059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe74802dbd0 msgr2=0x7fe74816f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.015+0000 7fe74fe00640 1 --2- 172.21.15.90:0/2123532059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe74802dbd0 0x7fe74816f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.015+0000 7fe74fe00640 1 -- 172.21.15.90:0/2123532059 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74802cce0 con 0x7fe748049740 2024-09-21T03:14:11.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.015+0000 7fe74f400640 1 --2- 172.21.15.90:0/2123532059 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe74802d7c0 0x7fe748041b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:14:11.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.015+0000 7fe74ea00640 1 --2- 172.21.15.90:0/2123532059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe74802dbd0 0x7fe74816f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:11.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.009+0000 7fd843200640 1 -- 172.21.15.90:0/156349228 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83c02b160 con 0x7fd83c02c180 2024-09-21T03:14:11.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.009+0000 7fd843200640 1 -- 172.21.15.90:0/156349228 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd83c02b720 con 0x7fd83c02c180 2024-09-21T03:14:11.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.010+0000 7fd83a000640 1 -- 172.21.15.90:0/156349228 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd84409b060 con 0x7fd83c02c180 2024-09-21T03:14:11.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.010+0000 7fd83a000640 1 -- 172.21.15.90:0/156349228 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd84409d920 con 0x7fd83c02c180 2024-09-21T03:14:11.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.017+0000 7fd82f400640 1 -- 172.21.15.90:0/156349228 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd83c00aa30 con 0x7fd83c02c180 2024-09-21T03:14:11.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.021+0000 7f224e000640 1 -- 172.21.15.90:0/922957450 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f2258090030 con 0x7f22500429a0 2024-09-21T03:14:11.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.020+0000 7fe74fe00640 1 --2- 172.21.15.90:0/2123532059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe748049740 0x7fe7480cf1e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe75006bd50 tx=0x7fe75006a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:11.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.015+0000 7f60e0c00640 1 -- 172.21.15.90:0/3777067501 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60d4003800 con 0x7f60e406e5d0 2024-09-21T03:14:11.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.017+0000 7f60ea400640 1 -- 172.21.15.90:0/3777067501 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e415a010 con 0x7f60e406e5d0 2024-09-21T03:14:11.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.017+0000 7f60ea400640 1 -- 172.21.15.90:0/3777067501 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e40c7df0 con 0x7f60e406e5d0 2024-09-21T03:14:11.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.019+0000 7f60e0c00640 1 -- 172.21.15.90:0/3777067501 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d4003c50 con 0x7f60e406e5d0 2024-09-21T03:14:11.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.020+0000 7f60ea400640 1 -- 172.21.15.90:0/3777067501 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60e4153e60 con 0x7f60e406e5d0 2024-09-21T03:14:11.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.021+0000 7f60e0c00640 1 -- 172.21.15.90:0/3777067501 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f60d4044030 con 0x7f60e406e5d0 2024-09-21T03:14:11.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.021+0000 7f60e0c00640 1 -- 172.21.15.90:0/3777067501 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f60d403c420 con 0x7f60e406e5d0 2024-09-21T03:14:11.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.020+0000 7effad000640 1 -- 172.21.15.90:0/3090520245 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effa80c8dc0 msgr2=0x7effa8154010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.020+0000 7effad000640 1 --2- 172.21.15.90:0/3090520245 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effa80c8dc0 0x7effa8154010 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7eff98009830 tx=0x7eff9802a3f0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.020+0000 7effad000640 1 -- 172.21.15.90:0/3090520245 shutdown_connections 2024-09-21T03:14:11.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.020+0000 7effad000640 1 --2- 172.21.15.90:0/3090520245 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effa80c8dc0 0x7effa8154010 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.020+0000 7effad000640 1 --2- 172.21.15.90:0/3090520245 >> v2:172.21.15.90:3300/0 conn(0x7effa80c7560 0x7effa8157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.020+0000 7effad000640 1 -- 172.21.15.90:0/3090520245 >> 172.21.15.90:0/3090520245 conn(0x7effa80add20 msgr2=0x7effa80ae130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:11.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.020+0000 7effad000640 1 -- 172.21.15.90:0/3090520245 shutdown_connections 2024-09-21T03:14:11.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.021+0000 7effad000640 1 -- 172.21.15.90:0/3090520245 wait complete. 2024-09-21T03:14:11.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.022+0000 7f225ce00640 1 -- 172.21.15.90:0/922957450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22500429a0 msgr2=0x7f225002c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.022+0000 7f225ce00640 1 --2- 172.21.15.90:0/922957450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22500429a0 0x7f225002c680 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f225806a520 tx=0x7f225806a1d0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.023+0000 7f225ce00640 1 -- 172.21.15.90:0/922957450 shutdown_connections 2024-09-21T03:14:11.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.023+0000 7f225ce00640 1 --2- 172.21.15.90:0/922957450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22500429a0 0x7f225002c680 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.023+0000 7f225ce00640 1 --2- 172.21.15.90:0/922957450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f225000ae90 0x7f225002cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.023+0000 7f225ce00640 1 --2- 172.21.15.90:0/922957450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2250005de0 0x7f2250162130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.023+0000 7f225ce00640 1 -- 172.21.15.90:0/922957450 >> 172.21.15.90:0/922957450 conn(0x7f2250048490 msgr2=0x7f22500d3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:11.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.022+0000 7fd83a000640 1 -- 172.21.15.90:0/156349228 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd8440a3020 con 0x7fd83c02c180 2024-09-21T03:14:11.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.023+0000 7f225ce00640 1 -- 172.21.15.90:0/922957450 shutdown_connections 2024-09-21T03:14:11.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.023+0000 7f225ce00640 1 -- 172.21.15.90:0/922957450 wait complete. 2024-09-21T03:14:11.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.029+0000 7effad000640 1 Processor -- start 2024-09-21T03:14:11.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.030+0000 7effad000640 1 -- start start 2024-09-21T03:14:11.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.032+0000 7fe743400640 1 -- 172.21.15.90:0/2123532059 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe750076920 con 0x7fe748049740 2024-09-21T03:14:11.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.032+0000 7fe743400640 1 -- 172.21.15.90:0/2123532059 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe750076bb0 con 0x7fe748049740 2024-09-21T03:14:11.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.032+0000 7fe743400640 1 -- 172.21.15.90:0/2123532059 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe750076fa0 con 0x7fe748049740 2024-09-21T03:14:11.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.032+0000 7fe756200640 1 -- 172.21.15.90:0/2123532059 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe748042420 con 0x7fe748049740 2024-09-21T03:14:11.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.032+0000 7fe756200640 1 -- 172.21.15.90:0/2123532059 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7480429e0 con 0x7fe748049740 2024-09-21T03:14:11.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.034+0000 7fe756200640 1 -- 172.21.15.90:0/2123532059 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7480d37a0 con 0x7fe748049740 2024-09-21T03:14:11.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.037+0000 7f60e0c00640 1 -- 172.21.15.90:0/3777067501 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f60d4032000 con 0x7f60e406e5d0 2024-09-21T03:14:11.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.039+0000 7fc324000640 1 -- 172.21.15.90:0/3059465972 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fc31404aff0 con 0x7fc3140dda50 2024-09-21T03:14:11.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.038+0000 7effad000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effa80c7560 0x7effa814ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:11.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.038+0000 7effad000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa80c8dc0 0x7effa815a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:11.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.038+0000 7effad000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa815ac80 0x7effa8159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:11.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.039+0000 7effad000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7effa8154550 con 0x7effa80c8dc0 2024-09-21T03:14:11.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.039+0000 7effad000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7effa80cbd80 con 0x7effa815ac80 2024-09-21T03:14:11.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.039+0000 7effad000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7effa81546d0 con 0x7effa80c7560 2024-09-21T03:14:11.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.040+0000 7effa7400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effa80c7560 0x7effa814ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:11.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.040+0000 7effa7400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effa80c7560 0x7effa814ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:41644/0 (socket says 172.21.15.90:41644) 2024-09-21T03:14:11.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.040+0000 7effa7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa815ac80 0x7effa8159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:11.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.040+0000 7effa7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa815ac80 0x7effa8159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:45226/0 (socket says 172.21.15.90:45226) 2024-09-21T03:14:11.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.040+0000 7effa7e00640 1 -- 172.21.15.90:0/3116163582 learned_addr learned my addr 172.21.15.90:0/3116163582 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:11.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.040+0000 7effa6a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa80c8dc0 0x7effa815a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:11.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.042+0000 7effa6a00640 1 -- 172.21.15.90:0/3116163582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effa80c7560 msgr2=0x7effa814ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.043+0000 7effa6a00640 1 --2- 172.21.15.90:0/3116163582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effa80c7560 0x7effa814ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.043+0000 7effa7400640 1 --2- 172.21.15.90:0/3116163582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effa80c7560 0x7effa814ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-21T03:14:11.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.043+0000 7effa6a00640 1 -- 172.21.15.90:0/3116163582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa815ac80 msgr2=0x7effa8159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.043+0000 7effa6a00640 1 --2- 172.21.15.90:0/3116163582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa815ac80 0x7effa8159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.043+0000 7effa6a00640 1 -- 172.21.15.90:0/3116163582 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa81f0ea0 con 0x7effa80c8dc0 2024-09-21T03:14:11.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.043+0000 7effa7e00640 1 --2- 172.21.15.90:0/3116163582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa815ac80 0x7effa8159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:14:11.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.040+0000 7fe743400640 1 -- 172.21.15.90:0/2123532059 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe750094400 con 0x7fe748049740 2024-09-21T03:14:11.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.040+0000 7fe743400640 1 -- 172.21.15.90:0/2123532059 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe75009d800 con 0x7fe748049740 2024-09-21T03:14:11.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.044+0000 7effa6a00640 1 --2- 172.21.15.90:0/3116163582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa80c8dc0 0x7effa815a740 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7eff98031000 tx=0x7eff98033f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:11.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.049+0000 7fe743400640 1 -- 172.21.15.90:0/2123532059 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe7500a2020 con 0x7fe748049740 2024-09-21T03:14:11.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.049+0000 7eff9f400640 1 -- 172.21.15.90:0/3116163582 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff98031d60 con 0x7effa80c8dc0 2024-09-21T03:14:11.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.049+0000 7effad000640 1 -- 172.21.15.90:0/3116163582 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa81e24b0 con 0x7effa80c8dc0 2024-09-21T03:14:11.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.050+0000 7effad000640 1 -- 172.21.15.90:0/3116163582 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa81e2a70 con 0x7effa80c8dc0 2024-09-21T03:14:11.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.051+0000 7f559be00640 1 -- 172.21.15.90:0/21465973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f559c0b2150 con 0x7f559c0c8dc0 2024-09-21T03:14:11.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.056+0000 7eff9f400640 1 -- 172.21.15.90:0/3116163582 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff98031770 con 0x7effa80c8dc0 2024-09-21T03:14:11.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.056+0000 7effad000640 1 -- 172.21.15.90:0/3116163582 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa80b2150 con 0x7effa80c8dc0 2024-09-21T03:14:11.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.060+0000 7fc319600640 1 -- 172.21.15.90:0/3059465972 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v17)=0 v17) ==== 120+0+0 (secure 0 0 0) 0x7fc3140d9c50 con 0x7fc3140dda50 2024-09-21T03:14:11.064 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi090') 2024-09-21T03:14:11.064 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi090') 2024-09-21T03:14:11.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.063+0000 7fc324000640 1 -- 172.21.15.90:0/3059465972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3140dda50 msgr2=0x7fc314180790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.063+0000 7fc324000640 1 --2- 172.21.15.90:0/3059465972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3140dda50 0x7fc314180790 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc31000e9c0 tx=0x7fc31000ee80 comp rx=0 tx=0).stop 2024-09-21T03:14:11.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.064+0000 7fc324000640 1 -- 172.21.15.90:0/3059465972 shutdown_connections 2024-09-21T03:14:11.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.064+0000 7fc324000640 1 --2- 172.21.15.90:0/3059465972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3140de3a0 0x7fc314040ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.064+0000 7fc324000640 1 --2- 172.21.15.90:0/3059465972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3140dda50 0x7fc314180790 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.064+0000 7fc324000640 1 --2- 172.21.15.90:0/3059465972 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc31404aa10 0x7fc3140dfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.064+0000 7fc324000640 1 -- 172.21.15.90:0/3059465972 >> 172.21.15.90:0/3059465972 conn(0x7fc3140484b0 msgr2=0x7fc3140dc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:11.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.064+0000 7fc324000640 1 -- 172.21.15.90:0/3059465972 shutdown_connections 2024-09-21T03:14:11.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.064+0000 7fc324000640 1 -- 172.21.15.90:0/3059465972 wait complete. 2024-09-21T03:14:11.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.063+0000 7eff9f400640 1 -- 172.21.15.90:0/3116163582 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff98048060 con 0x7effa80c8dc0 2024-09-21T03:14:11.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.067+0000 7eff9f400640 1 -- 172.21.15.90:0/3116163582 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7eff980047a0 con 0x7effa80c8dc0 2024-09-21T03:14:11.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.067+0000 7eff9f400640 1 -- 172.21.15.90:0/3116163582 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7eff98033570 con 0x7effa80c8dc0 2024-09-21T03:14:11.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.068+0000 7eff9f400640 1 -- 172.21.15.90:0/3116163582 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7eff9803f070 con 0x7effa80c8dc0 2024-09-21T03:14:11.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.068+0000 7fe007200640 1 -- 172.21.15.90:0/3300014727 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fdfe0005850 con 0x7fe0080730e0 2024-09-21T03:14:11.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.077+0000 7f5592a00640 1 -- 172.21.15.90:0/21465973 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v18)=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f5584051070 con 0x7f559c0c8dc0 2024-09-21T03:14:11.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.083+0000 7f559be00640 1 -- 172.21.15.90:0/21465973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f559c0c8dc0 msgr2=0x7f559c14e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.083+0000 7f559be00640 1 --2- 172.21.15.90:0/21465973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f559c0c8dc0 0x7f559c14e2e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5584031000 tx=0x7f5584033c20 comp rx=0 tx=0).stop 2024-09-21T03:14:11.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.083+0000 7f559be00640 1 -- 172.21.15.90:0/21465973 shutdown_connections 2024-09-21T03:14:11.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.083+0000 7f559be00640 1 --2- 172.21.15.90:0/21465973 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f559c15ad40 0x7f559c1500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.083+0000 7f559be00640 1 --2- 172.21.15.90:0/21465973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f559c0c8dc0 0x7f559c14e2e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.083+0000 7f559be00640 1 --2- 172.21.15.90:0/21465973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f559c0c7560 0x7f559c15a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.083+0000 7f559be00640 1 -- 172.21.15.90:0/21465973 >> 172.21.15.90:0/21465973 conn(0x7f559c0add20 msgr2=0x7f559c0c6020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:11.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.083+0000 7f559be00640 1 -- 172.21.15.90:0/21465973 shutdown_connections 2024-09-21T03:14:11.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.084+0000 7f559be00640 1 -- 172.21.15.90:0/21465973 wait complete. 2024-09-21T03:14:11.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.090+0000 7fdffe000640 1 -- 172.21.15.90:0/3300014727 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v19)=0 v19) ==== 106+0+0 (secure 0 0 0) 0x7fdff80053b0 con 0x7fe0080730e0 2024-09-21T03:14:11.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.110+0000 7fe007200640 1 -- 172.21.15.90:0/3300014727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0080730e0 msgr2=0x7fe0080c71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.111+0000 7fe007200640 1 --2- 172.21.15.90:0/3300014727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0080730e0 0x7fe0080c71f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdff80077e0 tx=0x7fdff8007ca0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.112+0000 7fe007200640 1 -- 172.21.15.90:0/3300014727 shutdown_connections 2024-09-21T03:14:11.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.112+0000 7fe007200640 1 --2- 172.21.15.90:0/3300014727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe008073a20 0x7fe0081ddcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.112+0000 7fe007200640 1 --2- 172.21.15.90:0/3300014727 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe008073610 0x7fe0081dc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.112+0000 7fe007200640 1 --2- 172.21.15.90:0/3300014727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0080730e0 0x7fe0080c71f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.112+0000 7fe007200640 1 -- 172.21.15.90:0/3300014727 >> 172.21.15.90:0/3300014727 conn(0x7fe0080c80a0 msgr2=0x7fe0081514d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:11.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.112+0000 7fe007200640 1 -- 172.21.15.90:0/3300014727 shutdown_connections 2024-09-21T03:14:11.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.113+0000 7fe007200640 1 -- 172.21.15.90:0/3300014727 wait complete. 2024-09-21T03:14:11.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.114+0000 7f2711600640 1 -- 172.21.15.90:0/3292846945 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f26f0005580 con 0x7f271c155640 2024-09-21T03:14:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.125+0000 7f2713e00640 1 -- 172.21.15.90:0/3292846945 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v20)=0 v20) ==== 119+0+0 (secure 0 0 0) 0x7f271403c9e0 con 0x7f271c155640 2024-09-21T03:14:11.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.130+0000 7f2721c00640 1 -- 172.21.15.90:0/3292846945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f271c155640 msgr2=0x7f271c1ee650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.130+0000 7f2721c00640 1 --2- 172.21.15.90:0/3292846945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f271c155640 0x7f271c1ee650 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2714009000 tx=0x7f2714004270 comp rx=0 tx=0).stop 2024-09-21T03:14:11.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.134+0000 7f2721c00640 1 -- 172.21.15.90:0/3292846945 shutdown_connections 2024-09-21T03:14:11.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.134+0000 7f2721c00640 1 --2- 172.21.15.90:0/3292846945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f271c155640 0x7f271c1ee650 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.134+0000 7f2721c00640 1 --2- 172.21.15.90:0/3292846945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f271c0adf00 0x7f271c14daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.134+0000 7f2721c00640 1 --2- 172.21.15.90:0/3292846945 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f271c0abc40 0x7f271c14d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.134+0000 7f2721c00640 1 -- 172.21.15.90:0/3292846945 >> 172.21.15.90:0/3292846945 conn(0x7f271c0c80a0 msgr2=0x7f271c0c7140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:11.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.135+0000 7fa3eb200640 1 -- 172.21.15.90:0/824790077 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fa3e40d1100 con 0x7fa3e404ab80 2024-09-21T03:14:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.138+0000 7f2721c00640 1 -- 172.21.15.90:0/3292846945 shutdown_connections 2024-09-21T03:14:11.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.138+0000 7f2721c00640 1 -- 172.21.15.90:0/3292846945 wait complete. 2024-09-21T03:14:11.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.146+0000 7fa3e2000640 1 -- 172.21.15.90:0/824790077 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7fa3d8005dc0 con 0x7fa3e404ab80 2024-09-21T03:14:11.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.148+0000 7fa3eb200640 1 -- 172.21.15.90:0/824790077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3e404ab80 msgr2=0x7fa3e40d5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.148+0000 7fa3eb200640 1 --2- 172.21.15.90:0/824790077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3e404ab80 0x7fa3e40d5240 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009850 tx=0x7fa3d8004a50 comp rx=0 tx=0).stop 2024-09-21T03:14:11.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.149+0000 7fa3eb200640 1 -- 172.21.15.90:0/824790077 shutdown_connections 2024-09-21T03:14:11.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.149+0000 7fa3eb200640 1 --2- 172.21.15.90:0/824790077 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3e40cd0b0 0x7fa3e40cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.149+0000 7fa3eb200640 1 --2- 172.21.15.90:0/824790077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3e40d3110 0x7fa3e4177ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.149+0000 7fa3eb200640 1 --2- 172.21.15.90:0/824790077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3e404ab80 0x7fa3e40d5240 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.149+0000 7fa3eb200640 1 -- 172.21.15.90:0/824790077 >> 172.21.15.90:0/824790077 conn(0x7fa3e404c8a0 msgr2=0x7fa3e40d3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:11.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.149+0000 7fa3eb200640 1 -- 172.21.15.90:0/824790077 shutdown_connections 2024-09-21T03:14:11.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.149+0000 7fa3eb200640 1 -- 172.21.15.90:0/824790077 wait complete. 2024-09-21T03:14:11.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.159+0000 7f33a2400640 1 -- 172.21.15.90:0/838922283 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f3374005850 con 0x7f339c15c400 2024-09-21T03:14:11.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.165+0000 7f3393400640 1 -- 172.21.15.90:0/838922283 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v22)=0 v22) ==== 111+0+0 (secure 0 0 0) 0x7f339403f030 con 0x7f339c15c400 2024-09-21T03:14:11.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.167+0000 7f33a2400640 1 -- 172.21.15.90:0/838922283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f339c15c400 msgr2=0x7f339c157530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.167+0000 7f33a2400640 1 --2- 172.21.15.90:0/838922283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f339c15c400 0x7f339c157530 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f339402aea0 tx=0x7f3394003ba0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.171+0000 7f33a2400640 1 -- 172.21.15.90:0/838922283 shutdown_connections 2024-09-21T03:14:11.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.171+0000 7f33a2400640 1 --2- 172.21.15.90:0/838922283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f339c15c400 0x7f339c157530 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.171+0000 7f33a2400640 1 --2- 172.21.15.90:0/838922283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f339c152a80 0x7f339c0bd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.171+0000 7f33a2400640 1 --2- 172.21.15.90:0/838922283 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f339c14fe60 0x7f339c156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.171+0000 7f33a2400640 1 -- 172.21.15.90:0/838922283 >> 172.21.15.90:0/838922283 conn(0x7f339c0c80a0 msgr2=0x7f339c070160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:11.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.171+0000 7f33a2400640 1 -- 172.21.15.90:0/838922283 shutdown_connections 2024-09-21T03:14:11.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.172+0000 7f33a2400640 1 -- 172.21.15.90:0/838922283 wait complete. 2024-09-21T03:14:11.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.172+0000 7f095b400640 1 -- 172.21.15.90:0/3614724976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f0948005580 con 0x7f09700730e0 2024-09-21T03:14:11.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.183+0000 7f0966000640 1 -- 172.21.15.90:0/3614724976 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f0960003d20 con 0x7f09700730e0 2024-09-21T03:14:11.187 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi090') 2024-09-21T03:14:11.187 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi090') 2024-09-21T03:14:11.188 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi090') 2024-09-21T03:14:11.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.186+0000 7f095b400640 1 -- 172.21.15.90:0/3614724976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09700730e0 msgr2=0x7f097014bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.186+0000 7f095b400640 1 --2- 172.21.15.90:0/3614724976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09700730e0 0x7f097014bcf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f096000c340 tx=0x7f096000c800 comp rx=0 tx=0).stop 2024-09-21T03:14:11.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.187+0000 7f095b400640 1 -- 172.21.15.90:0/3614724976 shutdown_connections 2024-09-21T03:14:11.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.187+0000 7f095b400640 1 --2- 172.21.15.90:0/3614724976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0970152d80 0x7f0970145b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.187+0000 7f095b400640 1 --2- 172.21.15.90:0/3614724976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0970073610 0x7f09701497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.187+0000 7f095b400640 1 --2- 172.21.15.90:0/3614724976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09700730e0 0x7f097014bcf0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.187+0000 7f095b400640 1 -- 172.21.15.90:0/3614724976 >> 172.21.15.90:0/3614724976 conn(0x7f09700c80a0 msgr2=0x7f09700c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:11.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.187+0000 7f095b400640 1 -- 172.21.15.90:0/3614724976 shutdown_connections 2024-09-21T03:14:11.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.188+0000 7f095b400640 1 -- 172.21.15.90:0/3614724976 wait complete. 2024-09-21T03:14:11.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.205+0000 7fe756200640 1 -- 172.21.15.90:0/2123532059 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fe74804aeb0 con 0x7fe748049740 2024-09-21T03:14:11.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.208+0000 7f60ea400640 1 -- 172.21.15.90:0/3777067501 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f60e40adec0 con 0x7f60e406e5d0 2024-09-21T03:14:11.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.210+0000 7fe743400640 1 -- 172.21.15.90:0/2123532059 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v24)=0 v24) ==== 120+0+0 (secure 0 0 0) 0x7fe750090030 con 0x7fe748049740 2024-09-21T03:14:11.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.213+0000 7fe756200640 1 -- 172.21.15.90:0/2123532059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe748049740 msgr2=0x7fe7480cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.213+0000 7fe756200640 1 --2- 172.21.15.90:0/2123532059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe748049740 0x7fe7480cf1e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe75006bd50 tx=0x7fe75006a1d0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.213+0000 7fe756200640 1 -- 172.21.15.90:0/2123532059 shutdown_connections 2024-09-21T03:14:11.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.213+0000 7fe756200640 1 --2- 172.21.15.90:0/2123532059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe748049740 0x7fe7480cf1e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.213+0000 7fe756200640 1 --2- 172.21.15.90:0/2123532059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe74802dbd0 0x7fe74816f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.213+0000 7fe756200640 1 --2- 172.21.15.90:0/2123532059 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe74802d7c0 0x7fe748041b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.213+0000 7fe756200640 1 -- 172.21.15.90:0/2123532059 >> 172.21.15.90:0/2123532059 conn(0x7fe748048650 msgr2=0x7fe7480d6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:11.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.214+0000 7fe756200640 1 -- 172.21.15.90:0/2123532059 shutdown_connections 2024-09-21T03:14:11.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.214+0000 7fe756200640 1 -- 172.21.15.90:0/2123532059 wait complete. 2024-09-21T03:14:11.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.214+0000 7f60e0c00640 1 -- 172.21.15.90:0/3777067501 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v25)=0 v25) ==== 119+0+0 (secure 0 0 0) 0x7f60d4003df0 con 0x7f60e406e5d0 2024-09-21T03:14:11.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.215+0000 7f60ea400640 1 -- 172.21.15.90:0/3777067501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60e406e5d0 msgr2=0x7f60e40ad190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.215+0000 7f60ea400640 1 --2- 172.21.15.90:0/3777067501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60e406e5d0 0x7f60e40ad190 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009950 tx=0x7f60d4032cd0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.216+0000 7f60ea400640 1 -- 172.21.15.90:0/3777067501 shutdown_connections 2024-09-21T03:14:11.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.216+0000 7f60ea400640 1 --2- 172.21.15.90:0/3777067501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40ada50 0x7f60e413b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.216+0000 7f60ea400640 1 --2- 172.21.15.90:0/3777067501 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60e4073a90 0x7f60e40abe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.216+0000 7f60ea400640 1 --2- 172.21.15.90:0/3777067501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60e406e5d0 0x7f60e40ad190 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.216+0000 7f60ea400640 1 -- 172.21.15.90:0/3777067501 >> 172.21.15.90:0/3777067501 conn(0x7f60e40c80a0 msgr2=0x7f60e40c3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:11.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.216+0000 7f60ea400640 1 -- 172.21.15.90:0/3777067501 shutdown_connections 2024-09-21T03:14:11.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.216+0000 7f60ea400640 1 -- 172.21.15.90:0/3777067501 wait complete. 2024-09-21T03:14:11.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.233+0000 7fd82f400640 1 -- 172.21.15.90:0/156349228 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fd83c00b430 con 0x7fd83c02c180 2024-09-21T03:14:11.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.239+0000 7fd83a000640 1 -- 172.21.15.90:0/156349228 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v26)=0 v26) ==== 125+0+0 (secure 0 0 0) 0x7fd84409db20 con 0x7fd83c02c180 2024-09-21T03:14:11.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.241+0000 7fd82f400640 1 -- 172.21.15.90:0/156349228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd83c02c180 msgr2=0x7fd83c041b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.241+0000 7fd82f400640 1 --2- 172.21.15.90:0/156349228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd83c02c180 0x7fd83c041b20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd84406c380 tx=0x7fd844069e00 comp rx=0 tx=0).stop 2024-09-21T03:14:11.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.241+0000 7fd82f400640 1 -- 172.21.15.90:0/156349228 shutdown_connections 2024-09-21T03:14:11.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.241+0000 7fd82f400640 1 --2- 172.21.15.90:0/156349228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd83c02c180 0x7fd83c041b20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.241+0000 7fd82f400640 1 --2- 172.21.15.90:0/156349228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd83c0454b0 0x7fd83c0415e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.241+0000 7fd82f400640 1 --2- 172.21.15.90:0/156349228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8280042e0 0x7fd83c02bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.241+0000 7fd82f400640 1 -- 172.21.15.90:0/156349228 >> 172.21.15.90:0/156349228 conn(0x7fd83c048450 msgr2=0x7fd83c0d50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:11.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.241+0000 7fd82f400640 1 -- 172.21.15.90:0/156349228 shutdown_connections 2024-09-21T03:14:11.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.241+0000 7fd82f400640 1 -- 172.21.15.90:0/156349228 wait complete. 2024-09-21T03:14:11.245 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi090') 2024-09-21T03:14:11.251 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi090') 2024-09-21T03:14:11.251 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi090') 2024-09-21T03:14:11.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.249+0000 7effad000640 1 -- 172.21.15.90:0/3116163582 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7effa80c6e80 con 0x7effa80c8dc0 2024-09-21T03:14:11.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.253+0000 7eff9f400640 1 -- 172.21.15.90:0/3116163582 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v27)=0 v27) ==== 108+0+0 (secure 0 0 0) 0x7eff98004a90 con 0x7effa80c8dc0 2024-09-21T03:14:11.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.254+0000 7effad000640 1 -- 172.21.15.90:0/3116163582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa80c8dc0 msgr2=0x7effa815a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.254+0000 7effad000640 1 --2- 172.21.15.90:0/3116163582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa80c8dc0 0x7effa815a740 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7eff98031000 tx=0x7eff98033f90 comp rx=0 tx=0).stop 2024-09-21T03:14:11.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.254+0000 7effad000640 1 -- 172.21.15.90:0/3116163582 shutdown_connections 2024-09-21T03:14:11.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.254+0000 7effad000640 1 --2- 172.21.15.90:0/3116163582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa815ac80 0x7effa8159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.254+0000 7effad000640 1 --2- 172.21.15.90:0/3116163582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa80c8dc0 0x7effa815a740 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.254+0000 7effad000640 1 --2- 172.21.15.90:0/3116163582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effa80c7560 0x7effa814ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.254+0000 7effad000640 1 -- 172.21.15.90:0/3116163582 >> 172.21.15.90:0/3116163582 conn(0x7effa80add20 msgr2=0x7effa806e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:11.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.254+0000 7effad000640 1 -- 172.21.15.90:0/3116163582 shutdown_connections 2024-09-21T03:14:11.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.256+0000 7effad000640 1 -- 172.21.15.90:0/3116163582 wait complete. 2024-09-21T03:14:11.282 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi090') 2024-09-21T03:14:11.282 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi090') 2024-09-21T03:14:11.282 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi090') 2024-09-21T03:14:11.283 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi090') 2024-09-21T03:14:11.283 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config dump 2024-09-21T03:14:11.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.539+0000 7fd14fe00640 1 -- 172.21.15.90:0/3983704616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd15006e380 msgr2=0x7fd1501625b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.539+0000 7fd14fe00640 1 --2- 172.21.15.90:0/3983704616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd15006e380 0x7fd1501625b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd148005fd0 tx=0x7fd14802a940 comp rx=0 tx=0).stop 2024-09-21T03:14:11.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.539+0000 7fd14fe00640 1 -- 172.21.15.90:0/3983704616 shutdown_connections 2024-09-21T03:14:11.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.539+0000 7fd14fe00640 1 --2- 172.21.15.90:0/3983704616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd15006e380 0x7fd1501625b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.539+0000 7fd14fe00640 1 -- 172.21.15.90:0/3983704616 >> 172.21.15.90:0/3983704616 conn(0x7fd1500c8d90 msgr2=0x7fd1500c91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:11.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.539+0000 7fd14fe00640 1 -- 172.21.15.90:0/3983704616 shutdown_connections 2024-09-21T03:14:11.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.540+0000 7fd14fe00640 1 -- 172.21.15.90:0/3983704616 wait complete. 2024-09-21T03:14:11.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.542+0000 7fd14fe00640 1 Processor -- start 2024-09-21T03:14:11.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.542+0000 7fd14fe00640 1 -- start start 2024-09-21T03:14:11.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.543+0000 7fd14fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd15006e380 0x7fd1500c11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:11.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.543+0000 7fd14fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1500c7900 0x7fd1501f0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:11.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.543+0000 7fd14fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1501545f0 0x7fd1501524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:11.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.543+0000 7fd14fe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd1500c8780 con 0x7fd15006e380 2024-09-21T03:14:11.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.543+0000 7fd14fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd1500c7150 con 0x7fd1501545f0 2024-09-21T03:14:11.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.543+0000 7fd14fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd150157b10 con 0x7fd1500c7900 2024-09-21T03:14:11.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.543+0000 7fd14ea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd15006e380 0x7fd1500c11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:11.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.543+0000 7fd14ea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd15006e380 0x7fd1500c11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53134/0 (socket says 172.21.15.90:53134) 2024-09-21T03:14:11.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.543+0000 7fd14ea00640 1 -- 172.21.15.90:0/2583542579 learned_addr learned my addr 172.21.15.90:0/2583542579 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:11.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.544+0000 7fd14f400640 1 --2- 172.21.15.90:0/2583542579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1501545f0 0x7fd1501524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:11.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.544+0000 7fd14ea00640 1 -- 172.21.15.90:0/2583542579 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1500c7900 msgr2=0x7fd1501f0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.544+0000 7fd14ea00640 1 --2- 172.21.15.90:0/2583542579 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1500c7900 0x7fd1501f0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.544+0000 7fd14ea00640 1 -- 172.21.15.90:0/2583542579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1501545f0 msgr2=0x7fd1501524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.544+0000 7fd14ea00640 1 --2- 172.21.15.90:0/2583542579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1501545f0 0x7fd1501524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.544+0000 7fd14ea00640 1 -- 172.21.15.90:0/2583542579 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1500c5c50 con 0x7fd15006e380 2024-09-21T03:14:11.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.544+0000 7fd14ea00640 1 --2- 172.21.15.90:0/2583542579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd15006e380 0x7fd1500c11d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd14000c3f0 tx=0x7fd14000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:11.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.544+0000 7fd146a00640 1 -- 172.21.15.90:0/2583542579 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd140017070 con 0x7fd15006e380 2024-09-21T03:14:11.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.544+0000 7fd146a00640 1 -- 172.21.15.90:0/2583542579 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1400035f0 con 0x7fd15006e380 2024-09-21T03:14:11.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.544+0000 7fd14fe00640 1 -- 172.21.15.90:0/2583542579 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1500c1710 con 0x7fd15006e380 2024-09-21T03:14:11.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.545+0000 7fd146a00640 1 -- 172.21.15.90:0/2583542579 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd140003a40 con 0x7fd15006e380 2024-09-21T03:14:11.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.545+0000 7fd14fe00640 1 -- 172.21.15.90:0/2583542579 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1500c55d0 con 0x7fd15006e380 2024-09-21T03:14:11.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.545+0000 7fd146a00640 1 -- 172.21.15.90:0/2583542579 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd14001a070 con 0x7fd15006e380 2024-09-21T03:14:11.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.545+0000 7fd146a00640 1 -- 172.21.15.90:0/2583542579 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd140012cf0 con 0x7fd15006e380 2024-09-21T03:14:11.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.546+0000 7fd14fe00640 1 -- 172.21.15.90:0/2583542579 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1500c6e00 con 0x7fd15006e380 2024-09-21T03:14:11.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.548+0000 7fd146a00640 1 -- 172.21.15.90:0/2583542579 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd140012400 con 0x7fd15006e380 2024-09-21T03:14:11.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.610+0000 7fd14fe00640 1 -- 172.21.15.90:0/2583542579 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fd1500c2840 con 0x7fd15006e380 2024-09-21T03:14:11.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.610+0000 7fd146a00640 1 -- 172.21.15.90:0/2583542579 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v27) ==== 59+0+1782 (secure 0 0 0) 0x7fd1400125e0 con 0x7fd15006e380 2024-09-21T03:14:11.612 INFO:teuthology.orchestra.run.smithi090.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T03:14:11.612 INFO:teuthology.orchestra.run.smithi090.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T03:14:11.612 INFO:teuthology.orchestra.run.smithi090.stdout:mgr advanced client_mount_timeout 30 2024-09-21T03:14:11.612 INFO:teuthology.orchestra.run.smithi090.stdout:mgr advanced debug_client 20/20 2024-09-21T03:14:11.612 INFO:teuthology.orchestra.run.smithi090.stdout:mgr advanced debug_mgr 20/20 2024-09-21T03:14:11.612 INFO:teuthology.orchestra.run.smithi090.stdout:mgr advanced debug_ms 1/1 2024-09-21T03:14:11.613 INFO:teuthology.orchestra.run.smithi090.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T03:14:11.613 INFO:teuthology.orchestra.run.smithi090.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T03:14:11.613 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_mds 20/20 2024-09-21T03:14:11.613 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T03:14:11.613 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_ms 2/2 2024-09-21T03:14:11.613 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T03:14:11.613 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T03:14:11.613 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T03:14:11.613 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced mds_bal_split_size 100 2024-09-21T03:14:11.613 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_debug_frag true 2024-09-21T03:14:11.613 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_debug_scatterstat true 2024-09-21T03:14:11.613 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T03:14:11.613 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_verify_scatter true 2024-09-21T03:14:11.613 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T03:14:11.614 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T03:14:11.614 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T03:14:11.614 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced client_mount_timeout 600 2024-09-21T03:14:11.614 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced debug_client 20/20 2024-09-21T03:14:11.614 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced debug_ms 1/1 2024-09-21T03:14:11.614 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T03:14:11.614 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T03:14:11.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.611+0000 7fd14fe00640 1 -- 172.21.15.90:0/2583542579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd15006e380 msgr2=0x7fd1500c11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.611+0000 7fd14fe00640 1 --2- 172.21.15.90:0/2583542579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd15006e380 0x7fd1500c11d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd14000c3f0 tx=0x7fd14000c8b0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.611+0000 7fd14fe00640 1 -- 172.21.15.90:0/2583542579 shutdown_connections 2024-09-21T03:14:11.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.611+0000 7fd14fe00640 1 --2- 172.21.15.90:0/2583542579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1501545f0 0x7fd1501524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.611+0000 7fd14fe00640 1 --2- 172.21.15.90:0/2583542579 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1500c7900 0x7fd1501f0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.611+0000 7fd14fe00640 1 --2- 172.21.15.90:0/2583542579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd15006e380 0x7fd1500c11d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.611+0000 7fd14fe00640 1 -- 172.21.15.90:0/2583542579 >> 172.21.15.90:0/2583542579 conn(0x7fd1500c8d90 msgr2=0x7fd150158ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:11.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.611+0000 7fd14fe00640 1 -- 172.21.15.90:0/2583542579 shutdown_connections 2024-09-21T03:14:11.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.611+0000 7fd14fe00640 1 -- 172.21.15.90:0/2583542579 wait complete. 2024-09-21T03:14:11.636 INFO:tasks.ceph:Setting crush tunables to default 2024-09-21T03:14:11.636 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd crush tunables default 2024-09-21T03:14:11.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.852+0000 7f834e400640 1 -- 172.21.15.90:0/2237999787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83480c5130 msgr2=0x7f83480c7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.852+0000 7f834e400640 1 --2- 172.21.15.90:0/2237999787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83480c5130 0x7f83480c7120 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8340005fd0 tx=0x7f834002aa00 comp rx=0 tx=0).stop 2024-09-21T03:14:11.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.853+0000 7f834e400640 1 -- 172.21.15.90:0/2237999787 shutdown_connections 2024-09-21T03:14:11.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.853+0000 7f834e400640 1 --2- 172.21.15.90:0/2237999787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83480c5130 0x7f83480c7120 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.853+0000 7f834e400640 1 --2- 172.21.15.90:0/2237999787 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83480aff90 0x7f83480c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.853+0000 7f834e400640 1 -- 172.21.15.90:0/2237999787 >> 172.21.15.90:0/2237999787 conn(0x7f83480ac330 msgr2=0x7f83480ac740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:11.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.853+0000 7f834e400640 1 -- 172.21.15.90:0/2237999787 shutdown_connections 2024-09-21T03:14:11.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.853+0000 7f834e400640 1 -- 172.21.15.90:0/2237999787 wait complete. 2024-09-21T03:14:11.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.855+0000 7f834e400640 1 Processor -- start 2024-09-21T03:14:11.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.855+0000 7f834e400640 1 -- start start 2024-09-21T03:14:11.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.856+0000 7f834e400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83480aff90 0x7f8348149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.856+0000 7f834e400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83480c5130 0x7f8348154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.856+0000 7f834e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83481522b0 0x7f8348148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.856+0000 7f834e400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f83480c5540 con 0x7f83480c5130 2024-09-21T03:14:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.856+0000 7f834e400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f83481526c0 con 0x7f83480aff90 2024-09-21T03:14:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.856+0000 7f834e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f83480c56c0 con 0x7f83481522b0 2024-09-21T03:14:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.857+0000 7f833fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83480c5130 0x7f8348154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.857+0000 7f8347400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83480aff90 0x7f8348149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.857+0000 7f833fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83480c5130 0x7f8348154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53146/0 (socket says 172.21.15.90:53146) 2024-09-21T03:14:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.857+0000 7f833fe00640 1 -- 172.21.15.90:0/1229429057 learned_addr learned my addr 172.21.15.90:0/1229429057 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.857+0000 7f8347e00640 1 --2- 172.21.15.90:0/1229429057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83481522b0 0x7f8348148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.857+0000 7f833fe00640 1 -- 172.21.15.90:0/1229429057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83481522b0 msgr2=0x7f8348148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.857+0000 7f833fe00640 1 --2- 172.21.15.90:0/1229429057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83481522b0 0x7f8348148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.857+0000 7f833fe00640 1 -- 172.21.15.90:0/1229429057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83480aff90 msgr2=0x7f8348149ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.857+0000 7f833fe00640 1 --2- 172.21.15.90:0/1229429057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83480aff90 0x7f8348149ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.857+0000 7f833fe00640 1 -- 172.21.15.90:0/1229429057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8348154f60 con 0x7f83480c5130 2024-09-21T03:14:11.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.857+0000 7f8347400640 1 --2- 172.21.15.90:0/1229429057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83480aff90 0x7f8348149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:14:11.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.857+0000 7f833fe00640 1 --2- 172.21.15.90:0/1229429057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83480c5130 0x7f8348154a20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f833000c3f0 tx=0x7f833000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:11.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.858+0000 7f833f400640 1 -- 172.21.15.90:0/1229429057 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8330017070 con 0x7f83480c5130 2024-09-21T03:14:11.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.858+0000 7f833f400640 1 -- 172.21.15.90:0/1229429057 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83300053c0 con 0x7f83480c5130 2024-09-21T03:14:11.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.858+0000 7f833f400640 1 -- 172.21.15.90:0/1229429057 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8330003850 con 0x7f83480c5130 2024-09-21T03:14:11.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.858+0000 7f834e400640 1 -- 172.21.15.90:0/1229429057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83481ebeb0 con 0x7f83480c5130 2024-09-21T03:14:11.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.858+0000 7f834e400640 1 -- 172.21.15.90:0/1229429057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83481553c0 con 0x7f83480c5130 2024-09-21T03:14:11.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.858+0000 7f833f400640 1 -- 172.21.15.90:0/1229429057 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f833001a070 con 0x7f83480c5130 2024-09-21T03:14:11.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.858+0000 7f833f400640 1 -- 172.21.15.90:0/1229429057 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f833001c440 con 0x7f83480c5130 2024-09-21T03:14:11.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.859+0000 7f834e400640 1 -- 172.21.15.90:0/1229429057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83480c5910 con 0x7f83480c5130 2024-09-21T03:14:11.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.861+0000 7f833f400640 1 -- 172.21.15.90:0/1229429057 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8330021020 con 0x7f83480c5130 2024-09-21T03:14:11.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.929+0000 7f834e400640 1 -- 172.21.15.90:0/1229429057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f83480acbe0 con 0x7f83480c5130 2024-09-21T03:14:11.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.931+0000 7f833f400640 1 -- 172.21.15.90:0/1229429057 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f8330011590 con 0x7f83480c5130 2024-09-21T03:14:11.933 INFO:teuthology.orchestra.run.smithi090.stderr:adjusted tunables profile to default 2024-09-21T03:14:11.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.932+0000 7f834e400640 1 -- 172.21.15.90:0/1229429057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83480c5130 msgr2=0x7f8348154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:11.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.932+0000 7f834e400640 1 --2- 172.21.15.90:0/1229429057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83480c5130 0x7f8348154a20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f833000c3f0 tx=0x7f833000c8b0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.932+0000 7f834e400640 1 -- 172.21.15.90:0/1229429057 shutdown_connections 2024-09-21T03:14:11.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.932+0000 7f834e400640 1 --2- 172.21.15.90:0/1229429057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83481522b0 0x7f8348148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.932+0000 7f834e400640 1 --2- 172.21.15.90:0/1229429057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83480c5130 0x7f8348154a20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.932+0000 7f834e400640 1 --2- 172.21.15.90:0/1229429057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83480aff90 0x7f8348149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:11.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.933+0000 7f834e400640 1 -- 172.21.15.90:0/1229429057 >> 172.21.15.90:0/1229429057 conn(0x7f83480ac330 msgr2=0x7f83480ae8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:11.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.933+0000 7f834e400640 1 -- 172.21.15.90:0/1229429057 shutdown_connections 2024-09-21T03:14:11.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:11.933+0000 7f834e400640 1 -- 172.21.15.90:0/1229429057 wait complete. 2024-09-21T03:14:11.959 INFO:tasks.ceph:check_enable_crimson: False 2024-09-21T03:14:11.959 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-21T03:14:11.959 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:14:11.959 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-21T03:14:12.014 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:14:12.014 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-21T03:14:12.110 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:14:12.239 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-21T03:14:12.295 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:14:12.296 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-21T03:14:12.391 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:14:12.391 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-21T03:14:12.448 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:14:12.448 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-21T03:14:12.544 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:14:12.545 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-21T03:14:12.641 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:14:12.641 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-21T03:14:12.737 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new ceaacfab-e71c-45e2-ac50-4597dfd460bb 0 2024-09-21T03:14:12.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:12.995+0000 7fb5dce00640 1 -- 172.21.15.149:0/818499015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5d806f250 msgr2=0x7fb5d8156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:12.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:12.995+0000 7fb5dce00640 1 --2- 172.21.15.149:0/818499015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5d806f250 0x7fb5d8156b40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0005fd0 tx=0x7fb5d002a780 comp rx=0 tx=0).stop 2024-09-21T03:14:12.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:12.996+0000 7fb5dce00640 1 -- 172.21.15.149:0/818499015 shutdown_connections 2024-09-21T03:14:12.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:12.996+0000 7fb5dce00640 1 --2- 172.21.15.149:0/818499015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5d806f250 0x7fb5d8156b40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:12.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:12.996+0000 7fb5dce00640 1 -- 172.21.15.149:0/818499015 >> 172.21.15.149:0/818499015 conn(0x7fb5d80adce0 msgr2=0x7fb5d80ae0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:12.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:12.996+0000 7fb5dce00640 1 -- 172.21.15.149:0/818499015 shutdown_connections 2024-09-21T03:14:12.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:12.996+0000 7fb5dce00640 1 -- 172.21.15.149:0/818499015 wait complete. 2024-09-21T03:14:12.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:12.998+0000 7fb5dce00640 1 Processor -- start 2024-09-21T03:14:12.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:12.998+0000 7fb5dce00640 1 -- start start 2024-09-21T03:14:13.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:12.999+0000 7fb5dce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5d806f250 0x7fb5d80b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:13.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:12.999+0000 7fb5dce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5d80c88c0 0x7fb5d81e2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:13.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:12.999+0000 7fb5dce00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5d8154420 0x7fb5d814efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:13.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:12.999+0000 7fb5dce00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d80cbc90 con 0x7fb5d80c88c0 2024-09-21T03:14:13.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:12.999+0000 7fb5dce00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d8157a30 con 0x7fb5d8154420 2024-09-21T03:14:13.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:12.999+0000 7fb5dce00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d80cbe10 con 0x7fb5d806f250 2024-09-21T03:14:13.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:12.999+0000 7fb5d7400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5d806f250 0x7fb5d80b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:13.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.000+0000 7fb5d7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5d8154420 0x7fb5d814efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:13.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.000+0000 7fb5d7400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5d806f250 0x7fb5d80b0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:33868/0 (socket says 172.21.15.149:33868) 2024-09-21T03:14:13.002 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.000+0000 7fb5d7400640 1 -- 172.21.15.149:0/2935433676 learned_addr learned my addr 172.21.15.149:0/2935433676 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-21T03:14:13.002 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.000+0000 7fb5d6a00640 1 --2- 172.21.15.149:0/2935433676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5d80c88c0 0x7fb5d81e2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:13.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.000+0000 7fb5d7400640 1 -- 172.21.15.149:0/2935433676 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5d8154420 msgr2=0x7fb5d814efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:13.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.000+0000 7fb5d7400640 1 --2- 172.21.15.149:0/2935433676 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5d8154420 0x7fb5d814efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.000+0000 7fb5d7400640 1 -- 172.21.15.149:0/2935433676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5d80c88c0 msgr2=0x7fb5d81e2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:13.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.000+0000 7fb5d7400640 1 --2- 172.21.15.149:0/2935433676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5d80c88c0 0x7fb5d81e2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.000+0000 7fb5d7400640 1 -- 172.21.15.149:0/2935433676 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d814fcb0 con 0x7fb5d806f250 2024-09-21T03:14:13.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.000+0000 7fb5d7400640 1 --2- 172.21.15.149:0/2935433676 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5d806f250 0x7fb5d80b0bb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb5c800b420 tx=0x7fb5c800b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:13.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.001+0000 7fb5cf400640 1 -- 172.21.15.149:0/2935433676 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8011830 con 0x7fb5d806f250 2024-09-21T03:14:13.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.001+0000 7fb5cf400640 1 -- 172.21.15.149:0/2935433676 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5c8016070 con 0x7fb5d806f250 2024-09-21T03:14:13.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.001+0000 7fb5cf400640 1 -- 172.21.15.149:0/2935433676 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8011d60 con 0x7fb5d806f250 2024-09-21T03:14:13.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.001+0000 7fb5dce00640 1 -- 172.21.15.149:0/2935433676 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5d81f07e0 con 0x7fb5d806f250 2024-09-21T03:14:13.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.001+0000 7fb5dce00640 1 -- 172.21.15.149:0/2935433676 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5d81e2e80 con 0x7fb5d806f250 2024-09-21T03:14:13.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.001+0000 7fb5cf400640 1 -- 172.21.15.149:0/2935433676 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb5c8004020 con 0x7fb5d806f250 2024-09-21T03:14:13.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.001+0000 7fb5cf400640 1 -- 172.21.15.149:0/2935433676 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fb5c801b540 con 0x7fb5d806f250 2024-09-21T03:14:13.004 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.002+0000 7fb5dce00640 1 -- 172.21.15.149:0/2935433676 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5d8156b40 con 0x7fb5d806f250 2024-09-21T03:14:13.007 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.006+0000 7fb5cf400640 1 -- 172.21.15.149:0/2935433676 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb5c8020020 con 0x7fb5d806f250 2024-09-21T03:14:13.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.077+0000 7fb5dce00640 1 -- 172.21.15.149:0/2935433676 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ceaacfab-e71c-45e2-ac50-4597dfd460bb", "id": 0} v 0) -- 0x7fb5d80cb360 con 0x7fb5d806f250 2024-09-21T03:14:13.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.083+0000 7fb5cf400640 1 -- 172.21.15.149:0/2935433676 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ceaacfab-e71c-45e2-ac50-4597dfd460bb", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fb5c80035f0 con 0x7fb5d806f250 2024-09-21T03:14:13.084 INFO:teuthology.orchestra.run.smithi149.stdout:0 2024-09-21T03:14:13.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.084+0000 7fb5dce00640 1 -- 172.21.15.149:0/2935433676 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5d806f250 msgr2=0x7fb5d80b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:13.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.084+0000 7fb5dce00640 1 --2- 172.21.15.149:0/2935433676 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5d806f250 0x7fb5d80b0bb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb5c800b420 tx=0x7fb5c800b8e0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.084+0000 7fb5dce00640 1 -- 172.21.15.149:0/2935433676 shutdown_connections 2024-09-21T03:14:13.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.084+0000 7fb5dce00640 1 --2- 172.21.15.149:0/2935433676 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5d8154420 0x7fb5d814efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.084+0000 7fb5dce00640 1 --2- 172.21.15.149:0/2935433676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5d80c88c0 0x7fb5d81e2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.084+0000 7fb5dce00640 1 --2- 172.21.15.149:0/2935433676 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5d806f250 0x7fb5d80b0bb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.084+0000 7fb5dce00640 1 -- 172.21.15.149:0/2935433676 >> 172.21.15.149:0/2935433676 conn(0x7fb5d80adce0 msgr2=0x7fb5d81501e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:13.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.084+0000 7fb5dce00640 1 -- 172.21.15.149:0/2935433676 shutdown_connections 2024-09-21T03:14:13.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.084+0000 7fb5dce00640 1 -- 172.21.15.149:0/2935433676 wait complete. 2024-09-21T03:14:13.107 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 86f91523-232b-4e80-ada7-d9e12770adb3 1 2024-09-21T03:14:13.325 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.323+0000 7fd019e00640 1 -- 172.21.15.149:0/2501810474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0141542b0 msgr2=0x7fd01415a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:13.325 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.323+0000 7fd019e00640 1 --2- 172.21.15.149:0/2501810474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0141542b0 0x7fd01415a0b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd000009830 tx=0x7fd00002a5c0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.325 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.324+0000 7fd019e00640 1 -- 172.21.15.149:0/2501810474 shutdown_connections 2024-09-21T03:14:13.325 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.324+0000 7fd019e00640 1 --2- 172.21.15.149:0/2501810474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0141542b0 0x7fd01415a0b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.325 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.324+0000 7fd019e00640 1 -- 172.21.15.149:0/2501810474 >> 172.21.15.149:0/2501810474 conn(0x7fd0140cca90 msgr2=0x7fd0140c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:13.326 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.324+0000 7fd019e00640 1 -- 172.21.15.149:0/2501810474 shutdown_connections 2024-09-21T03:14:13.326 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.324+0000 7fd019e00640 1 -- 172.21.15.149:0/2501810474 wait complete. 2024-09-21T03:14:13.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.326+0000 7fd019e00640 1 Processor -- start 2024-09-21T03:14:13.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.326+0000 7fd019e00640 1 -- start start 2024-09-21T03:14:13.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.327+0000 7fd019e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0140c6d30 0x7fd0140ac340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:13.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.327+0000 7fd019e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0141542b0 0x7fd014159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:13.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.327+0000 7fd019e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd01415a5f0 0x7fd014159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:13.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.327+0000 7fd019e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd0141546c0 con 0x7fd0141542b0 2024-09-21T03:14:13.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.327+0000 7fd019e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd0140cb960 con 0x7fd01415a5f0 2024-09-21T03:14:13.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.327+0000 7fd019e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd0140ae520 con 0x7fd0140c6d30 2024-09-21T03:14:13.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.327+0000 7fd019400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd01415a5f0 0x7fd014159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:13.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.327+0000 7fd018a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0140c6d30 0x7fd0140ac340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:13.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.327+0000 7fd013e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0141542b0 0x7fd014159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:13.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.327+0000 7fd019400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd01415a5f0 0x7fd014159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:51322/0 (socket says 172.21.15.149:51322) 2024-09-21T03:14:13.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.327+0000 7fd018a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0140c6d30 0x7fd0140ac340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:33870/0 (socket says 172.21.15.149:33870) 2024-09-21T03:14:13.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.327+0000 7fd019400640 1 -- 172.21.15.149:0/1213771050 learned_addr learned my addr 172.21.15.149:0/1213771050 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-21T03:14:13.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.328+0000 7fd019400640 1 -- 172.21.15.149:0/1213771050 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0140c6d30 msgr2=0x7fd0140ac340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:13.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.328+0000 7fd019400640 1 --2- 172.21.15.149:0/1213771050 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0140c6d30 0x7fd0140ac340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.328+0000 7fd019400640 1 -- 172.21.15.149:0/1213771050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0141542b0 msgr2=0x7fd014159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:13.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.328+0000 7fd019400640 1 --2- 172.21.15.149:0/1213771050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0141542b0 0x7fd014159590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.330 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.328+0000 7fd019400640 1 -- 172.21.15.149:0/1213771050 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0141589d0 con 0x7fd01415a5f0 2024-09-21T03:14:13.331 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.328+0000 7fd019400640 1 --2- 172.21.15.149:0/1213771050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd01415a5f0 0x7fd014159ad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd00c00c790 tx=0x7fd00c00cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:13.331 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.328+0000 7fd010c00640 1 -- 172.21.15.149:0/1213771050 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c003da0 con 0x7fd01415a5f0 2024-09-21T03:14:13.331 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.329+0000 7fd010c00640 1 -- 172.21.15.149:0/1213771050 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd00c00ce40 con 0x7fd01415a5f0 2024-09-21T03:14:13.331 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.329+0000 7fd010c00640 1 -- 172.21.15.149:0/1213771050 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c0052d0 con 0x7fd01415a5f0 2024-09-21T03:14:13.332 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.329+0000 7fd019e00640 1 -- 172.21.15.149:0/1213771050 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd014158730 con 0x7fd01415a5f0 2024-09-21T03:14:13.332 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.329+0000 7fd019e00640 1 -- 172.21.15.149:0/1213771050 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0140abf00 con 0x7fd01415a5f0 2024-09-21T03:14:13.332 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.329+0000 7fd010c00640 1 -- 172.21.15.149:0/1213771050 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd00c005470 con 0x7fd01415a5f0 2024-09-21T03:14:13.332 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.329+0000 7fd010c00640 1 -- 172.21.15.149:0/1213771050 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fd00c01b890 con 0x7fd01415a5f0 2024-09-21T03:14:13.332 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.330+0000 7fd019e00640 1 -- 172.21.15.149:0/1213771050 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd01415aa00 con 0x7fd01415a5f0 2024-09-21T03:14:13.333 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.332+0000 7fd010c00640 1 -- 172.21.15.149:0/1213771050 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd00c01ba90 con 0x7fd01415a5f0 2024-09-21T03:14:13.405 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.404+0000 7fd019e00640 1 -- 172.21.15.149:0/1213771050 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "86f91523-232b-4e80-ada7-d9e12770adb3", "id": 1} v 0) -- 0x7fd01406a2e0 con 0x7fd01415a5f0 2024-09-21T03:14:13.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.409+0000 7fd010c00640 1 -- 172.21.15.149:0/1213771050 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "86f91523-232b-4e80-ada7-d9e12770adb3", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fd00c01bc70 con 0x7fd01415a5f0 2024-09-21T03:14:13.410 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-21T03:14:13.411 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.410+0000 7fd019e00640 1 -- 172.21.15.149:0/1213771050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd01415a5f0 msgr2=0x7fd014159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:13.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.410+0000 7fd019e00640 1 --2- 172.21.15.149:0/1213771050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd01415a5f0 0x7fd014159ad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd00c00c790 tx=0x7fd00c00cc50 comp rx=0 tx=0).stop 2024-09-21T03:14:13.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.410+0000 7fd019e00640 1 -- 172.21.15.149:0/1213771050 shutdown_connections 2024-09-21T03:14:13.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.410+0000 7fd019e00640 1 --2- 172.21.15.149:0/1213771050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd01415a5f0 0x7fd014159ad0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.410+0000 7fd019e00640 1 --2- 172.21.15.149:0/1213771050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0141542b0 0x7fd014159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.410+0000 7fd019e00640 1 --2- 172.21.15.149:0/1213771050 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0140c6d30 0x7fd0140ac340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.410+0000 7fd019e00640 1 -- 172.21.15.149:0/1213771050 >> 172.21.15.149:0/1213771050 conn(0x7fd0140cca90 msgr2=0x7fd0141535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:13.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.410+0000 7fd019e00640 1 -- 172.21.15.149:0/1213771050 shutdown_connections 2024-09-21T03:14:13.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.410+0000 7fd019e00640 1 -- 172.21.15.149:0/1213771050 wait complete. 2024-09-21T03:14:13.431 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 6eb0f47b-e767-49c0-8d72-07f71b9c2e67 2 2024-09-21T03:14:13.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.653+0000 7f957b200640 1 -- 172.21.15.149:0/1226742884 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95740ca440 msgr2=0x7f95740c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:13.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.653+0000 7f957b200640 1 --2- 172.21.15.149:0/1226742884 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95740ca440 0x7f95740c7260 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9564005fd0 tx=0x7f956402a5d0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.653+0000 7f957b200640 1 -- 172.21.15.149:0/1226742884 shutdown_connections 2024-09-21T03:14:13.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.653+0000 7f957b200640 1 --2- 172.21.15.149:0/1226742884 >> v2:172.21.15.149:3300/0 conn(0x7f95740c77a0 0x7f9574161390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.653+0000 7f957b200640 1 --2- 172.21.15.149:0/1226742884 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95740ca440 0x7f95740c7260 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.653+0000 7f957b200640 1 -- 172.21.15.149:0/1226742884 >> 172.21.15.149:0/1226742884 conn(0x7f95740c8e40 msgr2=0x7f95740c9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:13.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.653+0000 7f957b200640 1 -- 172.21.15.149:0/1226742884 shutdown_connections 2024-09-21T03:14:13.655 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.653+0000 7f957b200640 1 -- 172.21.15.149:0/1226742884 wait complete. 2024-09-21T03:14:13.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.656+0000 7f957b200640 1 Processor -- start 2024-09-21T03:14:13.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.656+0000 7f957b200640 1 -- start start 2024-09-21T03:14:13.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.657+0000 7f957b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95740c77a0 0x7f95740ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:13.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.657+0000 7f957b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95740c85e0 0x7f95740c2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:13.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.657+0000 7f957b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95740ca440 0x7f95740c08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:13.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.657+0000 7f957b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f957406d7d0 con 0x7f95740c85e0 2024-09-21T03:14:13.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.657+0000 7f957b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f957406d4f0 con 0x7f95740c77a0 2024-09-21T03:14:13.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.657+0000 7f957b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f95740ca850 con 0x7f95740ca440 2024-09-21T03:14:13.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.657+0000 7f9579e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95740c77a0 0x7f95740ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:13.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.657+0000 7f9579e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95740c77a0 0x7f95740ae530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:51338/0 (socket says 172.21.15.149:51338) 2024-09-21T03:14:13.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.657+0000 7f957a800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95740ca440 0x7f95740c08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:13.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.657+0000 7f9579e00640 1 -- 172.21.15.149:0/1249088896 learned_addr learned my addr 172.21.15.149:0/1249088896 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-21T03:14:13.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.657+0000 7f9579400640 1 --2- 172.21.15.149:0/1249088896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95740c85e0 0x7f95740c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:13.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.658+0000 7f9579e00640 1 -- 172.21.15.149:0/1249088896 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95740ca440 msgr2=0x7f95740c08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:13.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.658+0000 7f9579e00640 1 --2- 172.21.15.149:0/1249088896 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95740ca440 0x7f95740c08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.658+0000 7f9579e00640 1 -- 172.21.15.149:0/1249088896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95740c85e0 msgr2=0x7f95740c2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:13.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.658+0000 7f9579e00640 1 --2- 172.21.15.149:0/1249088896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95740c85e0 0x7f95740c2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.658+0000 7f9579e00640 1 -- 172.21.15.149:0/1249088896 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95740c19e0 con 0x7f95740c77a0 2024-09-21T03:14:13.661 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.658+0000 7f9579e00640 1 --2- 172.21.15.149:0/1249088896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95740c77a0 0x7f95740ae530 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f956800c3d0 tx=0x7f956800c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:13.661 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.658+0000 7f956e000640 1 -- 172.21.15.149:0/1249088896 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568017070 con 0x7f95740c77a0 2024-09-21T03:14:13.661 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.658+0000 7f956e000640 1 -- 172.21.15.149:0/1249088896 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95680053c0 con 0x7f95740c77a0 2024-09-21T03:14:13.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.658+0000 7f956e000640 1 -- 172.21.15.149:0/1249088896 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568003850 con 0x7f95740c77a0 2024-09-21T03:14:13.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.658+0000 7f957b200640 1 -- 172.21.15.149:0/1249088896 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95740c1cc0 con 0x7f95740c77a0 2024-09-21T03:14:13.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.659+0000 7f957b200640 1 -- 172.21.15.149:0/1249088896 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95740c03b0 con 0x7f95740c77a0 2024-09-21T03:14:13.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.659+0000 7f956e000640 1 -- 172.21.15.149:0/1249088896 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f956801a070 con 0x7f95740c77a0 2024-09-21T03:14:13.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.659+0000 7f956e000640 1 -- 172.21.15.149:0/1249088896 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f9568011c70 con 0x7f95740c77a0 2024-09-21T03:14:13.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.660+0000 7f957b200640 1 -- 172.21.15.149:0/1249088896 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95740c7e40 con 0x7f95740c77a0 2024-09-21T03:14:13.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.664+0000 7f956e000640 1 -- 172.21.15.149:0/1249088896 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9568021070 con 0x7f95740c77a0 2024-09-21T03:14:13.738 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.737+0000 7f957b200640 1 -- 172.21.15.149:0/1249088896 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6eb0f47b-e767-49c0-8d72-07f71b9c2e67", "id": 2} v 0) -- 0x7f95740cbf50 con 0x7f95740c77a0 2024-09-21T03:14:13.743 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.742+0000 7f956e000640 1 -- 172.21.15.149:0/1249088896 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6eb0f47b-e767-49c0-8d72-07f71b9c2e67", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f9574154650 con 0x7f95740c77a0 2024-09-21T03:14:13.744 INFO:teuthology.orchestra.run.smithi149.stdout:2 2024-09-21T03:14:13.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.743+0000 7f957b200640 1 -- 172.21.15.149:0/1249088896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95740c77a0 msgr2=0x7f95740ae530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:13.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.743+0000 7f957b200640 1 --2- 172.21.15.149:0/1249088896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95740c77a0 0x7f95740ae530 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f956800c3d0 tx=0x7f956800c890 comp rx=0 tx=0).stop 2024-09-21T03:14:13.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.743+0000 7f957b200640 1 -- 172.21.15.149:0/1249088896 shutdown_connections 2024-09-21T03:14:13.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.743+0000 7f957b200640 1 --2- 172.21.15.149:0/1249088896 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95740ca440 0x7f95740c08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.743+0000 7f957b200640 1 --2- 172.21.15.149:0/1249088896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95740c85e0 0x7f95740c2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.743+0000 7f957b200640 1 --2- 172.21.15.149:0/1249088896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95740c77a0 0x7f95740ae530 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.743+0000 7f957b200640 1 -- 172.21.15.149:0/1249088896 >> 172.21.15.149:0/1249088896 conn(0x7f95740c8e40 msgr2=0x7f95740cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:13.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.743+0000 7f957b200640 1 -- 172.21.15.149:0/1249088896 shutdown_connections 2024-09-21T03:14:13.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.744+0000 7f957b200640 1 -- 172.21.15.149:0/1249088896 wait complete. 2024-09-21T03:14:13.767 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 64418862-beef-479c-be11-dfe0e515e09e 3 2024-09-21T03:14:13.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.988+0000 7fb221000640 1 -- 172.21.15.149:0/1317777044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb21c0c84d0 msgr2=0x7fb21c0af070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:13.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.988+0000 7fb221000640 1 --2- 172.21.15.149:0/1317777044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb21c0c84d0 0x7fb21c0af070 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0c8990 tx=0x7fb21402aa30 comp rx=0 tx=0).stop 2024-09-21T03:14:13.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.989+0000 7fb221000640 1 -- 172.21.15.149:0/1317777044 shutdown_connections 2024-09-21T03:14:13.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.989+0000 7fb221000640 1 --2- 172.21.15.149:0/1317777044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb21c0c84d0 0x7fb21c0af070 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.989+0000 7fb221000640 1 --2- 172.21.15.149:0/1317777044 >> v2:172.21.15.90:3300/0 conn(0x7fb21c072860 0x7fb21c1589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.989+0000 7fb221000640 1 -- 172.21.15.149:0/1317777044 >> 172.21.15.149:0/1317777044 conn(0x7fb21c0c9fe0 msgr2=0x7fb21c0ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:13.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.989+0000 7fb221000640 1 -- 172.21.15.149:0/1317777044 shutdown_connections 2024-09-21T03:14:13.991 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.989+0000 7fb221000640 1 -- 172.21.15.149:0/1317777044 wait complete. 2024-09-21T03:14:13.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.991+0000 7fb221000640 1 Processor -- start 2024-09-21T03:14:13.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.991+0000 7fb221000640 1 -- start start 2024-09-21T03:14:13.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.992+0000 7fb221000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb21c072860 0x7fb21c1e14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:13.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.992+0000 7fb221000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb21c0c80c0 0x7fb21c1e07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:13.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.992+0000 7fb221000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb21c14e6e0 0x7fb21c14d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:13.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.992+0000 7fb221000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c0c4b20 con 0x7fb21c14e6e0 2024-09-21T03:14:13.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.992+0000 7fb221000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c0c49a0 con 0x7fb21c072860 2024-09-21T03:14:13.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.992+0000 7fb221000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb21c1550e0 con 0x7fb21c0c80c0 2024-09-21T03:14:13.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.992+0000 7fb21b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb21c072860 0x7fb21c1e14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:13.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.992+0000 7fb21b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb21c072860 0x7fb21c1e14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:51364/0 (socket says 172.21.15.149:51364) 2024-09-21T03:14:13.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.992+0000 7fb21b400640 1 -- 172.21.15.149:0/2865524813 learned_addr learned my addr 172.21.15.149:0/2865524813 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-21T03:14:13.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.993+0000 7fb21be00640 1 --2- 172.21.15.149:0/2865524813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb21c14e6e0 0x7fb21c14d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:13.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.993+0000 7fb212a00640 1 --2- 172.21.15.149:0/2865524813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb21c0c80c0 0x7fb21c1e07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:13.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.993+0000 7fb21b400640 1 -- 172.21.15.149:0/2865524813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb21c0c80c0 msgr2=0x7fb21c1e07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:13.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.993+0000 7fb21b400640 1 --2- 172.21.15.149:0/2865524813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb21c0c80c0 0x7fb21c1e07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.993+0000 7fb21b400640 1 -- 172.21.15.149:0/2865524813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb21c14e6e0 msgr2=0x7fb21c14d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.993+0000 7fb21b400640 1 --2- 172.21.15.149:0/2865524813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb21c14e6e0 0x7fb21c14d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.993+0000 7fb21b400640 1 -- 172.21.15.149:0/2865524813 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21c14e4c0 con 0x7fb21c072860 2024-09-21T03:14:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.993+0000 7fb21be00640 1 --2- 172.21.15.149:0/2865524813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb21c14e6e0 0x7fb21c14d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:14:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.993+0000 7fb21b400640 1 --2- 172.21.15.149:0/2865524813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb21c072860 0x7fb21c1e14c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00e7c0 tx=0x7fb20c00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.994+0000 7fb213e00640 1 -- 172.21.15.149:0/2865524813 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c00ccc0 con 0x7fb21c072860 2024-09-21T03:14:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.994+0000 7fb213e00640 1 -- 172.21.15.149:0/2865524813 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb20c010430 con 0x7fb21c072860 2024-09-21T03:14:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.994+0000 7fb221000640 1 -- 172.21.15.149:0/2865524813 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21c1eda10 con 0x7fb21c072860 2024-09-21T03:14:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.994+0000 7fb213e00640 1 -- 172.21.15.149:0/2865524813 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c010860 con 0x7fb21c072860 2024-09-21T03:14:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.994+0000 7fb221000640 1 -- 172.21.15.149:0/2865524813 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb21c1ecf30 con 0x7fb21c072860 2024-09-21T03:14:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.994+0000 7fb213e00640 1 -- 172.21.15.149:0/2865524813 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb20c010a00 con 0x7fb21c072860 2024-09-21T03:14:13.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.994+0000 7fb213e00640 1 -- 172.21.15.149:0/2865524813 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fb20c010cf0 con 0x7fb21c072860 2024-09-21T03:14:13.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.995+0000 7fb221000640 1 -- 172.21.15.149:0/2865524813 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb21c0c84d0 con 0x7fb21c072860 2024-09-21T03:14:13.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:13.997+0000 7fb213e00640 1 -- 172.21.15.149:0/2865524813 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb20c018c40 con 0x7fb21c072860 2024-09-21T03:14:14.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.070+0000 7fb221000640 1 -- 172.21.15.149:0/2865524813 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "64418862-beef-479c-be11-dfe0e515e09e", "id": 3} v 0) -- 0x7fb21c073160 con 0x7fb21c072860 2024-09-21T03:14:14.076 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.074+0000 7fb213e00640 1 -- 172.21.15.149:0/2865524813 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "64418862-beef-479c-be11-dfe0e515e09e", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fb20c018420 con 0x7fb21c072860 2024-09-21T03:14:14.076 INFO:teuthology.orchestra.run.smithi149.stdout:3 2024-09-21T03:14:14.078 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.075+0000 7fb221000640 1 -- 172.21.15.149:0/2865524813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb21c072860 msgr2=0x7fb21c1e14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:14.078 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.075+0000 7fb221000640 1 --2- 172.21.15.149:0/2865524813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb21c072860 0x7fb21c1e14c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00e7c0 tx=0x7fb20c00ec80 comp rx=0 tx=0).stop 2024-09-21T03:14:14.078 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.075+0000 7fb221000640 1 -- 172.21.15.149:0/2865524813 shutdown_connections 2024-09-21T03:14:14.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.075+0000 7fb221000640 1 --2- 172.21.15.149:0/2865524813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb21c14e6e0 0x7fb21c14d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.075+0000 7fb221000640 1 --2- 172.21.15.149:0/2865524813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb21c0c80c0 0x7fb21c1e07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.076+0000 7fb221000640 1 --2- 172.21.15.149:0/2865524813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb21c072860 0x7fb21c1e14c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.076+0000 7fb221000640 1 -- 172.21.15.149:0/2865524813 >> 172.21.15.149:0/2865524813 conn(0x7fb21c0c9fe0 msgr2=0x7fb21c0ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:14.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.076+0000 7fb221000640 1 -- 172.21.15.149:0/2865524813 shutdown_connections 2024-09-21T03:14:14.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.076+0000 7fb221000640 1 -- 172.21.15.149:0/2865524813 wait complete. 2024-09-21T03:14:14.099 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new a05b63f4-ec0a-426c-9d60-285e2680a897 4 2024-09-21T03:14:14.315 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.313+0000 7f1cf5000640 1 -- 172.21.15.149:0/4233151779 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1cf00c7850 msgr2=0x7f1cf006ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:14.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.313+0000 7f1cf5000640 1 --2- 172.21.15.149:0/4233151779 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1cf00c7850 0x7f1cf006ea80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1cf015b330 tx=0x7f1ce802a890 comp rx=0 tx=0).stop 2024-09-21T03:14:14.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.314+0000 7f1cf5000640 1 -- 172.21.15.149:0/4233151779 shutdown_connections 2024-09-21T03:14:14.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.314+0000 7f1cf5000640 1 --2- 172.21.15.149:0/4233151779 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1cf00c7850 0x7f1cf006ea80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.314+0000 7f1cf5000640 1 --2- 172.21.15.149:0/4233151779 >> v2:172.21.15.90:3300/0 conn(0x7f1cf00c8660 0x7f1cf0154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.314+0000 7f1cf5000640 1 -- 172.21.15.149:0/4233151779 >> 172.21.15.149:0/4233151779 conn(0x7f1cf00cc2d0 msgr2=0x7f1cf00cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:14.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.314+0000 7f1cf5000640 1 -- 172.21.15.149:0/4233151779 shutdown_connections 2024-09-21T03:14:14.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.314+0000 7f1cf5000640 1 -- 172.21.15.149:0/4233151779 wait complete. 2024-09-21T03:14:14.317 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.316+0000 7f1cf5000640 1 Processor -- start 2024-09-21T03:14:14.317 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.316+0000 7f1cf5000640 1 -- start start 2024-09-21T03:14:14.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.317+0000 7f1cf5000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cf00c7440 0x7f1cf01e3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:14.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.317+0000 7f1cf5000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1cf00c8660 0x7f1cf01e1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:14.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.317+0000 7f1cf5000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cf00ada50 0x7f1cf014d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:14.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.317+0000 7f1cf5000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf00ae420 con 0x7f1cf00c7440 2024-09-21T03:14:14.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.317+0000 7f1cf5000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf015ae40 con 0x7f1cf00ada50 2024-09-21T03:14:14.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.317+0000 7f1cf5000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1cf00ae5a0 con 0x7f1cf00c8660 2024-09-21T03:14:14.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.318+0000 7f1ce7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1cf00c8660 0x7f1cf01e1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:14.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.318+0000 7f1cef400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cf00c7440 0x7f1cf01e3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:14.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.318+0000 7f1cef400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cf00c7440 0x7f1cf01e3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.149:51356/0 (socket says 172.21.15.149:51356) 2024-09-21T03:14:14.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.318+0000 7f1cef400640 1 -- 172.21.15.149:0/3827004706 learned_addr learned my addr 172.21.15.149:0/3827004706 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-21T03:14:14.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.318+0000 7f1cefe00640 1 --2- 172.21.15.149:0/3827004706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cf00ada50 0x7f1cf014d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:14.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.318+0000 7f1cef400640 1 -- 172.21.15.149:0/3827004706 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1cf00c8660 msgr2=0x7f1cf01e1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:14.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.318+0000 7f1cef400640 1 --2- 172.21.15.149:0/3827004706 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1cf00c8660 0x7f1cf01e1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.318+0000 7f1cef400640 1 -- 172.21.15.149:0/3827004706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cf00ada50 msgr2=0x7f1cf014d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:14.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.318+0000 7f1cef400640 1 --2- 172.21.15.149:0/3827004706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cf00ada50 0x7f1cf014d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.318+0000 7f1cef400640 1 -- 172.21.15.149:0/3827004706 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf01edcc0 con 0x7f1cf00c7440 2024-09-21T03:14:14.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.318+0000 7f1cef400640 1 --2- 172.21.15.149:0/3827004706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cf00c7440 0x7f1cf01e3fa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000e7c0 tx=0x7f1ce000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:14.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.319+0000 7f1ce7400640 1 -- 172.21.15.149:0/3827004706 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce000ccc0 con 0x7f1cf00c7440 2024-09-21T03:14:14.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.319+0000 7f1ce7400640 1 -- 172.21.15.149:0/3827004706 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ce0010430 con 0x7f1cf00c7440 2024-09-21T03:14:14.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.319+0000 7f1ce7400640 1 -- 172.21.15.149:0/3827004706 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0010860 con 0x7f1cf00c7440 2024-09-21T03:14:14.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.319+0000 7f1cf5000640 1 -- 172.21.15.149:0/3827004706 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf01ed760 con 0x7f1cf00c7440 2024-09-21T03:14:14.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.319+0000 7f1cf5000640 1 -- 172.21.15.149:0/3827004706 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf00abc50 con 0x7f1cf00c7440 2024-09-21T03:14:14.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.319+0000 7f1ce7400640 1 -- 172.21.15.149:0/3827004706 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1ce0010a00 con 0x7f1cf00c7440 2024-09-21T03:14:14.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.319+0000 7f1ce7400640 1 -- 172.21.15.149:0/3827004706 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f1ce0010cf0 con 0x7f1cf00c7440 2024-09-21T03:14:14.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.320+0000 7f1cf5000640 1 -- 172.21.15.149:0/3827004706 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cf00c7850 con 0x7f1cf00c7440 2024-09-21T03:14:14.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.322+0000 7f1ce7400640 1 -- 172.21.15.149:0/3827004706 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1cf01ed760 con 0x7f1cf00c7440 2024-09-21T03:14:14.396 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.395+0000 7f1cf5000640 1 -- 172.21.15.149:0/3827004706 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a05b63f4-ec0a-426c-9d60-285e2680a897", "id": 4} v 0) -- 0x7f1cf00c7010 con 0x7f1cf00c7440 2024-09-21T03:14:14.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.397+0000 7f1ce7400640 1 -- 172.21.15.149:0/3827004706 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a05b63f4-ec0a-426c-9d60-285e2680a897", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f1ce0018c40 con 0x7f1cf00c7440 2024-09-21T03:14:14.399 INFO:teuthology.orchestra.run.smithi149.stdout:4 2024-09-21T03:14:14.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.398+0000 7f1cf5000640 1 -- 172.21.15.149:0/3827004706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cf00c7440 msgr2=0x7f1cf01e3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:14.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.398+0000 7f1cf5000640 1 --2- 172.21.15.149:0/3827004706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cf00c7440 0x7f1cf01e3fa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000e7c0 tx=0x7f1ce000ec80 comp rx=0 tx=0).stop 2024-09-21T03:14:14.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.399+0000 7f1cf5000640 1 -- 172.21.15.149:0/3827004706 shutdown_connections 2024-09-21T03:14:14.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.399+0000 7f1cf5000640 1 --2- 172.21.15.149:0/3827004706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cf00ada50 0x7f1cf014d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.399+0000 7f1cf5000640 1 --2- 172.21.15.149:0/3827004706 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1cf00c8660 0x7f1cf01e1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.399+0000 7f1cf5000640 1 --2- 172.21.15.149:0/3827004706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cf00c7440 0x7f1cf01e3fa0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.399+0000 7f1cf5000640 1 -- 172.21.15.149:0/3827004706 >> 172.21.15.149:0/3827004706 conn(0x7f1cf00cc2d0 msgr2=0x7f1cf00b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:14.401 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.399+0000 7f1cf5000640 1 -- 172.21.15.149:0/3827004706 shutdown_connections 2024-09-21T03:14:14.401 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.399+0000 7f1cf5000640 1 -- 172.21.15.149:0/3827004706 wait complete. 2024-09-21T03:14:14.423 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 3a1bab89-963c-4fe7-b14f-3080c5cf7830 5 2024-09-21T03:14:14.652 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.650+0000 7f6dbb800640 1 -- 172.21.15.149:0/2567151501 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6db40ad0a0 msgr2=0x7f6db4156ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:14.652 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.650+0000 7f6dbb800640 1 --2- 172.21.15.149:0/2567151501 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6db40ad0a0 0x7f6db4156ee0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6dac005fd0 tx=0x7f6dac02a780 comp rx=0 tx=0).stop 2024-09-21T03:14:14.652 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.650+0000 7f6dbb800640 1 -- 172.21.15.149:0/2567151501 shutdown_connections 2024-09-21T03:14:14.652 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.650+0000 7f6dbb800640 1 --2- 172.21.15.149:0/2567151501 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6db40ad0a0 0x7f6db4156ee0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.652 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.650+0000 7f6dbb800640 1 --2- 172.21.15.149:0/2567151501 >> v2:172.21.15.90:3300/0 conn(0x7f6db40ac750 0x7f6db40acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.653 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.650+0000 7f6dbb800640 1 -- 172.21.15.149:0/2567151501 >> 172.21.15.149:0/2567151501 conn(0x7f6db40c85a0 msgr2=0x7f6db40c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:14.653 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.650+0000 7f6dbb800640 1 -- 172.21.15.149:0/2567151501 shutdown_connections 2024-09-21T03:14:14.653 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.651+0000 7f6dbb800640 1 -- 172.21.15.149:0/2567151501 wait complete. 2024-09-21T03:14:14.654 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.653+0000 7f6dbb800640 1 Processor -- start 2024-09-21T03:14:14.654 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.653+0000 7f6dbb800640 1 -- start start 2024-09-21T03:14:14.656 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.654+0000 7f6dbb800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6db4074ec0 0x7f6db40c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:14.656 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.654+0000 7f6dbb800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6db40ac750 0x7f6db41de710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:14.656 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.654+0000 7f6dbb800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db40ad0a0 0x7f6db4147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:14.656 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.654+0000 7f6dbb800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6db4073d60 con 0x7f6db40ad0a0 2024-09-21T03:14:14.656 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.654+0000 7f6dbb800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6db4073be0 con 0x7f6db4074ec0 2024-09-21T03:14:14.656 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.654+0000 7f6dbb800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6db4157420 con 0x7f6db40ac750 2024-09-21T03:14:14.656 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.654+0000 7f6db3e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6db40ac750 0x7f6db41de710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:14.656 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.654+0000 7f6db8e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6db4074ec0 0x7f6db40c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:14.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.654+0000 7f6db3e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6db40ac750 0x7f6db41de710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:33964/0 (socket says 172.21.15.149:33964) 2024-09-21T03:14:14.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.654+0000 7f6db3e00640 1 -- 172.21.15.149:0/1653030262 learned_addr learned my addr 172.21.15.149:0/1653030262 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-21T03:14:14.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.654+0000 7f6db9800640 1 --2- 172.21.15.149:0/1653030262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db40ad0a0 0x7f6db4147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:14.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.655+0000 7f6db3e00640 1 -- 172.21.15.149:0/1653030262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6db4074ec0 msgr2=0x7f6db40c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:14.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.655+0000 7f6db3e00640 1 --2- 172.21.15.149:0/1653030262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6db4074ec0 0x7f6db40c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.655+0000 7f6db3e00640 1 -- 172.21.15.149:0/1653030262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db40ad0a0 msgr2=0x7f6db4147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:14.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.655+0000 7f6db3e00640 1 --2- 172.21.15.149:0/1653030262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db40ad0a0 0x7f6db4147370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.655+0000 7f6db3e00640 1 -- 172.21.15.149:0/1653030262 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db41ed7e0 con 0x7f6db40ac750 2024-09-21T03:14:14.657 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.655+0000 7f6db3e00640 1 --2- 172.21.15.149:0/1653030262 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6db40ac750 0x7f6db41de710 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6da000e790 tx=0x7f6da000ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:14.658 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.655+0000 7f6db0c00640 1 -- 172.21.15.149:0/1653030262 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da000eea0 con 0x7f6db40ac750 2024-09-21T03:14:14.658 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.655+0000 7f6db0c00640 1 -- 172.21.15.149:0/1653030262 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6da000ccc0 con 0x7f6db40ac750 2024-09-21T03:14:14.658 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.655+0000 7f6dbb800640 1 -- 172.21.15.149:0/1653030262 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db41edac0 con 0x7f6db40ac750 2024-09-21T03:14:14.658 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.655+0000 7f6db0c00640 1 -- 172.21.15.149:0/1653030262 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da0005280 con 0x7f6db40ac750 2024-09-21T03:14:14.658 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.655+0000 7f6dbb800640 1 -- 172.21.15.149:0/1653030262 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db414b5b0 con 0x7f6db40ac750 2024-09-21T03:14:14.658 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.656+0000 7f6dbb800640 1 -- 172.21.15.149:0/1653030262 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6db41578a0 con 0x7f6db40ac750 2024-09-21T03:14:14.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.656+0000 7f6db0c00640 1 -- 172.21.15.149:0/1653030262 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7f6da0005420 con 0x7f6db40ac750 2024-09-21T03:14:14.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.657+0000 7f6db0c00640 1 -- 172.21.15.149:0/1653030262 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f6da0052ba0 con 0x7f6db40ac750 2024-09-21T03:14:14.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.659+0000 7f6db0c00640 1 -- 172.21.15.149:0/1653030262 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6da0020580 con 0x7f6db40ac750 2024-09-21T03:14:14.732 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.731+0000 7f6dbb800640 1 -- 172.21.15.149:0/1653030262 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3a1bab89-963c-4fe7-b14f-3080c5cf7830", "id": 5} v 0) -- 0x7f6db41481d0 con 0x7f6db40ac750 2024-09-21T03:14:14.742 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.741+0000 7f6db0c00640 1 -- 172.21.15.149:0/1653030262 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3a1bab89-963c-4fe7-b14f-3080c5cf7830", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f6da0020760 con 0x7f6db40ac750 2024-09-21T03:14:14.742 INFO:teuthology.orchestra.run.smithi149.stdout:5 2024-09-21T03:14:14.743 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.742+0000 7f6dbb800640 1 -- 172.21.15.149:0/1653030262 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6db40ac750 msgr2=0x7f6db41de710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:14.743 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.742+0000 7f6dbb800640 1 --2- 172.21.15.149:0/1653030262 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6db40ac750 0x7f6db41de710 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6da000e790 tx=0x7f6da000ec50 comp rx=0 tx=0).stop 2024-09-21T03:14:14.743 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.742+0000 7f6dbb800640 1 -- 172.21.15.149:0/1653030262 shutdown_connections 2024-09-21T03:14:14.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.742+0000 7f6dbb800640 1 --2- 172.21.15.149:0/1653030262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db40ad0a0 0x7f6db4147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.742+0000 7f6dbb800640 1 --2- 172.21.15.149:0/1653030262 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6db40ac750 0x7f6db41de710 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.742+0000 7f6dbb800640 1 --2- 172.21.15.149:0/1653030262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6db4074ec0 0x7f6db40c17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.742+0000 7f6dbb800640 1 -- 172.21.15.149:0/1653030262 >> 172.21.15.149:0/1653030262 conn(0x7f6db40c85a0 msgr2=0x7f6db40c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:14.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.742+0000 7f6dbb800640 1 -- 172.21.15.149:0/1653030262 shutdown_connections 2024-09-21T03:14:14.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.742+0000 7f6dbb800640 1 -- 172.21.15.149:0/1653030262 wait complete. 2024-09-21T03:14:14.763 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new bfcd1596-2688-4deb-be2e-55f305a5b4dd 6 2024-09-21T03:14:14.982 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.980+0000 7fd692400640 1 -- 172.21.15.149:0/3922879721 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c1542b0 msgr2=0x7fd68c15a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:14.983 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.980+0000 7fd692400640 1 --2- 172.21.15.149:0/3922879721 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c1542b0 0x7fd68c15a0b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd68c0c80a0 tx=0x7fd67402a5f0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.983 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.981+0000 7fd692400640 1 -- 172.21.15.149:0/3922879721 shutdown_connections 2024-09-21T03:14:14.983 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.981+0000 7fd692400640 1 --2- 172.21.15.149:0/3922879721 >> v2:172.21.15.90:3300/0 conn(0x7fd68c15a5f0 0x7fd68c161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.983 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.981+0000 7fd692400640 1 --2- 172.21.15.149:0/3922879721 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c1542b0 0x7fd68c15a0b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.983 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.981+0000 7fd692400640 1 -- 172.21.15.149:0/3922879721 >> 172.21.15.149:0/3922879721 conn(0x7fd68c0cca90 msgr2=0x7fd68c0c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:14.983 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.981+0000 7fd692400640 1 -- 172.21.15.149:0/3922879721 shutdown_connections 2024-09-21T03:14:14.983 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.981+0000 7fd692400640 1 -- 172.21.15.149:0/3922879721 wait complete. 2024-09-21T03:14:14.984 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.983+0000 7fd692400640 1 Processor -- start 2024-09-21T03:14:14.984 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.983+0000 7fd692400640 1 -- start start 2024-09-21T03:14:14.986 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.984+0000 7fd692400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd68c0c6d30 0x7fd68c0adf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:14.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.984+0000 7fd692400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c1542b0 0x7fd68c1e3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:14.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.984+0000 7fd692400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c15a5f0 0x7fd68c14d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:14.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.984+0000 7fd692400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c1546c0 con 0x7fd68c0c6d30 2024-09-21T03:14:14.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.984+0000 7fd692400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c0cb960 con 0x7fd68c1542b0 2024-09-21T03:14:14.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.984+0000 7fd692400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd68c0ae520 con 0x7fd68c15a5f0 2024-09-21T03:14:14.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.985+0000 7fd683e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c1542b0 0x7fd68c1e3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:14.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.985+0000 7fd691a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c15a5f0 0x7fd68c14d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:14.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.985+0000 7fd691000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd68c0c6d30 0x7fd68c0adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:14.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.985+0000 7fd683e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c1542b0 0x7fd68c1e3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:51468/0 (socket says 172.21.15.149:51468) 2024-09-21T03:14:14.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.985+0000 7fd691a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c15a5f0 0x7fd68c14d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:33966/0 (socket says 172.21.15.149:33966) 2024-09-21T03:14:14.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.985+0000 7fd683e00640 1 -- 172.21.15.149:0/2688114996 learned_addr learned my addr 172.21.15.149:0/2688114996 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-21T03:14:14.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.985+0000 7fd683e00640 1 -- 172.21.15.149:0/2688114996 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c15a5f0 msgr2=0x7fd68c14d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:14.987 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.985+0000 7fd683e00640 1 --2- 172.21.15.149:0/2688114996 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c15a5f0 0x7fd68c14d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.988 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.985+0000 7fd683e00640 1 -- 172.21.15.149:0/2688114996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd68c0c6d30 msgr2=0x7fd68c0adf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:14.988 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.985+0000 7fd683e00640 1 --2- 172.21.15.149:0/2688114996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd68c0c6d30 0x7fd68c0adf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:14.988 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.985+0000 7fd683e00640 1 -- 172.21.15.149:0/2688114996 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c1f09e0 con 0x7fd68c1542b0 2024-09-21T03:14:14.988 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.985+0000 7fd691000640 1 --2- 172.21.15.149:0/2688114996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd68c0c6d30 0x7fd68c0adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:14:14.988 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.985+0000 7fd683e00640 1 --2- 172.21.15.149:0/2688114996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c1542b0 0x7fd68c1e3e80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd674034040 tx=0x7fd674003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:14.989 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.986+0000 7fd689600640 1 -- 172.21.15.149:0/2688114996 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67403e030 con 0x7fd68c1542b0 2024-09-21T03:14:14.989 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.986+0000 7fd689600640 1 -- 172.21.15.149:0/2688114996 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd674003d10 con 0x7fd68c1542b0 2024-09-21T03:14:14.989 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.986+0000 7fd689600640 1 -- 172.21.15.149:0/2688114996 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd674035040 con 0x7fd68c1542b0 2024-09-21T03:14:14.989 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.986+0000 7fd692400640 1 -- 172.21.15.149:0/2688114996 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd68c0ac7e0 con 0x7fd68c1542b0 2024-09-21T03:14:14.989 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.986+0000 7fd692400640 1 -- 172.21.15.149:0/2688114996 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd68c159a00 con 0x7fd68c1542b0 2024-09-21T03:14:14.989 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.987+0000 7fd692400640 1 -- 172.21.15.149:0/2688114996 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd68c15aa00 con 0x7fd68c1542b0 2024-09-21T03:14:14.989 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.987+0000 7fd689600640 1 -- 172.21.15.149:0/2688114996 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7fd674041030 con 0x7fd68c1542b0 2024-09-21T03:14:14.989 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.987+0000 7fd689600640 1 -- 172.21.15.149:0/2688114996 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fd674072ab0 con 0x7fd68c1542b0 2024-09-21T03:14:14.990 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:14.989+0000 7fd689600640 1 -- 172.21.15.149:0/2688114996 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd674004e90 con 0x7fd68c1542b0 2024-09-21T03:14:15.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.061+0000 7fd692400640 1 -- 172.21.15.149:0/2688114996 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bfcd1596-2688-4deb-be2e-55f305a5b4dd", "id": 6} v 0) -- 0x7fd68c0ac5d0 con 0x7fd68c1542b0 2024-09-21T03:14:15.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.069+0000 7fd689600640 1 -- 172.21.15.149:0/2688114996 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bfcd1596-2688-4deb-be2e-55f305a5b4dd", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fd6740049c0 con 0x7fd68c1542b0 2024-09-21T03:14:15.071 INFO:teuthology.orchestra.run.smithi149.stdout:6 2024-09-21T03:14:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.070+0000 7fd692400640 1 -- 172.21.15.149:0/2688114996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c1542b0 msgr2=0x7fd68c1e3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.070+0000 7fd692400640 1 --2- 172.21.15.149:0/2688114996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c1542b0 0x7fd68c1e3e80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd674034040 tx=0x7fd674003820 comp rx=0 tx=0).stop 2024-09-21T03:14:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.071+0000 7fd692400640 1 -- 172.21.15.149:0/2688114996 shutdown_connections 2024-09-21T03:14:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.071+0000 7fd692400640 1 --2- 172.21.15.149:0/2688114996 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c15a5f0 0x7fd68c14d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.071+0000 7fd692400640 1 --2- 172.21.15.149:0/2688114996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c1542b0 0x7fd68c1e3e80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.071+0000 7fd692400640 1 --2- 172.21.15.149:0/2688114996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd68c0c6d30 0x7fd68c0adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:15.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.071+0000 7fd692400640 1 -- 172.21.15.149:0/2688114996 >> 172.21.15.149:0/2688114996 conn(0x7fd68c0cca90 msgr2=0x7fd68c151b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:15.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.071+0000 7fd692400640 1 -- 172.21.15.149:0/2688114996 shutdown_connections 2024-09-21T03:14:15.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.071+0000 7fd692400640 1 -- 172.21.15.149:0/2688114996 wait complete. 2024-09-21T03:14:15.092 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 58b19790-4006-4f07-966c-911b938cc1f3 7 2024-09-21T03:14:15.307 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.305+0000 7f2c1b200640 1 -- 172.21.15.149:0/1119923166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c1c06f320 msgr2=0x7f2c1c1553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:15.307 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.305+0000 7f2c1b200640 1 --2- 172.21.15.149:0/1119923166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c1c06f320 0x7f2c1c1553b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c009830 tx=0x7f2c0c02a530 comp rx=0 tx=0).stop 2024-09-21T03:14:15.307 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.305+0000 7f2c1b200640 1 -- 172.21.15.149:0/1119923166 shutdown_connections 2024-09-21T03:14:15.307 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.305+0000 7f2c1b200640 1 --2- 172.21.15.149:0/1119923166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c1c06f320 0x7f2c1c1553b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:15.307 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.305+0000 7f2c1b200640 1 -- 172.21.15.149:0/1119923166 >> 172.21.15.149:0/1119923166 conn(0x7f2c1c0c8490 msgr2=0x7f2c1c0c88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:15.307 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.305+0000 7f2c1b200640 1 -- 172.21.15.149:0/1119923166 shutdown_connections 2024-09-21T03:14:15.307 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.305+0000 7f2c1b200640 1 -- 172.21.15.149:0/1119923166 wait complete. 2024-09-21T03:14:15.308 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.307+0000 7f2c1b200640 1 Processor -- start 2024-09-21T03:14:15.308 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.307+0000 7f2c1b200640 1 -- start start 2024-09-21T03:14:15.311 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.308+0000 7f2c1b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c1c06f320 0x7f2c1c1df0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:15.311 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.308+0000 7f2c1b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c1c0ad480 0x7f2c1c0c1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:15.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.308+0000 7f2c1b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c1c1548d0 0x7f2c1c1df8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:15.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.309+0000 7f2c1b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c0ae120 con 0x7f2c1c06f320 2024-09-21T03:14:15.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.309+0000 7f2c1b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c0adfa0 con 0x7f2c1c1548d0 2024-09-21T03:14:15.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.309+0000 7f2c1b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2c1c0ab1c0 con 0x7f2c1c0ad480 2024-09-21T03:14:15.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.309+0000 7f2c1a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c1c1548d0 0x7f2c1c1df8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:15.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.309+0000 7f2c11400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c1c0ad480 0x7f2c1c0c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:15.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.309+0000 7f2c19e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c1c06f320 0x7f2c1c1df0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:15.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.309+0000 7f2c1a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c1c1548d0 0x7f2c1c1df8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:51476/0 (socket says 172.21.15.149:51476) 2024-09-21T03:14:15.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.309+0000 7f2c1a800640 1 -- 172.21.15.149:0/3032881963 learned_addr learned my addr 172.21.15.149:0/3032881963 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-21T03:14:15.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.309+0000 7f2c11400640 1 -- 172.21.15.149:0/3032881963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c1c1548d0 msgr2=0x7f2c1c1df8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:15.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.309+0000 7f2c11400640 1 --2- 172.21.15.149:0/3032881963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c1c1548d0 0x7f2c1c1df8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:15.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.309+0000 7f2c11400640 1 -- 172.21.15.149:0/3032881963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c1c06f320 msgr2=0x7f2c1c1df0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:15.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.309+0000 7f2c11400640 1 --2- 172.21.15.149:0/3032881963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c1c06f320 0x7f2c1c1df0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:15.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.309+0000 7f2c11400640 1 -- 172.21.15.149:0/3032881963 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1c0c3b60 con 0x7f2c1c0ad480 2024-09-21T03:14:15.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.309+0000 7f2c1a800640 1 --2- 172.21.15.149:0/3032881963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c1c1548d0 0x7f2c1c1df8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:14:15.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.310+0000 7f2c11400640 1 --2- 172.21.15.149:0/3032881963 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c1c0ad480 0x7f2c1c0c1640 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400c310 tx=0x7f2c0400c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:15.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.310+0000 7f2c12a00640 1 -- 172.21.15.149:0/3032881963 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04017070 con 0x7f2c1c0ad480 2024-09-21T03:14:15.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.310+0000 7f2c12a00640 1 -- 172.21.15.149:0/3032881963 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c040053c0 con 0x7f2c1c0ad480 2024-09-21T03:14:15.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.310+0000 7f2c1b200640 1 -- 172.21.15.149:0/3032881963 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c1c0c4040 con 0x7f2c1c0ad480 2024-09-21T03:14:15.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.310+0000 7f2c12a00640 1 -- 172.21.15.149:0/3032881963 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04003850 con 0x7f2c1c0ad480 2024-09-21T03:14:15.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.310+0000 7f2c1b200640 1 -- 172.21.15.149:0/3032881963 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c1c1472e0 con 0x7f2c1c0ad480 2024-09-21T03:14:15.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.311+0000 7f2c12a00640 1 -- 172.21.15.149:0/3032881963 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7f2c0401a070 con 0x7f2c1c0ad480 2024-09-21T03:14:15.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.311+0000 7f2c1b200640 1 -- 172.21.15.149:0/3032881963 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c1c1553b0 con 0x7f2c1c0ad480 2024-09-21T03:14:15.314 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.312+0000 7f2c12a00640 1 -- 172.21.15.149:0/3032881963 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f2c04051680 con 0x7f2c1c0ad480 2024-09-21T03:14:15.315 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.313+0000 7f2c12a00640 1 -- 172.21.15.149:0/3032881963 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2c0401ed60 con 0x7f2c1c0ad480 2024-09-21T03:14:15.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.385+0000 7f2c1b200640 1 -- 172.21.15.149:0/3032881963 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "58b19790-4006-4f07-966c-911b938cc1f3", "id": 7} v 0) -- 0x7f2c1c1544b0 con 0x7f2c1c0ad480 2024-09-21T03:14:15.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.394+0000 7f2c12a00640 1 -- 172.21.15.149:0/3032881963 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "58b19790-4006-4f07-966c-911b938cc1f3", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f2c0401bdc0 con 0x7f2c1c0ad480 2024-09-21T03:14:15.396 INFO:teuthology.orchestra.run.smithi149.stdout:7 2024-09-21T03:14:15.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.395+0000 7f2c1b200640 1 -- 172.21.15.149:0/3032881963 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c1c0ad480 msgr2=0x7f2c1c0c1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:15.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.395+0000 7f2c1b200640 1 --2- 172.21.15.149:0/3032881963 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c1c0ad480 0x7f2c1c0c1640 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400c310 tx=0x7f2c0400c7d0 comp rx=0 tx=0).stop 2024-09-21T03:14:15.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.395+0000 7f2c1b200640 1 -- 172.21.15.149:0/3032881963 shutdown_connections 2024-09-21T03:14:15.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.395+0000 7f2c1b200640 1 --2- 172.21.15.149:0/3032881963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c1c1548d0 0x7f2c1c1df8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:15.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.395+0000 7f2c1b200640 1 --2- 172.21.15.149:0/3032881963 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c1c0ad480 0x7f2c1c0c1640 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:15.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.395+0000 7f2c1b200640 1 --2- 172.21.15.149:0/3032881963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c1c06f320 0x7f2c1c1df0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:15.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.395+0000 7f2c1b200640 1 -- 172.21.15.149:0/3032881963 >> 172.21.15.149:0/3032881963 conn(0x7f2c1c0c8490 msgr2=0x7f2c1c152940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:15.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.396+0000 7f2c1b200640 1 -- 172.21.15.149:0/3032881963 shutdown_connections 2024-09-21T03:14:15.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:14:15.396+0000 7f2c1b200640 1 -- 172.21.15.149:0/3032881963 wait complete. 2024-09-21T03:14:15.420 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-21T03:14:15.420 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-21T03:14:15.423 INFO:tasks.ceph.osd.0:Started 2024-09-21T03:14:15.424 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-21T03:14:15.424 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-21T03:14:15.427 INFO:tasks.ceph.osd.1:Started 2024-09-21T03:14:15.427 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-21T03:14:15.427 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-21T03:14:15.431 INFO:tasks.ceph.osd.2:Started 2024-09-21T03:14:15.431 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-21T03:14:15.431 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-21T03:14:15.435 INFO:tasks.ceph.osd.3:Started 2024-09-21T03:14:15.435 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-21T03:14:15.435 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-21T03:14:15.439 INFO:tasks.ceph.osd.4:Started 2024-09-21T03:14:15.439 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-21T03:14:15.439 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-21T03:14:15.443 INFO:tasks.ceph.osd.5:Started 2024-09-21T03:14:15.443 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-21T03:14:15.443 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-21T03:14:15.448 INFO:tasks.ceph.osd.6:Started 2024-09-21T03:14:15.448 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-21T03:14:15.448 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-21T03:14:15.452 INFO:tasks.ceph.osd.7:Started 2024-09-21T03:14:15.452 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:14:15.487 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T03:14:15.486+0000 7fe4b3000640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-21T03:14:15.487 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T03:14:15.486+0000 7fe4b3000640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-21T03:14:15.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.754+0000 7f1a0da00640 1 -- 172.21.15.90:0/82495637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a0815a6d0 msgr2=0x7f1a0815aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:15.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.754+0000 7f1a0da00640 1 --2- 172.21.15.90:0/82495637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a0815a6d0 0x7f1a0815aae0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1a0808d660 tx=0x7f1a0002aac0 comp rx=0 tx=0).stop 2024-09-21T03:14:15.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.754+0000 7f1a0da00640 1 -- 172.21.15.90:0/82495637 shutdown_connections 2024-09-21T03:14:15.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.754+0000 7f1a0da00640 1 --2- 172.21.15.90:0/82495637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a0815a6d0 0x7f1a0815aae0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:15.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.754+0000 7f1a0da00640 1 --2- 172.21.15.90:0/82495637 >> v2:172.21.15.149:3300/0 conn(0x7f1a081578e0 0x7f1a080c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:15.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.754+0000 7f1a0da00640 1 -- 172.21.15.90:0/82495637 >> 172.21.15.90:0/82495637 conn(0x7f1a08074b40 msgr2=0x7f1a0806e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:15.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.754+0000 7f1a0da00640 1 -- 172.21.15.90:0/82495637 shutdown_connections 2024-09-21T03:14:15.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.754+0000 7f1a0da00640 1 -- 172.21.15.90:0/82495637 wait complete. 2024-09-21T03:14:15.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.756+0000 7f1a0da00640 1 Processor -- start 2024-09-21T03:14:15.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.757+0000 7f1a0da00640 1 -- start start 2024-09-21T03:14:15.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.758+0000 7f1a0da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a08154150 0x7f1a081f0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:15.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.758+0000 7f1a0da00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a0815a6d0 0x7f1a0814fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:15.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.758+0000 7f1a0da00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a081532e0 0x7f1a081497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:15.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.758+0000 7f1a0da00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1a080c9590 con 0x7f1a0815a6d0 2024-09-21T03:14:15.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.758+0000 7f1a0da00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1a080cbc60 con 0x7f1a081532e0 2024-09-21T03:14:15.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.758+0000 7f1a0da00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1a080c74a0 con 0x7f1a08154150 2024-09-21T03:14:15.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.758+0000 7f1a06000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a0815a6d0 0x7f1a0814fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:15.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.758+0000 7f1a06000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a0815a6d0 0x7f1a0814fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49286/0 (socket says 172.21.15.90:49286) 2024-09-21T03:14:15.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.758+0000 7f1a06000640 1 -- 172.21.15.90:0/352844041 learned_addr learned my addr 172.21.15.90:0/352844041 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:15.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.758+0000 7f1a06a00640 1 --2- 172.21.15.90:0/352844041 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a08154150 0x7f1a081f0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:15.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.758+0000 7f1a07400640 1 --2- 172.21.15.90:0/352844041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a081532e0 0x7f1a081497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:15.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.759+0000 7f1a06000640 1 -- 172.21.15.90:0/352844041 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a08154150 msgr2=0x7f1a081f0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:15.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.759+0000 7f1a06000640 1 --2- 172.21.15.90:0/352844041 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a08154150 0x7f1a081f0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:15.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.759+0000 7f1a06000640 1 -- 172.21.15.90:0/352844041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a081532e0 msgr2=0x7f1a081497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:15.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.759+0000 7f1a06000640 1 --2- 172.21.15.90:0/352844041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a081532e0 0x7f1a081497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:15.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.759+0000 7f1a06000640 1 -- 172.21.15.90:0/352844041 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a08153790 con 0x7f1a0815a6d0 2024-09-21T03:14:15.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.759+0000 7f1a06000640 1 --2- 172.21.15.90:0/352844041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a0815a6d0 0x7f1a0814fac0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f19f400c3f0 tx=0x7f19f400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:15.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.759+0000 7f19fea00640 1 -- 172.21.15.90:0/352844041 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4017070 con 0x7f1a0815a6d0 2024-09-21T03:14:15.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.759+0000 7f19fea00640 1 -- 172.21.15.90:0/352844041 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19f40035f0 con 0x7f1a0815a6d0 2024-09-21T03:14:15.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.759+0000 7f1a0da00640 1 -- 172.21.15.90:0/352844041 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a080ac7d0 con 0x7f1a0815a6d0 2024-09-21T03:14:15.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.759+0000 7f19fea00640 1 -- 172.21.15.90:0/352844041 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4003a40 con 0x7f1a0815a6d0 2024-09-21T03:14:15.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.759+0000 7f1a0da00640 1 -- 172.21.15.90:0/352844041 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a0814dc30 con 0x7f1a0815a6d0 2024-09-21T03:14:15.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.760+0000 7f19fea00640 1 -- 172.21.15.90:0/352844041 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 3) ==== 50869+0+0 (secure 0 0 0) 0x7f19f401a070 con 0x7f1a0815a6d0 2024-09-21T03:14:15.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.760+0000 7f1a0da00640 1 -- 172.21.15.90:0/352844041 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a080c9250 con 0x7f1a0815a6d0 2024-09-21T03:14:15.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.761+0000 7f19fea00640 1 --2- 172.21.15.90:0/352844041 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f19e803e670 0x7f19e8040b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:15.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.761+0000 7f19fea00640 1 -- 172.21.15.90:0/352844041 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f19f40518c0 con 0x7f1a0815a6d0 2024-09-21T03:14:15.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.761+0000 7f1a06a00640 1 --2- 172.21.15.90:0/352844041 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f19e803e670 0x7f19e8040b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:15.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.762+0000 7f1a06a00640 1 --2- 172.21.15.90:0/352844041 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f19e803e670 0x7f19e8040b80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f19f80095f0 tx=0x7f19f8005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:15.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.766+0000 7f19fea00640 1 -- 172.21.15.90:0/352844041 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f19f401ad70 con 0x7f1a0815a6d0 2024-09-21T03:14:15.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.954+0000 7f1a0da00640 1 -- 172.21.15.90:0/352844041 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a0806f490 con 0x7f1a0815a6d0 2024-09-21T03:14:15.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.955+0000 7f19fea00640 1 -- 172.21.15.90:0/352844041 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f19f4003dc0 con 0x7f1a0815a6d0 2024-09-21T03:14:15.957 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:15.957 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":10,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","created":"2024-09-21T03:14:09.323302+0000","modified":"2024-09-21T03:14:15.386953+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T03:14:15.386953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ceaacfab-e71c-45e2-ac50-4597dfd460bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"86f91523-232b-4e80-ada7-d9e12770adb3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6eb0f47b-e767-49c0-8d72-07f71b9c2e67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"64418862-beef-479c-be11-dfe0e515e09e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a05b63f4-ec0a-426c-9d60-285e2680a897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3a1bab89-963c-4fe7-b14f-3080c5cf7830","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bfcd1596-2688-4deb-be2e-55f305a5b4dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"58b19790-4006-4f07-966c-911b938cc1f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:14:15.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.957+0000 7f1a0da00640 1 -- 172.21.15.90:0/352844041 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f19e803e670 msgr2=0x7f19e8040b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:15.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.957+0000 7f1a0da00640 1 --2- 172.21.15.90:0/352844041 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f19e803e670 0x7f19e8040b80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f19f80095f0 tx=0x7f19f8005f90 comp rx=0 tx=0).stop 2024-09-21T03:14:15.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.957+0000 7f1a0da00640 1 -- 172.21.15.90:0/352844041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a0815a6d0 msgr2=0x7f1a0814fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:15.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.957+0000 7f1a0da00640 1 --2- 172.21.15.90:0/352844041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a0815a6d0 0x7f1a0814fac0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f19f400c3f0 tx=0x7f19f400c8b0 comp rx=0 tx=0).stop 2024-09-21T03:14:15.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.957+0000 7f1a0da00640 1 -- 172.21.15.90:0/352844041 shutdown_connections 2024-09-21T03:14:15.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.957+0000 7f1a0da00640 1 --2- 172.21.15.90:0/352844041 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f19e803e670 0x7f19e8040b80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:15.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.957+0000 7f1a0da00640 1 --2- 172.21.15.90:0/352844041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a081532e0 0x7f1a081497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:15.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.957+0000 7f1a0da00640 1 --2- 172.21.15.90:0/352844041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a0815a6d0 0x7f1a0814fac0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:15.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.957+0000 7f1a0da00640 1 --2- 172.21.15.90:0/352844041 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a08154150 0x7f1a081f0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:15.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.957+0000 7f1a0da00640 1 -- 172.21.15.90:0/352844041 >> 172.21.15.90:0/352844041 conn(0x7f1a08074b40 msgr2=0x7f1a08156580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:15.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.957+0000 7f1a0da00640 1 -- 172.21.15.90:0/352844041 shutdown_connections 2024-09-21T03:14:15.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:15.957+0000 7f1a0da00640 1 -- 172.21.15.90:0/352844041 wait complete. 2024-09-21T03:14:15.980 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-21T03:14:15.980 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-21T03:14:16.784 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T03:14:16.988 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.986+0000 7fe082200640 1 -- 172.21.15.90:0/2595458672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe07c0c39b0 msgr2=0x7fe07c070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:16.988 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.986+0000 7fe082200640 1 --2- 172.21.15.90:0/2595458672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe07c0c39b0 0x7fe07c070990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe07c0ab340 tx=0x7fe07402a970 comp rx=0 tx=0).stop 2024-09-21T03:14:16.988 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.986+0000 7fe082200640 1 -- 172.21.15.90:0/2595458672 shutdown_connections 2024-09-21T03:14:16.989 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.986+0000 7fe082200640 1 --2- 172.21.15.90:0/2595458672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe07c0c39b0 0x7fe07c070990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:16.989 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.986+0000 7fe082200640 1 --2- 172.21.15.90:0/2595458672 >> v2:172.21.15.149:3300/0 conn(0x7fe07c13dc40 0x7fe07c0c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:16.989 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.986+0000 7fe082200640 1 -- 172.21.15.90:0/2595458672 >> 172.21.15.90:0/2595458672 conn(0x7fe07c0c86d0 msgr2=0x7fe07c0c4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:16.989 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.986+0000 7fe082200640 1 -- 172.21.15.90:0/2595458672 shutdown_connections 2024-09-21T03:14:16.989 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.986+0000 7fe082200640 1 -- 172.21.15.90:0/2595458672 wait complete. 2024-09-21T03:14:16.990 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.988+0000 7fe082200640 1 Processor -- start 2024-09-21T03:14:16.990 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.989+0000 7fe082200640 1 -- start start 2024-09-21T03:14:16.992 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.990+0000 7fe082200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe07c0c35a0 0x7fe07c1f14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:16.992 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.990+0000 7fe082200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe07c0c39b0 0x7fe07c135c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:16.992 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.990+0000 7fe082200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe07c13dc40 0x7fe07c134b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:16.993 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.990+0000 7fe082200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c070ed0 con 0x7fe07c13dc40 2024-09-21T03:14:16.993 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.990+0000 7fe082200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c074f60 con 0x7fe07c0c39b0 2024-09-21T03:14:16.993 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.990+0000 7fe082200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe07c071050 con 0x7fe07c0c35a0 2024-09-21T03:14:16.993 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.990+0000 7fe07be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe07c13dc40 0x7fe07c134b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:16.993 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.990+0000 7fe07be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe07c13dc40 0x7fe07c134b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49316/0 (socket says 172.21.15.90:49316) 2024-09-21T03:14:16.993 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.990+0000 7fe07be00640 1 -- 172.21.15.90:0/3412872120 learned_addr learned my addr 172.21.15.90:0/3412872120 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:16.993 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.990+0000 7fe072a00640 1 --2- 172.21.15.90:0/3412872120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe07c0c39b0 0x7fe07c135c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:16.993 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.990+0000 7fe07b400640 1 --2- 172.21.15.90:0/3412872120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe07c0c35a0 0x7fe07c1f14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:16.993 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.991+0000 7fe07be00640 1 -- 172.21.15.90:0/3412872120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe07c0c35a0 msgr2=0x7fe07c1f14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:16.993 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.991+0000 7fe07be00640 1 --2- 172.21.15.90:0/3412872120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe07c0c35a0 0x7fe07c1f14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:16.993 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.991+0000 7fe07be00640 1 -- 172.21.15.90:0/3412872120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe07c0c39b0 msgr2=0x7fe07c135c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:16.993 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.991+0000 7fe07be00640 1 --2- 172.21.15.90:0/3412872120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe07c0c39b0 0x7fe07c135c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:16.993 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.991+0000 7fe07be00640 1 -- 172.21.15.90:0/3412872120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe07c1e0050 con 0x7fe07c13dc40 2024-09-21T03:14:16.993 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.991+0000 7fe07be00640 1 --2- 172.21.15.90:0/3412872120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe07c13dc40 0x7fe07c134b60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe07402af30 tx=0x7fe074003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:16.994 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.991+0000 7fe073e00640 1 -- 172.21.15.90:0/3412872120 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe074034050 con 0x7fe07c13dc40 2024-09-21T03:14:16.994 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.991+0000 7fe073e00640 1 -- 172.21.15.90:0/3412872120 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe074004550 con 0x7fe07c13dc40 2024-09-21T03:14:16.994 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.991+0000 7fe082200640 1 -- 172.21.15.90:0/3412872120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe07c1e1e60 con 0x7fe07c13dc40 2024-09-21T03:14:16.994 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.991+0000 7fe073e00640 1 -- 172.21.15.90:0/3412872120 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe074043440 con 0x7fe07c13dc40 2024-09-21T03:14:16.994 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.991+0000 7fe082200640 1 -- 172.21.15.90:0/3412872120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe07c151e70 con 0x7fe07c13dc40 2024-09-21T03:14:16.995 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.993+0000 7fe082200640 1 -- 172.21.15.90:0/3412872120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe07c1e0220 con 0x7fe07c13dc40 2024-09-21T03:14:16.995 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.993+0000 7fe073e00640 1 -- 172.21.15.90:0/3412872120 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7fe074037020 con 0x7fe07c13dc40 2024-09-21T03:14:16.996 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.994+0000 7fe073e00640 1 --2- 172.21.15.90:0/3412872120 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe058078b30 0x7fe05807b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:16.996 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.994+0000 7fe073e00640 1 -- 172.21.15.90:0/3412872120 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fe0740baf60 con 0x7fe07c13dc40 2024-09-21T03:14:16.996 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.995+0000 7fe07b400640 1 --2- 172.21.15.90:0/3412872120 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe058078b30 0x7fe05807b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:16.997 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.995+0000 7fe07b400640 1 --2- 172.21.15.90:0/3412872120 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe058078b30 0x7fe05807b040 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe06c004630 tx=0x7fe06c00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:17.000 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:16.999+0000 7fe073e00640 1 -- 172.21.15.90:0/3412872120 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe074083e90 con 0x7fe07c13dc40 2024-09-21T03:14:17.030 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T03:14:17.029+0000 7f2bffa11640 -1 Falling back to public interface 2024-09-21T03:14:17.038 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T03:14:17.037+0000 7f0b76b20640 -1 Falling back to public interface 2024-09-21T03:14:17.040 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T03:14:17.039+0000 7f6a1d824640 -1 Falling back to public interface 2024-09-21T03:14:17.081 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-21T03:14:17.079+0000 7efe465bb640 -1 Falling back to public interface 2024-09-21T03:14:17.170 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-09-21T03:14:17.168+0000 7fd982033640 -1 Falling back to public interface 2024-09-21T03:14:17.192 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:17.190+0000 7fe082200640 1 -- 172.21.15.90:0/3412872120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe07c06eb40 con 0x7fe07c13dc40 2024-09-21T03:14:17.192 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:17.191+0000 7fe073e00640 1 -- 172.21.15.90:0/3412872120 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fe0740888c0 con 0x7fe07c13dc40 2024-09-21T03:14:17.193 INFO:teuthology.misc.health.smithi090.stdout: 2024-09-21T03:14:17.193 INFO:teuthology.misc.health.smithi090.stdout:{"epoch":10,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","created":"2024-09-21T03:14:09.323302+0000","modified":"2024-09-21T03:14:15.386953+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T03:14:15.386953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ceaacfab-e71c-45e2-ac50-4597dfd460bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"86f91523-232b-4e80-ada7-d9e12770adb3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6eb0f47b-e767-49c0-8d72-07f71b9c2e67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"64418862-beef-479c-be11-dfe0e515e09e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a05b63f4-ec0a-426c-9d60-285e2680a897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3a1bab89-963c-4fe7-b14f-3080c5cf7830","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bfcd1596-2688-4deb-be2e-55f305a5b4dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"58b19790-4006-4f07-966c-911b938cc1f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:14:17.195 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:17.193+0000 7fe082200640 1 -- 172.21.15.90:0/3412872120 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe058078b30 msgr2=0x7fe05807b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:17.195 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:17.193+0000 7fe082200640 1 --2- 172.21.15.90:0/3412872120 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe058078b30 0x7fe05807b040 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe06c004630 tx=0x7fe06c00b2e0 comp rx=0 tx=0).stop 2024-09-21T03:14:17.195 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:17.193+0000 7fe082200640 1 -- 172.21.15.90:0/3412872120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe07c13dc40 msgr2=0x7fe07c134b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:17.195 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:17.193+0000 7fe082200640 1 --2- 172.21.15.90:0/3412872120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe07c13dc40 0x7fe07c134b60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe07402af30 tx=0x7fe074003f90 comp rx=0 tx=0).stop 2024-09-21T03:14:17.195 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:17.193+0000 7fe082200640 1 -- 172.21.15.90:0/3412872120 shutdown_connections 2024-09-21T03:14:17.196 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:17.193+0000 7fe082200640 1 --2- 172.21.15.90:0/3412872120 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe058078b30 0x7fe05807b040 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:17.196 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:17.193+0000 7fe082200640 1 --2- 172.21.15.90:0/3412872120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe07c13dc40 0x7fe07c134b60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:17.196 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:17.193+0000 7fe082200640 1 --2- 172.21.15.90:0/3412872120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe07c0c39b0 0x7fe07c135c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:17.196 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:17.193+0000 7fe082200640 1 --2- 172.21.15.90:0/3412872120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe07c0c35a0 0x7fe07c1f14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:17.196 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:17.193+0000 7fe082200640 1 -- 172.21.15.90:0/3412872120 >> 172.21.15.90:0/3412872120 conn(0x7fe07c0c86d0 msgr2=0x7fe07c13c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:17.196 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:17.193+0000 7fe082200640 1 -- 172.21.15.90:0/3412872120 shutdown_connections 2024-09-21T03:14:17.196 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:17.194+0000 7fe082200640 1 -- 172.21.15.90:0/3412872120 wait complete. 2024-09-21T03:14:17.213 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-21T03:14:17.306 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T03:14:17.304+0000 7fd0a4b45640 -1 Falling back to public interface 2024-09-21T03:14:17.311 INFO:tasks.ceph.osd.3.smithi090.stderr:2024-09-21T03:14:17.310+0000 7f7e762d8640 -1 Falling back to public interface 2024-09-21T03:14:17.476 INFO:tasks.ceph.osd.2.smithi090.stderr:2024-09-21T03:14:17.474+0000 7f606cfd7640 -1 Falling back to public interface 2024-09-21T03:14:20.943 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T03:14:20.942+0000 7f0b76b20640 -1 osd.6 0 log_to_monitors true 2024-09-21T03:14:20.992 INFO:tasks.ceph.osd.3.smithi090.stderr:2024-09-21T03:14:20.991+0000 7f7e762d8640 -1 osd.3 0 log_to_monitors true 2024-09-21T03:14:21.006 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-21T03:14:21.004+0000 7efe465bb640 -1 osd.1 0 log_to_monitors true 2024-09-21T03:14:21.168 INFO:tasks.ceph.osd.2.smithi090.stderr:2024-09-21T03:14:21.166+0000 7f606cfd7640 -1 osd.2 0 log_to_monitors true 2024-09-21T03:14:21.240 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T03:14:21.239+0000 7fd0a4b45640 -1 osd.5 0 log_to_monitors true 2024-09-21T03:14:21.352 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-09-21T03:14:21.350+0000 7fd982033640 -1 osd.0 0 log_to_monitors true 2024-09-21T03:14:21.492 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T03:14:21.491+0000 7f2bffa11640 -1 osd.7 0 log_to_monitors true 2024-09-21T03:14:21.493 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T03:14:21.491+0000 7f6a1d824640 -1 osd.4 0 log_to_monitors true 2024-09-21T03:14:23.240 INFO:tasks.ceph.osd.3.smithi090.stderr:2024-09-21T03:14:23.239+0000 7f7e71c00640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T03:14:23.243 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T03:14:23.242+0000 7f0b71a00640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T03:14:23.337 INFO:tasks.ceph.osd.3.smithi090.stderr:2024-09-21T03:14:23.336+0000 7f7e67200640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:14:23.355 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T03:14:23.354+0000 7f0b67a00640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:14:24.019 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T03:14:24.301 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.299+0000 7f1d93200640 1 -- 172.21.15.90:0/19752333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d940adb90 msgr2=0x7f1d9415f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:24.301 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.299+0000 7f1d93200640 1 --2- 172.21.15.90:0/19752333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d940adb90 0x7f1d9415f120 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c009830 tx=0x7f1d8c02a510 comp rx=0 tx=0).stop 2024-09-21T03:14:24.301 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.299+0000 7f1d93200640 1 -- 172.21.15.90:0/19752333 shutdown_connections 2024-09-21T03:14:24.301 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.299+0000 7f1d93200640 1 --2- 172.21.15.90:0/19752333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d940adb90 0x7f1d9415f120 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:24.301 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.299+0000 7f1d93200640 1 -- 172.21.15.90:0/19752333 >> 172.21.15.90:0/19752333 conn(0x7f1d940c49c0 msgr2=0x7f1d940c4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:24.301 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.299+0000 7f1d93200640 1 -- 172.21.15.90:0/19752333 shutdown_connections 2024-09-21T03:14:24.301 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.299+0000 7f1d93200640 1 -- 172.21.15.90:0/19752333 wait complete. 2024-09-21T03:14:24.304 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.303+0000 7f1d93200640 1 Processor -- start 2024-09-21T03:14:24.305 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.303+0000 7f1d93200640 1 -- start start 2024-09-21T03:14:24.306 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.305+0000 7f1d93200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d9406eb50 0x7f1d94150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:24.306 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.305+0000 7f1d93200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d940aa8e0 0x7f1d9414fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:24.306 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.305+0000 7f1d93200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d940adb90 0x7f1d941ee620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:24.307 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.305+0000 7f1d93200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1d94070c10 con 0x7f1d940adb90 2024-09-21T03:14:24.307 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.305+0000 7f1d93200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1d94153a30 con 0x7f1d9406eb50 2024-09-21T03:14:24.307 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.305+0000 7f1d93200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1d940adfa0 con 0x7f1d940aa8e0 2024-09-21T03:14:24.307 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.305+0000 7f1d91400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d940aa8e0 0x7f1d9414fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:24.307 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.305+0000 7f1d92800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d940adb90 0x7f1d941ee620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:24.307 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.305+0000 7f1d91400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d940aa8e0 0x7f1d9414fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:35398/0 (socket says 172.21.15.90:35398) 2024-09-21T03:14:24.309 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.305+0000 7f1d91400640 1 -- 172.21.15.90:0/397205589 learned_addr learned my addr 172.21.15.90:0/397205589 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:24.309 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.305+0000 7f1d91e00640 1 --2- 172.21.15.90:0/397205589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d9406eb50 0x7f1d94150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:24.309 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.306+0000 7f1d91400640 1 -- 172.21.15.90:0/397205589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d9406eb50 msgr2=0x7f1d94150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:24.309 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.306+0000 7f1d91400640 1 --2- 172.21.15.90:0/397205589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d9406eb50 0x7f1d94150770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:24.309 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.306+0000 7f1d91400640 1 -- 172.21.15.90:0/397205589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d940adb90 msgr2=0x7f1d941ee620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:24.309 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.306+0000 7f1d91400640 1 --2- 172.21.15.90:0/397205589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d940adb90 0x7f1d941ee620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:24.310 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.306+0000 7f1d91400640 1 -- 172.21.15.90:0/397205589 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d941ef130 con 0x7f1d940aa8e0 2024-09-21T03:14:24.310 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.306+0000 7f1d91e00640 1 --2- 172.21.15.90:0/397205589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d9406eb50 0x7f1d94150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:14:24.310 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.306+0000 7f1d91400640 1 --2- 172.21.15.90:0/397205589 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d940aa8e0 0x7f1d9414fd20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000c430 tx=0x7f1d8000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:24.310 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.307+0000 7f1d8a000640 1 -- 172.21.15.90:0/397205589 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d80017070 con 0x7f1d940aa8e0 2024-09-21T03:14:24.310 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.307+0000 7f1d8a000640 1 -- 172.21.15.90:0/397205589 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d800053c0 con 0x7f1d940aa8e0 2024-09-21T03:14:24.310 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.307+0000 7f1d93200640 1 -- 172.21.15.90:0/397205589 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d9414df60 con 0x7f1d940aa8e0 2024-09-21T03:14:24.310 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.307+0000 7f1d93200640 1 -- 172.21.15.90:0/397205589 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d9414e900 con 0x7f1d940aa8e0 2024-09-21T03:14:24.310 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.307+0000 7f1d8a000640 1 -- 172.21.15.90:0/397205589 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d80003850 con 0x7f1d940aa8e0 2024-09-21T03:14:24.310 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.309+0000 7f1d93200640 1 -- 172.21.15.90:0/397205589 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d6c005290 con 0x7f1d940aa8e0 2024-09-21T03:14:24.314 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.313+0000 7f1d8a000640 1 -- 172.21.15.90:0/397205589 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7f1d8001a070 con 0x7f1d940aa8e0 2024-09-21T03:14:24.316 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.314+0000 7f1d8a000640 1 --2- 172.21.15.90:0/397205589 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1d74078b00 0x7f1d7407b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:24.316 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.314+0000 7f1d8a000640 1 -- 172.21.15.90:0/397205589 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(13..13 src has 1..13) ==== 2231+0+0 (secure 0 0 0) 0x7f1d80099340 con 0x7f1d940aa8e0 2024-09-21T03:14:24.316 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.315+0000 7f1d91e00640 1 --2- 172.21.15.90:0/397205589 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1d74078b00 0x7f1d7407b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:24.317 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.316+0000 7f1d91e00640 1 --2- 172.21.15.90:0/397205589 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1d74078b00 0x7f1d7407b010 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1d840012e0 tx=0x7f1d84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:24.322 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.320+0000 7f1d8a000640 1 -- 172.21.15.90:0/397205589 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1d800620a0 con 0x7f1d940aa8e0 2024-09-21T03:14:24.660 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.658+0000 7f1d93200640 1 -- 172.21.15.90:0/397205589 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d6c005850 con 0x7f1d940aa8e0 2024-09-21T03:14:24.661 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.659+0000 7f1d8a000640 1 -- 172.21.15.90:0/397205589 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8029 (secure 0 0 0) 0x7f1d80066ad0 con 0x7f1d940aa8e0 2024-09-21T03:14:24.661 INFO:teuthology.misc.health.smithi090.stdout: 2024-09-21T03:14:24.661 INFO:teuthology.misc.health.smithi090.stdout:{"epoch":14,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","created":"2024-09-21T03:14:09.323302+0000","modified":"2024-09-21T03:14:24.325696+0000","last_up_change":"2024-09-21T03:14:24.325696+0000","last_in_change":"2024-09-21T03:14:15.386953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ceaacfab-e71c-45e2-ac50-4597dfd460bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"86f91523-232b-4e80-ada7-d9e12770adb3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6eb0f47b-e767-49c0-8d72-07f71b9c2e67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"64418862-beef-479c-be11-dfe0e515e09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6817","nonce":1515884437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6819","nonce":1515884437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6823","nonce":1515884437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6821","nonce":1515884437}]},"public_addr":"172.21.15.90:6817/1515884437","cluster_addr":"172.21.15.90:6819/1515884437","heartbeat_back_addr":"172.21.15.90:6823/1515884437","heartbeat_front_addr":"172.21.15.90:6821/1515884437","state":["exists","up"]},{"osd":4,"uuid":"a05b63f4-ec0a-426c-9d60-285e2680a897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3a1bab89-963c-4fe7-b14f-3080c5cf7830","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bfcd1596-2688-4deb-be2e-55f305a5b4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6811","nonce":821196931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6813","nonce":821196931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6821","nonce":821196931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6817","nonce":821196931}]},"public_addr":"172.21.15.149:6811/821196931","cluster_addr":"172.21.15.149:6813/821196931","heartbeat_back_addr":"172.21.15.149:6821/821196931","heartbeat_front_addr":"172.21.15.149:6817/821196931","state":["exists","up"]},{"osd":7,"uuid":"58b19790-4006-4f07-966c-911b938cc1f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:14:24.665 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.663+0000 7f1d93200640 1 -- 172.21.15.90:0/397205589 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1d74078b00 msgr2=0x7f1d7407b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:24.665 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.663+0000 7f1d93200640 1 --2- 172.21.15.90:0/397205589 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1d74078b00 0x7f1d7407b010 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1d840012e0 tx=0x7f1d84009040 comp rx=0 tx=0).stop 2024-09-21T03:14:24.665 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.663+0000 7f1d93200640 1 -- 172.21.15.90:0/397205589 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d940aa8e0 msgr2=0x7f1d9414fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:24.665 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.663+0000 7f1d93200640 1 --2- 172.21.15.90:0/397205589 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d940aa8e0 0x7f1d9414fd20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000c430 tx=0x7f1d8000c8f0 comp rx=0 tx=0).stop 2024-09-21T03:14:24.665 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.664+0000 7f1d93200640 1 -- 172.21.15.90:0/397205589 shutdown_connections 2024-09-21T03:14:24.666 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.664+0000 7f1d93200640 1 --2- 172.21.15.90:0/397205589 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1d74078b00 0x7f1d7407b010 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:24.666 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.664+0000 7f1d93200640 1 --2- 172.21.15.90:0/397205589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d940adb90 0x7f1d941ee620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:24.666 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.664+0000 7f1d93200640 1 --2- 172.21.15.90:0/397205589 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d940aa8e0 0x7f1d9414fd20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:24.666 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.664+0000 7f1d93200640 1 --2- 172.21.15.90:0/397205589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d9406eb50 0x7f1d94150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:24.666 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.664+0000 7f1d93200640 1 -- 172.21.15.90:0/397205589 >> 172.21.15.90:0/397205589 conn(0x7f1d940c49c0 msgr2=0x7f1d94143be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:24.666 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.664+0000 7f1d93200640 1 -- 172.21.15.90:0/397205589 shutdown_connections 2024-09-21T03:14:24.666 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:24.664+0000 7f1d93200640 1 -- 172.21.15.90:0/397205589 wait complete. 2024-09-21T03:14:24.694 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-09-21T03:14:24.912 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T03:14:24.911+0000 7f2bfa200640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T03:14:24.919 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T03:14:24.918+0000 7f2bf0200640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:14:24.945 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T03:14:24.944+0000 7f6a19000640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T03:14:24.953 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T03:14:24.952+0000 7f6a0e600640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:14:24.972 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T03:14:24.971+0000 7fd0a0400640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T03:14:24.978 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T03:14:24.976+0000 7fd095a00640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:14:24.988 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-09-21T03:14:24.987+0000 7fd97ce00640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T03:14:24.994 INFO:tasks.ceph.osd.2.smithi090.stderr:2024-09-21T03:14:24.993+0000 7f6068800640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T03:14:24.995 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-09-21T03:14:24.993+0000 7fd972e00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:14:25.003 INFO:tasks.ceph.osd.2.smithi090.stderr:2024-09-21T03:14:25.001+0000 7f605de00640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:14:25.022 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-21T03:14:25.021+0000 7efe41e00640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T03:14:25.032 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-21T03:14:25.031+0000 7efe37400640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:14:27.139 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:14:27.143 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:14:31.501 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T03:14:31.710 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.708+0000 7f57a5600640 1 -- 172.21.15.90:0/3898538569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57a00ac440 msgr2=0x7f57a00c3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:31.710 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.708+0000 7f57a5600640 1 --2- 172.21.15.90:0/3898538569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57a00ac440 0x7f57a00c3c70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5798005fd0 tx=0x7f579802aa10 comp rx=0 tx=0).stop 2024-09-21T03:14:31.710 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.708+0000 7f57a5600640 1 -- 172.21.15.90:0/3898538569 shutdown_connections 2024-09-21T03:14:31.710 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.708+0000 7f57a5600640 1 --2- 172.21.15.90:0/3898538569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57a00ac440 0x7f57a00c3c70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:31.710 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.708+0000 7f57a5600640 1 -- 172.21.15.90:0/3898538569 >> 172.21.15.90:0/3898538569 conn(0x7f57a00c86d0 msgr2=0x7f57a00c4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:31.710 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.708+0000 7f57a5600640 1 -- 172.21.15.90:0/3898538569 shutdown_connections 2024-09-21T03:14:31.710 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.708+0000 7f57a5600640 1 -- 172.21.15.90:0/3898538569 wait complete. 2024-09-21T03:14:31.712 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.710+0000 7f57a5600640 1 Processor -- start 2024-09-21T03:14:31.712 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.710+0000 7f57a5600640 1 -- start start 2024-09-21T03:14:31.714 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.711+0000 7f57a5600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57a00ac440 0x7f57a00c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:31.715 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.712+0000 7f57a5600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57a00c4610 0x7f57a006f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:31.715 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.712+0000 7f57a5600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57a0154580 0x7f57a006f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:31.715 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.712+0000 7f57a5600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f57a00ab250 con 0x7f57a00ac440 2024-09-21T03:14:31.715 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.712+0000 7f57a5600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f57a015a8d0 con 0x7f57a00c4610 2024-09-21T03:14:31.715 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.712+0000 7f57a5600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f57a00c1be0 con 0x7f57a0154580 2024-09-21T03:14:31.715 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.712+0000 7f579ea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57a00ac440 0x7f57a00c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:31.715 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.712+0000 7f579ea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57a00ac440 0x7f57a00c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47502/0 (socket says 172.21.15.90:47502) 2024-09-21T03:14:31.715 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.712+0000 7f579ea00640 1 -- 172.21.15.90:0/2338144891 learned_addr learned my addr 172.21.15.90:0/2338144891 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:31.715 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.712+0000 7f579e000640 1 --2- 172.21.15.90:0/2338144891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57a00c4610 0x7f57a006f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:31.715 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.712+0000 7f579f400640 1 --2- 172.21.15.90:0/2338144891 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57a0154580 0x7f57a006f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:31.715 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.712+0000 7f579ea00640 1 -- 172.21.15.90:0/2338144891 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57a0154580 msgr2=0x7f57a006f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:31.715 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.712+0000 7f579ea00640 1 --2- 172.21.15.90:0/2338144891 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57a0154580 0x7f57a006f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:31.716 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.712+0000 7f579ea00640 1 -- 172.21.15.90:0/2338144891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57a00c4610 msgr2=0x7f57a006f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:31.716 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.712+0000 7f579ea00640 1 --2- 172.21.15.90:0/2338144891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57a00c4610 0x7f57a006f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:31.716 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.712+0000 7f579ea00640 1 -- 172.21.15.90:0/2338144891 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57a00c69e0 con 0x7f57a00ac440 2024-09-21T03:14:31.716 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.712+0000 7f579e000640 1 --2- 172.21.15.90:0/2338144891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57a00c4610 0x7f57a006f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:31.716 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.712+0000 7f579f400640 1 --2- 172.21.15.90:0/2338144891 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57a0154580 0x7f57a006f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:31.716 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.713+0000 7f579ea00640 1 --2- 172.21.15.90:0/2338144891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57a00ac440 0x7f57a00c64a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f579000c3f0 tx=0x7f579000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:31.716 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.713+0000 7f5796a00640 1 -- 172.21.15.90:0/2338144891 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5790017070 con 0x7f57a00ac440 2024-09-21T03:14:31.716 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.713+0000 7f5796a00640 1 -- 172.21.15.90:0/2338144891 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57900035f0 con 0x7f57a00ac440 2024-09-21T03:14:31.716 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.713+0000 7f5796a00640 1 -- 172.21.15.90:0/2338144891 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5790003a40 con 0x7f57a00ac440 2024-09-21T03:14:31.716 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.713+0000 7f57a5600640 1 -- 172.21.15.90:0/2338144891 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57a00c7580 con 0x7f57a00ac440 2024-09-21T03:14:31.716 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.713+0000 7f57a5600640 1 -- 172.21.15.90:0/2338144891 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57a006ed70 con 0x7f57a00ac440 2024-09-21T03:14:31.717 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.714+0000 7f57a5600640 1 -- 172.21.15.90:0/2338144891 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57a00c6bb0 con 0x7f57a00ac440 2024-09-21T03:14:31.718 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.717+0000 7f5796a00640 1 -- 172.21.15.90:0/2338144891 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f579001a070 con 0x7f57a00ac440 2024-09-21T03:14:31.719 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.718+0000 7f5796a00640 1 --2- 172.21.15.90:0/2338144891 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5780078b90 0x7f578007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:31.719 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.718+0000 7f5796a00640 1 -- 172.21.15.90:0/2338144891 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f579009a120 con 0x7f57a00ac440 2024-09-21T03:14:31.720 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.718+0000 7f579e000640 1 --2- 172.21.15.90:0/2338144891 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5780078b90 0x7f578007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:31.720 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.719+0000 7f579e000640 1 --2- 172.21.15.90:0/2338144891 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5780078b90 0x7f578007b0a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f57a006ec60 tx=0x7f578c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:31.723 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.721+0000 7f5796a00640 1 -- 172.21.15.90:0/2338144891 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5790021020 con 0x7f57a00ac440 2024-09-21T03:14:31.910 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.908+0000 7f57a5600640 1 -- 172.21.15.90:0/2338144891 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f57a00c3c70 con 0x7f57a00ac440 2024-09-21T03:14:31.911 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.909+0000 7f5796a00640 1 -- 172.21.15.90:0/2338144891 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12908 (secure 0 0 0) 0x7f5790062920 con 0x7f57a00ac440 2024-09-21T03:14:31.911 INFO:teuthology.misc.health.smithi090.stdout: 2024-09-21T03:14:31.911 INFO:teuthology.misc.health.smithi090.stdout:{"epoch":17,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","created":"2024-09-21T03:14:09.323302+0000","modified":"2024-09-21T03:14:27.341675+0000","last_up_change":"2024-09-21T03:14:25.329650+0000","last_in_change":"2024-09-21T03:14:15.386953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:14:24.511246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ceaacfab-e71c-45e2-ac50-4597dfd460bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6809","nonce":3187794863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6811","nonce":3187794863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6815","nonce":3187794863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6813","nonce":3187794863}]},"public_addr":"172.21.15.90:6809/3187794863","cluster_addr":"172.21.15.90:6811/3187794863","heartbeat_back_addr":"172.21.15.90:6815/3187794863","heartbeat_front_addr":"172.21.15.90:6813/3187794863","state":["exists","up"]},{"osd":1,"uuid":"86f91523-232b-4e80-ada7-d9e12770adb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6801","nonce":3769758484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6803","nonce":3769758484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6807","nonce":3769758484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6805","nonce":3769758484}]},"public_addr":"172.21.15.90:6801/3769758484","cluster_addr":"172.21.15.90:6803/3769758484","heartbeat_back_addr":"172.21.15.90:6807/3769758484","heartbeat_front_addr":"172.21.15.90:6805/3769758484","state":["exists","up"]},{"osd":2,"uuid":"6eb0f47b-e767-49c0-8d72-07f71b9c2e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6825","nonce":1025535744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6827","nonce":1025535744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6831","nonce":1025535744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6829","nonce":1025535744}]},"public_addr":"172.21.15.90:6825/1025535744","cluster_addr":"172.21.15.90:6827/1025535744","heartbeat_back_addr":"172.21.15.90:6831/1025535744","heartbeat_front_addr":"172.21.15.90:6829/1025535744","state":["exists","up"]},{"osd":3,"uuid":"64418862-beef-479c-be11-dfe0e515e09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6817","nonce":1515884437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6819","nonce":1515884437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6823","nonce":1515884437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6821","nonce":1515884437}]},"public_addr":"172.21.15.90:6817/1515884437","cluster_addr":"172.21.15.90:6819/1515884437","heartbeat_back_addr":"172.21.15.90:6823/1515884437","heartbeat_front_addr":"172.21.15.90:6821/1515884437","state":["exists","up"]},{"osd":4,"uuid":"a05b63f4-ec0a-426c-9d60-285e2680a897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6816","nonce":4278726553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6820","nonce":4278726553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6825","nonce":4278726553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6823","nonce":4278726553}]},"public_addr":"172.21.15.149:6816/4278726553","cluster_addr":"172.21.15.149:6820/4278726553","heartbeat_back_addr":"172.21.15.149:6825/4278726553","heartbeat_front_addr":"172.21.15.149:6823/4278726553","state":["exists","up"]},{"osd":5,"uuid":"3a1bab89-963c-4fe7-b14f-3080c5cf7830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6827","nonce":1341677333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6829","nonce":1341677333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6833","nonce":1341677333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6831","nonce":1341677333}]},"public_addr":"172.21.15.149:6827/1341677333","cluster_addr":"172.21.15.149:6829/1341677333","heartbeat_back_addr":"172.21.15.149:6833/1341677333","heartbeat_front_addr":"172.21.15.149:6831/1341677333","state":["exists","up"]},{"osd":6,"uuid":"bfcd1596-2688-4deb-be2e-55f305a5b4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6811","nonce":821196931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6813","nonce":821196931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6821","nonce":821196931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6817","nonce":821196931}]},"public_addr":"172.21.15.149:6811/821196931","cluster_addr":"172.21.15.149:6813/821196931","heartbeat_back_addr":"172.21.15.149:6821/821196931","heartbeat_front_addr":"172.21.15.149:6817/821196931","state":["exists","up"]},{"osd":7,"uuid":"58b19790-4006-4f07-966c-911b938cc1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6803","nonce":1657326880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6805","nonce":1657326880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6809","nonce":1657326880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6807","nonce":1657326880}]},"public_addr":"172.21.15.149:6803/1657326880","cluster_addr":"172.21.15.149:6805/1657326880","heartbeat_back_addr":"172.21.15.149:6809/1657326880","heartbeat_front_addr":"172.21.15.149:6807/1657326880","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.399701+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.051745+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.190159+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:23.240143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.446570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.259974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:21.990407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.459259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:14:31.914 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.911+0000 7f57a5600640 1 -- 172.21.15.90:0/2338144891 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5780078b90 msgr2=0x7f578007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:31.914 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.911+0000 7f57a5600640 1 --2- 172.21.15.90:0/2338144891 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5780078b90 0x7f578007b0a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f57a006ec60 tx=0x7f578c008040 comp rx=0 tx=0).stop 2024-09-21T03:14:31.914 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.912+0000 7f57a5600640 1 -- 172.21.15.90:0/2338144891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57a00ac440 msgr2=0x7f57a00c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:31.914 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.912+0000 7f57a5600640 1 --2- 172.21.15.90:0/2338144891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57a00ac440 0x7f57a00c64a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f579000c3f0 tx=0x7f579000c8b0 comp rx=0 tx=0).stop 2024-09-21T03:14:31.914 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.912+0000 7f57a5600640 1 -- 172.21.15.90:0/2338144891 shutdown_connections 2024-09-21T03:14:31.914 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.912+0000 7f57a5600640 1 --2- 172.21.15.90:0/2338144891 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5780078b90 0x7f578007b0a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:31.914 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.912+0000 7f57a5600640 1 --2- 172.21.15.90:0/2338144891 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57a0154580 0x7f57a006f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:31.914 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.912+0000 7f57a5600640 1 --2- 172.21.15.90:0/2338144891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57a00c4610 0x7f57a006f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:31.914 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.912+0000 7f57a5600640 1 --2- 172.21.15.90:0/2338144891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57a00ac440 0x7f57a00c64a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:31.914 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.912+0000 7f57a5600640 1 -- 172.21.15.90:0/2338144891 >> 172.21.15.90:0/2338144891 conn(0x7f57a00c86d0 msgr2=0x7f57a00c4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:31.914 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.912+0000 7f57a5600640 1 -- 172.21.15.90:0/2338144891 shutdown_connections 2024-09-21T03:14:31.914 INFO:teuthology.misc.health.smithi090.stderr:2024-09-21T03:14:31.912+0000 7f57a5600640 1 -- 172.21.15.90:0/2338144891 wait complete. 2024-09-21T03:14:31.934 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-21T03:14:31.934 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-21T03:14:31.934 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T03:14:31.935 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T03:14:31.938 INFO:tasks.ceph.mds.a:Started 2024-09-21T03:14:31.939 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T03:14:31.939 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T03:14:31.942 INFO:tasks.ceph.mds.c:Started 2024-09-21T03:14:31.942 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T03:14:31.942 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T03:14:31.947 INFO:tasks.ceph.mds.b:Started 2024-09-21T03:14:31.947 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T03:14:31.947 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T03:14:31.951 INFO:tasks.ceph.mds.d:Started 2024-09-21T03:14:31.951 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-21T03:14:31.951 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:14:32.134 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-09-21T03:14:32.137 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2024-09-21T03:14:32.154 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-21T03:14:32.154 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-21T03:14:32.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.183+0000 7f169c000640 1 -- 172.21.15.90:0/1157981299 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f167c003a30 msgr2=0x7f167c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:32.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.183+0000 7f169c000640 1 --2- 172.21.15.90:0/1157981299 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f167c003a30 0x7f167c003ea0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f168800c290 tx=0x7f167c005830 comp rx=0 tx=0).stop 2024-09-21T03:14:32.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.183+0000 7f169a000640 1 -- 172.21.15.90:0/1157981299 reap_dead start 2024-09-21T03:14:32.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.183+0000 7f169c000640 1 -- 172.21.15.90:0/1157981299 shutdown_connections 2024-09-21T03:14:32.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.183+0000 7f169c000640 1 -- 172.21.15.90:0/1157981299 >> 172.21.15.90:0/1157981299 conn(0x7f169406d410 msgr2=0x7f16940ac020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:32.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.183+0000 7f169c000640 1 -- 172.21.15.90:0/1157981299 shutdown_connections 2024-09-21T03:14:32.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.183+0000 7f169c000640 1 -- 172.21.15.90:0/1157981299 wait complete. 2024-09-21T03:14:32.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.185+0000 7f169c000640 1 Processor -- start 2024-09-21T03:14:32.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.185+0000 7f169c000640 1 -- start start 2024-09-21T03:14:32.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.186+0000 7f169c000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f167c003a30 0x7f16941521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:32.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.186+0000 7f169c000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16941e09a0 0x7f1694153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:32.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.186+0000 7f169c000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16941543f0 0x7f16941efea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:32.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.186+0000 7f169c000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1694156db0 con 0x7f167c003a30 2024-09-21T03:14:32.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.186+0000 7f169c000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f169415b320 con 0x7f16941e09a0 2024-09-21T03:14:32.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.186+0000 7f169c000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f16940c6970 con 0x7f16941543f0 2024-09-21T03:14:32.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.187+0000 7f1699600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f167c003a30 0x7f16941521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:32.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.187+0000 7f1699600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f167c003a30 0x7f16941521b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47542/0 (socket says 172.21.15.90:47542) 2024-09-21T03:14:32.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.187+0000 7f1699600640 1 -- 172.21.15.90:0/2132636330 learned_addr learned my addr 172.21.15.90:0/2132636330 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:32.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.187+0000 7f1698c00640 1 --2- 172.21.15.90:0/2132636330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16941e09a0 0x7f1694153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:32.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.187+0000 7f169a000640 1 --2- 172.21.15.90:0/2132636330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16941543f0 0x7f16941efea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:32.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.187+0000 7f1699600640 1 -- 172.21.15.90:0/2132636330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16941543f0 msgr2=0x7f16941efea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:32.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.187+0000 7f1699600640 1 --2- 172.21.15.90:0/2132636330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16941543f0 0x7f16941efea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:32.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.187+0000 7f1699600640 1 -- 172.21.15.90:0/2132636330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16941e09a0 msgr2=0x7f1694153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:32.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.187+0000 7f1699600640 1 --2- 172.21.15.90:0/2132636330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16941e09a0 0x7f1694153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:32.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.187+0000 7f1699600640 1 -- 172.21.15.90:0/2132636330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16941e1a60 con 0x7f167c003a30 2024-09-21T03:14:32.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.187+0000 7f1698c00640 1 --2- 172.21.15.90:0/2132636330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16941e09a0 0x7f1694153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:14:32.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.187+0000 7f1699600640 1 --2- 172.21.15.90:0/2132636330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f167c003a30 0x7f16941521b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f168802b110 tx=0x7f1688001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:32.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.188+0000 7f1691600640 1 -- 172.21.15.90:0/2132636330 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1688031040 con 0x7f167c003a30 2024-09-21T03:14:32.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.188+0000 7f1691600640 1 -- 172.21.15.90:0/2132636330 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16880035f0 con 0x7f167c003a30 2024-09-21T03:14:32.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.188+0000 7f1691600640 1 -- 172.21.15.90:0/2132636330 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1688003a40 con 0x7f167c003a30 2024-09-21T03:14:32.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.188+0000 7f169c000640 1 -- 172.21.15.90:0/2132636330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1694150890 con 0x7f167c003a30 2024-09-21T03:14:32.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.188+0000 7f169c000640 1 -- 172.21.15.90:0/2132636330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16940caa90 con 0x7f167c003a30 2024-09-21T03:14:32.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.189+0000 7f169c000640 1 -- 172.21.15.90:0/2132636330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1694157b80 con 0x7f167c003a30 2024-09-21T03:14:32.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.190+0000 7f1691600640 1 -- 172.21.15.90:0/2132636330 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1688034070 con 0x7f167c003a30 2024-09-21T03:14:32.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.191+0000 7f1691600640 1 --2- 172.21.15.90:0/2132636330 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1674078b90 0x7f167407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:32.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.192+0000 7f1691600640 1 -- 172.21.15.90:0/2132636330 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f16880ba920 con 0x7f167c003a30 2024-09-21T03:14:32.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.192+0000 7f1698c00640 1 --2- 172.21.15.90:0/2132636330 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1674078b90 0x7f167407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:32.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.193+0000 7f1698c00640 1 --2- 172.21.15.90:0/2132636330 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1674078b90 0x7f167407b0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f169415a930 tx=0x7f1680005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:32.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.196+0000 7f1691600640 1 -- 172.21.15.90:0/2132636330 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1688083130 con 0x7f167c003a30 2024-09-21T03:14:32.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.419+0000 7f169c000640 1 -- 172.21.15.90:0/2132636330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16940ade90 con 0x7f167c003a30 2024-09-21T03:14:32.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.420+0000 7f1691600640 1 -- 172.21.15.90:0/2132636330 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f1688082a30 con 0x7f167c003a30 2024-09-21T03:14:32.422 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:32.422 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":2,"btime":"2024-09-21T03:14:32:140915+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4395,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1105275899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1105275899},{"type":"v1","addr":"172.21.15.90:6833","nonce":1105275899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T03:14:32.422 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 2 2024-09-21T03:14:32.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.422+0000 7f169c000640 1 -- 172.21.15.90:0/2132636330 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1674078b90 msgr2=0x7f167407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:32.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.422+0000 7f169c000640 1 --2- 172.21.15.90:0/2132636330 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1674078b90 0x7f167407b0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f169415a930 tx=0x7f1680005f90 comp rx=0 tx=0).stop 2024-09-21T03:14:32.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.422+0000 7f169c000640 1 -- 172.21.15.90:0/2132636330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f167c003a30 msgr2=0x7f16941521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:32.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.422+0000 7f169c000640 1 --2- 172.21.15.90:0/2132636330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f167c003a30 0x7f16941521b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f168802b110 tx=0x7f1688001d20 comp rx=0 tx=0).stop 2024-09-21T03:14:32.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.423+0000 7f169c000640 1 -- 172.21.15.90:0/2132636330 shutdown_connections 2024-09-21T03:14:32.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.423+0000 7f169c000640 1 --2- 172.21.15.90:0/2132636330 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1674078b90 0x7f167407b0a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:32.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.423+0000 7f169c000640 1 --2- 172.21.15.90:0/2132636330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16941543f0 0x7f16941efea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:32.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.423+0000 7f169c000640 1 --2- 172.21.15.90:0/2132636330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16941e09a0 0x7f1694153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:32.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.423+0000 7f169c000640 1 --2- 172.21.15.90:0/2132636330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f167c003a30 0x7f16941521b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:32.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.423+0000 7f169c000640 1 -- 172.21.15.90:0/2132636330 >> 172.21.15.90:0/2132636330 conn(0x7f169406d410 msgr2=0x7f169406f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:32.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.423+0000 7f169c000640 1 -- 172.21.15.90:0/2132636330 shutdown_connections 2024-09-21T03:14:32.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:32.423+0000 7f169c000640 1 -- 172.21.15.90:0/2132636330 wait complete. 2024-09-21T03:14:34.448 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:14:34.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.678+0000 7fa416c00640 1 -- 172.21.15.90:0/3256690931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa41006d960 msgr2=0x7fa41013dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:34.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.678+0000 7fa416c00640 1 --2- 172.21.15.90:0/3256690931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa41006d960 0x7fa41013dd40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa410069d10 tx=0x7fa40002a4a0 comp rx=0 tx=0).stop 2024-09-21T03:14:34.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.678+0000 7fa416c00640 1 -- 172.21.15.90:0/3256690931 shutdown_connections 2024-09-21T03:14:34.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.678+0000 7fa416c00640 1 --2- 172.21.15.90:0/3256690931 >> v2:172.21.15.149:3300/0 conn(0x7fa4100ac350 0x7fa4100ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:34.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.678+0000 7fa416c00640 1 --2- 172.21.15.90:0/3256690931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa41006d960 0x7fa41013dd40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:34.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.678+0000 7fa416c00640 1 -- 172.21.15.90:0/3256690931 >> 172.21.15.90:0/3256690931 conn(0x7fa4100c8ba0 msgr2=0x7fa41006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:34.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.678+0000 7fa416c00640 1 -- 172.21.15.90:0/3256690931 shutdown_connections 2024-09-21T03:14:34.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.678+0000 7fa416c00640 1 -- 172.21.15.90:0/3256690931 wait complete. 2024-09-21T03:14:34.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.680+0000 7fa416c00640 1 Processor -- start 2024-09-21T03:14:34.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.680+0000 7fa416c00640 1 -- start start 2024-09-21T03:14:34.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.681+0000 7fa416c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa41006d960 0x7fa410132d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:34.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.682+0000 7fa416c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4100ac350 0x7fa410158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:34.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.682+0000 7fa416c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4100acca0 0x7fa410156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:34.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.682+0000 7fa416c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa4100ab640 con 0x7fa4100acca0 2024-09-21T03:14:34.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.682+0000 7fa416c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa4100ab360 con 0x7fa4100ac350 2024-09-21T03:14:34.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.682+0000 7fa416c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa410074930 con 0x7fa41006d960 2024-09-21T03:14:34.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.682+0000 7fa414c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4100acca0 0x7fa410156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:34.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.682+0000 7fa414c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4100acca0 0x7fa410156110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47560/0 (socket says 172.21.15.90:47560) 2024-09-21T03:14:34.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.682+0000 7fa414c00640 1 -- 172.21.15.90:0/467146396 learned_addr learned my addr 172.21.15.90:0/467146396 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:34.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.682+0000 7fa414c00640 1 -- 172.21.15.90:0/467146396 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa41006d960 msgr2=0x7fa410132d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:34.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.682+0000 7fa40fe00640 1 --2- 172.21.15.90:0/467146396 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa41006d960 0x7fa410132d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:34.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.682+0000 7fa407e00640 1 --2- 172.21.15.90:0/467146396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4100ac350 0x7fa410158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:34.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.682+0000 7fa414c00640 1 --2- 172.21.15.90:0/467146396 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa41006d960 0x7fa410132d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:34.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.682+0000 7fa414c00640 1 -- 172.21.15.90:0/467146396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4100ac350 msgr2=0x7fa410158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:34.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.682+0000 7fa414c00640 1 --2- 172.21.15.90:0/467146396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4100ac350 0x7fa410158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:34.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.682+0000 7fa414c00640 1 -- 172.21.15.90:0/467146396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4101332d0 con 0x7fa4100acca0 2024-09-21T03:14:34.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.682+0000 7fa407e00640 1 --2- 172.21.15.90:0/467146396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4100ac350 0x7fa410158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:34.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.682+0000 7fa40fe00640 1 --2- 172.21.15.90:0/467146396 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa41006d960 0x7fa410132d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:34.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.683+0000 7fa414c00640 1 --2- 172.21.15.90:0/467146396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4100acca0 0x7fa410156110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa40800cad0 tx=0x7fa40800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:34.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.683+0000 7fa40cc00640 1 -- 172.21.15.90:0/467146396 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa408016020 con 0x7fa4100acca0 2024-09-21T03:14:34.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.683+0000 7fa40cc00640 1 -- 172.21.15.90:0/467146396 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa40800ad20 con 0x7fa4100acca0 2024-09-21T03:14:34.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.683+0000 7fa416c00640 1 -- 172.21.15.90:0/467146396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4101ecf50 con 0x7fa4100acca0 2024-09-21T03:14:34.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.683+0000 7fa40cc00640 1 -- 172.21.15.90:0/467146396 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa408012680 con 0x7fa4100acca0 2024-09-21T03:14:34.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.683+0000 7fa416c00640 1 -- 172.21.15.90:0/467146396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4100c6400 con 0x7fa4100acca0 2024-09-21T03:14:34.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.684+0000 7fa416c00640 1 -- 172.21.15.90:0/467146396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4100c5e90 con 0x7fa4100acca0 2024-09-21T03:14:34.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.685+0000 7fa40cc00640 1 -- 172.21.15.90:0/467146396 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa408019020 con 0x7fa4100acca0 2024-09-21T03:14:34.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.686+0000 7fa40cc00640 1 --2- 172.21.15.90:0/467146396 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa3ec078b90 0x7fa3ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:34.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.686+0000 7fa40cc00640 1 -- 172.21.15.90:0/467146396 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa40809b530 con 0x7fa4100acca0 2024-09-21T03:14:34.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.687+0000 7fa40fe00640 1 --2- 172.21.15.90:0/467146396 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa3ec078b90 0x7fa3ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:34.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.687+0000 7fa40fe00640 1 --2- 172.21.15.90:0/467146396 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa3ec078b90 0x7fa3ec07b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa400034000 tx=0x7fa400004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:34.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.689+0000 7fa40cc00640 1 -- 172.21.15.90:0/467146396 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa408020020 con 0x7fa4100acca0 2024-09-21T03:14:34.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.912+0000 7fa416c00640 1 -- 172.21.15.90:0/467146396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa41013ab20 con 0x7fa4100acca0 2024-09-21T03:14:34.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.913+0000 7fa40cc00640 1 -- 172.21.15.90:0/467146396 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3912 (secure 0 0 0) 0x7fa4101332d0 con 0x7fa4100acca0 2024-09-21T03:14:34.915 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:34.915 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":3,"btime":"2024-09-21T03:14:33:142316+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3707484056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3707484056},{"type":"v1","addr":"172.21.15.90:6835","nonce":3707484056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1650707992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1650707992},{"type":"v1","addr":"172.21.15.149:6837","nonce":1650707992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4395,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1105275899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1105275899},{"type":"v1","addr":"172.21.15.90:6833","nonce":1105275899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4414,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2166962836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2166962836},{"type":"v1","addr":"172.21.15.149:6836","nonce":2166962836}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T03:14:34.915 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 3 2024-09-21T03:14:34.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.915+0000 7fa416c00640 1 -- 172.21.15.90:0/467146396 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa3ec078b90 msgr2=0x7fa3ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:34.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.915+0000 7fa416c00640 1 --2- 172.21.15.90:0/467146396 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa3ec078b90 0x7fa3ec07b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa400034000 tx=0x7fa400004730 comp rx=0 tx=0).stop 2024-09-21T03:14:34.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.915+0000 7fa416c00640 1 -- 172.21.15.90:0/467146396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4100acca0 msgr2=0x7fa410156110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:34.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.915+0000 7fa416c00640 1 --2- 172.21.15.90:0/467146396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4100acca0 0x7fa410156110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa40800cad0 tx=0x7fa40800cf90 comp rx=0 tx=0).stop 2024-09-21T03:14:34.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.916+0000 7fa416c00640 1 -- 172.21.15.90:0/467146396 shutdown_connections 2024-09-21T03:14:34.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.916+0000 7fa416c00640 1 --2- 172.21.15.90:0/467146396 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa3ec078b90 0x7fa3ec07b0a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:34.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.916+0000 7fa416c00640 1 --2- 172.21.15.90:0/467146396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4100acca0 0x7fa410156110 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:34.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.916+0000 7fa416c00640 1 --2- 172.21.15.90:0/467146396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4100ac350 0x7fa410158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:34.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.916+0000 7fa416c00640 1 --2- 172.21.15.90:0/467146396 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa41006d960 0x7fa410132d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:34.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.916+0000 7fa416c00640 1 -- 172.21.15.90:0/467146396 >> 172.21.15.90:0/467146396 conn(0x7fa4100c8ba0 msgr2=0x7fa4100763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:34.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.916+0000 7fa416c00640 1 -- 172.21.15.90:0/467146396 shutdown_connections 2024-09-21T03:14:34.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:34.916+0000 7fa416c00640 1 -- 172.21.15.90:0/467146396 wait complete. 2024-09-21T03:14:34.938 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T03:14:35.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.155+0000 7f33ff200640 1 -- 172.21.15.90:0/3768544077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34001545f0 msgr2=0x7f3400156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:35.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.155+0000 7f33ff200640 1 --2- 172.21.15.90:0/3768544077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34001545f0 0x7f3400156c80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f33e8005fd0 tx=0x7f33e802a540 comp rx=0 tx=0).stop 2024-09-21T03:14:35.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.155+0000 7f33ff200640 1 -- 172.21.15.90:0/3768544077 shutdown_connections 2024-09-21T03:14:35.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.155+0000 7f33ff200640 1 --2- 172.21.15.90:0/3768544077 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f340006e380 0x7f34001571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:35.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.155+0000 7f33ff200640 1 --2- 172.21.15.90:0/3768544077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34001545f0 0x7f3400156c80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:35.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.155+0000 7f33ff200640 1 -- 172.21.15.90:0/3768544077 >> 172.21.15.90:0/3768544077 conn(0x7f34000c8d90 msgr2=0x7f34000c91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:35.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.155+0000 7f33ff200640 1 -- 172.21.15.90:0/3768544077 shutdown_connections 2024-09-21T03:14:35.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.155+0000 7f33ff200640 1 -- 172.21.15.90:0/3768544077 wait complete. 2024-09-21T03:14:35.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.157+0000 7f33ff200640 1 Processor -- start 2024-09-21T03:14:35.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.158+0000 7f33ff200640 1 -- start start 2024-09-21T03:14:35.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.159+0000 7f33ff200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f340006e380 0x7f34001ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:35.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.159+0000 7f33ff200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34000c7900 0x7f34000acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:35.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.159+0000 7f33ff200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34001545f0 0x7f34001490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:35.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.159+0000 7f33ff200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f34000c75e0 con 0x7f340006e380 2024-09-21T03:14:35.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.159+0000 7f33ff200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f34000c8780 con 0x7f34001545f0 2024-09-21T03:14:35.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.159+0000 7f33ff200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3400157b10 con 0x7f34000c7900 2024-09-21T03:14:35.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.159+0000 7f33fde00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f340006e380 0x7f34001ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:35.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.159+0000 7f33fde00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f340006e380 0x7f34001ed140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37902/0 (socket says 172.21.15.90:37902) 2024-09-21T03:14:35.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.159+0000 7f33fde00640 1 -- 172.21.15.90:0/2140093012 learned_addr learned my addr 172.21.15.90:0/2140093012 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:35.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.159+0000 7f33fe800640 1 --2- 172.21.15.90:0/2140093012 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34001545f0 0x7f34001490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:35.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.159+0000 7f33fd400640 1 --2- 172.21.15.90:0/2140093012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34000c7900 0x7f34000acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:35.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.160+0000 7f33fde00640 1 -- 172.21.15.90:0/2140093012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34000c7900 msgr2=0x7f34000acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:35.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.160+0000 7f33fde00640 1 --2- 172.21.15.90:0/2140093012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34000c7900 0x7f34000acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:35.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.160+0000 7f33fde00640 1 -- 172.21.15.90:0/2140093012 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34001545f0 msgr2=0x7f34001490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:35.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.160+0000 7f33fde00640 1 --2- 172.21.15.90:0/2140093012 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34001545f0 0x7f34001490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:35.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.160+0000 7f33fde00640 1 -- 172.21.15.90:0/2140093012 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34001ee3a0 con 0x7f340006e380 2024-09-21T03:14:35.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.160+0000 7f33fde00640 1 --2- 172.21.15.90:0/2140093012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f340006e380 0x7f34001ed140 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f33f000c3d0 tx=0x7f33f000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:35.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.160+0000 7f33f6000640 1 -- 172.21.15.90:0/2140093012 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f0017070 con 0x7f340006e380 2024-09-21T03:14:35.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.160+0000 7f33f6000640 1 -- 172.21.15.90:0/2140093012 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33f00053c0 con 0x7f340006e380 2024-09-21T03:14:35.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.160+0000 7f33f6000640 1 -- 172.21.15.90:0/2140093012 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f0003850 con 0x7f340006e380 2024-09-21T03:14:35.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.160+0000 7f33ff200640 1 -- 172.21.15.90:0/2140093012 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34001eda10 con 0x7f340006e380 2024-09-21T03:14:35.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.160+0000 7f33ff200640 1 -- 172.21.15.90:0/2140093012 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34000ad710 con 0x7f340006e380 2024-09-21T03:14:35.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.161+0000 7f33ff200640 1 -- 172.21.15.90:0/2140093012 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34000c6960 con 0x7f340006e380 2024-09-21T03:14:35.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.163+0000 7f33f6000640 1 -- 172.21.15.90:0/2140093012 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f33f001a070 con 0x7f340006e380 2024-09-21T03:14:35.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.164+0000 7f33f6000640 1 --2- 172.21.15.90:0/2140093012 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f33dc078b90 0x7f33dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:35.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.164+0000 7f33f6000640 1 -- 172.21.15.90:0/2140093012 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f33f0099d10 con 0x7f340006e380 2024-09-21T03:14:35.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.165+0000 7f33fd400640 1 --2- 172.21.15.90:0/2140093012 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f33dc078b90 0x7f33dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:35.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.165+0000 7f33fd400640 1 --2- 172.21.15.90:0/2140093012 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f33dc078b90 0x7f33dc07b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f33e8033000 tx=0x7f33e8004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:35.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.169+0000 7f33f6000640 1 -- 172.21.15.90:0/2140093012 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f33f009f020 con 0x7f340006e380 2024-09-21T03:14:35.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.356+0000 7f33ff200640 1 -- 172.21.15.90:0/2140093012 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f34000c8b10 con 0x7f340006e380 2024-09-21T03:14:35.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.356+0000 7f33f6000640 1 -- 172.21.15.90:0/2140093012 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f33f0061e40 con 0x7f340006e380 2024-09-21T03:14:35.358 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:35.358 INFO:teuthology.orchestra.run.smithi090.stdout:[ 2024-09-21T03:14:35.358 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:14:35.358 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 1, 2024-09-21T03:14:35.358 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": ".mgr" 2024-09-21T03:14:35.358 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:14:35.358 INFO:teuthology.orchestra.run.smithi090.stdout:] 2024-09-21T03:14:35.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.358+0000 7f33ff200640 1 -- 172.21.15.90:0/2140093012 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f33dc078b90 msgr2=0x7f33dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:35.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.358+0000 7f33ff200640 1 --2- 172.21.15.90:0/2140093012 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f33dc078b90 0x7f33dc07b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f33e8033000 tx=0x7f33e8004730 comp rx=0 tx=0).stop 2024-09-21T03:14:35.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.358+0000 7f33ff200640 1 -- 172.21.15.90:0/2140093012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f340006e380 msgr2=0x7f34001ed140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:35.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.358+0000 7f33ff200640 1 --2- 172.21.15.90:0/2140093012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f340006e380 0x7f34001ed140 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f33f000c3d0 tx=0x7f33f000c890 comp rx=0 tx=0).stop 2024-09-21T03:14:35.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.358+0000 7f33ff200640 1 -- 172.21.15.90:0/2140093012 shutdown_connections 2024-09-21T03:14:35.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.358+0000 7f33ff200640 1 --2- 172.21.15.90:0/2140093012 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f33dc078b90 0x7f33dc07b0a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:35.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.358+0000 7f33ff200640 1 --2- 172.21.15.90:0/2140093012 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34001545f0 0x7f34001490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:35.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.358+0000 7f33ff200640 1 --2- 172.21.15.90:0/2140093012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34000c7900 0x7f34000acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:35.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.358+0000 7f33ff200640 1 --2- 172.21.15.90:0/2140093012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f340006e380 0x7f34001ed140 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:35.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.358+0000 7f33ff200640 1 -- 172.21.15.90:0/2140093012 >> 172.21.15.90:0/2140093012 conn(0x7f34000c8d90 msgr2=0x7f3400153090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:35.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.358+0000 7f33ff200640 1 -- 172.21.15.90:0/2140093012 shutdown_connections 2024-09-21T03:14:35.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.358+0000 7f33ff200640 1 -- 172.21.15.90:0/2140093012 wait complete. 2024-09-21T03:14:35.380 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'a' 2024-09-21T03:14:35.381 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_metadata --pg_num_min 64 2024-09-21T03:14:35.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.603+0000 7f9a44c00640 1 -- 172.21.15.90:0/2323273755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a240053c0 msgr2=0x7f9a2400ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:35.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.603+0000 7f9a44c00640 1 --2- 172.21.15.90:0/2323273755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a240053c0 0x7f9a2400ba70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9a40074f20 tx=0x7f9a24005830 comp rx=0 tx=0).stop 2024-09-21T03:14:35.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.603+0000 7f9a44c00640 1 -- 172.21.15.90:0/2323273755 shutdown_connections 2024-09-21T03:14:35.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.603+0000 7f9a44c00640 1 --2- 172.21.15.90:0/2323273755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a240053c0 0x7f9a2400ba70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:35.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.603+0000 7f9a44c00640 1 -- 172.21.15.90:0/2323273755 >> 172.21.15.90:0/2323273755 conn(0x7f9a400c85a0 msgr2=0x7f9a400c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:35.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.603+0000 7f9a44c00640 1 -- 172.21.15.90:0/2323273755 shutdown_connections 2024-09-21T03:14:35.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.603+0000 7f9a44c00640 1 -- 172.21.15.90:0/2323273755 wait complete. 2024-09-21T03:14:35.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.605+0000 7f9a44c00640 1 Processor -- start 2024-09-21T03:14:35.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.606+0000 7f9a44c00640 1 -- start start 2024-09-21T03:14:35.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.607+0000 7f9a44c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a240053c0 0x7f9a40150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:35.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.607+0000 7f9a44c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9a4013d9b0 0x7f9a4013ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:35.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.607+0000 7f9a44c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a401eff10 0x7f9a401f0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:35.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.607+0000 7f9a44c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9a40074260 con 0x7f9a401eff10 2024-09-21T03:14:35.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.607+0000 7f9a44c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9a400740e0 con 0x7f9a240053c0 2024-09-21T03:14:35.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.607+0000 7f9a44c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9a40152140 con 0x7f9a4013d9b0 2024-09-21T03:14:35.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.607+0000 7f9a3e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a401eff10 0x7f9a401f0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:35.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.607+0000 7f9a3e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a401eff10 0x7f9a401f0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37914/0 (socket says 172.21.15.90:37914) 2024-09-21T03:14:35.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.607+0000 7f9a3e800640 1 -- 172.21.15.90:0/3994233376 learned_addr learned my addr 172.21.15.90:0/3994233376 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:35.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.607+0000 7f9a3de00640 1 --2- 172.21.15.90:0/3994233376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a240053c0 0x7f9a40150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:35.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.607+0000 7f9a3d400640 1 --2- 172.21.15.90:0/3994233376 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9a4013d9b0 0x7f9a4013ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:35.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.608+0000 7f9a3e800640 1 -- 172.21.15.90:0/3994233376 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9a4013d9b0 msgr2=0x7f9a4013ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:35.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.608+0000 7f9a3e800640 1 --2- 172.21.15.90:0/3994233376 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9a4013d9b0 0x7f9a4013ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:35.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.608+0000 7f9a3e800640 1 -- 172.21.15.90:0/3994233376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a240053c0 msgr2=0x7f9a40150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:35.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.608+0000 7f9a3e800640 1 --2- 172.21.15.90:0/3994233376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a240053c0 0x7f9a40150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:35.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.608+0000 7f9a3e800640 1 -- 172.21.15.90:0/3994233376 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a40158d70 con 0x7f9a401eff10 2024-09-21T03:14:35.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.608+0000 7f9a3e800640 1 --2- 172.21.15.90:0/3994233376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a401eff10 0x7f9a401f0320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9a3802b3b0 tx=0x7f9a38004980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:35.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.608+0000 7f9a36000640 1 -- 172.21.15.90:0/3994233376 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3802b900 con 0x7f9a401eff10 2024-09-21T03:14:35.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.608+0000 7f9a36000640 1 -- 172.21.15.90:0/3994233376 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a3802bb90 con 0x7f9a401eff10 2024-09-21T03:14:35.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.608+0000 7f9a44c00640 1 -- 172.21.15.90:0/3994233376 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a4013e300 con 0x7f9a401eff10 2024-09-21T03:14:35.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.608+0000 7f9a36000640 1 -- 172.21.15.90:0/3994233376 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a38004e40 con 0x7f9a401eff10 2024-09-21T03:14:35.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.608+0000 7f9a44c00640 1 -- 172.21.15.90:0/3994233376 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a401ed590 con 0x7f9a401eff10 2024-09-21T03:14:35.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.609+0000 7f9a44c00640 1 -- 172.21.15.90:0/3994233376 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a401ed3a0 con 0x7f9a401eff10 2024-09-21T03:14:35.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.611+0000 7f9a36000640 1 -- 172.21.15.90:0/3994233376 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9a38006070 con 0x7f9a401eff10 2024-09-21T03:14:35.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.612+0000 7f9a36000640 1 --2- 172.21.15.90:0/3994233376 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9a20078b90 0x7f9a2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:35.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.612+0000 7f9a36000640 1 -- 172.21.15.90:0/3994233376 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f9a380ba4a0 con 0x7f9a401eff10 2024-09-21T03:14:35.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.612+0000 7f9a3de00640 1 --2- 172.21.15.90:0/3994233376 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9a20078b90 0x7f9a2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:35.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.613+0000 7f9a3de00640 1 --2- 172.21.15.90:0/3994233376 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9a20078b90 0x7f9a2007b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9a30009b10 tx=0x7f9a30005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:35.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.617+0000 7f9a36000640 1 -- 172.21.15.90:0/3994233376 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9a38082cb0 con 0x7f9a401eff10 2024-09-21T03:14:35.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:35.803+0000 7f9a44c00640 1 -- 172.21.15.90:0/3994233376 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64} v 0) -- 0x7f9a4014c430 con 0x7f9a401eff10 2024-09-21T03:14:36.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.437+0000 7f9a36000640 1 -- 172.21.15.90:0/3994233376 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64}]=0 pool 'a_metadata' created v18) ==== 128+0+0 (secure 0 0 0) 0x7f9a4014c430 con 0x7f9a401eff10 2024-09-21T03:14:36.439 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'a_metadata' created 2024-09-21T03:14:36.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.440+0000 7f9a44c00640 1 -- 172.21.15.90:0/3994233376 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9a20078b90 msgr2=0x7f9a2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:36.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.440+0000 7f9a44c00640 1 --2- 172.21.15.90:0/3994233376 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9a20078b90 0x7f9a2007b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9a30009b10 tx=0x7f9a30005f90 comp rx=0 tx=0).stop 2024-09-21T03:14:36.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.440+0000 7f9a44c00640 1 -- 172.21.15.90:0/3994233376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a401eff10 msgr2=0x7f9a401f0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:36.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.440+0000 7f9a44c00640 1 --2- 172.21.15.90:0/3994233376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a401eff10 0x7f9a401f0320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9a3802b3b0 tx=0x7f9a38004980 comp rx=0 tx=0).stop 2024-09-21T03:14:36.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.440+0000 7f9a44c00640 1 -- 172.21.15.90:0/3994233376 shutdown_connections 2024-09-21T03:14:36.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.440+0000 7f9a44c00640 1 --2- 172.21.15.90:0/3994233376 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9a20078b90 0x7f9a2007b0a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:36.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.440+0000 7f9a44c00640 1 --2- 172.21.15.90:0/3994233376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a401eff10 0x7f9a401f0320 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:36.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.440+0000 7f9a44c00640 1 --2- 172.21.15.90:0/3994233376 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9a4013d9b0 0x7f9a4013ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:36.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.440+0000 7f9a44c00640 1 --2- 172.21.15.90:0/3994233376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a240053c0 0x7f9a40150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:36.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.440+0000 7f9a44c00640 1 -- 172.21.15.90:0/3994233376 >> 172.21.15.90:0/3994233376 conn(0x7f9a400c85a0 msgr2=0x7f9a400c3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:36.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.441+0000 7f9a44c00640 1 -- 172.21.15.90:0/3994233376 shutdown_connections 2024-09-21T03:14:36.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.441+0000 7f9a44c00640 1 -- 172.21.15.90:0/3994233376 wait complete. 2024-09-21T03:14:36.473 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T03:14:36.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.700+0000 7f53cb200640 1 -- 172.21.15.90:0/147936221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53cc156f70 msgr2=0x7f53cc157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:36.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.700+0000 7f53cb200640 1 --2- 172.21.15.90:0/147936221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53cc156f70 0x7f53cc157380 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0c91d0 tx=0x7f53c402a560 comp rx=0 tx=0).stop 2024-09-21T03:14:36.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.700+0000 7f53cb200640 1 -- 172.21.15.90:0/147936221 shutdown_connections 2024-09-21T03:14:36.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.700+0000 7f53cb200640 1 --2- 172.21.15.90:0/147936221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53cc156f70 0x7f53cc157380 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:36.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.700+0000 7f53cb200640 1 --2- 172.21.15.90:0/147936221 >> v2:172.21.15.149:3300/0 conn(0x7f53cc074d10 0x7f53cc14d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:36.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.700+0000 7f53cb200640 1 -- 172.21.15.90:0/147936221 >> 172.21.15.90:0/147936221 conn(0x7f53cc06d1d0 msgr2=0x7f53cc06d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:36.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.700+0000 7f53cb200640 1 -- 172.21.15.90:0/147936221 shutdown_connections 2024-09-21T03:14:36.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.700+0000 7f53cb200640 1 -- 172.21.15.90:0/147936221 wait complete. 2024-09-21T03:14:36.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.702+0000 7f53cb200640 1 Processor -- start 2024-09-21T03:14:36.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.702+0000 7f53cb200640 1 -- start start 2024-09-21T03:14:36.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.704+0000 7f53cb200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53cc06e860 0x7f53cc1e1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:36.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.704+0000 7f53cb200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53cc074d10 0x7f53cc0c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:36.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.704+0000 7f53cb200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53cc156f70 0x7f53cc0c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:36.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.704+0000 7f53cb200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc0707f0 con 0x7f53cc156f70 2024-09-21T03:14:36.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.704+0000 7f53cb200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc070670 con 0x7f53cc074d10 2024-09-21T03:14:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.704+0000 7f53cb200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f53cc1578c0 con 0x7f53cc06e860 2024-09-21T03:14:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.704+0000 7f53ca800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53cc156f70 0x7f53cc0c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.704+0000 7f53c9e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53cc06e860 0x7f53cc1e1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.704+0000 7f53ca800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53cc156f70 0x7f53cc0c6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37928/0 (socket says 172.21.15.90:37928) 2024-09-21T03:14:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.704+0000 7f53ca800640 1 -- 172.21.15.90:0/332847146 learned_addr learned my addr 172.21.15.90:0/332847146 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.704+0000 7f53c1400640 1 --2- 172.21.15.90:0/332847146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53cc074d10 0x7f53cc0c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.704+0000 7f53ca800640 1 -- 172.21.15.90:0/332847146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53cc06e860 msgr2=0x7f53cc1e1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.704+0000 7f53ca800640 1 --2- 172.21.15.90:0/332847146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53cc06e860 0x7f53cc1e1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.704+0000 7f53ca800640 1 -- 172.21.15.90:0/332847146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53cc074d10 msgr2=0x7f53cc0c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.704+0000 7f53ca800640 1 --2- 172.21.15.90:0/332847146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53cc074d10 0x7f53cc0c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.705+0000 7f53ca800640 1 -- 172.21.15.90:0/332847146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53cc0c6050 con 0x7f53cc156f70 2024-09-21T03:14:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.705+0000 7f53ca800640 1 --2- 172.21.15.90:0/332847146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53cc156f70 0x7f53cc0c6470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f53c4034040 tx=0x7f53c4003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:36.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.705+0000 7f53c2a00640 1 -- 172.21.15.90:0/332847146 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c403e030 con 0x7f53cc156f70 2024-09-21T03:14:36.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.705+0000 7f53c2a00640 1 -- 172.21.15.90:0/332847146 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53c4003e50 con 0x7f53cc156f70 2024-09-21T03:14:36.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.705+0000 7f53cb200640 1 -- 172.21.15.90:0/332847146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53cc156450 con 0x7f53cc156f70 2024-09-21T03:14:36.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.705+0000 7f53c2a00640 1 -- 172.21.15.90:0/332847146 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4035040 con 0x7f53cc156f70 2024-09-21T03:14:36.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.705+0000 7f53cb200640 1 -- 172.21.15.90:0/332847146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53cc149760 con 0x7f53cc156f70 2024-09-21T03:14:36.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.706+0000 7f53cb200640 1 -- 172.21.15.90:0/332847146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53cc1eda30 con 0x7f53cc156f70 2024-09-21T03:14:36.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.708+0000 7f53c2a00640 1 -- 172.21.15.90:0/332847146 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f53c4041030 con 0x7f53cc156f70 2024-09-21T03:14:36.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.709+0000 7f53c2a00640 1 --2- 172.21.15.90:0/332847146 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f53a8078b90 0x7f53a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:36.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.709+0000 7f53c2a00640 1 -- 172.21.15.90:0/332847146 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5222+0+0 (secure 0 0 0) 0x7f53c40bb350 con 0x7f53cc156f70 2024-09-21T03:14:36.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.709+0000 7f53c9e00640 1 --2- 172.21.15.90:0/332847146 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f53a8078b90 0x7f53a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:36.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.710+0000 7f53c9e00640 1 --2- 172.21.15.90:0/332847146 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f53a8078b90 0x7f53a807b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00ae50 tx=0x7f53bc00a540 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:36.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.714+0000 7f53c2a00640 1 -- 172.21.15.90:0/332847146 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f53c40833a0 con 0x7f53cc156f70 2024-09-21T03:14:36.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:36.902+0000 7f53cb200640 1 -- 172.21.15.90:0/332847146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f53cc14d8b0 con 0x7f53cc156f70 2024-09-21T03:14:37.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.443+0000 7f53c2a00640 1 -- 172.21.15.90:0/332847146 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'a_data' created v19) ==== 160+0+0 (secure 0 0 0) 0x7f53c4087dd0 con 0x7f53cc156f70 2024-09-21T03:14:37.445 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'a_data' created 2024-09-21T03:14:37.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.447+0000 7f53cb200640 1 -- 172.21.15.90:0/332847146 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f53a8078b90 msgr2=0x7f53a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:37.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.447+0000 7f53cb200640 1 --2- 172.21.15.90:0/332847146 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f53a8078b90 0x7f53a807b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00ae50 tx=0x7f53bc00a540 comp rx=0 tx=0).stop 2024-09-21T03:14:37.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.447+0000 7f53cb200640 1 -- 172.21.15.90:0/332847146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53cc156f70 msgr2=0x7f53cc0c6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:37.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.447+0000 7f53cb200640 1 --2- 172.21.15.90:0/332847146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53cc156f70 0x7f53cc0c6470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f53c4034040 tx=0x7f53c4003960 comp rx=0 tx=0).stop 2024-09-21T03:14:37.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.447+0000 7f53cb200640 1 -- 172.21.15.90:0/332847146 shutdown_connections 2024-09-21T03:14:37.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.447+0000 7f53cb200640 1 --2- 172.21.15.90:0/332847146 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f53a8078b90 0x7f53a807b0a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:37.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.447+0000 7f53cb200640 1 --2- 172.21.15.90:0/332847146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53cc156f70 0x7f53cc0c6470 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:37.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.447+0000 7f53cb200640 1 --2- 172.21.15.90:0/332847146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53cc074d10 0x7f53cc0c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:37.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.447+0000 7f53cb200640 1 --2- 172.21.15.90:0/332847146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53cc06e860 0x7f53cc1e1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:37.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.447+0000 7f53cb200640 1 -- 172.21.15.90:0/332847146 >> 172.21.15.90:0/332847146 conn(0x7f53cc06d1d0 msgr2=0x7f53cc06ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:37.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.450+0000 7f53cb200640 1 -- 172.21.15.90:0/332847146 shutdown_connections 2024-09-21T03:14:37.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.450+0000 7f53cb200640 1 -- 172.21.15.90:0/332847146 wait complete. 2024-09-21T03:14:37.493 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new a a_metadata a_data 2024-09-21T03:14:37.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.715+0000 7f02d5c00640 1 -- 172.21.15.90:0/3846680200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02d0149f50 msgr2=0x7f02d014a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:37.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.715+0000 7f02d5c00640 1 --2- 172.21.15.90:0/3846680200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02d0149f50 0x7f02d014a360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f02d00c2960 tx=0x7f02c002a440 comp rx=0 tx=0).stop 2024-09-21T03:14:37.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.715+0000 7f02d5c00640 1 -- 172.21.15.90:0/3846680200 shutdown_connections 2024-09-21T03:14:37.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.715+0000 7f02d5c00640 1 --2- 172.21.15.90:0/3846680200 >> v2:172.21.15.149:3300/0 conn(0x7f02d00ac5d0 0x7f02d00ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:37.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.715+0000 7f02d5c00640 1 --2- 172.21.15.90:0/3846680200 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02d01570a0 0x7f02d01574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:37.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.715+0000 7f02d5c00640 1 --2- 172.21.15.90:0/3846680200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02d0149f50 0x7f02d014a360 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:37.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.715+0000 7f02d5c00640 1 -- 172.21.15.90:0/3846680200 >> 172.21.15.90:0/3846680200 conn(0x7f02d00c85a0 msgr2=0x7f02d00c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:37.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.715+0000 7f02d5c00640 1 -- 172.21.15.90:0/3846680200 shutdown_connections 2024-09-21T03:14:37.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.715+0000 7f02d5c00640 1 -- 172.21.15.90:0/3846680200 wait complete. 2024-09-21T03:14:37.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.717+0000 7f02d5c00640 1 Processor -- start 2024-09-21T03:14:37.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.718+0000 7f02d5c00640 1 -- start start 2024-09-21T03:14:37.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.719+0000 7f02d5c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02d00ac5d0 0x7f02d0142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:37.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.719+0000 7f02d5c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02d0149f50 0x7f02d0154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:37.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.719+0000 7f02d5c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02d01570a0 0x7f02d01ef010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:37.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.719+0000 7f02d5c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f02d0073cf0 con 0x7f02d0149f50 2024-09-21T03:14:37.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.719+0000 7f02d5c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f02d0073b70 con 0x7f02d00ac5d0 2024-09-21T03:14:37.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.719+0000 7f02d5c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f02d00c2f30 con 0x7f02d01570a0 2024-09-21T03:14:37.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.719+0000 7f02ce000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02d0149f50 0x7f02d0154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:37.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.719+0000 7f02ce000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02d0149f50 0x7f02d0154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37948/0 (socket says 172.21.15.90:37948) 2024-09-21T03:14:37.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.719+0000 7f02ce000640 1 -- 172.21.15.90:0/4036911853 learned_addr learned my addr 172.21.15.90:0/4036911853 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:37.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.719+0000 7f02cea00640 1 --2- 172.21.15.90:0/4036911853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02d00ac5d0 0x7f02d0142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:37.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.719+0000 7f02cf400640 1 --2- 172.21.15.90:0/4036911853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02d01570a0 0x7f02d01ef010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:37.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.719+0000 7f02ce000640 1 -- 172.21.15.90:0/4036911853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02d01570a0 msgr2=0x7f02d01ef010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:37.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.719+0000 7f02ce000640 1 --2- 172.21.15.90:0/4036911853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02d01570a0 0x7f02d01ef010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:37.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.720+0000 7f02ce000640 1 -- 172.21.15.90:0/4036911853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02d00ac5d0 msgr2=0x7f02d0142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:37.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.720+0000 7f02ce000640 1 --2- 172.21.15.90:0/4036911853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02d00ac5d0 0x7f02d0142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:37.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.720+0000 7f02ce000640 1 -- 172.21.15.90:0/4036911853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d01ef550 con 0x7f02d0149f50 2024-09-21T03:14:37.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.720+0000 7f02cf400640 1 --2- 172.21.15.90:0/4036911853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02d01570a0 0x7f02d01ef010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:14:37.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.720+0000 7f02ce000640 1 --2- 172.21.15.90:0/4036911853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02d0149f50 0x7f02d0154270 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00d770 tx=0x7f02bc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:37.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.720+0000 7f02c6a00640 1 -- 172.21.15.90:0/4036911853 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc017070 con 0x7f02d0149f50 2024-09-21T03:14:37.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.720+0000 7f02c6a00640 1 -- 172.21.15.90:0/4036911853 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02bc009d20 con 0x7f02d0149f50 2024-09-21T03:14:37.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.720+0000 7f02d5c00640 1 -- 172.21.15.90:0/4036911853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d0153540 con 0x7f02d0149f50 2024-09-21T03:14:37.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.720+0000 7f02c6a00640 1 -- 172.21.15.90:0/4036911853 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc004280 con 0x7f02d0149f50 2024-09-21T03:14:37.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.720+0000 7f02d5c00640 1 -- 172.21.15.90:0/4036911853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d0143570 con 0x7f02d0149f50 2024-09-21T03:14:37.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.721+0000 7f02d5c00640 1 -- 172.21.15.90:0/4036911853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d0143360 con 0x7f02d0149f50 2024-09-21T03:14:37.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.722+0000 7f02c6a00640 1 -- 172.21.15.90:0/4036911853 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f02bc0047a0 con 0x7f02d0149f50 2024-09-21T03:14:37.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.723+0000 7f02c6a00640 1 --2- 172.21.15.90:0/4036911853 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f02b0078bc0 0x7f02b007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:37.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.724+0000 7f02c6a00640 1 -- 172.21.15.90:0/4036911853 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5599+0+0 (secure 0 0 0) 0x7f02bc09af80 con 0x7f02d0149f50 2024-09-21T03:14:37.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.724+0000 7f02cea00640 1 --2- 172.21.15.90:0/4036911853 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f02b0078bc0 0x7f02b007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:37.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.725+0000 7f02cea00640 1 --2- 172.21.15.90:0/4036911853 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f02b0078bc0 0x7f02b007b0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f02c0033000 tx=0x7f02c0004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:37.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.728+0000 7f02c6a00640 1 -- 172.21.15.90:0/4036911853 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f02bc020020 con 0x7f02d0149f50 2024-09-21T03:14:37.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:37.952+0000 7f02d5c00640 1 -- 172.21.15.90:0/4036911853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"} v 0) -- 0x7f02d0157bb0 con 0x7f02d0149f50 2024-09-21T03:14:38.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.444+0000 7f02c6a00640 1 -- 172.21.15.90:0/4036911853 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 157+0+0 (secure 0 0 0) 0x7f02bc063420 con 0x7f02d0149f50 2024-09-21T03:14:38.447 INFO:teuthology.orchestra.run.smithi090.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T03:14:38.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.448+0000 7f02d5c00640 1 -- 172.21.15.90:0/4036911853 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f02b0078bc0 msgr2=0x7f02b007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:38.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.448+0000 7f02d5c00640 1 --2- 172.21.15.90:0/4036911853 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f02b0078bc0 0x7f02b007b0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f02c0033000 tx=0x7f02c0004730 comp rx=0 tx=0).stop 2024-09-21T03:14:38.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.448+0000 7f02d5c00640 1 -- 172.21.15.90:0/4036911853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02d0149f50 msgr2=0x7f02d0154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:38.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.448+0000 7f02d5c00640 1 --2- 172.21.15.90:0/4036911853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02d0149f50 0x7f02d0154270 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00d770 tx=0x7f02bc00dc30 comp rx=0 tx=0).stop 2024-09-21T03:14:38.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.448+0000 7f02d5c00640 1 -- 172.21.15.90:0/4036911853 shutdown_connections 2024-09-21T03:14:38.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.448+0000 7f02d5c00640 1 --2- 172.21.15.90:0/4036911853 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f02b0078bc0 0x7f02b007b0d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:38.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.448+0000 7f02d5c00640 1 --2- 172.21.15.90:0/4036911853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02d01570a0 0x7f02d01ef010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:38.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.448+0000 7f02d5c00640 1 --2- 172.21.15.90:0/4036911853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02d0149f50 0x7f02d0154270 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:38.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.448+0000 7f02d5c00640 1 --2- 172.21.15.90:0/4036911853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02d00ac5d0 0x7f02d0142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:38.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.448+0000 7f02d5c00640 1 -- 172.21.15.90:0/4036911853 >> 172.21.15.90:0/4036911853 conn(0x7f02d00c85a0 msgr2=0x7f02d0156460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:38.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.448+0000 7f02d5c00640 1 -- 172.21.15.90:0/4036911853 shutdown_connections 2024-09-21T03:14:38.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.448+0000 7f02d5c00640 1 -- 172.21.15.90:0/4036911853 wait complete. 2024-09-21T03:14:38.501 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:14:38.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.718+0000 7ffa1da00640 1 -- 172.21.15.90:0/1087497489 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa180c55a0 msgr2=0x7ffa1813cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:38.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.718+0000 7ffa1da00640 1 --2- 172.21.15.90:0/1087497489 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa180c55a0 0x7ffa1813cfe0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ffa00005fd0 tx=0x7ffa0002a540 comp rx=0 tx=0).stop 2024-09-21T03:14:38.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.718+0000 7ffa1da00640 1 -- 172.21.15.90:0/1087497489 shutdown_connections 2024-09-21T03:14:38.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.718+0000 7ffa1da00640 1 --2- 172.21.15.90:0/1087497489 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa180c55a0 0x7ffa1813cfe0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:38.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.718+0000 7ffa1da00640 1 --2- 172.21.15.90:0/1087497489 >> v2:172.21.15.149:3300/0 conn(0x7ffa1813ddc0 0x7ffa180c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:38.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.718+0000 7ffa1da00640 1 -- 172.21.15.90:0/1087497489 >> 172.21.15.90:0/1087497489 conn(0x7ffa180c84c0 msgr2=0x7ffa180c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:38.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.718+0000 7ffa1da00640 1 -- 172.21.15.90:0/1087497489 shutdown_connections 2024-09-21T03:14:38.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.718+0000 7ffa1da00640 1 -- 172.21.15.90:0/1087497489 wait complete. 2024-09-21T03:14:38.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.720+0000 7ffa1da00640 1 Processor -- start 2024-09-21T03:14:38.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.720+0000 7ffa1da00640 1 -- start start 2024-09-21T03:14:38.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.722+0000 7ffa1da00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa180c55a0 0x7ffa1806fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:38.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.722+0000 7ffa1da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa1813d520 0x7ffa18156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:38.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.722+0000 7ffa1da00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa1813ddc0 0x7ffa18153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:38.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.722+0000 7ffa1da00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1813dab0 con 0x7ffa180c55a0 2024-09-21T03:14:38.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.722+0000 7ffa1da00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1813d930 con 0x7ffa1813ddc0 2024-09-21T03:14:38.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.722+0000 7ffa1da00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ffa18155170 con 0x7ffa1813d520 2024-09-21T03:14:38.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.722+0000 7ffa17e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa180c55a0 0x7ffa1806fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:38.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.722+0000 7ffa17e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa180c55a0 0x7ffa1806fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37964/0 (socket says 172.21.15.90:37964) 2024-09-21T03:14:38.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.722+0000 7ffa17e00640 1 -- 172.21.15.90:0/3783193396 learned_addr learned my addr 172.21.15.90:0/3783193396 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:38.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.722+0000 7ffa0f400640 1 --2- 172.21.15.90:0/3783193396 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa1813d520 0x7ffa18156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:38.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.722+0000 7ffa1d000640 1 --2- 172.21.15.90:0/3783193396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa1813ddc0 0x7ffa18153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:38.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.723+0000 7ffa17e00640 1 -- 172.21.15.90:0/3783193396 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa1813d520 msgr2=0x7ffa18156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:38.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.723+0000 7ffa17e00640 1 --2- 172.21.15.90:0/3783193396 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa1813d520 0x7ffa18156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:38.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.723+0000 7ffa17e00640 1 -- 172.21.15.90:0/3783193396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa1813ddc0 msgr2=0x7ffa18153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:38.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.723+0000 7ffa17e00640 1 --2- 172.21.15.90:0/3783193396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa1813ddc0 0x7ffa18153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:38.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.723+0000 7ffa17e00640 1 -- 172.21.15.90:0/3783193396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa181390d0 con 0x7ffa180c55a0 2024-09-21T03:14:38.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.723+0000 7ffa17e00640 1 --2- 172.21.15.90:0/3783193396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa180c55a0 0x7ffa1806fc70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffa08009fd0 tx=0x7ffa0800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:38.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.723+0000 7ffa14c00640 1 -- 172.21.15.90:0/3783193396 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0800ccc0 con 0x7ffa180c55a0 2024-09-21T03:14:38.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.723+0000 7ffa14c00640 1 -- 172.21.15.90:0/3783193396 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa0800ee70 con 0x7ffa180c55a0 2024-09-21T03:14:38.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.723+0000 7ffa14c00640 1 -- 172.21.15.90:0/3783193396 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0800ce60 con 0x7ffa180c55a0 2024-09-21T03:14:38.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.723+0000 7ffa1da00640 1 -- 172.21.15.90:0/3783193396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa1813c020 con 0x7ffa180c55a0 2024-09-21T03:14:38.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.723+0000 7ffa1da00640 1 -- 172.21.15.90:0/3783193396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa18157920 con 0x7ffa180c55a0 2024-09-21T03:14:38.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.724+0000 7ffa1da00640 1 -- 172.21.15.90:0/3783193396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa18155620 con 0x7ffa180c55a0 2024-09-21T03:14:38.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.726+0000 7ffa14c00640 1 -- 172.21.15.90:0/3783193396 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffa08004280 con 0x7ffa180c55a0 2024-09-21T03:14:38.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.727+0000 7ffa14c00640 1 --2- 172.21.15.90:0/3783193396 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff9f4078b90 0x7ff9f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:38.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.727+0000 7ffa14c00640 1 -- 172.21.15.90:0/3783193396 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7ffa0809b560 con 0x7ffa180c55a0 2024-09-21T03:14:38.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.727+0000 7ffa0f400640 1 --2- 172.21.15.90:0/3783193396 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff9f4078b90 0x7ff9f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:38.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.728+0000 7ffa0f400640 1 --2- 172.21.15.90:0/3783193396 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff9f4078b90 0x7ff9f407b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffa00033000 tx=0x7ffa00004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:38.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.732+0000 7ffa14c00640 1 -- 172.21.15.90:0/3783193396 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ffa08063ad0 con 0x7ffa180c55a0 2024-09-21T03:14:38.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.916+0000 7ffa1da00640 1 -- 172.21.15.90:0/3783193396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffa181e2d00 con 0x7ffa180c55a0 2024-09-21T03:14:38.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.918+0000 7ffa14c00640 1 -- 172.21.15.90:0/3783193396 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16674 (secure 0 0 0) 0x7ffa080633d0 con 0x7ffa180c55a0 2024-09-21T03:14:38.921 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:38.921 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","created":"2024-09-21T03:14:09.323302+0000","modified":"2024-09-21T03:14:37.954920+0000","last_up_change":"2024-09-21T03:14:25.329650+0000","last_in_change":"2024-09-21T03:14:15.386953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:14:24.511246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-21T03:14:35.815250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-21T03:14:36.914615+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ceaacfab-e71c-45e2-ac50-4597dfd460bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6809","nonce":3187794863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6811","nonce":3187794863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6815","nonce":3187794863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6813","nonce":3187794863}]},"public_addr":"172.21.15.90:6809/3187794863","cluster_addr":"172.21.15.90:6811/3187794863","heartbeat_back_addr":"172.21.15.90:6815/3187794863","heartbeat_front_addr":"172.21.15.90:6813/3187794863","state":["exists","up"]},{"osd":1,"uuid":"86f91523-232b-4e80-ada7-d9e12770adb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6801","nonce":3769758484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6803","nonce":3769758484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6807","nonce":3769758484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6805","nonce":3769758484}]},"public_addr":"172.21.15.90:6801/3769758484","cluster_addr":"172.21.15.90:6803/3769758484","heartbeat_back_addr":"172.21.15.90:6807/3769758484","heartbeat_front_addr":"172.21.15.90:6805/3769758484","state":["exists","up"]},{"osd":2,"uuid":"6eb0f47b-e767-49c0-8d72-07f71b9c2e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6825","nonce":1025535744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6827","nonce":1025535744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6831","nonce":1025535744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6829","nonce":1025535744}]},"public_addr":"172.21.15.90:6825/1025535744","cluster_addr":"172.21.15.90:6827/1025535744","heartbeat_back_addr":"172.21.15.90:6831/1025535744","heartbeat_front_addr":"172.21.15.90:6829/1025535744","state":["exists","up"]},{"osd":3,"uuid":"64418862-beef-479c-be11-dfe0e515e09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6817","nonce":1515884437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6819","nonce":1515884437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6823","nonce":1515884437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6821","nonce":1515884437}]},"public_addr":"172.21.15.90:6817/1515884437","cluster_addr":"172.21.15.90:6819/1515884437","heartbeat_back_addr":"172.21.15.90:6823/1515884437","heartbeat_front_addr":"172.21.15.90:6821/1515884437","state":["exists","up"]},{"osd":4,"uuid":"a05b63f4-ec0a-426c-9d60-285e2680a897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6816","nonce":4278726553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6820","nonce":4278726553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6825","nonce":4278726553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6823","nonce":4278726553}]},"public_addr":"172.21.15.149:6816/4278726553","cluster_addr":"172.21.15.149:6820/4278726553","heartbeat_back_addr":"172.21.15.149:6825/4278726553","heartbeat_front_addr":"172.21.15.149:6823/4278726553","state":["exists","up"]},{"osd":5,"uuid":"3a1bab89-963c-4fe7-b14f-3080c5cf7830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6827","nonce":1341677333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6829","nonce":1341677333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6833","nonce":1341677333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6831","nonce":1341677333}]},"public_addr":"172.21.15.149:6827/1341677333","cluster_addr":"172.21.15.149:6829/1341677333","heartbeat_back_addr":"172.21.15.149:6833/1341677333","heartbeat_front_addr":"172.21.15.149:6831/1341677333","state":["exists","up"]},{"osd":6,"uuid":"bfcd1596-2688-4deb-be2e-55f305a5b4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6811","nonce":821196931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6813","nonce":821196931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6821","nonce":821196931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6817","nonce":821196931}]},"public_addr":"172.21.15.149:6811/821196931","cluster_addr":"172.21.15.149:6813/821196931","heartbeat_back_addr":"172.21.15.149:6821/821196931","heartbeat_front_addr":"172.21.15.149:6817/821196931","state":["exists","up"]},{"osd":7,"uuid":"58b19790-4006-4f07-966c-911b938cc1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6803","nonce":1657326880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6805","nonce":1657326880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6809","nonce":1657326880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6807","nonce":1657326880}]},"public_addr":"172.21.15.149:6803/1657326880","cluster_addr":"172.21.15.149:6805/1657326880","heartbeat_back_addr":"172.21.15.149:6809/1657326880","heartbeat_front_addr":"172.21.15.149:6807/1657326880","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.399701+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.051745+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.190159+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:23.240143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.446570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.259974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:21.990407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.459259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:14:38.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.920+0000 7ffa1da00640 1 -- 172.21.15.90:0/3783193396 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff9f4078b90 msgr2=0x7ff9f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:38.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.920+0000 7ffa1da00640 1 --2- 172.21.15.90:0/3783193396 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff9f4078b90 0x7ff9f407b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffa00033000 tx=0x7ffa00004730 comp rx=0 tx=0).stop 2024-09-21T03:14:38.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.920+0000 7ffa1da00640 1 -- 172.21.15.90:0/3783193396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa180c55a0 msgr2=0x7ffa1806fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:38.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.920+0000 7ffa1da00640 1 --2- 172.21.15.90:0/3783193396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa180c55a0 0x7ffa1806fc70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffa08009fd0 tx=0x7ffa0800ec20 comp rx=0 tx=0).stop 2024-09-21T03:14:38.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.920+0000 7ffa1da00640 1 -- 172.21.15.90:0/3783193396 shutdown_connections 2024-09-21T03:14:38.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.920+0000 7ffa1da00640 1 --2- 172.21.15.90:0/3783193396 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff9f4078b90 0x7ff9f407b0a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:38.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.920+0000 7ffa1da00640 1 --2- 172.21.15.90:0/3783193396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa1813ddc0 0x7ffa18153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:38.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.920+0000 7ffa1da00640 1 --2- 172.21.15.90:0/3783193396 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa1813d520 0x7ffa18156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:38.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.920+0000 7ffa1da00640 1 --2- 172.21.15.90:0/3783193396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa180c55a0 0x7ffa1806fc70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:38.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.920+0000 7ffa1da00640 1 -- 172.21.15.90:0/3783193396 >> 172.21.15.90:0/3783193396 conn(0x7ffa180c84c0 msgr2=0x7ffa180c33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:38.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.920+0000 7ffa1da00640 1 -- 172.21.15.90:0/3783193396 shutdown_connections 2024-09-21T03:14:38.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:38.920+0000 7ffa1da00640 1 -- 172.21.15.90:0/3783193396 wait complete. 2024-09-21T03:14:38.944 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:14:39.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.162+0000 7f806e000640 1 -- 172.21.15.90:0/2152741417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80680ac350 msgr2=0x7f80680ac760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:39.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.162+0000 7f806e000640 1 --2- 172.21.15.90:0/2152741417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80680ac350 0x7f80680ac760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8050009830 tx=0x7f805002a530 comp rx=0 tx=0).stop 2024-09-21T03:14:39.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.162+0000 7f806e000640 1 -- 172.21.15.90:0/2152741417 shutdown_connections 2024-09-21T03:14:39.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.162+0000 7f806e000640 1 --2- 172.21.15.90:0/2152741417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80680ac350 0x7f80680ac760 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:39.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.162+0000 7f806e000640 1 -- 172.21.15.90:0/2152741417 >> 172.21.15.90:0/2152741417 conn(0x7f80680c8ba0 msgr2=0x7f806806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:39.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.162+0000 7f806e000640 1 -- 172.21.15.90:0/2152741417 shutdown_connections 2024-09-21T03:14:39.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.162+0000 7f806e000640 1 -- 172.21.15.90:0/2152741417 wait complete. 2024-09-21T03:14:39.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.164+0000 7f806e000640 1 Processor -- start 2024-09-21T03:14:39.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.164+0000 7f806e000640 1 -- start start 2024-09-21T03:14:39.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.166+0000 7f806e000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f806806d960 0x7f806814f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:39.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.166+0000 7f806e000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80680ac350 0x7f80681eea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:39.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.166+0000 7f806e000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80680acca0 0x7f80680c3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:39.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.166+0000 7f806e000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8068074930 con 0x7f806806d960 2024-09-21T03:14:39.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.166+0000 7f806e000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f80680abec0 con 0x7f80680ac350 2024-09-21T03:14:39.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.166+0000 7f806e000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8068074ab0 con 0x7f80680acca0 2024-09-21T03:14:39.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.166+0000 7f8067400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f806806d960 0x7f806814f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:39.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.166+0000 7f8067400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f806806d960 0x7f806814f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37988/0 (socket says 172.21.15.90:37988) 2024-09-21T03:14:39.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.166+0000 7f8067400640 1 -- 172.21.15.90:0/3138000712 learned_addr learned my addr 172.21.15.90:0/3138000712 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:39.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.166+0000 7f805ea00640 1 --2- 172.21.15.90:0/3138000712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80680ac350 0x7f80681eea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:39.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.166+0000 7f8067e00640 1 --2- 172.21.15.90:0/3138000712 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80680acca0 0x7f80680c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:39.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.166+0000 7f8067400640 1 -- 172.21.15.90:0/3138000712 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80680acca0 msgr2=0x7f80680c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:39.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.166+0000 7f8067400640 1 --2- 172.21.15.90:0/3138000712 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80680acca0 0x7f80680c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:39.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.166+0000 7f8067400640 1 -- 172.21.15.90:0/3138000712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80680ac350 msgr2=0x7f80681eea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:39.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.166+0000 7f8067400640 1 --2- 172.21.15.90:0/3138000712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80680ac350 0x7f80681eea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:39.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.166+0000 7f8067400640 1 -- 172.21.15.90:0/3138000712 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80680c6de0 con 0x7f806806d960 2024-09-21T03:14:39.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.166+0000 7f8067e00640 1 --2- 172.21.15.90:0/3138000712 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80680acca0 0x7f80680c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:14:39.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.167+0000 7f8067400640 1 --2- 172.21.15.90:0/3138000712 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f806806d960 0x7f806814f370 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f805800c430 tx=0x7f805800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:39.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.167+0000 7f805fe00640 1 -- 172.21.15.90:0/3138000712 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8058011790 con 0x7f806806d960 2024-09-21T03:14:39.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.167+0000 7f805fe00640 1 -- 172.21.15.90:0/3138000712 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8058017070 con 0x7f806806d960 2024-09-21T03:14:39.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.167+0000 7f805fe00640 1 -- 172.21.15.90:0/3138000712 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8058011cc0 con 0x7f806806d960 2024-09-21T03:14:39.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.167+0000 7f806e000640 1 -- 172.21.15.90:0/3138000712 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80681e0ed0 con 0x7f806806d960 2024-09-21T03:14:39.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.167+0000 7f806e000640 1 -- 172.21.15.90:0/3138000712 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80681ee290 con 0x7f806806d960 2024-09-21T03:14:39.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.168+0000 7f806e000640 1 -- 172.21.15.90:0/3138000712 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80681eae50 con 0x7f806806d960 2024-09-21T03:14:39.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.169+0000 7f805fe00640 1 -- 172.21.15.90:0/3138000712 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f805801c460 con 0x7f806806d960 2024-09-21T03:14:39.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.170+0000 7f805fe00640 1 --2- 172.21.15.90:0/3138000712 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8044078b90 0x7f804407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:39.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.170+0000 7f805fe00640 1 -- 172.21.15.90:0/3138000712 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f805809a7f0 con 0x7f806806d960 2024-09-21T03:14:39.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.171+0000 7f805ea00640 1 --2- 172.21.15.90:0/3138000712 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8044078b90 0x7f804407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:39.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.172+0000 7f805ea00640 1 --2- 172.21.15.90:0/3138000712 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8044078b90 0x7f804407b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8050034000 tx=0x7f8050004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:39.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.175+0000 7f805fe00640 1 -- 172.21.15.90:0/3138000712 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f80681eae50 con 0x7f806806d960 2024-09-21T03:14:39.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.363+0000 7f806e000640 1 -- 172.21.15.90:0/3138000712 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f80680ac760 con 0x7f806806d960 2024-09-21T03:14:39.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.364+0000 7f805fe00640 1 -- 172.21.15.90:0/3138000712 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16674 (secure 0 0 0) 0x7f8058021020 con 0x7f806806d960 2024-09-21T03:14:39.366 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:39.366 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","created":"2024-09-21T03:14:09.323302+0000","modified":"2024-09-21T03:14:37.954920+0000","last_up_change":"2024-09-21T03:14:25.329650+0000","last_in_change":"2024-09-21T03:14:15.386953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:14:24.511246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-21T03:14:35.815250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-21T03:14:36.914615+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ceaacfab-e71c-45e2-ac50-4597dfd460bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6809","nonce":3187794863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6811","nonce":3187794863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6815","nonce":3187794863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6813","nonce":3187794863}]},"public_addr":"172.21.15.90:6809/3187794863","cluster_addr":"172.21.15.90:6811/3187794863","heartbeat_back_addr":"172.21.15.90:6815/3187794863","heartbeat_front_addr":"172.21.15.90:6813/3187794863","state":["exists","up"]},{"osd":1,"uuid":"86f91523-232b-4e80-ada7-d9e12770adb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6801","nonce":3769758484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6803","nonce":3769758484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6807","nonce":3769758484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6805","nonce":3769758484}]},"public_addr":"172.21.15.90:6801/3769758484","cluster_addr":"172.21.15.90:6803/3769758484","heartbeat_back_addr":"172.21.15.90:6807/3769758484","heartbeat_front_addr":"172.21.15.90:6805/3769758484","state":["exists","up"]},{"osd":2,"uuid":"6eb0f47b-e767-49c0-8d72-07f71b9c2e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6825","nonce":1025535744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6827","nonce":1025535744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6831","nonce":1025535744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6829","nonce":1025535744}]},"public_addr":"172.21.15.90:6825/1025535744","cluster_addr":"172.21.15.90:6827/1025535744","heartbeat_back_addr":"172.21.15.90:6831/1025535744","heartbeat_front_addr":"172.21.15.90:6829/1025535744","state":["exists","up"]},{"osd":3,"uuid":"64418862-beef-479c-be11-dfe0e515e09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6817","nonce":1515884437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6819","nonce":1515884437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6823","nonce":1515884437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6821","nonce":1515884437}]},"public_addr":"172.21.15.90:6817/1515884437","cluster_addr":"172.21.15.90:6819/1515884437","heartbeat_back_addr":"172.21.15.90:6823/1515884437","heartbeat_front_addr":"172.21.15.90:6821/1515884437","state":["exists","up"]},{"osd":4,"uuid":"a05b63f4-ec0a-426c-9d60-285e2680a897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6816","nonce":4278726553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6820","nonce":4278726553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6825","nonce":4278726553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6823","nonce":4278726553}]},"public_addr":"172.21.15.149:6816/4278726553","cluster_addr":"172.21.15.149:6820/4278726553","heartbeat_back_addr":"172.21.15.149:6825/4278726553","heartbeat_front_addr":"172.21.15.149:6823/4278726553","state":["exists","up"]},{"osd":5,"uuid":"3a1bab89-963c-4fe7-b14f-3080c5cf7830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6827","nonce":1341677333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6829","nonce":1341677333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6833","nonce":1341677333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6831","nonce":1341677333}]},"public_addr":"172.21.15.149:6827/1341677333","cluster_addr":"172.21.15.149:6829/1341677333","heartbeat_back_addr":"172.21.15.149:6833/1341677333","heartbeat_front_addr":"172.21.15.149:6831/1341677333","state":["exists","up"]},{"osd":6,"uuid":"bfcd1596-2688-4deb-be2e-55f305a5b4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6811","nonce":821196931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6813","nonce":821196931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6821","nonce":821196931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6817","nonce":821196931}]},"public_addr":"172.21.15.149:6811/821196931","cluster_addr":"172.21.15.149:6813/821196931","heartbeat_back_addr":"172.21.15.149:6821/821196931","heartbeat_front_addr":"172.21.15.149:6817/821196931","state":["exists","up"]},{"osd":7,"uuid":"58b19790-4006-4f07-966c-911b938cc1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6803","nonce":1657326880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6805","nonce":1657326880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6809","nonce":1657326880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6807","nonce":1657326880}]},"public_addr":"172.21.15.149:6803/1657326880","cluster_addr":"172.21.15.149:6805/1657326880","heartbeat_back_addr":"172.21.15.149:6809/1657326880","heartbeat_front_addr":"172.21.15.149:6807/1657326880","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.399701+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.051745+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.190159+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:23.240143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.446570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.259974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:21.990407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.459259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:14:39.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.366+0000 7f806e000640 1 -- 172.21.15.90:0/3138000712 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8044078b90 msgr2=0x7f804407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:39.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.366+0000 7f806e000640 1 --2- 172.21.15.90:0/3138000712 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8044078b90 0x7f804407b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8050034000 tx=0x7f8050004730 comp rx=0 tx=0).stop 2024-09-21T03:14:39.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.366+0000 7f806e000640 1 -- 172.21.15.90:0/3138000712 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f806806d960 msgr2=0x7f806814f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:39.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.366+0000 7f806e000640 1 --2- 172.21.15.90:0/3138000712 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f806806d960 0x7f806814f370 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f805800c430 tx=0x7f805800c8f0 comp rx=0 tx=0).stop 2024-09-21T03:14:39.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.366+0000 7f806e000640 1 -- 172.21.15.90:0/3138000712 shutdown_connections 2024-09-21T03:14:39.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.366+0000 7f806e000640 1 --2- 172.21.15.90:0/3138000712 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8044078b90 0x7f804407b0a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:39.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.366+0000 7f806e000640 1 --2- 172.21.15.90:0/3138000712 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80680acca0 0x7f80680c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:39.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.366+0000 7f806e000640 1 --2- 172.21.15.90:0/3138000712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80680ac350 0x7f80681eea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:39.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.366+0000 7f806e000640 1 --2- 172.21.15.90:0/3138000712 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f806806d960 0x7f806814f370 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:39.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.366+0000 7f806e000640 1 -- 172.21.15.90:0/3138000712 >> 172.21.15.90:0/3138000712 conn(0x7f80680c8ba0 msgr2=0x7f806813ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:39.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.367+0000 7f806e000640 1 -- 172.21.15.90:0/3138000712 shutdown_connections 2024-09-21T03:14:39.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.367+0000 7f806e000640 1 -- 172.21.15.90:0/3138000712 wait complete. 2024-09-21T03:14:39.389 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a standby_count_wanted 0 2024-09-21T03:14:39.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.612+0000 7f5ffee00640 1 -- 172.21.15.90:0/569602667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ff81522b0 msgr2=0x7f5ff8154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:39.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.612+0000 7f5ffee00640 1 --2- 172.21.15.90:0/569602667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ff81522b0 0x7f5ff8154b00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4005fd0 tx=0x7f5fe402a540 comp rx=0 tx=0).stop 2024-09-21T03:14:39.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.613+0000 7f5ffee00640 1 -- 172.21.15.90:0/569602667 shutdown_connections 2024-09-21T03:14:39.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.613+0000 7f5ffee00640 1 --2- 172.21.15.90:0/569602667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ff81522b0 0x7f5ff8154b00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:39.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.613+0000 7f5ffee00640 1 --2- 172.21.15.90:0/569602667 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ff80aff90 0x7f5ff80c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:39.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.613+0000 7f5ffee00640 1 -- 172.21.15.90:0/569602667 >> 172.21.15.90:0/569602667 conn(0x7f5ff80ac330 msgr2=0x7f5ff80ac740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:39.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.613+0000 7f5ffee00640 1 -- 172.21.15.90:0/569602667 shutdown_connections 2024-09-21T03:14:39.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.613+0000 7f5ffee00640 1 -- 172.21.15.90:0/569602667 wait complete. 2024-09-21T03:14:39.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.615+0000 7f5ffee00640 1 Processor -- start 2024-09-21T03:14:39.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.615+0000 7f5ffee00640 1 -- start start 2024-09-21T03:14:39.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.616+0000 7f5ffee00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ff80aff90 0x7f5ff8151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:39.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.616+0000 7f5ffee00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ff80c5130 0x7f5ff8155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:39.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.616+0000 7f5ffee00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ff81522b0 0x7f5ff80ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:39.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.616+0000 7f5ffee00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff81526c0 con 0x7f5ff80aff90 2024-09-21T03:14:39.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.616+0000 7f5ffee00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff80c4c10 con 0x7f5ff80c5130 2024-09-21T03:14:39.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.616+0000 7f5ffee00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff80c7830 con 0x7f5ff81522b0 2024-09-21T03:14:39.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.616+0000 7f5ff7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ff80aff90 0x7f5ff8151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:39.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.616+0000 7f5ff7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ff80aff90 0x7f5ff8151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38000/0 (socket says 172.21.15.90:38000) 2024-09-21T03:14:39.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.617+0000 7f5ff7e00640 1 -- 172.21.15.90:0/2599474363 learned_addr learned my addr 172.21.15.90:0/2599474363 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:39.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.617+0000 7f5ff7400640 1 --2- 172.21.15.90:0/2599474363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ff80c5130 0x7f5ff8155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:39.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.617+0000 7f5ffce00640 1 --2- 172.21.15.90:0/2599474363 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ff81522b0 0x7f5ff80ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:39.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.617+0000 7f5ff7e00640 1 -- 172.21.15.90:0/2599474363 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ff81522b0 msgr2=0x7f5ff80ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:39.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.617+0000 7f5ff7e00640 1 --2- 172.21.15.90:0/2599474363 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ff81522b0 0x7f5ff80ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:39.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.617+0000 7f5ff7e00640 1 -- 172.21.15.90:0/2599474363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ff80c5130 msgr2=0x7f5ff8155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:39.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.617+0000 7f5ff7e00640 1 --2- 172.21.15.90:0/2599474363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ff80c5130 0x7f5ff8155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:39.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.617+0000 7f5ff7e00640 1 -- 172.21.15.90:0/2599474363 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff81eeac0 con 0x7f5ff80aff90 2024-09-21T03:14:39.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.617+0000 7f5ff7e00640 1 --2- 172.21.15.90:0/2599474363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ff80aff90 0x7f5ff8151920 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800d700 tx=0x7f5fe800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:39.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.617+0000 7f5fefe00640 1 -- 172.21.15.90:0/2599474363 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8017070 con 0x7f5ff80aff90 2024-09-21T03:14:39.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.618+0000 7f5fefe00640 1 -- 172.21.15.90:0/2599474363 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fe8005310 con 0x7f5ff80aff90 2024-09-21T03:14:39.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.618+0000 7f5ffee00640 1 -- 172.21.15.90:0/2599474363 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff81eeda0 con 0x7f5ff80aff90 2024-09-21T03:14:39.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.618+0000 7f5fefe00640 1 -- 172.21.15.90:0/2599474363 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8009820 con 0x7f5ff80aff90 2024-09-21T03:14:39.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.618+0000 7f5ffee00640 1 -- 172.21.15.90:0/2599474363 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff80ae1e0 con 0x7f5ff80aff90 2024-09-21T03:14:39.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.619+0000 7f5ffee00640 1 -- 172.21.15.90:0/2599474363 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff80c5540 con 0x7f5ff80aff90 2024-09-21T03:14:39.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.620+0000 7f5fefe00640 1 -- 172.21.15.90:0/2599474363 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5fe80099c0 con 0x7f5ff80aff90 2024-09-21T03:14:39.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.621+0000 7f5fefe00640 1 --2- 172.21.15.90:0/2599474363 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5fd8078b90 0x7f5fd807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:39.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.621+0000 7f5fefe00640 1 -- 172.21.15.90:0/2599474363 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f5fe809ad50 con 0x7f5ff80aff90 2024-09-21T03:14:39.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.621+0000 7f5ff7400640 1 --2- 172.21.15.90:0/2599474363 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5fd8078b90 0x7f5fd807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:39.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.622+0000 7f5ff7400640 1 --2- 172.21.15.90:0/2599474363 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5fd8078b90 0x7f5fd807b0a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4033000 tx=0x7f5fe4004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:39.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.626+0000 7f5fefe00640 1 -- 172.21.15.90:0/2599474363 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5fe8062bd0 con 0x7f5ff80aff90 2024-09-21T03:14:39.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:39.850+0000 7f5ffee00640 1 -- 172.21.15.90:0/2599474363 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5ff80c59a0 con 0x7f5ff80aff90 2024-09-21T03:14:40.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.480+0000 7f5fefe00640 1 -- 172.21.15.90:0/2599474363 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 113+0+0 (secure 0 0 0) 0x7f5fe8067600 con 0x7f5ff80aff90 2024-09-21T03:14:40.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.484+0000 7f5ffee00640 1 -- 172.21.15.90:0/2599474363 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5fd8078b90 msgr2=0x7f5fd807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:40.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.484+0000 7f5ffee00640 1 --2- 172.21.15.90:0/2599474363 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5fd8078b90 0x7f5fd807b0a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4033000 tx=0x7f5fe4004730 comp rx=0 tx=0).stop 2024-09-21T03:14:40.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.484+0000 7f5ffee00640 1 -- 172.21.15.90:0/2599474363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ff80aff90 msgr2=0x7f5ff8151920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:40.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.484+0000 7f5ffee00640 1 --2- 172.21.15.90:0/2599474363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ff80aff90 0x7f5ff8151920 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800d700 tx=0x7f5fe800dbc0 comp rx=0 tx=0).stop 2024-09-21T03:14:40.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.484+0000 7f5ffee00640 1 -- 172.21.15.90:0/2599474363 shutdown_connections 2024-09-21T03:14:40.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.484+0000 7f5ffee00640 1 --2- 172.21.15.90:0/2599474363 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5fd8078b90 0x7f5fd807b0a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:40.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.484+0000 7f5ffee00640 1 --2- 172.21.15.90:0/2599474363 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ff81522b0 0x7f5ff80ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:40.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.484+0000 7f5ffee00640 1 --2- 172.21.15.90:0/2599474363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ff80c5130 0x7f5ff8155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:40.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.484+0000 7f5ffee00640 1 --2- 172.21.15.90:0/2599474363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ff80aff90 0x7f5ff8151920 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:40.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.484+0000 7f5ffee00640 1 -- 172.21.15.90:0/2599474363 >> 172.21.15.90:0/2599474363 conn(0x7f5ff80ac330 msgr2=0x7f5ff80763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:40.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.484+0000 7f5ffee00640 1 -- 172.21.15.90:0/2599474363 shutdown_connections 2024-09-21T03:14:40.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.484+0000 7f5ffee00640 1 -- 172.21.15.90:0/2599474363 wait complete. 2024-09-21T03:14:40.510 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-09-21T03:14:40.510 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a allow_standby_replay false 2024-09-21T03:14:40.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.731+0000 7fd819800640 1 -- 172.21.15.90:0/724224397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8140c69f0 msgr2=0x7fd8140c6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:40.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.731+0000 7fd819800640 1 --2- 172.21.15.90:0/724224397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8140c69f0 0x7fd8140c6e00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd8140ae240 tx=0x7fd7fc02a440 comp rx=0 tx=0).stop 2024-09-21T03:14:40.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.731+0000 7fd819800640 1 -- 172.21.15.90:0/724224397 shutdown_connections 2024-09-21T03:14:40.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.731+0000 7fd819800640 1 --2- 172.21.15.90:0/724224397 >> v2:172.21.15.149:3300/0 conn(0x7fd814157ee0 0x7fd8141582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:40.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.731+0000 7fd819800640 1 --2- 172.21.15.90:0/724224397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8140c69f0 0x7fd8140c6e00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:40.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.731+0000 7fd819800640 1 -- 172.21.15.90:0/724224397 >> 172.21.15.90:0/724224397 conn(0x7fd8140c9fe0 msgr2=0x7fd8140ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:40.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.731+0000 7fd819800640 1 -- 172.21.15.90:0/724224397 shutdown_connections 2024-09-21T03:14:40.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.731+0000 7fd819800640 1 -- 172.21.15.90:0/724224397 wait complete. 2024-09-21T03:14:40.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.733+0000 7fd819800640 1 Processor -- start 2024-09-21T03:14:40.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.733+0000 7fd819800640 1 -- start start 2024-09-21T03:14:40.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.735+0000 7fd819800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8140acf70 0x7fd81406f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:40.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.735+0000 7fd819800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8140c69f0 0x7fd8140c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:40.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.735+0000 7fd819800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd814157ee0 0x7fd81414b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:40.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.735+0000 7fd819800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd8140ae470 con 0x7fd8140c69f0 2024-09-21T03:14:40.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.735+0000 7fd819800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd8140c4d50 con 0x7fd814157ee0 2024-09-21T03:14:40.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.735+0000 7fd819800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd8140ae5f0 con 0x7fd8140acf70 2024-09-21T03:14:40.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.735+0000 7fd80b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8140c69f0 0x7fd8140c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:40.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.735+0000 7fd80b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8140c69f0 0x7fd8140c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38028/0 (socket says 172.21.15.90:38028) 2024-09-21T03:14:40.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.735+0000 7fd80b400640 1 -- 172.21.15.90:0/698958712 learned_addr learned my addr 172.21.15.90:0/698958712 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:40.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.735+0000 7fd818e00640 1 --2- 172.21.15.90:0/698958712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd814157ee0 0x7fd81414b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:40.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.735+0000 7fd813e00640 1 --2- 172.21.15.90:0/698958712 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8140acf70 0x7fd81406f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:40.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.735+0000 7fd80b400640 1 -- 172.21.15.90:0/698958712 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8140acf70 msgr2=0x7fd81406f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:40.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.735+0000 7fd80b400640 1 --2- 172.21.15.90:0/698958712 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8140acf70 0x7fd81406f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:40.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.735+0000 7fd80b400640 1 -- 172.21.15.90:0/698958712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd814157ee0 msgr2=0x7fd81414b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:40.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.735+0000 7fd80b400640 1 --2- 172.21.15.90:0/698958712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd814157ee0 0x7fd81414b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:40.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.735+0000 7fd80b400640 1 -- 172.21.15.90:0/698958712 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8141e0490 con 0x7fd8140c69f0 2024-09-21T03:14:40.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.735+0000 7fd818e00640 1 --2- 172.21.15.90:0/698958712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd814157ee0 0x7fd81414b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:14:40.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.735+0000 7fd813e00640 1 --2- 172.21.15.90:0/698958712 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8140acf70 0x7fd81406f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:14:40.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.736+0000 7fd80b400640 1 --2- 172.21.15.90:0/698958712 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8140c69f0 0x7fd8140c34d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc000c00 tx=0x7fd7fc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:40.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.736+0000 7fd810c00640 1 -- 172.21.15.90:0/698958712 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc03e030 con 0x7fd8140c69f0 2024-09-21T03:14:40.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.736+0000 7fd810c00640 1 -- 172.21.15.90:0/698958712 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7fc0047a0 con 0x7fd8140c69f0 2024-09-21T03:14:40.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.736+0000 7fd819800640 1 -- 172.21.15.90:0/698958712 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8141f11b0 con 0x7fd8140c69f0 2024-09-21T03:14:40.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.736+0000 7fd810c00640 1 -- 172.21.15.90:0/698958712 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc035040 con 0x7fd8140c69f0 2024-09-21T03:14:40.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.736+0000 7fd819800640 1 -- 172.21.15.90:0/698958712 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8141f1490 con 0x7fd8140c69f0 2024-09-21T03:14:40.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.737+0000 7fd819800640 1 -- 172.21.15.90:0/698958712 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8140c6e00 con 0x7fd8140c69f0 2024-09-21T03:14:40.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.738+0000 7fd810c00640 1 -- 172.21.15.90:0/698958712 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd7fc041030 con 0x7fd8140c69f0 2024-09-21T03:14:40.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.739+0000 7fd810c00640 1 --2- 172.21.15.90:0/698958712 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd7f0078b90 0x7fd7f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:40.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.739+0000 7fd810c00640 1 -- 172.21.15.90:0/698958712 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7fd7fc0bb5a0 con 0x7fd8140c69f0 2024-09-21T03:14:40.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.740+0000 7fd813e00640 1 --2- 172.21.15.90:0/698958712 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd7f0078b90 0x7fd7f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:40.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.740+0000 7fd813e00640 1 --2- 172.21.15.90:0/698958712 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd7f0078b90 0x7fd7f007b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd804006fd0 tx=0x7fd804008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:40.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.744+0000 7fd810c00640 1 -- 172.21.15.90:0/698958712 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd7fc083a70 con 0x7fd8140c69f0 2024-09-21T03:14:40.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:40.964+0000 7fd819800640 1 -- 172.21.15.90:0/698958712 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd814158df0 con 0x7fd8140c69f0 2024-09-21T03:14:41.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.483+0000 7fd810c00640 1 -- 172.21.15.90:0/698958712 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 117+0+0 (secure 0 0 0) 0x7fd7fc083370 con 0x7fd8140c69f0 2024-09-21T03:14:41.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.486+0000 7fd819800640 1 -- 172.21.15.90:0/698958712 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd7f0078b90 msgr2=0x7fd7f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:41.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.486+0000 7fd819800640 1 --2- 172.21.15.90:0/698958712 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd7f0078b90 0x7fd7f007b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd804006fd0 tx=0x7fd804008040 comp rx=0 tx=0).stop 2024-09-21T03:14:41.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.486+0000 7fd819800640 1 -- 172.21.15.90:0/698958712 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8140c69f0 msgr2=0x7fd8140c34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:41.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.486+0000 7fd819800640 1 --2- 172.21.15.90:0/698958712 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8140c69f0 0x7fd8140c34d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc000c00 tx=0x7fd7fc0039e0 comp rx=0 tx=0).stop 2024-09-21T03:14:41.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.486+0000 7fd819800640 1 -- 172.21.15.90:0/698958712 shutdown_connections 2024-09-21T03:14:41.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.486+0000 7fd819800640 1 --2- 172.21.15.90:0/698958712 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd7f0078b90 0x7fd7f007b0a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:41.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.486+0000 7fd819800640 1 --2- 172.21.15.90:0/698958712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd814157ee0 0x7fd81414b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:41.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.486+0000 7fd819800640 1 --2- 172.21.15.90:0/698958712 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8140c69f0 0x7fd8140c34d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:41.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.486+0000 7fd819800640 1 --2- 172.21.15.90:0/698958712 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8140acf70 0x7fd81406f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:41.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.486+0000 7fd819800640 1 -- 172.21.15.90:0/698958712 >> 172.21.15.90:0/698958712 conn(0x7fd8140c9fe0 msgr2=0x7fd814152760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:41.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.486+0000 7fd819800640 1 -- 172.21.15.90:0/698958712 shutdown_connections 2024-09-21T03:14:41.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.486+0000 7fd819800640 1 -- 172.21.15.90:0/698958712 wait complete. 2024-09-21T03:14:41.509 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a session_timeout 300 2024-09-21T03:14:41.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.732+0000 7f43cd000640 1 -- 172.21.15.90:0/439747318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43ac003a00 msgr2=0x7f43ac003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:41.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.732+0000 7f43cd000640 1 --2- 172.21.15.90:0/439747318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43ac003a00 0x7f43ac003e70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009b50 tx=0x7f43ac005830 comp rx=0 tx=0).stop 2024-09-21T03:14:41.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.732+0000 7f43c6800640 1 -- 172.21.15.90:0/439747318 reap_dead start 2024-09-21T03:14:41.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.732+0000 7f43cd000640 1 -- 172.21.15.90:0/439747318 shutdown_connections 2024-09-21T03:14:41.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.732+0000 7f43cd000640 1 -- 172.21.15.90:0/439747318 >> 172.21.15.90:0/439747318 conn(0x7f43c80c85a0 msgr2=0x7f43c80c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:41.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.732+0000 7f43cd000640 1 -- 172.21.15.90:0/439747318 shutdown_connections 2024-09-21T03:14:41.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.732+0000 7f43cd000640 1 -- 172.21.15.90:0/439747318 wait complete. 2024-09-21T03:14:41.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.734+0000 7f43cd000640 1 Processor -- start 2024-09-21T03:14:41.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.734+0000 7f43cd000640 1 -- start start 2024-09-21T03:14:41.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.736+0000 7f43cd000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43ac003a00 0x7f43c8149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:41.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.736+0000 7f43cd000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43c80c1bd0 0x7f43c8150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:41.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.736+0000 7f43cd000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c8150c40 0x7f43c8146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:41.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.736+0000 7f43cd000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f43c8152430 con 0x7f43c8150c40 2024-09-21T03:14:41.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.736+0000 7f43cd000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f43c81522b0 con 0x7f43c80c1bd0 2024-09-21T03:14:41.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.736+0000 7f43cd000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f43c81525b0 con 0x7f43ac003a00 2024-09-21T03:14:41.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.736+0000 7f43c6800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c8150c40 0x7f43c8146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:41.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.736+0000 7f43c6800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c8150c40 0x7f43c8146f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38052/0 (socket says 172.21.15.90:38052) 2024-09-21T03:14:41.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.736+0000 7f43c6800640 1 -- 172.21.15.90:0/2986250161 learned_addr learned my addr 172.21.15.90:0/2986250161 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:41.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.736+0000 7f43c5e00640 1 --2- 172.21.15.90:0/2986250161 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43ac003a00 0x7f43c8149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:41.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.736+0000 7f43c5400640 1 --2- 172.21.15.90:0/2986250161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43c80c1bd0 0x7f43c8150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:41.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.736+0000 7f43c6800640 1 -- 172.21.15.90:0/2986250161 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43ac003a00 msgr2=0x7f43c8149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:41.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.736+0000 7f43c6800640 1 --2- 172.21.15.90:0/2986250161 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43ac003a00 0x7f43c8149ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:41.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.736+0000 7f43c6800640 1 -- 172.21.15.90:0/2986250161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43c80c1bd0 msgr2=0x7f43c8150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:41.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.736+0000 7f43c6800640 1 --2- 172.21.15.90:0/2986250161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43c80c1bd0 0x7f43c8150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:41.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.736+0000 7f43c6800640 1 -- 172.21.15.90:0/2986250161 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c8147a50 con 0x7f43c8150c40 2024-09-21T03:14:41.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.737+0000 7f43c6800640 1 --2- 172.21.15.90:0/2986250161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c8150c40 0x7f43c8146f20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f43c80ac830 tx=0x7f43c000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:41.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.737+0000 7f43be000640 1 -- 172.21.15.90:0/2986250161 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c0015020 con 0x7f43c8150c40 2024-09-21T03:14:41.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.737+0000 7f43be000640 1 -- 172.21.15.90:0/2986250161 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43c000cb10 con 0x7f43c8150c40 2024-09-21T03:14:41.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.737+0000 7f43cd000640 1 -- 172.21.15.90:0/2986250161 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c81481b0 con 0x7f43c8150c40 2024-09-21T03:14:41.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.737+0000 7f43be000640 1 -- 172.21.15.90:0/2986250161 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c0011460 con 0x7f43c8150c40 2024-09-21T03:14:41.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.737+0000 7f43cd000640 1 -- 172.21.15.90:0/2986250161 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c814a8b0 con 0x7f43c8150c40 2024-09-21T03:14:41.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.738+0000 7f43cd000640 1 -- 172.21.15.90:0/2986250161 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43c80737f0 con 0x7f43c8150c40 2024-09-21T03:14:41.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.739+0000 7f43be000640 1 -- 172.21.15.90:0/2986250161 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f43c0018020 con 0x7f43c8150c40 2024-09-21T03:14:41.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.740+0000 7f43be000640 1 --2- 172.21.15.90:0/2986250161 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f43a8078b90 0x7f43a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:41.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.740+0000 7f43be000640 1 -- 172.21.15.90:0/2986250161 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f43c009afe0 con 0x7f43c8150c40 2024-09-21T03:14:41.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.741+0000 7f43c5e00640 1 --2- 172.21.15.90:0/2986250161 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f43a8078b90 0x7f43a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:41.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.742+0000 7f43c5e00640 1 --2- 172.21.15.90:0/2986250161 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f43a8078b90 0x7f43a807b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009b50 tx=0x7f43b802d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:41.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.745+0000 7f43be000640 1 -- 172.21.15.90:0/2986250161 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f43c001f030 con 0x7f43c8150c40 2024-09-21T03:14:41.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:41.969+0000 7f43cd000640 1 -- 172.21.15.90:0/2986250161 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"} v 0) -- 0x7f43c80c89b0 con 0x7f43c8150c40 2024-09-21T03:14:42.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.496+0000 7f43be000640 1 -- 172.21.15.90:0/2986250161 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"}]=0 v8) ==== 110+0+0 (secure 0 0 0) 0x7f43c00634f0 con 0x7f43c8150c40 2024-09-21T03:14:42.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.499+0000 7f43cd000640 1 -- 172.21.15.90:0/2986250161 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f43a8078b90 msgr2=0x7f43a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:42.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.499+0000 7f43cd000640 1 --2- 172.21.15.90:0/2986250161 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f43a8078b90 0x7f43a807b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009b50 tx=0x7f43b802d040 comp rx=0 tx=0).stop 2024-09-21T03:14:42.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.499+0000 7f43cd000640 1 -- 172.21.15.90:0/2986250161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c8150c40 msgr2=0x7f43c8146f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:42.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.499+0000 7f43cd000640 1 --2- 172.21.15.90:0/2986250161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c8150c40 0x7f43c8146f20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f43c80ac830 tx=0x7f43c000ec50 comp rx=0 tx=0).stop 2024-09-21T03:14:42.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.499+0000 7f43cd000640 1 -- 172.21.15.90:0/2986250161 shutdown_connections 2024-09-21T03:14:42.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.499+0000 7f43cd000640 1 --2- 172.21.15.90:0/2986250161 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f43a8078b90 0x7f43a807b0a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:42.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.499+0000 7f43cd000640 1 --2- 172.21.15.90:0/2986250161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c8150c40 0x7f43c8146f20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:42.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.499+0000 7f43cd000640 1 --2- 172.21.15.90:0/2986250161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43c80c1bd0 0x7f43c8150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:42.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.499+0000 7f43cd000640 1 --2- 172.21.15.90:0/2986250161 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43ac003a00 0x7f43c8149ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:42.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.499+0000 7f43cd000640 1 -- 172.21.15.90:0/2986250161 >> 172.21.15.90:0/2986250161 conn(0x7f43c80c85a0 msgr2=0x7f43c80763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:42.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.499+0000 7f43cd000640 1 -- 172.21.15.90:0/2986250161 shutdown_connections 2024-09-21T03:14:42.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.499+0000 7f43cd000640 1 -- 172.21.15.90:0/2986250161 wait complete. 2024-09-21T03:14:42.525 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'a' 2024-09-21T03:14:42.525 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:14:42.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.744+0000 7fe8a0200640 1 -- 172.21.15.90:0/554427561 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe89806d960 msgr2=0x7fe89813dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:42.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.744+0000 7fe8a0200640 1 --2- 172.21.15.90:0/554427561 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe89806d960 0x7fe89813dd40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe88c009830 tx=0x7fe88c02a530 comp rx=0 tx=0).stop 2024-09-21T03:14:42.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.744+0000 7fe8a0200640 1 -- 172.21.15.90:0/554427561 shutdown_connections 2024-09-21T03:14:42.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.744+0000 7fe8a0200640 1 --2- 172.21.15.90:0/554427561 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe89806d960 0x7fe89813dd40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:42.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.744+0000 7fe8a0200640 1 -- 172.21.15.90:0/554427561 >> 172.21.15.90:0/554427561 conn(0x7fe8980c8ba0 msgr2=0x7fe89806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:42.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.744+0000 7fe8a0200640 1 -- 172.21.15.90:0/554427561 shutdown_connections 2024-09-21T03:14:42.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.744+0000 7fe8a0200640 1 -- 172.21.15.90:0/554427561 wait complete. 2024-09-21T03:14:42.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.746+0000 7fe8a0200640 1 Processor -- start 2024-09-21T03:14:42.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.746+0000 7fe8a0200640 1 -- start start 2024-09-21T03:14:42.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.748+0000 7fe8a0200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe89806d960 0x7fe8980c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:42.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.748+0000 7fe8a0200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe898074220 0x7fe898138ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:42.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.748+0000 7fe8a0200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8980ac350 0x7fe8981f0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:42.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.748+0000 7fe8a0200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe8980ab640 con 0x7fe898074220 2024-09-21T03:14:42.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.748+0000 7fe8a0200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe8980abec0 con 0x7fe89806d960 2024-09-21T03:14:42.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.748+0000 7fe8a0200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe8980ace70 con 0x7fe8980ac350 2024-09-21T03:14:42.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.748+0000 7fe89ce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe898074220 0x7fe898138ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:42.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.748+0000 7fe89ce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe898074220 0x7fe898138ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38066/0 (socket says 172.21.15.90:38066) 2024-09-21T03:14:42.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.748+0000 7fe89ce00640 1 -- 172.21.15.90:0/2047845691 learned_addr learned my addr 172.21.15.90:0/2047845691 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:42.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.748+0000 7fe89d800640 1 --2- 172.21.15.90:0/2047845691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe89806d960 0x7fe8980c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:42.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.748+0000 7fe89ce00640 1 -- 172.21.15.90:0/2047845691 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8980ac350 msgr2=0x7fe8981f0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:42.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.748+0000 7fe89ce00640 1 --2- 172.21.15.90:0/2047845691 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8980ac350 0x7fe8981f0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:42.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.748+0000 7fe89ce00640 1 -- 172.21.15.90:0/2047845691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe89806d960 msgr2=0x7fe8980c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:42.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.748+0000 7fe89ce00640 1 --2- 172.21.15.90:0/2047845691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe89806d960 0x7fe8980c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:42.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.748+0000 7fe89ce00640 1 -- 172.21.15.90:0/2047845691 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8981589b0 con 0x7fe898074220 2024-09-21T03:14:42.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.748+0000 7fe89d800640 1 --2- 172.21.15.90:0/2047845691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe89806d960 0x7fe8980c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:42.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.748+0000 7fe89ce00640 1 --2- 172.21.15.90:0/2047845691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe898074220 0x7fe898138ca0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe884001eb0 tx=0x7fe88400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:42.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.749+0000 7fe895600640 1 -- 172.21.15.90:0/2047845691 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884017070 con 0x7fe898074220 2024-09-21T03:14:42.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.749+0000 7fe895600640 1 -- 172.21.15.90:0/2047845691 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8840053c0 con 0x7fe898074220 2024-09-21T03:14:42.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.749+0000 7fe895600640 1 -- 172.21.15.90:0/2047845691 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884003830 con 0x7fe898074220 2024-09-21T03:14:42.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.749+0000 7fe8a0200640 1 -- 172.21.15.90:0/2047845691 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe898158710 con 0x7fe898074220 2024-09-21T03:14:42.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.749+0000 7fe8a0200640 1 -- 172.21.15.90:0/2047845691 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe89814b7f0 con 0x7fe898074220 2024-09-21T03:14:42.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.750+0000 7fe8a0200640 1 -- 172.21.15.90:0/2047845691 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8981f0f80 con 0x7fe898074220 2024-09-21T03:14:42.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.751+0000 7fe895600640 1 -- 172.21.15.90:0/2047845691 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe88401a070 con 0x7fe898074220 2024-09-21T03:14:42.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.752+0000 7fe895600640 1 --2- 172.21.15.90:0/2047845691 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe878078bc0 0x7fe87807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:42.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.753+0000 7fe895600640 1 -- 172.21.15.90:0/2047845691 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7fe884099fe0 con 0x7fe898074220 2024-09-21T03:14:42.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.753+0000 7fe89d800640 1 --2- 172.21.15.90:0/2047845691 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe878078bc0 0x7fe87807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:42.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.754+0000 7fe89d800640 1 --2- 172.21.15.90:0/2047845691 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe878078bc0 0x7fe87807b0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe88c034000 tx=0x7fe88c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:42.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.757+0000 7fe895600640 1 -- 172.21.15.90:0/2047845691 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe8840624b0 con 0x7fe898074220 2024-09-21T03:14:42.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.979+0000 7fe8a0200640 1 -- 172.21.15.90:0/2047845691 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8981ed680 con 0x7fe898074220 2024-09-21T03:14:42.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.980+0000 7fe895600640 1 -- 172.21.15.90:0/2047845691 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5219 (secure 0 0 0) 0x7fe884061db0 con 0x7fe898074220 2024-09-21T03:14:42.981 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:42.982 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":8,"btime":"2024-09-21T03:14:42:490343+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3707484056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3707484056},{"type":"v1","addr":"172.21.15.90:6835","nonce":3707484056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1650707992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1650707992},{"type":"v1","addr":"172.21.15.149:6837","nonce":1650707992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4395,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1105275899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1105275899},{"type":"v1","addr":"172.21.15.90:6833","nonce":1105275899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:37.954868+0000","modified":"2024-09-21T03:14:41.971257+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/2166962836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2166962836},{"type":"v1","addr":"172.21.15.149:6836","nonce":2166962836}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1}]} 2024-09-21T03:14:42.982 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 8 2024-09-21T03:14:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.982+0000 7fe8a0200640 1 -- 172.21.15.90:0/2047845691 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe878078bc0 msgr2=0x7fe87807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.982+0000 7fe8a0200640 1 --2- 172.21.15.90:0/2047845691 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe878078bc0 0x7fe87807b0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe88c034000 tx=0x7fe88c004730 comp rx=0 tx=0).stop 2024-09-21T03:14:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.982+0000 7fe8a0200640 1 -- 172.21.15.90:0/2047845691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe898074220 msgr2=0x7fe898138ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.982+0000 7fe8a0200640 1 --2- 172.21.15.90:0/2047845691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe898074220 0x7fe898138ca0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe884001eb0 tx=0x7fe88400c890 comp rx=0 tx=0).stop 2024-09-21T03:14:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.982+0000 7fe8a0200640 1 -- 172.21.15.90:0/2047845691 shutdown_connections 2024-09-21T03:14:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.982+0000 7fe8a0200640 1 --2- 172.21.15.90:0/2047845691 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe878078bc0 0x7fe87807b0d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.982+0000 7fe8a0200640 1 --2- 172.21.15.90:0/2047845691 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8980ac350 0x7fe8981f0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.982+0000 7fe8a0200640 1 --2- 172.21.15.90:0/2047845691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe898074220 0x7fe898138ca0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.982+0000 7fe8a0200640 1 --2- 172.21.15.90:0/2047845691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe89806d960 0x7fe8980c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:42.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.982+0000 7fe8a0200640 1 -- 172.21.15.90:0/2047845691 >> 172.21.15.90:0/2047845691 conn(0x7fe8980c8ba0 msgr2=0x7fe8980c34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:42.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.982+0000 7fe8a0200640 1 -- 172.21.15.90:0/2047845691 shutdown_connections 2024-09-21T03:14:42.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:42.982+0000 7fe8a0200640 1 -- 172.21.15.90:0/2047845691 wait complete. 2024-09-21T03:14:43.005 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:14:43.154 INFO:tasks.ceph.mds.b.smithi149.stderr:2024-09-21T03:14:43.152+0000 7f8f7c400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:14:43.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.222+0000 7fccaa600640 1 -- 172.21.15.90:0/2315178144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc88003fd0 msgr2=0x7fcc88004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:43.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.222+0000 7fccaa600640 1 --2- 172.21.15.90:0/2315178144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc88003fd0 0x7fcc88004800 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c00c290 tx=0x7fcc88005830 comp rx=0 tx=0).stop 2024-09-21T03:14:43.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.222+0000 7fcca9c00640 1 -- 172.21.15.90:0/2315178144 reap_dead start 2024-09-21T03:14:43.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.223+0000 7fccaa600640 1 -- 172.21.15.90:0/2315178144 shutdown_connections 2024-09-21T03:14:43.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.223+0000 7fccaa600640 1 -- 172.21.15.90:0/2315178144 >> 172.21.15.90:0/2315178144 conn(0x7fcca40c8d90 msgr2=0x7fcca40c91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:43.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.223+0000 7fccaa600640 1 -- 172.21.15.90:0/2315178144 shutdown_connections 2024-09-21T03:14:43.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.223+0000 7fccaa600640 1 -- 172.21.15.90:0/2315178144 wait complete. 2024-09-21T03:14:43.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.225+0000 7fccaa600640 1 Processor -- start 2024-09-21T03:14:43.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.225+0000 7fccaa600640 1 -- start start 2024-09-21T03:14:43.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.226+0000 7fccaa600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc88003fd0 0x7fcca41e2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:43.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.226+0000 7fccaa600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcca40c4b70 0x7fcca41f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:43.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.226+0000 7fccaa600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcca41f0b10 0x7fcca40c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:43.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.226+0000 7fccaa600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcca4157b10 con 0x7fcc88003fd0 2024-09-21T03:14:43.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.226+0000 7fccaa600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcca40c75e0 con 0x7fcca40c4b70 2024-09-21T03:14:43.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.226+0000 7fccaa600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcca40c89e0 con 0x7fcca41f0b10 2024-09-21T03:14:43.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.226+0000 7fcca9200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc88003fd0 0x7fcca41e2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:43.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.226+0000 7fcca9200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc88003fd0 0x7fcca41e2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38096/0 (socket says 172.21.15.90:38096) 2024-09-21T03:14:43.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.226+0000 7fcca9200640 1 -- 172.21.15.90:0/2510844472 learned_addr learned my addr 172.21.15.90:0/2510844472 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:43.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.227+0000 7fcc9be00640 1 --2- 172.21.15.90:0/2510844472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcca40c4b70 0x7fcca41f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:43.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.227+0000 7fcca9c00640 1 --2- 172.21.15.90:0/2510844472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcca41f0b10 0x7fcca40c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:43.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.227+0000 7fcca9200640 1 -- 172.21.15.90:0/2510844472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcca41f0b10 msgr2=0x7fcca40c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:43.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.227+0000 7fcca9200640 1 --2- 172.21.15.90:0/2510844472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcca41f0b10 0x7fcca40c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:43.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.227+0000 7fcca9200640 1 -- 172.21.15.90:0/2510844472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcca40c4b70 msgr2=0x7fcca41f05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:43.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.227+0000 7fcca9200640 1 --2- 172.21.15.90:0/2510844472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcca40c4b70 0x7fcca41f05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:43.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.227+0000 7fcca9200640 1 -- 172.21.15.90:0/2510844472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca40c33f0 con 0x7fcc88003fd0 2024-09-21T03:14:43.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.227+0000 7fcc9be00640 1 --2- 172.21.15.90:0/2510844472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcca40c4b70 0x7fcca41f05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:43.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.227+0000 7fcca9c00640 1 --2- 172.21.15.90:0/2510844472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcca41f0b10 0x7fcca40c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:43.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.227+0000 7fcca9200640 1 --2- 172.21.15.90:0/2510844472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc88003fd0 0x7fcca41e2540 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcc94011a80 tx=0x7fcc94011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:43.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.227+0000 7fcca1600640 1 -- 172.21.15.90:0/2510844472 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9400fe70 con 0x7fcc88003fd0 2024-09-21T03:14:43.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.227+0000 7fcca1600640 1 -- 172.21.15.90:0/2510844472 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc94016070 con 0x7fcc88003fd0 2024-09-21T03:14:43.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.227+0000 7fccaa600640 1 -- 172.21.15.90:0/2510844472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca41f0fd0 con 0x7fcc88003fd0 2024-09-21T03:14:43.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.227+0000 7fcca1600640 1 -- 172.21.15.90:0/2510844472 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc940127c0 con 0x7fcc88003fd0 2024-09-21T03:14:43.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.227+0000 7fccaa600640 1 -- 172.21.15.90:0/2510844472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca41e2a80 con 0x7fcc88003fd0 2024-09-21T03:14:43.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.228+0000 7fccaa600640 1 -- 172.21.15.90:0/2510844472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca40c6e00 con 0x7fcc88003fd0 2024-09-21T03:14:43.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.230+0000 7fcca1600640 1 -- 172.21.15.90:0/2510844472 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc94018030 con 0x7fcc88003fd0 2024-09-21T03:14:43.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.230+0000 7fcca1600640 1 --2- 172.21.15.90:0/2510844472 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc80078b90 0x7fcc8007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:43.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.231+0000 7fcca1600640 1 -- 172.21.15.90:0/2510844472 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7fcc9409b5d0 con 0x7fcc88003fd0 2024-09-21T03:14:43.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.231+0000 7fcc9be00640 1 --2- 172.21.15.90:0/2510844472 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc80078b90 0x7fcc8007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:43.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.232+0000 7fcc9be00640 1 --2- 172.21.15.90:0/2510844472 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc80078b90 0x7fcc8007b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c033000 tx=0x7fcc8c02d000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:43.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.235+0000 7fcca1600640 1 -- 172.21.15.90:0/2510844472 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcc94063b40 con 0x7fcc88003fd0 2024-09-21T03:14:43.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.421+0000 7fccaa600640 1 -- 172.21.15.90:0/2510844472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcca415a0f0 con 0x7fcc88003fd0 2024-09-21T03:14:43.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.422+0000 7fcca1600640 1 -- 172.21.15.90:0/2510844472 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16661 (secure 0 0 0) 0x7fcc94063440 con 0x7fcc88003fd0 2024-09-21T03:14:43.425 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:43.425 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":21,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","created":"2024-09-21T03:14:09.323302+0000","modified":"2024-09-21T03:14:39.460303+0000","last_up_change":"2024-09-21T03:14:25.329650+0000","last_in_change":"2024-09-21T03:14:15.386953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:14:24.511246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-21T03:14:35.815250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-21T03:14:36.914615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ceaacfab-e71c-45e2-ac50-4597dfd460bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6809","nonce":3187794863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6811","nonce":3187794863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6815","nonce":3187794863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6813","nonce":3187794863}]},"public_addr":"172.21.15.90:6809/3187794863","cluster_addr":"172.21.15.90:6811/3187794863","heartbeat_back_addr":"172.21.15.90:6815/3187794863","heartbeat_front_addr":"172.21.15.90:6813/3187794863","state":["exists","up"]},{"osd":1,"uuid":"86f91523-232b-4e80-ada7-d9e12770adb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6801","nonce":3769758484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6803","nonce":3769758484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6807","nonce":3769758484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6805","nonce":3769758484}]},"public_addr":"172.21.15.90:6801/3769758484","cluster_addr":"172.21.15.90:6803/3769758484","heartbeat_back_addr":"172.21.15.90:6807/3769758484","heartbeat_front_addr":"172.21.15.90:6805/3769758484","state":["exists","up"]},{"osd":2,"uuid":"6eb0f47b-e767-49c0-8d72-07f71b9c2e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6825","nonce":1025535744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6827","nonce":1025535744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6831","nonce":1025535744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6829","nonce":1025535744}]},"public_addr":"172.21.15.90:6825/1025535744","cluster_addr":"172.21.15.90:6827/1025535744","heartbeat_back_addr":"172.21.15.90:6831/1025535744","heartbeat_front_addr":"172.21.15.90:6829/1025535744","state":["exists","up"]},{"osd":3,"uuid":"64418862-beef-479c-be11-dfe0e515e09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6817","nonce":1515884437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6819","nonce":1515884437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6823","nonce":1515884437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6821","nonce":1515884437}]},"public_addr":"172.21.15.90:6817/1515884437","cluster_addr":"172.21.15.90:6819/1515884437","heartbeat_back_addr":"172.21.15.90:6823/1515884437","heartbeat_front_addr":"172.21.15.90:6821/1515884437","state":["exists","up"]},{"osd":4,"uuid":"a05b63f4-ec0a-426c-9d60-285e2680a897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6816","nonce":4278726553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6820","nonce":4278726553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6825","nonce":4278726553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6823","nonce":4278726553}]},"public_addr":"172.21.15.149:6816/4278726553","cluster_addr":"172.21.15.149:6820/4278726553","heartbeat_back_addr":"172.21.15.149:6825/4278726553","heartbeat_front_addr":"172.21.15.149:6823/4278726553","state":["exists","up"]},{"osd":5,"uuid":"3a1bab89-963c-4fe7-b14f-3080c5cf7830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6827","nonce":1341677333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6829","nonce":1341677333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6833","nonce":1341677333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6831","nonce":1341677333}]},"public_addr":"172.21.15.149:6827/1341677333","cluster_addr":"172.21.15.149:6829/1341677333","heartbeat_back_addr":"172.21.15.149:6833/1341677333","heartbeat_front_addr":"172.21.15.149:6831/1341677333","state":["exists","up"]},{"osd":6,"uuid":"bfcd1596-2688-4deb-be2e-55f305a5b4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6811","nonce":821196931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6813","nonce":821196931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6821","nonce":821196931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6817","nonce":821196931}]},"public_addr":"172.21.15.149:6811/821196931","cluster_addr":"172.21.15.149:6813/821196931","heartbeat_back_addr":"172.21.15.149:6821/821196931","heartbeat_front_addr":"172.21.15.149:6817/821196931","state":["exists","up"]},{"osd":7,"uuid":"58b19790-4006-4f07-966c-911b938cc1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6803","nonce":1657326880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6805","nonce":1657326880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6809","nonce":1657326880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6807","nonce":1657326880}]},"public_addr":"172.21.15.149:6803/1657326880","cluster_addr":"172.21.15.149:6805/1657326880","heartbeat_back_addr":"172.21.15.149:6809/1657326880","heartbeat_front_addr":"172.21.15.149:6807/1657326880","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.399701+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.051745+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.190159+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:23.240143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.446570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.259974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:21.990407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.459259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:14:43.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.425+0000 7fccaa600640 1 -- 172.21.15.90:0/2510844472 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc80078b90 msgr2=0x7fcc8007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:43.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.425+0000 7fccaa600640 1 --2- 172.21.15.90:0/2510844472 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc80078b90 0x7fcc8007b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c033000 tx=0x7fcc8c02d000 comp rx=0 tx=0).stop 2024-09-21T03:14:43.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.425+0000 7fccaa600640 1 -- 172.21.15.90:0/2510844472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc88003fd0 msgr2=0x7fcca41e2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:43.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.425+0000 7fccaa600640 1 --2- 172.21.15.90:0/2510844472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc88003fd0 0x7fcca41e2540 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcc94011a80 tx=0x7fcc94011f40 comp rx=0 tx=0).stop 2024-09-21T03:14:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.425+0000 7fccaa600640 1 -- 172.21.15.90:0/2510844472 shutdown_connections 2024-09-21T03:14:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.425+0000 7fccaa600640 1 --2- 172.21.15.90:0/2510844472 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc80078b90 0x7fcc8007b0a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.425+0000 7fccaa600640 1 --2- 172.21.15.90:0/2510844472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcca41f0b10 0x7fcca40c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.425+0000 7fccaa600640 1 --2- 172.21.15.90:0/2510844472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcca40c4b70 0x7fcca41f05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.425+0000 7fccaa600640 1 --2- 172.21.15.90:0/2510844472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc88003fd0 0x7fcca41e2540 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.425+0000 7fccaa600640 1 -- 172.21.15.90:0/2510844472 >> 172.21.15.90:0/2510844472 conn(0x7fcca40c8d90 msgr2=0x7fcca4158d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.425+0000 7fccaa600640 1 -- 172.21.15.90:0/2510844472 shutdown_connections 2024-09-21T03:14:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.425+0000 7fccaa600640 1 -- 172.21.15.90:0/2510844472 wait complete. 2024-09-21T03:14:43.449 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T03:14:43.450 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:14:43.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.667+0000 7f72ce000640 1 -- 172.21.15.90:0/3856413457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c806d960 msgr2=0x7f72c813dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:43.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.667+0000 7f72ce000640 1 --2- 172.21.15.90:0/3856413457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c806d960 0x7f72c813dd40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f72c8069d10 tx=0x7f72b802a4d0 comp rx=0 tx=0).stop 2024-09-21T03:14:43.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.667+0000 7f72ce000640 1 -- 172.21.15.90:0/3856413457 shutdown_connections 2024-09-21T03:14:43.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.667+0000 7f72ce000640 1 --2- 172.21.15.90:0/3856413457 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72c80acca0 0x7f72c8074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:43.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.667+0000 7f72ce000640 1 --2- 172.21.15.90:0/3856413457 >> v2:172.21.15.149:3300/0 conn(0x7f72c80ac350 0x7f72c80ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:43.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.667+0000 7f72ce000640 1 --2- 172.21.15.90:0/3856413457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c806d960 0x7f72c813dd40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:43.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.667+0000 7f72ce000640 1 -- 172.21.15.90:0/3856413457 >> 172.21.15.90:0/3856413457 conn(0x7f72c80c8ba0 msgr2=0x7f72c806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:43.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.667+0000 7f72ce000640 1 -- 172.21.15.90:0/3856413457 shutdown_connections 2024-09-21T03:14:43.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.667+0000 7f72ce000640 1 -- 172.21.15.90:0/3856413457 wait complete. 2024-09-21T03:14:43.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.669+0000 7f72ce000640 1 Processor -- start 2024-09-21T03:14:43.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.669+0000 7f72ce000640 1 -- start start 2024-09-21T03:14:43.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.671+0000 7f72ce000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c806d960 0x7f72c814d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:43.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.671+0000 7f72ce000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72c80ac350 0x7f72c814dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:43.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.671+0000 7f72ce000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72c80acca0 0x7f72c814e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:43.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.671+0000 7f72ce000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f72c80ab640 con 0x7f72c806d960 2024-09-21T03:14:43.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.671+0000 7f72ce000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f72c80ab360 con 0x7f72c80ac350 2024-09-21T03:14:43.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.671+0000 7f72ce000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f72c8074760 con 0x7f72c80acca0 2024-09-21T03:14:43.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.671+0000 7f72c7400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c806d960 0x7f72c814d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:43.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.671+0000 7f72c7400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c806d960 0x7f72c814d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38106/0 (socket says 172.21.15.90:38106) 2024-09-21T03:14:43.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.671+0000 7f72c7400640 1 -- 172.21.15.90:0/2919862834 learned_addr learned my addr 172.21.15.90:0/2919862834 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:43.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.671+0000 7f72c7e00640 1 --2- 172.21.15.90:0/2919862834 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72c80acca0 0x7f72c814e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:43.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.671+0000 7f72bea00640 1 --2- 172.21.15.90:0/2919862834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72c80ac350 0x7f72c814dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:43.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.671+0000 7f72c7400640 1 -- 172.21.15.90:0/2919862834 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72c80acca0 msgr2=0x7f72c814e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:43.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.671+0000 7f72c7400640 1 --2- 172.21.15.90:0/2919862834 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72c80acca0 0x7f72c814e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:43.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.671+0000 7f72c7400640 1 -- 172.21.15.90:0/2919862834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72c80ac350 msgr2=0x7f72c814dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:43.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.671+0000 7f72c7400640 1 --2- 172.21.15.90:0/2919862834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72c80ac350 0x7f72c814dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:43.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.671+0000 7f72c7400640 1 -- 172.21.15.90:0/2919862834 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c8157f70 con 0x7f72c806d960 2024-09-21T03:14:43.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.671+0000 7f72c7e00640 1 --2- 172.21.15.90:0/2919862834 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72c80acca0 0x7f72c814e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:14:43.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.672+0000 7f72c7400640 1 --2- 172.21.15.90:0/2919862834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c806d960 0x7f72c814d130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f72b8034040 tx=0x7f72b8003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:43.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.672+0000 7f72bfe00640 1 -- 172.21.15.90:0/2919862834 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b803e030 con 0x7f72c806d960 2024-09-21T03:14:43.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.672+0000 7f72bfe00640 1 -- 172.21.15.90:0/2919862834 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72b8003e00 con 0x7f72c806d960 2024-09-21T03:14:43.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.672+0000 7f72bfe00640 1 -- 172.21.15.90:0/2919862834 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8035040 con 0x7f72c806d960 2024-09-21T03:14:43.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.672+0000 7f72ce000640 1 -- 172.21.15.90:0/2919862834 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c8158210 con 0x7f72c806d960 2024-09-21T03:14:43.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.672+0000 7f72ce000640 1 -- 172.21.15.90:0/2919862834 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c814cc10 con 0x7f72c806d960 2024-09-21T03:14:43.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.673+0000 7f72ce000640 1 -- 172.21.15.90:0/2919862834 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c8074cc0 con 0x7f72c806d960 2024-09-21T03:14:43.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.674+0000 7f72bfe00640 1 -- 172.21.15.90:0/2919862834 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f72b8041030 con 0x7f72c806d960 2024-09-21T03:14:43.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.675+0000 7f72bfe00640 1 --2- 172.21.15.90:0/2919862834 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f72a4078bc0 0x7f72a407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:43.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.675+0000 7f72bfe00640 1 -- 172.21.15.90:0/2919862834 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f72b80bb440 con 0x7f72c806d960 2024-09-21T03:14:43.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.676+0000 7f72bea00640 1 --2- 172.21.15.90:0/2919862834 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f72a4078bc0 0x7f72a407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:43.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.676+0000 7f72bea00640 1 --2- 172.21.15.90:0/2919862834 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f72a4078bc0 0x7f72a407b0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f72c81527b0 tx=0x7f72b000b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:43.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.679+0000 7f72bfe00640 1 -- 172.21.15.90:0/2919862834 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f72b80831a0 con 0x7f72c806d960 2024-09-21T03:14:43.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.862+0000 7f72ce000640 1 -- 172.21.15.90:0/2919862834 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f72c8076c50 con 0x7f72a4078bc0 2024-09-21T03:14:43.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.868+0000 7f72bfe00640 1 -- 172.21.15.90:0/2919862834 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251931 (secure 0 0 0) 0x7f72c8076c50 con 0x7f72a4078bc0 2024-09-21T03:14:43.873 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:43.874 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-21T03:14:43.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.872+0000 7f72ce000640 1 -- 172.21.15.90:0/2919862834 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f72a4078bc0 msgr2=0x7f72a407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:43.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.872+0000 7f72ce000640 1 --2- 172.21.15.90:0/2919862834 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f72a4078bc0 0x7f72a407b0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f72c81527b0 tx=0x7f72b000b2e0 comp rx=0 tx=0).stop 2024-09-21T03:14:43.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.872+0000 7f72ce000640 1 -- 172.21.15.90:0/2919862834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c806d960 msgr2=0x7f72c814d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:43.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.872+0000 7f72ce000640 1 --2- 172.21.15.90:0/2919862834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c806d960 0x7f72c814d130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f72b8034040 tx=0x7f72b8003910 comp rx=0 tx=0).stop 2024-09-21T03:14:43.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.872+0000 7f72ce000640 1 -- 172.21.15.90:0/2919862834 shutdown_connections 2024-09-21T03:14:43.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.872+0000 7f72ce000640 1 --2- 172.21.15.90:0/2919862834 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f72a4078bc0 0x7f72a407b0d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:43.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.872+0000 7f72ce000640 1 --2- 172.21.15.90:0/2919862834 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72c80acca0 0x7f72c814e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:43.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.872+0000 7f72ce000640 1 --2- 172.21.15.90:0/2919862834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72c80ac350 0x7f72c814dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:43.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.872+0000 7f72ce000640 1 --2- 172.21.15.90:0/2919862834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c806d960 0x7f72c814d130 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:43.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.872+0000 7f72ce000640 1 -- 172.21.15.90:0/2919862834 >> 172.21.15.90:0/2919862834 conn(0x7f72c80c8ba0 msgr2=0x7f72c806e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:43.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.872+0000 7f72ce000640 1 -- 172.21.15.90:0/2919862834 shutdown_connections 2024-09-21T03:14:43.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:43.872+0000 7f72ce000640 1 -- 172.21.15.90:0/2919862834 wait complete. 2024-09-21T03:14:43.895 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-21T03:14:42.473530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":145,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219064,"kb_used_data":2808,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755656,"statfs":{"total":773094113280,"available":772869791744,"internally_reserved":0,"allocated":2875392,"data_stored":1737312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002000"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469681+0000","last_change":"2024-09-21T03:14:38.490309+0000","last_active":"2024-09-21T03:14:39.469681+0000","last_peered":"2024-09-21T03:14:39.469681+0000","last_clean":"2024-09-21T03:14:39.469681+0000","last_became_active":"2024-09-21T03:14:38.489167+0000","last_became_peered":"2024-09-21T03:14:38.489167+0000","last_unstale":"2024-09-21T03:14:39.469681+0000","last_undegraded":"2024-09-21T03:14:39.469681+0000","last_fullsized":"2024-09-21T03:14:39.469681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:07.725691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.468135+0000","last_change":"2024-09-21T03:14:38.496218+0000","last_active":"2024-09-21T03:14:39.468135+0000","last_peered":"2024-09-21T03:14:39.468135+0000","last_clean":"2024-09-21T03:14:39.468135+0000","last_became_active":"2024-09-21T03:14:38.488537+0000","last_became_peered":"2024-09-21T03:14:38.488537+0000","last_unstale":"2024-09-21T03:14:39.468135+0000","last_undegraded":"2024-09-21T03:14:39.468135+0000","last_fullsized":"2024-09-21T03:14:39.468135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:59.667392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467689+0000","last_change":"2024-09-21T03:14:38.482605+0000","last_active":"2024-09-21T03:14:39.467689+0000","last_peered":"2024-09-21T03:14:39.467689+0000","last_clean":"2024-09-21T03:14:39.467689+0000","last_became_active":"2024-09-21T03:14:38.482306+0000","last_became_peered":"2024-09-21T03:14:38.482306+0000","last_unstale":"2024-09-21T03:14:39.467689+0000","last_undegraded":"2024-09-21T03:14:39.467689+0000","last_fullsized":"2024-09-21T03:14:39.467689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:40.482635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.974795+0000","last_change":"2024-09-21T03:14:38.481389+0000","last_active":"2024-09-21T03:14:39.974795+0000","last_peered":"2024-09-21T03:14:39.974795+0000","last_clean":"2024-09-21T03:14:39.974795+0000","last_became_active":"2024-09-21T03:14:38.470907+0000","last_became_peered":"2024-09-21T03:14:38.470907+0000","last_unstale":"2024-09-21T03:14:39.974795+0000","last_undegraded":"2024-09-21T03:14:39.974795+0000","last_fullsized":"2024-09-21T03:14:39.974795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:30.068915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469151+0000","last_change":"2024-09-21T03:14:38.466077+0000","last_active":"2024-09-21T03:14:39.469151+0000","last_peered":"2024-09-21T03:14:39.469151+0000","last_clean":"2024-09-21T03:14:39.469151+0000","last_became_active":"2024-09-21T03:14:38.465818+0000","last_became_peered":"2024-09-21T03:14:38.465818+0000","last_unstale":"2024-09-21T03:14:39.469151+0000","last_undegraded":"2024-09-21T03:14:39.469151+0000","last_fullsized":"2024-09-21T03:14:39.469151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:34.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.974583+0000","last_change":"2024-09-21T03:14:38.471270+0000","last_active":"2024-09-21T03:14:39.974583+0000","last_peered":"2024-09-21T03:14:39.974583+0000","last_clean":"2024-09-21T03:14:39.974583+0000","last_became_active":"2024-09-21T03:14:38.470708+0000","last_became_peered":"2024-09-21T03:14:38.470708+0000","last_unstale":"2024-09-21T03:14:39.974583+0000","last_undegraded":"2024-09-21T03:14:39.974583+0000","last_fullsized":"2024-09-21T03:14:39.974583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.122804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.468962+0000","last_change":"2024-09-21T03:14:38.482620+0000","last_active":"2024-09-21T03:14:39.468962+0000","last_peered":"2024-09-21T03:14:39.468962+0000","last_clean":"2024-09-21T03:14:39.468962+0000","last_became_active":"2024-09-21T03:14:38.482346+0000","last_became_peered":"2024-09-21T03:14:38.482346+0000","last_unstale":"2024-09-21T03:14:39.468962+0000","last_undegraded":"2024-09-21T03:14:39.468962+0000","last_fullsized":"2024-09-21T03:14:39.468962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:52.977725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467259+0000","last_change":"2024-09-21T03:14:38.465771+0000","last_active":"2024-09-21T03:14:39.467259+0000","last_peered":"2024-09-21T03:14:39.467259+0000","last_clean":"2024-09-21T03:14:39.467259+0000","last_became_active":"2024-09-21T03:14:38.465479+0000","last_became_peered":"2024-09-21T03:14:38.465479+0000","last_unstale":"2024-09-21T03:14:39.467259+0000","last_undegraded":"2024-09-21T03:14:39.467259+0000","last_fullsized":"2024-09-21T03:14:39.467259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.754315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.714105+0000","last_change":"2024-09-21T03:14:38.483370+0000","last_active":"2024-09-21T03:14:39.714105+0000","last_peered":"2024-09-21T03:14:39.714105+0000","last_clean":"2024-09-21T03:14:39.714105+0000","last_became_active":"2024-09-21T03:14:38.483019+0000","last_became_peered":"2024-09-21T03:14:38.483019+0000","last_unstale":"2024-09-21T03:14:39.714105+0000","last_undegraded":"2024-09-21T03:14:39.714105+0000","last_fullsized":"2024-09-21T03:14:39.714105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:55.085422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469797+0000","last_change":"2024-09-21T03:14:38.474326+0000","last_active":"2024-09-21T03:14:39.469797+0000","last_peered":"2024-09-21T03:14:39.469797+0000","last_clean":"2024-09-21T03:14:39.469797+0000","last_became_active":"2024-09-21T03:14:38.470430+0000","last_became_peered":"2024-09-21T03:14:38.470430+0000","last_unstale":"2024-09-21T03:14:39.469797+0000","last_undegraded":"2024-09-21T03:14:39.469797+0000","last_fullsized":"2024-09-21T03:14:39.469797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:09.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469360+0000","last_change":"2024-09-21T03:14:38.473907+0000","last_active":"2024-09-21T03:14:39.469360+0000","last_peered":"2024-09-21T03:14:39.469360+0000","last_clean":"2024-09-21T03:14:39.469360+0000","last_became_active":"2024-09-21T03:14:38.473579+0000","last_became_peered":"2024-09-21T03:14:38.473579+0000","last_unstale":"2024-09-21T03:14:39.469360+0000","last_undegraded":"2024-09-21T03:14:39.469360+0000","last_fullsized":"2024-09-21T03:14:39.469360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:32.273503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469318+0000","last_change":"2024-09-21T03:14:38.481308+0000","last_active":"2024-09-21T03:14:39.469318+0000","last_peered":"2024-09-21T03:14:39.469318+0000","last_clean":"2024-09-21T03:14:39.469318+0000","last_became_active":"2024-09-21T03:14:38.480923+0000","last_became_peered":"2024-09-21T03:14:38.480923+0000","last_unstale":"2024-09-21T03:14:39.469318+0000","last_undegraded":"2024-09-21T03:14:39.469318+0000","last_fullsized":"2024-09-21T03:14:39.469318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:40.689231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.550917+0000","last_change":"2024-09-21T03:14:38.478853+0000","last_active":"2024-09-21T03:14:39.550917+0000","last_peered":"2024-09-21T03:14:39.550917+0000","last_clean":"2024-09-21T03:14:39.550917+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:14:39.550917+0000","last_undegraded":"2024-09-21T03:14:39.550917+0000","last_fullsized":"2024-09-21T03:14:39.550917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:31.427596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.551007+0000","last_change":"2024-09-21T03:14:38.487983+0000","last_active":"2024-09-21T03:14:39.551007+0000","last_peered":"2024-09-21T03:14:39.551007+0000","last_clean":"2024-09-21T03:14:39.551007+0000","last_became_active":"2024-09-21T03:14:38.487676+0000","last_became_peered":"2024-09-21T03:14:38.487676+0000","last_unstale":"2024-09-21T03:14:39.551007+0000","last_undegraded":"2024-09-21T03:14:39.551007+0000","last_fullsized":"2024-09-21T03:14:39.551007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:35.320169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467226+0000","last_change":"2024-09-21T03:14:38.469736+0000","last_active":"2024-09-21T03:14:39.467226+0000","last_peered":"2024-09-21T03:14:39.467226+0000","last_clean":"2024-09-21T03:14:39.467226+0000","last_became_active":"2024-09-21T03:14:38.469240+0000","last_became_peered":"2024-09-21T03:14:38.469240+0000","last_unstale":"2024-09-21T03:14:39.467226+0000","last_undegraded":"2024-09-21T03:14:39.467226+0000","last_fullsized":"2024-09-21T03:14:39.467226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:04.258761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.466678+0000","last_change":"2024-09-21T03:14:38.474262+0000","last_active":"2024-09-21T03:14:39.466678+0000","last_peered":"2024-09-21T03:14:39.466678+0000","last_clean":"2024-09-21T03:14:39.466678+0000","last_became_active":"2024-09-21T03:14:38.473856+0000","last_became_peered":"2024-09-21T03:14:38.473856+0000","last_unstale":"2024-09-21T03:14:39.466678+0000","last_undegraded":"2024-09-21T03:14:39.466678+0000","last_fullsized":"2024-09-21T03:14:39.466678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467584+0000","last_change":"2024-09-21T03:14:38.474462+0000","last_active":"2024-09-21T03:14:39.467584+0000","last_peered":"2024-09-21T03:14:39.467584+0000","last_clean":"2024-09-21T03:14:39.467584+0000","last_became_active":"2024-09-21T03:14:38.474156+0000","last_became_peered":"2024-09-21T03:14:38.474156+0000","last_unstale":"2024-09-21T03:14:39.467584+0000","last_undegraded":"2024-09-21T03:14:39.467584+0000","last_fullsized":"2024-09-21T03:14:39.467584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:55.329945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701285+0000","last_change":"2024-09-21T03:14:38.494878+0000","last_active":"2024-09-21T03:14:40.701285+0000","last_peered":"2024-09-21T03:14:40.701285+0000","last_clean":"2024-09-21T03:14:40.701285+0000","last_became_active":"2024-09-21T03:14:38.492813+0000","last_became_peered":"2024-09-21T03:14:38.492813+0000","last_unstale":"2024-09-21T03:14:40.701285+0000","last_undegraded":"2024-09-21T03:14:40.701285+0000","last_fullsized":"2024-09-21T03:14:40.701285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:55.064844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467704+0000","last_change":"2024-09-21T03:14:38.478039+0000","last_active":"2024-09-21T03:14:39.467704+0000","last_peered":"2024-09-21T03:14:39.467704+0000","last_clean":"2024-09-21T03:14:39.467704+0000","last_became_active":"2024-09-21T03:14:38.473843+0000","last_became_peered":"2024-09-21T03:14:38.473843+0000","last_unstale":"2024-09-21T03:14:39.467704+0000","last_undegraded":"2024-09-21T03:14:39.467704+0000","last_fullsized":"2024-09-21T03:14:39.467704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:27.072406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469466+0000","last_change":"2024-09-21T03:14:38.480638+0000","last_active":"2024-09-21T03:14:39.469466+0000","last_peered":"2024-09-21T03:14:39.469466+0000","last_clean":"2024-09-21T03:14:39.469466+0000","last_became_active":"2024-09-21T03:14:38.477739+0000","last_became_peered":"2024-09-21T03:14:38.477739+0000","last_unstale":"2024-09-21T03:14:39.469466+0000","last_undegraded":"2024-09-21T03:14:39.469466+0000","last_fullsized":"2024-09-21T03:14:39.469466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:35.097761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701525+0000","last_change":"2024-09-21T03:14:38.482681+0000","last_active":"2024-09-21T03:14:40.701525+0000","last_peered":"2024-09-21T03:14:40.701525+0000","last_clean":"2024-09-21T03:14:40.701525+0000","last_became_active":"2024-09-21T03:14:38.477816+0000","last_became_peered":"2024-09-21T03:14:38.477816+0000","last_unstale":"2024-09-21T03:14:40.701525+0000","last_undegraded":"2024-09-21T03:14:40.701525+0000","last_fullsized":"2024-09-21T03:14:40.701525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:18.675641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.713987+0000","last_change":"2024-09-21T03:14:38.470991+0000","last_active":"2024-09-21T03:14:39.713987+0000","last_peered":"2024-09-21T03:14:39.713987+0000","last_clean":"2024-09-21T03:14:39.713987+0000","last_became_active":"2024-09-21T03:14:38.470666+0000","last_became_peered":"2024-09-21T03:14:38.470666+0000","last_unstale":"2024-09-21T03:14:39.713987+0000","last_undegraded":"2024-09-21T03:14:39.713987+0000","last_fullsized":"2024-09-21T03:14:39.713987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:25.477992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467789+0000","last_change":"2024-09-21T03:14:38.491888+0000","last_active":"2024-09-21T03:14:39.467789+0000","last_peered":"2024-09-21T03:14:39.467789+0000","last_clean":"2024-09-21T03:14:39.467789+0000","last_became_active":"2024-09-21T03:14:38.491510+0000","last_became_peered":"2024-09-21T03:14:38.491510+0000","last_unstale":"2024-09-21T03:14:39.467789+0000","last_undegraded":"2024-09-21T03:14:39.467789+0000","last_fullsized":"2024-09-21T03:14:39.467789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:26.740304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467241+0000","last_change":"2024-09-21T03:14:38.471959+0000","last_active":"2024-09-21T03:14:39.467241+0000","last_peered":"2024-09-21T03:14:39.467241+0000","last_clean":"2024-09-21T03:14:39.467241+0000","last_became_active":"2024-09-21T03:14:38.471625+0000","last_became_peered":"2024-09-21T03:14:38.471625+0000","last_unstale":"2024-09-21T03:14:39.467241+0000","last_undegraded":"2024-09-21T03:14:39.467241+0000","last_fullsized":"2024-09-21T03:14:39.467241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:17.761951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.468139+0000","last_change":"2024-09-21T03:14:38.487093+0000","last_active":"2024-09-21T03:14:39.468139+0000","last_peered":"2024-09-21T03:14:39.468139+0000","last_clean":"2024-09-21T03:14:39.468139+0000","last_became_active":"2024-09-21T03:14:38.486204+0000","last_became_peered":"2024-09-21T03:14:38.486204+0000","last_unstale":"2024-09-21T03:14:39.468139+0000","last_undegraded":"2024-09-21T03:14:39.468139+0000","last_fullsized":"2024-09-21T03:14:39.468139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:55.531046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.974920+0000","last_change":"2024-09-21T03:14:38.484198+0000","last_active":"2024-09-21T03:14:39.974920+0000","last_peered":"2024-09-21T03:14:39.974920+0000","last_clean":"2024-09-21T03:14:39.974920+0000","last_became_active":"2024-09-21T03:14:38.483893+0000","last_became_peered":"2024-09-21T03:14:38.483893+0000","last_unstale":"2024-09-21T03:14:39.974920+0000","last_undegraded":"2024-09-21T03:14:39.974920+0000","last_fullsized":"2024-09-21T03:14:39.974920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:56.665359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.551241+0000","last_change":"2024-09-21T03:14:38.478099+0000","last_active":"2024-09-21T03:14:39.551241+0000","last_peered":"2024-09-21T03:14:39.551241+0000","last_clean":"2024-09-21T03:14:39.551241+0000","last_became_active":"2024-09-21T03:14:38.475894+0000","last_became_peered":"2024-09-21T03:14:38.475894+0000","last_unstale":"2024-09-21T03:14:39.551241+0000","last_undegraded":"2024-09-21T03:14:39.551241+0000","last_fullsized":"2024-09-21T03:14:39.551241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:49.876430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.550914+0000","last_change":"2024-09-21T03:14:38.473900+0000","last_active":"2024-09-21T03:14:39.550914+0000","last_peered":"2024-09-21T03:14:39.550914+0000","last_clean":"2024-09-21T03:14:39.550914+0000","last_became_active":"2024-09-21T03:14:38.471325+0000","last_became_peered":"2024-09-21T03:14:38.471325+0000","last_unstale":"2024-09-21T03:14:39.550914+0000","last_undegraded":"2024-09-21T03:14:39.550914+0000","last_fullsized":"2024-09-21T03:14:39.550914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:47.556293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467640+0000","last_change":"2024-09-21T03:14:38.481039+0000","last_active":"2024-09-21T03:14:39.467640+0000","last_peered":"2024-09-21T03:14:39.467640+0000","last_clean":"2024-09-21T03:14:39.467640+0000","last_became_active":"2024-09-21T03:14:38.480686+0000","last_became_peered":"2024-09-21T03:14:38.480686+0000","last_unstale":"2024-09-21T03:14:39.467640+0000","last_undegraded":"2024-09-21T03:14:39.467640+0000","last_fullsized":"2024-09-21T03:14:39.467640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:18.603386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467019+0000","last_change":"2024-09-21T03:14:38.472860+0000","last_active":"2024-09-21T03:14:39.467019+0000","last_peered":"2024-09-21T03:14:39.467019+0000","last_clean":"2024-09-21T03:14:39.467019+0000","last_became_active":"2024-09-21T03:14:38.472548+0000","last_became_peered":"2024-09-21T03:14:38.472548+0000","last_unstale":"2024-09-21T03:14:39.467019+0000","last_undegraded":"2024-09-21T03:14:39.467019+0000","last_fullsized":"2024-09-21T03:14:39.467019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:16.071692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701356+0000","last_change":"2024-09-21T03:14:38.477183+0000","last_active":"2024-09-21T03:14:40.701356+0000","last_peered":"2024-09-21T03:14:40.701356+0000","last_clean":"2024-09-21T03:14:40.701356+0000","last_became_active":"2024-09-21T03:14:38.476657+0000","last_became_peered":"2024-09-21T03:14:38.476657+0000","last_unstale":"2024-09-21T03:14:40.701356+0000","last_undegraded":"2024-09-21T03:14:40.701356+0000","last_fullsized":"2024-09-21T03:14:40.701356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:36.801764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.974555+0000","last_change":"2024-09-21T03:14:38.484311+0000","last_active":"2024-09-21T03:14:39.974555+0000","last_peered":"2024-09-21T03:14:39.974555+0000","last_clean":"2024-09-21T03:14:39.974555+0000","last_became_active":"2024-09-21T03:14:38.483975+0000","last_became_peered":"2024-09-21T03:14:38.483975+0000","last_unstale":"2024-09-21T03:14:39.974555+0000","last_undegraded":"2024-09-21T03:14:39.974555+0000","last_fullsized":"2024-09-21T03:14:39.974555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:31.145431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.713792+0000","last_change":"2024-09-21T03:14:38.474516+0000","last_active":"2024-09-21T03:14:39.713792+0000","last_peered":"2024-09-21T03:14:39.713792+0000","last_clean":"2024-09-21T03:14:39.713792+0000","last_became_active":"2024-09-21T03:14:38.472225+0000","last_became_peered":"2024-09-21T03:14:38.472225+0000","last_unstale":"2024-09-21T03:14:39.713792+0000","last_undegraded":"2024-09-21T03:14:39.713792+0000","last_fullsized":"2024-09-21T03:14:39.713792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:47.504910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467651+0000","last_change":"2024-09-21T03:14:37.465536+0000","last_active":"2024-09-21T03:14:39.467651+0000","last_peered":"2024-09-21T03:14:39.467651+0000","last_clean":"2024-09-21T03:14:39.467651+0000","last_became_active":"2024-09-21T03:14:37.465240+0000","last_became_peered":"2024-09-21T03:14:37.465240+0000","last_unstale":"2024-09-21T03:14:39.467651+0000","last_undegraded":"2024-09-21T03:14:39.467651+0000","last_fullsized":"2024-09-21T03:14:39.467651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:34.780298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701436+0000","last_change":"2024-09-21T03:14:38.483226+0000","last_active":"2024-09-21T03:14:40.701436+0000","last_peered":"2024-09-21T03:14:40.701436+0000","last_clean":"2024-09-21T03:14:40.701436+0000","last_became_active":"2024-09-21T03:14:38.482354+0000","last_became_peered":"2024-09-21T03:14:38.482354+0000","last_unstale":"2024-09-21T03:14:40.701436+0000","last_undegraded":"2024-09-21T03:14:40.701436+0000","last_fullsized":"2024-09-21T03:14:40.701436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:51.488594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467272+0000","last_change":"2024-09-21T03:14:37.475076+0000","last_active":"2024-09-21T03:14:39.467272+0000","last_peered":"2024-09-21T03:14:39.467272+0000","last_clean":"2024-09-21T03:14:39.467272+0000","last_became_active":"2024-09-21T03:14:37.474595+0000","last_became_peered":"2024-09-21T03:14:37.474595+0000","last_unstale":"2024-09-21T03:14:39.467272+0000","last_undegraded":"2024-09-21T03:14:39.467272+0000","last_fullsized":"2024-09-21T03:14:39.467272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:16.880647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.550595+0000","last_change":"2024-09-21T03:14:37.472209+0000","last_active":"2024-09-21T03:14:39.550595+0000","last_peered":"2024-09-21T03:14:39.550595+0000","last_clean":"2024-09-21T03:14:39.550595+0000","last_became_active":"2024-09-21T03:14:37.471771+0000","last_became_peered":"2024-09-21T03:14:37.471771+0000","last_unstale":"2024-09-21T03:14:39.550595+0000","last_undegraded":"2024-09-21T03:14:39.550595+0000","last_fullsized":"2024-09-21T03:14:39.550595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:30.648010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467635+0000","last_change":"2024-09-21T03:14:38.480723+0000","last_active":"2024-09-21T03:14:39.467635+0000","last_peered":"2024-09-21T03:14:39.467635+0000","last_clean":"2024-09-21T03:14:39.467635+0000","last_became_active":"2024-09-21T03:14:38.472823+0000","last_became_peered":"2024-09-21T03:14:38.472823+0000","last_unstale":"2024-09-21T03:14:39.467635+0000","last_undegraded":"2024-09-21T03:14:39.467635+0000","last_fullsized":"2024-09-21T03:14:39.467635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:59.862592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467360+0000","last_change":"2024-09-21T03:14:37.459351+0000","last_active":"2024-09-21T03:14:39.467360+0000","last_peered":"2024-09-21T03:14:39.467360+0000","last_clean":"2024-09-21T03:14:39.467360+0000","last_became_active":"2024-09-21T03:14:37.458676+0000","last_became_peered":"2024-09-21T03:14:37.458676+0000","last_unstale":"2024-09-21T03:14:39.467360+0000","last_undegraded":"2024-09-21T03:14:39.467360+0000","last_fullsized":"2024-09-21T03:14:39.467360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:42.671520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.700996+0000","last_change":"2024-09-21T03:14:38.481837+0000","last_active":"2024-09-21T03:14:40.700996+0000","last_peered":"2024-09-21T03:14:40.700996+0000","last_clean":"2024-09-21T03:14:40.700996+0000","last_became_active":"2024-09-21T03:14:38.478400+0000","last_became_peered":"2024-09-21T03:14:38.478400+0000","last_unstale":"2024-09-21T03:14:40.700996+0000","last_undegraded":"2024-09-21T03:14:40.700996+0000","last_fullsized":"2024-09-21T03:14:40.700996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.702185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.714109+0000","last_change":"2024-09-21T03:14:37.471363+0000","last_active":"2024-09-21T03:14:39.714109+0000","last_peered":"2024-09-21T03:14:39.714109+0000","last_clean":"2024-09-21T03:14:39.714109+0000","last_became_active":"2024-09-21T03:14:37.471002+0000","last_became_peered":"2024-09-21T03:14:37.471002+0000","last_unstale":"2024-09-21T03:14:39.714109+0000","last_undegraded":"2024-09-21T03:14:39.714109+0000","last_fullsized":"2024-09-21T03:14:39.714109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:25.922368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.975024+0000","last_change":"2024-09-21T03:14:38.488227+0000","last_active":"2024-09-21T03:14:39.975024+0000","last_peered":"2024-09-21T03:14:39.975024+0000","last_clean":"2024-09-21T03:14:39.975024+0000","last_became_active":"2024-09-21T03:14:38.482370+0000","last_became_peered":"2024-09-21T03:14:38.482370+0000","last_unstale":"2024-09-21T03:14:39.975024+0000","last_undegraded":"2024-09-21T03:14:39.975024+0000","last_fullsized":"2024-09-21T03:14:39.975024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:52.561391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469966+0000","last_change":"2024-09-21T03:14:37.479047+0000","last_active":"2024-09-21T03:14:39.469966+0000","last_peered":"2024-09-21T03:14:39.469966+0000","last_clean":"2024-09-21T03:14:39.469966+0000","last_became_active":"2024-09-21T03:14:37.478700+0000","last_became_peered":"2024-09-21T03:14:37.478700+0000","last_unstale":"2024-09-21T03:14:39.469966+0000","last_undegraded":"2024-09-21T03:14:39.469966+0000","last_fullsized":"2024-09-21T03:14:39.469966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:31.702450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.468492+0000","last_change":"2024-09-21T03:14:38.484757+0000","last_active":"2024-09-21T03:14:39.468492+0000","last_peered":"2024-09-21T03:14:39.468492+0000","last_clean":"2024-09-21T03:14:39.468492+0000","last_became_active":"2024-09-21T03:14:38.483348+0000","last_became_peered":"2024-09-21T03:14:38.483348+0000","last_unstale":"2024-09-21T03:14:39.468492+0000","last_undegraded":"2024-09-21T03:14:39.468492+0000","last_fullsized":"2024-09-21T03:14:39.468492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:57.697723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.700802+0000","last_change":"2024-09-21T03:14:37.473709+0000","last_active":"2024-09-21T03:14:40.700802+0000","last_peered":"2024-09-21T03:14:40.700802+0000","last_clean":"2024-09-21T03:14:40.700802+0000","last_became_active":"2024-09-21T03:14:37.472544+0000","last_became_peered":"2024-09-21T03:14:37.472544+0000","last_unstale":"2024-09-21T03:14:40.700802+0000","last_undegraded":"2024-09-21T03:14:40.700802+0000","last_fullsized":"2024-09-21T03:14:40.700802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:47.892146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467733+0000","last_change":"2024-09-21T03:14:38.476564+0000","last_active":"2024-09-21T03:14:39.467733+0000","last_peered":"2024-09-21T03:14:39.467733+0000","last_clean":"2024-09-21T03:14:39.467733+0000","last_became_active":"2024-09-21T03:14:38.476158+0000","last_became_peered":"2024-09-21T03:14:38.476158+0000","last_unstale":"2024-09-21T03:14:39.467733+0000","last_undegraded":"2024-09-21T03:14:39.467733+0000","last_fullsized":"2024-09-21T03:14:39.467733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:26.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.974755+0000","last_change":"2024-09-21T03:14:37.472695+0000","last_active":"2024-09-21T03:14:39.974755+0000","last_peered":"2024-09-21T03:14:39.974755+0000","last_clean":"2024-09-21T03:14:39.974755+0000","last_became_active":"2024-09-21T03:14:37.472374+0000","last_became_peered":"2024-09-21T03:14:37.472374+0000","last_unstale":"2024-09-21T03:14:39.974755+0000","last_undegraded":"2024-09-21T03:14:39.974755+0000","last_fullsized":"2024-09-21T03:14:39.974755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:11.245914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469604+0000","last_change":"2024-09-21T03:14:38.478509+0000","last_active":"2024-09-21T03:14:39.469604+0000","last_peered":"2024-09-21T03:14:39.469604+0000","last_clean":"2024-09-21T03:14:39.469604+0000","last_became_active":"2024-09-21T03:14:38.478197+0000","last_became_peered":"2024-09-21T03:14:38.478197+0000","last_unstale":"2024-09-21T03:14:39.469604+0000","last_undegraded":"2024-09-21T03:14:39.469604+0000","last_fullsized":"2024-09-21T03:14:39.469604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.411134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701029+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:14:40.701029+0000","last_peered":"2024-09-21T03:14:40.701029+0000","last_clean":"2024-09-21T03:14:40.701029+0000","last_became_active":"2024-09-21T03:14:37.478882+0000","last_became_peered":"2024-09-21T03:14:37.478882+0000","last_unstale":"2024-09-21T03:14:40.701029+0000","last_undegraded":"2024-09-21T03:14:40.701029+0000","last_fullsized":"2024-09-21T03:14:40.701029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:11.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.550863+0000","last_change":"2024-09-21T03:14:38.482528+0000","last_active":"2024-09-21T03:14:39.550863+0000","last_peered":"2024-09-21T03:14:39.550863+0000","last_clean":"2024-09-21T03:14:39.550863+0000","last_became_active":"2024-09-21T03:14:38.482241+0000","last_became_peered":"2024-09-21T03:14:38.482241+0000","last_unstale":"2024-09-21T03:14:39.550863+0000","last_undegraded":"2024-09-21T03:14:39.550863+0000","last_fullsized":"2024-09-21T03:14:39.550863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:23.110703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467424+0000","last_change":"2024-09-21T03:14:37.466544+0000","last_active":"2024-09-21T03:14:39.467424+0000","last_peered":"2024-09-21T03:14:39.467424+0000","last_clean":"2024-09-21T03:14:39.467424+0000","last_became_active":"2024-09-21T03:14:37.465817+0000","last_became_peered":"2024-09-21T03:14:37.465817+0000","last_unstale":"2024-09-21T03:14:39.467424+0000","last_undegraded":"2024-09-21T03:14:39.467424+0000","last_fullsized":"2024-09-21T03:14:39.467424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:36.113483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.466918+0000","last_change":"2024-09-21T03:14:38.485454+0000","last_active":"2024-09-21T03:14:39.466918+0000","last_peered":"2024-09-21T03:14:39.466918+0000","last_clean":"2024-09-21T03:14:39.466918+0000","last_became_active":"2024-09-21T03:14:38.485235+0000","last_became_peered":"2024-09-21T03:14:38.485235+0000","last_unstale":"2024-09-21T03:14:39.466918+0000","last_undegraded":"2024-09-21T03:14:39.466918+0000","last_fullsized":"2024-09-21T03:14:39.466918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:11.585637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.468918+0000","last_change":"2024-09-21T03:14:37.478714+0000","last_active":"2024-09-21T03:14:39.468918+0000","last_peered":"2024-09-21T03:14:39.468918+0000","last_clean":"2024-09-21T03:14:39.468918+0000","last_became_active":"2024-09-21T03:14:37.477951+0000","last_became_peered":"2024-09-21T03:14:37.477951+0000","last_unstale":"2024-09-21T03:14:39.468918+0000","last_undegraded":"2024-09-21T03:14:39.468918+0000","last_fullsized":"2024-09-21T03:14:39.468918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:42.529545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.713635+0000","last_change":"2024-09-21T03:14:38.472906+0000","last_active":"2024-09-21T03:14:39.713635+0000","last_peered":"2024-09-21T03:14:39.713635+0000","last_clean":"2024-09-21T03:14:39.713635+0000","last_became_active":"2024-09-21T03:14:38.471933+0000","last_became_peered":"2024-09-21T03:14:38.471933+0000","last_unstale":"2024-09-21T03:14:39.713635+0000","last_undegraded":"2024-09-21T03:14:39.713635+0000","last_fullsized":"2024-09-21T03:14:39.713635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:05.395821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701145+0000","last_change":"2024-09-21T03:14:37.471063+0000","last_active":"2024-09-21T03:14:40.701145+0000","last_peered":"2024-09-21T03:14:40.701145+0000","last_clean":"2024-09-21T03:14:40.701145+0000","last_became_active":"2024-09-21T03:14:37.470720+0000","last_became_peered":"2024-09-21T03:14:37.470720+0000","last_unstale":"2024-09-21T03:14:40.701145+0000","last_undegraded":"2024-09-21T03:14:40.701145+0000","last_fullsized":"2024-09-21T03:14:40.701145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:00.054692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.466806+0000","last_change":"2024-09-21T03:14:38.479516+0000","last_active":"2024-09-21T03:14:39.466806+0000","last_peered":"2024-09-21T03:14:39.466806+0000","last_clean":"2024-09-21T03:14:39.466806+0000","last_became_active":"2024-09-21T03:14:38.474826+0000","last_became_peered":"2024-09-21T03:14:38.474826+0000","last_unstale":"2024-09-21T03:14:39.466806+0000","last_undegraded":"2024-09-21T03:14:39.466806+0000","last_fullsized":"2024-09-21T03:14:39.466806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:22.181411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.470029+0000","last_change":"2024-09-21T03:14:37.480905+0000","last_active":"2024-09-21T03:14:39.470029+0000","last_peered":"2024-09-21T03:14:39.470029+0000","last_clean":"2024-09-21T03:14:39.470029+0000","last_became_active":"2024-09-21T03:14:37.478227+0000","last_became_peered":"2024-09-21T03:14:37.478227+0000","last_unstale":"2024-09-21T03:14:39.470029+0000","last_undegraded":"2024-09-21T03:14:39.470029+0000","last_fullsized":"2024-09-21T03:14:39.470029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:42.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.975056+0000","last_change":"2024-09-21T03:14:38.469502+0000","last_active":"2024-09-21T03:14:39.975056+0000","last_peered":"2024-09-21T03:14:39.975056+0000","last_clean":"2024-09-21T03:14:39.975056+0000","last_became_active":"2024-09-21T03:14:38.468972+0000","last_became_peered":"2024-09-21T03:14:38.468972+0000","last_unstale":"2024-09-21T03:14:39.975056+0000","last_undegraded":"2024-09-21T03:14:39.975056+0000","last_fullsized":"2024-09-21T03:14:39.975056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701676+0000","last_change":"2024-09-21T03:14:37.472491+0000","last_active":"2024-09-21T03:14:40.701676+0000","last_peered":"2024-09-21T03:14:40.701676+0000","last_clean":"2024-09-21T03:14:40.701676+0000","last_became_active":"2024-09-21T03:14:37.472164+0000","last_became_peered":"2024-09-21T03:14:37.472164+0000","last_unstale":"2024-09-21T03:14:40.701676+0000","last_undegraded":"2024-09-21T03:14:40.701676+0000","last_fullsized":"2024-09-21T03:14:40.701676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.498178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469936+0000","last_change":"2024-09-21T03:14:38.480629+0000","last_active":"2024-09-21T03:14:39.469936+0000","last_peered":"2024-09-21T03:14:39.469936+0000","last_clean":"2024-09-21T03:14:39.469936+0000","last_became_active":"2024-09-21T03:14:38.474135+0000","last_became_peered":"2024-09-21T03:14:38.474135+0000","last_unstale":"2024-09-21T03:14:39.469936+0000","last_undegraded":"2024-09-21T03:14:39.469936+0000","last_fullsized":"2024-09-21T03:14:39.469936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:36.171044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467945+0000","last_change":"2024-09-21T03:14:37.460763+0000","last_active":"2024-09-21T03:14:39.467945+0000","last_peered":"2024-09-21T03:14:39.467945+0000","last_clean":"2024-09-21T03:14:39.467945+0000","last_became_active":"2024-09-21T03:14:37.460320+0000","last_became_peered":"2024-09-21T03:14:37.460320+0000","last_unstale":"2024-09-21T03:14:39.467945+0000","last_undegraded":"2024-09-21T03:14:39.467945+0000","last_fullsized":"2024-09-21T03:14:39.467945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.907794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469601+0000","last_change":"2024-09-21T03:14:38.488259+0000","last_active":"2024-09-21T03:14:39.469601+0000","last_peered":"2024-09-21T03:14:39.469601+0000","last_clean":"2024-09-21T03:14:39.469601+0000","last_became_active":"2024-09-21T03:14:38.487420+0000","last_became_peered":"2024-09-21T03:14:38.487420+0000","last_unstale":"2024-09-21T03:14:39.469601+0000","last_undegraded":"2024-09-21T03:14:39.469601+0000","last_fullsized":"2024-09-21T03:14:39.469601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:48.003893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.551058+0000","last_change":"2024-09-21T03:14:37.479578+0000","last_active":"2024-09-21T03:14:39.551058+0000","last_peered":"2024-09-21T03:14:39.551058+0000","last_clean":"2024-09-21T03:14:39.551058+0000","last_became_active":"2024-09-21T03:14:37.479284+0000","last_became_peered":"2024-09-21T03:14:37.479284+0000","last_unstale":"2024-09-21T03:14:39.551058+0000","last_undegraded":"2024-09-21T03:14:39.551058+0000","last_fullsized":"2024-09-21T03:14:39.551058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:15.732230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467541+0000","last_change":"2024-09-21T03:14:38.478414+0000","last_active":"2024-09-21T03:14:39.467541+0000","last_peered":"2024-09-21T03:14:39.467541+0000","last_clean":"2024-09-21T03:14:39.467541+0000","last_became_active":"2024-09-21T03:14:38.478116+0000","last_became_peered":"2024-09-21T03:14:38.478116+0000","last_unstale":"2024-09-21T03:14:39.467541+0000","last_undegraded":"2024-09-21T03:14:39.467541+0000","last_fullsized":"2024-09-21T03:14:39.467541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:29.618008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.713575+0000","last_change":"2024-09-21T03:14:26.342355+0000","last_active":"2024-09-21T03:14:39.713575+0000","last_peered":"2024-09-21T03:14:39.713575+0000","last_clean":"2024-09-21T03:14:39.713575+0000","last_became_active":"2024-09-21T03:14:26.341929+0000","last_became_peered":"2024-09-21T03:14:26.341929+0000","last_unstale":"2024-09-21T03:14:39.713575+0000","last_undegraded":"2024-09-21T03:14:39.713575+0000","last_fullsized":"2024-09-21T03:14:39.713575+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_clean_scrub_stamp":"2024-09-21T03:14:25.329650+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:45.390822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467183+0000","last_change":"2024-09-21T03:14:37.463990+0000","last_active":"2024-09-21T03:14:39.467183+0000","last_peered":"2024-09-21T03:14:39.467183+0000","last_clean":"2024-09-21T03:14:39.467183+0000","last_became_active":"2024-09-21T03:14:37.463674+0000","last_became_peered":"2024-09-21T03:14:37.463674+0000","last_unstale":"2024-09-21T03:14:39.467183+0000","last_undegraded":"2024-09-21T03:14:39.467183+0000","last_fullsized":"2024-09-21T03:14:39.467183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:35.391985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701690+0000","last_change":"2024-09-21T03:14:38.479181+0000","last_active":"2024-09-21T03:14:40.701690+0000","last_peered":"2024-09-21T03:14:40.701690+0000","last_clean":"2024-09-21T03:14:40.701690+0000","last_became_active":"2024-09-21T03:14:38.478842+0000","last_became_peered":"2024-09-21T03:14:38.478842+0000","last_unstale":"2024-09-21T03:14:40.701690+0000","last_undegraded":"2024-09-21T03:14:40.701690+0000","last_fullsized":"2024-09-21T03:14:40.701690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:08.664381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467451+0000","last_change":"2024-09-21T03:14:37.464554+0000","last_active":"2024-09-21T03:14:39.467451+0000","last_peered":"2024-09-21T03:14:39.467451+0000","last_clean":"2024-09-21T03:14:39.467451+0000","last_became_active":"2024-09-21T03:14:37.464228+0000","last_became_peered":"2024-09-21T03:14:37.464228+0000","last_unstale":"2024-09-21T03:14:39.467451+0000","last_undegraded":"2024-09-21T03:14:39.467451+0000","last_fullsized":"2024-09-21T03:14:39.467451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:32.529512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.550747+0000","last_change":"2024-09-21T03:14:38.480026+0000","last_active":"2024-09-21T03:14:39.550747+0000","last_peered":"2024-09-21T03:14:39.550747+0000","last_clean":"2024-09-21T03:14:39.550747+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:14:39.550747+0000","last_undegraded":"2024-09-21T03:14:39.550747+0000","last_fullsized":"2024-09-21T03:14:39.550747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:20.481816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701000+0000","last_change":"2024-09-21T03:14:37.474798+0000","last_active":"2024-09-21T03:14:40.701000+0000","last_peered":"2024-09-21T03:14:40.701000+0000","last_clean":"2024-09-21T03:14:40.701000+0000","last_became_active":"2024-09-21T03:14:37.473829+0000","last_became_peered":"2024-09-21T03:14:37.473829+0000","last_unstale":"2024-09-21T03:14:40.701000+0000","last_undegraded":"2024-09-21T03:14:40.701000+0000","last_fullsized":"2024-09-21T03:14:40.701000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:11.571814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467295+0000","last_change":"2024-09-21T03:14:38.481801+0000","last_active":"2024-09-21T03:14:39.467295+0000","last_peered":"2024-09-21T03:14:39.467295+0000","last_clean":"2024-09-21T03:14:39.467295+0000","last_became_active":"2024-09-21T03:14:38.481186+0000","last_became_peered":"2024-09-21T03:14:38.481186+0000","last_unstale":"2024-09-21T03:14:39.467295+0000","last_undegraded":"2024-09-21T03:14:39.467295+0000","last_fullsized":"2024-09-21T03:14:39.467295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:54.271470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467533+0000","last_change":"2024-09-21T03:14:37.466857+0000","last_active":"2024-09-21T03:14:39.467533+0000","last_peered":"2024-09-21T03:14:39.467533+0000","last_clean":"2024-09-21T03:14:39.467533+0000","last_became_active":"2024-09-21T03:14:37.466256+0000","last_became_peered":"2024-09-21T03:14:37.466256+0000","last_unstale":"2024-09-21T03:14:39.467533+0000","last_undegraded":"2024-09-21T03:14:39.467533+0000","last_fullsized":"2024-09-21T03:14:39.467533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:02.240461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469255+0000","last_change":"2024-09-21T03:14:38.476763+0000","last_active":"2024-09-21T03:14:39.469255+0000","last_peered":"2024-09-21T03:14:39.469255+0000","last_clean":"2024-09-21T03:14:39.469255+0000","last_became_active":"2024-09-21T03:14:38.474299+0000","last_became_peered":"2024-09-21T03:14:38.474299+0000","last_unstale":"2024-09-21T03:14:39.469255+0000","last_undegraded":"2024-09-21T03:14:39.469255+0000","last_fullsized":"2024-09-21T03:14:39.469255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:46.544930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467471+0000","last_change":"2024-09-21T03:14:37.469799+0000","last_active":"2024-09-21T03:14:39.467471+0000","last_peered":"2024-09-21T03:14:39.467471+0000","last_clean":"2024-09-21T03:14:39.467471+0000","last_became_active":"2024-09-21T03:14:37.469495+0000","last_became_peered":"2024-09-21T03:14:37.469495+0000","last_unstale":"2024-09-21T03:14:39.467471+0000","last_undegraded":"2024-09-21T03:14:39.467471+0000","last_fullsized":"2024-09-21T03:14:39.467471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:50.247050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.974835+0000","last_change":"2024-09-21T03:14:38.479657+0000","last_active":"2024-09-21T03:14:39.974835+0000","last_peered":"2024-09-21T03:14:39.974835+0000","last_clean":"2024-09-21T03:14:39.974835+0000","last_became_active":"2024-09-21T03:14:38.479439+0000","last_became_peered":"2024-09-21T03:14:38.479439+0000","last_unstale":"2024-09-21T03:14:39.974835+0000","last_undegraded":"2024-09-21T03:14:39.974835+0000","last_fullsized":"2024-09-21T03:14:39.974835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.107215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467657+0000","last_change":"2024-09-21T03:14:37.473484+0000","last_active":"2024-09-21T03:14:39.467657+0000","last_peered":"2024-09-21T03:14:39.467657+0000","last_clean":"2024-09-21T03:14:39.467657+0000","last_became_active":"2024-09-21T03:14:37.473218+0000","last_became_peered":"2024-09-21T03:14:37.473218+0000","last_unstale":"2024-09-21T03:14:39.467657+0000","last_undegraded":"2024-09-21T03:14:39.467657+0000","last_fullsized":"2024-09-21T03:14:39.467657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:49.006579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.550922+0000","last_change":"2024-09-21T03:14:38.493350+0000","last_active":"2024-09-21T03:14:39.550922+0000","last_peered":"2024-09-21T03:14:39.550922+0000","last_clean":"2024-09-21T03:14:39.550922+0000","last_became_active":"2024-09-21T03:14:38.492830+0000","last_became_peered":"2024-09-21T03:14:38.492830+0000","last_unstale":"2024-09-21T03:14:39.550922+0000","last_undegraded":"2024-09-21T03:14:39.550922+0000","last_fullsized":"2024-09-21T03:14:39.550922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:19.946319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701795+0000","last_change":"2024-09-21T03:14:37.479651+0000","last_active":"2024-09-21T03:14:40.701795+0000","last_peered":"2024-09-21T03:14:40.701795+0000","last_clean":"2024-09-21T03:14:40.701795+0000","last_became_active":"2024-09-21T03:14:37.478833+0000","last_became_peered":"2024-09-21T03:14:37.478833+0000","last_unstale":"2024-09-21T03:14:40.701795+0000","last_undegraded":"2024-09-21T03:14:40.701795+0000","last_fullsized":"2024-09-21T03:14:40.701795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:48.578637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701927+0000","last_change":"2024-09-21T03:14:38.475318+0000","last_active":"2024-09-21T03:14:40.701927+0000","last_peered":"2024-09-21T03:14:40.701927+0000","last_clean":"2024-09-21T03:14:40.701927+0000","last_became_active":"2024-09-21T03:14:38.474978+0000","last_became_peered":"2024-09-21T03:14:38.474978+0000","last_unstale":"2024-09-21T03:14:40.701927+0000","last_undegraded":"2024-09-21T03:14:40.701927+0000","last_fullsized":"2024-09-21T03:14:40.701927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:38.209624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467702+0000","last_change":"2024-09-21T03:14:37.480508+0000","last_active":"2024-09-21T03:14:39.467702+0000","last_peered":"2024-09-21T03:14:39.467702+0000","last_clean":"2024-09-21T03:14:39.467702+0000","last_became_active":"2024-09-21T03:14:37.480218+0000","last_became_peered":"2024-09-21T03:14:37.480218+0000","last_unstale":"2024-09-21T03:14:39.467702+0000","last_undegraded":"2024-09-21T03:14:39.467702+0000","last_fullsized":"2024-09-21T03:14:39.467702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:01.851380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701814+0000","last_change":"2024-09-21T03:14:38.479133+0000","last_active":"2024-09-21T03:14:40.701814+0000","last_peered":"2024-09-21T03:14:40.701814+0000","last_clean":"2024-09-21T03:14:40.701814+0000","last_became_active":"2024-09-21T03:14:38.478077+0000","last_became_peered":"2024-09-21T03:14:38.478077+0000","last_unstale":"2024-09-21T03:14:40.701814+0000","last_undegraded":"2024-09-21T03:14:40.701814+0000","last_fullsized":"2024-09-21T03:14:40.701814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:56.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.468690+0000","last_change":"2024-09-21T03:14:37.472962+0000","last_active":"2024-09-21T03:14:39.468690+0000","last_peered":"2024-09-21T03:14:39.468690+0000","last_clean":"2024-09-21T03:14:39.468690+0000","last_became_active":"2024-09-21T03:14:37.472271+0000","last_became_peered":"2024-09-21T03:14:37.472271+0000","last_unstale":"2024-09-21T03:14:39.468690+0000","last_undegraded":"2024-09-21T03:14:39.468690+0000","last_fullsized":"2024-09-21T03:14:39.468690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:54.952223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467830+0000","last_change":"2024-09-21T03:14:38.482658+0000","last_active":"2024-09-21T03:14:39.467830+0000","last_peered":"2024-09-21T03:14:39.467830+0000","last_clean":"2024-09-21T03:14:39.467830+0000","last_became_active":"2024-09-21T03:14:38.482369+0000","last_became_peered":"2024-09-21T03:14:38.482369+0000","last_unstale":"2024-09-21T03:14:39.467830+0000","last_undegraded":"2024-09-21T03:14:39.467830+0000","last_fullsized":"2024-09-21T03:14:39.467830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:36.682534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.700840+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:14:40.700840+0000","last_peered":"2024-09-21T03:14:40.700840+0000","last_clean":"2024-09-21T03:14:40.700840+0000","last_became_active":"2024-09-21T03:14:37.478840+0000","last_became_peered":"2024-09-21T03:14:37.478840+0000","last_unstale":"2024-09-21T03:14:40.700840+0000","last_undegraded":"2024-09-21T03:14:40.700840+0000","last_fullsized":"2024-09-21T03:14:40.700840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:00.964354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.700808+0000","last_change":"2024-09-21T03:14:38.479370+0000","last_active":"2024-09-21T03:14:40.700808+0000","last_peered":"2024-09-21T03:14:40.700808+0000","last_clean":"2024-09-21T03:14:40.700808+0000","last_became_active":"2024-09-21T03:14:38.476976+0000","last_became_peered":"2024-09-21T03:14:38.476976+0000","last_unstale":"2024-09-21T03:14:40.700808+0000","last_undegraded":"2024-09-21T03:14:40.700808+0000","last_fullsized":"2024-09-21T03:14:40.700808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:14.695819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.551049+0000","last_change":"2024-09-21T03:14:37.465907+0000","last_active":"2024-09-21T03:14:39.551049+0000","last_peered":"2024-09-21T03:14:39.551049+0000","last_clean":"2024-09-21T03:14:39.551049+0000","last_became_active":"2024-09-21T03:14:37.465551+0000","last_became_peered":"2024-09-21T03:14:37.465551+0000","last_unstale":"2024-09-21T03:14:39.551049+0000","last_undegraded":"2024-09-21T03:14:39.551049+0000","last_fullsized":"2024-09-21T03:14:39.551049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:10.599687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.700969+0000","last_change":"2024-09-21T03:14:38.494021+0000","last_active":"2024-09-21T03:14:40.700969+0000","last_peered":"2024-09-21T03:14:40.700969+0000","last_clean":"2024-09-21T03:14:40.700969+0000","last_became_active":"2024-09-21T03:14:38.486802+0000","last_became_peered":"2024-09-21T03:14:38.486802+0000","last_unstale":"2024-09-21T03:14:40.700969+0000","last_undegraded":"2024-09-21T03:14:40.700969+0000","last_fullsized":"2024-09-21T03:14:40.700969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:31.817505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467062+0000","last_change":"2024-09-21T03:14:37.463164+0000","last_active":"2024-09-21T03:14:39.467062+0000","last_peered":"2024-09-21T03:14:39.467062+0000","last_clean":"2024-09-21T03:14:39.467062+0000","last_became_active":"2024-09-21T03:14:37.461409+0000","last_became_peered":"2024-09-21T03:14:37.461409+0000","last_unstale":"2024-09-21T03:14:39.467062+0000","last_undegraded":"2024-09-21T03:14:39.467062+0000","last_fullsized":"2024-09-21T03:14:39.467062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:51.126291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467133+0000","last_change":"2024-09-21T03:14:38.476747+0000","last_active":"2024-09-21T03:14:39.467133+0000","last_peered":"2024-09-21T03:14:39.467133+0000","last_clean":"2024-09-21T03:14:39.467133+0000","last_became_active":"2024-09-21T03:14:38.476386+0000","last_became_peered":"2024-09-21T03:14:38.476386+0000","last_unstale":"2024-09-21T03:14:39.467133+0000","last_undegraded":"2024-09-21T03:14:39.467133+0000","last_fullsized":"2024-09-21T03:14:39.467133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:28.751991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467321+0000","last_change":"2024-09-21T03:14:38.468756+0000","last_active":"2024-09-21T03:14:39.467321+0000","last_peered":"2024-09-21T03:14:39.467321+0000","last_clean":"2024-09-21T03:14:39.467321+0000","last_became_active":"2024-09-21T03:14:38.467570+0000","last_became_peered":"2024-09-21T03:14:38.467570+0000","last_unstale":"2024-09-21T03:14:39.467321+0000","last_undegraded":"2024-09-21T03:14:39.467321+0000","last_fullsized":"2024-09-21T03:14:39.467321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:24.784157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469709+0000","last_change":"2024-09-21T03:14:37.479842+0000","last_active":"2024-09-21T03:14:39.469709+0000","last_peered":"2024-09-21T03:14:39.469709+0000","last_clean":"2024-09-21T03:14:39.469709+0000","last_became_active":"2024-09-21T03:14:37.478893+0000","last_became_peered":"2024-09-21T03:14:37.478893+0000","last_unstale":"2024-09-21T03:14:39.469709+0000","last_undegraded":"2024-09-21T03:14:39.469709+0000","last_fullsized":"2024-09-21T03:14:39.469709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:27.916133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.713960+0000","last_change":"2024-09-21T03:14:38.472992+0000","last_active":"2024-09-21T03:14:39.713960+0000","last_peered":"2024-09-21T03:14:39.713960+0000","last_clean":"2024-09-21T03:14:39.713960+0000","last_became_active":"2024-09-21T03:14:38.472426+0000","last_became_peered":"2024-09-21T03:14:38.472426+0000","last_unstale":"2024-09-21T03:14:39.713960+0000","last_undegraded":"2024-09-21T03:14:39.713960+0000","last_fullsized":"2024-09-21T03:14:39.713960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:36.825612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469745+0000","last_change":"2024-09-21T03:14:37.478711+0000","last_active":"2024-09-21T03:14:39.469745+0000","last_peered":"2024-09-21T03:14:39.469745+0000","last_clean":"2024-09-21T03:14:39.469745+0000","last_became_active":"2024-09-21T03:14:37.477910+0000","last_became_peered":"2024-09-21T03:14:37.477910+0000","last_unstale":"2024-09-21T03:14:39.469745+0000","last_undegraded":"2024-09-21T03:14:39.469745+0000","last_fullsized":"2024-09-21T03:14:39.469745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:40.166966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.468494+0000","last_change":"2024-09-21T03:14:38.486401+0000","last_active":"2024-09-21T03:14:39.468494+0000","last_peered":"2024-09-21T03:14:39.468494+0000","last_clean":"2024-09-21T03:14:39.468494+0000","last_became_active":"2024-09-21T03:14:38.486090+0000","last_became_peered":"2024-09-21T03:14:38.486090+0000","last_unstale":"2024-09-21T03:14:39.468494+0000","last_undegraded":"2024-09-21T03:14:39.468494+0000","last_fullsized":"2024-09-21T03:14:39.468494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:44.085100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.468282+0000","last_change":"2024-09-21T03:14:37.467448+0000","last_active":"2024-09-21T03:14:39.468282+0000","last_peered":"2024-09-21T03:14:39.468282+0000","last_clean":"2024-09-21T03:14:39.468282+0000","last_became_active":"2024-09-21T03:14:37.467146+0000","last_became_peered":"2024-09-21T03:14:37.467146+0000","last_unstale":"2024-09-21T03:14:39.468282+0000","last_undegraded":"2024-09-21T03:14:39.468282+0000","last_fullsized":"2024-09-21T03:14:39.468282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:53.475083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.468195+0000","last_change":"2024-09-21T03:14:38.496252+0000","last_active":"2024-09-21T03:14:39.468195+0000","last_peered":"2024-09-21T03:14:39.468195+0000","last_clean":"2024-09-21T03:14:39.468195+0000","last_became_active":"2024-09-21T03:14:38.488292+0000","last_became_peered":"2024-09-21T03:14:38.488292+0000","last_unstale":"2024-09-21T03:14:39.468195+0000","last_undegraded":"2024-09-21T03:14:39.468195+0000","last_fullsized":"2024-09-21T03:14:39.468195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:57.409792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701868+0000","last_change":"2024-09-21T03:14:37.471004+0000","last_active":"2024-09-21T03:14:40.701868+0000","last_peered":"2024-09-21T03:14:40.701868+0000","last_clean":"2024-09-21T03:14:40.701868+0000","last_became_active":"2024-09-21T03:14:37.470563+0000","last_became_peered":"2024-09-21T03:14:37.470563+0000","last_unstale":"2024-09-21T03:14:40.701868+0000","last_undegraded":"2024-09-21T03:14:40.701868+0000","last_fullsized":"2024-09-21T03:14:40.701868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.422826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":204800,"data_stored":65956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":811008,"data_stored":662567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":68116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":73719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":806912,"data_stored":662545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":65832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":200704,"data_stored":66414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:14:43.899 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:14:44.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.152+0000 7fee25000640 1 -- 172.21.15.90:0/1747851737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee200acca0 msgr2=0x7fee20074220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:44.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.152+0000 7fee25000640 1 --2- 172.21.15.90:0/1747851737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee200acca0 0x7fee20074220 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fee20155680 tx=0x7fee1802aa10 comp rx=0 tx=0).stop 2024-09-21T03:14:44.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.152+0000 7fee25000640 1 -- 172.21.15.90:0/1747851737 shutdown_connections 2024-09-21T03:14:44.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.152+0000 7fee25000640 1 --2- 172.21.15.90:0/1747851737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee200acca0 0x7fee20074220 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:44.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.152+0000 7fee25000640 1 --2- 172.21.15.90:0/1747851737 >> v2:172.21.15.149:3300/0 conn(0x7fee200ac350 0x7fee200ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:44.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.152+0000 7fee25000640 1 -- 172.21.15.90:0/1747851737 >> 172.21.15.90:0/1747851737 conn(0x7fee200c8ba0 msgr2=0x7fee2006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:44.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.152+0000 7fee25000640 1 -- 172.21.15.90:0/1747851737 shutdown_connections 2024-09-21T03:14:44.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.152+0000 7fee25000640 1 -- 172.21.15.90:0/1747851737 wait complete. 2024-09-21T03:14:44.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.154+0000 7fee25000640 1 Processor -- start 2024-09-21T03:14:44.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.154+0000 7fee25000640 1 -- start start 2024-09-21T03:14:44.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.156+0000 7fee25000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee2006d960 0x7fee200c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:44.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.156+0000 7fee25000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee200ac350 0x7fee2006e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:44.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.156+0000 7fee25000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee200acca0 0x7fee20151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:44.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.156+0000 7fee25000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fee20074760 con 0x7fee200ac350 2024-09-21T03:14:44.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.156+0000 7fee25000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fee200ab640 con 0x7fee2006d960 2024-09-21T03:14:44.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.156+0000 7fee25000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fee200748e0 con 0x7fee200acca0 2024-09-21T03:14:44.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.156+0000 7fee17e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee200ac350 0x7fee2006e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:44.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.156+0000 7fee17e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee200ac350 0x7fee2006e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38114/0 (socket says 172.21.15.90:38114) 2024-09-21T03:14:44.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.156+0000 7fee17e00640 1 -- 172.21.15.90:0/706479729 learned_addr learned my addr 172.21.15.90:0/706479729 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:44.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.156+0000 7fee1de00640 1 --2- 172.21.15.90:0/706479729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee2006d960 0x7fee200c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:44.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.156+0000 7fee1e800640 1 --2- 172.21.15.90:0/706479729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee200acca0 0x7fee20151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:44.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.156+0000 7fee17e00640 1 -- 172.21.15.90:0/706479729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee200acca0 msgr2=0x7fee20151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:44.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.156+0000 7fee17e00640 1 --2- 172.21.15.90:0/706479729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee200acca0 0x7fee20151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:44.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.156+0000 7fee17e00640 1 -- 172.21.15.90:0/706479729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee2006d960 msgr2=0x7fee200c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:44.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.156+0000 7fee17e00640 1 --2- 172.21.15.90:0/706479729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee2006d960 0x7fee200c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:44.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.156+0000 7fee17e00640 1 -- 172.21.15.90:0/706479729 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee201ed950 con 0x7fee200ac350 2024-09-21T03:14:44.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.156+0000 7fee1de00640 1 --2- 172.21.15.90:0/706479729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee2006d960 0x7fee200c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:44.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.156+0000 7fee1e800640 1 --2- 172.21.15.90:0/706479729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee200acca0 0x7fee20151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:44.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.157+0000 7fee17e00640 1 --2- 172.21.15.90:0/706479729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee200ac350 0x7fee2006e7d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fee0800e790 tx=0x7fee0800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:44.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.157+0000 7fee16000640 1 -- 172.21.15.90:0/706479729 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0800eea0 con 0x7fee200ac350 2024-09-21T03:14:44.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.157+0000 7fee16000640 1 -- 172.21.15.90:0/706479729 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee0800ccc0 con 0x7fee200ac350 2024-09-21T03:14:44.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.157+0000 7fee25000640 1 -- 172.21.15.90:0/706479729 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee201edc30 con 0x7fee200ac350 2024-09-21T03:14:44.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.157+0000 7fee16000640 1 -- 172.21.15.90:0/706479729 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee08005280 con 0x7fee200ac350 2024-09-21T03:14:44.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.157+0000 7fee25000640 1 -- 172.21.15.90:0/706479729 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee201ee1f0 con 0x7fee200ac350 2024-09-21T03:14:44.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.158+0000 7fee25000640 1 -- 172.21.15.90:0/706479729 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee20076b20 con 0x7fee200ac350 2024-09-21T03:14:44.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.159+0000 7fee16000640 1 -- 172.21.15.90:0/706479729 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fee08005420 con 0x7fee200ac350 2024-09-21T03:14:44.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.160+0000 7fee16000640 1 --2- 172.21.15.90:0/706479729 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fedfc078b90 0x7fedfc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:44.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.160+0000 7fee16000640 1 -- 172.21.15.90:0/706479729 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7fee0809b690 con 0x7fee200ac350 2024-09-21T03:14:44.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.161+0000 7fee1de00640 1 --2- 172.21.15.90:0/706479729 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fedfc078b90 0x7fedfc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:44.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.161+0000 7fee1de00640 1 --2- 172.21.15.90:0/706479729 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fedfc078b90 0x7fedfc07b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee200c5ca0 tx=0x7fee10009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:44.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.165+0000 7fee16000640 1 -- 172.21.15.90:0/706479729 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fee20076b20 con 0x7fee200ac350 2024-09-21T03:14:44.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.346+0000 7fee25000640 1 -- 172.21.15.90:0/706479729 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fee20074d60 con 0x7fedfc078b90 2024-09-21T03:14:44.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.352+0000 7fee16000640 1 -- 172.21.15.90:0/706479729 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251931 (secure 0 0 0) 0x7fee20074d60 con 0x7fedfc078b90 2024-09-21T03:14:44.356 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:44.357 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-21T03:14:44.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.356+0000 7fee25000640 1 -- 172.21.15.90:0/706479729 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fedfc078b90 msgr2=0x7fedfc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:44.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.356+0000 7fee25000640 1 --2- 172.21.15.90:0/706479729 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fedfc078b90 0x7fedfc07b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee200c5ca0 tx=0x7fee10009040 comp rx=0 tx=0).stop 2024-09-21T03:14:44.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.356+0000 7fee25000640 1 -- 172.21.15.90:0/706479729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee200ac350 msgr2=0x7fee2006e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:44.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.356+0000 7fee25000640 1 --2- 172.21.15.90:0/706479729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee200ac350 0x7fee2006e7d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fee0800e790 tx=0x7fee0800ec50 comp rx=0 tx=0).stop 2024-09-21T03:14:44.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.356+0000 7fee25000640 1 -- 172.21.15.90:0/706479729 shutdown_connections 2024-09-21T03:14:44.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.356+0000 7fee25000640 1 --2- 172.21.15.90:0/706479729 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fedfc078b90 0x7fedfc07b0a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:44.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.356+0000 7fee25000640 1 --2- 172.21.15.90:0/706479729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee200acca0 0x7fee20151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:44.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.356+0000 7fee25000640 1 --2- 172.21.15.90:0/706479729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee200ac350 0x7fee2006e7d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:44.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.356+0000 7fee25000640 1 --2- 172.21.15.90:0/706479729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee2006d960 0x7fee200c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:44.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.356+0000 7fee25000640 1 -- 172.21.15.90:0/706479729 >> 172.21.15.90:0/706479729 conn(0x7fee200c8ba0 msgr2=0x7fee2013cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:44.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.356+0000 7fee25000640 1 -- 172.21.15.90:0/706479729 shutdown_connections 2024-09-21T03:14:44.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.356+0000 7fee25000640 1 -- 172.21.15.90:0/706479729 wait complete. 2024-09-21T03:14:44.382 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-21T03:14:42.473530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":145,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219064,"kb_used_data":2808,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755656,"statfs":{"total":773094113280,"available":772869791744,"internally_reserved":0,"allocated":2875392,"data_stored":1737312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002000"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469681+0000","last_change":"2024-09-21T03:14:38.490309+0000","last_active":"2024-09-21T03:14:39.469681+0000","last_peered":"2024-09-21T03:14:39.469681+0000","last_clean":"2024-09-21T03:14:39.469681+0000","last_became_active":"2024-09-21T03:14:38.489167+0000","last_became_peered":"2024-09-21T03:14:38.489167+0000","last_unstale":"2024-09-21T03:14:39.469681+0000","last_undegraded":"2024-09-21T03:14:39.469681+0000","last_fullsized":"2024-09-21T03:14:39.469681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:07.725691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.468135+0000","last_change":"2024-09-21T03:14:38.496218+0000","last_active":"2024-09-21T03:14:39.468135+0000","last_peered":"2024-09-21T03:14:39.468135+0000","last_clean":"2024-09-21T03:14:39.468135+0000","last_became_active":"2024-09-21T03:14:38.488537+0000","last_became_peered":"2024-09-21T03:14:38.488537+0000","last_unstale":"2024-09-21T03:14:39.468135+0000","last_undegraded":"2024-09-21T03:14:39.468135+0000","last_fullsized":"2024-09-21T03:14:39.468135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:59.667392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467689+0000","last_change":"2024-09-21T03:14:38.482605+0000","last_active":"2024-09-21T03:14:39.467689+0000","last_peered":"2024-09-21T03:14:39.467689+0000","last_clean":"2024-09-21T03:14:39.467689+0000","last_became_active":"2024-09-21T03:14:38.482306+0000","last_became_peered":"2024-09-21T03:14:38.482306+0000","last_unstale":"2024-09-21T03:14:39.467689+0000","last_undegraded":"2024-09-21T03:14:39.467689+0000","last_fullsized":"2024-09-21T03:14:39.467689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:40.482635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.974795+0000","last_change":"2024-09-21T03:14:38.481389+0000","last_active":"2024-09-21T03:14:39.974795+0000","last_peered":"2024-09-21T03:14:39.974795+0000","last_clean":"2024-09-21T03:14:39.974795+0000","last_became_active":"2024-09-21T03:14:38.470907+0000","last_became_peered":"2024-09-21T03:14:38.470907+0000","last_unstale":"2024-09-21T03:14:39.974795+0000","last_undegraded":"2024-09-21T03:14:39.974795+0000","last_fullsized":"2024-09-21T03:14:39.974795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:30.068915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469151+0000","last_change":"2024-09-21T03:14:38.466077+0000","last_active":"2024-09-21T03:14:39.469151+0000","last_peered":"2024-09-21T03:14:39.469151+0000","last_clean":"2024-09-21T03:14:39.469151+0000","last_became_active":"2024-09-21T03:14:38.465818+0000","last_became_peered":"2024-09-21T03:14:38.465818+0000","last_unstale":"2024-09-21T03:14:39.469151+0000","last_undegraded":"2024-09-21T03:14:39.469151+0000","last_fullsized":"2024-09-21T03:14:39.469151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:34.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.974583+0000","last_change":"2024-09-21T03:14:38.471270+0000","last_active":"2024-09-21T03:14:39.974583+0000","last_peered":"2024-09-21T03:14:39.974583+0000","last_clean":"2024-09-21T03:14:39.974583+0000","last_became_active":"2024-09-21T03:14:38.470708+0000","last_became_peered":"2024-09-21T03:14:38.470708+0000","last_unstale":"2024-09-21T03:14:39.974583+0000","last_undegraded":"2024-09-21T03:14:39.974583+0000","last_fullsized":"2024-09-21T03:14:39.974583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.122804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.468962+0000","last_change":"2024-09-21T03:14:38.482620+0000","last_active":"2024-09-21T03:14:39.468962+0000","last_peered":"2024-09-21T03:14:39.468962+0000","last_clean":"2024-09-21T03:14:39.468962+0000","last_became_active":"2024-09-21T03:14:38.482346+0000","last_became_peered":"2024-09-21T03:14:38.482346+0000","last_unstale":"2024-09-21T03:14:39.468962+0000","last_undegraded":"2024-09-21T03:14:39.468962+0000","last_fullsized":"2024-09-21T03:14:39.468962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:52.977725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467259+0000","last_change":"2024-09-21T03:14:38.465771+0000","last_active":"2024-09-21T03:14:39.467259+0000","last_peered":"2024-09-21T03:14:39.467259+0000","last_clean":"2024-09-21T03:14:39.467259+0000","last_became_active":"2024-09-21T03:14:38.465479+0000","last_became_peered":"2024-09-21T03:14:38.465479+0000","last_unstale":"2024-09-21T03:14:39.467259+0000","last_undegraded":"2024-09-21T03:14:39.467259+0000","last_fullsized":"2024-09-21T03:14:39.467259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.754315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.714105+0000","last_change":"2024-09-21T03:14:38.483370+0000","last_active":"2024-09-21T03:14:39.714105+0000","last_peered":"2024-09-21T03:14:39.714105+0000","last_clean":"2024-09-21T03:14:39.714105+0000","last_became_active":"2024-09-21T03:14:38.483019+0000","last_became_peered":"2024-09-21T03:14:38.483019+0000","last_unstale":"2024-09-21T03:14:39.714105+0000","last_undegraded":"2024-09-21T03:14:39.714105+0000","last_fullsized":"2024-09-21T03:14:39.714105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:55.085422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469797+0000","last_change":"2024-09-21T03:14:38.474326+0000","last_active":"2024-09-21T03:14:39.469797+0000","last_peered":"2024-09-21T03:14:39.469797+0000","last_clean":"2024-09-21T03:14:39.469797+0000","last_became_active":"2024-09-21T03:14:38.470430+0000","last_became_peered":"2024-09-21T03:14:38.470430+0000","last_unstale":"2024-09-21T03:14:39.469797+0000","last_undegraded":"2024-09-21T03:14:39.469797+0000","last_fullsized":"2024-09-21T03:14:39.469797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:09.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469360+0000","last_change":"2024-09-21T03:14:38.473907+0000","last_active":"2024-09-21T03:14:39.469360+0000","last_peered":"2024-09-21T03:14:39.469360+0000","last_clean":"2024-09-21T03:14:39.469360+0000","last_became_active":"2024-09-21T03:14:38.473579+0000","last_became_peered":"2024-09-21T03:14:38.473579+0000","last_unstale":"2024-09-21T03:14:39.469360+0000","last_undegraded":"2024-09-21T03:14:39.469360+0000","last_fullsized":"2024-09-21T03:14:39.469360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:32.273503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469318+0000","last_change":"2024-09-21T03:14:38.481308+0000","last_active":"2024-09-21T03:14:39.469318+0000","last_peered":"2024-09-21T03:14:39.469318+0000","last_clean":"2024-09-21T03:14:39.469318+0000","last_became_active":"2024-09-21T03:14:38.480923+0000","last_became_peered":"2024-09-21T03:14:38.480923+0000","last_unstale":"2024-09-21T03:14:39.469318+0000","last_undegraded":"2024-09-21T03:14:39.469318+0000","last_fullsized":"2024-09-21T03:14:39.469318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:40.689231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.550917+0000","last_change":"2024-09-21T03:14:38.478853+0000","last_active":"2024-09-21T03:14:39.550917+0000","last_peered":"2024-09-21T03:14:39.550917+0000","last_clean":"2024-09-21T03:14:39.550917+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:14:39.550917+0000","last_undegraded":"2024-09-21T03:14:39.550917+0000","last_fullsized":"2024-09-21T03:14:39.550917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:31.427596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.551007+0000","last_change":"2024-09-21T03:14:38.487983+0000","last_active":"2024-09-21T03:14:39.551007+0000","last_peered":"2024-09-21T03:14:39.551007+0000","last_clean":"2024-09-21T03:14:39.551007+0000","last_became_active":"2024-09-21T03:14:38.487676+0000","last_became_peered":"2024-09-21T03:14:38.487676+0000","last_unstale":"2024-09-21T03:14:39.551007+0000","last_undegraded":"2024-09-21T03:14:39.551007+0000","last_fullsized":"2024-09-21T03:14:39.551007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:35.320169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467226+0000","last_change":"2024-09-21T03:14:38.469736+0000","last_active":"2024-09-21T03:14:39.467226+0000","last_peered":"2024-09-21T03:14:39.467226+0000","last_clean":"2024-09-21T03:14:39.467226+0000","last_became_active":"2024-09-21T03:14:38.469240+0000","last_became_peered":"2024-09-21T03:14:38.469240+0000","last_unstale":"2024-09-21T03:14:39.467226+0000","last_undegraded":"2024-09-21T03:14:39.467226+0000","last_fullsized":"2024-09-21T03:14:39.467226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:04.258761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.466678+0000","last_change":"2024-09-21T03:14:38.474262+0000","last_active":"2024-09-21T03:14:39.466678+0000","last_peered":"2024-09-21T03:14:39.466678+0000","last_clean":"2024-09-21T03:14:39.466678+0000","last_became_active":"2024-09-21T03:14:38.473856+0000","last_became_peered":"2024-09-21T03:14:38.473856+0000","last_unstale":"2024-09-21T03:14:39.466678+0000","last_undegraded":"2024-09-21T03:14:39.466678+0000","last_fullsized":"2024-09-21T03:14:39.466678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467584+0000","last_change":"2024-09-21T03:14:38.474462+0000","last_active":"2024-09-21T03:14:39.467584+0000","last_peered":"2024-09-21T03:14:39.467584+0000","last_clean":"2024-09-21T03:14:39.467584+0000","last_became_active":"2024-09-21T03:14:38.474156+0000","last_became_peered":"2024-09-21T03:14:38.474156+0000","last_unstale":"2024-09-21T03:14:39.467584+0000","last_undegraded":"2024-09-21T03:14:39.467584+0000","last_fullsized":"2024-09-21T03:14:39.467584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:55.329945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701285+0000","last_change":"2024-09-21T03:14:38.494878+0000","last_active":"2024-09-21T03:14:40.701285+0000","last_peered":"2024-09-21T03:14:40.701285+0000","last_clean":"2024-09-21T03:14:40.701285+0000","last_became_active":"2024-09-21T03:14:38.492813+0000","last_became_peered":"2024-09-21T03:14:38.492813+0000","last_unstale":"2024-09-21T03:14:40.701285+0000","last_undegraded":"2024-09-21T03:14:40.701285+0000","last_fullsized":"2024-09-21T03:14:40.701285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:55.064844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467704+0000","last_change":"2024-09-21T03:14:38.478039+0000","last_active":"2024-09-21T03:14:39.467704+0000","last_peered":"2024-09-21T03:14:39.467704+0000","last_clean":"2024-09-21T03:14:39.467704+0000","last_became_active":"2024-09-21T03:14:38.473843+0000","last_became_peered":"2024-09-21T03:14:38.473843+0000","last_unstale":"2024-09-21T03:14:39.467704+0000","last_undegraded":"2024-09-21T03:14:39.467704+0000","last_fullsized":"2024-09-21T03:14:39.467704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:27.072406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469466+0000","last_change":"2024-09-21T03:14:38.480638+0000","last_active":"2024-09-21T03:14:39.469466+0000","last_peered":"2024-09-21T03:14:39.469466+0000","last_clean":"2024-09-21T03:14:39.469466+0000","last_became_active":"2024-09-21T03:14:38.477739+0000","last_became_peered":"2024-09-21T03:14:38.477739+0000","last_unstale":"2024-09-21T03:14:39.469466+0000","last_undegraded":"2024-09-21T03:14:39.469466+0000","last_fullsized":"2024-09-21T03:14:39.469466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:35.097761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701525+0000","last_change":"2024-09-21T03:14:38.482681+0000","last_active":"2024-09-21T03:14:40.701525+0000","last_peered":"2024-09-21T03:14:40.701525+0000","last_clean":"2024-09-21T03:14:40.701525+0000","last_became_active":"2024-09-21T03:14:38.477816+0000","last_became_peered":"2024-09-21T03:14:38.477816+0000","last_unstale":"2024-09-21T03:14:40.701525+0000","last_undegraded":"2024-09-21T03:14:40.701525+0000","last_fullsized":"2024-09-21T03:14:40.701525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:18.675641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.713987+0000","last_change":"2024-09-21T03:14:38.470991+0000","last_active":"2024-09-21T03:14:39.713987+0000","last_peered":"2024-09-21T03:14:39.713987+0000","last_clean":"2024-09-21T03:14:39.713987+0000","last_became_active":"2024-09-21T03:14:38.470666+0000","last_became_peered":"2024-09-21T03:14:38.470666+0000","last_unstale":"2024-09-21T03:14:39.713987+0000","last_undegraded":"2024-09-21T03:14:39.713987+0000","last_fullsized":"2024-09-21T03:14:39.713987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:25.477992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467789+0000","last_change":"2024-09-21T03:14:38.491888+0000","last_active":"2024-09-21T03:14:39.467789+0000","last_peered":"2024-09-21T03:14:39.467789+0000","last_clean":"2024-09-21T03:14:39.467789+0000","last_became_active":"2024-09-21T03:14:38.491510+0000","last_became_peered":"2024-09-21T03:14:38.491510+0000","last_unstale":"2024-09-21T03:14:39.467789+0000","last_undegraded":"2024-09-21T03:14:39.467789+0000","last_fullsized":"2024-09-21T03:14:39.467789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:26.740304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467241+0000","last_change":"2024-09-21T03:14:38.471959+0000","last_active":"2024-09-21T03:14:39.467241+0000","last_peered":"2024-09-21T03:14:39.467241+0000","last_clean":"2024-09-21T03:14:39.467241+0000","last_became_active":"2024-09-21T03:14:38.471625+0000","last_became_peered":"2024-09-21T03:14:38.471625+0000","last_unstale":"2024-09-21T03:14:39.467241+0000","last_undegraded":"2024-09-21T03:14:39.467241+0000","last_fullsized":"2024-09-21T03:14:39.467241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:17.761951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.468139+0000","last_change":"2024-09-21T03:14:38.487093+0000","last_active":"2024-09-21T03:14:39.468139+0000","last_peered":"2024-09-21T03:14:39.468139+0000","last_clean":"2024-09-21T03:14:39.468139+0000","last_became_active":"2024-09-21T03:14:38.486204+0000","last_became_peered":"2024-09-21T03:14:38.486204+0000","last_unstale":"2024-09-21T03:14:39.468139+0000","last_undegraded":"2024-09-21T03:14:39.468139+0000","last_fullsized":"2024-09-21T03:14:39.468139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:55.531046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.974920+0000","last_change":"2024-09-21T03:14:38.484198+0000","last_active":"2024-09-21T03:14:39.974920+0000","last_peered":"2024-09-21T03:14:39.974920+0000","last_clean":"2024-09-21T03:14:39.974920+0000","last_became_active":"2024-09-21T03:14:38.483893+0000","last_became_peered":"2024-09-21T03:14:38.483893+0000","last_unstale":"2024-09-21T03:14:39.974920+0000","last_undegraded":"2024-09-21T03:14:39.974920+0000","last_fullsized":"2024-09-21T03:14:39.974920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:56.665359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.551241+0000","last_change":"2024-09-21T03:14:38.478099+0000","last_active":"2024-09-21T03:14:39.551241+0000","last_peered":"2024-09-21T03:14:39.551241+0000","last_clean":"2024-09-21T03:14:39.551241+0000","last_became_active":"2024-09-21T03:14:38.475894+0000","last_became_peered":"2024-09-21T03:14:38.475894+0000","last_unstale":"2024-09-21T03:14:39.551241+0000","last_undegraded":"2024-09-21T03:14:39.551241+0000","last_fullsized":"2024-09-21T03:14:39.551241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:49.876430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.550914+0000","last_change":"2024-09-21T03:14:38.473900+0000","last_active":"2024-09-21T03:14:39.550914+0000","last_peered":"2024-09-21T03:14:39.550914+0000","last_clean":"2024-09-21T03:14:39.550914+0000","last_became_active":"2024-09-21T03:14:38.471325+0000","last_became_peered":"2024-09-21T03:14:38.471325+0000","last_unstale":"2024-09-21T03:14:39.550914+0000","last_undegraded":"2024-09-21T03:14:39.550914+0000","last_fullsized":"2024-09-21T03:14:39.550914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:47.556293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467640+0000","last_change":"2024-09-21T03:14:38.481039+0000","last_active":"2024-09-21T03:14:39.467640+0000","last_peered":"2024-09-21T03:14:39.467640+0000","last_clean":"2024-09-21T03:14:39.467640+0000","last_became_active":"2024-09-21T03:14:38.480686+0000","last_became_peered":"2024-09-21T03:14:38.480686+0000","last_unstale":"2024-09-21T03:14:39.467640+0000","last_undegraded":"2024-09-21T03:14:39.467640+0000","last_fullsized":"2024-09-21T03:14:39.467640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:18.603386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467019+0000","last_change":"2024-09-21T03:14:38.472860+0000","last_active":"2024-09-21T03:14:39.467019+0000","last_peered":"2024-09-21T03:14:39.467019+0000","last_clean":"2024-09-21T03:14:39.467019+0000","last_became_active":"2024-09-21T03:14:38.472548+0000","last_became_peered":"2024-09-21T03:14:38.472548+0000","last_unstale":"2024-09-21T03:14:39.467019+0000","last_undegraded":"2024-09-21T03:14:39.467019+0000","last_fullsized":"2024-09-21T03:14:39.467019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:16.071692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701356+0000","last_change":"2024-09-21T03:14:38.477183+0000","last_active":"2024-09-21T03:14:40.701356+0000","last_peered":"2024-09-21T03:14:40.701356+0000","last_clean":"2024-09-21T03:14:40.701356+0000","last_became_active":"2024-09-21T03:14:38.476657+0000","last_became_peered":"2024-09-21T03:14:38.476657+0000","last_unstale":"2024-09-21T03:14:40.701356+0000","last_undegraded":"2024-09-21T03:14:40.701356+0000","last_fullsized":"2024-09-21T03:14:40.701356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:36.801764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.974555+0000","last_change":"2024-09-21T03:14:38.484311+0000","last_active":"2024-09-21T03:14:39.974555+0000","last_peered":"2024-09-21T03:14:39.974555+0000","last_clean":"2024-09-21T03:14:39.974555+0000","last_became_active":"2024-09-21T03:14:38.483975+0000","last_became_peered":"2024-09-21T03:14:38.483975+0000","last_unstale":"2024-09-21T03:14:39.974555+0000","last_undegraded":"2024-09-21T03:14:39.974555+0000","last_fullsized":"2024-09-21T03:14:39.974555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:31.145431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.713792+0000","last_change":"2024-09-21T03:14:38.474516+0000","last_active":"2024-09-21T03:14:39.713792+0000","last_peered":"2024-09-21T03:14:39.713792+0000","last_clean":"2024-09-21T03:14:39.713792+0000","last_became_active":"2024-09-21T03:14:38.472225+0000","last_became_peered":"2024-09-21T03:14:38.472225+0000","last_unstale":"2024-09-21T03:14:39.713792+0000","last_undegraded":"2024-09-21T03:14:39.713792+0000","last_fullsized":"2024-09-21T03:14:39.713792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:47.504910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467651+0000","last_change":"2024-09-21T03:14:37.465536+0000","last_active":"2024-09-21T03:14:39.467651+0000","last_peered":"2024-09-21T03:14:39.467651+0000","last_clean":"2024-09-21T03:14:39.467651+0000","last_became_active":"2024-09-21T03:14:37.465240+0000","last_became_peered":"2024-09-21T03:14:37.465240+0000","last_unstale":"2024-09-21T03:14:39.467651+0000","last_undegraded":"2024-09-21T03:14:39.467651+0000","last_fullsized":"2024-09-21T03:14:39.467651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:34.780298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701436+0000","last_change":"2024-09-21T03:14:38.483226+0000","last_active":"2024-09-21T03:14:40.701436+0000","last_peered":"2024-09-21T03:14:40.701436+0000","last_clean":"2024-09-21T03:14:40.701436+0000","last_became_active":"2024-09-21T03:14:38.482354+0000","last_became_peered":"2024-09-21T03:14:38.482354+0000","last_unstale":"2024-09-21T03:14:40.701436+0000","last_undegraded":"2024-09-21T03:14:40.701436+0000","last_fullsized":"2024-09-21T03:14:40.701436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:51.488594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467272+0000","last_change":"2024-09-21T03:14:37.475076+0000","last_active":"2024-09-21T03:14:39.467272+0000","last_peered":"2024-09-21T03:14:39.467272+0000","last_clean":"2024-09-21T03:14:39.467272+0000","last_became_active":"2024-09-21T03:14:37.474595+0000","last_became_peered":"2024-09-21T03:14:37.474595+0000","last_unstale":"2024-09-21T03:14:39.467272+0000","last_undegraded":"2024-09-21T03:14:39.467272+0000","last_fullsized":"2024-09-21T03:14:39.467272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:16.880647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.550595+0000","last_change":"2024-09-21T03:14:37.472209+0000","last_active":"2024-09-21T03:14:39.550595+0000","last_peered":"2024-09-21T03:14:39.550595+0000","last_clean":"2024-09-21T03:14:39.550595+0000","last_became_active":"2024-09-21T03:14:37.471771+0000","last_became_peered":"2024-09-21T03:14:37.471771+0000","last_unstale":"2024-09-21T03:14:39.550595+0000","last_undegraded":"2024-09-21T03:14:39.550595+0000","last_fullsized":"2024-09-21T03:14:39.550595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:30.648010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467635+0000","last_change":"2024-09-21T03:14:38.480723+0000","last_active":"2024-09-21T03:14:39.467635+0000","last_peered":"2024-09-21T03:14:39.467635+0000","last_clean":"2024-09-21T03:14:39.467635+0000","last_became_active":"2024-09-21T03:14:38.472823+0000","last_became_peered":"2024-09-21T03:14:38.472823+0000","last_unstale":"2024-09-21T03:14:39.467635+0000","last_undegraded":"2024-09-21T03:14:39.467635+0000","last_fullsized":"2024-09-21T03:14:39.467635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:59.862592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467360+0000","last_change":"2024-09-21T03:14:37.459351+0000","last_active":"2024-09-21T03:14:39.467360+0000","last_peered":"2024-09-21T03:14:39.467360+0000","last_clean":"2024-09-21T03:14:39.467360+0000","last_became_active":"2024-09-21T03:14:37.458676+0000","last_became_peered":"2024-09-21T03:14:37.458676+0000","last_unstale":"2024-09-21T03:14:39.467360+0000","last_undegraded":"2024-09-21T03:14:39.467360+0000","last_fullsized":"2024-09-21T03:14:39.467360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:42.671520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.700996+0000","last_change":"2024-09-21T03:14:38.481837+0000","last_active":"2024-09-21T03:14:40.700996+0000","last_peered":"2024-09-21T03:14:40.700996+0000","last_clean":"2024-09-21T03:14:40.700996+0000","last_became_active":"2024-09-21T03:14:38.478400+0000","last_became_peered":"2024-09-21T03:14:38.478400+0000","last_unstale":"2024-09-21T03:14:40.700996+0000","last_undegraded":"2024-09-21T03:14:40.700996+0000","last_fullsized":"2024-09-21T03:14:40.700996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.702185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.714109+0000","last_change":"2024-09-21T03:14:37.471363+0000","last_active":"2024-09-21T03:14:39.714109+0000","last_peered":"2024-09-21T03:14:39.714109+0000","last_clean":"2024-09-21T03:14:39.714109+0000","last_became_active":"2024-09-21T03:14:37.471002+0000","last_became_peered":"2024-09-21T03:14:37.471002+0000","last_unstale":"2024-09-21T03:14:39.714109+0000","last_undegraded":"2024-09-21T03:14:39.714109+0000","last_fullsized":"2024-09-21T03:14:39.714109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:25.922368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.975024+0000","last_change":"2024-09-21T03:14:38.488227+0000","last_active":"2024-09-21T03:14:39.975024+0000","last_peered":"2024-09-21T03:14:39.975024+0000","last_clean":"2024-09-21T03:14:39.975024+0000","last_became_active":"2024-09-21T03:14:38.482370+0000","last_became_peered":"2024-09-21T03:14:38.482370+0000","last_unstale":"2024-09-21T03:14:39.975024+0000","last_undegraded":"2024-09-21T03:14:39.975024+0000","last_fullsized":"2024-09-21T03:14:39.975024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:52.561391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469966+0000","last_change":"2024-09-21T03:14:37.479047+0000","last_active":"2024-09-21T03:14:39.469966+0000","last_peered":"2024-09-21T03:14:39.469966+0000","last_clean":"2024-09-21T03:14:39.469966+0000","last_became_active":"2024-09-21T03:14:37.478700+0000","last_became_peered":"2024-09-21T03:14:37.478700+0000","last_unstale":"2024-09-21T03:14:39.469966+0000","last_undegraded":"2024-09-21T03:14:39.469966+0000","last_fullsized":"2024-09-21T03:14:39.469966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:31.702450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.468492+0000","last_change":"2024-09-21T03:14:38.484757+0000","last_active":"2024-09-21T03:14:39.468492+0000","last_peered":"2024-09-21T03:14:39.468492+0000","last_clean":"2024-09-21T03:14:39.468492+0000","last_became_active":"2024-09-21T03:14:38.483348+0000","last_became_peered":"2024-09-21T03:14:38.483348+0000","last_unstale":"2024-09-21T03:14:39.468492+0000","last_undegraded":"2024-09-21T03:14:39.468492+0000","last_fullsized":"2024-09-21T03:14:39.468492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:57.697723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.700802+0000","last_change":"2024-09-21T03:14:37.473709+0000","last_active":"2024-09-21T03:14:40.700802+0000","last_peered":"2024-09-21T03:14:40.700802+0000","last_clean":"2024-09-21T03:14:40.700802+0000","last_became_active":"2024-09-21T03:14:37.472544+0000","last_became_peered":"2024-09-21T03:14:37.472544+0000","last_unstale":"2024-09-21T03:14:40.700802+0000","last_undegraded":"2024-09-21T03:14:40.700802+0000","last_fullsized":"2024-09-21T03:14:40.700802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:47.892146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467733+0000","last_change":"2024-09-21T03:14:38.476564+0000","last_active":"2024-09-21T03:14:39.467733+0000","last_peered":"2024-09-21T03:14:39.467733+0000","last_clean":"2024-09-21T03:14:39.467733+0000","last_became_active":"2024-09-21T03:14:38.476158+0000","last_became_peered":"2024-09-21T03:14:38.476158+0000","last_unstale":"2024-09-21T03:14:39.467733+0000","last_undegraded":"2024-09-21T03:14:39.467733+0000","last_fullsized":"2024-09-21T03:14:39.467733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:26.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.974755+0000","last_change":"2024-09-21T03:14:37.472695+0000","last_active":"2024-09-21T03:14:39.974755+0000","last_peered":"2024-09-21T03:14:39.974755+0000","last_clean":"2024-09-21T03:14:39.974755+0000","last_became_active":"2024-09-21T03:14:37.472374+0000","last_became_peered":"2024-09-21T03:14:37.472374+0000","last_unstale":"2024-09-21T03:14:39.974755+0000","last_undegraded":"2024-09-21T03:14:39.974755+0000","last_fullsized":"2024-09-21T03:14:39.974755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:11.245914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469604+0000","last_change":"2024-09-21T03:14:38.478509+0000","last_active":"2024-09-21T03:14:39.469604+0000","last_peered":"2024-09-21T03:14:39.469604+0000","last_clean":"2024-09-21T03:14:39.469604+0000","last_became_active":"2024-09-21T03:14:38.478197+0000","last_became_peered":"2024-09-21T03:14:38.478197+0000","last_unstale":"2024-09-21T03:14:39.469604+0000","last_undegraded":"2024-09-21T03:14:39.469604+0000","last_fullsized":"2024-09-21T03:14:39.469604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.411134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701029+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:14:40.701029+0000","last_peered":"2024-09-21T03:14:40.701029+0000","last_clean":"2024-09-21T03:14:40.701029+0000","last_became_active":"2024-09-21T03:14:37.478882+0000","last_became_peered":"2024-09-21T03:14:37.478882+0000","last_unstale":"2024-09-21T03:14:40.701029+0000","last_undegraded":"2024-09-21T03:14:40.701029+0000","last_fullsized":"2024-09-21T03:14:40.701029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:11.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.550863+0000","last_change":"2024-09-21T03:14:38.482528+0000","last_active":"2024-09-21T03:14:39.550863+0000","last_peered":"2024-09-21T03:14:39.550863+0000","last_clean":"2024-09-21T03:14:39.550863+0000","last_became_active":"2024-09-21T03:14:38.482241+0000","last_became_peered":"2024-09-21T03:14:38.482241+0000","last_unstale":"2024-09-21T03:14:39.550863+0000","last_undegraded":"2024-09-21T03:14:39.550863+0000","last_fullsized":"2024-09-21T03:14:39.550863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:23.110703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467424+0000","last_change":"2024-09-21T03:14:37.466544+0000","last_active":"2024-09-21T03:14:39.467424+0000","last_peered":"2024-09-21T03:14:39.467424+0000","last_clean":"2024-09-21T03:14:39.467424+0000","last_became_active":"2024-09-21T03:14:37.465817+0000","last_became_peered":"2024-09-21T03:14:37.465817+0000","last_unstale":"2024-09-21T03:14:39.467424+0000","last_undegraded":"2024-09-21T03:14:39.467424+0000","last_fullsized":"2024-09-21T03:14:39.467424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:36.113483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.466918+0000","last_change":"2024-09-21T03:14:38.485454+0000","last_active":"2024-09-21T03:14:39.466918+0000","last_peered":"2024-09-21T03:14:39.466918+0000","last_clean":"2024-09-21T03:14:39.466918+0000","last_became_active":"2024-09-21T03:14:38.485235+0000","last_became_peered":"2024-09-21T03:14:38.485235+0000","last_unstale":"2024-09-21T03:14:39.466918+0000","last_undegraded":"2024-09-21T03:14:39.466918+0000","last_fullsized":"2024-09-21T03:14:39.466918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:11.585637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.468918+0000","last_change":"2024-09-21T03:14:37.478714+0000","last_active":"2024-09-21T03:14:39.468918+0000","last_peered":"2024-09-21T03:14:39.468918+0000","last_clean":"2024-09-21T03:14:39.468918+0000","last_became_active":"2024-09-21T03:14:37.477951+0000","last_became_peered":"2024-09-21T03:14:37.477951+0000","last_unstale":"2024-09-21T03:14:39.468918+0000","last_undegraded":"2024-09-21T03:14:39.468918+0000","last_fullsized":"2024-09-21T03:14:39.468918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:42.529545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.713635+0000","last_change":"2024-09-21T03:14:38.472906+0000","last_active":"2024-09-21T03:14:39.713635+0000","last_peered":"2024-09-21T03:14:39.713635+0000","last_clean":"2024-09-21T03:14:39.713635+0000","last_became_active":"2024-09-21T03:14:38.471933+0000","last_became_peered":"2024-09-21T03:14:38.471933+0000","last_unstale":"2024-09-21T03:14:39.713635+0000","last_undegraded":"2024-09-21T03:14:39.713635+0000","last_fullsized":"2024-09-21T03:14:39.713635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:05.395821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701145+0000","last_change":"2024-09-21T03:14:37.471063+0000","last_active":"2024-09-21T03:14:40.701145+0000","last_peered":"2024-09-21T03:14:40.701145+0000","last_clean":"2024-09-21T03:14:40.701145+0000","last_became_active":"2024-09-21T03:14:37.470720+0000","last_became_peered":"2024-09-21T03:14:37.470720+0000","last_unstale":"2024-09-21T03:14:40.701145+0000","last_undegraded":"2024-09-21T03:14:40.701145+0000","last_fullsized":"2024-09-21T03:14:40.701145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:00.054692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.466806+0000","last_change":"2024-09-21T03:14:38.479516+0000","last_active":"2024-09-21T03:14:39.466806+0000","last_peered":"2024-09-21T03:14:39.466806+0000","last_clean":"2024-09-21T03:14:39.466806+0000","last_became_active":"2024-09-21T03:14:38.474826+0000","last_became_peered":"2024-09-21T03:14:38.474826+0000","last_unstale":"2024-09-21T03:14:39.466806+0000","last_undegraded":"2024-09-21T03:14:39.466806+0000","last_fullsized":"2024-09-21T03:14:39.466806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:22.181411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.470029+0000","last_change":"2024-09-21T03:14:37.480905+0000","last_active":"2024-09-21T03:14:39.470029+0000","last_peered":"2024-09-21T03:14:39.470029+0000","last_clean":"2024-09-21T03:14:39.470029+0000","last_became_active":"2024-09-21T03:14:37.478227+0000","last_became_peered":"2024-09-21T03:14:37.478227+0000","last_unstale":"2024-09-21T03:14:39.470029+0000","last_undegraded":"2024-09-21T03:14:39.470029+0000","last_fullsized":"2024-09-21T03:14:39.470029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:42.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.975056+0000","last_change":"2024-09-21T03:14:38.469502+0000","last_active":"2024-09-21T03:14:39.975056+0000","last_peered":"2024-09-21T03:14:39.975056+0000","last_clean":"2024-09-21T03:14:39.975056+0000","last_became_active":"2024-09-21T03:14:38.468972+0000","last_became_peered":"2024-09-21T03:14:38.468972+0000","last_unstale":"2024-09-21T03:14:39.975056+0000","last_undegraded":"2024-09-21T03:14:39.975056+0000","last_fullsized":"2024-09-21T03:14:39.975056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701676+0000","last_change":"2024-09-21T03:14:37.472491+0000","last_active":"2024-09-21T03:14:40.701676+0000","last_peered":"2024-09-21T03:14:40.701676+0000","last_clean":"2024-09-21T03:14:40.701676+0000","last_became_active":"2024-09-21T03:14:37.472164+0000","last_became_peered":"2024-09-21T03:14:37.472164+0000","last_unstale":"2024-09-21T03:14:40.701676+0000","last_undegraded":"2024-09-21T03:14:40.701676+0000","last_fullsized":"2024-09-21T03:14:40.701676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.498178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469936+0000","last_change":"2024-09-21T03:14:38.480629+0000","last_active":"2024-09-21T03:14:39.469936+0000","last_peered":"2024-09-21T03:14:39.469936+0000","last_clean":"2024-09-21T03:14:39.469936+0000","last_became_active":"2024-09-21T03:14:38.474135+0000","last_became_peered":"2024-09-21T03:14:38.474135+0000","last_unstale":"2024-09-21T03:14:39.469936+0000","last_undegraded":"2024-09-21T03:14:39.469936+0000","last_fullsized":"2024-09-21T03:14:39.469936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:36.171044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467945+0000","last_change":"2024-09-21T03:14:37.460763+0000","last_active":"2024-09-21T03:14:39.467945+0000","last_peered":"2024-09-21T03:14:39.467945+0000","last_clean":"2024-09-21T03:14:39.467945+0000","last_became_active":"2024-09-21T03:14:37.460320+0000","last_became_peered":"2024-09-21T03:14:37.460320+0000","last_unstale":"2024-09-21T03:14:39.467945+0000","last_undegraded":"2024-09-21T03:14:39.467945+0000","last_fullsized":"2024-09-21T03:14:39.467945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.907794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469601+0000","last_change":"2024-09-21T03:14:38.488259+0000","last_active":"2024-09-21T03:14:39.469601+0000","last_peered":"2024-09-21T03:14:39.469601+0000","last_clean":"2024-09-21T03:14:39.469601+0000","last_became_active":"2024-09-21T03:14:38.487420+0000","last_became_peered":"2024-09-21T03:14:38.487420+0000","last_unstale":"2024-09-21T03:14:39.469601+0000","last_undegraded":"2024-09-21T03:14:39.469601+0000","last_fullsized":"2024-09-21T03:14:39.469601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:48.003893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.551058+0000","last_change":"2024-09-21T03:14:37.479578+0000","last_active":"2024-09-21T03:14:39.551058+0000","last_peered":"2024-09-21T03:14:39.551058+0000","last_clean":"2024-09-21T03:14:39.551058+0000","last_became_active":"2024-09-21T03:14:37.479284+0000","last_became_peered":"2024-09-21T03:14:37.479284+0000","last_unstale":"2024-09-21T03:14:39.551058+0000","last_undegraded":"2024-09-21T03:14:39.551058+0000","last_fullsized":"2024-09-21T03:14:39.551058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:15.732230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467541+0000","last_change":"2024-09-21T03:14:38.478414+0000","last_active":"2024-09-21T03:14:39.467541+0000","last_peered":"2024-09-21T03:14:39.467541+0000","last_clean":"2024-09-21T03:14:39.467541+0000","last_became_active":"2024-09-21T03:14:38.478116+0000","last_became_peered":"2024-09-21T03:14:38.478116+0000","last_unstale":"2024-09-21T03:14:39.467541+0000","last_undegraded":"2024-09-21T03:14:39.467541+0000","last_fullsized":"2024-09-21T03:14:39.467541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:29.618008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.713575+0000","last_change":"2024-09-21T03:14:26.342355+0000","last_active":"2024-09-21T03:14:39.713575+0000","last_peered":"2024-09-21T03:14:39.713575+0000","last_clean":"2024-09-21T03:14:39.713575+0000","last_became_active":"2024-09-21T03:14:26.341929+0000","last_became_peered":"2024-09-21T03:14:26.341929+0000","last_unstale":"2024-09-21T03:14:39.713575+0000","last_undegraded":"2024-09-21T03:14:39.713575+0000","last_fullsized":"2024-09-21T03:14:39.713575+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_clean_scrub_stamp":"2024-09-21T03:14:25.329650+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:45.390822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467183+0000","last_change":"2024-09-21T03:14:37.463990+0000","last_active":"2024-09-21T03:14:39.467183+0000","last_peered":"2024-09-21T03:14:39.467183+0000","last_clean":"2024-09-21T03:14:39.467183+0000","last_became_active":"2024-09-21T03:14:37.463674+0000","last_became_peered":"2024-09-21T03:14:37.463674+0000","last_unstale":"2024-09-21T03:14:39.467183+0000","last_undegraded":"2024-09-21T03:14:39.467183+0000","last_fullsized":"2024-09-21T03:14:39.467183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:35.391985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701690+0000","last_change":"2024-09-21T03:14:38.479181+0000","last_active":"2024-09-21T03:14:40.701690+0000","last_peered":"2024-09-21T03:14:40.701690+0000","last_clean":"2024-09-21T03:14:40.701690+0000","last_became_active":"2024-09-21T03:14:38.478842+0000","last_became_peered":"2024-09-21T03:14:38.478842+0000","last_unstale":"2024-09-21T03:14:40.701690+0000","last_undegraded":"2024-09-21T03:14:40.701690+0000","last_fullsized":"2024-09-21T03:14:40.701690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:08.664381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467451+0000","last_change":"2024-09-21T03:14:37.464554+0000","last_active":"2024-09-21T03:14:39.467451+0000","last_peered":"2024-09-21T03:14:39.467451+0000","last_clean":"2024-09-21T03:14:39.467451+0000","last_became_active":"2024-09-21T03:14:37.464228+0000","last_became_peered":"2024-09-21T03:14:37.464228+0000","last_unstale":"2024-09-21T03:14:39.467451+0000","last_undegraded":"2024-09-21T03:14:39.467451+0000","last_fullsized":"2024-09-21T03:14:39.467451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:32.529512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.550747+0000","last_change":"2024-09-21T03:14:38.480026+0000","last_active":"2024-09-21T03:14:39.550747+0000","last_peered":"2024-09-21T03:14:39.550747+0000","last_clean":"2024-09-21T03:14:39.550747+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:14:39.550747+0000","last_undegraded":"2024-09-21T03:14:39.550747+0000","last_fullsized":"2024-09-21T03:14:39.550747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:20.481816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701000+0000","last_change":"2024-09-21T03:14:37.474798+0000","last_active":"2024-09-21T03:14:40.701000+0000","last_peered":"2024-09-21T03:14:40.701000+0000","last_clean":"2024-09-21T03:14:40.701000+0000","last_became_active":"2024-09-21T03:14:37.473829+0000","last_became_peered":"2024-09-21T03:14:37.473829+0000","last_unstale":"2024-09-21T03:14:40.701000+0000","last_undegraded":"2024-09-21T03:14:40.701000+0000","last_fullsized":"2024-09-21T03:14:40.701000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:11.571814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467295+0000","last_change":"2024-09-21T03:14:38.481801+0000","last_active":"2024-09-21T03:14:39.467295+0000","last_peered":"2024-09-21T03:14:39.467295+0000","last_clean":"2024-09-21T03:14:39.467295+0000","last_became_active":"2024-09-21T03:14:38.481186+0000","last_became_peered":"2024-09-21T03:14:38.481186+0000","last_unstale":"2024-09-21T03:14:39.467295+0000","last_undegraded":"2024-09-21T03:14:39.467295+0000","last_fullsized":"2024-09-21T03:14:39.467295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:54.271470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467533+0000","last_change":"2024-09-21T03:14:37.466857+0000","last_active":"2024-09-21T03:14:39.467533+0000","last_peered":"2024-09-21T03:14:39.467533+0000","last_clean":"2024-09-21T03:14:39.467533+0000","last_became_active":"2024-09-21T03:14:37.466256+0000","last_became_peered":"2024-09-21T03:14:37.466256+0000","last_unstale":"2024-09-21T03:14:39.467533+0000","last_undegraded":"2024-09-21T03:14:39.467533+0000","last_fullsized":"2024-09-21T03:14:39.467533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:02.240461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469255+0000","last_change":"2024-09-21T03:14:38.476763+0000","last_active":"2024-09-21T03:14:39.469255+0000","last_peered":"2024-09-21T03:14:39.469255+0000","last_clean":"2024-09-21T03:14:39.469255+0000","last_became_active":"2024-09-21T03:14:38.474299+0000","last_became_peered":"2024-09-21T03:14:38.474299+0000","last_unstale":"2024-09-21T03:14:39.469255+0000","last_undegraded":"2024-09-21T03:14:39.469255+0000","last_fullsized":"2024-09-21T03:14:39.469255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:46.544930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467471+0000","last_change":"2024-09-21T03:14:37.469799+0000","last_active":"2024-09-21T03:14:39.467471+0000","last_peered":"2024-09-21T03:14:39.467471+0000","last_clean":"2024-09-21T03:14:39.467471+0000","last_became_active":"2024-09-21T03:14:37.469495+0000","last_became_peered":"2024-09-21T03:14:37.469495+0000","last_unstale":"2024-09-21T03:14:39.467471+0000","last_undegraded":"2024-09-21T03:14:39.467471+0000","last_fullsized":"2024-09-21T03:14:39.467471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:50.247050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.974835+0000","last_change":"2024-09-21T03:14:38.479657+0000","last_active":"2024-09-21T03:14:39.974835+0000","last_peered":"2024-09-21T03:14:39.974835+0000","last_clean":"2024-09-21T03:14:39.974835+0000","last_became_active":"2024-09-21T03:14:38.479439+0000","last_became_peered":"2024-09-21T03:14:38.479439+0000","last_unstale":"2024-09-21T03:14:39.974835+0000","last_undegraded":"2024-09-21T03:14:39.974835+0000","last_fullsized":"2024-09-21T03:14:39.974835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.107215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467657+0000","last_change":"2024-09-21T03:14:37.473484+0000","last_active":"2024-09-21T03:14:39.467657+0000","last_peered":"2024-09-21T03:14:39.467657+0000","last_clean":"2024-09-21T03:14:39.467657+0000","last_became_active":"2024-09-21T03:14:37.473218+0000","last_became_peered":"2024-09-21T03:14:37.473218+0000","last_unstale":"2024-09-21T03:14:39.467657+0000","last_undegraded":"2024-09-21T03:14:39.467657+0000","last_fullsized":"2024-09-21T03:14:39.467657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:49.006579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.550922+0000","last_change":"2024-09-21T03:14:38.493350+0000","last_active":"2024-09-21T03:14:39.550922+0000","last_peered":"2024-09-21T03:14:39.550922+0000","last_clean":"2024-09-21T03:14:39.550922+0000","last_became_active":"2024-09-21T03:14:38.492830+0000","last_became_peered":"2024-09-21T03:14:38.492830+0000","last_unstale":"2024-09-21T03:14:39.550922+0000","last_undegraded":"2024-09-21T03:14:39.550922+0000","last_fullsized":"2024-09-21T03:14:39.550922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:19.946319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701795+0000","last_change":"2024-09-21T03:14:37.479651+0000","last_active":"2024-09-21T03:14:40.701795+0000","last_peered":"2024-09-21T03:14:40.701795+0000","last_clean":"2024-09-21T03:14:40.701795+0000","last_became_active":"2024-09-21T03:14:37.478833+0000","last_became_peered":"2024-09-21T03:14:37.478833+0000","last_unstale":"2024-09-21T03:14:40.701795+0000","last_undegraded":"2024-09-21T03:14:40.701795+0000","last_fullsized":"2024-09-21T03:14:40.701795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:48.578637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701927+0000","last_change":"2024-09-21T03:14:38.475318+0000","last_active":"2024-09-21T03:14:40.701927+0000","last_peered":"2024-09-21T03:14:40.701927+0000","last_clean":"2024-09-21T03:14:40.701927+0000","last_became_active":"2024-09-21T03:14:38.474978+0000","last_became_peered":"2024-09-21T03:14:38.474978+0000","last_unstale":"2024-09-21T03:14:40.701927+0000","last_undegraded":"2024-09-21T03:14:40.701927+0000","last_fullsized":"2024-09-21T03:14:40.701927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:38.209624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467702+0000","last_change":"2024-09-21T03:14:37.480508+0000","last_active":"2024-09-21T03:14:39.467702+0000","last_peered":"2024-09-21T03:14:39.467702+0000","last_clean":"2024-09-21T03:14:39.467702+0000","last_became_active":"2024-09-21T03:14:37.480218+0000","last_became_peered":"2024-09-21T03:14:37.480218+0000","last_unstale":"2024-09-21T03:14:39.467702+0000","last_undegraded":"2024-09-21T03:14:39.467702+0000","last_fullsized":"2024-09-21T03:14:39.467702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:01.851380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701814+0000","last_change":"2024-09-21T03:14:38.479133+0000","last_active":"2024-09-21T03:14:40.701814+0000","last_peered":"2024-09-21T03:14:40.701814+0000","last_clean":"2024-09-21T03:14:40.701814+0000","last_became_active":"2024-09-21T03:14:38.478077+0000","last_became_peered":"2024-09-21T03:14:38.478077+0000","last_unstale":"2024-09-21T03:14:40.701814+0000","last_undegraded":"2024-09-21T03:14:40.701814+0000","last_fullsized":"2024-09-21T03:14:40.701814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:56.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.468690+0000","last_change":"2024-09-21T03:14:37.472962+0000","last_active":"2024-09-21T03:14:39.468690+0000","last_peered":"2024-09-21T03:14:39.468690+0000","last_clean":"2024-09-21T03:14:39.468690+0000","last_became_active":"2024-09-21T03:14:37.472271+0000","last_became_peered":"2024-09-21T03:14:37.472271+0000","last_unstale":"2024-09-21T03:14:39.468690+0000","last_undegraded":"2024-09-21T03:14:39.468690+0000","last_fullsized":"2024-09-21T03:14:39.468690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:54.952223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467830+0000","last_change":"2024-09-21T03:14:38.482658+0000","last_active":"2024-09-21T03:14:39.467830+0000","last_peered":"2024-09-21T03:14:39.467830+0000","last_clean":"2024-09-21T03:14:39.467830+0000","last_became_active":"2024-09-21T03:14:38.482369+0000","last_became_peered":"2024-09-21T03:14:38.482369+0000","last_unstale":"2024-09-21T03:14:39.467830+0000","last_undegraded":"2024-09-21T03:14:39.467830+0000","last_fullsized":"2024-09-21T03:14:39.467830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:36.682534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.700840+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:14:40.700840+0000","last_peered":"2024-09-21T03:14:40.700840+0000","last_clean":"2024-09-21T03:14:40.700840+0000","last_became_active":"2024-09-21T03:14:37.478840+0000","last_became_peered":"2024-09-21T03:14:37.478840+0000","last_unstale":"2024-09-21T03:14:40.700840+0000","last_undegraded":"2024-09-21T03:14:40.700840+0000","last_fullsized":"2024-09-21T03:14:40.700840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:00.964354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.700808+0000","last_change":"2024-09-21T03:14:38.479370+0000","last_active":"2024-09-21T03:14:40.700808+0000","last_peered":"2024-09-21T03:14:40.700808+0000","last_clean":"2024-09-21T03:14:40.700808+0000","last_became_active":"2024-09-21T03:14:38.476976+0000","last_became_peered":"2024-09-21T03:14:38.476976+0000","last_unstale":"2024-09-21T03:14:40.700808+0000","last_undegraded":"2024-09-21T03:14:40.700808+0000","last_fullsized":"2024-09-21T03:14:40.700808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:14.695819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.551049+0000","last_change":"2024-09-21T03:14:37.465907+0000","last_active":"2024-09-21T03:14:39.551049+0000","last_peered":"2024-09-21T03:14:39.551049+0000","last_clean":"2024-09-21T03:14:39.551049+0000","last_became_active":"2024-09-21T03:14:37.465551+0000","last_became_peered":"2024-09-21T03:14:37.465551+0000","last_unstale":"2024-09-21T03:14:39.551049+0000","last_undegraded":"2024-09-21T03:14:39.551049+0000","last_fullsized":"2024-09-21T03:14:39.551049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:10.599687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.700969+0000","last_change":"2024-09-21T03:14:38.494021+0000","last_active":"2024-09-21T03:14:40.700969+0000","last_peered":"2024-09-21T03:14:40.700969+0000","last_clean":"2024-09-21T03:14:40.700969+0000","last_became_active":"2024-09-21T03:14:38.486802+0000","last_became_peered":"2024-09-21T03:14:38.486802+0000","last_unstale":"2024-09-21T03:14:40.700969+0000","last_undegraded":"2024-09-21T03:14:40.700969+0000","last_fullsized":"2024-09-21T03:14:40.700969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:31.817505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467062+0000","last_change":"2024-09-21T03:14:37.463164+0000","last_active":"2024-09-21T03:14:39.467062+0000","last_peered":"2024-09-21T03:14:39.467062+0000","last_clean":"2024-09-21T03:14:39.467062+0000","last_became_active":"2024-09-21T03:14:37.461409+0000","last_became_peered":"2024-09-21T03:14:37.461409+0000","last_unstale":"2024-09-21T03:14:39.467062+0000","last_undegraded":"2024-09-21T03:14:39.467062+0000","last_fullsized":"2024-09-21T03:14:39.467062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:51.126291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467133+0000","last_change":"2024-09-21T03:14:38.476747+0000","last_active":"2024-09-21T03:14:39.467133+0000","last_peered":"2024-09-21T03:14:39.467133+0000","last_clean":"2024-09-21T03:14:39.467133+0000","last_became_active":"2024-09-21T03:14:38.476386+0000","last_became_peered":"2024-09-21T03:14:38.476386+0000","last_unstale":"2024-09-21T03:14:39.467133+0000","last_undegraded":"2024-09-21T03:14:39.467133+0000","last_fullsized":"2024-09-21T03:14:39.467133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:28.751991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.467321+0000","last_change":"2024-09-21T03:14:38.468756+0000","last_active":"2024-09-21T03:14:39.467321+0000","last_peered":"2024-09-21T03:14:39.467321+0000","last_clean":"2024-09-21T03:14:39.467321+0000","last_became_active":"2024-09-21T03:14:38.467570+0000","last_became_peered":"2024-09-21T03:14:38.467570+0000","last_unstale":"2024-09-21T03:14:39.467321+0000","last_undegraded":"2024-09-21T03:14:39.467321+0000","last_fullsized":"2024-09-21T03:14:39.467321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:24.784157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469709+0000","last_change":"2024-09-21T03:14:37.479842+0000","last_active":"2024-09-21T03:14:39.469709+0000","last_peered":"2024-09-21T03:14:39.469709+0000","last_clean":"2024-09-21T03:14:39.469709+0000","last_became_active":"2024-09-21T03:14:37.478893+0000","last_became_peered":"2024-09-21T03:14:37.478893+0000","last_unstale":"2024-09-21T03:14:39.469709+0000","last_undegraded":"2024-09-21T03:14:39.469709+0000","last_fullsized":"2024-09-21T03:14:39.469709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:27.916133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.713960+0000","last_change":"2024-09-21T03:14:38.472992+0000","last_active":"2024-09-21T03:14:39.713960+0000","last_peered":"2024-09-21T03:14:39.713960+0000","last_clean":"2024-09-21T03:14:39.713960+0000","last_became_active":"2024-09-21T03:14:38.472426+0000","last_became_peered":"2024-09-21T03:14:38.472426+0000","last_unstale":"2024-09-21T03:14:39.713960+0000","last_undegraded":"2024-09-21T03:14:39.713960+0000","last_fullsized":"2024-09-21T03:14:39.713960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:36.825612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.469745+0000","last_change":"2024-09-21T03:14:37.478711+0000","last_active":"2024-09-21T03:14:39.469745+0000","last_peered":"2024-09-21T03:14:39.469745+0000","last_clean":"2024-09-21T03:14:39.469745+0000","last_became_active":"2024-09-21T03:14:37.477910+0000","last_became_peered":"2024-09-21T03:14:37.477910+0000","last_unstale":"2024-09-21T03:14:39.469745+0000","last_undegraded":"2024-09-21T03:14:39.469745+0000","last_fullsized":"2024-09-21T03:14:39.469745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:40.166966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.468494+0000","last_change":"2024-09-21T03:14:38.486401+0000","last_active":"2024-09-21T03:14:39.468494+0000","last_peered":"2024-09-21T03:14:39.468494+0000","last_clean":"2024-09-21T03:14:39.468494+0000","last_became_active":"2024-09-21T03:14:38.486090+0000","last_became_peered":"2024-09-21T03:14:38.486090+0000","last_unstale":"2024-09-21T03:14:39.468494+0000","last_undegraded":"2024-09-21T03:14:39.468494+0000","last_fullsized":"2024-09-21T03:14:39.468494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:44.085100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.468282+0000","last_change":"2024-09-21T03:14:37.467448+0000","last_active":"2024-09-21T03:14:39.468282+0000","last_peered":"2024-09-21T03:14:39.468282+0000","last_clean":"2024-09-21T03:14:39.468282+0000","last_became_active":"2024-09-21T03:14:37.467146+0000","last_became_peered":"2024-09-21T03:14:37.467146+0000","last_unstale":"2024-09-21T03:14:39.468282+0000","last_undegraded":"2024-09-21T03:14:39.468282+0000","last_fullsized":"2024-09-21T03:14:39.468282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:53.475083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:39.468195+0000","last_change":"2024-09-21T03:14:38.496252+0000","last_active":"2024-09-21T03:14:39.468195+0000","last_peered":"2024-09-21T03:14:39.468195+0000","last_clean":"2024-09-21T03:14:39.468195+0000","last_became_active":"2024-09-21T03:14:38.488292+0000","last_became_peered":"2024-09-21T03:14:38.488292+0000","last_unstale":"2024-09-21T03:14:39.468195+0000","last_undegraded":"2024-09-21T03:14:39.468195+0000","last_fullsized":"2024-09-21T03:14:39.468195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:57.409792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T03:14:40.701868+0000","last_change":"2024-09-21T03:14:37.471004+0000","last_active":"2024-09-21T03:14:40.701868+0000","last_peered":"2024-09-21T03:14:40.701868+0000","last_clean":"2024-09-21T03:14:40.701868+0000","last_became_active":"2024-09-21T03:14:37.470563+0000","last_became_peered":"2024-09-21T03:14:37.470563+0000","last_unstale":"2024-09-21T03:14:40.701868+0000","last_undegraded":"2024-09-21T03:14:40.701868+0000","last_fullsized":"2024-09-21T03:14:40.701868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.422826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":204800,"data_stored":65956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":811008,"data_stored":662567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":68116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":73719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":806912,"data_stored":662545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":65832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":200704,"data_stored":66414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:14:44.390 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T03:14:44.391 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T03:14:44.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.640+0000 7fd44f200640 1 -- 172.21.15.90:0/1068326116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd450154ad0 msgr2=0x7fd450154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:44.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.640+0000 7fd44f200640 1 --2- 172.21.15.90:0/1068326116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd450154ad0 0x7fd450154ee0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd448005fd0 tx=0x7fd44802a820 comp rx=0 tx=0).stop 2024-09-21T03:14:44.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.640+0000 7fd44f200640 1 -- 172.21.15.90:0/1068326116 shutdown_connections 2024-09-21T03:14:44.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.640+0000 7fd44f200640 1 --2- 172.21.15.90:0/1068326116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd450154ad0 0x7fd450154ee0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:44.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.640+0000 7fd44f200640 1 --2- 172.21.15.90:0/1068326116 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd45013d110 0x7fd45013d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:44.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.640+0000 7fd44f200640 1 -- 172.21.15.90:0/1068326116 >> 172.21.15.90:0/1068326116 conn(0x7fd4500c84c0 msgr2=0x7fd4500c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:44.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.640+0000 7fd44f200640 1 -- 172.21.15.90:0/1068326116 shutdown_connections 2024-09-21T03:14:44.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.640+0000 7fd44f200640 1 -- 172.21.15.90:0/1068326116 wait complete. 2024-09-21T03:14:44.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.642+0000 7fd44f200640 1 Processor -- start 2024-09-21T03:14:44.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.642+0000 7fd44f200640 1 -- start start 2024-09-21T03:14:44.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.644+0000 7fd44f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd45013d110 0x7fd4501eb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:44.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.644+0000 7fd44f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd45013dde0 0x7fd450152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:44.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.644+0000 7fd44f200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd450154ad0 0x7fd4501e1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:44.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.644+0000 7fd44f200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd4500c56d0 con 0x7fd450154ad0 2024-09-21T03:14:44.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.644+0000 7fd44f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd45013da60 con 0x7fd45013dde0 2024-09-21T03:14:44.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.644+0000 7fd44f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd4500c5850 con 0x7fd45013d110 2024-09-21T03:14:44.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.644+0000 7fd44e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd450154ad0 0x7fd4501e1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:44.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.644+0000 7fd44e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd450154ad0 0x7fd4501e1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38134/0 (socket says 172.21.15.90:38134) 2024-09-21T03:14:44.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.644+0000 7fd44e800640 1 -- 172.21.15.90:0/620838689 learned_addr learned my addr 172.21.15.90:0/620838689 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:44.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.644+0000 7fd44de00640 1 --2- 172.21.15.90:0/620838689 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd45013d110 0x7fd4501eb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:44.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.644+0000 7fd44d400640 1 --2- 172.21.15.90:0/620838689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd45013dde0 0x7fd450152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:44.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.645+0000 7fd44e800640 1 -- 172.21.15.90:0/620838689 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd45013d110 msgr2=0x7fd4501eb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:44.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.645+0000 7fd44e800640 1 --2- 172.21.15.90:0/620838689 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd45013d110 0x7fd4501eb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:44.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.645+0000 7fd44e800640 1 -- 172.21.15.90:0/620838689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd45013dde0 msgr2=0x7fd450152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:44.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.645+0000 7fd44e800640 1 --2- 172.21.15.90:0/620838689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd45013dde0 0x7fd450152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:44.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.645+0000 7fd44e800640 1 -- 172.21.15.90:0/620838689 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd450139240 con 0x7fd450154ad0 2024-09-21T03:14:44.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.645+0000 7fd44e800640 1 --2- 172.21.15.90:0/620838689 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd450154ad0 0x7fd4501e1200 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd448035040 tx=0x7fd448032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:44.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.645+0000 7fd446000640 1 -- 172.21.15.90:0/620838689 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd448037040 con 0x7fd450154ad0 2024-09-21T03:14:44.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.645+0000 7fd446000640 1 -- 172.21.15.90:0/620838689 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd448042070 con 0x7fd450154ad0 2024-09-21T03:14:44.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.645+0000 7fd44f200640 1 -- 172.21.15.90:0/620838689 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd450138f60 con 0x7fd450154ad0 2024-09-21T03:14:44.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.645+0000 7fd446000640 1 -- 172.21.15.90:0/620838689 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd448004260 con 0x7fd450154ad0 2024-09-21T03:14:44.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.645+0000 7fd44f200640 1 -- 172.21.15.90:0/620838689 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4501534a0 con 0x7fd450154ad0 2024-09-21T03:14:44.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.646+0000 7fd44f200640 1 -- 172.21.15.90:0/620838689 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd45013d520 con 0x7fd450154ad0 2024-09-21T03:14:44.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.647+0000 7fd446000640 1 -- 172.21.15.90:0/620838689 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd448004400 con 0x7fd450154ad0 2024-09-21T03:14:44.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.648+0000 7fd446000640 1 --2- 172.21.15.90:0/620838689 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd430078b90 0x7fd43007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:44.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.649+0000 7fd446000640 1 -- 172.21.15.90:0/620838689 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7fd4480bb9d0 con 0x7fd450154ad0 2024-09-21T03:14:44.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.649+0000 7fd44de00640 1 --2- 172.21.15.90:0/620838689 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd430078b90 0x7fd43007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:44.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.650+0000 7fd44de00640 1 --2- 172.21.15.90:0/620838689 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd430078b90 0x7fd43007b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd440000f60 tx=0x7fd440009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:44.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.653+0000 7fd446000640 1 -- 172.21.15.90:0/620838689 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd448083860 con 0x7fd450154ad0 2024-09-21T03:14:44.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.840+0000 7fd44f200640 1 -- 172.21.15.90:0/620838689 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd450139640 con 0x7fd450154ad0 2024-09-21T03:14:44.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.840+0000 7fd446000640 1 -- 172.21.15.90:0/620838689 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v21) ==== 84+0+197 (secure 0 0 0) 0x7fd448088290 con 0x7fd450154ad0 2024-09-21T03:14:44.842 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:44.842 INFO:teuthology.orchestra.run.smithi090.stdout:[ 2024-09-21T03:14:44.843 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:14:44.843 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 1, 2024-09-21T03:14:44.843 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": ".mgr" 2024-09-21T03:14:44.843 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:14:44.843 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:14:44.843 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 2, 2024-09-21T03:14:44.843 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": "a_metadata" 2024-09-21T03:14:44.843 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:14:44.843 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:14:44.843 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 3, 2024-09-21T03:14:44.843 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": "a_data" 2024-09-21T03:14:44.843 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:14:44.843 INFO:teuthology.orchestra.run.smithi090.stdout:] 2024-09-21T03:14:44.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.843+0000 7fd44f200640 1 -- 172.21.15.90:0/620838689 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd430078b90 msgr2=0x7fd43007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:44.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.843+0000 7fd44f200640 1 --2- 172.21.15.90:0/620838689 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd430078b90 0x7fd43007b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd440000f60 tx=0x7fd440009040 comp rx=0 tx=0).stop 2024-09-21T03:14:44.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.843+0000 7fd44f200640 1 -- 172.21.15.90:0/620838689 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd450154ad0 msgr2=0x7fd4501e1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:44.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.843+0000 7fd44f200640 1 --2- 172.21.15.90:0/620838689 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd450154ad0 0x7fd4501e1200 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd448035040 tx=0x7fd448032d10 comp rx=0 tx=0).stop 2024-09-21T03:14:44.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.843+0000 7fd44f200640 1 -- 172.21.15.90:0/620838689 shutdown_connections 2024-09-21T03:14:44.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.843+0000 7fd44f200640 1 --2- 172.21.15.90:0/620838689 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd430078b90 0x7fd43007b0a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:44.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.843+0000 7fd44f200640 1 --2- 172.21.15.90:0/620838689 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd450154ad0 0x7fd4501e1200 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:44.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.843+0000 7fd44f200640 1 --2- 172.21.15.90:0/620838689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd45013dde0 0x7fd450152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:44.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.843+0000 7fd44f200640 1 --2- 172.21.15.90:0/620838689 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd45013d110 0x7fd4501eb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:44.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.843+0000 7fd44f200640 1 -- 172.21.15.90:0/620838689 >> 172.21.15.90:0/620838689 conn(0x7fd4500c84c0 msgr2=0x7fd4500768b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:44.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.843+0000 7fd44f200640 1 -- 172.21.15.90:0/620838689 shutdown_connections 2024-09-21T03:14:44.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:44.843+0000 7fd44f200640 1 -- 172.21.15.90:0/620838689 wait complete. 2024-09-21T03:14:44.866 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'b' 2024-09-21T03:14:44.867 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_metadata --pg_num_min 64 2024-09-21T03:14:45.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.089+0000 7f404b200640 1 -- 172.21.15.90:0/3339488967 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4044151e30 msgr2=0x7f4044152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:45.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.089+0000 7f404b200640 1 --2- 172.21.15.90:0/3339488967 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4044151e30 0x7f4044152240 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4034005fd0 tx=0x7f403402a4b0 comp rx=0 tx=0).stop 2024-09-21T03:14:45.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.089+0000 7f404b200640 1 -- 172.21.15.90:0/3339488967 shutdown_connections 2024-09-21T03:14:45.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.089+0000 7f404b200640 1 --2- 172.21.15.90:0/3339488967 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4044151e30 0x7f4044152240 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:45.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.089+0000 7f404b200640 1 --2- 172.21.15.90:0/3339488967 >> v2:172.21.15.149:3300/0 conn(0x7f40440ae000 0x7f4044073220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:45.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.089+0000 7f404b200640 1 -- 172.21.15.90:0/3339488967 >> 172.21.15.90:0/3339488967 conn(0x7f404406d1d0 msgr2=0x7f404406d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:45.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.089+0000 7f404b200640 1 -- 172.21.15.90:0/3339488967 shutdown_connections 2024-09-21T03:14:45.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.089+0000 7f404b200640 1 -- 172.21.15.90:0/3339488967 wait complete. 2024-09-21T03:14:45.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.091+0000 7f404b200640 1 Processor -- start 2024-09-21T03:14:45.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.091+0000 7f404b200640 1 -- start start 2024-09-21T03:14:45.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.093+0000 7f404b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40440ae000 0x7f40440c1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:45.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.093+0000 7f404b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4044151e30 0x7f40440c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:45.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.093+0000 7f404b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4044154a00 0x7f404414a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:45.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.093+0000 7f404b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4044073760 con 0x7f4044154a00 2024-09-21T03:14:45.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.093+0000 7f404b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f40440ac000 con 0x7f40440ae000 2024-09-21T03:14:45.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.093+0000 7f404b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4044155520 con 0x7f4044151e30 2024-09-21T03:14:45.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.093+0000 7f404a800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4044154a00 0x7f404414a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:45.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.093+0000 7f404a800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4044154a00 0x7f404414a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49734/0 (socket says 172.21.15.90:49734) 2024-09-21T03:14:45.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.093+0000 7f404a800640 1 -- 172.21.15.90:0/3457400823 learned_addr learned my addr 172.21.15.90:0/3457400823 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:45.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.093+0000 7f4049400640 1 --2- 172.21.15.90:0/3457400823 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4044151e30 0x7f40440c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:45.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.093+0000 7f4049e00640 1 --2- 172.21.15.90:0/3457400823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40440ae000 0x7f40440c1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:45.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.093+0000 7f404a800640 1 -- 172.21.15.90:0/3457400823 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4044151e30 msgr2=0x7f40440c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:45.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.093+0000 7f404a800640 1 --2- 172.21.15.90:0/3457400823 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4044151e30 0x7f40440c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:45.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.094+0000 7f404a800640 1 -- 172.21.15.90:0/3457400823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40440ae000 msgr2=0x7f40440c1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:45.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.094+0000 7f404a800640 1 --2- 172.21.15.90:0/3457400823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40440ae000 0x7f40440c1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:45.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.094+0000 7f404a800640 1 -- 172.21.15.90:0/3457400823 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f404414d1d0 con 0x7f4044154a00 2024-09-21T03:14:45.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.094+0000 7f404a800640 1 --2- 172.21.15.90:0/3457400823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4044154a00 0x7f404414a900 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f404000c6b0 tx=0x7f404000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:45.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.094+0000 7f403e000640 1 -- 172.21.15.90:0/3457400823 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4040003b70 con 0x7f4044154a00 2024-09-21T03:14:45.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.094+0000 7f404b200640 1 -- 172.21.15.90:0/3457400823 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40440c2460 con 0x7f4044154a00 2024-09-21T03:14:45.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.094+0000 7f403e000640 1 -- 172.21.15.90:0/3457400823 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4040003d30 con 0x7f4044154a00 2024-09-21T03:14:45.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.094+0000 7f403e000640 1 -- 172.21.15.90:0/3457400823 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4040005330 con 0x7f4044154a00 2024-09-21T03:14:45.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.094+0000 7f404b200640 1 -- 172.21.15.90:0/3457400823 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f404414d470 con 0x7f4044154a00 2024-09-21T03:14:45.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.095+0000 7f404b200640 1 -- 172.21.15.90:0/3457400823 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4044074be0 con 0x7f4044154a00 2024-09-21T03:14:45.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.096+0000 7f403e000640 1 -- 172.21.15.90:0/3457400823 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f40400054d0 con 0x7f4044154a00 2024-09-21T03:14:45.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.098+0000 7f403e000640 1 --2- 172.21.15.90:0/3457400823 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4028078bc0 0x7f402807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:45.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.098+0000 7f403e000640 1 -- 172.21.15.90:0/3457400823 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f404009aa10 con 0x7f4044154a00 2024-09-21T03:14:45.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.098+0000 7f4049e00640 1 --2- 172.21.15.90:0/3457400823 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4028078bc0 0x7f402807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:45.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.099+0000 7f4049e00640 1 --2- 172.21.15.90:0/3457400823 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4028078bc0 0x7f402807b0d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4038009b30 tx=0x7f4038005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:45.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.102+0000 7f403e000640 1 -- 172.21.15.90:0/3457400823 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4040062790 con 0x7f4044154a00 2024-09-21T03:14:45.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.286+0000 7f404b200640 1 -- 172.21.15.90:0/3457400823 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64} v 0) -- 0x7f40440c1a90 con 0x7f4044154a00 2024-09-21T03:14:45.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.509+0000 7f403e000640 1 -- 172.21.15.90:0/3457400823 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64}]=0 pool 'b_metadata' created v22) ==== 128+0+0 (secure 0 0 0) 0x7f40400671c0 con 0x7f4044154a00 2024-09-21T03:14:45.511 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'b_metadata' created 2024-09-21T03:14:45.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.513+0000 7f404b200640 1 -- 172.21.15.90:0/3457400823 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4028078bc0 msgr2=0x7f402807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:45.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.513+0000 7f404b200640 1 --2- 172.21.15.90:0/3457400823 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4028078bc0 0x7f402807b0d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4038009b30 tx=0x7f4038005f90 comp rx=0 tx=0).stop 2024-09-21T03:14:45.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.513+0000 7f404b200640 1 -- 172.21.15.90:0/3457400823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4044154a00 msgr2=0x7f404414a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:45.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.513+0000 7f404b200640 1 --2- 172.21.15.90:0/3457400823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4044154a00 0x7f404414a900 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f404000c6b0 tx=0x7f404000cb70 comp rx=0 tx=0).stop 2024-09-21T03:14:45.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.513+0000 7f404b200640 1 -- 172.21.15.90:0/3457400823 shutdown_connections 2024-09-21T03:14:45.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.513+0000 7f404b200640 1 --2- 172.21.15.90:0/3457400823 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4028078bc0 0x7f402807b0d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:45.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.513+0000 7f404b200640 1 --2- 172.21.15.90:0/3457400823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4044154a00 0x7f404414a900 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:45.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.513+0000 7f404b200640 1 --2- 172.21.15.90:0/3457400823 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4044151e30 0x7f40440c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:45.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.513+0000 7f404b200640 1 --2- 172.21.15.90:0/3457400823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40440ae000 0x7f40440c1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:45.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.513+0000 7f404b200640 1 -- 172.21.15.90:0/3457400823 >> 172.21.15.90:0/3457400823 conn(0x7f404406d1d0 msgr2=0x7f4044150d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:45.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.513+0000 7f404b200640 1 -- 172.21.15.90:0/3457400823 shutdown_connections 2024-09-21T03:14:45.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.513+0000 7f404b200640 1 -- 172.21.15.90:0/3457400823 wait complete. 2024-09-21T03:14:45.543 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T03:14:45.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.766+0000 7f2fc3e00640 1 -- 172.21.15.90:0/218769419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fbc155140 msgr2=0x7f2fbc155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:45.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.766+0000 7f2fc3e00640 1 --2- 172.21.15.90:0/218769419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fbc155140 0x7f2fbc155550 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc070800 tx=0x7f2fb402a8f0 comp rx=0 tx=0).stop 2024-09-21T03:14:45.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.767+0000 7f2fc3e00640 1 -- 172.21.15.90:0/218769419 shutdown_connections 2024-09-21T03:14:45.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.767+0000 7f2fc3e00640 1 --2- 172.21.15.90:0/218769419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fbc155140 0x7f2fbc155550 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:45.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.767+0000 7f2fc3e00640 1 --2- 172.21.15.90:0/218769419 >> v2:172.21.15.149:3300/0 conn(0x7f2fbc0c41b0 0x7f2fbc154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:45.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.767+0000 7f2fc3e00640 1 -- 172.21.15.90:0/218769419 >> 172.21.15.90:0/218769419 conn(0x7f2fbc0c87e0 msgr2=0x7f2fbc0c4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:45.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.767+0000 7f2fc3e00640 1 -- 172.21.15.90:0/218769419 shutdown_connections 2024-09-21T03:14:45.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.767+0000 7f2fc3e00640 1 -- 172.21.15.90:0/218769419 wait complete. 2024-09-21T03:14:45.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.769+0000 7f2fc3e00640 1 Processor -- start 2024-09-21T03:14:45.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.769+0000 7f2fc3e00640 1 -- start start 2024-09-21T03:14:45.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.770+0000 7f2fc3e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fbc0c3da0 0x7f2fbc0c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:45.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.770+0000 7f2fc3e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2fbc155140 0x7f2fbc158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:45.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.770+0000 7f2fc3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fbc1573f0 0x7f2fbc1497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:45.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.770+0000 7f2fc3e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc0ae2e0 con 0x7f2fbc1573f0 2024-09-21T03:14:45.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.770+0000 7f2fc3e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc0ae160 con 0x7f2fbc0c3da0 2024-09-21T03:14:45.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.770+0000 7f2fc3e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2fbc0abd90 con 0x7f2fbc155140 2024-09-21T03:14:45.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.770+0000 7f2fc1e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fbc1573f0 0x7f2fbc1497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:45.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.770+0000 7f2fc1e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fbc1573f0 0x7f2fbc1497e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49756/0 (socket says 172.21.15.90:49756) 2024-09-21T03:14:45.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.770+0000 7f2fc1e00640 1 -- 172.21.15.90:0/3284506078 learned_addr learned my addr 172.21.15.90:0/3284506078 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:45.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.771+0000 7f2fc0a00640 1 --2- 172.21.15.90:0/3284506078 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2fbc155140 0x7f2fbc158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:45.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.771+0000 7f2fc1400640 1 --2- 172.21.15.90:0/3284506078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fbc0c3da0 0x7f2fbc0c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:45.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.771+0000 7f2fc1e00640 1 -- 172.21.15.90:0/3284506078 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2fbc155140 msgr2=0x7f2fbc158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:45.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.771+0000 7f2fc1e00640 1 --2- 172.21.15.90:0/3284506078 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2fbc155140 0x7f2fbc158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:45.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.771+0000 7f2fc1e00640 1 -- 172.21.15.90:0/3284506078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fbc0c3da0 msgr2=0x7f2fbc0c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:45.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.771+0000 7f2fc1e00640 1 --2- 172.21.15.90:0/3284506078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fbc0c3da0 0x7f2fbc0c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:45.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.771+0000 7f2fc1e00640 1 -- 172.21.15.90:0/3284506078 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fbc1587c0 con 0x7f2fbc1573f0 2024-09-21T03:14:45.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.771+0000 7f2fc1e00640 1 --2- 172.21.15.90:0/3284506078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fbc1573f0 0x7f2fbc1497e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009bf0 tx=0x7f2fb4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:45.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.771+0000 7f2fb9600640 1 -- 172.21.15.90:0/3284506078 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4004040 con 0x7f2fbc1573f0 2024-09-21T03:14:45.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.771+0000 7f2fb9600640 1 -- 172.21.15.90:0/3284506078 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2fb402d070 con 0x7f2fbc1573f0 2024-09-21T03:14:45.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.771+0000 7f2fc3e00640 1 -- 172.21.15.90:0/3284506078 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fbc150420 con 0x7f2fbc1573f0 2024-09-21T03:14:45.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.772+0000 7f2fb9600640 1 -- 172.21.15.90:0/3284506078 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4004440 con 0x7f2fbc1573f0 2024-09-21T03:14:45.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.772+0000 7f2fc3e00640 1 -- 172.21.15.90:0/3284506078 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fbc1ed270 con 0x7f2fbc1573f0 2024-09-21T03:14:45.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.773+0000 7f2fc3e00640 1 -- 172.21.15.90:0/3284506078 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fbc150660 con 0x7f2fbc1573f0 2024-09-21T03:14:45.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.774+0000 7f2fb9600640 1 -- 172.21.15.90:0/3284506078 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2fb40045e0 con 0x7f2fbc1573f0 2024-09-21T03:14:45.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.776+0000 7f2fb9600640 1 --2- 172.21.15.90:0/3284506078 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2f9c078b90 0x7f2f9c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:45.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.776+0000 7f2fb9600640 1 -- 172.21.15.90:0/3284506078 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6054+0+0 (secure 0 0 0) 0x7f2fb40bc9e0 con 0x7f2fbc1573f0 2024-09-21T03:14:45.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.776+0000 7f2fc1400640 1 --2- 172.21.15.90:0/3284506078 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2f9c078b90 0x7f2f9c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:45.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.777+0000 7f2fc1400640 1 --2- 172.21.15.90:0/3284506078 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2f9c078b90 0x7f2f9c07b0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0006fd0 tx=0x7f2fb0009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.780+0000 7f2fb9600640 1 -- 172.21.15.90:0/3284506078 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2fbc150660 con 0x7f2fbc1573f0 2024-09-21T03:14:45.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:45.965+0000 7f2fc3e00640 1 -- 172.21.15.90:0/3284506078 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2fbc074810 con 0x7f2fbc1573f0 2024-09-21T03:14:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.512+0000 7f2fb9600640 1 -- 172.21.15.90:0/3284506078 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'b_data' created v23) ==== 160+0+0 (secure 0 0 0) 0x7f2fb4084770 con 0x7f2fbc1573f0 2024-09-21T03:14:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'b_data' created 2024-09-21T03:14:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.518+0000 7f2fc3e00640 1 -- 172.21.15.90:0/3284506078 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2f9c078b90 msgr2=0x7f2f9c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.518+0000 7f2fc3e00640 1 --2- 172.21.15.90:0/3284506078 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2f9c078b90 0x7f2f9c07b0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0006fd0 tx=0x7f2fb0009060 comp rx=0 tx=0).stop 2024-09-21T03:14:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.518+0000 7f2fc3e00640 1 -- 172.21.15.90:0/3284506078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fbc1573f0 msgr2=0x7f2fbc1497e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.518+0000 7f2fc3e00640 1 --2- 172.21.15.90:0/3284506078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fbc1573f0 0x7f2fbc1497e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009bf0 tx=0x7f2fb4003c10 comp rx=0 tx=0).stop 2024-09-21T03:14:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.518+0000 7f2fc3e00640 1 -- 172.21.15.90:0/3284506078 shutdown_connections 2024-09-21T03:14:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.518+0000 7f2fc3e00640 1 --2- 172.21.15.90:0/3284506078 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2f9c078b90 0x7f2f9c07b0a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.519+0000 7f2fc3e00640 1 --2- 172.21.15.90:0/3284506078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fbc1573f0 0x7f2fbc1497e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.519+0000 7f2fc3e00640 1 --2- 172.21.15.90:0/3284506078 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2fbc155140 0x7f2fbc158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.519+0000 7f2fc3e00640 1 --2- 172.21.15.90:0/3284506078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fbc0c3da0 0x7f2fbc0c17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:46.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.519+0000 7f2fc3e00640 1 -- 172.21.15.90:0/3284506078 >> 172.21.15.90:0/3284506078 conn(0x7f2fbc0c87e0 msgr2=0x7f2fbc070330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:46.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.519+0000 7f2fc3e00640 1 -- 172.21.15.90:0/3284506078 shutdown_connections 2024-09-21T03:14:46.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.520+0000 7f2fc3e00640 1 -- 172.21.15.90:0/3284506078 wait complete. 2024-09-21T03:14:46.563 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new b b_metadata b_data 2024-09-21T03:14:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.786+0000 7fdf31000640 1 -- 172.21.15.90:0/1140936088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf2c06f000 msgr2=0x7fdf2c151d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.786+0000 7fdf31000640 1 --2- 172.21.15.90:0/1140936088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf2c06f000 0x7fdf2c151d30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdf24005fd0 tx=0x7fdf2402a780 comp rx=0 tx=0).stop 2024-09-21T03:14:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.786+0000 7fdf31000640 1 -- 172.21.15.90:0/1140936088 shutdown_connections 2024-09-21T03:14:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.786+0000 7fdf31000640 1 --2- 172.21.15.90:0/1140936088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf2c06f000 0x7fdf2c151d30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.786+0000 7fdf31000640 1 --2- 172.21.15.90:0/1140936088 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf2c0abcd0 0x7fdf2c154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.786+0000 7fdf31000640 1 -- 172.21.15.90:0/1140936088 >> 172.21.15.90:0/1140936088 conn(0x7fdf2c0c8490 msgr2=0x7fdf2c0c88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.786+0000 7fdf31000640 1 -- 172.21.15.90:0/1140936088 shutdown_connections 2024-09-21T03:14:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.786+0000 7fdf31000640 1 -- 172.21.15.90:0/1140936088 wait complete. 2024-09-21T03:14:46.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.788+0000 7fdf31000640 1 Processor -- start 2024-09-21T03:14:46.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.788+0000 7fdf31000640 1 -- start start 2024-09-21T03:14:46.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.790+0000 7fdf31000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf2c06ebf0 0x7fdf2c0c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:46.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.790+0000 7fdf31000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf2c0abcd0 0x7fdf2c156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:46.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.790+0000 7fdf31000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf2c156740 0x7fdf2c1488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:46.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.790+0000 7fdf31000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c0c44e0 con 0x7fdf2c06ebf0 2024-09-21T03:14:46.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.790+0000 7fdf31000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c158210 con 0x7fdf2c156740 2024-09-21T03:14:46.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.790+0000 7fdf31000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdf2c0adf90 con 0x7fdf2c0abcd0 2024-09-21T03:14:46.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.790+0000 7fdf2b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf2c06ebf0 0x7fdf2c0c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:46.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.790+0000 7fdf2b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf2c06ebf0 0x7fdf2c0c5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49758/0 (socket says 172.21.15.90:49758) 2024-09-21T03:14:46.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.790+0000 7fdf2b400640 1 -- 172.21.15.90:0/92558588 learned_addr learned my addr 172.21.15.90:0/92558588 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:46.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.790+0000 7fdf2be00640 1 --2- 172.21.15.90:0/92558588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf2c156740 0x7fdf2c1488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:46.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.790+0000 7fdf2aa00640 1 --2- 172.21.15.90:0/92558588 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf2c0abcd0 0x7fdf2c156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:46.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.790+0000 7fdf2b400640 1 -- 172.21.15.90:0/92558588 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf2c0abcd0 msgr2=0x7fdf2c156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:46.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.790+0000 7fdf2b400640 1 --2- 172.21.15.90:0/92558588 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf2c0abcd0 0x7fdf2c156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:46.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.790+0000 7fdf2b400640 1 -- 172.21.15.90:0/92558588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf2c156740 msgr2=0x7fdf2c1488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:46.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.790+0000 7fdf2b400640 1 --2- 172.21.15.90:0/92558588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf2c156740 0x7fdf2c1488e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:46.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.790+0000 7fdf2b400640 1 -- 172.21.15.90:0/92558588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2c1ed7d0 con 0x7fdf2c06ebf0 2024-09-21T03:14:46.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.791+0000 7fdf2b400640 1 --2- 172.21.15.90:0/92558588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf2c06ebf0 0x7fdf2c0c5e70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00ea20 tx=0x7fdf1c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:46.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.791+0000 7fdf23400640 1 -- 172.21.15.90:0/92558588 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c00ce40 con 0x7fdf2c06ebf0 2024-09-21T03:14:46.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.791+0000 7fdf23400640 1 -- 172.21.15.90:0/92558588 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf1c004020 con 0x7fdf2c06ebf0 2024-09-21T03:14:46.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.791+0000 7fdf23400640 1 -- 172.21.15.90:0/92558588 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c004470 con 0x7fdf2c06ebf0 2024-09-21T03:14:46.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.791+0000 7fdf31000640 1 -- 172.21.15.90:0/92558588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf2c0c6840 con 0x7fdf2c06ebf0 2024-09-21T03:14:46.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.791+0000 7fdf31000640 1 -- 172.21.15.90:0/92558588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf2c156c60 con 0x7fdf2c06ebf0 2024-09-21T03:14:46.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.792+0000 7fdf31000640 1 -- 172.21.15.90:0/92558588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf2c06f000 con 0x7fdf2c06ebf0 2024-09-21T03:14:46.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.794+0000 7fdf23400640 1 -- 172.21.15.90:0/92558588 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdf1c0035f0 con 0x7fdf2c06ebf0 2024-09-21T03:14:46.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.795+0000 7fdf23400640 1 --2- 172.21.15.90:0/92558588 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdf0c078b90 0x7fdf0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:46.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.795+0000 7fdf23400640 1 -- 172.21.15.90:0/92558588 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6431+0+0 (secure 0 0 0) 0x7fdf1c09b990 con 0x7fdf2c06ebf0 2024-09-21T03:14:46.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.796+0000 7fdf2aa00640 1 --2- 172.21.15.90:0/92558588 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdf0c078b90 0x7fdf0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:46.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.796+0000 7fdf2aa00640 1 --2- 172.21.15.90:0/92558588 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdf0c078b90 0x7fdf0c07b0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdf18007fd0 tx=0x7fdf18001390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:46.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:46.800+0000 7fdf23400640 1 -- 172.21.15.90:0/92558588 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdf1c063530 con 0x7fdf2c06ebf0 2024-09-21T03:14:47.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.020+0000 7fdf31000640 1 -- 172.21.15.90:0/92558588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"} v 0) -- 0x7fdf2c14f350 con 0x7fdf2c06ebf0 2024-09-21T03:14:47.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.552+0000 7fdf23400640 1 -- 172.21.15.90:0/92558588 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"}]=0 new fs with metadata pool 4 and data pool 5 v9) ==== 157+0+0 (secure 0 0 0) 0x7fdf1c067f60 con 0x7fdf2c06ebf0 2024-09-21T03:14:47.555 INFO:teuthology.orchestra.run.smithi090.stderr:new fs with metadata pool 4 and data pool 5 2024-09-21T03:14:47.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.556+0000 7fdf31000640 1 -- 172.21.15.90:0/92558588 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdf0c078b90 msgr2=0x7fdf0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:47.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.556+0000 7fdf31000640 1 --2- 172.21.15.90:0/92558588 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdf0c078b90 0x7fdf0c07b0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdf18007fd0 tx=0x7fdf18001390 comp rx=0 tx=0).stop 2024-09-21T03:14:47.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.556+0000 7fdf31000640 1 -- 172.21.15.90:0/92558588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf2c06ebf0 msgr2=0x7fdf2c0c5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:47.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.556+0000 7fdf31000640 1 --2- 172.21.15.90:0/92558588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf2c06ebf0 0x7fdf2c0c5e70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00ea20 tx=0x7fdf1c00eee0 comp rx=0 tx=0).stop 2024-09-21T03:14:47.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.559+0000 7fdf31000640 1 -- 172.21.15.90:0/92558588 shutdown_connections 2024-09-21T03:14:47.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.559+0000 7fdf31000640 1 --2- 172.21.15.90:0/92558588 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdf0c078b90 0x7fdf0c07b0a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:47.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.560+0000 7fdf31000640 1 --2- 172.21.15.90:0/92558588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf2c156740 0x7fdf2c1488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:47.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.560+0000 7fdf31000640 1 --2- 172.21.15.90:0/92558588 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf2c0abcd0 0x7fdf2c156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:47.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.560+0000 7fdf31000640 1 --2- 172.21.15.90:0/92558588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf2c06ebf0 0x7fdf2c0c5e70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:47.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.560+0000 7fdf31000640 1 -- 172.21.15.90:0/92558588 >> 172.21.15.90:0/92558588 conn(0x7fdf2c0c8490 msgr2=0x7fdf2c0c88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:47.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.560+0000 7fdf31000640 1 -- 172.21.15.90:0/92558588 shutdown_connections 2024-09-21T03:14:47.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.560+0000 7fdf31000640 1 -- 172.21.15.90:0/92558588 wait complete. 2024-09-21T03:14:47.596 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:14:47.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.816+0000 7f325be00640 1 -- 172.21.15.90:0/828203185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f325c1520e0 msgr2=0x7f325c158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:47.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.816+0000 7f325be00640 1 --2- 172.21.15.90:0/828203185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f325c1520e0 0x7f325c158690 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3248005fd0 tx=0x7f324802a4b0 comp rx=0 tx=0).stop 2024-09-21T03:14:47.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.816+0000 7f325be00640 1 -- 172.21.15.90:0/828203185 shutdown_connections 2024-09-21T03:14:47.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.816+0000 7f325be00640 1 --2- 172.21.15.90:0/828203185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f325c1520e0 0x7f325c158690 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:47.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.816+0000 7f325be00640 1 --2- 172.21.15.90:0/828203185 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f325c0bf920 0x7f325c154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:47.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.816+0000 7f325be00640 1 -- 172.21.15.90:0/828203185 >> 172.21.15.90:0/828203185 conn(0x7f325c0ac360 msgr2=0x7f325c0ca0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:47.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.816+0000 7f325be00640 1 -- 172.21.15.90:0/828203185 shutdown_connections 2024-09-21T03:14:47.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.816+0000 7f325be00640 1 -- 172.21.15.90:0/828203185 wait complete. 2024-09-21T03:14:47.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.818+0000 7f325be00640 1 Processor -- start 2024-09-21T03:14:47.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.818+0000 7f325be00640 1 -- start start 2024-09-21T03:14:47.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.820+0000 7f325be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f325c0bf920 0x7f325c1ddf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:47.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.820+0000 7f325be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f325c0ca7d0 0x7f325c155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:47.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.820+0000 7f325be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f325c1520e0 0x7f325c0ab140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:47.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.820+0000 7f325be00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f325c0c5bb0 con 0x7f325c1520e0 2024-09-21T03:14:47.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.820+0000 7f325be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f325c0c5a30 con 0x7f325c0ca7d0 2024-09-21T03:14:47.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.820+0000 7f325be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f325c158bd0 con 0x7f325c0bf920 2024-09-21T03:14:47.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.820+0000 7f325b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f325c1520e0 0x7f325c0ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:47.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.820+0000 7f325b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f325c1520e0 0x7f325c0ab140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49764/0 (socket says 172.21.15.90:49764) 2024-09-21T03:14:47.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.820+0000 7f325b400640 1 -- 172.21.15.90:0/3483236781 learned_addr learned my addr 172.21.15.90:0/3483236781 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:47.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.820+0000 7f325aa00640 1 --2- 172.21.15.90:0/3483236781 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f325c0bf920 0x7f325c1ddf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:47.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.820+0000 7f325a000640 1 --2- 172.21.15.90:0/3483236781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f325c0ca7d0 0x7f325c155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:47.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.820+0000 7f325b400640 1 -- 172.21.15.90:0/3483236781 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f325c0bf920 msgr2=0x7f325c1ddf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:47.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.821+0000 7f325b400640 1 --2- 172.21.15.90:0/3483236781 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f325c0bf920 0x7f325c1ddf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:47.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.821+0000 7f325b400640 1 -- 172.21.15.90:0/3483236781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f325c0ca7d0 msgr2=0x7f325c155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:47.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.821+0000 7f325b400640 1 --2- 172.21.15.90:0/3483236781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f325c0ca7d0 0x7f325c155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:47.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.821+0000 7f325b400640 1 -- 172.21.15.90:0/3483236781 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f325c06ff30 con 0x7f325c1520e0 2024-09-21T03:14:47.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.821+0000 7f325a000640 1 --2- 172.21.15.90:0/3483236781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f325c0ca7d0 0x7f325c155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:14:47.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.821+0000 7f325b400640 1 --2- 172.21.15.90:0/3483236781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f325c1520e0 0x7f325c0ab140 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f325400c730 tx=0x7f325400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:47.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.821+0000 7f3252a00640 1 -- 172.21.15.90:0/3483236781 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3254003b70 con 0x7f325c1520e0 2024-09-21T03:14:47.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.821+0000 7f3252a00640 1 -- 172.21.15.90:0/3483236781 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3254003d10 con 0x7f325c1520e0 2024-09-21T03:14:47.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.821+0000 7f325be00640 1 -- 172.21.15.90:0/3483236781 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f325c070cc0 con 0x7f325c1520e0 2024-09-21T03:14:47.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.821+0000 7f3252a00640 1 -- 172.21.15.90:0/3483236781 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3254005330 con 0x7f325c1520e0 2024-09-21T03:14:47.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.821+0000 7f325be00640 1 -- 172.21.15.90:0/3483236781 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f325c1e04f0 con 0x7f325c1520e0 2024-09-21T03:14:47.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.822+0000 7f325be00640 1 -- 172.21.15.90:0/3483236781 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f325c0c63c0 con 0x7f325c1520e0 2024-09-21T03:14:47.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.823+0000 7f3252a00640 1 -- 172.21.15.90:0/3483236781 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f32540054d0 con 0x7f325c1520e0 2024-09-21T03:14:47.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.824+0000 7f3252a00640 1 --2- 172.21.15.90:0/3483236781 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f323c078bc0 0x7f323c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:47.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.824+0000 7f3252a00640 1 -- 172.21.15.90:0/3483236781 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f325409ada0 con 0x7f325c1520e0 2024-09-21T03:14:47.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.825+0000 7f325aa00640 1 --2- 172.21.15.90:0/3483236781 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f323c078bc0 0x7f323c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:47.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.825+0000 7f325aa00640 1 --2- 172.21.15.90:0/3483236781 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f323c078bc0 0x7f323c07b0d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f324c009b30 tx=0x7f324c005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:47.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:47.829+0000 7f3252a00640 1 -- 172.21.15.90:0/3483236781 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f32540627c0 con 0x7f325c1520e0 2024-09-21T03:14:48.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.015+0000 7f325be00640 1 -- 172.21.15.90:0/3483236781 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f325c0c8740 con 0x7f325c1520e0 2024-09-21T03:14:48.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.016+0000 7f3252a00640 1 -- 172.21.15.90:0/3483236781 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20420 (secure 0 0 0) 0x7f32540671f0 con 0x7f325c1520e0 2024-09-21T03:14:48.018 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:48.018 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":24,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","created":"2024-09-21T03:14:09.323302+0000","modified":"2024-09-21T03:14:47.022026+0000","last_up_change":"2024-09-21T03:14:25.329650+0000","last_in_change":"2024-09-21T03:14:15.386953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:14:24.511246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-21T03:14:35.815250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-21T03:14:36.914615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-21T03:14:45.298287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-21T03:14:45.977111+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ceaacfab-e71c-45e2-ac50-4597dfd460bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6809","nonce":3187794863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6811","nonce":3187794863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6815","nonce":3187794863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6813","nonce":3187794863}]},"public_addr":"172.21.15.90:6809/3187794863","cluster_addr":"172.21.15.90:6811/3187794863","heartbeat_back_addr":"172.21.15.90:6815/3187794863","heartbeat_front_addr":"172.21.15.90:6813/3187794863","state":["exists","up"]},{"osd":1,"uuid":"86f91523-232b-4e80-ada7-d9e12770adb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6801","nonce":3769758484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6803","nonce":3769758484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6807","nonce":3769758484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6805","nonce":3769758484}]},"public_addr":"172.21.15.90:6801/3769758484","cluster_addr":"172.21.15.90:6803/3769758484","heartbeat_back_addr":"172.21.15.90:6807/3769758484","heartbeat_front_addr":"172.21.15.90:6805/3769758484","state":["exists","up"]},{"osd":2,"uuid":"6eb0f47b-e767-49c0-8d72-07f71b9c2e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6825","nonce":1025535744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6827","nonce":1025535744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6831","nonce":1025535744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6829","nonce":1025535744}]},"public_addr":"172.21.15.90:6825/1025535744","cluster_addr":"172.21.15.90:6827/1025535744","heartbeat_back_addr":"172.21.15.90:6831/1025535744","heartbeat_front_addr":"172.21.15.90:6829/1025535744","state":["exists","up"]},{"osd":3,"uuid":"64418862-beef-479c-be11-dfe0e515e09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6817","nonce":1515884437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6819","nonce":1515884437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6823","nonce":1515884437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6821","nonce":1515884437}]},"public_addr":"172.21.15.90:6817/1515884437","cluster_addr":"172.21.15.90:6819/1515884437","heartbeat_back_addr":"172.21.15.90:6823/1515884437","heartbeat_front_addr":"172.21.15.90:6821/1515884437","state":["exists","up"]},{"osd":4,"uuid":"a05b63f4-ec0a-426c-9d60-285e2680a897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6816","nonce":4278726553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6820","nonce":4278726553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6825","nonce":4278726553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6823","nonce":4278726553}]},"public_addr":"172.21.15.149:6816/4278726553","cluster_addr":"172.21.15.149:6820/4278726553","heartbeat_back_addr":"172.21.15.149:6825/4278726553","heartbeat_front_addr":"172.21.15.149:6823/4278726553","state":["exists","up"]},{"osd":5,"uuid":"3a1bab89-963c-4fe7-b14f-3080c5cf7830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6827","nonce":1341677333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6829","nonce":1341677333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6833","nonce":1341677333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6831","nonce":1341677333}]},"public_addr":"172.21.15.149:6827/1341677333","cluster_addr":"172.21.15.149:6829/1341677333","heartbeat_back_addr":"172.21.15.149:6833/1341677333","heartbeat_front_addr":"172.21.15.149:6831/1341677333","state":["exists","up"]},{"osd":6,"uuid":"bfcd1596-2688-4deb-be2e-55f305a5b4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6811","nonce":821196931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6813","nonce":821196931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6821","nonce":821196931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6817","nonce":821196931}]},"public_addr":"172.21.15.149:6811/821196931","cluster_addr":"172.21.15.149:6813/821196931","heartbeat_back_addr":"172.21.15.149:6821/821196931","heartbeat_front_addr":"172.21.15.149:6817/821196931","state":["exists","up"]},{"osd":7,"uuid":"58b19790-4006-4f07-966c-911b938cc1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6803","nonce":1657326880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6805","nonce":1657326880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6809","nonce":1657326880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6807","nonce":1657326880}]},"public_addr":"172.21.15.149:6803/1657326880","cluster_addr":"172.21.15.149:6805/1657326880","heartbeat_back_addr":"172.21.15.149:6809/1657326880","heartbeat_front_addr":"172.21.15.149:6807/1657326880","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.399701+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.051745+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.190159+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:23.240143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.446570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.259974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:21.990407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.459259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:14:48.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.018+0000 7f325be00640 1 -- 172.21.15.90:0/3483236781 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f323c078bc0 msgr2=0x7f323c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:48.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.018+0000 7f325be00640 1 --2- 172.21.15.90:0/3483236781 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f323c078bc0 0x7f323c07b0d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f324c009b30 tx=0x7f324c005f90 comp rx=0 tx=0).stop 2024-09-21T03:14:48.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.018+0000 7f325be00640 1 -- 172.21.15.90:0/3483236781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f325c1520e0 msgr2=0x7f325c0ab140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:48.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.018+0000 7f325be00640 1 --2- 172.21.15.90:0/3483236781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f325c1520e0 0x7f325c0ab140 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f325400c730 tx=0x7f325400cb30 comp rx=0 tx=0).stop 2024-09-21T03:14:48.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.018+0000 7f325be00640 1 -- 172.21.15.90:0/3483236781 shutdown_connections 2024-09-21T03:14:48.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.018+0000 7f325be00640 1 --2- 172.21.15.90:0/3483236781 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f323c078bc0 0x7f323c07b0d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:48.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.018+0000 7f325be00640 1 --2- 172.21.15.90:0/3483236781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f325c1520e0 0x7f325c0ab140 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:48.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.018+0000 7f325be00640 1 --2- 172.21.15.90:0/3483236781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f325c0ca7d0 0x7f325c155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:48.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.018+0000 7f325be00640 1 --2- 172.21.15.90:0/3483236781 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f325c0bf920 0x7f325c1ddf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:48.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.018+0000 7f325be00640 1 -- 172.21.15.90:0/3483236781 >> 172.21.15.90:0/3483236781 conn(0x7f325c0ac360 msgr2=0x7f325c0c7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:48.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.019+0000 7f325be00640 1 -- 172.21.15.90:0/3483236781 shutdown_connections 2024-09-21T03:14:48.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.019+0000 7f325be00640 1 -- 172.21.15.90:0/3483236781 wait complete. 2024-09-21T03:14:48.045 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:14:48.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.263+0000 7fa231e00640 1 -- 172.21.15.90:0/1039603024 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa22c06e630 msgr2=0x7fa22c154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:48.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.263+0000 7fa231e00640 1 --2- 172.21.15.90:0/1039603024 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa22c06e630 0x7fa22c154530 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0c70d0 tx=0x7fa21c02a4d0 comp rx=0 tx=0).stop 2024-09-21T03:14:48.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.263+0000 7fa231e00640 1 -- 172.21.15.90:0/1039603024 shutdown_connections 2024-09-21T03:14:48.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.263+0000 7fa231e00640 1 --2- 172.21.15.90:0/1039603024 >> v2:172.21.15.149:3300/0 conn(0x7fa22c0cb140 0x7fa22c0cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:48.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.263+0000 7fa231e00640 1 --2- 172.21.15.90:0/1039603024 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa22c06e630 0x7fa22c154530 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:48.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.263+0000 7fa231e00640 1 -- 172.21.15.90:0/1039603024 >> 172.21.15.90:0/1039603024 conn(0x7fa22c0c8d60 msgr2=0x7fa22c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:48.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.263+0000 7fa231e00640 1 -- 172.21.15.90:0/1039603024 shutdown_connections 2024-09-21T03:14:48.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.263+0000 7fa231e00640 1 -- 172.21.15.90:0/1039603024 wait complete. 2024-09-21T03:14:48.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.265+0000 7fa231e00640 1 Processor -- start 2024-09-21T03:14:48.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.266+0000 7fa231e00640 1 -- start start 2024-09-21T03:14:48.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.267+0000 7fa231e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa22c06e630 0x7fa22c0c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:48.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.267+0000 7fa231e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa22c0c7460 0x7fa22c0c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:48.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.267+0000 7fa231e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa22c0cb140 0x7fa22c151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:48.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.267+0000 7fa231e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c0cba90 con 0x7fa22c06e630 2024-09-21T03:14:48.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.267+0000 7fa231e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c0ca940 con 0x7fa22c0cb140 2024-09-21T03:14:48.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.267+0000 7fa231e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa22c1582a0 con 0x7fa22c0c7460 2024-09-21T03:14:48.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.267+0000 7fa230a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa22c06e630 0x7fa22c0c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:48.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.267+0000 7fa230a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa22c06e630 0x7fa22c0c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49772/0 (socket says 172.21.15.90:49772) 2024-09-21T03:14:48.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.267+0000 7fa230a00640 1 -- 172.21.15.90:0/3516794169 learned_addr learned my addr 172.21.15.90:0/3516794169 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:48.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.267+0000 7fa231400640 1 --2- 172.21.15.90:0/3516794169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa22c0cb140 0x7fa22c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:48.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.267+0000 7fa223e00640 1 --2- 172.21.15.90:0/3516794169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa22c0c7460 0x7fa22c0c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:48.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.267+0000 7fa230a00640 1 -- 172.21.15.90:0/3516794169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa22c0c7460 msgr2=0x7fa22c0c41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:48.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.267+0000 7fa230a00640 1 --2- 172.21.15.90:0/3516794169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa22c0c7460 0x7fa22c0c41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:48.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.267+0000 7fa230a00640 1 -- 172.21.15.90:0/3516794169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa22c0cb140 msgr2=0x7fa22c151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:48.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.267+0000 7fa230a00640 1 --2- 172.21.15.90:0/3516794169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa22c0cb140 0x7fa22c151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:48.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.267+0000 7fa230a00640 1 -- 172.21.15.90:0/3516794169 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22c0c46e0 con 0x7fa22c06e630 2024-09-21T03:14:48.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.268+0000 7fa230a00640 1 --2- 172.21.15.90:0/3516794169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa22c06e630 0x7fa22c0c5e90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa21c034040 tx=0x7fa21c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:48.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.268+0000 7fa229600640 1 -- 172.21.15.90:0/3516794169 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c03e030 con 0x7fa22c06e630 2024-09-21T03:14:48.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.268+0000 7fa229600640 1 -- 172.21.15.90:0/3516794169 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa21c003e00 con 0x7fa22c06e630 2024-09-21T03:14:48.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.268+0000 7fa231e00640 1 -- 172.21.15.90:0/3516794169 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa22c152510 con 0x7fa22c06e630 2024-09-21T03:14:48.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.268+0000 7fa229600640 1 -- 172.21.15.90:0/3516794169 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c035040 con 0x7fa22c06e630 2024-09-21T03:14:48.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.268+0000 7fa231e00640 1 -- 172.21.15.90:0/3516794169 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa22c14fb80 con 0x7fa22c06e630 2024-09-21T03:14:48.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.269+0000 7fa231e00640 1 -- 172.21.15.90:0/3516794169 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa22c159d30 con 0x7fa22c06e630 2024-09-21T03:14:48.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.270+0000 7fa229600640 1 -- 172.21.15.90:0/3516794169 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa21c041030 con 0x7fa22c06e630 2024-09-21T03:14:48.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.271+0000 7fa229600640 1 --2- 172.21.15.90:0/3516794169 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa208078b90 0x7fa20807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:48.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.271+0000 7fa229600640 1 -- 172.21.15.90:0/3516794169 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fa21c0bb860 con 0x7fa22c06e630 2024-09-21T03:14:48.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.272+0000 7fa223e00640 1 --2- 172.21.15.90:0/3516794169 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa208078b90 0x7fa20807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:48.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.272+0000 7fa223e00640 1 --2- 172.21.15.90:0/3516794169 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa208078b90 0x7fa20807b0a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa214005fd0 tx=0x7fa214005850 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:48.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.276+0000 7fa229600640 1 -- 172.21.15.90:0/3516794169 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa22c159d30 con 0x7fa22c06e630 2024-09-21T03:14:48.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.460+0000 7fa231e00640 1 -- 172.21.15.90:0/3516794169 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa22c06d750 con 0x7fa22c06e630 2024-09-21T03:14:48.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.462+0000 7fa229600640 1 -- 172.21.15.90:0/3516794169 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20420 (secure 0 0 0) 0x7fa21c083a00 con 0x7fa22c06e630 2024-09-21T03:14:48.464 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:48.464 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":24,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","created":"2024-09-21T03:14:09.323302+0000","modified":"2024-09-21T03:14:47.022026+0000","last_up_change":"2024-09-21T03:14:25.329650+0000","last_in_change":"2024-09-21T03:14:15.386953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:14:24.511246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-21T03:14:35.815250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-21T03:14:36.914615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-21T03:14:45.298287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-21T03:14:45.977111+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ceaacfab-e71c-45e2-ac50-4597dfd460bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6809","nonce":3187794863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6811","nonce":3187794863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6815","nonce":3187794863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6813","nonce":3187794863}]},"public_addr":"172.21.15.90:6809/3187794863","cluster_addr":"172.21.15.90:6811/3187794863","heartbeat_back_addr":"172.21.15.90:6815/3187794863","heartbeat_front_addr":"172.21.15.90:6813/3187794863","state":["exists","up"]},{"osd":1,"uuid":"86f91523-232b-4e80-ada7-d9e12770adb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6801","nonce":3769758484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6803","nonce":3769758484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6807","nonce":3769758484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6805","nonce":3769758484}]},"public_addr":"172.21.15.90:6801/3769758484","cluster_addr":"172.21.15.90:6803/3769758484","heartbeat_back_addr":"172.21.15.90:6807/3769758484","heartbeat_front_addr":"172.21.15.90:6805/3769758484","state":["exists","up"]},{"osd":2,"uuid":"6eb0f47b-e767-49c0-8d72-07f71b9c2e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6825","nonce":1025535744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6827","nonce":1025535744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6831","nonce":1025535744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6829","nonce":1025535744}]},"public_addr":"172.21.15.90:6825/1025535744","cluster_addr":"172.21.15.90:6827/1025535744","heartbeat_back_addr":"172.21.15.90:6831/1025535744","heartbeat_front_addr":"172.21.15.90:6829/1025535744","state":["exists","up"]},{"osd":3,"uuid":"64418862-beef-479c-be11-dfe0e515e09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6817","nonce":1515884437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6819","nonce":1515884437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6823","nonce":1515884437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6821","nonce":1515884437}]},"public_addr":"172.21.15.90:6817/1515884437","cluster_addr":"172.21.15.90:6819/1515884437","heartbeat_back_addr":"172.21.15.90:6823/1515884437","heartbeat_front_addr":"172.21.15.90:6821/1515884437","state":["exists","up"]},{"osd":4,"uuid":"a05b63f4-ec0a-426c-9d60-285e2680a897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6816","nonce":4278726553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6820","nonce":4278726553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6825","nonce":4278726553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6823","nonce":4278726553}]},"public_addr":"172.21.15.149:6816/4278726553","cluster_addr":"172.21.15.149:6820/4278726553","heartbeat_back_addr":"172.21.15.149:6825/4278726553","heartbeat_front_addr":"172.21.15.149:6823/4278726553","state":["exists","up"]},{"osd":5,"uuid":"3a1bab89-963c-4fe7-b14f-3080c5cf7830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6827","nonce":1341677333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6829","nonce":1341677333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6833","nonce":1341677333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6831","nonce":1341677333}]},"public_addr":"172.21.15.149:6827/1341677333","cluster_addr":"172.21.15.149:6829/1341677333","heartbeat_back_addr":"172.21.15.149:6833/1341677333","heartbeat_front_addr":"172.21.15.149:6831/1341677333","state":["exists","up"]},{"osd":6,"uuid":"bfcd1596-2688-4deb-be2e-55f305a5b4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6811","nonce":821196931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6813","nonce":821196931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6821","nonce":821196931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6817","nonce":821196931}]},"public_addr":"172.21.15.149:6811/821196931","cluster_addr":"172.21.15.149:6813/821196931","heartbeat_back_addr":"172.21.15.149:6821/821196931","heartbeat_front_addr":"172.21.15.149:6817/821196931","state":["exists","up"]},{"osd":7,"uuid":"58b19790-4006-4f07-966c-911b938cc1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6803","nonce":1657326880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6805","nonce":1657326880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6809","nonce":1657326880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6807","nonce":1657326880}]},"public_addr":"172.21.15.149:6803/1657326880","cluster_addr":"172.21.15.149:6805/1657326880","heartbeat_back_addr":"172.21.15.149:6809/1657326880","heartbeat_front_addr":"172.21.15.149:6807/1657326880","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.399701+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.051745+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.190159+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:23.240143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.446570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.259974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:21.990407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.459259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:14:48.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.464+0000 7fa231e00640 1 -- 172.21.15.90:0/3516794169 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa208078b90 msgr2=0x7fa20807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:48.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.464+0000 7fa231e00640 1 --2- 172.21.15.90:0/3516794169 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa208078b90 0x7fa20807b0a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa214005fd0 tx=0x7fa214005850 comp rx=0 tx=0).stop 2024-09-21T03:14:48.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.464+0000 7fa231e00640 1 -- 172.21.15.90:0/3516794169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa22c06e630 msgr2=0x7fa22c0c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:48.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.464+0000 7fa231e00640 1 --2- 172.21.15.90:0/3516794169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa22c06e630 0x7fa22c0c5e90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa21c034040 tx=0x7fa21c003910 comp rx=0 tx=0).stop 2024-09-21T03:14:48.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.465+0000 7fa231e00640 1 -- 172.21.15.90:0/3516794169 shutdown_connections 2024-09-21T03:14:48.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.465+0000 7fa231e00640 1 --2- 172.21.15.90:0/3516794169 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa208078b90 0x7fa20807b0a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:48.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.465+0000 7fa231e00640 1 --2- 172.21.15.90:0/3516794169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa22c0cb140 0x7fa22c151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:48.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.465+0000 7fa231e00640 1 --2- 172.21.15.90:0/3516794169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa22c0c7460 0x7fa22c0c41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:48.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.465+0000 7fa231e00640 1 --2- 172.21.15.90:0/3516794169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa22c06e630 0x7fa22c0c5e90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:48.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.465+0000 7fa231e00640 1 -- 172.21.15.90:0/3516794169 >> 172.21.15.90:0/3516794169 conn(0x7fa22c0c8d60 msgr2=0x7fa22c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:48.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.465+0000 7fa231e00640 1 -- 172.21.15.90:0/3516794169 shutdown_connections 2024-09-21T03:14:48.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.465+0000 7fa231e00640 1 -- 172.21.15.90:0/3516794169 wait complete. 2024-09-21T03:14:48.489 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b standby_count_wanted 0 2024-09-21T03:14:48.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.718+0000 7f79a0200640 1 -- 172.21.15.90:0/1967222809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7980003a50 msgr2=0x7f7980003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:48.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.718+0000 7f79a0200640 1 --2- 172.21.15.90:0/1967222809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7980003a50 0x7f7980003ec0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f798c009b50 tx=0x7f7980005830 comp rx=0 tx=0).stop 2024-09-21T03:14:48.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.718+0000 7f79a0200640 1 -- 172.21.15.90:0/1967222809 shutdown_connections 2024-09-21T03:14:48.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.718+0000 7f79a0200640 1 --2- 172.21.15.90:0/1967222809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7980003a50 0x7f7980003ec0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:48.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.718+0000 7f79a0200640 1 -- 172.21.15.90:0/1967222809 >> 172.21.15.90:0/1967222809 conn(0x7f79980c85a0 msgr2=0x7f79980c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:48.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.718+0000 7f79a0200640 1 -- 172.21.15.90:0/1967222809 shutdown_connections 2024-09-21T03:14:48.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.718+0000 7f79a0200640 1 -- 172.21.15.90:0/1967222809 wait complete. 2024-09-21T03:14:48.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.720+0000 7f79a0200640 1 Processor -- start 2024-09-21T03:14:48.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.720+0000 7f79a0200640 1 -- start start 2024-09-21T03:14:48.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.722+0000 7f79a0200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7980003a50 0x7f7998150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:48.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.722+0000 7f79a0200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f799806fef0 0x7f7998151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:48.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.722+0000 7f79a0200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79981f02c0 0x7f7998147970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:48.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.722+0000 7f79a0200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7998152430 con 0x7f7980003a50 2024-09-21T03:14:48.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.722+0000 7f79a0200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f79981522b0 con 0x7f79981f02c0 2024-09-21T03:14:48.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.722+0000 7f79a0200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f79981525b0 con 0x7f799806fef0 2024-09-21T03:14:48.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.722+0000 7f799d800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7980003a50 0x7f7998150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:48.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.722+0000 7f799d800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7980003a50 0x7f7998150810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49796/0 (socket says 172.21.15.90:49796) 2024-09-21T03:14:48.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.722+0000 7f799d800640 1 -- 172.21.15.90:0/1911757336 learned_addr learned my addr 172.21.15.90:0/1911757336 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:48.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.722+0000 7f799e200640 1 --2- 172.21.15.90:0/1911757336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79981f02c0 0x7f7998147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:48.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.722+0000 7f799d800640 1 -- 172.21.15.90:0/1911757336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f799806fef0 msgr2=0x7f7998151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:48.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.722+0000 7f799ce00640 1 --2- 172.21.15.90:0/1911757336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f799806fef0 0x7f7998151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:48.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.722+0000 7f799d800640 1 --2- 172.21.15.90:0/1911757336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f799806fef0 0x7f7998151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:48.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.722+0000 7f799d800640 1 -- 172.21.15.90:0/1911757336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79981f02c0 msgr2=0x7f7998147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:48.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.722+0000 7f799d800640 1 --2- 172.21.15.90:0/1911757336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79981f02c0 0x7f7998147970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:48.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.722+0000 7f799d800640 1 -- 172.21.15.90:0/1911757336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79981f0e20 con 0x7f7980003a50 2024-09-21T03:14:48.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.722+0000 7f799e200640 1 --2- 172.21.15.90:0/1911757336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79981f02c0 0x7f7998147970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:48.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.722+0000 7f799ce00640 1 --2- 172.21.15.90:0/1911757336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f799806fef0 0x7f7998151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:48.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.723+0000 7f799d800640 1 --2- 172.21.15.90:0/1911757336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7980003a50 0x7f7998150810 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f798c036040 tx=0x7f798c0336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:48.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.723+0000 7f7995600640 1 -- 172.21.15.90:0/1911757336 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c038040 con 0x7f7980003a50 2024-09-21T03:14:48.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.723+0000 7f7995600640 1 -- 172.21.15.90:0/1911757336 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f798c041070 con 0x7f7980003a50 2024-09-21T03:14:48.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.723+0000 7f7995600640 1 -- 172.21.15.90:0/1911757336 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c03c430 con 0x7f7980003a50 2024-09-21T03:14:48.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.723+0000 7f79a0200640 1 -- 172.21.15.90:0/1911757336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f799806ef40 con 0x7f7980003a50 2024-09-21T03:14:48.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.723+0000 7f79a0200640 1 -- 172.21.15.90:0/1911757336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7998150d50 con 0x7f7980003a50 2024-09-21T03:14:48.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.724+0000 7f79a0200640 1 -- 172.21.15.90:0/1911757336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79980737f0 con 0x7f7980003a50 2024-09-21T03:14:48.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.725+0000 7f7995600640 1 -- 172.21.15.90:0/1911757336 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f798c03c5d0 con 0x7f7980003a50 2024-09-21T03:14:48.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.726+0000 7f7995600640 1 --2- 172.21.15.90:0/1911757336 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7978078b90 0x7f797807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:48.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.726+0000 7f7995600640 1 -- 172.21.15.90:0/1911757336 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f798c0bb9a0 con 0x7f7980003a50 2024-09-21T03:14:48.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.727+0000 7f799ce00640 1 --2- 172.21.15.90:0/1911757336 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7978078b90 0x7f797807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:48.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.728+0000 7f799ce00640 1 --2- 172.21.15.90:0/1911757336 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7978078b90 0x7f797807b0a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7984001220 tx=0x7f7984009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:48.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.731+0000 7f7995600640 1 -- 172.21.15.90:0/1911757336 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f798c083b30 con 0x7f7980003a50 2024-09-21T03:14:48.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:48.953+0000 7f79a0200640 1 -- 172.21.15.90:0/1911757336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f799814f440 con 0x7f7980003a50 2024-09-21T03:14:49.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.560+0000 7f7995600640 1 -- 172.21.15.90:0/1911757336 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"}]=0 v12) ==== 113+0+0 (secure 0 0 0) 0x7f798c083430 con 0x7f7980003a50 2024-09-21T03:14:49.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.562+0000 7f79a0200640 1 -- 172.21.15.90:0/1911757336 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7978078b90 msgr2=0x7f797807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:49.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.562+0000 7f79a0200640 1 --2- 172.21.15.90:0/1911757336 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7978078b90 0x7f797807b0a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7984001220 tx=0x7f7984009040 comp rx=0 tx=0).stop 2024-09-21T03:14:49.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.562+0000 7f79a0200640 1 -- 172.21.15.90:0/1911757336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7980003a50 msgr2=0x7f7998150810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:49.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.562+0000 7f79a0200640 1 --2- 172.21.15.90:0/1911757336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7980003a50 0x7f7998150810 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f798c036040 tx=0x7f798c0336f0 comp rx=0 tx=0).stop 2024-09-21T03:14:49.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.562+0000 7f79a0200640 1 -- 172.21.15.90:0/1911757336 shutdown_connections 2024-09-21T03:14:49.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.562+0000 7f79a0200640 1 --2- 172.21.15.90:0/1911757336 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7978078b90 0x7f797807b0a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:49.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.562+0000 7f79a0200640 1 --2- 172.21.15.90:0/1911757336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79981f02c0 0x7f7998147970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:49.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.562+0000 7f79a0200640 1 --2- 172.21.15.90:0/1911757336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f799806fef0 0x7f7998151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:49.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.562+0000 7f79a0200640 1 --2- 172.21.15.90:0/1911757336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7980003a50 0x7f7998150810 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:49.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.562+0000 7f79a0200640 1 -- 172.21.15.90:0/1911757336 >> 172.21.15.90:0/1911757336 conn(0x7f79980c85a0 msgr2=0x7f7998154340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:49.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.563+0000 7f79a0200640 1 -- 172.21.15.90:0/1911757336 shutdown_connections 2024-09-21T03:14:49.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.563+0000 7f79a0200640 1 -- 172.21.15.90:0/1911757336 wait complete. 2024-09-21T03:14:49.585 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-09-21T03:14:49.585 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b allow_standby_replay false 2024-09-21T03:14:49.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.807+0000 7f2cf3e00640 1 -- 172.21.15.90:0/1250532440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cec0abde0 msgr2=0x7f2cec1522b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:49.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.807+0000 7f2cf3e00640 1 --2- 172.21.15.90:0/1250532440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cec0abde0 0x7f2cec1522b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009830 tx=0x7f2ce002a5c0 comp rx=0 tx=0).stop 2024-09-21T03:14:49.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.807+0000 7f2cf3e00640 1 -- 172.21.15.90:0/1250532440 shutdown_connections 2024-09-21T03:14:49.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.807+0000 7f2cf3e00640 1 --2- 172.21.15.90:0/1250532440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cec0abde0 0x7f2cec1522b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:49.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.807+0000 7f2cf3e00640 1 -- 172.21.15.90:0/1250532440 >> 172.21.15.90:0/1250532440 conn(0x7f2cec0c85a0 msgr2=0x7f2cec0c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:49.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.807+0000 7f2cf3e00640 1 -- 172.21.15.90:0/1250532440 shutdown_connections 2024-09-21T03:14:49.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.807+0000 7f2cf3e00640 1 -- 172.21.15.90:0/1250532440 wait complete. 2024-09-21T03:14:49.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.809+0000 7f2cf3e00640 1 Processor -- start 2024-09-21T03:14:49.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.810+0000 7f2cf3e00640 1 -- start start 2024-09-21T03:14:49.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.811+0000 7f2cf3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cec0733e0 0x7f2cec147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:49.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.811+0000 7f2cf3e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cec0abde0 0x7f2cec14db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:49.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.811+0000 7f2cf3e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2cec0ad600 0x7f2cec14e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:49.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.811+0000 7f2cf3e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec074080 con 0x7f2cec0733e0 2024-09-21T03:14:49.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.811+0000 7f2cf3e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec073f00 con 0x7f2cec0abde0 2024-09-21T03:14:49.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.811+0000 7f2cf3e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2cec0ae120 con 0x7f2cec0ad600 2024-09-21T03:14:49.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.811+0000 7f2cf1400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cec0733e0 0x7f2cec147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:49.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.811+0000 7f2cf1400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cec0733e0 0x7f2cec147f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49824/0 (socket says 172.21.15.90:49824) 2024-09-21T03:14:49.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.811+0000 7f2cf1400640 1 -- 172.21.15.90:0/1472073926 learned_addr learned my addr 172.21.15.90:0/1472073926 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:49.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.811+0000 7f2cf0a00640 1 --2- 172.21.15.90:0/1472073926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cec0abde0 0x7f2cec14db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:49.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.811+0000 7f2cf1e00640 1 --2- 172.21.15.90:0/1472073926 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2cec0ad600 0x7f2cec14e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:49.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.812+0000 7f2cf1400640 1 -- 172.21.15.90:0/1472073926 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2cec0ad600 msgr2=0x7f2cec14e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:49.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.812+0000 7f2cf1400640 1 --2- 172.21.15.90:0/1472073926 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2cec0ad600 0x7f2cec14e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:49.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.812+0000 7f2cf1400640 1 -- 172.21.15.90:0/1472073926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cec0abde0 msgr2=0x7f2cec14db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:49.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.812+0000 7f2cf1400640 1 --2- 172.21.15.90:0/1472073926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cec0abde0 0x7f2cec14db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:49.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.812+0000 7f2cf1400640 1 -- 172.21.15.90:0/1472073926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cec1eda60 con 0x7f2cec0733e0 2024-09-21T03:14:49.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.812+0000 7f2cf0a00640 1 --2- 172.21.15.90:0/1472073926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cec0abde0 0x7f2cec14db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:49.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.812+0000 7f2cf1e00640 1 --2- 172.21.15.90:0/1472073926 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2cec0ad600 0x7f2cec14e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:49.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.812+0000 7f2cf1400640 1 --2- 172.21.15.90:0/1472073926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cec0733e0 0x7f2cec147f20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009950 tx=0x7f2ce0033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:49.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.812+0000 7f2ce9600640 1 -- 172.21.15.90:0/1472073926 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0031b60 con 0x7f2cec0733e0 2024-09-21T03:14:49.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.812+0000 7f2ce9600640 1 -- 172.21.15.90:0/1472073926 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ce0031df0 con 0x7f2cec0733e0 2024-09-21T03:14:49.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.812+0000 7f2cf3e00640 1 -- 172.21.15.90:0/1472073926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cec1edd40 con 0x7f2cec0733e0 2024-09-21T03:14:49.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.812+0000 7f2ce9600640 1 -- 172.21.15.90:0/1472073926 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0005280 con 0x7f2cec0733e0 2024-09-21T03:14:49.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.812+0000 7f2cf3e00640 1 -- 172.21.15.90:0/1472073926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cec147200 con 0x7f2cec0733e0 2024-09-21T03:14:49.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.813+0000 7f2cf3e00640 1 -- 172.21.15.90:0/1472073926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cec1522b0 con 0x7f2cec0733e0 2024-09-21T03:14:49.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.814+0000 7f2ce9600640 1 -- 172.21.15.90:0/1472073926 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2ce0005420 con 0x7f2cec0733e0 2024-09-21T03:14:49.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.815+0000 7f2ce9600640 1 --2- 172.21.15.90:0/1472073926 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2ccc078bc0 0x7f2ccc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:49.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.816+0000 7f2ce9600640 1 -- 172.21.15.90:0/1472073926 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f2ce00bc2a0 con 0x7f2cec0733e0 2024-09-21T03:14:49.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.816+0000 7f2cf0a00640 1 --2- 172.21.15.90:0/1472073926 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2ccc078bc0 0x7f2ccc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:49.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.817+0000 7f2cf0a00640 1 --2- 172.21.15.90:0/1472073926 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2ccc078bc0 0x7f2ccc07b0d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2cec152080 tx=0x7f2cd8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:49.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:49.820+0000 7f2ce9600640 1 -- 172.21.15.90:0/1472073926 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2ce003f030 con 0x7f2cec0733e0 2024-09-21T03:14:50.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.044+0000 7f2cf3e00640 1 -- 172.21.15.90:0/1472073926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2cec1e3160 con 0x7f2cec0733e0 2024-09-21T03:14:50.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.569+0000 7f2ce9600640 1 -- 172.21.15.90:0/1472073926 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"}]=0 v13) ==== 117+0+0 (secure 0 0 0) 0x7f2ce0031770 con 0x7f2cec0733e0 2024-09-21T03:14:50.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.571+0000 7f2cf3e00640 1 -- 172.21.15.90:0/1472073926 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2ccc078bc0 msgr2=0x7f2ccc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:50.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.571+0000 7f2cf3e00640 1 --2- 172.21.15.90:0/1472073926 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2ccc078bc0 0x7f2ccc07b0d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2cec152080 tx=0x7f2cd8009040 comp rx=0 tx=0).stop 2024-09-21T03:14:50.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.571+0000 7f2cf3e00640 1 -- 172.21.15.90:0/1472073926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cec0733e0 msgr2=0x7f2cec147f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:50.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.571+0000 7f2cf3e00640 1 --2- 172.21.15.90:0/1472073926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cec0733e0 0x7f2cec147f20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009950 tx=0x7f2ce0033c10 comp rx=0 tx=0).stop 2024-09-21T03:14:50.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.571+0000 7f2cf3e00640 1 -- 172.21.15.90:0/1472073926 shutdown_connections 2024-09-21T03:14:50.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.571+0000 7f2cf3e00640 1 --2- 172.21.15.90:0/1472073926 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2ccc078bc0 0x7f2ccc07b0d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:50.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.571+0000 7f2cf3e00640 1 --2- 172.21.15.90:0/1472073926 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2cec0ad600 0x7f2cec14e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:50.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.571+0000 7f2cf3e00640 1 --2- 172.21.15.90:0/1472073926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cec0abde0 0x7f2cec14db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:50.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.571+0000 7f2cf3e00640 1 --2- 172.21.15.90:0/1472073926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cec0733e0 0x7f2cec147f20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:50.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.572+0000 7f2cf3e00640 1 -- 172.21.15.90:0/1472073926 >> 172.21.15.90:0/1472073926 conn(0x7f2cec0c85a0 msgr2=0x7f2cec0c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:50.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.572+0000 7f2cf3e00640 1 -- 172.21.15.90:0/1472073926 shutdown_connections 2024-09-21T03:14:50.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.572+0000 7f2cf3e00640 1 -- 172.21.15.90:0/1472073926 wait complete. 2024-09-21T03:14:50.597 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b session_timeout 300 2024-09-21T03:14:50.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.819+0000 7f8a5d200640 1 -- 172.21.15.90:0/2717770155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a3c003c10 msgr2=0x7f8a3c004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:50.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.819+0000 7f8a5d200640 1 --2- 172.21.15.90:0/2717770155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a3c003c10 0x7f8a3c004060 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8a48006f90 tx=0x7f8a3c005830 comp rx=0 tx=0).stop 2024-09-21T03:14:50.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.819+0000 7f8a56800640 1 -- 172.21.15.90:0/2717770155 reap_dead start 2024-09-21T03:14:50.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.819+0000 7f8a5d200640 1 -- 172.21.15.90:0/2717770155 shutdown_connections 2024-09-21T03:14:50.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.819+0000 7f8a5d200640 1 -- 172.21.15.90:0/2717770155 >> 172.21.15.90:0/2717770155 conn(0x7f8a580c85a0 msgr2=0x7f8a580c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:50.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.819+0000 7f8a5d200640 1 -- 172.21.15.90:0/2717770155 shutdown_connections 2024-09-21T03:14:50.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.819+0000 7f8a5d200640 1 -- 172.21.15.90:0/2717770155 wait complete. 2024-09-21T03:14:50.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.821+0000 7f8a5d200640 1 Processor -- start 2024-09-21T03:14:50.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.821+0000 7f8a5d200640 1 -- start start 2024-09-21T03:14:50.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.823+0000 7f8a5d200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a3c003c10 0x7f8a581eb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:50.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.823+0000 7f8a5d200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a58150450 0x7f8a580bd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:50.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.823+0000 7f8a5d200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a580c21b0 0x7f8a5814b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:50.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.823+0000 7f8a5d200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8a580ab550 con 0x7f8a580c21b0 2024-09-21T03:14:50.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.823+0000 7f8a5d200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8a580ab3d0 con 0x7f8a3c003c10 2024-09-21T03:14:50.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.823+0000 7f8a5d200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8a5814ed10 con 0x7f8a58150450 2024-09-21T03:14:50.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.823+0000 7f8a56800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a580c21b0 0x7f8a5814b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:50.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.823+0000 7f8a55400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a58150450 0x7f8a580bd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:50.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.823+0000 7f8a56800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a580c21b0 0x7f8a5814b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49830/0 (socket says 172.21.15.90:49830) 2024-09-21T03:14:50.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.823+0000 7f8a56800640 1 -- 172.21.15.90:0/2811403667 learned_addr learned my addr 172.21.15.90:0/2811403667 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:50.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.823+0000 7f8a55e00640 1 --2- 172.21.15.90:0/2811403667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a3c003c10 0x7f8a581eb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:50.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.823+0000 7f8a56800640 1 -- 172.21.15.90:0/2811403667 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a58150450 msgr2=0x7f8a580bd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:50.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.823+0000 7f8a56800640 1 --2- 172.21.15.90:0/2811403667 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a58150450 0x7f8a580bd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:50.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.823+0000 7f8a56800640 1 -- 172.21.15.90:0/2811403667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a3c003c10 msgr2=0x7f8a581eb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:50.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.823+0000 7f8a56800640 1 --2- 172.21.15.90:0/2811403667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a3c003c10 0x7f8a581eb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:50.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.823+0000 7f8a56800640 1 -- 172.21.15.90:0/2811403667 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5814c220 con 0x7f8a580c21b0 2024-09-21T03:14:50.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.824+0000 7f8a56800640 1 --2- 172.21.15.90:0/2811403667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a580c21b0 0x7f8a5814b5d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8a50005fd0 tx=0x7f8a50011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:50.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.824+0000 7f8a4e000640 1 -- 172.21.15.90:0/2811403667 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50004b20 con 0x7f8a580c21b0 2024-09-21T03:14:50.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.824+0000 7f8a4e000640 1 -- 172.21.15.90:0/2811403667 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a50004cc0 con 0x7f8a580c21b0 2024-09-21T03:14:50.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.824+0000 7f8a5d200640 1 -- 172.21.15.90:0/2811403667 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a581ead30 con 0x7f8a580c21b0 2024-09-21T03:14:50.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.824+0000 7f8a4e000640 1 -- 172.21.15.90:0/2811403667 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50003bd0 con 0x7f8a580c21b0 2024-09-21T03:14:50.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.824+0000 7f8a5d200640 1 -- 172.21.15.90:0/2811403667 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a58151910 con 0x7f8a580c21b0 2024-09-21T03:14:50.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.825+0000 7f8a5d200640 1 -- 172.21.15.90:0/2811403667 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a5814e600 con 0x7f8a580c21b0 2024-09-21T03:14:50.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.826+0000 7f8a4e000640 1 -- 172.21.15.90:0/2811403667 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8a50004030 con 0x7f8a580c21b0 2024-09-21T03:14:50.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.827+0000 7f8a4e000640 1 --2- 172.21.15.90:0/2811403667 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8a38078bc0 0x7f8a3807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:50.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.827+0000 7f8a4e000640 1 -- 172.21.15.90:0/2811403667 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f8a5009bd00 con 0x7f8a580c21b0 2024-09-21T03:14:50.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.828+0000 7f8a55e00640 1 --2- 172.21.15.90:0/2811403667 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8a38078bc0 0x7f8a3807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:50.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.828+0000 7f8a55e00640 1 --2- 172.21.15.90:0/2811403667 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8a38078bc0 0x7f8a3807b0d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8a48033000 tx=0x7f8a4803a040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:50.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:50.832+0000 7f8a4e000640 1 -- 172.21.15.90:0/2811403667 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8a5001f060 con 0x7f8a580c21b0 2024-09-21T03:14:51.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.054+0000 7f8a5d200640 1 -- 172.21.15.90:0/2811403667 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"} v 0) -- 0x7f8a580746a0 con 0x7f8a580c21b0 2024-09-21T03:14:51.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.571+0000 7f8a4e000640 1 -- 172.21.15.90:0/2811403667 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"}]=0 v14) ==== 110+0+0 (secure 0 0 0) 0x7f8a50063d70 con 0x7f8a580c21b0 2024-09-21T03:14:51.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.574+0000 7f8a5d200640 1 -- 172.21.15.90:0/2811403667 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8a38078bc0 msgr2=0x7f8a3807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:51.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.574+0000 7f8a5d200640 1 --2- 172.21.15.90:0/2811403667 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8a38078bc0 0x7f8a3807b0d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8a48033000 tx=0x7f8a4803a040 comp rx=0 tx=0).stop 2024-09-21T03:14:51.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.574+0000 7f8a5d200640 1 -- 172.21.15.90:0/2811403667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a580c21b0 msgr2=0x7f8a5814b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:51.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.574+0000 7f8a5d200640 1 --2- 172.21.15.90:0/2811403667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a580c21b0 0x7f8a5814b5d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8a50005fd0 tx=0x7f8a50011ef0 comp rx=0 tx=0).stop 2024-09-21T03:14:51.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.574+0000 7f8a5d200640 1 -- 172.21.15.90:0/2811403667 shutdown_connections 2024-09-21T03:14:51.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.574+0000 7f8a5d200640 1 --2- 172.21.15.90:0/2811403667 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8a38078bc0 0x7f8a3807b0d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:51.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.574+0000 7f8a5d200640 1 --2- 172.21.15.90:0/2811403667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a580c21b0 0x7f8a5814b5d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:51.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.574+0000 7f8a5d200640 1 --2- 172.21.15.90:0/2811403667 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a58150450 0x7f8a580bd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:51.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.574+0000 7f8a5d200640 1 --2- 172.21.15.90:0/2811403667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a3c003c10 0x7f8a581eb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:51.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.574+0000 7f8a5d200640 1 -- 172.21.15.90:0/2811403667 >> 172.21.15.90:0/2811403667 conn(0x7f8a580c85a0 msgr2=0x7f8a581e09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:51.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.574+0000 7f8a5d200640 1 -- 172.21.15.90:0/2811403667 shutdown_connections 2024-09-21T03:14:51.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.574+0000 7f8a5d200640 1 -- 172.21.15.90:0/2811403667 wait complete. 2024-09-21T03:14:51.598 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'b' 2024-09-21T03:14:51.598 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:14:51.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.820+0000 7f3615e00640 1 -- 172.21.15.90:0/1284763977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35f4003a50 msgr2=0x7f35f4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:51.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.820+0000 7f3615e00640 1 --2- 172.21.15.90:0/1284763977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35f4003a50 0x7f35f4003ec0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3600005fd0 tx=0x7f35f4005830 comp rx=0 tx=0).stop 2024-09-21T03:14:51.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.820+0000 7f3615e00640 1 -- 172.21.15.90:0/1284763977 shutdown_connections 2024-09-21T03:14:51.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.820+0000 7f3615e00640 1 --2- 172.21.15.90:0/1284763977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35f4003a50 0x7f35f4003ec0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:51.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.820+0000 7f3615e00640 1 -- 172.21.15.90:0/1284763977 >> 172.21.15.90:0/1284763977 conn(0x7f36100c8ba0 msgr2=0x7f361006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:51.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.820+0000 7f3615e00640 1 -- 172.21.15.90:0/1284763977 shutdown_connections 2024-09-21T03:14:51.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.820+0000 7f3615e00640 1 -- 172.21.15.90:0/1284763977 wait complete. 2024-09-21T03:14:51.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.822+0000 7f3615e00640 1 Processor -- start 2024-09-21T03:14:51.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.823+0000 7f3615e00640 1 -- start start 2024-09-21T03:14:51.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.824+0000 7f3615e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35f4003a50 0x7f361014c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:51.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.824+0000 7f3615e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36101de2c0 0x7f3610157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:51.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.824+0000 7f3615e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36101de6d0 0x7f36101387c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:51.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.824+0000 7f3615e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f36100ab640 con 0x7f36101de6d0 2024-09-21T03:14:51.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.824+0000 7f3615e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f36100abec0 con 0x7f35f4003a50 2024-09-21T03:14:51.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.824+0000 7f3615e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f361013dd40 con 0x7f36101de2c0 2024-09-21T03:14:51.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.824+0000 7f360f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36101de6d0 0x7f36101387c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:51.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.824+0000 7f360f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36101de6d0 0x7f36101387c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49846/0 (socket says 172.21.15.90:49846) 2024-09-21T03:14:51.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.824+0000 7f360f400640 1 -- 172.21.15.90:0/444921564 learned_addr learned my addr 172.21.15.90:0/444921564 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:51.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.824+0000 7f360ea00640 1 --2- 172.21.15.90:0/444921564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35f4003a50 0x7f361014c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:51.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.824+0000 7f360e000640 1 --2- 172.21.15.90:0/444921564 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36101de2c0 0x7f3610157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:51.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.825+0000 7f360f400640 1 -- 172.21.15.90:0/444921564 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36101de2c0 msgr2=0x7f3610157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:51.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.825+0000 7f360f400640 1 --2- 172.21.15.90:0/444921564 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36101de2c0 0x7f3610157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:51.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.825+0000 7f360f400640 1 -- 172.21.15.90:0/444921564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35f4003a50 msgr2=0x7f361014c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:51.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.825+0000 7f360f400640 1 --2- 172.21.15.90:0/444921564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35f4003a50 0x7f361014c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:51.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.825+0000 7f360f400640 1 -- 172.21.15.90:0/444921564 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f361014c940 con 0x7f36101de6d0 2024-09-21T03:14:51.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.825+0000 7f360e000640 1 --2- 172.21.15.90:0/444921564 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36101de2c0 0x7f3610157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:14:51.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.825+0000 7f360f400640 1 --2- 172.21.15.90:0/444921564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36101de6d0 0x7f36101387c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3610155b80 tx=0x7f3608001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:51.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.825+0000 7f3607400640 1 -- 172.21.15.90:0/444921564 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3608001cc0 con 0x7f36101de6d0 2024-09-21T03:14:51.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.825+0000 7f3607400640 1 -- 172.21.15.90:0/444921564 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3608016020 con 0x7f36101de6d0 2024-09-21T03:14:51.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.825+0000 7f3615e00640 1 -- 172.21.15.90:0/444921564 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36101e8ce0 con 0x7f36101de6d0 2024-09-21T03:14:51.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.825+0000 7f3607400640 1 -- 172.21.15.90:0/444921564 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3608011690 con 0x7f36101de6d0 2024-09-21T03:14:51.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.825+0000 7f3615e00640 1 -- 172.21.15.90:0/444921564 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36101eb3f0 con 0x7f36101de6d0 2024-09-21T03:14:51.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.827+0000 7f3615e00640 1 -- 172.21.15.90:0/444921564 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f361013ceb0 con 0x7f36101de6d0 2024-09-21T03:14:51.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.828+0000 7f3607400640 1 -- 172.21.15.90:0/444921564 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3608011830 con 0x7f36101de6d0 2024-09-21T03:14:51.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.829+0000 7f3607400640 1 --2- 172.21.15.90:0/444921564 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f35f0078bc0 0x7f35f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:51.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.829+0000 7f3607400640 1 -- 172.21.15.90:0/444921564 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f360809b970 con 0x7f36101de6d0 2024-09-21T03:14:51.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.829+0000 7f360ea00640 1 --2- 172.21.15.90:0/444921564 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f35f0078bc0 0x7f35f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:51.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.830+0000 7f360ea00640 1 --2- 172.21.15.90:0/444921564 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f35f0078bc0 0x7f35f007b0d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3600035000 tx=0x7f3600004a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:51.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:51.833+0000 7f3607400640 1 -- 172.21.15.90:0/444921564 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f361013ceb0 con 0x7f36101de6d0 2024-09-21T03:14:52.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.055+0000 7f3615e00640 1 -- 172.21.15.90:0/444921564 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36100ac760 con 0x7f36101de6d0 2024-09-21T03:14:52.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.056+0000 7f3607400640 1 -- 172.21.15.90:0/444921564 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6530 (secure 0 0 0) 0x7f3608020020 con 0x7f36101de6d0 2024-09-21T03:14:52.058 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:52.058 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"btime":"2024-09-21T03:14:51:570098+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3707484056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3707484056},{"type":"v1","addr":"172.21.15.90:6835","nonce":3707484056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1650707992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1650707992},{"type":"v1","addr":"172.21.15.149:6837","nonce":1650707992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:37.954868+0000","modified":"2024-09-21T03:14:41.971257+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/2166962836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2166962836},{"type":"v1","addr":"172.21.15.149:6836","nonce":2166962836}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:47.021969+0000","modified":"2024-09-21T03:14:51.055397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4395},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4395":{"gid":4395,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6833/1105275899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1105275899},{"type":"v1","addr":"172.21.15.90:6833","nonce":1105275899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4395,"qdb_cluster":[4395]},"id":2}]} 2024-09-21T03:14:52.058 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2024-09-21T03:14:52.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.058+0000 7f3615e00640 1 -- 172.21.15.90:0/444921564 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f35f0078bc0 msgr2=0x7f35f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:52.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.058+0000 7f3615e00640 1 --2- 172.21.15.90:0/444921564 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f35f0078bc0 0x7f35f007b0d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3600035000 tx=0x7f3600004a40 comp rx=0 tx=0).stop 2024-09-21T03:14:52.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.058+0000 7f3615e00640 1 -- 172.21.15.90:0/444921564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36101de6d0 msgr2=0x7f36101387c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:52.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.058+0000 7f3615e00640 1 --2- 172.21.15.90:0/444921564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36101de6d0 0x7f36101387c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3610155b80 tx=0x7f3608001630 comp rx=0 tx=0).stop 2024-09-21T03:14:52.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.058+0000 7f3615e00640 1 -- 172.21.15.90:0/444921564 shutdown_connections 2024-09-21T03:14:52.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.058+0000 7f3615e00640 1 --2- 172.21.15.90:0/444921564 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f35f0078bc0 0x7f35f007b0d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:52.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.058+0000 7f3615e00640 1 --2- 172.21.15.90:0/444921564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36101de6d0 0x7f36101387c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:52.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.058+0000 7f3615e00640 1 --2- 172.21.15.90:0/444921564 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36101de2c0 0x7f3610157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:52.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.058+0000 7f3615e00640 1 --2- 172.21.15.90:0/444921564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35f4003a50 0x7f361014c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:52.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.058+0000 7f3615e00640 1 -- 172.21.15.90:0/444921564 >> 172.21.15.90:0/444921564 conn(0x7f36100c8ba0 msgr2=0x7f36100c3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:52.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.058+0000 7f3615e00640 1 -- 172.21.15.90:0/444921564 shutdown_connections 2024-09-21T03:14:52.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.058+0000 7f3615e00640 1 -- 172.21.15.90:0/444921564 wait complete. 2024-09-21T03:14:52.081 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:14:52.152 INFO:tasks.ceph.mds.a.smithi090.stderr:2024-09-21T03:14:52.150+0000 7f2945000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:14:52.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.300+0000 7f31da000640 1 -- 172.21.15.90:0/3532005978 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31b8003a50 msgr2=0x7f31b8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:52.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.300+0000 7f31da000640 1 --2- 172.21.15.90:0/3532005978 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31b8003a50 0x7f31b8003ec0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f31c400c4a0 tx=0x7f31b8005830 comp rx=0 tx=0).stop 2024-09-21T03:14:52.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.300+0000 7f31da000640 1 -- 172.21.15.90:0/3532005978 shutdown_connections 2024-09-21T03:14:52.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.300+0000 7f31da000640 1 --2- 172.21.15.90:0/3532005978 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31b8003a50 0x7f31b8003ec0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:52.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.300+0000 7f31da000640 1 -- 172.21.15.90:0/3532005978 >> 172.21.15.90:0/3532005978 conn(0x7f31d40c8ba0 msgr2=0x7f31d406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:52.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.300+0000 7f31da000640 1 -- 172.21.15.90:0/3532005978 shutdown_connections 2024-09-21T03:14:52.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.300+0000 7f31da000640 1 -- 172.21.15.90:0/3532005978 wait complete. 2024-09-21T03:14:52.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.302+0000 7f31da000640 1 Processor -- start 2024-09-21T03:14:52.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.302+0000 7f31da000640 1 -- start start 2024-09-21T03:14:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.304+0000 7f31da000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31b8003a50 0x7f31d40c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.304+0000 7f31da000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31d41ecc10 0x7f31d414c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.304+0000 7f31da000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31d41ed020 0x7f31d414c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.304+0000 7f31da000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f31d406fcb0 con 0x7f31d41ed020 2024-09-21T03:14:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.304+0000 7f31da000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f31d406f9d0 con 0x7f31b8003a50 2024-09-21T03:14:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.304+0000 7f31da000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f31d40c26e0 con 0x7f31d41ecc10 2024-09-21T03:14:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.304+0000 7f31d3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31d41ed020 0x7f31d414c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.304+0000 7f31d3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31d41ed020 0x7f31d414c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49870/0 (socket says 172.21.15.90:49870) 2024-09-21T03:14:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.304+0000 7f31d3e00640 1 -- 172.21.15.90:0/3676999215 learned_addr learned my addr 172.21.15.90:0/3676999215 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.304+0000 7f31cbe00640 1 --2- 172.21.15.90:0/3676999215 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31d41ecc10 0x7f31d414c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.304+0000 7f31d3400640 1 --2- 172.21.15.90:0/3676999215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31b8003a50 0x7f31d40c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.304+0000 7f31d3e00640 1 -- 172.21.15.90:0/3676999215 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31d41ecc10 msgr2=0x7f31d414c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:52.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.304+0000 7f31d3e00640 1 --2- 172.21.15.90:0/3676999215 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31d41ecc10 0x7f31d414c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:52.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.304+0000 7f31d3e00640 1 -- 172.21.15.90:0/3676999215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31b8003a50 msgr2=0x7f31d40c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:52.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.304+0000 7f31d3e00640 1 --2- 172.21.15.90:0/3676999215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31b8003a50 0x7f31d40c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:52.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.304+0000 7f31d3e00640 1 -- 172.21.15.90:0/3676999215 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d4152860 con 0x7f31d41ed020 2024-09-21T03:14:52.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.304+0000 7f31cbe00640 1 --2- 172.21.15.90:0/3676999215 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31d41ecc10 0x7f31d414c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:52.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.304+0000 7f31d3400640 1 --2- 172.21.15.90:0/3676999215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31b8003a50 0x7f31d40c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:52.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.305+0000 7f31d3e00640 1 --2- 172.21.15.90:0/3676999215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31d41ed020 0x7f31d414c860 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f31d4070960 tx=0x7f31cc0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:52.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.305+0000 7f31cb400640 1 -- 172.21.15.90:0/3676999215 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc015020 con 0x7f31d41ed020 2024-09-21T03:14:52.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.305+0000 7f31cb400640 1 -- 172.21.15.90:0/3676999215 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31cc011960 con 0x7f31d41ed020 2024-09-21T03:14:52.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.305+0000 7f31cb400640 1 -- 172.21.15.90:0/3676999215 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc011db0 con 0x7f31d41ed020 2024-09-21T03:14:52.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.305+0000 7f31da000640 1 -- 172.21.15.90:0/3676999215 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d40c7d40 con 0x7f31d41ed020 2024-09-21T03:14:52.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.305+0000 7f31da000640 1 -- 172.21.15.90:0/3676999215 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d414cfa0 con 0x7f31d41ed020 2024-09-21T03:14:52.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.306+0000 7f31da000640 1 -- 172.21.15.90:0/3676999215 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d40c3b20 con 0x7f31d41ed020 2024-09-21T03:14:52.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.307+0000 7f31cb400640 1 -- 172.21.15.90:0/3676999215 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f31cc018020 con 0x7f31d41ed020 2024-09-21T03:14:52.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.308+0000 7f31cb400640 1 --2- 172.21.15.90:0/3676999215 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f31b0078b90 0x7f31b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:52.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.308+0000 7f31cb400640 1 -- 172.21.15.90:0/3676999215 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f31cc09b9e0 con 0x7f31d41ed020 2024-09-21T03:14:52.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.309+0000 7f31d3400640 1 --2- 172.21.15.90:0/3676999215 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f31b0078b90 0x7f31b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:52.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.309+0000 7f31d3400640 1 --2- 172.21.15.90:0/3676999215 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f31b0078b90 0x7f31b007b0a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f31c4033000 tx=0x7f31c4038040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:52.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.313+0000 7f31cb400640 1 -- 172.21.15.90:0/3676999215 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f31cc01f020 con 0x7f31d41ed020 2024-09-21T03:14:52.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.499+0000 7f31da000640 1 -- 172.21.15.90:0/3676999215 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31d4152a30 con 0x7f31d41ed020 2024-09-21T03:14:52.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.501+0000 7f31cb400640 1 -- 172.21.15.90:0/3676999215 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20407 (secure 0 0 0) 0x7f31cc063c10 con 0x7f31d41ed020 2024-09-21T03:14:52.503 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:52.503 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":25,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","created":"2024-09-21T03:14:09.323302+0000","modified":"2024-09-21T03:14:48.547226+0000","last_up_change":"2024-09-21T03:14:25.329650+0000","last_in_change":"2024-09-21T03:14:15.386953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:14:24.511246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-21T03:14:35.815250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-21T03:14:36.914615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-21T03:14:45.298287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-21T03:14:45.977111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ceaacfab-e71c-45e2-ac50-4597dfd460bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6809","nonce":3187794863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6811","nonce":3187794863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6815","nonce":3187794863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6813","nonce":3187794863}]},"public_addr":"172.21.15.90:6809/3187794863","cluster_addr":"172.21.15.90:6811/3187794863","heartbeat_back_addr":"172.21.15.90:6815/3187794863","heartbeat_front_addr":"172.21.15.90:6813/3187794863","state":["exists","up"]},{"osd":1,"uuid":"86f91523-232b-4e80-ada7-d9e12770adb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6801","nonce":3769758484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6803","nonce":3769758484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6807","nonce":3769758484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6805","nonce":3769758484}]},"public_addr":"172.21.15.90:6801/3769758484","cluster_addr":"172.21.15.90:6803/3769758484","heartbeat_back_addr":"172.21.15.90:6807/3769758484","heartbeat_front_addr":"172.21.15.90:6805/3769758484","state":["exists","up"]},{"osd":2,"uuid":"6eb0f47b-e767-49c0-8d72-07f71b9c2e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6825","nonce":1025535744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6827","nonce":1025535744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6831","nonce":1025535744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6829","nonce":1025535744}]},"public_addr":"172.21.15.90:6825/1025535744","cluster_addr":"172.21.15.90:6827/1025535744","heartbeat_back_addr":"172.21.15.90:6831/1025535744","heartbeat_front_addr":"172.21.15.90:6829/1025535744","state":["exists","up"]},{"osd":3,"uuid":"64418862-beef-479c-be11-dfe0e515e09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6817","nonce":1515884437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6819","nonce":1515884437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6823","nonce":1515884437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6821","nonce":1515884437}]},"public_addr":"172.21.15.90:6817/1515884437","cluster_addr":"172.21.15.90:6819/1515884437","heartbeat_back_addr":"172.21.15.90:6823/1515884437","heartbeat_front_addr":"172.21.15.90:6821/1515884437","state":["exists","up"]},{"osd":4,"uuid":"a05b63f4-ec0a-426c-9d60-285e2680a897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6816","nonce":4278726553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6820","nonce":4278726553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6825","nonce":4278726553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6823","nonce":4278726553}]},"public_addr":"172.21.15.149:6816/4278726553","cluster_addr":"172.21.15.149:6820/4278726553","heartbeat_back_addr":"172.21.15.149:6825/4278726553","heartbeat_front_addr":"172.21.15.149:6823/4278726553","state":["exists","up"]},{"osd":5,"uuid":"3a1bab89-963c-4fe7-b14f-3080c5cf7830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6827","nonce":1341677333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6829","nonce":1341677333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6833","nonce":1341677333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6831","nonce":1341677333}]},"public_addr":"172.21.15.149:6827/1341677333","cluster_addr":"172.21.15.149:6829/1341677333","heartbeat_back_addr":"172.21.15.149:6833/1341677333","heartbeat_front_addr":"172.21.15.149:6831/1341677333","state":["exists","up"]},{"osd":6,"uuid":"bfcd1596-2688-4deb-be2e-55f305a5b4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6811","nonce":821196931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6813","nonce":821196931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6821","nonce":821196931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6817","nonce":821196931}]},"public_addr":"172.21.15.149:6811/821196931","cluster_addr":"172.21.15.149:6813/821196931","heartbeat_back_addr":"172.21.15.149:6821/821196931","heartbeat_front_addr":"172.21.15.149:6817/821196931","state":["exists","up"]},{"osd":7,"uuid":"58b19790-4006-4f07-966c-911b938cc1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6803","nonce":1657326880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6805","nonce":1657326880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6809","nonce":1657326880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6807","nonce":1657326880}]},"public_addr":"172.21.15.149:6803/1657326880","cluster_addr":"172.21.15.149:6805/1657326880","heartbeat_back_addr":"172.21.15.149:6809/1657326880","heartbeat_front_addr":"172.21.15.149:6807/1657326880","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.399701+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.051745+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.190159+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:23.240143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.446570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.259974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:21.990407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.459259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:14:52.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.503+0000 7f31da000640 1 -- 172.21.15.90:0/3676999215 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f31b0078b90 msgr2=0x7f31b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:52.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.503+0000 7f31da000640 1 --2- 172.21.15.90:0/3676999215 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f31b0078b90 0x7f31b007b0a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f31c4033000 tx=0x7f31c4038040 comp rx=0 tx=0).stop 2024-09-21T03:14:52.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.503+0000 7f31da000640 1 -- 172.21.15.90:0/3676999215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31d41ed020 msgr2=0x7f31d414c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:52.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.503+0000 7f31da000640 1 --2- 172.21.15.90:0/3676999215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31d41ed020 0x7f31d414c860 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f31d4070960 tx=0x7f31cc0019b0 comp rx=0 tx=0).stop 2024-09-21T03:14:52.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.503+0000 7f31da000640 1 -- 172.21.15.90:0/3676999215 shutdown_connections 2024-09-21T03:14:52.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.503+0000 7f31da000640 1 --2- 172.21.15.90:0/3676999215 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f31b0078b90 0x7f31b007b0a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:52.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.503+0000 7f31da000640 1 --2- 172.21.15.90:0/3676999215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31d41ed020 0x7f31d414c860 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:52.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.503+0000 7f31da000640 1 --2- 172.21.15.90:0/3676999215 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31d41ecc10 0x7f31d414c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:52.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.503+0000 7f31da000640 1 --2- 172.21.15.90:0/3676999215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31b8003a50 0x7f31d40c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:52.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.503+0000 7f31da000640 1 -- 172.21.15.90:0/3676999215 >> 172.21.15.90:0/3676999215 conn(0x7f31d40c8ba0 msgr2=0x7f31d40c6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:52.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.503+0000 7f31da000640 1 -- 172.21.15.90:0/3676999215 shutdown_connections 2024-09-21T03:14:52.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.503+0000 7f31da000640 1 -- 172.21.15.90:0/3676999215 wait complete. 2024-09-21T03:14:52.527 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T03:14:52.527 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:14:52.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.745+0000 7f7770c00640 1 -- 172.21.15.90:0/648804107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7750004db0 msgr2=0x7f7750005280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:52.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.745+0000 7f7770c00640 1 --2- 172.21.15.90:0/648804107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7750004db0 0x7f7750005280 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f776c06de40 tx=0x7f7750005830 comp rx=0 tx=0).stop 2024-09-21T03:14:52.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.745+0000 7f776a800640 1 -- 172.21.15.90:0/648804107 reap_dead start 2024-09-21T03:14:52.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.745+0000 7f7770c00640 1 -- 172.21.15.90:0/648804107 shutdown_connections 2024-09-21T03:14:52.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.745+0000 7f7770c00640 1 -- 172.21.15.90:0/648804107 >> 172.21.15.90:0/648804107 conn(0x7f776c0c8ba0 msgr2=0x7f776c06cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:52.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.745+0000 7f7770c00640 1 -- 172.21.15.90:0/648804107 shutdown_connections 2024-09-21T03:14:52.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.745+0000 7f7770c00640 1 -- 172.21.15.90:0/648804107 wait complete. 2024-09-21T03:14:52.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.747+0000 7f7770c00640 1 Processor -- start 2024-09-21T03:14:52.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.747+0000 7f7770c00640 1 -- start start 2024-09-21T03:14:52.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.749+0000 7f7770c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7750004db0 0x7f776c0c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:52.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.749+0000 7f7770c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f776c159420 0x7f776c073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:52.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.749+0000 7f7770c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f776c0736c0 0x7f776c14b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:52.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.749+0000 7f7770c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f776c06f720 con 0x7f7750004db0 2024-09-21T03:14:52.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.749+0000 7f7770c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f776c0ad720 con 0x7f776c159420 2024-09-21T03:14:52.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.749+0000 7f7770c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f776c153ab0 con 0x7f776c0736c0 2024-09-21T03:14:52.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.749+0000 7f7769e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7750004db0 0x7f776c0c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:52.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.749+0000 7f7769e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7750004db0 0x7f776c0c2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49894/0 (socket says 172.21.15.90:49894) 2024-09-21T03:14:52.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.749+0000 7f7769e00640 1 -- 172.21.15.90:0/1048673450 learned_addr learned my addr 172.21.15.90:0/1048673450 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:52.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.749+0000 7f776a800640 1 --2- 172.21.15.90:0/1048673450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f776c0736c0 0x7f776c14b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:52.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.749+0000 7f7769400640 1 --2- 172.21.15.90:0/1048673450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f776c159420 0x7f776c073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:52.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.749+0000 7f7769e00640 1 -- 172.21.15.90:0/1048673450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f776c0736c0 msgr2=0x7f776c14b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:52.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.749+0000 7f7769e00640 1 --2- 172.21.15.90:0/1048673450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f776c0736c0 0x7f776c14b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:52.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.749+0000 7f7769e00640 1 -- 172.21.15.90:0/1048673450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f776c159420 msgr2=0x7f776c073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:52.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.749+0000 7f7769e00640 1 --2- 172.21.15.90:0/1048673450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f776c159420 0x7f776c073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:52.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.749+0000 7f7769e00640 1 -- 172.21.15.90:0/1048673450 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776c0729a0 con 0x7f7750004db0 2024-09-21T03:14:52.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.749+0000 7f776a800640 1 --2- 172.21.15.90:0/1048673450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f776c0736c0 0x7f776c14b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:14:52.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.749+0000 7f7769400640 1 --2- 172.21.15.90:0/1048673450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f776c159420 0x7f776c073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:14:52.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.749+0000 7f7769e00640 1 --2- 172.21.15.90:0/1048673450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7750004db0 0x7f776c0c2070 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f775c011b10 tx=0x7f775c009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:52.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.750+0000 7f7762000640 1 -- 172.21.15.90:0/1048673450 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c01e070 con 0x7f7750004db0 2024-09-21T03:14:52.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.750+0000 7f7762000640 1 -- 172.21.15.90:0/1048673450 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f775c004050 con 0x7f7750004db0 2024-09-21T03:14:52.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.750+0000 7f7770c00640 1 -- 172.21.15.90:0/1048673450 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f776c0c2d50 con 0x7f7750004db0 2024-09-21T03:14:52.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.750+0000 7f7762000640 1 -- 172.21.15.90:0/1048673450 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c00fea0 con 0x7f7750004db0 2024-09-21T03:14:52.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.750+0000 7f7770c00640 1 -- 172.21.15.90:0/1048673450 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f776c073be0 con 0x7f7750004db0 2024-09-21T03:14:52.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.751+0000 7f7770c00640 1 -- 172.21.15.90:0/1048673450 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f776c073e40 con 0x7f7750004db0 2024-09-21T03:14:52.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.752+0000 7f7762000640 1 -- 172.21.15.90:0/1048673450 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f775c021070 con 0x7f7750004db0 2024-09-21T03:14:52.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.753+0000 7f7762000640 1 --2- 172.21.15.90:0/1048673450 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f774c078bc0 0x7f774c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:52.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.753+0000 7f7762000640 1 -- 172.21.15.90:0/1048673450 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f775c09ba80 con 0x7f7750004db0 2024-09-21T03:14:52.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.754+0000 7f7769400640 1 --2- 172.21.15.90:0/1048673450 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f774c078bc0 0x7f774c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:52.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.754+0000 7f7769400640 1 --2- 172.21.15.90:0/1048673450 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f774c078bc0 0x7f774c07b0d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f776c153710 tx=0x7f7758006b10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:52.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.757+0000 7f7762000640 1 -- 172.21.15.90:0/1048673450 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f775c063690 con 0x7f7750004db0 2024-09-21T03:14:52.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.942+0000 7f7770c00640 1 -- 172.21.15.90:0/1048673450 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f776c0c2b00 con 0x7f774c078bc0 2024-09-21T03:14:52.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.953+0000 7f7762000640 1 -- 172.21.15.90:0/1048673450 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490408 (secure 0 0 0) 0x7f776c0c2b00 con 0x7f774c078bc0 2024-09-21T03:14:52.960 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:52.963 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-21T03:14:52.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.958+0000 7f7770c00640 1 -- 172.21.15.90:0/1048673450 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f774c078bc0 msgr2=0x7f774c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:52.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.958+0000 7f7770c00640 1 --2- 172.21.15.90:0/1048673450 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f774c078bc0 0x7f774c07b0d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f776c153710 tx=0x7f7758006b10 comp rx=0 tx=0).stop 2024-09-21T03:14:52.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.958+0000 7f7770c00640 1 -- 172.21.15.90:0/1048673450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7750004db0 msgr2=0x7f776c0c2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:52.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.958+0000 7f7770c00640 1 --2- 172.21.15.90:0/1048673450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7750004db0 0x7f776c0c2070 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f775c011b10 tx=0x7f775c009e90 comp rx=0 tx=0).stop 2024-09-21T03:14:52.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.958+0000 7f7770c00640 1 -- 172.21.15.90:0/1048673450 shutdown_connections 2024-09-21T03:14:52.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.958+0000 7f7770c00640 1 --2- 172.21.15.90:0/1048673450 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f774c078bc0 0x7f774c07b0d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:52.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.958+0000 7f7770c00640 1 --2- 172.21.15.90:0/1048673450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f776c0736c0 0x7f776c14b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:52.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.958+0000 7f7770c00640 1 --2- 172.21.15.90:0/1048673450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f776c159420 0x7f776c073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:52.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.958+0000 7f7770c00640 1 --2- 172.21.15.90:0/1048673450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7750004db0 0x7f776c0c2070 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:52.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.958+0000 7f7770c00640 1 -- 172.21.15.90:0/1048673450 >> 172.21.15.90:0/1048673450 conn(0x7f776c0c8ba0 msgr2=0x7f776c14f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:52.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.959+0000 7f7770c00640 1 -- 172.21.15.90:0/1048673450 shutdown_connections 2024-09-21T03:14:52.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:52.959+0000 7f7770c00640 1 -- 172.21.15.90:0/1048673450 wait complete. 2024-09-21T03:14:52.982 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-21T03:14:52.476833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":191,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":376,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219552,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755168,"statfs":{"total":773094113280,"available":772869292032,"internally_reserved":0,"allocated":3383296,"data_stored":1994552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002105"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.576924+0000","last_change":"2024-09-21T03:14:47.552762+0000","last_active":"2024-09-21T03:14:48.576924+0000","last_peered":"2024-09-21T03:14:48.576924+0000","last_clean":"2024-09-21T03:14:48.576924+0000","last_became_active":"2024-09-21T03:14:47.551883+0000","last_became_peered":"2024-09-21T03:14:47.551883+0000","last_unstale":"2024-09-21T03:14:48.576924+0000","last_undegraded":"2024-09-21T03:14:48.576924+0000","last_fullsized":"2024-09-21T03:14:48.576924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:51.935797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578270+0000","last_change":"2024-09-21T03:14:37.471004+0000","last_active":"2024-09-21T03:14:48.578270+0000","last_peered":"2024-09-21T03:14:48.578270+0000","last_clean":"2024-09-21T03:14:48.578270+0000","last_became_active":"2024-09-21T03:14:37.470563+0000","last_became_peered":"2024-09-21T03:14:37.470563+0000","last_unstale":"2024-09-21T03:14:48.578270+0000","last_undegraded":"2024-09-21T03:14:48.578270+0000","last_fullsized":"2024-09-21T03:14:48.578270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.422826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558700+0000","last_change":"2024-09-21T03:14:38.496252+0000","last_active":"2024-09-21T03:14:48.558700+0000","last_peered":"2024-09-21T03:14:48.558700+0000","last_clean":"2024-09-21T03:14:48.558700+0000","last_became_active":"2024-09-21T03:14:38.488292+0000","last_became_peered":"2024-09-21T03:14:38.488292+0000","last_unstale":"2024-09-21T03:14:48.558700+0000","last_undegraded":"2024-09-21T03:14:48.558700+0000","last_fullsized":"2024-09-21T03:14:48.558700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:57.409792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566258+0000","last_change":"2024-09-21T03:14:46.549877+0000","last_active":"2024-09-21T03:14:48.566258+0000","last_peered":"2024-09-21T03:14:48.566258+0000","last_clean":"2024-09-21T03:14:48.566258+0000","last_became_active":"2024-09-21T03:14:46.549536+0000","last_became_peered":"2024-09-21T03:14:46.549536+0000","last_unstale":"2024-09-21T03:14:48.566258+0000","last_undegraded":"2024-09-21T03:14:48.566258+0000","last_fullsized":"2024-09-21T03:14:48.566258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:57.491042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577064+0000","last_change":"2024-09-21T03:14:47.560303+0000","last_active":"2024-09-21T03:14:48.577064+0000","last_peered":"2024-09-21T03:14:48.577064+0000","last_clean":"2024-09-21T03:14:48.577064+0000","last_became_active":"2024-09-21T03:14:47.559659+0000","last_became_peered":"2024-09-21T03:14:47.559659+0000","last_unstale":"2024-09-21T03:14:48.577064+0000","last_undegraded":"2024-09-21T03:14:48.577064+0000","last_fullsized":"2024-09-21T03:14:48.577064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:49.328036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558972+0000","last_change":"2024-09-21T03:14:37.467448+0000","last_active":"2024-09-21T03:14:48.558972+0000","last_peered":"2024-09-21T03:14:48.558972+0000","last_clean":"2024-09-21T03:14:48.558972+0000","last_became_active":"2024-09-21T03:14:37.467146+0000","last_became_peered":"2024-09-21T03:14:37.467146+0000","last_unstale":"2024-09-21T03:14:48.558972+0000","last_undegraded":"2024-09-21T03:14:48.558972+0000","last_fullsized":"2024-09-21T03:14:48.558972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:53.475083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558357+0000","last_change":"2024-09-21T03:14:38.486401+0000","last_active":"2024-09-21T03:14:48.558357+0000","last_peered":"2024-09-21T03:14:48.558357+0000","last_clean":"2024-09-21T03:14:48.558357+0000","last_became_active":"2024-09-21T03:14:38.486090+0000","last_became_peered":"2024-09-21T03:14:38.486090+0000","last_unstale":"2024-09-21T03:14:48.558357+0000","last_undegraded":"2024-09-21T03:14:48.558357+0000","last_fullsized":"2024-09-21T03:14:48.558357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:44.085100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556977+0000","last_change":"2024-09-21T03:14:46.541705+0000","last_active":"2024-09-21T03:14:48.556977+0000","last_peered":"2024-09-21T03:14:48.556977+0000","last_clean":"2024-09-21T03:14:48.556977+0000","last_became_active":"2024-09-21T03:14:46.541357+0000","last_became_peered":"2024-09-21T03:14:46.541357+0000","last_unstale":"2024-09-21T03:14:48.556977+0000","last_undegraded":"2024-09-21T03:14:48.556977+0000","last_fullsized":"2024-09-21T03:14:48.556977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:31.082059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577964+0000","last_change":"2024-09-21T03:14:47.556183+0000","last_active":"2024-09-21T03:14:48.577964+0000","last_peered":"2024-09-21T03:14:48.577964+0000","last_clean":"2024-09-21T03:14:48.577964+0000","last_became_active":"2024-09-21T03:14:47.553312+0000","last_became_peered":"2024-09-21T03:14:47.553312+0000","last_unstale":"2024-09-21T03:14:48.577964+0000","last_undegraded":"2024-09-21T03:14:48.577964+0000","last_fullsized":"2024-09-21T03:14:48.577964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:07.314491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579685+0000","last_change":"2024-09-21T03:14:37.478711+0000","last_active":"2024-09-21T03:14:48.579685+0000","last_peered":"2024-09-21T03:14:48.579685+0000","last_clean":"2024-09-21T03:14:48.579685+0000","last_became_active":"2024-09-21T03:14:37.477910+0000","last_became_peered":"2024-09-21T03:14:37.477910+0000","last_unstale":"2024-09-21T03:14:48.579685+0000","last_undegraded":"2024-09-21T03:14:48.579685+0000","last_fullsized":"2024-09-21T03:14:48.579685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:40.166966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578888+0000","last_change":"2024-09-21T03:14:38.472992+0000","last_active":"2024-09-21T03:14:48.578888+0000","last_peered":"2024-09-21T03:14:48.578888+0000","last_clean":"2024-09-21T03:14:48.578888+0000","last_became_active":"2024-09-21T03:14:38.472426+0000","last_became_peered":"2024-09-21T03:14:38.472426+0000","last_unstale":"2024-09-21T03:14:48.578888+0000","last_undegraded":"2024-09-21T03:14:48.578888+0000","last_fullsized":"2024-09-21T03:14:48.578888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:36.825612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556418+0000","last_change":"2024-09-21T03:14:46.526996+0000","last_active":"2024-09-21T03:14:48.556418+0000","last_peered":"2024-09-21T03:14:48.556418+0000","last_clean":"2024-09-21T03:14:48.556418+0000","last_became_active":"2024-09-21T03:14:46.525587+0000","last_became_peered":"2024-09-21T03:14:46.525587+0000","last_unstale":"2024-09-21T03:14:48.556418+0000","last_undegraded":"2024-09-21T03:14:48.556418+0000","last_fullsized":"2024-09-21T03:14:48.556418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:56.977126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556369+0000","last_change":"2024-09-21T03:14:47.554143+0000","last_active":"2024-09-21T03:14:48.556369+0000","last_peered":"2024-09-21T03:14:48.556369+0000","last_clean":"2024-09-21T03:14:48.556369+0000","last_became_active":"2024-09-21T03:14:47.553802+0000","last_became_peered":"2024-09-21T03:14:47.553802+0000","last_unstale":"2024-09-21T03:14:48.556369+0000","last_undegraded":"2024-09-21T03:14:48.556369+0000","last_fullsized":"2024-09-21T03:14:48.556369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:37.963442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578752+0000","last_change":"2024-09-21T03:14:37.479842+0000","last_active":"2024-09-21T03:14:48.578752+0000","last_peered":"2024-09-21T03:14:48.578752+0000","last_clean":"2024-09-21T03:14:48.578752+0000","last_became_active":"2024-09-21T03:14:37.478893+0000","last_became_peered":"2024-09-21T03:14:37.478893+0000","last_unstale":"2024-09-21T03:14:48.578752+0000","last_undegraded":"2024-09-21T03:14:48.578752+0000","last_fullsized":"2024-09-21T03:14:48.578752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:27.916133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581255+0000","last_change":"2024-09-21T03:14:38.468756+0000","last_active":"2024-09-21T03:14:48.581255+0000","last_peered":"2024-09-21T03:14:48.581255+0000","last_clean":"2024-09-21T03:14:48.581255+0000","last_became_active":"2024-09-21T03:14:38.467570+0000","last_became_peered":"2024-09-21T03:14:38.467570+0000","last_unstale":"2024-09-21T03:14:48.581255+0000","last_undegraded":"2024-09-21T03:14:48.581255+0000","last_fullsized":"2024-09-21T03:14:48.581255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:24.784157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556546+0000","last_change":"2024-09-21T03:14:46.529932+0000","last_active":"2024-09-21T03:14:48.556546+0000","last_peered":"2024-09-21T03:14:48.556546+0000","last_clean":"2024-09-21T03:14:48.556546+0000","last_became_active":"2024-09-21T03:14:46.529629+0000","last_became_peered":"2024-09-21T03:14:46.529629+0000","last_unstale":"2024-09-21T03:14:48.556546+0000","last_undegraded":"2024-09-21T03:14:48.556546+0000","last_fullsized":"2024-09-21T03:14:48.556546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:39.808494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558854+0000","last_change":"2024-09-21T03:14:47.547724+0000","last_active":"2024-09-21T03:14:48.558854+0000","last_peered":"2024-09-21T03:14:48.558854+0000","last_clean":"2024-09-21T03:14:48.558854+0000","last_became_active":"2024-09-21T03:14:47.546770+0000","last_became_peered":"2024-09-21T03:14:47.546770+0000","last_unstale":"2024-09-21T03:14:48.558854+0000","last_undegraded":"2024-09-21T03:14:48.558854+0000","last_fullsized":"2024-09-21T03:14:48.558854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:31.476710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580313+0000","last_change":"2024-09-21T03:14:38.476747+0000","last_active":"2024-09-21T03:14:48.580313+0000","last_peered":"2024-09-21T03:14:48.580313+0000","last_clean":"2024-09-21T03:14:48.580313+0000","last_became_active":"2024-09-21T03:14:38.476386+0000","last_became_peered":"2024-09-21T03:14:38.476386+0000","last_unstale":"2024-09-21T03:14:48.580313+0000","last_undegraded":"2024-09-21T03:14:48.580313+0000","last_fullsized":"2024-09-21T03:14:48.580313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:28.751991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580177+0000","last_change":"2024-09-21T03:14:37.463164+0000","last_active":"2024-09-21T03:14:48.580177+0000","last_peered":"2024-09-21T03:14:48.580177+0000","last_clean":"2024-09-21T03:14:48.580177+0000","last_became_active":"2024-09-21T03:14:37.461409+0000","last_became_peered":"2024-09-21T03:14:37.461409+0000","last_unstale":"2024-09-21T03:14:48.580177+0000","last_undegraded":"2024-09-21T03:14:48.580177+0000","last_fullsized":"2024-09-21T03:14:48.580177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:51.126291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581202+0000","last_change":"2024-09-21T03:14:46.538480+0000","last_active":"2024-09-21T03:14:48.581202+0000","last_peered":"2024-09-21T03:14:48.581202+0000","last_clean":"2024-09-21T03:14:48.581202+0000","last_became_active":"2024-09-21T03:14:46.537493+0000","last_became_peered":"2024-09-21T03:14:46.537493+0000","last_unstale":"2024-09-21T03:14:48.581202+0000","last_undegraded":"2024-09-21T03:14:48.581202+0000","last_fullsized":"2024-09-21T03:14:48.581202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:52.769190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566771+0000","last_change":"2024-09-21T03:14:47.580512+0000","last_active":"2024-09-21T03:14:48.566771+0000","last_peered":"2024-09-21T03:14:48.566771+0000","last_clean":"2024-09-21T03:14:48.566771+0000","last_became_active":"2024-09-21T03:14:47.580210+0000","last_became_peered":"2024-09-21T03:14:47.580210+0000","last_unstale":"2024-09-21T03:14:48.566771+0000","last_undegraded":"2024-09-21T03:14:48.566771+0000","last_fullsized":"2024-09-21T03:14:48.566771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:20.192190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566435+0000","last_change":"2024-09-21T03:14:38.494021+0000","last_active":"2024-09-21T03:14:48.566435+0000","last_peered":"2024-09-21T03:14:48.566435+0000","last_clean":"2024-09-21T03:14:48.566435+0000","last_became_active":"2024-09-21T03:14:38.486802+0000","last_became_peered":"2024-09-21T03:14:38.486802+0000","last_unstale":"2024-09-21T03:14:48.566435+0000","last_undegraded":"2024-09-21T03:14:48.566435+0000","last_fullsized":"2024-09-21T03:14:48.566435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:31.817505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558034+0000","last_change":"2024-09-21T03:14:37.465907+0000","last_active":"2024-09-21T03:14:48.558034+0000","last_peered":"2024-09-21T03:14:48.558034+0000","last_clean":"2024-09-21T03:14:48.558034+0000","last_became_active":"2024-09-21T03:14:37.465551+0000","last_became_peered":"2024-09-21T03:14:37.465551+0000","last_unstale":"2024-09-21T03:14:48.558034+0000","last_undegraded":"2024-09-21T03:14:48.558034+0000","last_fullsized":"2024-09-21T03:14:48.558034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:10.599687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578561+0000","last_change":"2024-09-21T03:14:46.546737+0000","last_active":"2024-09-21T03:14:48.578561+0000","last_peered":"2024-09-21T03:14:48.578561+0000","last_clean":"2024-09-21T03:14:48.578561+0000","last_became_active":"2024-09-21T03:14:46.546312+0000","last_became_peered":"2024-09-21T03:14:46.546312+0000","last_unstale":"2024-09-21T03:14:48.578561+0000","last_undegraded":"2024-09-21T03:14:48.578561+0000","last_fullsized":"2024-09-21T03:14:48.578561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:03.939168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580853+0000","last_change":"2024-09-21T03:14:47.558742+0000","last_active":"2024-09-21T03:14:48.580853+0000","last_peered":"2024-09-21T03:14:48.580853+0000","last_clean":"2024-09-21T03:14:48.580853+0000","last_became_active":"2024-09-21T03:14:47.558431+0000","last_became_peered":"2024-09-21T03:14:47.558431+0000","last_unstale":"2024-09-21T03:14:48.580853+0000","last_undegraded":"2024-09-21T03:14:48.580853+0000","last_fullsized":"2024-09-21T03:14:48.580853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:32.053674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.576948+0000","last_change":"2024-09-21T03:14:38.479370+0000","last_active":"2024-09-21T03:14:48.576948+0000","last_peered":"2024-09-21T03:14:48.576948+0000","last_clean":"2024-09-21T03:14:48.576948+0000","last_became_active":"2024-09-21T03:14:38.476976+0000","last_became_peered":"2024-09-21T03:14:38.476976+0000","last_unstale":"2024-09-21T03:14:48.576948+0000","last_undegraded":"2024-09-21T03:14:48.576948+0000","last_fullsized":"2024-09-21T03:14:48.576948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:14.695819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577301+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:14:48.577301+0000","last_peered":"2024-09-21T03:14:48.577301+0000","last_clean":"2024-09-21T03:14:48.577301+0000","last_became_active":"2024-09-21T03:14:37.478840+0000","last_became_peered":"2024-09-21T03:14:37.478840+0000","last_unstale":"2024-09-21T03:14:48.577301+0000","last_undegraded":"2024-09-21T03:14:48.577301+0000","last_fullsized":"2024-09-21T03:14:48.577301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:00.964354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566781+0000","last_change":"2024-09-21T03:14:46.543085+0000","last_active":"2024-09-21T03:14:48.566781+0000","last_peered":"2024-09-21T03:14:48.566781+0000","last_clean":"2024-09-21T03:14:48.566781+0000","last_became_active":"2024-09-21T03:14:46.542721+0000","last_became_peered":"2024-09-21T03:14:46.542721+0000","last_unstale":"2024-09-21T03:14:48.566781+0000","last_undegraded":"2024-09-21T03:14:48.566781+0000","last_fullsized":"2024-09-21T03:14:48.566781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:05.590871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579821+0000","last_change":"2024-09-21T03:14:47.566806+0000","last_active":"2024-09-21T03:14:48.579821+0000","last_peered":"2024-09-21T03:14:48.579821+0000","last_clean":"2024-09-21T03:14:48.579821+0000","last_became_active":"2024-09-21T03:14:47.566634+0000","last_became_peered":"2024-09-21T03:14:47.566634+0000","last_unstale":"2024-09-21T03:14:48.579821+0000","last_undegraded":"2024-09-21T03:14:48.579821+0000","last_fullsized":"2024-09-21T03:14:48.579821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:03.997294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579153+0000","last_change":"2024-09-21T03:14:38.482658+0000","last_active":"2024-09-21T03:14:48.579153+0000","last_peered":"2024-09-21T03:14:48.579153+0000","last_clean":"2024-09-21T03:14:48.579153+0000","last_became_active":"2024-09-21T03:14:38.482369+0000","last_became_peered":"2024-09-21T03:14:38.482369+0000","last_unstale":"2024-09-21T03:14:48.579153+0000","last_undegraded":"2024-09-21T03:14:48.579153+0000","last_fullsized":"2024-09-21T03:14:48.579153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:36.682534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577485+0000","last_change":"2024-09-21T03:14:37.472962+0000","last_active":"2024-09-21T03:14:48.577485+0000","last_peered":"2024-09-21T03:14:48.577485+0000","last_clean":"2024-09-21T03:14:48.577485+0000","last_became_active":"2024-09-21T03:14:37.472271+0000","last_became_peered":"2024-09-21T03:14:37.472271+0000","last_unstale":"2024-09-21T03:14:48.577485+0000","last_undegraded":"2024-09-21T03:14:48.577485+0000","last_fullsized":"2024-09-21T03:14:48.577485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:54.952223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557189+0000","last_change":"2024-09-21T03:14:46.537137+0000","last_active":"2024-09-21T03:14:48.557189+0000","last_peered":"2024-09-21T03:14:48.557189+0000","last_clean":"2024-09-21T03:14:48.557189+0000","last_became_active":"2024-09-21T03:14:46.536791+0000","last_became_peered":"2024-09-21T03:14:46.536791+0000","last_unstale":"2024-09-21T03:14:48.557189+0000","last_undegraded":"2024-09-21T03:14:48.557189+0000","last_fullsized":"2024-09-21T03:14:48.557189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:43.186807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577598+0000","last_change":"2024-09-21T03:14:47.555605+0000","last_active":"2024-09-21T03:14:48.577598+0000","last_peered":"2024-09-21T03:14:48.577598+0000","last_clean":"2024-09-21T03:14:48.577598+0000","last_became_active":"2024-09-21T03:14:47.555329+0000","last_became_peered":"2024-09-21T03:14:47.555329+0000","last_unstale":"2024-09-21T03:14:48.577598+0000","last_undegraded":"2024-09-21T03:14:48.577598+0000","last_fullsized":"2024-09-21T03:14:48.577598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:24.271656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577873+0000","last_change":"2024-09-21T03:14:38.479133+0000","last_active":"2024-09-21T03:14:48.577873+0000","last_peered":"2024-09-21T03:14:48.577873+0000","last_clean":"2024-09-21T03:14:48.577873+0000","last_became_active":"2024-09-21T03:14:38.478077+0000","last_became_peered":"2024-09-21T03:14:38.478077+0000","last_unstale":"2024-09-21T03:14:48.577873+0000","last_undegraded":"2024-09-21T03:14:48.577873+0000","last_fullsized":"2024-09-21T03:14:48.577873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:56.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581077+0000","last_change":"2024-09-21T03:14:37.480508+0000","last_active":"2024-09-21T03:14:48.581077+0000","last_peered":"2024-09-21T03:14:48.581077+0000","last_clean":"2024-09-21T03:14:48.581077+0000","last_became_active":"2024-09-21T03:14:37.480218+0000","last_became_peered":"2024-09-21T03:14:37.480218+0000","last_unstale":"2024-09-21T03:14:48.581077+0000","last_undegraded":"2024-09-21T03:14:48.581077+0000","last_fullsized":"2024-09-21T03:14:48.581077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:01.851380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556442+0000","last_change":"2024-09-21T03:14:46.531615+0000","last_active":"2024-09-21T03:14:48.556442+0000","last_peered":"2024-09-21T03:14:48.556442+0000","last_clean":"2024-09-21T03:14:48.556442+0000","last_became_active":"2024-09-21T03:14:46.531289+0000","last_became_peered":"2024-09-21T03:14:46.531289+0000","last_unstale":"2024-09-21T03:14:48.556442+0000","last_undegraded":"2024-09-21T03:14:48.556442+0000","last_fullsized":"2024-09-21T03:14:48.556442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:10.145489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579006+0000","last_change":"2024-09-21T03:14:47.552705+0000","last_active":"2024-09-21T03:14:48.579006+0000","last_peered":"2024-09-21T03:14:48.579006+0000","last_clean":"2024-09-21T03:14:48.579006+0000","last_became_active":"2024-09-21T03:14:47.552367+0000","last_became_peered":"2024-09-21T03:14:47.552367+0000","last_unstale":"2024-09-21T03:14:48.579006+0000","last_undegraded":"2024-09-21T03:14:48.579006+0000","last_fullsized":"2024-09-21T03:14:48.579006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:45.379581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577998+0000","last_change":"2024-09-21T03:14:38.475318+0000","last_active":"2024-09-21T03:14:48.577998+0000","last_peered":"2024-09-21T03:14:48.577998+0000","last_clean":"2024-09-21T03:14:48.577998+0000","last_became_active":"2024-09-21T03:14:38.474978+0000","last_became_peered":"2024-09-21T03:14:38.474978+0000","last_unstale":"2024-09-21T03:14:48.577998+0000","last_undegraded":"2024-09-21T03:14:48.577998+0000","last_fullsized":"2024-09-21T03:14:48.577998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:38.209624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578286+0000","last_change":"2024-09-21T03:14:37.479651+0000","last_active":"2024-09-21T03:14:48.578286+0000","last_peered":"2024-09-21T03:14:48.578286+0000","last_clean":"2024-09-21T03:14:48.578286+0000","last_became_active":"2024-09-21T03:14:37.478833+0000","last_became_peered":"2024-09-21T03:14:37.478833+0000","last_unstale":"2024-09-21T03:14:48.578286+0000","last_undegraded":"2024-09-21T03:14:48.578286+0000","last_fullsized":"2024-09-21T03:14:48.578286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:48.578637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.576901+0000","last_change":"2024-09-21T03:14:46.536054+0000","last_active":"2024-09-21T03:14:48.576901+0000","last_peered":"2024-09-21T03:14:48.576901+0000","last_clean":"2024-09-21T03:14:48.576901+0000","last_became_active":"2024-09-21T03:14:46.535569+0000","last_became_peered":"2024-09-21T03:14:46.535569+0000","last_unstale":"2024-09-21T03:14:48.576901+0000","last_undegraded":"2024-09-21T03:14:48.576901+0000","last_fullsized":"2024-09-21T03:14:48.576901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:04.556059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577758+0000","last_change":"2024-09-21T03:14:47.571889+0000","last_active":"2024-09-21T03:14:48.577758+0000","last_peered":"2024-09-21T03:14:48.577758+0000","last_clean":"2024-09-21T03:14:48.577758+0000","last_became_active":"2024-09-21T03:14:47.571620+0000","last_became_peered":"2024-09-21T03:14:47.571620+0000","last_unstale":"2024-09-21T03:14:48.577758+0000","last_undegraded":"2024-09-21T03:14:48.577758+0000","last_fullsized":"2024-09-21T03:14:48.577758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:23.103973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558656+0000","last_change":"2024-09-21T03:14:38.493350+0000","last_active":"2024-09-21T03:14:48.558656+0000","last_peered":"2024-09-21T03:14:48.558656+0000","last_clean":"2024-09-21T03:14:48.558656+0000","last_became_active":"2024-09-21T03:14:38.492830+0000","last_became_peered":"2024-09-21T03:14:38.492830+0000","last_unstale":"2024-09-21T03:14:48.558656+0000","last_undegraded":"2024-09-21T03:14:48.558656+0000","last_fullsized":"2024-09-21T03:14:48.558656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:19.946319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581436+0000","last_change":"2024-09-21T03:14:37.473484+0000","last_active":"2024-09-21T03:14:48.581436+0000","last_peered":"2024-09-21T03:14:48.581436+0000","last_clean":"2024-09-21T03:14:48.581436+0000","last_became_active":"2024-09-21T03:14:37.473218+0000","last_became_peered":"2024-09-21T03:14:37.473218+0000","last_unstale":"2024-09-21T03:14:48.581436+0000","last_undegraded":"2024-09-21T03:14:48.581436+0000","last_fullsized":"2024-09-21T03:14:48.581436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:49.006579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558777+0000","last_change":"2024-09-21T03:14:46.548858+0000","last_active":"2024-09-21T03:14:48.558777+0000","last_peered":"2024-09-21T03:14:48.558777+0000","last_clean":"2024-09-21T03:14:48.558777+0000","last_became_active":"2024-09-21T03:14:46.548166+0000","last_became_peered":"2024-09-21T03:14:46.548166+0000","last_unstale":"2024-09-21T03:14:48.558777+0000","last_undegraded":"2024-09-21T03:14:48.558777+0000","last_fullsized":"2024-09-21T03:14:48.558777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:41.470072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577431+0000","last_change":"2024-09-21T03:14:47.555787+0000","last_active":"2024-09-21T03:14:48.577431+0000","last_peered":"2024-09-21T03:14:48.577431+0000","last_clean":"2024-09-21T03:14:48.577431+0000","last_became_active":"2024-09-21T03:14:47.555420+0000","last_became_peered":"2024-09-21T03:14:47.555420+0000","last_unstale":"2024-09-21T03:14:48.577431+0000","last_undegraded":"2024-09-21T03:14:48.577431+0000","last_fullsized":"2024-09-21T03:14:48.577431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:45.769786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556963+0000","last_change":"2024-09-21T03:14:38.479657+0000","last_active":"2024-09-21T03:14:48.556963+0000","last_peered":"2024-09-21T03:14:48.556963+0000","last_clean":"2024-09-21T03:14:48.556963+0000","last_became_active":"2024-09-21T03:14:38.479439+0000","last_became_peered":"2024-09-21T03:14:38.479439+0000","last_unstale":"2024-09-21T03:14:48.556963+0000","last_undegraded":"2024-09-21T03:14:48.556963+0000","last_fullsized":"2024-09-21T03:14:48.556963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.107215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.559008+0000","last_change":"2024-09-21T03:14:37.469799+0000","last_active":"2024-09-21T03:14:48.559008+0000","last_peered":"2024-09-21T03:14:48.559008+0000","last_clean":"2024-09-21T03:14:48.559008+0000","last_became_active":"2024-09-21T03:14:37.469495+0000","last_became_peered":"2024-09-21T03:14:37.469495+0000","last_unstale":"2024-09-21T03:14:48.559008+0000","last_undegraded":"2024-09-21T03:14:48.559008+0000","last_fullsized":"2024-09-21T03:14:48.559008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:50.247050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557375+0000","last_change":"2024-09-21T03:14:46.544320+0000","last_active":"2024-09-21T03:14:48.557375+0000","last_peered":"2024-09-21T03:14:48.557375+0000","last_clean":"2024-09-21T03:14:48.557375+0000","last_became_active":"2024-09-21T03:14:46.544038+0000","last_became_peered":"2024-09-21T03:14:46.544038+0000","last_unstale":"2024-09-21T03:14:48.557375+0000","last_undegraded":"2024-09-21T03:14:48.557375+0000","last_fullsized":"2024-09-21T03:14:48.557375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:57.457687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.567034+0000","last_change":"2024-09-21T03:14:47.579698+0000","last_active":"2024-09-21T03:14:48.567034+0000","last_peered":"2024-09-21T03:14:48.567034+0000","last_clean":"2024-09-21T03:14:48.567034+0000","last_became_active":"2024-09-21T03:14:47.579324+0000","last_became_peered":"2024-09-21T03:14:47.579324+0000","last_unstale":"2024-09-21T03:14:48.567034+0000","last_undegraded":"2024-09-21T03:14:48.567034+0000","last_fullsized":"2024-09-21T03:14:48.567034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:37.656859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578191+0000","last_change":"2024-09-21T03:14:38.476763+0000","last_active":"2024-09-21T03:14:48.578191+0000","last_peered":"2024-09-21T03:14:48.578191+0000","last_clean":"2024-09-21T03:14:48.578191+0000","last_became_active":"2024-09-21T03:14:38.474299+0000","last_became_peered":"2024-09-21T03:14:38.474299+0000","last_unstale":"2024-09-21T03:14:48.578191+0000","last_undegraded":"2024-09-21T03:14:48.578191+0000","last_fullsized":"2024-09-21T03:14:48.578191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:46.544930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580641+0000","last_change":"2024-09-21T03:14:37.466857+0000","last_active":"2024-09-21T03:14:48.580641+0000","last_peered":"2024-09-21T03:14:48.580641+0000","last_clean":"2024-09-21T03:14:48.580641+0000","last_became_active":"2024-09-21T03:14:37.466256+0000","last_became_peered":"2024-09-21T03:14:37.466256+0000","last_unstale":"2024-09-21T03:14:48.580641+0000","last_undegraded":"2024-09-21T03:14:48.580641+0000","last_fullsized":"2024-09-21T03:14:48.580641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:02.240461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558502+0000","last_change":"2024-09-21T03:14:46.537315+0000","last_active":"2024-09-21T03:14:48.558502+0000","last_peered":"2024-09-21T03:14:48.558502+0000","last_clean":"2024-09-21T03:14:48.558502+0000","last_became_active":"2024-09-21T03:14:46.536975+0000","last_became_peered":"2024-09-21T03:14:46.536975+0000","last_unstale":"2024-09-21T03:14:48.558502+0000","last_undegraded":"2024-09-21T03:14:48.558502+0000","last_fullsized":"2024-09-21T03:14:48.558502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:42.529591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566848+0000","last_change":"2024-09-21T03:14:47.573009+0000","last_active":"2024-09-21T03:14:48.566848+0000","last_peered":"2024-09-21T03:14:48.566848+0000","last_clean":"2024-09-21T03:14:48.566848+0000","last_became_active":"2024-09-21T03:14:47.572395+0000","last_became_peered":"2024-09-21T03:14:47.572395+0000","last_unstale":"2024-09-21T03:14:48.566848+0000","last_undegraded":"2024-09-21T03:14:48.566848+0000","last_fullsized":"2024-09-21T03:14:48.566848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:41.733447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556923+0000","last_change":"2024-09-21T03:14:38.481801+0000","last_active":"2024-09-21T03:14:48.556923+0000","last_peered":"2024-09-21T03:14:48.556923+0000","last_clean":"2024-09-21T03:14:48.556923+0000","last_became_active":"2024-09-21T03:14:38.481186+0000","last_became_peered":"2024-09-21T03:14:38.481186+0000","last_unstale":"2024-09-21T03:14:48.556923+0000","last_undegraded":"2024-09-21T03:14:48.556923+0000","last_fullsized":"2024-09-21T03:14:48.556923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:54.271470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566292+0000","last_change":"2024-09-21T03:14:37.474798+0000","last_active":"2024-09-21T03:14:48.566292+0000","last_peered":"2024-09-21T03:14:48.566292+0000","last_clean":"2024-09-21T03:14:48.566292+0000","last_became_active":"2024-09-21T03:14:37.473829+0000","last_became_peered":"2024-09-21T03:14:37.473829+0000","last_unstale":"2024-09-21T03:14:48.566292+0000","last_undegraded":"2024-09-21T03:14:48.566292+0000","last_fullsized":"2024-09-21T03:14:48.566292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:11.571814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558227+0000","last_change":"2024-09-21T03:14:46.542495+0000","last_active":"2024-09-21T03:14:48.558227+0000","last_peered":"2024-09-21T03:14:48.558227+0000","last_clean":"2024-09-21T03:14:48.558227+0000","last_became_active":"2024-09-21T03:14:46.542181+0000","last_became_peered":"2024-09-21T03:14:46.542181+0000","last_unstale":"2024-09-21T03:14:48.558227+0000","last_undegraded":"2024-09-21T03:14:48.558227+0000","last_fullsized":"2024-09-21T03:14:48.558227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:22.481477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580850+0000","last_change":"2024-09-21T03:14:47.569409+0000","last_active":"2024-09-21T03:14:48.580850+0000","last_peered":"2024-09-21T03:14:48.580850+0000","last_clean":"2024-09-21T03:14:48.580850+0000","last_became_active":"2024-09-21T03:14:47.569212+0000","last_became_peered":"2024-09-21T03:14:47.569212+0000","last_unstale":"2024-09-21T03:14:48.580850+0000","last_undegraded":"2024-09-21T03:14:48.580850+0000","last_fullsized":"2024-09-21T03:14:48.580850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.851943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557644+0000","last_change":"2024-09-21T03:14:38.480026+0000","last_active":"2024-09-21T03:14:48.557644+0000","last_peered":"2024-09-21T03:14:48.557644+0000","last_clean":"2024-09-21T03:14:48.557644+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:14:48.557644+0000","last_undegraded":"2024-09-21T03:14:48.557644+0000","last_fullsized":"2024-09-21T03:14:48.557644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:20.481816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578131+0000","last_change":"2024-09-21T03:14:37.464554+0000","last_active":"2024-09-21T03:14:48.578131+0000","last_peered":"2024-09-21T03:14:48.578131+0000","last_clean":"2024-09-21T03:14:48.578131+0000","last_became_active":"2024-09-21T03:14:37.464228+0000","last_became_peered":"2024-09-21T03:14:37.464228+0000","last_unstale":"2024-09-21T03:14:48.578131+0000","last_undegraded":"2024-09-21T03:14:48.578131+0000","last_fullsized":"2024-09-21T03:14:48.578131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:32.529512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558894+0000","last_change":"2024-09-21T03:14:46.538538+0000","last_active":"2024-09-21T03:14:48.558894+0000","last_peered":"2024-09-21T03:14:48.558894+0000","last_clean":"2024-09-21T03:14:48.558894+0000","last_became_active":"2024-09-21T03:14:46.537815+0000","last_became_peered":"2024-09-21T03:14:46.537815+0000","last_unstale":"2024-09-21T03:14:48.558894+0000","last_undegraded":"2024-09-21T03:14:48.558894+0000","last_fullsized":"2024-09-21T03:14:48.558894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:42.264439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578432+0000","last_change":"2024-09-21T03:14:47.558861+0000","last_active":"2024-09-21T03:14:48.578432+0000","last_peered":"2024-09-21T03:14:48.578432+0000","last_clean":"2024-09-21T03:14:48.578432+0000","last_became_active":"2024-09-21T03:14:47.557305+0000","last_became_peered":"2024-09-21T03:14:47.557305+0000","last_unstale":"2024-09-21T03:14:48.578432+0000","last_undegraded":"2024-09-21T03:14:48.578432+0000","last_fullsized":"2024-09-21T03:14:48.578432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:45.962367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577698+0000","last_change":"2024-09-21T03:14:38.479181+0000","last_active":"2024-09-21T03:14:48.577698+0000","last_peered":"2024-09-21T03:14:48.577698+0000","last_clean":"2024-09-21T03:14:48.577698+0000","last_became_active":"2024-09-21T03:14:38.478842+0000","last_became_peered":"2024-09-21T03:14:38.478842+0000","last_unstale":"2024-09-21T03:14:48.577698+0000","last_undegraded":"2024-09-21T03:14:48.577698+0000","last_fullsized":"2024-09-21T03:14:48.577698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:08.664381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580210+0000","last_change":"2024-09-21T03:14:37.463990+0000","last_active":"2024-09-21T03:14:48.580210+0000","last_peered":"2024-09-21T03:14:48.580210+0000","last_clean":"2024-09-21T03:14:48.580210+0000","last_became_active":"2024-09-21T03:14:37.463674+0000","last_became_peered":"2024-09-21T03:14:37.463674+0000","last_unstale":"2024-09-21T03:14:48.580210+0000","last_undegraded":"2024-09-21T03:14:48.580210+0000","last_fullsized":"2024-09-21T03:14:48.580210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:35.391985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577246+0000","last_change":"2024-09-21T03:14:26.342355+0000","last_active":"2024-09-21T03:14:48.577246+0000","last_peered":"2024-09-21T03:14:48.577246+0000","last_clean":"2024-09-21T03:14:48.577246+0000","last_became_active":"2024-09-21T03:14:26.341929+0000","last_became_peered":"2024-09-21T03:14:26.341929+0000","last_unstale":"2024-09-21T03:14:48.577246+0000","last_undegraded":"2024-09-21T03:14:48.577246+0000","last_fullsized":"2024-09-21T03:14:48.577246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_clean_scrub_stamp":"2024-09-21T03:14:25.329650+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:45.390822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581358+0000","last_change":"2024-09-21T03:14:46.538184+0000","last_active":"2024-09-21T03:14:48.581358+0000","last_peered":"2024-09-21T03:14:48.581358+0000","last_clean":"2024-09-21T03:14:48.581358+0000","last_became_active":"2024-09-21T03:14:46.536753+0000","last_became_peered":"2024-09-21T03:14:46.536753+0000","last_unstale":"2024-09-21T03:14:48.581358+0000","last_undegraded":"2024-09-21T03:14:48.581358+0000","last_fullsized":"2024-09-21T03:14:48.581358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:49.078638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558519+0000","last_change":"2024-09-21T03:14:47.552966+0000","last_active":"2024-09-21T03:14:48.558519+0000","last_peered":"2024-09-21T03:14:48.558519+0000","last_clean":"2024-09-21T03:14:48.558519+0000","last_became_active":"2024-09-21T03:14:47.552642+0000","last_became_peered":"2024-09-21T03:14:47.552642+0000","last_unstale":"2024-09-21T03:14:48.558519+0000","last_undegraded":"2024-09-21T03:14:48.558519+0000","last_fullsized":"2024-09-21T03:14:48.558519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:15.928026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581346+0000","last_change":"2024-09-21T03:14:38.478414+0000","last_active":"2024-09-21T03:14:48.581346+0000","last_peered":"2024-09-21T03:14:48.581346+0000","last_clean":"2024-09-21T03:14:48.581346+0000","last_became_active":"2024-09-21T03:14:38.478116+0000","last_became_peered":"2024-09-21T03:14:38.478116+0000","last_unstale":"2024-09-21T03:14:48.581346+0000","last_undegraded":"2024-09-21T03:14:48.581346+0000","last_fullsized":"2024-09-21T03:14:48.581346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:29.618008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558850+0000","last_change":"2024-09-21T03:14:37.479578+0000","last_active":"2024-09-21T03:14:48.558850+0000","last_peered":"2024-09-21T03:14:48.558850+0000","last_clean":"2024-09-21T03:14:48.558850+0000","last_became_active":"2024-09-21T03:14:37.479284+0000","last_became_peered":"2024-09-21T03:14:37.479284+0000","last_unstale":"2024-09-21T03:14:48.558850+0000","last_undegraded":"2024-09-21T03:14:48.558850+0000","last_fullsized":"2024-09-21T03:14:48.558850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:15.732230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556655+0000","last_change":"2024-09-21T03:14:46.531536+0000","last_active":"2024-09-21T03:14:48.556655+0000","last_peered":"2024-09-21T03:14:48.556655+0000","last_clean":"2024-09-21T03:14:48.556655+0000","last_became_active":"2024-09-21T03:14:46.531069+0000","last_became_peered":"2024-09-21T03:14:46.531069+0000","last_unstale":"2024-09-21T03:14:48.556655+0000","last_undegraded":"2024-09-21T03:14:48.556655+0000","last_fullsized":"2024-09-21T03:14:48.556655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:14.050618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557238+0000","last_change":"2024-09-21T03:14:47.553039+0000","last_active":"2024-09-21T03:14:48.557238+0000","last_peered":"2024-09-21T03:14:48.557238+0000","last_clean":"2024-09-21T03:14:48.557238+0000","last_became_active":"2024-09-21T03:14:47.552712+0000","last_became_peered":"2024-09-21T03:14:47.552712+0000","last_unstale":"2024-09-21T03:14:48.557238+0000","last_undegraded":"2024-09-21T03:14:48.557238+0000","last_fullsized":"2024-09-21T03:14:48.557238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:32.630319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578701+0000","last_change":"2024-09-21T03:14:38.488259+0000","last_active":"2024-09-21T03:14:48.578701+0000","last_peered":"2024-09-21T03:14:48.578701+0000","last_clean":"2024-09-21T03:14:48.578701+0000","last_became_active":"2024-09-21T03:14:38.487420+0000","last_became_peered":"2024-09-21T03:14:38.487420+0000","last_unstale":"2024-09-21T03:14:48.578701+0000","last_undegraded":"2024-09-21T03:14:48.578701+0000","last_fullsized":"2024-09-21T03:14:48.578701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:48.003893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.559532+0000","last_change":"2024-09-21T03:14:37.460763+0000","last_active":"2024-09-21T03:14:48.559532+0000","last_peered":"2024-09-21T03:14:48.559532+0000","last_clean":"2024-09-21T03:14:48.559532+0000","last_became_active":"2024-09-21T03:14:37.460320+0000","last_became_peered":"2024-09-21T03:14:37.460320+0000","last_unstale":"2024-09-21T03:14:48.559532+0000","last_undegraded":"2024-09-21T03:14:48.559532+0000","last_fullsized":"2024-09-21T03:14:48.559532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.907794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558692+0000","last_change":"2024-09-21T03:14:46.540901+0000","last_active":"2024-09-21T03:14:48.558692+0000","last_peered":"2024-09-21T03:14:48.558692+0000","last_clean":"2024-09-21T03:14:48.558692+0000","last_became_active":"2024-09-21T03:14:46.540182+0000","last_became_peered":"2024-09-21T03:14:46.540182+0000","last_unstale":"2024-09-21T03:14:48.558692+0000","last_undegraded":"2024-09-21T03:14:48.558692+0000","last_fullsized":"2024-09-21T03:14:48.558692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:38.416663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577089+0000","last_change":"2024-09-21T03:14:47.553810+0000","last_active":"2024-09-21T03:14:48.577089+0000","last_peered":"2024-09-21T03:14:48.577089+0000","last_clean":"2024-09-21T03:14:48.577089+0000","last_became_active":"2024-09-21T03:14:47.552371+0000","last_became_peered":"2024-09-21T03:14:47.552371+0000","last_unstale":"2024-09-21T03:14:48.577089+0000","last_undegraded":"2024-09-21T03:14:48.577089+0000","last_fullsized":"2024-09-21T03:14:48.577089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:38.659512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579745+0000","last_change":"2024-09-21T03:14:38.480629+0000","last_active":"2024-09-21T03:14:48.579745+0000","last_peered":"2024-09-21T03:14:48.579745+0000","last_clean":"2024-09-21T03:14:48.579745+0000","last_became_active":"2024-09-21T03:14:38.474135+0000","last_became_peered":"2024-09-21T03:14:38.474135+0000","last_unstale":"2024-09-21T03:14:48.579745+0000","last_undegraded":"2024-09-21T03:14:48.579745+0000","last_fullsized":"2024-09-21T03:14:48.579745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:36.171044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578278+0000","last_change":"2024-09-21T03:14:37.472491+0000","last_active":"2024-09-21T03:14:48.578278+0000","last_peered":"2024-09-21T03:14:48.578278+0000","last_clean":"2024-09-21T03:14:48.578278+0000","last_became_active":"2024-09-21T03:14:37.472164+0000","last_became_peered":"2024-09-21T03:14:37.472164+0000","last_unstale":"2024-09-21T03:14:48.578278+0000","last_undegraded":"2024-09-21T03:14:48.578278+0000","last_fullsized":"2024-09-21T03:14:48.578278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.498178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577656+0000","last_change":"2024-09-21T03:14:46.544828+0000","last_active":"2024-09-21T03:14:48.577656+0000","last_peered":"2024-09-21T03:14:48.577656+0000","last_clean":"2024-09-21T03:14:48.577656+0000","last_became_active":"2024-09-21T03:14:46.535901+0000","last_became_peered":"2024-09-21T03:14:46.535901+0000","last_unstale":"2024-09-21T03:14:48.577656+0000","last_undegraded":"2024-09-21T03:14:48.577656+0000","last_fullsized":"2024-09-21T03:14:48.577656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:08.608530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557424+0000","last_change":"2024-09-21T03:14:47.556478+0000","last_active":"2024-09-21T03:14:48.557424+0000","last_peered":"2024-09-21T03:14:48.557424+0000","last_clean":"2024-09-21T03:14:48.557424+0000","last_became_active":"2024-09-21T03:14:47.556145+0000","last_became_peered":"2024-09-21T03:14:47.556145+0000","last_unstale":"2024-09-21T03:14:48.557424+0000","last_undegraded":"2024-09-21T03:14:48.557424+0000","last_fullsized":"2024-09-21T03:14:48.557424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:59.004648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557482+0000","last_change":"2024-09-21T03:14:38.469502+0000","last_active":"2024-09-21T03:14:48.557482+0000","last_peered":"2024-09-21T03:14:48.557482+0000","last_clean":"2024-09-21T03:14:48.557482+0000","last_became_active":"2024-09-21T03:14:38.468972+0000","last_became_peered":"2024-09-21T03:14:38.468972+0000","last_unstale":"2024-09-21T03:14:48.557482+0000","last_undegraded":"2024-09-21T03:14:48.557482+0000","last_fullsized":"2024-09-21T03:14:48.557482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579796+0000","last_change":"2024-09-21T03:14:37.480905+0000","last_active":"2024-09-21T03:14:48.579796+0000","last_peered":"2024-09-21T03:14:48.579796+0000","last_clean":"2024-09-21T03:14:48.579796+0000","last_became_active":"2024-09-21T03:14:37.478227+0000","last_became_peered":"2024-09-21T03:14:37.478227+0000","last_unstale":"2024-09-21T03:14:48.579796+0000","last_undegraded":"2024-09-21T03:14:48.579796+0000","last_fullsized":"2024-09-21T03:14:48.579796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:42.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577322+0000","last_change":"2024-09-21T03:14:46.536103+0000","last_active":"2024-09-21T03:14:48.577322+0000","last_peered":"2024-09-21T03:14:48.577322+0000","last_clean":"2024-09-21T03:14:48.577322+0000","last_became_active":"2024-09-21T03:14:46.535445+0000","last_became_peered":"2024-09-21T03:14:46.535445+0000","last_unstale":"2024-09-21T03:14:48.577322+0000","last_undegraded":"2024-09-21T03:14:48.577322+0000","last_fullsized":"2024-09-21T03:14:48.577322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:59.078000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578149+0000","last_change":"2024-09-21T03:14:47.557503+0000","last_active":"2024-09-21T03:14:48.578149+0000","last_peered":"2024-09-21T03:14:48.578149+0000","last_clean":"2024-09-21T03:14:48.578149+0000","last_became_active":"2024-09-21T03:14:47.554366+0000","last_became_peered":"2024-09-21T03:14:47.554366+0000","last_unstale":"2024-09-21T03:14:48.578149+0000","last_undegraded":"2024-09-21T03:14:48.578149+0000","last_fullsized":"2024-09-21T03:14:48.578149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.994560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579154+0000","last_change":"2024-09-21T03:14:38.479516+0000","last_active":"2024-09-21T03:14:48.579154+0000","last_peered":"2024-09-21T03:14:48.579154+0000","last_clean":"2024-09-21T03:14:48.579154+0000","last_became_active":"2024-09-21T03:14:38.474826+0000","last_became_peered":"2024-09-21T03:14:38.474826+0000","last_unstale":"2024-09-21T03:14:48.579154+0000","last_undegraded":"2024-09-21T03:14:48.579154+0000","last_fullsized":"2024-09-21T03:14:48.579154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:22.181411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577156+0000","last_change":"2024-09-21T03:14:37.471063+0000","last_active":"2024-09-21T03:14:48.577156+0000","last_peered":"2024-09-21T03:14:48.577156+0000","last_clean":"2024-09-21T03:14:48.577156+0000","last_became_active":"2024-09-21T03:14:37.470720+0000","last_became_peered":"2024-09-21T03:14:37.470720+0000","last_unstale":"2024-09-21T03:14:48.577156+0000","last_undegraded":"2024-09-21T03:14:48.577156+0000","last_fullsized":"2024-09-21T03:14:48.577156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:00.054692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558350+0000","last_change":"2024-09-21T03:14:46.538665+0000","last_active":"2024-09-21T03:14:48.558350+0000","last_peered":"2024-09-21T03:14:48.558350+0000","last_clean":"2024-09-21T03:14:48.558350+0000","last_became_active":"2024-09-21T03:14:46.537774+0000","last_became_peered":"2024-09-21T03:14:46.537774+0000","last_unstale":"2024-09-21T03:14:48.558350+0000","last_undegraded":"2024-09-21T03:14:48.558350+0000","last_fullsized":"2024-09-21T03:14:48.558350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:07.736404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580727+0000","last_change":"2024-09-21T03:14:47.553011+0000","last_active":"2024-09-21T03:14:48.580727+0000","last_peered":"2024-09-21T03:14:48.580727+0000","last_clean":"2024-09-21T03:14:48.580727+0000","last_became_active":"2024-09-21T03:14:47.552700+0000","last_became_peered":"2024-09-21T03:14:47.552700+0000","last_unstale":"2024-09-21T03:14:48.580727+0000","last_undegraded":"2024-09-21T03:14:48.580727+0000","last_fullsized":"2024-09-21T03:14:48.580727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:58.780132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577072+0000","last_change":"2024-09-21T03:14:38.472906+0000","last_active":"2024-09-21T03:14:48.577072+0000","last_peered":"2024-09-21T03:14:48.577072+0000","last_clean":"2024-09-21T03:14:48.577072+0000","last_became_active":"2024-09-21T03:14:38.471933+0000","last_became_peered":"2024-09-21T03:14:38.471933+0000","last_unstale":"2024-09-21T03:14:48.577072+0000","last_undegraded":"2024-09-21T03:14:48.577072+0000","last_fullsized":"2024-09-21T03:14:48.577072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:05.395821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577473+0000","last_change":"2024-09-21T03:14:37.478714+0000","last_active":"2024-09-21T03:14:48.577473+0000","last_peered":"2024-09-21T03:14:48.577473+0000","last_clean":"2024-09-21T03:14:48.577473+0000","last_became_active":"2024-09-21T03:14:37.477951+0000","last_became_peered":"2024-09-21T03:14:37.477951+0000","last_unstale":"2024-09-21T03:14:48.577473+0000","last_undegraded":"2024-09-21T03:14:48.577473+0000","last_fullsized":"2024-09-21T03:14:48.577473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:42.529545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557789+0000","last_change":"2024-09-21T03:14:46.546142+0000","last_active":"2024-09-21T03:14:48.557789+0000","last_peered":"2024-09-21T03:14:48.557789+0000","last_clean":"2024-09-21T03:14:48.557789+0000","last_became_active":"2024-09-21T03:14:46.545865+0000","last_became_peered":"2024-09-21T03:14:46.545865+0000","last_unstale":"2024-09-21T03:14:48.557789+0000","last_undegraded":"2024-09-21T03:14:48.557789+0000","last_fullsized":"2024-09-21T03:14:48.557789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:11.705309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580406+0000","last_change":"2024-09-21T03:14:47.568961+0000","last_active":"2024-09-21T03:14:48.580406+0000","last_peered":"2024-09-21T03:14:48.580406+0000","last_clean":"2024-09-21T03:14:48.580406+0000","last_became_active":"2024-09-21T03:14:47.568656+0000","last_became_peered":"2024-09-21T03:14:47.568656+0000","last_unstale":"2024-09-21T03:14:48.580406+0000","last_undegraded":"2024-09-21T03:14:48.580406+0000","last_fullsized":"2024-09-21T03:14:48.580406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.041710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580087+0000","last_change":"2024-09-21T03:14:38.485454+0000","last_active":"2024-09-21T03:14:48.580087+0000","last_peered":"2024-09-21T03:14:48.580087+0000","last_clean":"2024-09-21T03:14:48.580087+0000","last_became_active":"2024-09-21T03:14:38.485235+0000","last_became_peered":"2024-09-21T03:14:38.485235+0000","last_unstale":"2024-09-21T03:14:48.580087+0000","last_undegraded":"2024-09-21T03:14:48.580087+0000","last_fullsized":"2024-09-21T03:14:48.580087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:11.585637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580507+0000","last_change":"2024-09-21T03:14:37.466544+0000","last_active":"2024-09-21T03:14:48.580507+0000","last_peered":"2024-09-21T03:14:48.580507+0000","last_clean":"2024-09-21T03:14:48.580507+0000","last_became_active":"2024-09-21T03:14:37.465817+0000","last_became_peered":"2024-09-21T03:14:37.465817+0000","last_unstale":"2024-09-21T03:14:48.580507+0000","last_undegraded":"2024-09-21T03:14:48.580507+0000","last_fullsized":"2024-09-21T03:14:48.580507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:36.113483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558395+0000","last_change":"2024-09-21T03:14:46.549921+0000","last_active":"2024-09-21T03:14:48.558395+0000","last_peered":"2024-09-21T03:14:48.558395+0000","last_clean":"2024-09-21T03:14:48.558395+0000","last_became_active":"2024-09-21T03:14:46.549119+0000","last_became_peered":"2024-09-21T03:14:46.549119+0000","last_unstale":"2024-09-21T03:14:48.558395+0000","last_undegraded":"2024-09-21T03:14:48.558395+0000","last_fullsized":"2024-09-21T03:14:48.558395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:09.622498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577943+0000","last_change":"2024-09-21T03:14:47.577090+0000","last_active":"2024-09-21T03:14:48.577943+0000","last_peered":"2024-09-21T03:14:48.577943+0000","last_clean":"2024-09-21T03:14:48.577943+0000","last_became_active":"2024-09-21T03:14:47.576098+0000","last_became_peered":"2024-09-21T03:14:47.576098+0000","last_unstale":"2024-09-21T03:14:48.577943+0000","last_undegraded":"2024-09-21T03:14:48.577943+0000","last_fullsized":"2024-09-21T03:14:48.577943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:33.414103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557891+0000","last_change":"2024-09-21T03:14:38.482528+0000","last_active":"2024-09-21T03:14:48.557891+0000","last_peered":"2024-09-21T03:14:48.557891+0000","last_clean":"2024-09-21T03:14:48.557891+0000","last_became_active":"2024-09-21T03:14:38.482241+0000","last_became_peered":"2024-09-21T03:14:38.482241+0000","last_unstale":"2024-09-21T03:14:48.557891+0000","last_undegraded":"2024-09-21T03:14:48.557891+0000","last_fullsized":"2024-09-21T03:14:48.557891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:23.110703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566561+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:14:48.566561+0000","last_peered":"2024-09-21T03:14:48.566561+0000","last_clean":"2024-09-21T03:14:48.566561+0000","last_became_active":"2024-09-21T03:14:37.478882+0000","last_became_peered":"2024-09-21T03:14:37.478882+0000","last_unstale":"2024-09-21T03:14:48.566561+0000","last_undegraded":"2024-09-21T03:14:48.566561+0000","last_fullsized":"2024-09-21T03:14:48.566561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:11.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581263+0000","last_change":"2024-09-21T03:14:46.538817+0000","last_active":"2024-09-21T03:14:48.581263+0000","last_peered":"2024-09-21T03:14:48.581263+0000","last_clean":"2024-09-21T03:14:48.581263+0000","last_became_active":"2024-09-21T03:14:46.537835+0000","last_became_peered":"2024-09-21T03:14:46.537835+0000","last_unstale":"2024-09-21T03:14:48.581263+0000","last_undegraded":"2024-09-21T03:14:48.581263+0000","last_fullsized":"2024-09-21T03:14:48.581263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:08.236663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577368+0000","last_change":"2024-09-21T03:14:47.566534+0000","last_active":"2024-09-21T03:14:48.577368+0000","last_peered":"2024-09-21T03:14:48.577368+0000","last_clean":"2024-09-21T03:14:48.577368+0000","last_became_active":"2024-09-21T03:14:47.566157+0000","last_became_peered":"2024-09-21T03:14:47.566157+0000","last_unstale":"2024-09-21T03:14:48.577368+0000","last_undegraded":"2024-09-21T03:14:48.577368+0000","last_fullsized":"2024-09-21T03:14:48.577368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:35.557811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579586+0000","last_change":"2024-09-21T03:14:38.478509+0000","last_active":"2024-09-21T03:14:48.579586+0000","last_peered":"2024-09-21T03:14:48.579586+0000","last_clean":"2024-09-21T03:14:48.579586+0000","last_became_active":"2024-09-21T03:14:38.478197+0000","last_became_peered":"2024-09-21T03:14:38.478197+0000","last_unstale":"2024-09-21T03:14:48.579586+0000","last_undegraded":"2024-09-21T03:14:48.579586+0000","last_fullsized":"2024-09-21T03:14:48.579586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.411134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557313+0000","last_change":"2024-09-21T03:14:37.472695+0000","last_active":"2024-09-21T03:14:48.557313+0000","last_peered":"2024-09-21T03:14:48.557313+0000","last_clean":"2024-09-21T03:14:48.557313+0000","last_became_active":"2024-09-21T03:14:37.472374+0000","last_became_peered":"2024-09-21T03:14:37.472374+0000","last_unstale":"2024-09-21T03:14:48.557313+0000","last_undegraded":"2024-09-21T03:14:48.557313+0000","last_fullsized":"2024-09-21T03:14:48.557313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:11.245914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577140+0000","last_change":"2024-09-21T03:14:46.547433+0000","last_active":"2024-09-21T03:14:48.577140+0000","last_peered":"2024-09-21T03:14:48.577140+0000","last_clean":"2024-09-21T03:14:48.577140+0000","last_became_active":"2024-09-21T03:14:46.547192+0000","last_became_peered":"2024-09-21T03:14:46.547192+0000","last_unstale":"2024-09-21T03:14:48.577140+0000","last_undegraded":"2024-09-21T03:14:48.577140+0000","last_fullsized":"2024-09-21T03:14:48.577140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:03.238245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557599+0000","last_change":"2024-09-21T03:14:47.545827+0000","last_active":"2024-09-21T03:14:48.557599+0000","last_peered":"2024-09-21T03:14:48.557599+0000","last_clean":"2024-09-21T03:14:48.557599+0000","last_became_active":"2024-09-21T03:14:47.545440+0000","last_became_peered":"2024-09-21T03:14:47.545440+0000","last_unstale":"2024-09-21T03:14:48.557599+0000","last_undegraded":"2024-09-21T03:14:48.557599+0000","last_fullsized":"2024-09-21T03:14:48.557599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:20.532645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580151+0000","last_change":"2024-09-21T03:14:38.476564+0000","last_active":"2024-09-21T03:14:48.580151+0000","last_peered":"2024-09-21T03:14:48.580151+0000","last_clean":"2024-09-21T03:14:48.580151+0000","last_became_active":"2024-09-21T03:14:38.476158+0000","last_became_peered":"2024-09-21T03:14:38.476158+0000","last_unstale":"2024-09-21T03:14:48.580151+0000","last_undegraded":"2024-09-21T03:14:48.580151+0000","last_fullsized":"2024-09-21T03:14:48.580151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:26.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.567071+0000","last_change":"2024-09-21T03:14:37.473709+0000","last_active":"2024-09-21T03:14:48.567071+0000","last_peered":"2024-09-21T03:14:48.567071+0000","last_clean":"2024-09-21T03:14:48.567071+0000","last_became_active":"2024-09-21T03:14:37.472544+0000","last_became_peered":"2024-09-21T03:14:37.472544+0000","last_unstale":"2024-09-21T03:14:48.567071+0000","last_undegraded":"2024-09-21T03:14:48.567071+0000","last_fullsized":"2024-09-21T03:14:48.567071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:47.892146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556540+0000","last_change":"2024-09-21T03:14:46.534201+0000","last_active":"2024-09-21T03:14:48.556540+0000","last_peered":"2024-09-21T03:14:48.556540+0000","last_clean":"2024-09-21T03:14:48.556540+0000","last_became_active":"2024-09-21T03:14:46.533891+0000","last_became_peered":"2024-09-21T03:14:46.533891+0000","last_unstale":"2024-09-21T03:14:48.556540+0000","last_undegraded":"2024-09-21T03:14:48.556540+0000","last_fullsized":"2024-09-21T03:14:48.556540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:06.645173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579059+0000","last_change":"2024-09-21T03:14:47.552016+0000","last_active":"2024-09-21T03:14:48.579059+0000","last_peered":"2024-09-21T03:14:48.579059+0000","last_clean":"2024-09-21T03:14:48.579059+0000","last_became_active":"2024-09-21T03:14:47.551622+0000","last_became_peered":"2024-09-21T03:14:47.551622+0000","last_unstale":"2024-09-21T03:14:48.579059+0000","last_undegraded":"2024-09-21T03:14:48.579059+0000","last_fullsized":"2024-09-21T03:14:48.579059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:56:04.849535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558475+0000","last_change":"2024-09-21T03:14:38.484757+0000","last_active":"2024-09-21T03:14:48.558475+0000","last_peered":"2024-09-21T03:14:48.558475+0000","last_clean":"2024-09-21T03:14:48.558475+0000","last_became_active":"2024-09-21T03:14:38.483348+0000","last_became_peered":"2024-09-21T03:14:38.483348+0000","last_unstale":"2024-09-21T03:14:48.558475+0000","last_undegraded":"2024-09-21T03:14:48.558475+0000","last_fullsized":"2024-09-21T03:14:48.558475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:57.697723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579637+0000","last_change":"2024-09-21T03:14:37.479047+0000","last_active":"2024-09-21T03:14:48.579637+0000","last_peered":"2024-09-21T03:14:48.579637+0000","last_clean":"2024-09-21T03:14:48.579637+0000","last_became_active":"2024-09-21T03:14:37.478700+0000","last_became_peered":"2024-09-21T03:14:37.478700+0000","last_unstale":"2024-09-21T03:14:48.579637+0000","last_undegraded":"2024-09-21T03:14:48.579637+0000","last_fullsized":"2024-09-21T03:14:48.579637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:31.702450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566046+0000","last_change":"2024-09-21T03:14:46.547287+0000","last_active":"2024-09-21T03:14:48.566046+0000","last_peered":"2024-09-21T03:14:48.566046+0000","last_clean":"2024-09-21T03:14:48.566046+0000","last_became_active":"2024-09-21T03:14:46.546867+0000","last_became_peered":"2024-09-21T03:14:46.546867+0000","last_unstale":"2024-09-21T03:14:48.566046+0000","last_undegraded":"2024-09-21T03:14:48.566046+0000","last_fullsized":"2024-09-21T03:14:48.566046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:54.119841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556239+0000","last_change":"2024-09-21T03:14:47.558571+0000","last_active":"2024-09-21T03:14:48.556239+0000","last_peered":"2024-09-21T03:14:48.556239+0000","last_clean":"2024-09-21T03:14:48.556239+0000","last_became_active":"2024-09-21T03:14:47.558037+0000","last_became_peered":"2024-09-21T03:14:47.558037+0000","last_unstale":"2024-09-21T03:14:48.556239+0000","last_undegraded":"2024-09-21T03:14:48.556239+0000","last_fullsized":"2024-09-21T03:14:48.556239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:42.564181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557395+0000","last_change":"2024-09-21T03:14:38.488227+0000","last_active":"2024-09-21T03:14:48.557395+0000","last_peered":"2024-09-21T03:14:48.557395+0000","last_clean":"2024-09-21T03:14:48.557395+0000","last_became_active":"2024-09-21T03:14:38.482370+0000","last_became_peered":"2024-09-21T03:14:38.482370+0000","last_unstale":"2024-09-21T03:14:48.557395+0000","last_undegraded":"2024-09-21T03:14:48.557395+0000","last_fullsized":"2024-09-21T03:14:48.557395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:52.561391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580228+0000","last_change":"2024-09-21T03:14:37.471363+0000","last_active":"2024-09-21T03:14:48.580228+0000","last_peered":"2024-09-21T03:14:48.580228+0000","last_clean":"2024-09-21T03:14:48.580228+0000","last_became_active":"2024-09-21T03:14:37.471002+0000","last_became_peered":"2024-09-21T03:14:37.471002+0000","last_unstale":"2024-09-21T03:14:48.580228+0000","last_undegraded":"2024-09-21T03:14:48.580228+0000","last_fullsized":"2024-09-21T03:14:48.580228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:25.922368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.576862+0000","last_change":"2024-09-21T03:14:46.545186+0000","last_active":"2024-09-21T03:14:48.576862+0000","last_peered":"2024-09-21T03:14:48.576862+0000","last_clean":"2024-09-21T03:14:48.576862+0000","last_became_active":"2024-09-21T03:14:46.543647+0000","last_became_peered":"2024-09-21T03:14:46.543647+0000","last_unstale":"2024-09-21T03:14:48.576862+0000","last_undegraded":"2024-09-21T03:14:48.576862+0000","last_fullsized":"2024-09-21T03:14:48.576862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:03.097368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557625+0000","last_change":"2024-09-21T03:14:47.554766+0000","last_active":"2024-09-21T03:14:48.557625+0000","last_peered":"2024-09-21T03:14:48.557625+0000","last_clean":"2024-09-21T03:14:48.557625+0000","last_became_active":"2024-09-21T03:14:47.551563+0000","last_became_peered":"2024-09-21T03:14:47.551563+0000","last_unstale":"2024-09-21T03:14:48.557625+0000","last_undegraded":"2024-09-21T03:14:48.557625+0000","last_fullsized":"2024-09-21T03:14:48.557625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:08.790725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577735+0000","last_change":"2024-09-21T03:14:46.542659+0000","last_active":"2024-09-21T03:14:48.577735+0000","last_peered":"2024-09-21T03:14:48.577735+0000","last_clean":"2024-09-21T03:14:48.577735+0000","last_became_active":"2024-09-21T03:14:46.541771+0000","last_became_peered":"2024-09-21T03:14:46.541771+0000","last_unstale":"2024-09-21T03:14:48.577735+0000","last_undegraded":"2024-09-21T03:14:48.577735+0000","last_fullsized":"2024-09-21T03:14:48.577735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:45.543904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577243+0000","last_change":"2024-09-21T03:14:38.481837+0000","last_active":"2024-09-21T03:14:48.577243+0000","last_peered":"2024-09-21T03:14:48.577243+0000","last_clean":"2024-09-21T03:14:48.577243+0000","last_became_active":"2024-09-21T03:14:38.478400+0000","last_became_peered":"2024-09-21T03:14:38.478400+0000","last_unstale":"2024-09-21T03:14:48.577243+0000","last_undegraded":"2024-09-21T03:14:48.577243+0000","last_fullsized":"2024-09-21T03:14:48.577243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.702185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578051+0000","last_change":"2024-09-21T03:14:37.459351+0000","last_active":"2024-09-21T03:14:48.578051+0000","last_peered":"2024-09-21T03:14:48.578051+0000","last_clean":"2024-09-21T03:14:48.578051+0000","last_became_active":"2024-09-21T03:14:37.458676+0000","last_became_peered":"2024-09-21T03:14:37.458676+0000","last_unstale":"2024-09-21T03:14:48.578051+0000","last_undegraded":"2024-09-21T03:14:48.578051+0000","last_fullsized":"2024-09-21T03:14:48.578051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:42.671520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558462+0000","last_change":"2024-09-21T03:14:47.561232+0000","last_active":"2024-09-21T03:14:48.558462+0000","last_peered":"2024-09-21T03:14:48.558462+0000","last_clean":"2024-09-21T03:14:48.558462+0000","last_became_active":"2024-09-21T03:14:47.557224+0000","last_became_peered":"2024-09-21T03:14:47.557224+0000","last_unstale":"2024-09-21T03:14:48.558462+0000","last_undegraded":"2024-09-21T03:14:48.558462+0000","last_fullsized":"2024-09-21T03:14:48.558462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:09.611235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580814+0000","last_change":"2024-09-21T03:14:46.543157+0000","last_active":"2024-09-21T03:14:48.580814+0000","last_peered":"2024-09-21T03:14:48.580814+0000","last_clean":"2024-09-21T03:14:48.580814+0000","last_became_active":"2024-09-21T03:14:46.542746+0000","last_became_peered":"2024-09-21T03:14:46.542746+0000","last_unstale":"2024-09-21T03:14:48.580814+0000","last_undegraded":"2024-09-21T03:14:48.580814+0000","last_fullsized":"2024-09-21T03:14:48.580814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:30.644843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557713+0000","last_change":"2024-09-21T03:14:38.480723+0000","last_active":"2024-09-21T03:14:48.557713+0000","last_peered":"2024-09-21T03:14:48.557713+0000","last_clean":"2024-09-21T03:14:48.557713+0000","last_became_active":"2024-09-21T03:14:38.472823+0000","last_became_peered":"2024-09-21T03:14:38.472823+0000","last_unstale":"2024-09-21T03:14:48.557713+0000","last_undegraded":"2024-09-21T03:14:48.557713+0000","last_fullsized":"2024-09-21T03:14:48.557713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:59.862592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557827+0000","last_change":"2024-09-21T03:14:37.472209+0000","last_active":"2024-09-21T03:14:48.557827+0000","last_peered":"2024-09-21T03:14:48.557827+0000","last_clean":"2024-09-21T03:14:48.557827+0000","last_became_active":"2024-09-21T03:14:37.471771+0000","last_became_peered":"2024-09-21T03:14:37.471771+0000","last_unstale":"2024-09-21T03:14:48.557827+0000","last_undegraded":"2024-09-21T03:14:48.557827+0000","last_fullsized":"2024-09-21T03:14:48.557827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:30.648010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577935+0000","last_change":"2024-09-21T03:14:47.570651+0000","last_active":"2024-09-21T03:14:48.577935+0000","last_peered":"2024-09-21T03:14:48.577935+0000","last_clean":"2024-09-21T03:14:48.577935+0000","last_became_active":"2024-09-21T03:14:47.568081+0000","last_became_peered":"2024-09-21T03:14:47.568081+0000","last_unstale":"2024-09-21T03:14:48.577935+0000","last_undegraded":"2024-09-21T03:14:48.577935+0000","last_fullsized":"2024-09-21T03:14:48.577935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:45.036938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580418+0000","last_change":"2024-09-21T03:14:37.475076+0000","last_active":"2024-09-21T03:14:48.580418+0000","last_peered":"2024-09-21T03:14:48.580418+0000","last_clean":"2024-09-21T03:14:48.580418+0000","last_became_active":"2024-09-21T03:14:37.474595+0000","last_became_peered":"2024-09-21T03:14:37.474595+0000","last_unstale":"2024-09-21T03:14:48.580418+0000","last_undegraded":"2024-09-21T03:14:48.580418+0000","last_fullsized":"2024-09-21T03:14:48.580418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:16.880647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577631+0000","last_change":"2024-09-21T03:14:38.483226+0000","last_active":"2024-09-21T03:14:48.577631+0000","last_peered":"2024-09-21T03:14:48.577631+0000","last_clean":"2024-09-21T03:14:48.577631+0000","last_became_active":"2024-09-21T03:14:38.482354+0000","last_became_peered":"2024-09-21T03:14:38.482354+0000","last_unstale":"2024-09-21T03:14:48.577631+0000","last_undegraded":"2024-09-21T03:14:48.577631+0000","last_fullsized":"2024-09-21T03:14:48.577631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:51.488594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578124+0000","last_change":"2024-09-21T03:14:46.551282+0000","last_active":"2024-09-21T03:14:48.578124+0000","last_peered":"2024-09-21T03:14:48.578124+0000","last_clean":"2024-09-21T03:14:48.578124+0000","last_became_active":"2024-09-21T03:14:46.550191+0000","last_became_peered":"2024-09-21T03:14:46.550191+0000","last_unstale":"2024-09-21T03:14:48.578124+0000","last_undegraded":"2024-09-21T03:14:48.578124+0000","last_fullsized":"2024-09-21T03:14:48.578124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:32.136739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557152+0000","last_change":"2024-09-21T03:14:47.561737+0000","last_active":"2024-09-21T03:14:48.557152+0000","last_peered":"2024-09-21T03:14:48.557152+0000","last_clean":"2024-09-21T03:14:48.557152+0000","last_became_active":"2024-09-21T03:14:47.557518+0000","last_became_peered":"2024-09-21T03:14:47.557518+0000","last_unstale":"2024-09-21T03:14:48.557152+0000","last_undegraded":"2024-09-21T03:14:48.557152+0000","last_fullsized":"2024-09-21T03:14:48.557152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:00.342378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.559033+0000","last_change":"2024-09-21T03:14:37.465536+0000","last_active":"2024-09-21T03:14:48.559033+0000","last_peered":"2024-09-21T03:14:48.559033+0000","last_clean":"2024-09-21T03:14:48.559033+0000","last_became_active":"2024-09-21T03:14:37.465240+0000","last_became_peered":"2024-09-21T03:14:37.465240+0000","last_unstale":"2024-09-21T03:14:48.559033+0000","last_undegraded":"2024-09-21T03:14:48.559033+0000","last_fullsized":"2024-09-21T03:14:48.559033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:34.780298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578325+0000","last_change":"2024-09-21T03:14:38.474516+0000","last_active":"2024-09-21T03:14:48.578325+0000","last_peered":"2024-09-21T03:14:48.578325+0000","last_clean":"2024-09-21T03:14:48.578325+0000","last_became_active":"2024-09-21T03:14:38.472225+0000","last_became_peered":"2024-09-21T03:14:38.472225+0000","last_unstale":"2024-09-21T03:14:48.578325+0000","last_undegraded":"2024-09-21T03:14:48.578325+0000","last_fullsized":"2024-09-21T03:14:48.578325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:47.504910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566849+0000","last_change":"2024-09-21T03:14:46.544072+0000","last_active":"2024-09-21T03:14:48.566849+0000","last_peered":"2024-09-21T03:14:48.566849+0000","last_clean":"2024-09-21T03:14:48.566849+0000","last_became_active":"2024-09-21T03:14:46.543729+0000","last_became_peered":"2024-09-21T03:14:46.543729+0000","last_unstale":"2024-09-21T03:14:48.566849+0000","last_undegraded":"2024-09-21T03:14:48.566849+0000","last_fullsized":"2024-09-21T03:14:48.566849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:18.560012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578210+0000","last_change":"2024-09-21T03:14:47.563764+0000","last_active":"2024-09-21T03:14:48.578210+0000","last_peered":"2024-09-21T03:14:48.578210+0000","last_clean":"2024-09-21T03:14:48.578210+0000","last_became_active":"2024-09-21T03:14:47.562943+0000","last_became_peered":"2024-09-21T03:14:47.562943+0000","last_unstale":"2024-09-21T03:14:48.578210+0000","last_undegraded":"2024-09-21T03:14:48.578210+0000","last_fullsized":"2024-09-21T03:14:48.578210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:39.284350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556697+0000","last_change":"2024-09-21T03:14:38.484311+0000","last_active":"2024-09-21T03:14:48.556697+0000","last_peered":"2024-09-21T03:14:48.556697+0000","last_clean":"2024-09-21T03:14:48.556697+0000","last_became_active":"2024-09-21T03:14:38.483975+0000","last_became_peered":"2024-09-21T03:14:38.483975+0000","last_unstale":"2024-09-21T03:14:48.556697+0000","last_undegraded":"2024-09-21T03:14:48.556697+0000","last_fullsized":"2024-09-21T03:14:48.556697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:31.145431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578221+0000","last_change":"2024-09-21T03:14:47.566252+0000","last_active":"2024-09-21T03:14:48.578221+0000","last_peered":"2024-09-21T03:14:48.578221+0000","last_clean":"2024-09-21T03:14:48.578221+0000","last_became_active":"2024-09-21T03:14:47.560282+0000","last_became_peered":"2024-09-21T03:14:47.560282+0000","last_unstale":"2024-09-21T03:14:48.578221+0000","last_undegraded":"2024-09-21T03:14:48.578221+0000","last_fullsized":"2024-09-21T03:14:48.578221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:23.553847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566179+0000","last_change":"2024-09-21T03:14:38.477183+0000","last_active":"2024-09-21T03:14:48.566179+0000","last_peered":"2024-09-21T03:14:48.566179+0000","last_clean":"2024-09-21T03:14:48.566179+0000","last_became_active":"2024-09-21T03:14:38.476657+0000","last_became_peered":"2024-09-21T03:14:38.476657+0000","last_unstale":"2024-09-21T03:14:48.566179+0000","last_undegraded":"2024-09-21T03:14:48.566179+0000","last_fullsized":"2024-09-21T03:14:48.566179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:36.801764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557242+0000","last_change":"2024-09-21T03:14:47.574339+0000","last_active":"2024-09-21T03:14:48.557242+0000","last_peered":"2024-09-21T03:14:48.557242+0000","last_clean":"2024-09-21T03:14:48.557242+0000","last_became_active":"2024-09-21T03:14:47.565732+0000","last_became_peered":"2024-09-21T03:14:47.565732+0000","last_unstale":"2024-09-21T03:14:48.557242+0000","last_undegraded":"2024-09-21T03:14:48.557242+0000","last_fullsized":"2024-09-21T03:14:48.557242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:57.896810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580141+0000","last_change":"2024-09-21T03:14:38.472860+0000","last_active":"2024-09-21T03:14:48.580141+0000","last_peered":"2024-09-21T03:14:48.580141+0000","last_clean":"2024-09-21T03:14:48.580141+0000","last_became_active":"2024-09-21T03:14:38.472548+0000","last_became_peered":"2024-09-21T03:14:38.472548+0000","last_unstale":"2024-09-21T03:14:48.580141+0000","last_undegraded":"2024-09-21T03:14:48.580141+0000","last_fullsized":"2024-09-21T03:14:48.580141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:16.071692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.559519+0000","last_change":"2024-09-21T03:14:47.557402+0000","last_active":"2024-09-21T03:14:48.559519+0000","last_peered":"2024-09-21T03:14:48.559519+0000","last_clean":"2024-09-21T03:14:48.559519+0000","last_became_active":"2024-09-21T03:14:47.557047+0000","last_became_peered":"2024-09-21T03:14:47.557047+0000","last_unstale":"2024-09-21T03:14:48.559519+0000","last_undegraded":"2024-09-21T03:14:48.559519+0000","last_fullsized":"2024-09-21T03:14:48.559519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:29.792514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558904+0000","last_change":"2024-09-21T03:14:38.481039+0000","last_active":"2024-09-21T03:14:48.558904+0000","last_peered":"2024-09-21T03:14:48.558904+0000","last_clean":"2024-09-21T03:14:48.558904+0000","last_became_active":"2024-09-21T03:14:38.480686+0000","last_became_peered":"2024-09-21T03:14:38.480686+0000","last_unstale":"2024-09-21T03:14:48.558904+0000","last_undegraded":"2024-09-21T03:14:48.558904+0000","last_fullsized":"2024-09-21T03:14:48.558904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:18.603386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577036+0000","last_change":"2024-09-21T03:14:47.565697+0000","last_active":"2024-09-21T03:14:48.577036+0000","last_peered":"2024-09-21T03:14:48.577036+0000","last_clean":"2024-09-21T03:14:48.577036+0000","last_became_active":"2024-09-21T03:14:47.565393+0000","last_became_peered":"2024-09-21T03:14:47.565393+0000","last_unstale":"2024-09-21T03:14:48.577036+0000","last_undegraded":"2024-09-21T03:14:48.577036+0000","last_fullsized":"2024-09-21T03:14:48.577036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:35.421803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558553+0000","last_change":"2024-09-21T03:14:38.473900+0000","last_active":"2024-09-21T03:14:48.558553+0000","last_peered":"2024-09-21T03:14:48.558553+0000","last_clean":"2024-09-21T03:14:48.558553+0000","last_became_active":"2024-09-21T03:14:38.471325+0000","last_became_peered":"2024-09-21T03:14:38.471325+0000","last_unstale":"2024-09-21T03:14:48.558553+0000","last_undegraded":"2024-09-21T03:14:48.558553+0000","last_fullsized":"2024-09-21T03:14:48.558553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:47.556293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578046+0000","last_change":"2024-09-21T03:14:47.573726+0000","last_active":"2024-09-21T03:14:48.578046+0000","last_peered":"2024-09-21T03:14:48.578046+0000","last_clean":"2024-09-21T03:14:48.578046+0000","last_became_active":"2024-09-21T03:14:47.571074+0000","last_became_peered":"2024-09-21T03:14:47.571074+0000","last_unstale":"2024-09-21T03:14:48.578046+0000","last_undegraded":"2024-09-21T03:14:48.578046+0000","last_fullsized":"2024-09-21T03:14:48.578046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:53.755098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557408+0000","last_change":"2024-09-21T03:14:38.478099+0000","last_active":"2024-09-21T03:14:48.557408+0000","last_peered":"2024-09-21T03:14:48.557408+0000","last_clean":"2024-09-21T03:14:48.557408+0000","last_became_active":"2024-09-21T03:14:38.475894+0000","last_became_peered":"2024-09-21T03:14:38.475894+0000","last_unstale":"2024-09-21T03:14:48.557408+0000","last_undegraded":"2024-09-21T03:14:48.557408+0000","last_fullsized":"2024-09-21T03:14:48.557408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:49.876430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577542+0000","last_change":"2024-09-21T03:14:47.556933+0000","last_active":"2024-09-21T03:14:48.577542+0000","last_peered":"2024-09-21T03:14:48.577542+0000","last_clean":"2024-09-21T03:14:48.577542+0000","last_became_active":"2024-09-21T03:14:47.556615+0000","last_became_peered":"2024-09-21T03:14:47.556615+0000","last_unstale":"2024-09-21T03:14:48.577542+0000","last_undegraded":"2024-09-21T03:14:48.577542+0000","last_fullsized":"2024-09-21T03:14:48.577542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:27.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557365+0000","last_change":"2024-09-21T03:14:38.484198+0000","last_active":"2024-09-21T03:14:48.557365+0000","last_peered":"2024-09-21T03:14:48.557365+0000","last_clean":"2024-09-21T03:14:48.557365+0000","last_became_active":"2024-09-21T03:14:38.483893+0000","last_became_peered":"2024-09-21T03:14:38.483893+0000","last_unstale":"2024-09-21T03:14:48.557365+0000","last_undegraded":"2024-09-21T03:14:48.557365+0000","last_fullsized":"2024-09-21T03:14:48.557365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:56.665359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556286+0000","last_change":"2024-09-21T03:14:47.553479+0000","last_active":"2024-09-21T03:14:48.556286+0000","last_peered":"2024-09-21T03:14:48.556286+0000","last_clean":"2024-09-21T03:14:48.556286+0000","last_became_active":"2024-09-21T03:14:47.553144+0000","last_became_peered":"2024-09-21T03:14:47.553144+0000","last_unstale":"2024-09-21T03:14:48.556286+0000","last_undegraded":"2024-09-21T03:14:48.556286+0000","last_fullsized":"2024-09-21T03:14:48.556286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:26.321488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558236+0000","last_change":"2024-09-21T03:14:38.487093+0000","last_active":"2024-09-21T03:14:48.558236+0000","last_peered":"2024-09-21T03:14:48.558236+0000","last_clean":"2024-09-21T03:14:48.558236+0000","last_became_active":"2024-09-21T03:14:38.486204+0000","last_became_peered":"2024-09-21T03:14:38.486204+0000","last_unstale":"2024-09-21T03:14:48.558236+0000","last_undegraded":"2024-09-21T03:14:48.558236+0000","last_fullsized":"2024-09-21T03:14:48.558236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:55.531046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566794+0000","last_change":"2024-09-21T03:14:47.573375+0000","last_active":"2024-09-21T03:14:48.566794+0000","last_peered":"2024-09-21T03:14:48.566794+0000","last_clean":"2024-09-21T03:14:48.566794+0000","last_became_active":"2024-09-21T03:14:47.572717+0000","last_became_peered":"2024-09-21T03:14:47.572717+0000","last_unstale":"2024-09-21T03:14:48.566794+0000","last_undegraded":"2024-09-21T03:14:48.566794+0000","last_fullsized":"2024-09-21T03:14:48.566794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:44.673283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577931+0000","last_change":"2024-09-21T03:14:38.471959+0000","last_active":"2024-09-21T03:14:48.577931+0000","last_peered":"2024-09-21T03:14:48.577931+0000","last_clean":"2024-09-21T03:14:48.577931+0000","last_became_active":"2024-09-21T03:14:38.471625+0000","last_became_peered":"2024-09-21T03:14:38.471625+0000","last_unstale":"2024-09-21T03:14:48.577931+0000","last_undegraded":"2024-09-21T03:14:48.577931+0000","last_fullsized":"2024-09-21T03:14:48.577931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:17.761951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581065+0000","last_change":"2024-09-21T03:14:47.564597+0000","last_active":"2024-09-21T03:14:48.581065+0000","last_peered":"2024-09-21T03:14:48.581065+0000","last_clean":"2024-09-21T03:14:48.581065+0000","last_became_active":"2024-09-21T03:14:47.563816+0000","last_became_peered":"2024-09-21T03:14:47.563816+0000","last_unstale":"2024-09-21T03:14:48.581065+0000","last_undegraded":"2024-09-21T03:14:48.581065+0000","last_fullsized":"2024-09-21T03:14:48.581065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:33.061271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557771+0000","last_change":"2024-09-21T03:14:38.491888+0000","last_active":"2024-09-21T03:14:48.557771+0000","last_peered":"2024-09-21T03:14:48.557771+0000","last_clean":"2024-09-21T03:14:48.557771+0000","last_became_active":"2024-09-21T03:14:38.491510+0000","last_became_peered":"2024-09-21T03:14:38.491510+0000","last_unstale":"2024-09-21T03:14:48.557771+0000","last_undegraded":"2024-09-21T03:14:48.557771+0000","last_fullsized":"2024-09-21T03:14:48.557771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:26.740304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558275+0000","last_change":"2024-09-21T03:14:47.564310+0000","last_active":"2024-09-21T03:14:48.558275+0000","last_peered":"2024-09-21T03:14:48.558275+0000","last_clean":"2024-09-21T03:14:48.558275+0000","last_became_active":"2024-09-21T03:14:47.564003+0000","last_became_peered":"2024-09-21T03:14:47.564003+0000","last_unstale":"2024-09-21T03:14:48.558275+0000","last_undegraded":"2024-09-21T03:14:48.558275+0000","last_fullsized":"2024-09-21T03:14:48.558275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:45.016321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578256+0000","last_change":"2024-09-21T03:14:38.470991+0000","last_active":"2024-09-21T03:14:48.578256+0000","last_peered":"2024-09-21T03:14:48.578256+0000","last_clean":"2024-09-21T03:14:48.578256+0000","last_became_active":"2024-09-21T03:14:38.470666+0000","last_became_peered":"2024-09-21T03:14:38.470666+0000","last_unstale":"2024-09-21T03:14:48.578256+0000","last_undegraded":"2024-09-21T03:14:48.578256+0000","last_fullsized":"2024-09-21T03:14:48.578256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:25.477992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566757+0000","last_change":"2024-09-21T03:14:47.575212+0000","last_active":"2024-09-21T03:14:48.566757+0000","last_peered":"2024-09-21T03:14:48.566757+0000","last_clean":"2024-09-21T03:14:48.566757+0000","last_became_active":"2024-09-21T03:14:47.574895+0000","last_became_peered":"2024-09-21T03:14:47.574895+0000","last_unstale":"2024-09-21T03:14:48.566757+0000","last_undegraded":"2024-09-21T03:14:48.566757+0000","last_fullsized":"2024-09-21T03:14:48.566757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:04.240949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577570+0000","last_change":"2024-09-21T03:14:38.482681+0000","last_active":"2024-09-21T03:14:48.577570+0000","last_peered":"2024-09-21T03:14:48.577570+0000","last_clean":"2024-09-21T03:14:48.577570+0000","last_became_active":"2024-09-21T03:14:38.477816+0000","last_became_peered":"2024-09-21T03:14:38.477816+0000","last_unstale":"2024-09-21T03:14:48.577570+0000","last_undegraded":"2024-09-21T03:14:48.577570+0000","last_fullsized":"2024-09-21T03:14:48.577570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:18.675641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557132+0000","last_change":"2024-09-21T03:14:47.555329+0000","last_active":"2024-09-21T03:14:48.557132+0000","last_peered":"2024-09-21T03:14:48.557132+0000","last_clean":"2024-09-21T03:14:48.557132+0000","last_became_active":"2024-09-21T03:14:47.555033+0000","last_became_peered":"2024-09-21T03:14:47.555033+0000","last_unstale":"2024-09-21T03:14:48.557132+0000","last_undegraded":"2024-09-21T03:14:48.557132+0000","last_fullsized":"2024-09-21T03:14:48.557132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:49.060834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578610+0000","last_change":"2024-09-21T03:14:38.480638+0000","last_active":"2024-09-21T03:14:48.578610+0000","last_peered":"2024-09-21T03:14:48.578610+0000","last_clean":"2024-09-21T03:14:48.578610+0000","last_became_active":"2024-09-21T03:14:38.477739+0000","last_became_peered":"2024-09-21T03:14:38.477739+0000","last_unstale":"2024-09-21T03:14:48.578610+0000","last_undegraded":"2024-09-21T03:14:48.578610+0000","last_fullsized":"2024-09-21T03:14:48.578610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:35.097761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577900+0000","last_change":"2024-09-21T03:14:47.573659+0000","last_active":"2024-09-21T03:14:48.577900+0000","last_peered":"2024-09-21T03:14:48.577900+0000","last_clean":"2024-09-21T03:14:48.577900+0000","last_became_active":"2024-09-21T03:14:47.572756+0000","last_became_peered":"2024-09-21T03:14:47.572756+0000","last_unstale":"2024-09-21T03:14:48.577900+0000","last_undegraded":"2024-09-21T03:14:48.577900+0000","last_fullsized":"2024-09-21T03:14:48.577900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:21.986681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581406+0000","last_change":"2024-09-21T03:14:38.478039+0000","last_active":"2024-09-21T03:14:48.581406+0000","last_peered":"2024-09-21T03:14:48.581406+0000","last_clean":"2024-09-21T03:14:48.581406+0000","last_became_active":"2024-09-21T03:14:38.473843+0000","last_became_peered":"2024-09-21T03:14:38.473843+0000","last_unstale":"2024-09-21T03:14:48.581406+0000","last_undegraded":"2024-09-21T03:14:48.581406+0000","last_fullsized":"2024-09-21T03:14:48.581406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:27.072406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556166+0000","last_change":"2024-09-21T03:14:47.555386+0000","last_active":"2024-09-21T03:14:48.556166+0000","last_peered":"2024-09-21T03:14:48.556166+0000","last_clean":"2024-09-21T03:14:48.556166+0000","last_became_active":"2024-09-21T03:14:47.554758+0000","last_became_peered":"2024-09-21T03:14:47.554758+0000","last_unstale":"2024-09-21T03:14:48.556166+0000","last_undegraded":"2024-09-21T03:14:48.556166+0000","last_fullsized":"2024-09-21T03:14:48.556166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:47.574672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566912+0000","last_change":"2024-09-21T03:14:38.494878+0000","last_active":"2024-09-21T03:14:48.566912+0000","last_peered":"2024-09-21T03:14:48.566912+0000","last_clean":"2024-09-21T03:14:48.566912+0000","last_became_active":"2024-09-21T03:14:38.492813+0000","last_became_peered":"2024-09-21T03:14:38.492813+0000","last_unstale":"2024-09-21T03:14:48.566912+0000","last_undegraded":"2024-09-21T03:14:48.566912+0000","last_fullsized":"2024-09-21T03:14:48.566912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:55.064844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557554+0000","last_change":"2024-09-21T03:14:47.544806+0000","last_active":"2024-09-21T03:14:48.557554+0000","last_peered":"2024-09-21T03:14:48.557554+0000","last_clean":"2024-09-21T03:14:48.557554+0000","last_became_active":"2024-09-21T03:14:47.544431+0000","last_became_peered":"2024-09-21T03:14:47.544431+0000","last_unstale":"2024-09-21T03:14:48.557554+0000","last_undegraded":"2024-09-21T03:14:48.557554+0000","last_fullsized":"2024-09-21T03:14:48.557554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:01.463573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581015+0000","last_change":"2024-09-21T03:14:38.474462+0000","last_active":"2024-09-21T03:14:48.581015+0000","last_peered":"2024-09-21T03:14:48.581015+0000","last_clean":"2024-09-21T03:14:48.581015+0000","last_became_active":"2024-09-21T03:14:38.474156+0000","last_became_peered":"2024-09-21T03:14:38.474156+0000","last_unstale":"2024-09-21T03:14:48.581015+0000","last_undegraded":"2024-09-21T03:14:48.581015+0000","last_fullsized":"2024-09-21T03:14:48.581015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:55.329945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578169+0000","last_change":"2024-09-21T03:14:47.563297+0000","last_active":"2024-09-21T03:14:48.578169+0000","last_peered":"2024-09-21T03:14:48.578169+0000","last_clean":"2024-09-21T03:14:48.578169+0000","last_became_active":"2024-09-21T03:14:47.562519+0000","last_became_peered":"2024-09-21T03:14:47.562519+0000","last_unstale":"2024-09-21T03:14:48.578169+0000","last_undegraded":"2024-09-21T03:14:48.578169+0000","last_fullsized":"2024-09-21T03:14:48.578169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:47.959373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577713+0000","last_change":"2024-09-21T03:14:38.474262+0000","last_active":"2024-09-21T03:14:48.577713+0000","last_peered":"2024-09-21T03:14:48.577713+0000","last_clean":"2024-09-21T03:14:48.577713+0000","last_became_active":"2024-09-21T03:14:38.473856+0000","last_became_peered":"2024-09-21T03:14:38.473856+0000","last_unstale":"2024-09-21T03:14:48.577713+0000","last_undegraded":"2024-09-21T03:14:48.577713+0000","last_fullsized":"2024-09-21T03:14:48.577713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579491+0000","last_change":"2024-09-21T03:14:47.558732+0000","last_active":"2024-09-21T03:14:48.579491+0000","last_peered":"2024-09-21T03:14:48.579491+0000","last_clean":"2024-09-21T03:14:48.579491+0000","last_became_active":"2024-09-21T03:14:47.558403+0000","last_became_peered":"2024-09-21T03:14:47.558403+0000","last_unstale":"2024-09-21T03:14:48.579491+0000","last_undegraded":"2024-09-21T03:14:48.579491+0000","last_fullsized":"2024-09-21T03:14:48.579491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:46.054565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557583+0000","last_change":"2024-09-21T03:14:38.469736+0000","last_active":"2024-09-21T03:14:48.557583+0000","last_peered":"2024-09-21T03:14:48.557583+0000","last_clean":"2024-09-21T03:14:48.557583+0000","last_became_active":"2024-09-21T03:14:38.469240+0000","last_became_peered":"2024-09-21T03:14:38.469240+0000","last_unstale":"2024-09-21T03:14:48.557583+0000","last_undegraded":"2024-09-21T03:14:48.557583+0000","last_fullsized":"2024-09-21T03:14:48.557583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:04.258761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578598+0000","last_change":"2024-09-21T03:14:47.550684+0000","last_active":"2024-09-21T03:14:48.578598+0000","last_peered":"2024-09-21T03:14:48.578598+0000","last_clean":"2024-09-21T03:14:48.578598+0000","last_became_active":"2024-09-21T03:14:47.550375+0000","last_became_peered":"2024-09-21T03:14:47.550375+0000","last_unstale":"2024-09-21T03:14:48.578598+0000","last_undegraded":"2024-09-21T03:14:48.578598+0000","last_fullsized":"2024-09-21T03:14:48.578598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:05.268160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557691+0000","last_change":"2024-09-21T03:14:38.487983+0000","last_active":"2024-09-21T03:14:48.557691+0000","last_peered":"2024-09-21T03:14:48.557691+0000","last_clean":"2024-09-21T03:14:48.557691+0000","last_became_active":"2024-09-21T03:14:38.487676+0000","last_became_peered":"2024-09-21T03:14:38.487676+0000","last_unstale":"2024-09-21T03:14:48.557691+0000","last_undegraded":"2024-09-21T03:14:48.557691+0000","last_fullsized":"2024-09-21T03:14:48.557691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:35.320169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580600+0000","last_change":"2024-09-21T03:14:47.561566+0000","last_active":"2024-09-21T03:14:48.580600+0000","last_peered":"2024-09-21T03:14:48.580600+0000","last_clean":"2024-09-21T03:14:48.580600+0000","last_became_active":"2024-09-21T03:14:47.561229+0000","last_became_peered":"2024-09-21T03:14:47.561229+0000","last_unstale":"2024-09-21T03:14:48.580600+0000","last_undegraded":"2024-09-21T03:14:48.580600+0000","last_fullsized":"2024-09-21T03:14:48.580600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:07.280356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558891+0000","last_change":"2024-09-21T03:14:38.478853+0000","last_active":"2024-09-21T03:14:48.558891+0000","last_peered":"2024-09-21T03:14:48.558891+0000","last_clean":"2024-09-21T03:14:48.558891+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:14:48.558891+0000","last_undegraded":"2024-09-21T03:14:48.558891+0000","last_fullsized":"2024-09-21T03:14:48.558891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:31.427596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577155+0000","last_change":"2024-09-21T03:14:47.553172+0000","last_active":"2024-09-21T03:14:48.577155+0000","last_peered":"2024-09-21T03:14:48.577155+0000","last_clean":"2024-09-21T03:14:48.577155+0000","last_became_active":"2024-09-21T03:14:47.552659+0000","last_became_peered":"2024-09-21T03:14:47.552659+0000","last_unstale":"2024-09-21T03:14:48.577155+0000","last_undegraded":"2024-09-21T03:14:48.577155+0000","last_fullsized":"2024-09-21T03:14:48.577155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:16:20.114663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578509+0000","last_change":"2024-09-21T03:14:38.481308+0000","last_active":"2024-09-21T03:14:48.578509+0000","last_peered":"2024-09-21T03:14:48.578509+0000","last_clean":"2024-09-21T03:14:48.578509+0000","last_became_active":"2024-09-21T03:14:38.480923+0000","last_became_peered":"2024-09-21T03:14:38.480923+0000","last_unstale":"2024-09-21T03:14:48.578509+0000","last_undegraded":"2024-09-21T03:14:48.578509+0000","last_fullsized":"2024-09-21T03:14:48.578509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:40.689231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557324+0000","last_change":"2024-09-21T03:14:47.561972+0000","last_active":"2024-09-21T03:14:48.557324+0000","last_peered":"2024-09-21T03:14:48.557324+0000","last_clean":"2024-09-21T03:14:48.557324+0000","last_became_active":"2024-09-21T03:14:47.561645+0000","last_became_peered":"2024-09-21T03:14:47.561645+0000","last_unstale":"2024-09-21T03:14:48.557324+0000","last_undegraded":"2024-09-21T03:14:48.557324+0000","last_fullsized":"2024-09-21T03:14:48.557324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:57.526787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579480+0000","last_change":"2024-09-21T03:14:38.473907+0000","last_active":"2024-09-21T03:14:48.579480+0000","last_peered":"2024-09-21T03:14:48.579480+0000","last_clean":"2024-09-21T03:14:48.579480+0000","last_became_active":"2024-09-21T03:14:38.473579+0000","last_became_peered":"2024-09-21T03:14:38.473579+0000","last_unstale":"2024-09-21T03:14:48.579480+0000","last_undegraded":"2024-09-21T03:14:48.579480+0000","last_fullsized":"2024-09-21T03:14:48.579480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:32.273503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577349+0000","last_change":"2024-09-21T03:14:47.566089+0000","last_active":"2024-09-21T03:14:48.577349+0000","last_peered":"2024-09-21T03:14:48.577349+0000","last_clean":"2024-09-21T03:14:48.577349+0000","last_became_active":"2024-09-21T03:14:47.565681+0000","last_became_peered":"2024-09-21T03:14:47.565681+0000","last_unstale":"2024-09-21T03:14:48.577349+0000","last_undegraded":"2024-09-21T03:14:48.577349+0000","last_fullsized":"2024-09-21T03:14:48.577349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.208933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579474+0000","last_change":"2024-09-21T03:14:38.474326+0000","last_active":"2024-09-21T03:14:48.579474+0000","last_peered":"2024-09-21T03:14:48.579474+0000","last_clean":"2024-09-21T03:14:48.579474+0000","last_became_active":"2024-09-21T03:14:38.470430+0000","last_became_peered":"2024-09-21T03:14:38.470430+0000","last_unstale":"2024-09-21T03:14:48.579474+0000","last_undegraded":"2024-09-21T03:14:48.579474+0000","last_fullsized":"2024-09-21T03:14:48.579474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:09.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577186+0000","last_change":"2024-09-21T03:14:47.571487+0000","last_active":"2024-09-21T03:14:48.577186+0000","last_peered":"2024-09-21T03:14:48.577186+0000","last_clean":"2024-09-21T03:14:48.577186+0000","last_became_active":"2024-09-21T03:14:47.571126+0000","last_became_peered":"2024-09-21T03:14:47.571126+0000","last_unstale":"2024-09-21T03:14:48.577186+0000","last_undegraded":"2024-09-21T03:14:48.577186+0000","last_fullsized":"2024-09-21T03:14:48.577186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:57.128853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580122+0000","last_change":"2024-09-21T03:14:38.483370+0000","last_active":"2024-09-21T03:14:48.580122+0000","last_peered":"2024-09-21T03:14:48.580122+0000","last_clean":"2024-09-21T03:14:48.580122+0000","last_became_active":"2024-09-21T03:14:38.483019+0000","last_became_peered":"2024-09-21T03:14:38.483019+0000","last_unstale":"2024-09-21T03:14:48.580122+0000","last_undegraded":"2024-09-21T03:14:48.580122+0000","last_fullsized":"2024-09-21T03:14:48.580122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:55.085422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558300+0000","last_change":"2024-09-21T03:14:47.555777+0000","last_active":"2024-09-21T03:14:48.558300+0000","last_peered":"2024-09-21T03:14:48.558300+0000","last_clean":"2024-09-21T03:14:48.558300+0000","last_became_active":"2024-09-21T03:14:47.555465+0000","last_became_peered":"2024-09-21T03:14:47.555465+0000","last_unstale":"2024-09-21T03:14:48.558300+0000","last_undegraded":"2024-09-21T03:14:48.558300+0000","last_fullsized":"2024-09-21T03:14:48.558300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:27.123740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556793+0000","last_change":"2024-09-21T03:14:38.465771+0000","last_active":"2024-09-21T03:14:48.556793+0000","last_peered":"2024-09-21T03:14:48.556793+0000","last_clean":"2024-09-21T03:14:48.556793+0000","last_became_active":"2024-09-21T03:14:38.465479+0000","last_became_peered":"2024-09-21T03:14:38.465479+0000","last_unstale":"2024-09-21T03:14:48.556793+0000","last_undegraded":"2024-09-21T03:14:48.556793+0000","last_fullsized":"2024-09-21T03:14:48.556793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.754315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557657+0000","last_change":"2024-09-21T03:14:47.567695+0000","last_active":"2024-09-21T03:14:48.557657+0000","last_peered":"2024-09-21T03:14:48.557657+0000","last_clean":"2024-09-21T03:14:48.557657+0000","last_became_active":"2024-09-21T03:14:47.566936+0000","last_became_peered":"2024-09-21T03:14:47.566936+0000","last_unstale":"2024-09-21T03:14:48.557657+0000","last_undegraded":"2024-09-21T03:14:48.557657+0000","last_fullsized":"2024-09-21T03:14:48.557657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:48.182523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577444+0000","last_change":"2024-09-21T03:14:38.482620+0000","last_active":"2024-09-21T03:14:48.577444+0000","last_peered":"2024-09-21T03:14:48.577444+0000","last_clean":"2024-09-21T03:14:48.577444+0000","last_became_active":"2024-09-21T03:14:38.482346+0000","last_became_peered":"2024-09-21T03:14:38.482346+0000","last_unstale":"2024-09-21T03:14:48.577444+0000","last_undegraded":"2024-09-21T03:14:48.577444+0000","last_fullsized":"2024-09-21T03:14:48.577444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:52.977725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577748+0000","last_change":"2024-09-21T03:14:47.580314+0000","last_active":"2024-09-21T03:14:48.577748+0000","last_peered":"2024-09-21T03:14:48.577748+0000","last_clean":"2024-09-21T03:14:48.577748+0000","last_became_active":"2024-09-21T03:14:47.576499+0000","last_became_peered":"2024-09-21T03:14:47.576499+0000","last_unstale":"2024-09-21T03:14:48.577748+0000","last_undegraded":"2024-09-21T03:14:48.577748+0000","last_fullsized":"2024-09-21T03:14:48.577748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:46.154586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557118+0000","last_change":"2024-09-21T03:14:38.471270+0000","last_active":"2024-09-21T03:14:48.557118+0000","last_peered":"2024-09-21T03:14:48.557118+0000","last_clean":"2024-09-21T03:14:48.557118+0000","last_became_active":"2024-09-21T03:14:38.470708+0000","last_became_peered":"2024-09-21T03:14:38.470708+0000","last_unstale":"2024-09-21T03:14:48.557118+0000","last_undegraded":"2024-09-21T03:14:48.557118+0000","last_fullsized":"2024-09-21T03:14:48.557118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.122804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578504+0000","last_change":"2024-09-21T03:14:47.554180+0000","last_active":"2024-09-21T03:14:48.578504+0000","last_peered":"2024-09-21T03:14:48.578504+0000","last_clean":"2024-09-21T03:14:48.578504+0000","last_became_active":"2024-09-21T03:14:47.552808+0000","last_became_peered":"2024-09-21T03:14:47.552808+0000","last_unstale":"2024-09-21T03:14:48.578504+0000","last_undegraded":"2024-09-21T03:14:48.578504+0000","last_fullsized":"2024-09-21T03:14:48.578504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:07.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578111+0000","last_change":"2024-09-21T03:14:38.466077+0000","last_active":"2024-09-21T03:14:48.578111+0000","last_peered":"2024-09-21T03:14:48.578111+0000","last_clean":"2024-09-21T03:14:48.578111+0000","last_became_active":"2024-09-21T03:14:38.465818+0000","last_became_peered":"2024-09-21T03:14:38.465818+0000","last_unstale":"2024-09-21T03:14:48.578111+0000","last_undegraded":"2024-09-21T03:14:48.578111+0000","last_fullsized":"2024-09-21T03:14:48.578111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:34.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566406+0000","last_change":"2024-09-21T03:14:47.577228+0000","last_active":"2024-09-21T03:14:48.566406+0000","last_peered":"2024-09-21T03:14:48.566406+0000","last_clean":"2024-09-21T03:14:48.566406+0000","last_became_active":"2024-09-21T03:14:47.576843+0000","last_became_peered":"2024-09-21T03:14:47.576843+0000","last_unstale":"2024-09-21T03:14:48.566406+0000","last_undegraded":"2024-09-21T03:14:48.566406+0000","last_fullsized":"2024-09-21T03:14:48.566406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:56.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557247+0000","last_change":"2024-09-21T03:14:38.481389+0000","last_active":"2024-09-21T03:14:48.557247+0000","last_peered":"2024-09-21T03:14:48.557247+0000","last_clean":"2024-09-21T03:14:48.557247+0000","last_became_active":"2024-09-21T03:14:38.470907+0000","last_became_peered":"2024-09-21T03:14:38.470907+0000","last_unstale":"2024-09-21T03:14:48.557247+0000","last_undegraded":"2024-09-21T03:14:48.557247+0000","last_fullsized":"2024-09-21T03:14:48.557247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:30.068915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558355+0000","last_change":"2024-09-21T03:14:47.551766+0000","last_active":"2024-09-21T03:14:48.558355+0000","last_peered":"2024-09-21T03:14:48.558355+0000","last_clean":"2024-09-21T03:14:48.558355+0000","last_became_active":"2024-09-21T03:14:47.551420+0000","last_became_peered":"2024-09-21T03:14:47.551420+0000","last_unstale":"2024-09-21T03:14:48.558355+0000","last_undegraded":"2024-09-21T03:14:48.558355+0000","last_fullsized":"2024-09-21T03:14:48.558355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:56.255472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.559417+0000","last_change":"2024-09-21T03:14:38.482605+0000","last_active":"2024-09-21T03:14:48.559417+0000","last_peered":"2024-09-21T03:14:48.559417+0000","last_clean":"2024-09-21T03:14:48.559417+0000","last_became_active":"2024-09-21T03:14:38.482306+0000","last_became_peered":"2024-09-21T03:14:38.482306+0000","last_unstale":"2024-09-21T03:14:48.559417+0000","last_undegraded":"2024-09-21T03:14:48.559417+0000","last_fullsized":"2024-09-21T03:14:48.559417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:40.482635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556625+0000","last_change":"2024-09-21T03:14:47.555070+0000","last_active":"2024-09-21T03:14:48.556625+0000","last_peered":"2024-09-21T03:14:48.556625+0000","last_clean":"2024-09-21T03:14:48.556625+0000","last_became_active":"2024-09-21T03:14:47.554363+0000","last_became_peered":"2024-09-21T03:14:47.554363+0000","last_unstale":"2024-09-21T03:14:48.556625+0000","last_undegraded":"2024-09-21T03:14:48.556625+0000","last_fullsized":"2024-09-21T03:14:48.556625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:40.027266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558524+0000","last_change":"2024-09-21T03:14:38.496218+0000","last_active":"2024-09-21T03:14:48.558524+0000","last_peered":"2024-09-21T03:14:48.558524+0000","last_clean":"2024-09-21T03:14:48.558524+0000","last_became_active":"2024-09-21T03:14:38.488537+0000","last_became_peered":"2024-09-21T03:14:38.488537+0000","last_unstale":"2024-09-21T03:14:48.558524+0000","last_undegraded":"2024-09-21T03:14:48.558524+0000","last_fullsized":"2024-09-21T03:14:48.558524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:59.667392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556307+0000","last_change":"2024-09-21T03:14:47.564250+0000","last_active":"2024-09-21T03:14:48.556307+0000","last_peered":"2024-09-21T03:14:48.556307+0000","last_clean":"2024-09-21T03:14:48.556307+0000","last_became_active":"2024-09-21T03:14:47.563745+0000","last_became_peered":"2024-09-21T03:14:47.563745+0000","last_unstale":"2024-09-21T03:14:48.556307+0000","last_undegraded":"2024-09-21T03:14:48.556307+0000","last_fullsized":"2024-09-21T03:14:48.556307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:31.282910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579673+0000","last_change":"2024-09-21T03:14:38.490309+0000","last_active":"2024-09-21T03:14:48.579673+0000","last_peered":"2024-09-21T03:14:48.579673+0000","last_clean":"2024-09-21T03:14:48.579673+0000","last_became_active":"2024-09-21T03:14:38.489167+0000","last_became_peered":"2024-09-21T03:14:38.489167+0000","last_unstale":"2024-09-21T03:14:48.579673+0000","last_undegraded":"2024-09-21T03:14:48.579673+0000","last_fullsized":"2024-09-21T03:14:48.579673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:07.725691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":100668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":691564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":104440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":102168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":860160,"data_stored":691030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":100668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":102134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":101880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:14:52.992 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:14:53.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.237+0000 7f329ba00640 1 -- 172.21.15.90:0/1037793461 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3278003a00 msgr2=0x7f3278003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:53.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.237+0000 7f329ba00640 1 --2- 172.21.15.90:0/1037793461 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3278003a00 0x7f3278003e70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3284009b50 tx=0x7f3278005830 comp rx=0 tx=0).stop 2024-09-21T03:14:53.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.237+0000 7f3299a00640 1 -- 172.21.15.90:0/1037793461 reap_dead start 2024-09-21T03:14:53.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.237+0000 7f329ba00640 1 -- 172.21.15.90:0/1037793461 shutdown_connections 2024-09-21T03:14:53.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.237+0000 7f329ba00640 1 -- 172.21.15.90:0/1037793461 >> 172.21.15.90:0/1037793461 conn(0x7f32940c8ba0 msgr2=0x7f329406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:53.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.237+0000 7f329ba00640 1 -- 172.21.15.90:0/1037793461 shutdown_connections 2024-09-21T03:14:53.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.237+0000 7f329ba00640 1 -- 172.21.15.90:0/1037793461 wait complete. 2024-09-21T03:14:53.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.239+0000 7f329ba00640 1 Processor -- start 2024-09-21T03:14:53.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.239+0000 7f329ba00640 1 -- start start 2024-09-21T03:14:53.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.241+0000 7f329ba00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3278003a00 0x7f32940c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:53.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.241+0000 7f329ba00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32941ed410 0x7f32941f05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:53.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.241+0000 7f329ba00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32941f0ae0 0x7f329414a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:53.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.241+0000 7f329ba00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f32940708e0 con 0x7f32941ed410 2024-09-21T03:14:53.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.241+0000 7f329ba00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f32940abef0 con 0x7f32941f0ae0 2024-09-21T03:14:53.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.241+0000 7f329ba00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3294070a60 con 0x7f3278003a00 2024-09-21T03:14:53.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.241+0000 7f328be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32941ed410 0x7f32941f05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:53.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.241+0000 7f328be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32941ed410 0x7f32941f05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49916/0 (socket says 172.21.15.90:49916) 2024-09-21T03:14:53.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.241+0000 7f328be00640 1 -- 172.21.15.90:0/3635211011 learned_addr learned my addr 172.21.15.90:0/3635211011 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:53.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.241+0000 7f328be00640 1 -- 172.21.15.90:0/3635211011 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3278003a00 msgr2=0x7f32940c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:53.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.241+0000 7f328be00640 1 --2- 172.21.15.90:0/3635211011 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3278003a00 0x7f32940c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:53.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.241+0000 7f328be00640 1 -- 172.21.15.90:0/3635211011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32941f0ae0 msgr2=0x7f329414a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:53.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.241+0000 7f328be00640 1 --2- 172.21.15.90:0/3635211011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32941f0ae0 0x7f329414a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:53.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.241+0000 7f328be00640 1 -- 172.21.15.90:0/3635211011 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32941e0820 con 0x7f32941ed410 2024-09-21T03:14:53.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.242+0000 7f328be00640 1 --2- 172.21.15.90:0/3635211011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32941ed410 0x7f32941f05a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f327c006480 tx=0x7f327c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:53.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.242+0000 7f3291600640 1 -- 172.21.15.90:0/3635211011 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c015070 con 0x7f32941ed410 2024-09-21T03:14:53.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.242+0000 7f3291600640 1 -- 172.21.15.90:0/3635211011 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f327c011860 con 0x7f32941ed410 2024-09-21T03:14:53.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.242+0000 7f3291600640 1 -- 172.21.15.90:0/3635211011 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c011cb0 con 0x7f32941ed410 2024-09-21T03:14:53.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.242+0000 7f329ba00640 1 -- 172.21.15.90:0/3635211011 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32941e0b00 con 0x7f32941ed410 2024-09-21T03:14:53.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.242+0000 7f329ba00640 1 -- 172.21.15.90:0/3635211011 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32940c2260 con 0x7f32941ed410 2024-09-21T03:14:53.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.243+0000 7f329ba00640 1 -- 172.21.15.90:0/3635211011 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32940c2b10 con 0x7f32941ed410 2024-09-21T03:14:53.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.244+0000 7f3291600640 1 -- 172.21.15.90:0/3635211011 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f327c018070 con 0x7f32941ed410 2024-09-21T03:14:53.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.246+0000 7f3291600640 1 --2- 172.21.15.90:0/3635211011 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3270078b90 0x7f327007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:53.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.246+0000 7f3291600640 1 -- 172.21.15.90:0/3635211011 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f327c09bd10 con 0x7f32941ed410 2024-09-21T03:14:53.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.246+0000 7f3299000640 1 --2- 172.21.15.90:0/3635211011 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3270078b90 0x7f327007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:53.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.247+0000 7f3299000640 1 --2- 172.21.15.90:0/3635211011 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3270078b90 0x7f327007b0a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3284035000 tx=0x7f3284004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:53.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.251+0000 7f3291600640 1 -- 172.21.15.90:0/3635211011 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f327c0a1020 con 0x7f32941ed410 2024-09-21T03:14:53.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.434+0000 7f329ba00640 1 -- 172.21.15.90:0/3635211011 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f32941e1020 con 0x7f3270078b90 2024-09-21T03:14:53.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.443+0000 7f3291600640 1 -- 172.21.15.90:0/3635211011 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490408 (secure 0 0 0) 0x7f32840040f0 con 0x7f3270078b90 2024-09-21T03:14:53.449 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:53.452 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-21T03:14:53.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.448+0000 7f329ba00640 1 -- 172.21.15.90:0/3635211011 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3270078b90 msgr2=0x7f327007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:53.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.448+0000 7f329ba00640 1 --2- 172.21.15.90:0/3635211011 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3270078b90 0x7f327007b0a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3284035000 tx=0x7f3284004730 comp rx=0 tx=0).stop 2024-09-21T03:14:53.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.448+0000 7f329ba00640 1 -- 172.21.15.90:0/3635211011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32941ed410 msgr2=0x7f32941f05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:53.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.448+0000 7f329ba00640 1 --2- 172.21.15.90:0/3635211011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32941ed410 0x7f32941f05a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f327c006480 tx=0x7f327c0039c0 comp rx=0 tx=0).stop 2024-09-21T03:14:53.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.448+0000 7f329ba00640 1 -- 172.21.15.90:0/3635211011 shutdown_connections 2024-09-21T03:14:53.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.448+0000 7f329ba00640 1 --2- 172.21.15.90:0/3635211011 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3270078b90 0x7f327007b0a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:53.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.448+0000 7f329ba00640 1 --2- 172.21.15.90:0/3635211011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32941f0ae0 0x7f329414a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:53.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.448+0000 7f329ba00640 1 --2- 172.21.15.90:0/3635211011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32941ed410 0x7f32941f05a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:53.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.448+0000 7f329ba00640 1 --2- 172.21.15.90:0/3635211011 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3278003a00 0x7f32940c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:53.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.448+0000 7f329ba00640 1 -- 172.21.15.90:0/3635211011 >> 172.21.15.90:0/3635211011 conn(0x7f32940c8ba0 msgr2=0x7f32940c33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:53.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.448+0000 7f329ba00640 1 -- 172.21.15.90:0/3635211011 shutdown_connections 2024-09-21T03:14:53.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.448+0000 7f329ba00640 1 -- 172.21.15.90:0/3635211011 wait complete. 2024-09-21T03:14:53.471 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-21T03:14:52.476833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":191,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":376,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219552,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755168,"statfs":{"total":773094113280,"available":772869292032,"internally_reserved":0,"allocated":3383296,"data_stored":1994552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002105"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.576924+0000","last_change":"2024-09-21T03:14:47.552762+0000","last_active":"2024-09-21T03:14:48.576924+0000","last_peered":"2024-09-21T03:14:48.576924+0000","last_clean":"2024-09-21T03:14:48.576924+0000","last_became_active":"2024-09-21T03:14:47.551883+0000","last_became_peered":"2024-09-21T03:14:47.551883+0000","last_unstale":"2024-09-21T03:14:48.576924+0000","last_undegraded":"2024-09-21T03:14:48.576924+0000","last_fullsized":"2024-09-21T03:14:48.576924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:51.935797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578270+0000","last_change":"2024-09-21T03:14:37.471004+0000","last_active":"2024-09-21T03:14:48.578270+0000","last_peered":"2024-09-21T03:14:48.578270+0000","last_clean":"2024-09-21T03:14:48.578270+0000","last_became_active":"2024-09-21T03:14:37.470563+0000","last_became_peered":"2024-09-21T03:14:37.470563+0000","last_unstale":"2024-09-21T03:14:48.578270+0000","last_undegraded":"2024-09-21T03:14:48.578270+0000","last_fullsized":"2024-09-21T03:14:48.578270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.422826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558700+0000","last_change":"2024-09-21T03:14:38.496252+0000","last_active":"2024-09-21T03:14:48.558700+0000","last_peered":"2024-09-21T03:14:48.558700+0000","last_clean":"2024-09-21T03:14:48.558700+0000","last_became_active":"2024-09-21T03:14:38.488292+0000","last_became_peered":"2024-09-21T03:14:38.488292+0000","last_unstale":"2024-09-21T03:14:48.558700+0000","last_undegraded":"2024-09-21T03:14:48.558700+0000","last_fullsized":"2024-09-21T03:14:48.558700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:57.409792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566258+0000","last_change":"2024-09-21T03:14:46.549877+0000","last_active":"2024-09-21T03:14:48.566258+0000","last_peered":"2024-09-21T03:14:48.566258+0000","last_clean":"2024-09-21T03:14:48.566258+0000","last_became_active":"2024-09-21T03:14:46.549536+0000","last_became_peered":"2024-09-21T03:14:46.549536+0000","last_unstale":"2024-09-21T03:14:48.566258+0000","last_undegraded":"2024-09-21T03:14:48.566258+0000","last_fullsized":"2024-09-21T03:14:48.566258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:57.491042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577064+0000","last_change":"2024-09-21T03:14:47.560303+0000","last_active":"2024-09-21T03:14:48.577064+0000","last_peered":"2024-09-21T03:14:48.577064+0000","last_clean":"2024-09-21T03:14:48.577064+0000","last_became_active":"2024-09-21T03:14:47.559659+0000","last_became_peered":"2024-09-21T03:14:47.559659+0000","last_unstale":"2024-09-21T03:14:48.577064+0000","last_undegraded":"2024-09-21T03:14:48.577064+0000","last_fullsized":"2024-09-21T03:14:48.577064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:49.328036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558972+0000","last_change":"2024-09-21T03:14:37.467448+0000","last_active":"2024-09-21T03:14:48.558972+0000","last_peered":"2024-09-21T03:14:48.558972+0000","last_clean":"2024-09-21T03:14:48.558972+0000","last_became_active":"2024-09-21T03:14:37.467146+0000","last_became_peered":"2024-09-21T03:14:37.467146+0000","last_unstale":"2024-09-21T03:14:48.558972+0000","last_undegraded":"2024-09-21T03:14:48.558972+0000","last_fullsized":"2024-09-21T03:14:48.558972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:53.475083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558357+0000","last_change":"2024-09-21T03:14:38.486401+0000","last_active":"2024-09-21T03:14:48.558357+0000","last_peered":"2024-09-21T03:14:48.558357+0000","last_clean":"2024-09-21T03:14:48.558357+0000","last_became_active":"2024-09-21T03:14:38.486090+0000","last_became_peered":"2024-09-21T03:14:38.486090+0000","last_unstale":"2024-09-21T03:14:48.558357+0000","last_undegraded":"2024-09-21T03:14:48.558357+0000","last_fullsized":"2024-09-21T03:14:48.558357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:44.085100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556977+0000","last_change":"2024-09-21T03:14:46.541705+0000","last_active":"2024-09-21T03:14:48.556977+0000","last_peered":"2024-09-21T03:14:48.556977+0000","last_clean":"2024-09-21T03:14:48.556977+0000","last_became_active":"2024-09-21T03:14:46.541357+0000","last_became_peered":"2024-09-21T03:14:46.541357+0000","last_unstale":"2024-09-21T03:14:48.556977+0000","last_undegraded":"2024-09-21T03:14:48.556977+0000","last_fullsized":"2024-09-21T03:14:48.556977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:31.082059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577964+0000","last_change":"2024-09-21T03:14:47.556183+0000","last_active":"2024-09-21T03:14:48.577964+0000","last_peered":"2024-09-21T03:14:48.577964+0000","last_clean":"2024-09-21T03:14:48.577964+0000","last_became_active":"2024-09-21T03:14:47.553312+0000","last_became_peered":"2024-09-21T03:14:47.553312+0000","last_unstale":"2024-09-21T03:14:48.577964+0000","last_undegraded":"2024-09-21T03:14:48.577964+0000","last_fullsized":"2024-09-21T03:14:48.577964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:07.314491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579685+0000","last_change":"2024-09-21T03:14:37.478711+0000","last_active":"2024-09-21T03:14:48.579685+0000","last_peered":"2024-09-21T03:14:48.579685+0000","last_clean":"2024-09-21T03:14:48.579685+0000","last_became_active":"2024-09-21T03:14:37.477910+0000","last_became_peered":"2024-09-21T03:14:37.477910+0000","last_unstale":"2024-09-21T03:14:48.579685+0000","last_undegraded":"2024-09-21T03:14:48.579685+0000","last_fullsized":"2024-09-21T03:14:48.579685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:40.166966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578888+0000","last_change":"2024-09-21T03:14:38.472992+0000","last_active":"2024-09-21T03:14:48.578888+0000","last_peered":"2024-09-21T03:14:48.578888+0000","last_clean":"2024-09-21T03:14:48.578888+0000","last_became_active":"2024-09-21T03:14:38.472426+0000","last_became_peered":"2024-09-21T03:14:38.472426+0000","last_unstale":"2024-09-21T03:14:48.578888+0000","last_undegraded":"2024-09-21T03:14:48.578888+0000","last_fullsized":"2024-09-21T03:14:48.578888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:36.825612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556418+0000","last_change":"2024-09-21T03:14:46.526996+0000","last_active":"2024-09-21T03:14:48.556418+0000","last_peered":"2024-09-21T03:14:48.556418+0000","last_clean":"2024-09-21T03:14:48.556418+0000","last_became_active":"2024-09-21T03:14:46.525587+0000","last_became_peered":"2024-09-21T03:14:46.525587+0000","last_unstale":"2024-09-21T03:14:48.556418+0000","last_undegraded":"2024-09-21T03:14:48.556418+0000","last_fullsized":"2024-09-21T03:14:48.556418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:56.977126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556369+0000","last_change":"2024-09-21T03:14:47.554143+0000","last_active":"2024-09-21T03:14:48.556369+0000","last_peered":"2024-09-21T03:14:48.556369+0000","last_clean":"2024-09-21T03:14:48.556369+0000","last_became_active":"2024-09-21T03:14:47.553802+0000","last_became_peered":"2024-09-21T03:14:47.553802+0000","last_unstale":"2024-09-21T03:14:48.556369+0000","last_undegraded":"2024-09-21T03:14:48.556369+0000","last_fullsized":"2024-09-21T03:14:48.556369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:37.963442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578752+0000","last_change":"2024-09-21T03:14:37.479842+0000","last_active":"2024-09-21T03:14:48.578752+0000","last_peered":"2024-09-21T03:14:48.578752+0000","last_clean":"2024-09-21T03:14:48.578752+0000","last_became_active":"2024-09-21T03:14:37.478893+0000","last_became_peered":"2024-09-21T03:14:37.478893+0000","last_unstale":"2024-09-21T03:14:48.578752+0000","last_undegraded":"2024-09-21T03:14:48.578752+0000","last_fullsized":"2024-09-21T03:14:48.578752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:27.916133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581255+0000","last_change":"2024-09-21T03:14:38.468756+0000","last_active":"2024-09-21T03:14:48.581255+0000","last_peered":"2024-09-21T03:14:48.581255+0000","last_clean":"2024-09-21T03:14:48.581255+0000","last_became_active":"2024-09-21T03:14:38.467570+0000","last_became_peered":"2024-09-21T03:14:38.467570+0000","last_unstale":"2024-09-21T03:14:48.581255+0000","last_undegraded":"2024-09-21T03:14:48.581255+0000","last_fullsized":"2024-09-21T03:14:48.581255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:24.784157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556546+0000","last_change":"2024-09-21T03:14:46.529932+0000","last_active":"2024-09-21T03:14:48.556546+0000","last_peered":"2024-09-21T03:14:48.556546+0000","last_clean":"2024-09-21T03:14:48.556546+0000","last_became_active":"2024-09-21T03:14:46.529629+0000","last_became_peered":"2024-09-21T03:14:46.529629+0000","last_unstale":"2024-09-21T03:14:48.556546+0000","last_undegraded":"2024-09-21T03:14:48.556546+0000","last_fullsized":"2024-09-21T03:14:48.556546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:39.808494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558854+0000","last_change":"2024-09-21T03:14:47.547724+0000","last_active":"2024-09-21T03:14:48.558854+0000","last_peered":"2024-09-21T03:14:48.558854+0000","last_clean":"2024-09-21T03:14:48.558854+0000","last_became_active":"2024-09-21T03:14:47.546770+0000","last_became_peered":"2024-09-21T03:14:47.546770+0000","last_unstale":"2024-09-21T03:14:48.558854+0000","last_undegraded":"2024-09-21T03:14:48.558854+0000","last_fullsized":"2024-09-21T03:14:48.558854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:31.476710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580313+0000","last_change":"2024-09-21T03:14:38.476747+0000","last_active":"2024-09-21T03:14:48.580313+0000","last_peered":"2024-09-21T03:14:48.580313+0000","last_clean":"2024-09-21T03:14:48.580313+0000","last_became_active":"2024-09-21T03:14:38.476386+0000","last_became_peered":"2024-09-21T03:14:38.476386+0000","last_unstale":"2024-09-21T03:14:48.580313+0000","last_undegraded":"2024-09-21T03:14:48.580313+0000","last_fullsized":"2024-09-21T03:14:48.580313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:28.751991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580177+0000","last_change":"2024-09-21T03:14:37.463164+0000","last_active":"2024-09-21T03:14:48.580177+0000","last_peered":"2024-09-21T03:14:48.580177+0000","last_clean":"2024-09-21T03:14:48.580177+0000","last_became_active":"2024-09-21T03:14:37.461409+0000","last_became_peered":"2024-09-21T03:14:37.461409+0000","last_unstale":"2024-09-21T03:14:48.580177+0000","last_undegraded":"2024-09-21T03:14:48.580177+0000","last_fullsized":"2024-09-21T03:14:48.580177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:51.126291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581202+0000","last_change":"2024-09-21T03:14:46.538480+0000","last_active":"2024-09-21T03:14:48.581202+0000","last_peered":"2024-09-21T03:14:48.581202+0000","last_clean":"2024-09-21T03:14:48.581202+0000","last_became_active":"2024-09-21T03:14:46.537493+0000","last_became_peered":"2024-09-21T03:14:46.537493+0000","last_unstale":"2024-09-21T03:14:48.581202+0000","last_undegraded":"2024-09-21T03:14:48.581202+0000","last_fullsized":"2024-09-21T03:14:48.581202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:52.769190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566771+0000","last_change":"2024-09-21T03:14:47.580512+0000","last_active":"2024-09-21T03:14:48.566771+0000","last_peered":"2024-09-21T03:14:48.566771+0000","last_clean":"2024-09-21T03:14:48.566771+0000","last_became_active":"2024-09-21T03:14:47.580210+0000","last_became_peered":"2024-09-21T03:14:47.580210+0000","last_unstale":"2024-09-21T03:14:48.566771+0000","last_undegraded":"2024-09-21T03:14:48.566771+0000","last_fullsized":"2024-09-21T03:14:48.566771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:20.192190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566435+0000","last_change":"2024-09-21T03:14:38.494021+0000","last_active":"2024-09-21T03:14:48.566435+0000","last_peered":"2024-09-21T03:14:48.566435+0000","last_clean":"2024-09-21T03:14:48.566435+0000","last_became_active":"2024-09-21T03:14:38.486802+0000","last_became_peered":"2024-09-21T03:14:38.486802+0000","last_unstale":"2024-09-21T03:14:48.566435+0000","last_undegraded":"2024-09-21T03:14:48.566435+0000","last_fullsized":"2024-09-21T03:14:48.566435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:31.817505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558034+0000","last_change":"2024-09-21T03:14:37.465907+0000","last_active":"2024-09-21T03:14:48.558034+0000","last_peered":"2024-09-21T03:14:48.558034+0000","last_clean":"2024-09-21T03:14:48.558034+0000","last_became_active":"2024-09-21T03:14:37.465551+0000","last_became_peered":"2024-09-21T03:14:37.465551+0000","last_unstale":"2024-09-21T03:14:48.558034+0000","last_undegraded":"2024-09-21T03:14:48.558034+0000","last_fullsized":"2024-09-21T03:14:48.558034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:10.599687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578561+0000","last_change":"2024-09-21T03:14:46.546737+0000","last_active":"2024-09-21T03:14:48.578561+0000","last_peered":"2024-09-21T03:14:48.578561+0000","last_clean":"2024-09-21T03:14:48.578561+0000","last_became_active":"2024-09-21T03:14:46.546312+0000","last_became_peered":"2024-09-21T03:14:46.546312+0000","last_unstale":"2024-09-21T03:14:48.578561+0000","last_undegraded":"2024-09-21T03:14:48.578561+0000","last_fullsized":"2024-09-21T03:14:48.578561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:03.939168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580853+0000","last_change":"2024-09-21T03:14:47.558742+0000","last_active":"2024-09-21T03:14:48.580853+0000","last_peered":"2024-09-21T03:14:48.580853+0000","last_clean":"2024-09-21T03:14:48.580853+0000","last_became_active":"2024-09-21T03:14:47.558431+0000","last_became_peered":"2024-09-21T03:14:47.558431+0000","last_unstale":"2024-09-21T03:14:48.580853+0000","last_undegraded":"2024-09-21T03:14:48.580853+0000","last_fullsized":"2024-09-21T03:14:48.580853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:32.053674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.576948+0000","last_change":"2024-09-21T03:14:38.479370+0000","last_active":"2024-09-21T03:14:48.576948+0000","last_peered":"2024-09-21T03:14:48.576948+0000","last_clean":"2024-09-21T03:14:48.576948+0000","last_became_active":"2024-09-21T03:14:38.476976+0000","last_became_peered":"2024-09-21T03:14:38.476976+0000","last_unstale":"2024-09-21T03:14:48.576948+0000","last_undegraded":"2024-09-21T03:14:48.576948+0000","last_fullsized":"2024-09-21T03:14:48.576948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:14.695819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577301+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:14:48.577301+0000","last_peered":"2024-09-21T03:14:48.577301+0000","last_clean":"2024-09-21T03:14:48.577301+0000","last_became_active":"2024-09-21T03:14:37.478840+0000","last_became_peered":"2024-09-21T03:14:37.478840+0000","last_unstale":"2024-09-21T03:14:48.577301+0000","last_undegraded":"2024-09-21T03:14:48.577301+0000","last_fullsized":"2024-09-21T03:14:48.577301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:00.964354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566781+0000","last_change":"2024-09-21T03:14:46.543085+0000","last_active":"2024-09-21T03:14:48.566781+0000","last_peered":"2024-09-21T03:14:48.566781+0000","last_clean":"2024-09-21T03:14:48.566781+0000","last_became_active":"2024-09-21T03:14:46.542721+0000","last_became_peered":"2024-09-21T03:14:46.542721+0000","last_unstale":"2024-09-21T03:14:48.566781+0000","last_undegraded":"2024-09-21T03:14:48.566781+0000","last_fullsized":"2024-09-21T03:14:48.566781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:05.590871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579821+0000","last_change":"2024-09-21T03:14:47.566806+0000","last_active":"2024-09-21T03:14:48.579821+0000","last_peered":"2024-09-21T03:14:48.579821+0000","last_clean":"2024-09-21T03:14:48.579821+0000","last_became_active":"2024-09-21T03:14:47.566634+0000","last_became_peered":"2024-09-21T03:14:47.566634+0000","last_unstale":"2024-09-21T03:14:48.579821+0000","last_undegraded":"2024-09-21T03:14:48.579821+0000","last_fullsized":"2024-09-21T03:14:48.579821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:03.997294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579153+0000","last_change":"2024-09-21T03:14:38.482658+0000","last_active":"2024-09-21T03:14:48.579153+0000","last_peered":"2024-09-21T03:14:48.579153+0000","last_clean":"2024-09-21T03:14:48.579153+0000","last_became_active":"2024-09-21T03:14:38.482369+0000","last_became_peered":"2024-09-21T03:14:38.482369+0000","last_unstale":"2024-09-21T03:14:48.579153+0000","last_undegraded":"2024-09-21T03:14:48.579153+0000","last_fullsized":"2024-09-21T03:14:48.579153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:36.682534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577485+0000","last_change":"2024-09-21T03:14:37.472962+0000","last_active":"2024-09-21T03:14:48.577485+0000","last_peered":"2024-09-21T03:14:48.577485+0000","last_clean":"2024-09-21T03:14:48.577485+0000","last_became_active":"2024-09-21T03:14:37.472271+0000","last_became_peered":"2024-09-21T03:14:37.472271+0000","last_unstale":"2024-09-21T03:14:48.577485+0000","last_undegraded":"2024-09-21T03:14:48.577485+0000","last_fullsized":"2024-09-21T03:14:48.577485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:54.952223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557189+0000","last_change":"2024-09-21T03:14:46.537137+0000","last_active":"2024-09-21T03:14:48.557189+0000","last_peered":"2024-09-21T03:14:48.557189+0000","last_clean":"2024-09-21T03:14:48.557189+0000","last_became_active":"2024-09-21T03:14:46.536791+0000","last_became_peered":"2024-09-21T03:14:46.536791+0000","last_unstale":"2024-09-21T03:14:48.557189+0000","last_undegraded":"2024-09-21T03:14:48.557189+0000","last_fullsized":"2024-09-21T03:14:48.557189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:43.186807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577598+0000","last_change":"2024-09-21T03:14:47.555605+0000","last_active":"2024-09-21T03:14:48.577598+0000","last_peered":"2024-09-21T03:14:48.577598+0000","last_clean":"2024-09-21T03:14:48.577598+0000","last_became_active":"2024-09-21T03:14:47.555329+0000","last_became_peered":"2024-09-21T03:14:47.555329+0000","last_unstale":"2024-09-21T03:14:48.577598+0000","last_undegraded":"2024-09-21T03:14:48.577598+0000","last_fullsized":"2024-09-21T03:14:48.577598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:24.271656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577873+0000","last_change":"2024-09-21T03:14:38.479133+0000","last_active":"2024-09-21T03:14:48.577873+0000","last_peered":"2024-09-21T03:14:48.577873+0000","last_clean":"2024-09-21T03:14:48.577873+0000","last_became_active":"2024-09-21T03:14:38.478077+0000","last_became_peered":"2024-09-21T03:14:38.478077+0000","last_unstale":"2024-09-21T03:14:48.577873+0000","last_undegraded":"2024-09-21T03:14:48.577873+0000","last_fullsized":"2024-09-21T03:14:48.577873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:56.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581077+0000","last_change":"2024-09-21T03:14:37.480508+0000","last_active":"2024-09-21T03:14:48.581077+0000","last_peered":"2024-09-21T03:14:48.581077+0000","last_clean":"2024-09-21T03:14:48.581077+0000","last_became_active":"2024-09-21T03:14:37.480218+0000","last_became_peered":"2024-09-21T03:14:37.480218+0000","last_unstale":"2024-09-21T03:14:48.581077+0000","last_undegraded":"2024-09-21T03:14:48.581077+0000","last_fullsized":"2024-09-21T03:14:48.581077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:01.851380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556442+0000","last_change":"2024-09-21T03:14:46.531615+0000","last_active":"2024-09-21T03:14:48.556442+0000","last_peered":"2024-09-21T03:14:48.556442+0000","last_clean":"2024-09-21T03:14:48.556442+0000","last_became_active":"2024-09-21T03:14:46.531289+0000","last_became_peered":"2024-09-21T03:14:46.531289+0000","last_unstale":"2024-09-21T03:14:48.556442+0000","last_undegraded":"2024-09-21T03:14:48.556442+0000","last_fullsized":"2024-09-21T03:14:48.556442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:10.145489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579006+0000","last_change":"2024-09-21T03:14:47.552705+0000","last_active":"2024-09-21T03:14:48.579006+0000","last_peered":"2024-09-21T03:14:48.579006+0000","last_clean":"2024-09-21T03:14:48.579006+0000","last_became_active":"2024-09-21T03:14:47.552367+0000","last_became_peered":"2024-09-21T03:14:47.552367+0000","last_unstale":"2024-09-21T03:14:48.579006+0000","last_undegraded":"2024-09-21T03:14:48.579006+0000","last_fullsized":"2024-09-21T03:14:48.579006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:45.379581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577998+0000","last_change":"2024-09-21T03:14:38.475318+0000","last_active":"2024-09-21T03:14:48.577998+0000","last_peered":"2024-09-21T03:14:48.577998+0000","last_clean":"2024-09-21T03:14:48.577998+0000","last_became_active":"2024-09-21T03:14:38.474978+0000","last_became_peered":"2024-09-21T03:14:38.474978+0000","last_unstale":"2024-09-21T03:14:48.577998+0000","last_undegraded":"2024-09-21T03:14:48.577998+0000","last_fullsized":"2024-09-21T03:14:48.577998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:38.209624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578286+0000","last_change":"2024-09-21T03:14:37.479651+0000","last_active":"2024-09-21T03:14:48.578286+0000","last_peered":"2024-09-21T03:14:48.578286+0000","last_clean":"2024-09-21T03:14:48.578286+0000","last_became_active":"2024-09-21T03:14:37.478833+0000","last_became_peered":"2024-09-21T03:14:37.478833+0000","last_unstale":"2024-09-21T03:14:48.578286+0000","last_undegraded":"2024-09-21T03:14:48.578286+0000","last_fullsized":"2024-09-21T03:14:48.578286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:48.578637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.576901+0000","last_change":"2024-09-21T03:14:46.536054+0000","last_active":"2024-09-21T03:14:48.576901+0000","last_peered":"2024-09-21T03:14:48.576901+0000","last_clean":"2024-09-21T03:14:48.576901+0000","last_became_active":"2024-09-21T03:14:46.535569+0000","last_became_peered":"2024-09-21T03:14:46.535569+0000","last_unstale":"2024-09-21T03:14:48.576901+0000","last_undegraded":"2024-09-21T03:14:48.576901+0000","last_fullsized":"2024-09-21T03:14:48.576901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:04.556059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577758+0000","last_change":"2024-09-21T03:14:47.571889+0000","last_active":"2024-09-21T03:14:48.577758+0000","last_peered":"2024-09-21T03:14:48.577758+0000","last_clean":"2024-09-21T03:14:48.577758+0000","last_became_active":"2024-09-21T03:14:47.571620+0000","last_became_peered":"2024-09-21T03:14:47.571620+0000","last_unstale":"2024-09-21T03:14:48.577758+0000","last_undegraded":"2024-09-21T03:14:48.577758+0000","last_fullsized":"2024-09-21T03:14:48.577758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:23.103973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558656+0000","last_change":"2024-09-21T03:14:38.493350+0000","last_active":"2024-09-21T03:14:48.558656+0000","last_peered":"2024-09-21T03:14:48.558656+0000","last_clean":"2024-09-21T03:14:48.558656+0000","last_became_active":"2024-09-21T03:14:38.492830+0000","last_became_peered":"2024-09-21T03:14:38.492830+0000","last_unstale":"2024-09-21T03:14:48.558656+0000","last_undegraded":"2024-09-21T03:14:48.558656+0000","last_fullsized":"2024-09-21T03:14:48.558656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:19.946319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581436+0000","last_change":"2024-09-21T03:14:37.473484+0000","last_active":"2024-09-21T03:14:48.581436+0000","last_peered":"2024-09-21T03:14:48.581436+0000","last_clean":"2024-09-21T03:14:48.581436+0000","last_became_active":"2024-09-21T03:14:37.473218+0000","last_became_peered":"2024-09-21T03:14:37.473218+0000","last_unstale":"2024-09-21T03:14:48.581436+0000","last_undegraded":"2024-09-21T03:14:48.581436+0000","last_fullsized":"2024-09-21T03:14:48.581436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:49.006579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558777+0000","last_change":"2024-09-21T03:14:46.548858+0000","last_active":"2024-09-21T03:14:48.558777+0000","last_peered":"2024-09-21T03:14:48.558777+0000","last_clean":"2024-09-21T03:14:48.558777+0000","last_became_active":"2024-09-21T03:14:46.548166+0000","last_became_peered":"2024-09-21T03:14:46.548166+0000","last_unstale":"2024-09-21T03:14:48.558777+0000","last_undegraded":"2024-09-21T03:14:48.558777+0000","last_fullsized":"2024-09-21T03:14:48.558777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:41.470072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577431+0000","last_change":"2024-09-21T03:14:47.555787+0000","last_active":"2024-09-21T03:14:48.577431+0000","last_peered":"2024-09-21T03:14:48.577431+0000","last_clean":"2024-09-21T03:14:48.577431+0000","last_became_active":"2024-09-21T03:14:47.555420+0000","last_became_peered":"2024-09-21T03:14:47.555420+0000","last_unstale":"2024-09-21T03:14:48.577431+0000","last_undegraded":"2024-09-21T03:14:48.577431+0000","last_fullsized":"2024-09-21T03:14:48.577431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:45.769786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556963+0000","last_change":"2024-09-21T03:14:38.479657+0000","last_active":"2024-09-21T03:14:48.556963+0000","last_peered":"2024-09-21T03:14:48.556963+0000","last_clean":"2024-09-21T03:14:48.556963+0000","last_became_active":"2024-09-21T03:14:38.479439+0000","last_became_peered":"2024-09-21T03:14:38.479439+0000","last_unstale":"2024-09-21T03:14:48.556963+0000","last_undegraded":"2024-09-21T03:14:48.556963+0000","last_fullsized":"2024-09-21T03:14:48.556963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.107215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.559008+0000","last_change":"2024-09-21T03:14:37.469799+0000","last_active":"2024-09-21T03:14:48.559008+0000","last_peered":"2024-09-21T03:14:48.559008+0000","last_clean":"2024-09-21T03:14:48.559008+0000","last_became_active":"2024-09-21T03:14:37.469495+0000","last_became_peered":"2024-09-21T03:14:37.469495+0000","last_unstale":"2024-09-21T03:14:48.559008+0000","last_undegraded":"2024-09-21T03:14:48.559008+0000","last_fullsized":"2024-09-21T03:14:48.559008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:50.247050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557375+0000","last_change":"2024-09-21T03:14:46.544320+0000","last_active":"2024-09-21T03:14:48.557375+0000","last_peered":"2024-09-21T03:14:48.557375+0000","last_clean":"2024-09-21T03:14:48.557375+0000","last_became_active":"2024-09-21T03:14:46.544038+0000","last_became_peered":"2024-09-21T03:14:46.544038+0000","last_unstale":"2024-09-21T03:14:48.557375+0000","last_undegraded":"2024-09-21T03:14:48.557375+0000","last_fullsized":"2024-09-21T03:14:48.557375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:57.457687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.567034+0000","last_change":"2024-09-21T03:14:47.579698+0000","last_active":"2024-09-21T03:14:48.567034+0000","last_peered":"2024-09-21T03:14:48.567034+0000","last_clean":"2024-09-21T03:14:48.567034+0000","last_became_active":"2024-09-21T03:14:47.579324+0000","last_became_peered":"2024-09-21T03:14:47.579324+0000","last_unstale":"2024-09-21T03:14:48.567034+0000","last_undegraded":"2024-09-21T03:14:48.567034+0000","last_fullsized":"2024-09-21T03:14:48.567034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:37.656859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578191+0000","last_change":"2024-09-21T03:14:38.476763+0000","last_active":"2024-09-21T03:14:48.578191+0000","last_peered":"2024-09-21T03:14:48.578191+0000","last_clean":"2024-09-21T03:14:48.578191+0000","last_became_active":"2024-09-21T03:14:38.474299+0000","last_became_peered":"2024-09-21T03:14:38.474299+0000","last_unstale":"2024-09-21T03:14:48.578191+0000","last_undegraded":"2024-09-21T03:14:48.578191+0000","last_fullsized":"2024-09-21T03:14:48.578191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:46.544930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580641+0000","last_change":"2024-09-21T03:14:37.466857+0000","last_active":"2024-09-21T03:14:48.580641+0000","last_peered":"2024-09-21T03:14:48.580641+0000","last_clean":"2024-09-21T03:14:48.580641+0000","last_became_active":"2024-09-21T03:14:37.466256+0000","last_became_peered":"2024-09-21T03:14:37.466256+0000","last_unstale":"2024-09-21T03:14:48.580641+0000","last_undegraded":"2024-09-21T03:14:48.580641+0000","last_fullsized":"2024-09-21T03:14:48.580641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:02.240461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558502+0000","last_change":"2024-09-21T03:14:46.537315+0000","last_active":"2024-09-21T03:14:48.558502+0000","last_peered":"2024-09-21T03:14:48.558502+0000","last_clean":"2024-09-21T03:14:48.558502+0000","last_became_active":"2024-09-21T03:14:46.536975+0000","last_became_peered":"2024-09-21T03:14:46.536975+0000","last_unstale":"2024-09-21T03:14:48.558502+0000","last_undegraded":"2024-09-21T03:14:48.558502+0000","last_fullsized":"2024-09-21T03:14:48.558502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:42.529591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566848+0000","last_change":"2024-09-21T03:14:47.573009+0000","last_active":"2024-09-21T03:14:48.566848+0000","last_peered":"2024-09-21T03:14:48.566848+0000","last_clean":"2024-09-21T03:14:48.566848+0000","last_became_active":"2024-09-21T03:14:47.572395+0000","last_became_peered":"2024-09-21T03:14:47.572395+0000","last_unstale":"2024-09-21T03:14:48.566848+0000","last_undegraded":"2024-09-21T03:14:48.566848+0000","last_fullsized":"2024-09-21T03:14:48.566848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:41.733447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556923+0000","last_change":"2024-09-21T03:14:38.481801+0000","last_active":"2024-09-21T03:14:48.556923+0000","last_peered":"2024-09-21T03:14:48.556923+0000","last_clean":"2024-09-21T03:14:48.556923+0000","last_became_active":"2024-09-21T03:14:38.481186+0000","last_became_peered":"2024-09-21T03:14:38.481186+0000","last_unstale":"2024-09-21T03:14:48.556923+0000","last_undegraded":"2024-09-21T03:14:48.556923+0000","last_fullsized":"2024-09-21T03:14:48.556923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:54.271470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566292+0000","last_change":"2024-09-21T03:14:37.474798+0000","last_active":"2024-09-21T03:14:48.566292+0000","last_peered":"2024-09-21T03:14:48.566292+0000","last_clean":"2024-09-21T03:14:48.566292+0000","last_became_active":"2024-09-21T03:14:37.473829+0000","last_became_peered":"2024-09-21T03:14:37.473829+0000","last_unstale":"2024-09-21T03:14:48.566292+0000","last_undegraded":"2024-09-21T03:14:48.566292+0000","last_fullsized":"2024-09-21T03:14:48.566292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:11.571814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558227+0000","last_change":"2024-09-21T03:14:46.542495+0000","last_active":"2024-09-21T03:14:48.558227+0000","last_peered":"2024-09-21T03:14:48.558227+0000","last_clean":"2024-09-21T03:14:48.558227+0000","last_became_active":"2024-09-21T03:14:46.542181+0000","last_became_peered":"2024-09-21T03:14:46.542181+0000","last_unstale":"2024-09-21T03:14:48.558227+0000","last_undegraded":"2024-09-21T03:14:48.558227+0000","last_fullsized":"2024-09-21T03:14:48.558227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:22.481477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580850+0000","last_change":"2024-09-21T03:14:47.569409+0000","last_active":"2024-09-21T03:14:48.580850+0000","last_peered":"2024-09-21T03:14:48.580850+0000","last_clean":"2024-09-21T03:14:48.580850+0000","last_became_active":"2024-09-21T03:14:47.569212+0000","last_became_peered":"2024-09-21T03:14:47.569212+0000","last_unstale":"2024-09-21T03:14:48.580850+0000","last_undegraded":"2024-09-21T03:14:48.580850+0000","last_fullsized":"2024-09-21T03:14:48.580850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.851943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557644+0000","last_change":"2024-09-21T03:14:38.480026+0000","last_active":"2024-09-21T03:14:48.557644+0000","last_peered":"2024-09-21T03:14:48.557644+0000","last_clean":"2024-09-21T03:14:48.557644+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:14:48.557644+0000","last_undegraded":"2024-09-21T03:14:48.557644+0000","last_fullsized":"2024-09-21T03:14:48.557644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:20.481816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578131+0000","last_change":"2024-09-21T03:14:37.464554+0000","last_active":"2024-09-21T03:14:48.578131+0000","last_peered":"2024-09-21T03:14:48.578131+0000","last_clean":"2024-09-21T03:14:48.578131+0000","last_became_active":"2024-09-21T03:14:37.464228+0000","last_became_peered":"2024-09-21T03:14:37.464228+0000","last_unstale":"2024-09-21T03:14:48.578131+0000","last_undegraded":"2024-09-21T03:14:48.578131+0000","last_fullsized":"2024-09-21T03:14:48.578131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:32.529512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558894+0000","last_change":"2024-09-21T03:14:46.538538+0000","last_active":"2024-09-21T03:14:48.558894+0000","last_peered":"2024-09-21T03:14:48.558894+0000","last_clean":"2024-09-21T03:14:48.558894+0000","last_became_active":"2024-09-21T03:14:46.537815+0000","last_became_peered":"2024-09-21T03:14:46.537815+0000","last_unstale":"2024-09-21T03:14:48.558894+0000","last_undegraded":"2024-09-21T03:14:48.558894+0000","last_fullsized":"2024-09-21T03:14:48.558894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:42.264439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578432+0000","last_change":"2024-09-21T03:14:47.558861+0000","last_active":"2024-09-21T03:14:48.578432+0000","last_peered":"2024-09-21T03:14:48.578432+0000","last_clean":"2024-09-21T03:14:48.578432+0000","last_became_active":"2024-09-21T03:14:47.557305+0000","last_became_peered":"2024-09-21T03:14:47.557305+0000","last_unstale":"2024-09-21T03:14:48.578432+0000","last_undegraded":"2024-09-21T03:14:48.578432+0000","last_fullsized":"2024-09-21T03:14:48.578432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:45.962367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577698+0000","last_change":"2024-09-21T03:14:38.479181+0000","last_active":"2024-09-21T03:14:48.577698+0000","last_peered":"2024-09-21T03:14:48.577698+0000","last_clean":"2024-09-21T03:14:48.577698+0000","last_became_active":"2024-09-21T03:14:38.478842+0000","last_became_peered":"2024-09-21T03:14:38.478842+0000","last_unstale":"2024-09-21T03:14:48.577698+0000","last_undegraded":"2024-09-21T03:14:48.577698+0000","last_fullsized":"2024-09-21T03:14:48.577698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:08.664381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580210+0000","last_change":"2024-09-21T03:14:37.463990+0000","last_active":"2024-09-21T03:14:48.580210+0000","last_peered":"2024-09-21T03:14:48.580210+0000","last_clean":"2024-09-21T03:14:48.580210+0000","last_became_active":"2024-09-21T03:14:37.463674+0000","last_became_peered":"2024-09-21T03:14:37.463674+0000","last_unstale":"2024-09-21T03:14:48.580210+0000","last_undegraded":"2024-09-21T03:14:48.580210+0000","last_fullsized":"2024-09-21T03:14:48.580210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:35.391985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577246+0000","last_change":"2024-09-21T03:14:26.342355+0000","last_active":"2024-09-21T03:14:48.577246+0000","last_peered":"2024-09-21T03:14:48.577246+0000","last_clean":"2024-09-21T03:14:48.577246+0000","last_became_active":"2024-09-21T03:14:26.341929+0000","last_became_peered":"2024-09-21T03:14:26.341929+0000","last_unstale":"2024-09-21T03:14:48.577246+0000","last_undegraded":"2024-09-21T03:14:48.577246+0000","last_fullsized":"2024-09-21T03:14:48.577246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_clean_scrub_stamp":"2024-09-21T03:14:25.329650+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:45.390822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581358+0000","last_change":"2024-09-21T03:14:46.538184+0000","last_active":"2024-09-21T03:14:48.581358+0000","last_peered":"2024-09-21T03:14:48.581358+0000","last_clean":"2024-09-21T03:14:48.581358+0000","last_became_active":"2024-09-21T03:14:46.536753+0000","last_became_peered":"2024-09-21T03:14:46.536753+0000","last_unstale":"2024-09-21T03:14:48.581358+0000","last_undegraded":"2024-09-21T03:14:48.581358+0000","last_fullsized":"2024-09-21T03:14:48.581358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:49.078638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558519+0000","last_change":"2024-09-21T03:14:47.552966+0000","last_active":"2024-09-21T03:14:48.558519+0000","last_peered":"2024-09-21T03:14:48.558519+0000","last_clean":"2024-09-21T03:14:48.558519+0000","last_became_active":"2024-09-21T03:14:47.552642+0000","last_became_peered":"2024-09-21T03:14:47.552642+0000","last_unstale":"2024-09-21T03:14:48.558519+0000","last_undegraded":"2024-09-21T03:14:48.558519+0000","last_fullsized":"2024-09-21T03:14:48.558519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:15.928026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581346+0000","last_change":"2024-09-21T03:14:38.478414+0000","last_active":"2024-09-21T03:14:48.581346+0000","last_peered":"2024-09-21T03:14:48.581346+0000","last_clean":"2024-09-21T03:14:48.581346+0000","last_became_active":"2024-09-21T03:14:38.478116+0000","last_became_peered":"2024-09-21T03:14:38.478116+0000","last_unstale":"2024-09-21T03:14:48.581346+0000","last_undegraded":"2024-09-21T03:14:48.581346+0000","last_fullsized":"2024-09-21T03:14:48.581346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:29.618008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558850+0000","last_change":"2024-09-21T03:14:37.479578+0000","last_active":"2024-09-21T03:14:48.558850+0000","last_peered":"2024-09-21T03:14:48.558850+0000","last_clean":"2024-09-21T03:14:48.558850+0000","last_became_active":"2024-09-21T03:14:37.479284+0000","last_became_peered":"2024-09-21T03:14:37.479284+0000","last_unstale":"2024-09-21T03:14:48.558850+0000","last_undegraded":"2024-09-21T03:14:48.558850+0000","last_fullsized":"2024-09-21T03:14:48.558850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:15.732230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556655+0000","last_change":"2024-09-21T03:14:46.531536+0000","last_active":"2024-09-21T03:14:48.556655+0000","last_peered":"2024-09-21T03:14:48.556655+0000","last_clean":"2024-09-21T03:14:48.556655+0000","last_became_active":"2024-09-21T03:14:46.531069+0000","last_became_peered":"2024-09-21T03:14:46.531069+0000","last_unstale":"2024-09-21T03:14:48.556655+0000","last_undegraded":"2024-09-21T03:14:48.556655+0000","last_fullsized":"2024-09-21T03:14:48.556655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:14.050618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557238+0000","last_change":"2024-09-21T03:14:47.553039+0000","last_active":"2024-09-21T03:14:48.557238+0000","last_peered":"2024-09-21T03:14:48.557238+0000","last_clean":"2024-09-21T03:14:48.557238+0000","last_became_active":"2024-09-21T03:14:47.552712+0000","last_became_peered":"2024-09-21T03:14:47.552712+0000","last_unstale":"2024-09-21T03:14:48.557238+0000","last_undegraded":"2024-09-21T03:14:48.557238+0000","last_fullsized":"2024-09-21T03:14:48.557238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:32.630319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578701+0000","last_change":"2024-09-21T03:14:38.488259+0000","last_active":"2024-09-21T03:14:48.578701+0000","last_peered":"2024-09-21T03:14:48.578701+0000","last_clean":"2024-09-21T03:14:48.578701+0000","last_became_active":"2024-09-21T03:14:38.487420+0000","last_became_peered":"2024-09-21T03:14:38.487420+0000","last_unstale":"2024-09-21T03:14:48.578701+0000","last_undegraded":"2024-09-21T03:14:48.578701+0000","last_fullsized":"2024-09-21T03:14:48.578701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:48.003893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.559532+0000","last_change":"2024-09-21T03:14:37.460763+0000","last_active":"2024-09-21T03:14:48.559532+0000","last_peered":"2024-09-21T03:14:48.559532+0000","last_clean":"2024-09-21T03:14:48.559532+0000","last_became_active":"2024-09-21T03:14:37.460320+0000","last_became_peered":"2024-09-21T03:14:37.460320+0000","last_unstale":"2024-09-21T03:14:48.559532+0000","last_undegraded":"2024-09-21T03:14:48.559532+0000","last_fullsized":"2024-09-21T03:14:48.559532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.907794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558692+0000","last_change":"2024-09-21T03:14:46.540901+0000","last_active":"2024-09-21T03:14:48.558692+0000","last_peered":"2024-09-21T03:14:48.558692+0000","last_clean":"2024-09-21T03:14:48.558692+0000","last_became_active":"2024-09-21T03:14:46.540182+0000","last_became_peered":"2024-09-21T03:14:46.540182+0000","last_unstale":"2024-09-21T03:14:48.558692+0000","last_undegraded":"2024-09-21T03:14:48.558692+0000","last_fullsized":"2024-09-21T03:14:48.558692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:38.416663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577089+0000","last_change":"2024-09-21T03:14:47.553810+0000","last_active":"2024-09-21T03:14:48.577089+0000","last_peered":"2024-09-21T03:14:48.577089+0000","last_clean":"2024-09-21T03:14:48.577089+0000","last_became_active":"2024-09-21T03:14:47.552371+0000","last_became_peered":"2024-09-21T03:14:47.552371+0000","last_unstale":"2024-09-21T03:14:48.577089+0000","last_undegraded":"2024-09-21T03:14:48.577089+0000","last_fullsized":"2024-09-21T03:14:48.577089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:38.659512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579745+0000","last_change":"2024-09-21T03:14:38.480629+0000","last_active":"2024-09-21T03:14:48.579745+0000","last_peered":"2024-09-21T03:14:48.579745+0000","last_clean":"2024-09-21T03:14:48.579745+0000","last_became_active":"2024-09-21T03:14:38.474135+0000","last_became_peered":"2024-09-21T03:14:38.474135+0000","last_unstale":"2024-09-21T03:14:48.579745+0000","last_undegraded":"2024-09-21T03:14:48.579745+0000","last_fullsized":"2024-09-21T03:14:48.579745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:36.171044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578278+0000","last_change":"2024-09-21T03:14:37.472491+0000","last_active":"2024-09-21T03:14:48.578278+0000","last_peered":"2024-09-21T03:14:48.578278+0000","last_clean":"2024-09-21T03:14:48.578278+0000","last_became_active":"2024-09-21T03:14:37.472164+0000","last_became_peered":"2024-09-21T03:14:37.472164+0000","last_unstale":"2024-09-21T03:14:48.578278+0000","last_undegraded":"2024-09-21T03:14:48.578278+0000","last_fullsized":"2024-09-21T03:14:48.578278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.498178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577656+0000","last_change":"2024-09-21T03:14:46.544828+0000","last_active":"2024-09-21T03:14:48.577656+0000","last_peered":"2024-09-21T03:14:48.577656+0000","last_clean":"2024-09-21T03:14:48.577656+0000","last_became_active":"2024-09-21T03:14:46.535901+0000","last_became_peered":"2024-09-21T03:14:46.535901+0000","last_unstale":"2024-09-21T03:14:48.577656+0000","last_undegraded":"2024-09-21T03:14:48.577656+0000","last_fullsized":"2024-09-21T03:14:48.577656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:08.608530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557424+0000","last_change":"2024-09-21T03:14:47.556478+0000","last_active":"2024-09-21T03:14:48.557424+0000","last_peered":"2024-09-21T03:14:48.557424+0000","last_clean":"2024-09-21T03:14:48.557424+0000","last_became_active":"2024-09-21T03:14:47.556145+0000","last_became_peered":"2024-09-21T03:14:47.556145+0000","last_unstale":"2024-09-21T03:14:48.557424+0000","last_undegraded":"2024-09-21T03:14:48.557424+0000","last_fullsized":"2024-09-21T03:14:48.557424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:59.004648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557482+0000","last_change":"2024-09-21T03:14:38.469502+0000","last_active":"2024-09-21T03:14:48.557482+0000","last_peered":"2024-09-21T03:14:48.557482+0000","last_clean":"2024-09-21T03:14:48.557482+0000","last_became_active":"2024-09-21T03:14:38.468972+0000","last_became_peered":"2024-09-21T03:14:38.468972+0000","last_unstale":"2024-09-21T03:14:48.557482+0000","last_undegraded":"2024-09-21T03:14:48.557482+0000","last_fullsized":"2024-09-21T03:14:48.557482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579796+0000","last_change":"2024-09-21T03:14:37.480905+0000","last_active":"2024-09-21T03:14:48.579796+0000","last_peered":"2024-09-21T03:14:48.579796+0000","last_clean":"2024-09-21T03:14:48.579796+0000","last_became_active":"2024-09-21T03:14:37.478227+0000","last_became_peered":"2024-09-21T03:14:37.478227+0000","last_unstale":"2024-09-21T03:14:48.579796+0000","last_undegraded":"2024-09-21T03:14:48.579796+0000","last_fullsized":"2024-09-21T03:14:48.579796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:42.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577322+0000","last_change":"2024-09-21T03:14:46.536103+0000","last_active":"2024-09-21T03:14:48.577322+0000","last_peered":"2024-09-21T03:14:48.577322+0000","last_clean":"2024-09-21T03:14:48.577322+0000","last_became_active":"2024-09-21T03:14:46.535445+0000","last_became_peered":"2024-09-21T03:14:46.535445+0000","last_unstale":"2024-09-21T03:14:48.577322+0000","last_undegraded":"2024-09-21T03:14:48.577322+0000","last_fullsized":"2024-09-21T03:14:48.577322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:59.078000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578149+0000","last_change":"2024-09-21T03:14:47.557503+0000","last_active":"2024-09-21T03:14:48.578149+0000","last_peered":"2024-09-21T03:14:48.578149+0000","last_clean":"2024-09-21T03:14:48.578149+0000","last_became_active":"2024-09-21T03:14:47.554366+0000","last_became_peered":"2024-09-21T03:14:47.554366+0000","last_unstale":"2024-09-21T03:14:48.578149+0000","last_undegraded":"2024-09-21T03:14:48.578149+0000","last_fullsized":"2024-09-21T03:14:48.578149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.994560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579154+0000","last_change":"2024-09-21T03:14:38.479516+0000","last_active":"2024-09-21T03:14:48.579154+0000","last_peered":"2024-09-21T03:14:48.579154+0000","last_clean":"2024-09-21T03:14:48.579154+0000","last_became_active":"2024-09-21T03:14:38.474826+0000","last_became_peered":"2024-09-21T03:14:38.474826+0000","last_unstale":"2024-09-21T03:14:48.579154+0000","last_undegraded":"2024-09-21T03:14:48.579154+0000","last_fullsized":"2024-09-21T03:14:48.579154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:22.181411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577156+0000","last_change":"2024-09-21T03:14:37.471063+0000","last_active":"2024-09-21T03:14:48.577156+0000","last_peered":"2024-09-21T03:14:48.577156+0000","last_clean":"2024-09-21T03:14:48.577156+0000","last_became_active":"2024-09-21T03:14:37.470720+0000","last_became_peered":"2024-09-21T03:14:37.470720+0000","last_unstale":"2024-09-21T03:14:48.577156+0000","last_undegraded":"2024-09-21T03:14:48.577156+0000","last_fullsized":"2024-09-21T03:14:48.577156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:00.054692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558350+0000","last_change":"2024-09-21T03:14:46.538665+0000","last_active":"2024-09-21T03:14:48.558350+0000","last_peered":"2024-09-21T03:14:48.558350+0000","last_clean":"2024-09-21T03:14:48.558350+0000","last_became_active":"2024-09-21T03:14:46.537774+0000","last_became_peered":"2024-09-21T03:14:46.537774+0000","last_unstale":"2024-09-21T03:14:48.558350+0000","last_undegraded":"2024-09-21T03:14:48.558350+0000","last_fullsized":"2024-09-21T03:14:48.558350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:07.736404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580727+0000","last_change":"2024-09-21T03:14:47.553011+0000","last_active":"2024-09-21T03:14:48.580727+0000","last_peered":"2024-09-21T03:14:48.580727+0000","last_clean":"2024-09-21T03:14:48.580727+0000","last_became_active":"2024-09-21T03:14:47.552700+0000","last_became_peered":"2024-09-21T03:14:47.552700+0000","last_unstale":"2024-09-21T03:14:48.580727+0000","last_undegraded":"2024-09-21T03:14:48.580727+0000","last_fullsized":"2024-09-21T03:14:48.580727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:58.780132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577072+0000","last_change":"2024-09-21T03:14:38.472906+0000","last_active":"2024-09-21T03:14:48.577072+0000","last_peered":"2024-09-21T03:14:48.577072+0000","last_clean":"2024-09-21T03:14:48.577072+0000","last_became_active":"2024-09-21T03:14:38.471933+0000","last_became_peered":"2024-09-21T03:14:38.471933+0000","last_unstale":"2024-09-21T03:14:48.577072+0000","last_undegraded":"2024-09-21T03:14:48.577072+0000","last_fullsized":"2024-09-21T03:14:48.577072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:05.395821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577473+0000","last_change":"2024-09-21T03:14:37.478714+0000","last_active":"2024-09-21T03:14:48.577473+0000","last_peered":"2024-09-21T03:14:48.577473+0000","last_clean":"2024-09-21T03:14:48.577473+0000","last_became_active":"2024-09-21T03:14:37.477951+0000","last_became_peered":"2024-09-21T03:14:37.477951+0000","last_unstale":"2024-09-21T03:14:48.577473+0000","last_undegraded":"2024-09-21T03:14:48.577473+0000","last_fullsized":"2024-09-21T03:14:48.577473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:42.529545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557789+0000","last_change":"2024-09-21T03:14:46.546142+0000","last_active":"2024-09-21T03:14:48.557789+0000","last_peered":"2024-09-21T03:14:48.557789+0000","last_clean":"2024-09-21T03:14:48.557789+0000","last_became_active":"2024-09-21T03:14:46.545865+0000","last_became_peered":"2024-09-21T03:14:46.545865+0000","last_unstale":"2024-09-21T03:14:48.557789+0000","last_undegraded":"2024-09-21T03:14:48.557789+0000","last_fullsized":"2024-09-21T03:14:48.557789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:11.705309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580406+0000","last_change":"2024-09-21T03:14:47.568961+0000","last_active":"2024-09-21T03:14:48.580406+0000","last_peered":"2024-09-21T03:14:48.580406+0000","last_clean":"2024-09-21T03:14:48.580406+0000","last_became_active":"2024-09-21T03:14:47.568656+0000","last_became_peered":"2024-09-21T03:14:47.568656+0000","last_unstale":"2024-09-21T03:14:48.580406+0000","last_undegraded":"2024-09-21T03:14:48.580406+0000","last_fullsized":"2024-09-21T03:14:48.580406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.041710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580087+0000","last_change":"2024-09-21T03:14:38.485454+0000","last_active":"2024-09-21T03:14:48.580087+0000","last_peered":"2024-09-21T03:14:48.580087+0000","last_clean":"2024-09-21T03:14:48.580087+0000","last_became_active":"2024-09-21T03:14:38.485235+0000","last_became_peered":"2024-09-21T03:14:38.485235+0000","last_unstale":"2024-09-21T03:14:48.580087+0000","last_undegraded":"2024-09-21T03:14:48.580087+0000","last_fullsized":"2024-09-21T03:14:48.580087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:11.585637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580507+0000","last_change":"2024-09-21T03:14:37.466544+0000","last_active":"2024-09-21T03:14:48.580507+0000","last_peered":"2024-09-21T03:14:48.580507+0000","last_clean":"2024-09-21T03:14:48.580507+0000","last_became_active":"2024-09-21T03:14:37.465817+0000","last_became_peered":"2024-09-21T03:14:37.465817+0000","last_unstale":"2024-09-21T03:14:48.580507+0000","last_undegraded":"2024-09-21T03:14:48.580507+0000","last_fullsized":"2024-09-21T03:14:48.580507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:36.113483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558395+0000","last_change":"2024-09-21T03:14:46.549921+0000","last_active":"2024-09-21T03:14:48.558395+0000","last_peered":"2024-09-21T03:14:48.558395+0000","last_clean":"2024-09-21T03:14:48.558395+0000","last_became_active":"2024-09-21T03:14:46.549119+0000","last_became_peered":"2024-09-21T03:14:46.549119+0000","last_unstale":"2024-09-21T03:14:48.558395+0000","last_undegraded":"2024-09-21T03:14:48.558395+0000","last_fullsized":"2024-09-21T03:14:48.558395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:09.622498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577943+0000","last_change":"2024-09-21T03:14:47.577090+0000","last_active":"2024-09-21T03:14:48.577943+0000","last_peered":"2024-09-21T03:14:48.577943+0000","last_clean":"2024-09-21T03:14:48.577943+0000","last_became_active":"2024-09-21T03:14:47.576098+0000","last_became_peered":"2024-09-21T03:14:47.576098+0000","last_unstale":"2024-09-21T03:14:48.577943+0000","last_undegraded":"2024-09-21T03:14:48.577943+0000","last_fullsized":"2024-09-21T03:14:48.577943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:33.414103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557891+0000","last_change":"2024-09-21T03:14:38.482528+0000","last_active":"2024-09-21T03:14:48.557891+0000","last_peered":"2024-09-21T03:14:48.557891+0000","last_clean":"2024-09-21T03:14:48.557891+0000","last_became_active":"2024-09-21T03:14:38.482241+0000","last_became_peered":"2024-09-21T03:14:38.482241+0000","last_unstale":"2024-09-21T03:14:48.557891+0000","last_undegraded":"2024-09-21T03:14:48.557891+0000","last_fullsized":"2024-09-21T03:14:48.557891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:23.110703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566561+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:14:48.566561+0000","last_peered":"2024-09-21T03:14:48.566561+0000","last_clean":"2024-09-21T03:14:48.566561+0000","last_became_active":"2024-09-21T03:14:37.478882+0000","last_became_peered":"2024-09-21T03:14:37.478882+0000","last_unstale":"2024-09-21T03:14:48.566561+0000","last_undegraded":"2024-09-21T03:14:48.566561+0000","last_fullsized":"2024-09-21T03:14:48.566561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:11.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581263+0000","last_change":"2024-09-21T03:14:46.538817+0000","last_active":"2024-09-21T03:14:48.581263+0000","last_peered":"2024-09-21T03:14:48.581263+0000","last_clean":"2024-09-21T03:14:48.581263+0000","last_became_active":"2024-09-21T03:14:46.537835+0000","last_became_peered":"2024-09-21T03:14:46.537835+0000","last_unstale":"2024-09-21T03:14:48.581263+0000","last_undegraded":"2024-09-21T03:14:48.581263+0000","last_fullsized":"2024-09-21T03:14:48.581263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:08.236663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577368+0000","last_change":"2024-09-21T03:14:47.566534+0000","last_active":"2024-09-21T03:14:48.577368+0000","last_peered":"2024-09-21T03:14:48.577368+0000","last_clean":"2024-09-21T03:14:48.577368+0000","last_became_active":"2024-09-21T03:14:47.566157+0000","last_became_peered":"2024-09-21T03:14:47.566157+0000","last_unstale":"2024-09-21T03:14:48.577368+0000","last_undegraded":"2024-09-21T03:14:48.577368+0000","last_fullsized":"2024-09-21T03:14:48.577368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:35.557811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579586+0000","last_change":"2024-09-21T03:14:38.478509+0000","last_active":"2024-09-21T03:14:48.579586+0000","last_peered":"2024-09-21T03:14:48.579586+0000","last_clean":"2024-09-21T03:14:48.579586+0000","last_became_active":"2024-09-21T03:14:38.478197+0000","last_became_peered":"2024-09-21T03:14:38.478197+0000","last_unstale":"2024-09-21T03:14:48.579586+0000","last_undegraded":"2024-09-21T03:14:48.579586+0000","last_fullsized":"2024-09-21T03:14:48.579586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.411134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557313+0000","last_change":"2024-09-21T03:14:37.472695+0000","last_active":"2024-09-21T03:14:48.557313+0000","last_peered":"2024-09-21T03:14:48.557313+0000","last_clean":"2024-09-21T03:14:48.557313+0000","last_became_active":"2024-09-21T03:14:37.472374+0000","last_became_peered":"2024-09-21T03:14:37.472374+0000","last_unstale":"2024-09-21T03:14:48.557313+0000","last_undegraded":"2024-09-21T03:14:48.557313+0000","last_fullsized":"2024-09-21T03:14:48.557313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:11.245914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577140+0000","last_change":"2024-09-21T03:14:46.547433+0000","last_active":"2024-09-21T03:14:48.577140+0000","last_peered":"2024-09-21T03:14:48.577140+0000","last_clean":"2024-09-21T03:14:48.577140+0000","last_became_active":"2024-09-21T03:14:46.547192+0000","last_became_peered":"2024-09-21T03:14:46.547192+0000","last_unstale":"2024-09-21T03:14:48.577140+0000","last_undegraded":"2024-09-21T03:14:48.577140+0000","last_fullsized":"2024-09-21T03:14:48.577140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:03.238245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557599+0000","last_change":"2024-09-21T03:14:47.545827+0000","last_active":"2024-09-21T03:14:48.557599+0000","last_peered":"2024-09-21T03:14:48.557599+0000","last_clean":"2024-09-21T03:14:48.557599+0000","last_became_active":"2024-09-21T03:14:47.545440+0000","last_became_peered":"2024-09-21T03:14:47.545440+0000","last_unstale":"2024-09-21T03:14:48.557599+0000","last_undegraded":"2024-09-21T03:14:48.557599+0000","last_fullsized":"2024-09-21T03:14:48.557599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:20.532645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580151+0000","last_change":"2024-09-21T03:14:38.476564+0000","last_active":"2024-09-21T03:14:48.580151+0000","last_peered":"2024-09-21T03:14:48.580151+0000","last_clean":"2024-09-21T03:14:48.580151+0000","last_became_active":"2024-09-21T03:14:38.476158+0000","last_became_peered":"2024-09-21T03:14:38.476158+0000","last_unstale":"2024-09-21T03:14:48.580151+0000","last_undegraded":"2024-09-21T03:14:48.580151+0000","last_fullsized":"2024-09-21T03:14:48.580151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:26.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.567071+0000","last_change":"2024-09-21T03:14:37.473709+0000","last_active":"2024-09-21T03:14:48.567071+0000","last_peered":"2024-09-21T03:14:48.567071+0000","last_clean":"2024-09-21T03:14:48.567071+0000","last_became_active":"2024-09-21T03:14:37.472544+0000","last_became_peered":"2024-09-21T03:14:37.472544+0000","last_unstale":"2024-09-21T03:14:48.567071+0000","last_undegraded":"2024-09-21T03:14:48.567071+0000","last_fullsized":"2024-09-21T03:14:48.567071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:47.892146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556540+0000","last_change":"2024-09-21T03:14:46.534201+0000","last_active":"2024-09-21T03:14:48.556540+0000","last_peered":"2024-09-21T03:14:48.556540+0000","last_clean":"2024-09-21T03:14:48.556540+0000","last_became_active":"2024-09-21T03:14:46.533891+0000","last_became_peered":"2024-09-21T03:14:46.533891+0000","last_unstale":"2024-09-21T03:14:48.556540+0000","last_undegraded":"2024-09-21T03:14:48.556540+0000","last_fullsized":"2024-09-21T03:14:48.556540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:06.645173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579059+0000","last_change":"2024-09-21T03:14:47.552016+0000","last_active":"2024-09-21T03:14:48.579059+0000","last_peered":"2024-09-21T03:14:48.579059+0000","last_clean":"2024-09-21T03:14:48.579059+0000","last_became_active":"2024-09-21T03:14:47.551622+0000","last_became_peered":"2024-09-21T03:14:47.551622+0000","last_unstale":"2024-09-21T03:14:48.579059+0000","last_undegraded":"2024-09-21T03:14:48.579059+0000","last_fullsized":"2024-09-21T03:14:48.579059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:56:04.849535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558475+0000","last_change":"2024-09-21T03:14:38.484757+0000","last_active":"2024-09-21T03:14:48.558475+0000","last_peered":"2024-09-21T03:14:48.558475+0000","last_clean":"2024-09-21T03:14:48.558475+0000","last_became_active":"2024-09-21T03:14:38.483348+0000","last_became_peered":"2024-09-21T03:14:38.483348+0000","last_unstale":"2024-09-21T03:14:48.558475+0000","last_undegraded":"2024-09-21T03:14:48.558475+0000","last_fullsized":"2024-09-21T03:14:48.558475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:57.697723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579637+0000","last_change":"2024-09-21T03:14:37.479047+0000","last_active":"2024-09-21T03:14:48.579637+0000","last_peered":"2024-09-21T03:14:48.579637+0000","last_clean":"2024-09-21T03:14:48.579637+0000","last_became_active":"2024-09-21T03:14:37.478700+0000","last_became_peered":"2024-09-21T03:14:37.478700+0000","last_unstale":"2024-09-21T03:14:48.579637+0000","last_undegraded":"2024-09-21T03:14:48.579637+0000","last_fullsized":"2024-09-21T03:14:48.579637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:31.702450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566046+0000","last_change":"2024-09-21T03:14:46.547287+0000","last_active":"2024-09-21T03:14:48.566046+0000","last_peered":"2024-09-21T03:14:48.566046+0000","last_clean":"2024-09-21T03:14:48.566046+0000","last_became_active":"2024-09-21T03:14:46.546867+0000","last_became_peered":"2024-09-21T03:14:46.546867+0000","last_unstale":"2024-09-21T03:14:48.566046+0000","last_undegraded":"2024-09-21T03:14:48.566046+0000","last_fullsized":"2024-09-21T03:14:48.566046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:54.119841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556239+0000","last_change":"2024-09-21T03:14:47.558571+0000","last_active":"2024-09-21T03:14:48.556239+0000","last_peered":"2024-09-21T03:14:48.556239+0000","last_clean":"2024-09-21T03:14:48.556239+0000","last_became_active":"2024-09-21T03:14:47.558037+0000","last_became_peered":"2024-09-21T03:14:47.558037+0000","last_unstale":"2024-09-21T03:14:48.556239+0000","last_undegraded":"2024-09-21T03:14:48.556239+0000","last_fullsized":"2024-09-21T03:14:48.556239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:42.564181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557395+0000","last_change":"2024-09-21T03:14:38.488227+0000","last_active":"2024-09-21T03:14:48.557395+0000","last_peered":"2024-09-21T03:14:48.557395+0000","last_clean":"2024-09-21T03:14:48.557395+0000","last_became_active":"2024-09-21T03:14:38.482370+0000","last_became_peered":"2024-09-21T03:14:38.482370+0000","last_unstale":"2024-09-21T03:14:48.557395+0000","last_undegraded":"2024-09-21T03:14:48.557395+0000","last_fullsized":"2024-09-21T03:14:48.557395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:52.561391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580228+0000","last_change":"2024-09-21T03:14:37.471363+0000","last_active":"2024-09-21T03:14:48.580228+0000","last_peered":"2024-09-21T03:14:48.580228+0000","last_clean":"2024-09-21T03:14:48.580228+0000","last_became_active":"2024-09-21T03:14:37.471002+0000","last_became_peered":"2024-09-21T03:14:37.471002+0000","last_unstale":"2024-09-21T03:14:48.580228+0000","last_undegraded":"2024-09-21T03:14:48.580228+0000","last_fullsized":"2024-09-21T03:14:48.580228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:25.922368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.576862+0000","last_change":"2024-09-21T03:14:46.545186+0000","last_active":"2024-09-21T03:14:48.576862+0000","last_peered":"2024-09-21T03:14:48.576862+0000","last_clean":"2024-09-21T03:14:48.576862+0000","last_became_active":"2024-09-21T03:14:46.543647+0000","last_became_peered":"2024-09-21T03:14:46.543647+0000","last_unstale":"2024-09-21T03:14:48.576862+0000","last_undegraded":"2024-09-21T03:14:48.576862+0000","last_fullsized":"2024-09-21T03:14:48.576862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:03.097368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557625+0000","last_change":"2024-09-21T03:14:47.554766+0000","last_active":"2024-09-21T03:14:48.557625+0000","last_peered":"2024-09-21T03:14:48.557625+0000","last_clean":"2024-09-21T03:14:48.557625+0000","last_became_active":"2024-09-21T03:14:47.551563+0000","last_became_peered":"2024-09-21T03:14:47.551563+0000","last_unstale":"2024-09-21T03:14:48.557625+0000","last_undegraded":"2024-09-21T03:14:48.557625+0000","last_fullsized":"2024-09-21T03:14:48.557625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:08.790725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577735+0000","last_change":"2024-09-21T03:14:46.542659+0000","last_active":"2024-09-21T03:14:48.577735+0000","last_peered":"2024-09-21T03:14:48.577735+0000","last_clean":"2024-09-21T03:14:48.577735+0000","last_became_active":"2024-09-21T03:14:46.541771+0000","last_became_peered":"2024-09-21T03:14:46.541771+0000","last_unstale":"2024-09-21T03:14:48.577735+0000","last_undegraded":"2024-09-21T03:14:48.577735+0000","last_fullsized":"2024-09-21T03:14:48.577735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:45.543904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577243+0000","last_change":"2024-09-21T03:14:38.481837+0000","last_active":"2024-09-21T03:14:48.577243+0000","last_peered":"2024-09-21T03:14:48.577243+0000","last_clean":"2024-09-21T03:14:48.577243+0000","last_became_active":"2024-09-21T03:14:38.478400+0000","last_became_peered":"2024-09-21T03:14:38.478400+0000","last_unstale":"2024-09-21T03:14:48.577243+0000","last_undegraded":"2024-09-21T03:14:48.577243+0000","last_fullsized":"2024-09-21T03:14:48.577243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.702185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578051+0000","last_change":"2024-09-21T03:14:37.459351+0000","last_active":"2024-09-21T03:14:48.578051+0000","last_peered":"2024-09-21T03:14:48.578051+0000","last_clean":"2024-09-21T03:14:48.578051+0000","last_became_active":"2024-09-21T03:14:37.458676+0000","last_became_peered":"2024-09-21T03:14:37.458676+0000","last_unstale":"2024-09-21T03:14:48.578051+0000","last_undegraded":"2024-09-21T03:14:48.578051+0000","last_fullsized":"2024-09-21T03:14:48.578051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:42.671520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558462+0000","last_change":"2024-09-21T03:14:47.561232+0000","last_active":"2024-09-21T03:14:48.558462+0000","last_peered":"2024-09-21T03:14:48.558462+0000","last_clean":"2024-09-21T03:14:48.558462+0000","last_became_active":"2024-09-21T03:14:47.557224+0000","last_became_peered":"2024-09-21T03:14:47.557224+0000","last_unstale":"2024-09-21T03:14:48.558462+0000","last_undegraded":"2024-09-21T03:14:48.558462+0000","last_fullsized":"2024-09-21T03:14:48.558462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:09.611235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580814+0000","last_change":"2024-09-21T03:14:46.543157+0000","last_active":"2024-09-21T03:14:48.580814+0000","last_peered":"2024-09-21T03:14:48.580814+0000","last_clean":"2024-09-21T03:14:48.580814+0000","last_became_active":"2024-09-21T03:14:46.542746+0000","last_became_peered":"2024-09-21T03:14:46.542746+0000","last_unstale":"2024-09-21T03:14:48.580814+0000","last_undegraded":"2024-09-21T03:14:48.580814+0000","last_fullsized":"2024-09-21T03:14:48.580814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:30.644843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557713+0000","last_change":"2024-09-21T03:14:38.480723+0000","last_active":"2024-09-21T03:14:48.557713+0000","last_peered":"2024-09-21T03:14:48.557713+0000","last_clean":"2024-09-21T03:14:48.557713+0000","last_became_active":"2024-09-21T03:14:38.472823+0000","last_became_peered":"2024-09-21T03:14:38.472823+0000","last_unstale":"2024-09-21T03:14:48.557713+0000","last_undegraded":"2024-09-21T03:14:48.557713+0000","last_fullsized":"2024-09-21T03:14:48.557713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:59.862592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557827+0000","last_change":"2024-09-21T03:14:37.472209+0000","last_active":"2024-09-21T03:14:48.557827+0000","last_peered":"2024-09-21T03:14:48.557827+0000","last_clean":"2024-09-21T03:14:48.557827+0000","last_became_active":"2024-09-21T03:14:37.471771+0000","last_became_peered":"2024-09-21T03:14:37.471771+0000","last_unstale":"2024-09-21T03:14:48.557827+0000","last_undegraded":"2024-09-21T03:14:48.557827+0000","last_fullsized":"2024-09-21T03:14:48.557827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:30.648010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577935+0000","last_change":"2024-09-21T03:14:47.570651+0000","last_active":"2024-09-21T03:14:48.577935+0000","last_peered":"2024-09-21T03:14:48.577935+0000","last_clean":"2024-09-21T03:14:48.577935+0000","last_became_active":"2024-09-21T03:14:47.568081+0000","last_became_peered":"2024-09-21T03:14:47.568081+0000","last_unstale":"2024-09-21T03:14:48.577935+0000","last_undegraded":"2024-09-21T03:14:48.577935+0000","last_fullsized":"2024-09-21T03:14:48.577935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:45.036938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580418+0000","last_change":"2024-09-21T03:14:37.475076+0000","last_active":"2024-09-21T03:14:48.580418+0000","last_peered":"2024-09-21T03:14:48.580418+0000","last_clean":"2024-09-21T03:14:48.580418+0000","last_became_active":"2024-09-21T03:14:37.474595+0000","last_became_peered":"2024-09-21T03:14:37.474595+0000","last_unstale":"2024-09-21T03:14:48.580418+0000","last_undegraded":"2024-09-21T03:14:48.580418+0000","last_fullsized":"2024-09-21T03:14:48.580418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:16.880647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577631+0000","last_change":"2024-09-21T03:14:38.483226+0000","last_active":"2024-09-21T03:14:48.577631+0000","last_peered":"2024-09-21T03:14:48.577631+0000","last_clean":"2024-09-21T03:14:48.577631+0000","last_became_active":"2024-09-21T03:14:38.482354+0000","last_became_peered":"2024-09-21T03:14:38.482354+0000","last_unstale":"2024-09-21T03:14:48.577631+0000","last_undegraded":"2024-09-21T03:14:48.577631+0000","last_fullsized":"2024-09-21T03:14:48.577631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:51.488594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578124+0000","last_change":"2024-09-21T03:14:46.551282+0000","last_active":"2024-09-21T03:14:48.578124+0000","last_peered":"2024-09-21T03:14:48.578124+0000","last_clean":"2024-09-21T03:14:48.578124+0000","last_became_active":"2024-09-21T03:14:46.550191+0000","last_became_peered":"2024-09-21T03:14:46.550191+0000","last_unstale":"2024-09-21T03:14:48.578124+0000","last_undegraded":"2024-09-21T03:14:48.578124+0000","last_fullsized":"2024-09-21T03:14:48.578124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:32.136739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557152+0000","last_change":"2024-09-21T03:14:47.561737+0000","last_active":"2024-09-21T03:14:48.557152+0000","last_peered":"2024-09-21T03:14:48.557152+0000","last_clean":"2024-09-21T03:14:48.557152+0000","last_became_active":"2024-09-21T03:14:47.557518+0000","last_became_peered":"2024-09-21T03:14:47.557518+0000","last_unstale":"2024-09-21T03:14:48.557152+0000","last_undegraded":"2024-09-21T03:14:48.557152+0000","last_fullsized":"2024-09-21T03:14:48.557152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:00.342378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.559033+0000","last_change":"2024-09-21T03:14:37.465536+0000","last_active":"2024-09-21T03:14:48.559033+0000","last_peered":"2024-09-21T03:14:48.559033+0000","last_clean":"2024-09-21T03:14:48.559033+0000","last_became_active":"2024-09-21T03:14:37.465240+0000","last_became_peered":"2024-09-21T03:14:37.465240+0000","last_unstale":"2024-09-21T03:14:48.559033+0000","last_undegraded":"2024-09-21T03:14:48.559033+0000","last_fullsized":"2024-09-21T03:14:48.559033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:34.780298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578325+0000","last_change":"2024-09-21T03:14:38.474516+0000","last_active":"2024-09-21T03:14:48.578325+0000","last_peered":"2024-09-21T03:14:48.578325+0000","last_clean":"2024-09-21T03:14:48.578325+0000","last_became_active":"2024-09-21T03:14:38.472225+0000","last_became_peered":"2024-09-21T03:14:38.472225+0000","last_unstale":"2024-09-21T03:14:48.578325+0000","last_undegraded":"2024-09-21T03:14:48.578325+0000","last_fullsized":"2024-09-21T03:14:48.578325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:47.504910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566849+0000","last_change":"2024-09-21T03:14:46.544072+0000","last_active":"2024-09-21T03:14:48.566849+0000","last_peered":"2024-09-21T03:14:48.566849+0000","last_clean":"2024-09-21T03:14:48.566849+0000","last_became_active":"2024-09-21T03:14:46.543729+0000","last_became_peered":"2024-09-21T03:14:46.543729+0000","last_unstale":"2024-09-21T03:14:48.566849+0000","last_undegraded":"2024-09-21T03:14:48.566849+0000","last_fullsized":"2024-09-21T03:14:48.566849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:18.560012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578210+0000","last_change":"2024-09-21T03:14:47.563764+0000","last_active":"2024-09-21T03:14:48.578210+0000","last_peered":"2024-09-21T03:14:48.578210+0000","last_clean":"2024-09-21T03:14:48.578210+0000","last_became_active":"2024-09-21T03:14:47.562943+0000","last_became_peered":"2024-09-21T03:14:47.562943+0000","last_unstale":"2024-09-21T03:14:48.578210+0000","last_undegraded":"2024-09-21T03:14:48.578210+0000","last_fullsized":"2024-09-21T03:14:48.578210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:39.284350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556697+0000","last_change":"2024-09-21T03:14:38.484311+0000","last_active":"2024-09-21T03:14:48.556697+0000","last_peered":"2024-09-21T03:14:48.556697+0000","last_clean":"2024-09-21T03:14:48.556697+0000","last_became_active":"2024-09-21T03:14:38.483975+0000","last_became_peered":"2024-09-21T03:14:38.483975+0000","last_unstale":"2024-09-21T03:14:48.556697+0000","last_undegraded":"2024-09-21T03:14:48.556697+0000","last_fullsized":"2024-09-21T03:14:48.556697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:31.145431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578221+0000","last_change":"2024-09-21T03:14:47.566252+0000","last_active":"2024-09-21T03:14:48.578221+0000","last_peered":"2024-09-21T03:14:48.578221+0000","last_clean":"2024-09-21T03:14:48.578221+0000","last_became_active":"2024-09-21T03:14:47.560282+0000","last_became_peered":"2024-09-21T03:14:47.560282+0000","last_unstale":"2024-09-21T03:14:48.578221+0000","last_undegraded":"2024-09-21T03:14:48.578221+0000","last_fullsized":"2024-09-21T03:14:48.578221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:23.553847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566179+0000","last_change":"2024-09-21T03:14:38.477183+0000","last_active":"2024-09-21T03:14:48.566179+0000","last_peered":"2024-09-21T03:14:48.566179+0000","last_clean":"2024-09-21T03:14:48.566179+0000","last_became_active":"2024-09-21T03:14:38.476657+0000","last_became_peered":"2024-09-21T03:14:38.476657+0000","last_unstale":"2024-09-21T03:14:48.566179+0000","last_undegraded":"2024-09-21T03:14:48.566179+0000","last_fullsized":"2024-09-21T03:14:48.566179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:36.801764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557242+0000","last_change":"2024-09-21T03:14:47.574339+0000","last_active":"2024-09-21T03:14:48.557242+0000","last_peered":"2024-09-21T03:14:48.557242+0000","last_clean":"2024-09-21T03:14:48.557242+0000","last_became_active":"2024-09-21T03:14:47.565732+0000","last_became_peered":"2024-09-21T03:14:47.565732+0000","last_unstale":"2024-09-21T03:14:48.557242+0000","last_undegraded":"2024-09-21T03:14:48.557242+0000","last_fullsized":"2024-09-21T03:14:48.557242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:57.896810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580141+0000","last_change":"2024-09-21T03:14:38.472860+0000","last_active":"2024-09-21T03:14:48.580141+0000","last_peered":"2024-09-21T03:14:48.580141+0000","last_clean":"2024-09-21T03:14:48.580141+0000","last_became_active":"2024-09-21T03:14:38.472548+0000","last_became_peered":"2024-09-21T03:14:38.472548+0000","last_unstale":"2024-09-21T03:14:48.580141+0000","last_undegraded":"2024-09-21T03:14:48.580141+0000","last_fullsized":"2024-09-21T03:14:48.580141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:16.071692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.559519+0000","last_change":"2024-09-21T03:14:47.557402+0000","last_active":"2024-09-21T03:14:48.559519+0000","last_peered":"2024-09-21T03:14:48.559519+0000","last_clean":"2024-09-21T03:14:48.559519+0000","last_became_active":"2024-09-21T03:14:47.557047+0000","last_became_peered":"2024-09-21T03:14:47.557047+0000","last_unstale":"2024-09-21T03:14:48.559519+0000","last_undegraded":"2024-09-21T03:14:48.559519+0000","last_fullsized":"2024-09-21T03:14:48.559519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:29.792514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558904+0000","last_change":"2024-09-21T03:14:38.481039+0000","last_active":"2024-09-21T03:14:48.558904+0000","last_peered":"2024-09-21T03:14:48.558904+0000","last_clean":"2024-09-21T03:14:48.558904+0000","last_became_active":"2024-09-21T03:14:38.480686+0000","last_became_peered":"2024-09-21T03:14:38.480686+0000","last_unstale":"2024-09-21T03:14:48.558904+0000","last_undegraded":"2024-09-21T03:14:48.558904+0000","last_fullsized":"2024-09-21T03:14:48.558904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:18.603386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577036+0000","last_change":"2024-09-21T03:14:47.565697+0000","last_active":"2024-09-21T03:14:48.577036+0000","last_peered":"2024-09-21T03:14:48.577036+0000","last_clean":"2024-09-21T03:14:48.577036+0000","last_became_active":"2024-09-21T03:14:47.565393+0000","last_became_peered":"2024-09-21T03:14:47.565393+0000","last_unstale":"2024-09-21T03:14:48.577036+0000","last_undegraded":"2024-09-21T03:14:48.577036+0000","last_fullsized":"2024-09-21T03:14:48.577036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:35.421803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558553+0000","last_change":"2024-09-21T03:14:38.473900+0000","last_active":"2024-09-21T03:14:48.558553+0000","last_peered":"2024-09-21T03:14:48.558553+0000","last_clean":"2024-09-21T03:14:48.558553+0000","last_became_active":"2024-09-21T03:14:38.471325+0000","last_became_peered":"2024-09-21T03:14:38.471325+0000","last_unstale":"2024-09-21T03:14:48.558553+0000","last_undegraded":"2024-09-21T03:14:48.558553+0000","last_fullsized":"2024-09-21T03:14:48.558553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:47.556293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578046+0000","last_change":"2024-09-21T03:14:47.573726+0000","last_active":"2024-09-21T03:14:48.578046+0000","last_peered":"2024-09-21T03:14:48.578046+0000","last_clean":"2024-09-21T03:14:48.578046+0000","last_became_active":"2024-09-21T03:14:47.571074+0000","last_became_peered":"2024-09-21T03:14:47.571074+0000","last_unstale":"2024-09-21T03:14:48.578046+0000","last_undegraded":"2024-09-21T03:14:48.578046+0000","last_fullsized":"2024-09-21T03:14:48.578046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:53.755098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557408+0000","last_change":"2024-09-21T03:14:38.478099+0000","last_active":"2024-09-21T03:14:48.557408+0000","last_peered":"2024-09-21T03:14:48.557408+0000","last_clean":"2024-09-21T03:14:48.557408+0000","last_became_active":"2024-09-21T03:14:38.475894+0000","last_became_peered":"2024-09-21T03:14:38.475894+0000","last_unstale":"2024-09-21T03:14:48.557408+0000","last_undegraded":"2024-09-21T03:14:48.557408+0000","last_fullsized":"2024-09-21T03:14:48.557408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:49.876430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577542+0000","last_change":"2024-09-21T03:14:47.556933+0000","last_active":"2024-09-21T03:14:48.577542+0000","last_peered":"2024-09-21T03:14:48.577542+0000","last_clean":"2024-09-21T03:14:48.577542+0000","last_became_active":"2024-09-21T03:14:47.556615+0000","last_became_peered":"2024-09-21T03:14:47.556615+0000","last_unstale":"2024-09-21T03:14:48.577542+0000","last_undegraded":"2024-09-21T03:14:48.577542+0000","last_fullsized":"2024-09-21T03:14:48.577542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:27.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557365+0000","last_change":"2024-09-21T03:14:38.484198+0000","last_active":"2024-09-21T03:14:48.557365+0000","last_peered":"2024-09-21T03:14:48.557365+0000","last_clean":"2024-09-21T03:14:48.557365+0000","last_became_active":"2024-09-21T03:14:38.483893+0000","last_became_peered":"2024-09-21T03:14:38.483893+0000","last_unstale":"2024-09-21T03:14:48.557365+0000","last_undegraded":"2024-09-21T03:14:48.557365+0000","last_fullsized":"2024-09-21T03:14:48.557365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:56.665359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556286+0000","last_change":"2024-09-21T03:14:47.553479+0000","last_active":"2024-09-21T03:14:48.556286+0000","last_peered":"2024-09-21T03:14:48.556286+0000","last_clean":"2024-09-21T03:14:48.556286+0000","last_became_active":"2024-09-21T03:14:47.553144+0000","last_became_peered":"2024-09-21T03:14:47.553144+0000","last_unstale":"2024-09-21T03:14:48.556286+0000","last_undegraded":"2024-09-21T03:14:48.556286+0000","last_fullsized":"2024-09-21T03:14:48.556286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:26.321488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558236+0000","last_change":"2024-09-21T03:14:38.487093+0000","last_active":"2024-09-21T03:14:48.558236+0000","last_peered":"2024-09-21T03:14:48.558236+0000","last_clean":"2024-09-21T03:14:48.558236+0000","last_became_active":"2024-09-21T03:14:38.486204+0000","last_became_peered":"2024-09-21T03:14:38.486204+0000","last_unstale":"2024-09-21T03:14:48.558236+0000","last_undegraded":"2024-09-21T03:14:48.558236+0000","last_fullsized":"2024-09-21T03:14:48.558236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:55.531046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566794+0000","last_change":"2024-09-21T03:14:47.573375+0000","last_active":"2024-09-21T03:14:48.566794+0000","last_peered":"2024-09-21T03:14:48.566794+0000","last_clean":"2024-09-21T03:14:48.566794+0000","last_became_active":"2024-09-21T03:14:47.572717+0000","last_became_peered":"2024-09-21T03:14:47.572717+0000","last_unstale":"2024-09-21T03:14:48.566794+0000","last_undegraded":"2024-09-21T03:14:48.566794+0000","last_fullsized":"2024-09-21T03:14:48.566794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:44.673283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577931+0000","last_change":"2024-09-21T03:14:38.471959+0000","last_active":"2024-09-21T03:14:48.577931+0000","last_peered":"2024-09-21T03:14:48.577931+0000","last_clean":"2024-09-21T03:14:48.577931+0000","last_became_active":"2024-09-21T03:14:38.471625+0000","last_became_peered":"2024-09-21T03:14:38.471625+0000","last_unstale":"2024-09-21T03:14:48.577931+0000","last_undegraded":"2024-09-21T03:14:48.577931+0000","last_fullsized":"2024-09-21T03:14:48.577931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:17.761951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581065+0000","last_change":"2024-09-21T03:14:47.564597+0000","last_active":"2024-09-21T03:14:48.581065+0000","last_peered":"2024-09-21T03:14:48.581065+0000","last_clean":"2024-09-21T03:14:48.581065+0000","last_became_active":"2024-09-21T03:14:47.563816+0000","last_became_peered":"2024-09-21T03:14:47.563816+0000","last_unstale":"2024-09-21T03:14:48.581065+0000","last_undegraded":"2024-09-21T03:14:48.581065+0000","last_fullsized":"2024-09-21T03:14:48.581065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:33.061271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557771+0000","last_change":"2024-09-21T03:14:38.491888+0000","last_active":"2024-09-21T03:14:48.557771+0000","last_peered":"2024-09-21T03:14:48.557771+0000","last_clean":"2024-09-21T03:14:48.557771+0000","last_became_active":"2024-09-21T03:14:38.491510+0000","last_became_peered":"2024-09-21T03:14:38.491510+0000","last_unstale":"2024-09-21T03:14:48.557771+0000","last_undegraded":"2024-09-21T03:14:48.557771+0000","last_fullsized":"2024-09-21T03:14:48.557771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:26.740304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558275+0000","last_change":"2024-09-21T03:14:47.564310+0000","last_active":"2024-09-21T03:14:48.558275+0000","last_peered":"2024-09-21T03:14:48.558275+0000","last_clean":"2024-09-21T03:14:48.558275+0000","last_became_active":"2024-09-21T03:14:47.564003+0000","last_became_peered":"2024-09-21T03:14:47.564003+0000","last_unstale":"2024-09-21T03:14:48.558275+0000","last_undegraded":"2024-09-21T03:14:48.558275+0000","last_fullsized":"2024-09-21T03:14:48.558275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:45.016321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578256+0000","last_change":"2024-09-21T03:14:38.470991+0000","last_active":"2024-09-21T03:14:48.578256+0000","last_peered":"2024-09-21T03:14:48.578256+0000","last_clean":"2024-09-21T03:14:48.578256+0000","last_became_active":"2024-09-21T03:14:38.470666+0000","last_became_peered":"2024-09-21T03:14:38.470666+0000","last_unstale":"2024-09-21T03:14:48.578256+0000","last_undegraded":"2024-09-21T03:14:48.578256+0000","last_fullsized":"2024-09-21T03:14:48.578256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:25.477992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566757+0000","last_change":"2024-09-21T03:14:47.575212+0000","last_active":"2024-09-21T03:14:48.566757+0000","last_peered":"2024-09-21T03:14:48.566757+0000","last_clean":"2024-09-21T03:14:48.566757+0000","last_became_active":"2024-09-21T03:14:47.574895+0000","last_became_peered":"2024-09-21T03:14:47.574895+0000","last_unstale":"2024-09-21T03:14:48.566757+0000","last_undegraded":"2024-09-21T03:14:48.566757+0000","last_fullsized":"2024-09-21T03:14:48.566757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:04.240949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577570+0000","last_change":"2024-09-21T03:14:38.482681+0000","last_active":"2024-09-21T03:14:48.577570+0000","last_peered":"2024-09-21T03:14:48.577570+0000","last_clean":"2024-09-21T03:14:48.577570+0000","last_became_active":"2024-09-21T03:14:38.477816+0000","last_became_peered":"2024-09-21T03:14:38.477816+0000","last_unstale":"2024-09-21T03:14:48.577570+0000","last_undegraded":"2024-09-21T03:14:48.577570+0000","last_fullsized":"2024-09-21T03:14:48.577570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:18.675641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557132+0000","last_change":"2024-09-21T03:14:47.555329+0000","last_active":"2024-09-21T03:14:48.557132+0000","last_peered":"2024-09-21T03:14:48.557132+0000","last_clean":"2024-09-21T03:14:48.557132+0000","last_became_active":"2024-09-21T03:14:47.555033+0000","last_became_peered":"2024-09-21T03:14:47.555033+0000","last_unstale":"2024-09-21T03:14:48.557132+0000","last_undegraded":"2024-09-21T03:14:48.557132+0000","last_fullsized":"2024-09-21T03:14:48.557132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:49.060834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578610+0000","last_change":"2024-09-21T03:14:38.480638+0000","last_active":"2024-09-21T03:14:48.578610+0000","last_peered":"2024-09-21T03:14:48.578610+0000","last_clean":"2024-09-21T03:14:48.578610+0000","last_became_active":"2024-09-21T03:14:38.477739+0000","last_became_peered":"2024-09-21T03:14:38.477739+0000","last_unstale":"2024-09-21T03:14:48.578610+0000","last_undegraded":"2024-09-21T03:14:48.578610+0000","last_fullsized":"2024-09-21T03:14:48.578610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:35.097761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577900+0000","last_change":"2024-09-21T03:14:47.573659+0000","last_active":"2024-09-21T03:14:48.577900+0000","last_peered":"2024-09-21T03:14:48.577900+0000","last_clean":"2024-09-21T03:14:48.577900+0000","last_became_active":"2024-09-21T03:14:47.572756+0000","last_became_peered":"2024-09-21T03:14:47.572756+0000","last_unstale":"2024-09-21T03:14:48.577900+0000","last_undegraded":"2024-09-21T03:14:48.577900+0000","last_fullsized":"2024-09-21T03:14:48.577900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:21.986681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581406+0000","last_change":"2024-09-21T03:14:38.478039+0000","last_active":"2024-09-21T03:14:48.581406+0000","last_peered":"2024-09-21T03:14:48.581406+0000","last_clean":"2024-09-21T03:14:48.581406+0000","last_became_active":"2024-09-21T03:14:38.473843+0000","last_became_peered":"2024-09-21T03:14:38.473843+0000","last_unstale":"2024-09-21T03:14:48.581406+0000","last_undegraded":"2024-09-21T03:14:48.581406+0000","last_fullsized":"2024-09-21T03:14:48.581406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:27.072406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556166+0000","last_change":"2024-09-21T03:14:47.555386+0000","last_active":"2024-09-21T03:14:48.556166+0000","last_peered":"2024-09-21T03:14:48.556166+0000","last_clean":"2024-09-21T03:14:48.556166+0000","last_became_active":"2024-09-21T03:14:47.554758+0000","last_became_peered":"2024-09-21T03:14:47.554758+0000","last_unstale":"2024-09-21T03:14:48.556166+0000","last_undegraded":"2024-09-21T03:14:48.556166+0000","last_fullsized":"2024-09-21T03:14:48.556166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:47.574672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566912+0000","last_change":"2024-09-21T03:14:38.494878+0000","last_active":"2024-09-21T03:14:48.566912+0000","last_peered":"2024-09-21T03:14:48.566912+0000","last_clean":"2024-09-21T03:14:48.566912+0000","last_became_active":"2024-09-21T03:14:38.492813+0000","last_became_peered":"2024-09-21T03:14:38.492813+0000","last_unstale":"2024-09-21T03:14:48.566912+0000","last_undegraded":"2024-09-21T03:14:48.566912+0000","last_fullsized":"2024-09-21T03:14:48.566912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:55.064844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557554+0000","last_change":"2024-09-21T03:14:47.544806+0000","last_active":"2024-09-21T03:14:48.557554+0000","last_peered":"2024-09-21T03:14:48.557554+0000","last_clean":"2024-09-21T03:14:48.557554+0000","last_became_active":"2024-09-21T03:14:47.544431+0000","last_became_peered":"2024-09-21T03:14:47.544431+0000","last_unstale":"2024-09-21T03:14:48.557554+0000","last_undegraded":"2024-09-21T03:14:48.557554+0000","last_fullsized":"2024-09-21T03:14:48.557554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:01.463573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581015+0000","last_change":"2024-09-21T03:14:38.474462+0000","last_active":"2024-09-21T03:14:48.581015+0000","last_peered":"2024-09-21T03:14:48.581015+0000","last_clean":"2024-09-21T03:14:48.581015+0000","last_became_active":"2024-09-21T03:14:38.474156+0000","last_became_peered":"2024-09-21T03:14:38.474156+0000","last_unstale":"2024-09-21T03:14:48.581015+0000","last_undegraded":"2024-09-21T03:14:48.581015+0000","last_fullsized":"2024-09-21T03:14:48.581015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:55.329945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578169+0000","last_change":"2024-09-21T03:14:47.563297+0000","last_active":"2024-09-21T03:14:48.578169+0000","last_peered":"2024-09-21T03:14:48.578169+0000","last_clean":"2024-09-21T03:14:48.578169+0000","last_became_active":"2024-09-21T03:14:47.562519+0000","last_became_peered":"2024-09-21T03:14:47.562519+0000","last_unstale":"2024-09-21T03:14:48.578169+0000","last_undegraded":"2024-09-21T03:14:48.578169+0000","last_fullsized":"2024-09-21T03:14:48.578169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:47.959373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577713+0000","last_change":"2024-09-21T03:14:38.474262+0000","last_active":"2024-09-21T03:14:48.577713+0000","last_peered":"2024-09-21T03:14:48.577713+0000","last_clean":"2024-09-21T03:14:48.577713+0000","last_became_active":"2024-09-21T03:14:38.473856+0000","last_became_peered":"2024-09-21T03:14:38.473856+0000","last_unstale":"2024-09-21T03:14:48.577713+0000","last_undegraded":"2024-09-21T03:14:48.577713+0000","last_fullsized":"2024-09-21T03:14:48.577713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579491+0000","last_change":"2024-09-21T03:14:47.558732+0000","last_active":"2024-09-21T03:14:48.579491+0000","last_peered":"2024-09-21T03:14:48.579491+0000","last_clean":"2024-09-21T03:14:48.579491+0000","last_became_active":"2024-09-21T03:14:47.558403+0000","last_became_peered":"2024-09-21T03:14:47.558403+0000","last_unstale":"2024-09-21T03:14:48.579491+0000","last_undegraded":"2024-09-21T03:14:48.579491+0000","last_fullsized":"2024-09-21T03:14:48.579491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:46.054565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557583+0000","last_change":"2024-09-21T03:14:38.469736+0000","last_active":"2024-09-21T03:14:48.557583+0000","last_peered":"2024-09-21T03:14:48.557583+0000","last_clean":"2024-09-21T03:14:48.557583+0000","last_became_active":"2024-09-21T03:14:38.469240+0000","last_became_peered":"2024-09-21T03:14:38.469240+0000","last_unstale":"2024-09-21T03:14:48.557583+0000","last_undegraded":"2024-09-21T03:14:48.557583+0000","last_fullsized":"2024-09-21T03:14:48.557583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:04.258761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578598+0000","last_change":"2024-09-21T03:14:47.550684+0000","last_active":"2024-09-21T03:14:48.578598+0000","last_peered":"2024-09-21T03:14:48.578598+0000","last_clean":"2024-09-21T03:14:48.578598+0000","last_became_active":"2024-09-21T03:14:47.550375+0000","last_became_peered":"2024-09-21T03:14:47.550375+0000","last_unstale":"2024-09-21T03:14:48.578598+0000","last_undegraded":"2024-09-21T03:14:48.578598+0000","last_fullsized":"2024-09-21T03:14:48.578598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:05.268160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557691+0000","last_change":"2024-09-21T03:14:38.487983+0000","last_active":"2024-09-21T03:14:48.557691+0000","last_peered":"2024-09-21T03:14:48.557691+0000","last_clean":"2024-09-21T03:14:48.557691+0000","last_became_active":"2024-09-21T03:14:38.487676+0000","last_became_peered":"2024-09-21T03:14:38.487676+0000","last_unstale":"2024-09-21T03:14:48.557691+0000","last_undegraded":"2024-09-21T03:14:48.557691+0000","last_fullsized":"2024-09-21T03:14:48.557691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:35.320169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580600+0000","last_change":"2024-09-21T03:14:47.561566+0000","last_active":"2024-09-21T03:14:48.580600+0000","last_peered":"2024-09-21T03:14:48.580600+0000","last_clean":"2024-09-21T03:14:48.580600+0000","last_became_active":"2024-09-21T03:14:47.561229+0000","last_became_peered":"2024-09-21T03:14:47.561229+0000","last_unstale":"2024-09-21T03:14:48.580600+0000","last_undegraded":"2024-09-21T03:14:48.580600+0000","last_fullsized":"2024-09-21T03:14:48.580600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:07.280356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558891+0000","last_change":"2024-09-21T03:14:38.478853+0000","last_active":"2024-09-21T03:14:48.558891+0000","last_peered":"2024-09-21T03:14:48.558891+0000","last_clean":"2024-09-21T03:14:48.558891+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:14:48.558891+0000","last_undegraded":"2024-09-21T03:14:48.558891+0000","last_fullsized":"2024-09-21T03:14:48.558891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:31.427596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577155+0000","last_change":"2024-09-21T03:14:47.553172+0000","last_active":"2024-09-21T03:14:48.577155+0000","last_peered":"2024-09-21T03:14:48.577155+0000","last_clean":"2024-09-21T03:14:48.577155+0000","last_became_active":"2024-09-21T03:14:47.552659+0000","last_became_peered":"2024-09-21T03:14:47.552659+0000","last_unstale":"2024-09-21T03:14:48.577155+0000","last_undegraded":"2024-09-21T03:14:48.577155+0000","last_fullsized":"2024-09-21T03:14:48.577155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:16:20.114663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578509+0000","last_change":"2024-09-21T03:14:38.481308+0000","last_active":"2024-09-21T03:14:48.578509+0000","last_peered":"2024-09-21T03:14:48.578509+0000","last_clean":"2024-09-21T03:14:48.578509+0000","last_became_active":"2024-09-21T03:14:38.480923+0000","last_became_peered":"2024-09-21T03:14:38.480923+0000","last_unstale":"2024-09-21T03:14:48.578509+0000","last_undegraded":"2024-09-21T03:14:48.578509+0000","last_fullsized":"2024-09-21T03:14:48.578509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:40.689231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557324+0000","last_change":"2024-09-21T03:14:47.561972+0000","last_active":"2024-09-21T03:14:48.557324+0000","last_peered":"2024-09-21T03:14:48.557324+0000","last_clean":"2024-09-21T03:14:48.557324+0000","last_became_active":"2024-09-21T03:14:47.561645+0000","last_became_peered":"2024-09-21T03:14:47.561645+0000","last_unstale":"2024-09-21T03:14:48.557324+0000","last_undegraded":"2024-09-21T03:14:48.557324+0000","last_fullsized":"2024-09-21T03:14:48.557324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:57.526787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579480+0000","last_change":"2024-09-21T03:14:38.473907+0000","last_active":"2024-09-21T03:14:48.579480+0000","last_peered":"2024-09-21T03:14:48.579480+0000","last_clean":"2024-09-21T03:14:48.579480+0000","last_became_active":"2024-09-21T03:14:38.473579+0000","last_became_peered":"2024-09-21T03:14:38.473579+0000","last_unstale":"2024-09-21T03:14:48.579480+0000","last_undegraded":"2024-09-21T03:14:48.579480+0000","last_fullsized":"2024-09-21T03:14:48.579480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:32.273503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577349+0000","last_change":"2024-09-21T03:14:47.566089+0000","last_active":"2024-09-21T03:14:48.577349+0000","last_peered":"2024-09-21T03:14:48.577349+0000","last_clean":"2024-09-21T03:14:48.577349+0000","last_became_active":"2024-09-21T03:14:47.565681+0000","last_became_peered":"2024-09-21T03:14:47.565681+0000","last_unstale":"2024-09-21T03:14:48.577349+0000","last_undegraded":"2024-09-21T03:14:48.577349+0000","last_fullsized":"2024-09-21T03:14:48.577349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.208933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579474+0000","last_change":"2024-09-21T03:14:38.474326+0000","last_active":"2024-09-21T03:14:48.579474+0000","last_peered":"2024-09-21T03:14:48.579474+0000","last_clean":"2024-09-21T03:14:48.579474+0000","last_became_active":"2024-09-21T03:14:38.470430+0000","last_became_peered":"2024-09-21T03:14:38.470430+0000","last_unstale":"2024-09-21T03:14:48.579474+0000","last_undegraded":"2024-09-21T03:14:48.579474+0000","last_fullsized":"2024-09-21T03:14:48.579474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:09.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577186+0000","last_change":"2024-09-21T03:14:47.571487+0000","last_active":"2024-09-21T03:14:48.577186+0000","last_peered":"2024-09-21T03:14:48.577186+0000","last_clean":"2024-09-21T03:14:48.577186+0000","last_became_active":"2024-09-21T03:14:47.571126+0000","last_became_peered":"2024-09-21T03:14:47.571126+0000","last_unstale":"2024-09-21T03:14:48.577186+0000","last_undegraded":"2024-09-21T03:14:48.577186+0000","last_fullsized":"2024-09-21T03:14:48.577186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:57.128853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580122+0000","last_change":"2024-09-21T03:14:38.483370+0000","last_active":"2024-09-21T03:14:48.580122+0000","last_peered":"2024-09-21T03:14:48.580122+0000","last_clean":"2024-09-21T03:14:48.580122+0000","last_became_active":"2024-09-21T03:14:38.483019+0000","last_became_peered":"2024-09-21T03:14:38.483019+0000","last_unstale":"2024-09-21T03:14:48.580122+0000","last_undegraded":"2024-09-21T03:14:48.580122+0000","last_fullsized":"2024-09-21T03:14:48.580122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:55.085422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558300+0000","last_change":"2024-09-21T03:14:47.555777+0000","last_active":"2024-09-21T03:14:48.558300+0000","last_peered":"2024-09-21T03:14:48.558300+0000","last_clean":"2024-09-21T03:14:48.558300+0000","last_became_active":"2024-09-21T03:14:47.555465+0000","last_became_peered":"2024-09-21T03:14:47.555465+0000","last_unstale":"2024-09-21T03:14:48.558300+0000","last_undegraded":"2024-09-21T03:14:48.558300+0000","last_fullsized":"2024-09-21T03:14:48.558300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:27.123740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556793+0000","last_change":"2024-09-21T03:14:38.465771+0000","last_active":"2024-09-21T03:14:48.556793+0000","last_peered":"2024-09-21T03:14:48.556793+0000","last_clean":"2024-09-21T03:14:48.556793+0000","last_became_active":"2024-09-21T03:14:38.465479+0000","last_became_peered":"2024-09-21T03:14:38.465479+0000","last_unstale":"2024-09-21T03:14:48.556793+0000","last_undegraded":"2024-09-21T03:14:48.556793+0000","last_fullsized":"2024-09-21T03:14:48.556793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.754315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557657+0000","last_change":"2024-09-21T03:14:47.567695+0000","last_active":"2024-09-21T03:14:48.557657+0000","last_peered":"2024-09-21T03:14:48.557657+0000","last_clean":"2024-09-21T03:14:48.557657+0000","last_became_active":"2024-09-21T03:14:47.566936+0000","last_became_peered":"2024-09-21T03:14:47.566936+0000","last_unstale":"2024-09-21T03:14:48.557657+0000","last_undegraded":"2024-09-21T03:14:48.557657+0000","last_fullsized":"2024-09-21T03:14:48.557657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:48.182523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577444+0000","last_change":"2024-09-21T03:14:38.482620+0000","last_active":"2024-09-21T03:14:48.577444+0000","last_peered":"2024-09-21T03:14:48.577444+0000","last_clean":"2024-09-21T03:14:48.577444+0000","last_became_active":"2024-09-21T03:14:38.482346+0000","last_became_peered":"2024-09-21T03:14:38.482346+0000","last_unstale":"2024-09-21T03:14:48.577444+0000","last_undegraded":"2024-09-21T03:14:48.577444+0000","last_fullsized":"2024-09-21T03:14:48.577444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:52.977725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577748+0000","last_change":"2024-09-21T03:14:47.580314+0000","last_active":"2024-09-21T03:14:48.577748+0000","last_peered":"2024-09-21T03:14:48.577748+0000","last_clean":"2024-09-21T03:14:48.577748+0000","last_became_active":"2024-09-21T03:14:47.576499+0000","last_became_peered":"2024-09-21T03:14:47.576499+0000","last_unstale":"2024-09-21T03:14:48.577748+0000","last_undegraded":"2024-09-21T03:14:48.577748+0000","last_fullsized":"2024-09-21T03:14:48.577748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:46.154586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557118+0000","last_change":"2024-09-21T03:14:38.471270+0000","last_active":"2024-09-21T03:14:48.557118+0000","last_peered":"2024-09-21T03:14:48.557118+0000","last_clean":"2024-09-21T03:14:48.557118+0000","last_became_active":"2024-09-21T03:14:38.470708+0000","last_became_peered":"2024-09-21T03:14:38.470708+0000","last_unstale":"2024-09-21T03:14:48.557118+0000","last_undegraded":"2024-09-21T03:14:48.557118+0000","last_fullsized":"2024-09-21T03:14:48.557118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.122804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578504+0000","last_change":"2024-09-21T03:14:47.554180+0000","last_active":"2024-09-21T03:14:48.578504+0000","last_peered":"2024-09-21T03:14:48.578504+0000","last_clean":"2024-09-21T03:14:48.578504+0000","last_became_active":"2024-09-21T03:14:47.552808+0000","last_became_peered":"2024-09-21T03:14:47.552808+0000","last_unstale":"2024-09-21T03:14:48.578504+0000","last_undegraded":"2024-09-21T03:14:48.578504+0000","last_fullsized":"2024-09-21T03:14:48.578504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:07.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578111+0000","last_change":"2024-09-21T03:14:38.466077+0000","last_active":"2024-09-21T03:14:48.578111+0000","last_peered":"2024-09-21T03:14:48.578111+0000","last_clean":"2024-09-21T03:14:48.578111+0000","last_became_active":"2024-09-21T03:14:38.465818+0000","last_became_peered":"2024-09-21T03:14:38.465818+0000","last_unstale":"2024-09-21T03:14:48.578111+0000","last_undegraded":"2024-09-21T03:14:48.578111+0000","last_fullsized":"2024-09-21T03:14:48.578111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:34.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566406+0000","last_change":"2024-09-21T03:14:47.577228+0000","last_active":"2024-09-21T03:14:48.566406+0000","last_peered":"2024-09-21T03:14:48.566406+0000","last_clean":"2024-09-21T03:14:48.566406+0000","last_became_active":"2024-09-21T03:14:47.576843+0000","last_became_peered":"2024-09-21T03:14:47.576843+0000","last_unstale":"2024-09-21T03:14:48.566406+0000","last_undegraded":"2024-09-21T03:14:48.566406+0000","last_fullsized":"2024-09-21T03:14:48.566406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:56.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557247+0000","last_change":"2024-09-21T03:14:38.481389+0000","last_active":"2024-09-21T03:14:48.557247+0000","last_peered":"2024-09-21T03:14:48.557247+0000","last_clean":"2024-09-21T03:14:48.557247+0000","last_became_active":"2024-09-21T03:14:38.470907+0000","last_became_peered":"2024-09-21T03:14:38.470907+0000","last_unstale":"2024-09-21T03:14:48.557247+0000","last_undegraded":"2024-09-21T03:14:48.557247+0000","last_fullsized":"2024-09-21T03:14:48.557247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:30.068915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558355+0000","last_change":"2024-09-21T03:14:47.551766+0000","last_active":"2024-09-21T03:14:48.558355+0000","last_peered":"2024-09-21T03:14:48.558355+0000","last_clean":"2024-09-21T03:14:48.558355+0000","last_became_active":"2024-09-21T03:14:47.551420+0000","last_became_peered":"2024-09-21T03:14:47.551420+0000","last_unstale":"2024-09-21T03:14:48.558355+0000","last_undegraded":"2024-09-21T03:14:48.558355+0000","last_fullsized":"2024-09-21T03:14:48.558355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:56.255472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.559417+0000","last_change":"2024-09-21T03:14:38.482605+0000","last_active":"2024-09-21T03:14:48.559417+0000","last_peered":"2024-09-21T03:14:48.559417+0000","last_clean":"2024-09-21T03:14:48.559417+0000","last_became_active":"2024-09-21T03:14:38.482306+0000","last_became_peered":"2024-09-21T03:14:38.482306+0000","last_unstale":"2024-09-21T03:14:48.559417+0000","last_undegraded":"2024-09-21T03:14:48.559417+0000","last_fullsized":"2024-09-21T03:14:48.559417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:40.482635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556625+0000","last_change":"2024-09-21T03:14:47.555070+0000","last_active":"2024-09-21T03:14:48.556625+0000","last_peered":"2024-09-21T03:14:48.556625+0000","last_clean":"2024-09-21T03:14:48.556625+0000","last_became_active":"2024-09-21T03:14:47.554363+0000","last_became_peered":"2024-09-21T03:14:47.554363+0000","last_unstale":"2024-09-21T03:14:48.556625+0000","last_undegraded":"2024-09-21T03:14:48.556625+0000","last_fullsized":"2024-09-21T03:14:48.556625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:40.027266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558524+0000","last_change":"2024-09-21T03:14:38.496218+0000","last_active":"2024-09-21T03:14:48.558524+0000","last_peered":"2024-09-21T03:14:48.558524+0000","last_clean":"2024-09-21T03:14:48.558524+0000","last_became_active":"2024-09-21T03:14:38.488537+0000","last_became_peered":"2024-09-21T03:14:38.488537+0000","last_unstale":"2024-09-21T03:14:48.558524+0000","last_undegraded":"2024-09-21T03:14:48.558524+0000","last_fullsized":"2024-09-21T03:14:48.558524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:59.667392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556307+0000","last_change":"2024-09-21T03:14:47.564250+0000","last_active":"2024-09-21T03:14:48.556307+0000","last_peered":"2024-09-21T03:14:48.556307+0000","last_clean":"2024-09-21T03:14:48.556307+0000","last_became_active":"2024-09-21T03:14:47.563745+0000","last_became_peered":"2024-09-21T03:14:47.563745+0000","last_unstale":"2024-09-21T03:14:48.556307+0000","last_undegraded":"2024-09-21T03:14:48.556307+0000","last_fullsized":"2024-09-21T03:14:48.556307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:31.282910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579673+0000","last_change":"2024-09-21T03:14:38.490309+0000","last_active":"2024-09-21T03:14:48.579673+0000","last_peered":"2024-09-21T03:14:48.579673+0000","last_clean":"2024-09-21T03:14:48.579673+0000","last_became_active":"2024-09-21T03:14:38.489167+0000","last_became_peered":"2024-09-21T03:14:38.489167+0000","last_unstale":"2024-09-21T03:14:48.579673+0000","last_undegraded":"2024-09-21T03:14:48.579673+0000","last_fullsized":"2024-09-21T03:14:48.579673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:07.725691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":100668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":691564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":104440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":102168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":860160,"data_stored":691030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":100668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":102134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":101880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:14:53.477 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T03:14:53.478 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-21T03:14:53.478 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-21T03:14:53.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.732+0000 7fe3edc00640 1 -- 172.21.15.90:0/619272693 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3e80c4fe0 msgr2=0x7fe3e80c53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:53.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.732+0000 7fe3edc00640 1 --2- 172.21.15.90:0/619272693 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3e80c4fe0 0x7fe3e80c53f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4009830 tx=0x7fe3d402a480 comp rx=0 tx=0).stop 2024-09-21T03:14:53.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.732+0000 7fe3edc00640 1 -- 172.21.15.90:0/619272693 shutdown_connections 2024-09-21T03:14:53.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.732+0000 7fe3edc00640 1 --2- 172.21.15.90:0/619272693 >> v2:172.21.15.149:3300/0 conn(0x7fe3e806fa20 0x7fe3e806fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:53.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.732+0000 7fe3edc00640 1 --2- 172.21.15.90:0/619272693 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3e80c4fe0 0x7fe3e80c53f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:53.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.732+0000 7fe3edc00640 1 -- 172.21.15.90:0/619272693 >> 172.21.15.90:0/619272693 conn(0x7fe3e806d200 msgr2=0x7fe3e806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:53.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.732+0000 7fe3edc00640 1 -- 172.21.15.90:0/619272693 shutdown_connections 2024-09-21T03:14:53.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.732+0000 7fe3edc00640 1 -- 172.21.15.90:0/619272693 wait complete. 2024-09-21T03:14:53.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.734+0000 7fe3edc00640 1 Processor -- start 2024-09-21T03:14:53.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.734+0000 7fe3edc00640 1 -- start start 2024-09-21T03:14:53.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.735+0000 7fe3edc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3e806fa20 0x7fe3e81501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:53.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.735+0000 7fe3edc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3e80aaec0 0x7fe3e8155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:53.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.735+0000 7fe3edc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3e80c4fe0 0x7fe3e814d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:53.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.735+0000 7fe3edc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e81525c0 con 0x7fe3e806fa20 2024-09-21T03:14:53.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.735+0000 7fe3edc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e81553c0 con 0x7fe3e80c4fe0 2024-09-21T03:14:53.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.735+0000 7fe3edc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e80ad3d0 con 0x7fe3e80aaec0 2024-09-21T03:14:53.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.736+0000 7fe3e7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3e806fa20 0x7fe3e81501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:53.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.736+0000 7fe3e7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3e806fa20 0x7fe3e81501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49920/0 (socket says 172.21.15.90:49920) 2024-09-21T03:14:53.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.736+0000 7fe3e7e00640 1 -- 172.21.15.90:0/1612534195 learned_addr learned my addr 172.21.15.90:0/1612534195 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:53.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.736+0000 7fe3e7400640 1 --2- 172.21.15.90:0/1612534195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3e80aaec0 0x7fe3e8155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:53.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.736+0000 7fe3ed200640 1 --2- 172.21.15.90:0/1612534195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3e80c4fe0 0x7fe3e814d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:53.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.736+0000 7fe3e7e00640 1 -- 172.21.15.90:0/1612534195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3e80aaec0 msgr2=0x7fe3e8155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:53.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.736+0000 7fe3e7e00640 1 --2- 172.21.15.90:0/1612534195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3e80aaec0 0x7fe3e8155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:53.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.736+0000 7fe3e7e00640 1 -- 172.21.15.90:0/1612534195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3e80c4fe0 msgr2=0x7fe3e814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:53.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.736+0000 7fe3e7e00640 1 --2- 172.21.15.90:0/1612534195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3e80c4fe0 0x7fe3e814d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:53.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.736+0000 7fe3e7e00640 1 -- 172.21.15.90:0/1612534195 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e8151500 con 0x7fe3e806fa20 2024-09-21T03:14:53.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.736+0000 7fe3e7e00640 1 --2- 172.21.15.90:0/1612534195 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3e806fa20 0x7fe3e81501d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800c460 tx=0x7fe3d800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:53.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.736+0000 7fe3dfe00640 1 -- 172.21.15.90:0/1612534195 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d80052d0 con 0x7fe3e806fa20 2024-09-21T03:14:53.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.737+0000 7fe3dfe00640 1 -- 172.21.15.90:0/1612534195 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3d8005490 con 0x7fe3e806fa20 2024-09-21T03:14:53.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.737+0000 7fe3edc00640 1 -- 172.21.15.90:0/1612534195 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e81e1eb0 con 0x7fe3e806fa20 2024-09-21T03:14:53.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.737+0000 7fe3dfe00640 1 -- 172.21.15.90:0/1612534195 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8012870 con 0x7fe3e806fa20 2024-09-21T03:14:53.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.737+0000 7fe3edc00640 1 -- 172.21.15.90:0/1612534195 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e8158410 con 0x7fe3e806fa20 2024-09-21T03:14:53.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.738+0000 7fe3edc00640 1 -- 172.21.15.90:0/1612534195 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3e80c53f0 con 0x7fe3e806fa20 2024-09-21T03:14:53.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.739+0000 7fe3dfe00640 1 -- 172.21.15.90:0/1612534195 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe3d8012a10 con 0x7fe3e806fa20 2024-09-21T03:14:53.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.740+0000 7fe3dfe00640 1 --2- 172.21.15.90:0/1612534195 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe3c8078bc0 0x7fe3c807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:53.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.741+0000 7fe3dfe00640 1 -- 172.21.15.90:0/1612534195 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fe3d809a980 con 0x7fe3e806fa20 2024-09-21T03:14:53.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.741+0000 7fe3e7400640 1 --2- 172.21.15.90:0/1612534195 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe3c8078bc0 0x7fe3c807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:53.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.742+0000 7fe3e7400640 1 --2- 172.21.15.90:0/1612534195 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe3c8078bc0 0x7fe3c807b0d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4034000 tx=0x7fe3d4004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:53.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.745+0000 7fe3dfe00640 1 -- 172.21.15.90:0/1612534195 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe3d80624c0 con 0x7fe3e806fa20 2024-09-21T03:14:53.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.932+0000 7fe3edc00640 1 -- 172.21.15.90:0/1612534195 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fe3e8158b80 con 0x7fe3e806fa20 2024-09-21T03:14:53.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.933+0000 7fe3dfe00640 1 -- 172.21.15.90:0/1612534195 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v35) ==== 86+0+160 (secure 0 0 0) 0x7fe3d8066ef0 con 0x7fe3e806fa20 2024-09-21T03:14:53.934 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:53.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.935+0000 7fe3edc00640 1 -- 172.21.15.90:0/1612534195 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe3c8078bc0 msgr2=0x7fe3c807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:53.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.935+0000 7fe3edc00640 1 --2- 172.21.15.90:0/1612534195 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe3c8078bc0 0x7fe3c807b0d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4034000 tx=0x7fe3d4004730 comp rx=0 tx=0).stop 2024-09-21T03:14:53.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.935+0000 7fe3edc00640 1 -- 172.21.15.90:0/1612534195 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3e806fa20 msgr2=0x7fe3e81501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:53.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.935+0000 7fe3edc00640 1 --2- 172.21.15.90:0/1612534195 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3e806fa20 0x7fe3e81501d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800c460 tx=0x7fe3d800c920 comp rx=0 tx=0).stop 2024-09-21T03:14:53.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.935+0000 7fe3edc00640 1 -- 172.21.15.90:0/1612534195 shutdown_connections 2024-09-21T03:14:53.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.935+0000 7fe3edc00640 1 --2- 172.21.15.90:0/1612534195 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe3c8078bc0 0x7fe3c807b0d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:53.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.935+0000 7fe3edc00640 1 --2- 172.21.15.90:0/1612534195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3e80c4fe0 0x7fe3e814d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:53.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.935+0000 7fe3edc00640 1 --2- 172.21.15.90:0/1612534195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3e80aaec0 0x7fe3e8155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:53.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.935+0000 7fe3edc00640 1 --2- 172.21.15.90:0/1612534195 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3e806fa20 0x7fe3e81501d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:53.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.935+0000 7fe3edc00640 1 -- 172.21.15.90:0/1612534195 >> 172.21.15.90:0/1612534195 conn(0x7fe3e806d200 msgr2=0x7fe3e80c77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:53.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.935+0000 7fe3edc00640 1 -- 172.21.15.90:0/1612534195 shutdown_connections 2024-09-21T03:14:53.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:53.935+0000 7fe3edc00640 1 -- 172.21.15.90:0/1612534195 wait complete. 2024-09-21T03:14:53.957 INFO:teuthology.orchestra.run.smithi090.stdout:[{"version":35,"timestamp":"2024-09-21T03:14:25.024699+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"3810.318572"}]}] 2024-09-21T03:14:53.957 INFO:tasks.ceph_manager:config epoch is 35 2024-09-21T03:14:53.957 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T03:14:53.957 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-21T03:14:53.958 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-21T03:14:54.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.176+0000 7f06bb600640 1 -- 172.21.15.90:0/2076137671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06b40acca0 msgr2=0x7f06b4074220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:54.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.176+0000 7f06bb600640 1 --2- 172.21.15.90:0/2076137671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06b40acca0 0x7f06b4074220 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f06b4070d20 tx=0x7f06ac02a4d0 comp rx=0 tx=0).stop 2024-09-21T03:14:54.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.176+0000 7f06bb600640 1 -- 172.21.15.90:0/2076137671 shutdown_connections 2024-09-21T03:14:54.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.176+0000 7f06bb600640 1 --2- 172.21.15.90:0/2076137671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06b40acca0 0x7f06b4074220 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:54.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.176+0000 7f06bb600640 1 --2- 172.21.15.90:0/2076137671 >> v2:172.21.15.149:3300/0 conn(0x7f06b40ac350 0x7f06b40ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:54.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.176+0000 7f06bb600640 1 --2- 172.21.15.90:0/2076137671 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b406d960 0x7f06b413dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:54.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.176+0000 7f06bb600640 1 -- 172.21.15.90:0/2076137671 >> 172.21.15.90:0/2076137671 conn(0x7f06b40c8ba0 msgr2=0x7f06b406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:54.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.176+0000 7f06bb600640 1 -- 172.21.15.90:0/2076137671 shutdown_connections 2024-09-21T03:14:54.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.176+0000 7f06bb600640 1 -- 172.21.15.90:0/2076137671 wait complete. 2024-09-21T03:14:54.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.178+0000 7f06bb600640 1 Processor -- start 2024-09-21T03:14:54.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.178+0000 7f06bb600640 1 -- start start 2024-09-21T03:14:54.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.180+0000 7f06bb600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06b406d960 0x7f06b414fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:54.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.180+0000 7f06bb600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b40ac350 0x7f06b41f0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:54.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.180+0000 7f06bb600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06b40acca0 0x7f06b40c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:54.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.180+0000 7f06bb600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f06b40ab640 con 0x7f06b406d960 2024-09-21T03:14:54.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.180+0000 7f06bb600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f06b40ab360 con 0x7f06b40acca0 2024-09-21T03:14:54.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.180+0000 7f06bb600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f06b4074760 con 0x7f06b40ac350 2024-09-21T03:14:54.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.180+0000 7f06b8c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06b406d960 0x7f06b414fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:54.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.180+0000 7f06b8c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06b406d960 0x7f06b414fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49938/0 (socket says 172.21.15.90:49938) 2024-09-21T03:14:54.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.180+0000 7f06b8c00640 1 -- 172.21.15.90:0/1300441935 learned_addr learned my addr 172.21.15.90:0/1300441935 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:54.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.180+0000 7f06b3e00640 1 --2- 172.21.15.90:0/1300441935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b40ac350 0x7f06b41f0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:54.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.180+0000 7f06b9600640 1 --2- 172.21.15.90:0/1300441935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06b40acca0 0x7f06b40c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:54.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.180+0000 7f06b8c00640 1 -- 172.21.15.90:0/1300441935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b40ac350 msgr2=0x7f06b41f0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:54.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.180+0000 7f06b8c00640 1 --2- 172.21.15.90:0/1300441935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b40ac350 0x7f06b41f0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:54.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.181+0000 7f06b8c00640 1 -- 172.21.15.90:0/1300441935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06b40acca0 msgr2=0x7f06b40c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:54.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.181+0000 7f06b8c00640 1 --2- 172.21.15.90:0/1300441935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06b40acca0 0x7f06b40c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:54.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.181+0000 7f06b8c00640 1 -- 172.21.15.90:0/1300441935 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b4150010 con 0x7f06b406d960 2024-09-21T03:14:54.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.181+0000 7f06b8c00640 1 --2- 172.21.15.90:0/1300441935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06b406d960 0x7f06b414fad0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009270 tx=0x7f06a400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:54.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.181+0000 7f06b0c00640 1 -- 172.21.15.90:0/1300441935 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a4016070 con 0x7f06b406d960 2024-09-21T03:14:54.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.181+0000 7f06b0c00640 1 -- 172.21.15.90:0/1300441935 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06a400c910 con 0x7f06b406d960 2024-09-21T03:14:54.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.181+0000 7f06bb600640 1 -- 172.21.15.90:0/1300441935 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06b40c67b0 con 0x7f06b406d960 2024-09-21T03:14:54.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.181+0000 7f06b0c00640 1 -- 172.21.15.90:0/1300441935 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a400cd60 con 0x7f06b406d960 2024-09-21T03:14:54.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.181+0000 7f06bb600640 1 -- 172.21.15.90:0/1300441935 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06b41f1540 con 0x7f06b406d960 2024-09-21T03:14:54.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.182+0000 7f06bb600640 1 -- 172.21.15.90:0/1300441935 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06b4074be0 con 0x7f06b406d960 2024-09-21T03:14:54.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.183+0000 7f06b0c00640 1 -- 172.21.15.90:0/1300441935 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f06a4019070 con 0x7f06b406d960 2024-09-21T03:14:54.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.185+0000 7f06b0c00640 1 --2- 172.21.15.90:0/1300441935 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0694078bc0 0x7f069407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:54.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.185+0000 7f06b0c00640 1 -- 172.21.15.90:0/1300441935 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f06a409b8b0 con 0x7f06b406d960 2024-09-21T03:14:54.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.185+0000 7f06b3e00640 1 --2- 172.21.15.90:0/1300441935 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0694078bc0 0x7f069407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:54.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.186+0000 7f06b3e00640 1 --2- 172.21.15.90:0/1300441935 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0694078bc0 0x7f069407b0d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f06a0005fd0 tx=0x7f06a000d4b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:54.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.190+0000 7f06b0c00640 1 -- 172.21.15.90:0/1300441935 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f06b4150010 con 0x7f06b406d960 2024-09-21T03:14:54.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.423+0000 7f06bb600640 1 -- 172.21.15.90:0/1300441935 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f06b4159190 con 0x7f06b406d960 2024-09-21T03:14:54.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.426+0000 7f06b0c00640 1 -- 172.21.15.90:0/1300441935 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194722 (secure 0 0 0) 0x7f06a4063920 con 0x7f06b406d960 2024-09-21T03:14:54.430 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:54.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.430+0000 7f06bb600640 1 -- 172.21.15.90:0/1300441935 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0694078bc0 msgr2=0x7f069407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:54.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.430+0000 7f06bb600640 1 --2- 172.21.15.90:0/1300441935 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0694078bc0 0x7f069407b0d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f06a0005fd0 tx=0x7f06a000d4b0 comp rx=0 tx=0).stop 2024-09-21T03:14:54.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.430+0000 7f06bb600640 1 -- 172.21.15.90:0/1300441935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06b406d960 msgr2=0x7f06b414fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:54.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.430+0000 7f06bb600640 1 --2- 172.21.15.90:0/1300441935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06b406d960 0x7f06b414fad0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009270 tx=0x7f06a400ee80 comp rx=0 tx=0).stop 2024-09-21T03:14:54.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.430+0000 7f06bb600640 1 -- 172.21.15.90:0/1300441935 shutdown_connections 2024-09-21T03:14:54.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.430+0000 7f06bb600640 1 --2- 172.21.15.90:0/1300441935 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0694078bc0 0x7f069407b0d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:54.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.430+0000 7f06bb600640 1 --2- 172.21.15.90:0/1300441935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06b40acca0 0x7f06b40c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:54.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.430+0000 7f06bb600640 1 --2- 172.21.15.90:0/1300441935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b40ac350 0x7f06b41f0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:54.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.430+0000 7f06bb600640 1 --2- 172.21.15.90:0/1300441935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06b406d960 0x7f06b414fad0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:54.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.430+0000 7f06bb600640 1 -- 172.21.15.90:0/1300441935 >> 172.21.15.90:0/1300441935 conn(0x7f06b40c8ba0 msgr2=0x7f06b413aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:54.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.430+0000 7f06bb600640 1 -- 172.21.15.90:0/1300441935 shutdown_connections 2024-09-21T03:14:54.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.430+0000 7f06bb600640 1 -- 172.21.15.90:0/1300441935 wait complete. 2024-09-21T03:14:54.452 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":5,"flags":0,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1230645092},{"type":"v1","addr":"172.21.15.149:6801","nonce":1230645092}]},"active_addr":"172.21.15.149:6801/1230645092","active_change":"2024-09-21T03:14:14.459600+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4112,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":2085862170}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":3157367013}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":2907606044}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":2303433732}]}]} 2024-09-21T03:14:54.456 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-21T03:14:54.456 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-21T03:14:54.456 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:14:54.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.680+0000 7f6bb7e00640 1 -- 172.21.15.90:0/880414980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b9c003a50 msgr2=0x7f6b9c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:54.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.680+0000 7f6bb7e00640 1 --2- 172.21.15.90:0/880414980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b9c003a50 0x7f6b9c003ec0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6ba80016c0 tx=0x7f6b9c005830 comp rx=0 tx=0).stop 2024-09-21T03:14:54.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.680+0000 7f6bb7e00640 1 -- 172.21.15.90:0/880414980 shutdown_connections 2024-09-21T03:14:54.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.680+0000 7f6bb7e00640 1 --2- 172.21.15.90:0/880414980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b9c003a50 0x7f6b9c003ec0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:54.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.680+0000 7f6bb7e00640 1 -- 172.21.15.90:0/880414980 >> 172.21.15.90:0/880414980 conn(0x7f6bb80c84c0 msgr2=0x7f6bb80c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:54.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.680+0000 7f6bb7e00640 1 -- 172.21.15.90:0/880414980 shutdown_connections 2024-09-21T03:14:54.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.680+0000 7f6bb7e00640 1 -- 172.21.15.90:0/880414980 wait complete. 2024-09-21T03:14:54.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.682+0000 7f6bb7e00640 1 Processor -- start 2024-09-21T03:14:54.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.682+0000 7f6bb7e00640 1 -- start start 2024-09-21T03:14:54.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.684+0000 7f6bb7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b9c003a50 0x7f6bb80c16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:54.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.684+0000 7f6bb7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6bb81ecec0 0x7f6bb81ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:54.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.684+0000 7f6bb7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bb8146470 0x7f6bb8146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:54.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.684+0000 7f6bb7e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb80742b0 con 0x7f6bb81ecec0 2024-09-21T03:14:54.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.684+0000 7f6bb7e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb80c44e0 con 0x7f6bb8146470 2024-09-21T03:14:54.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.684+0000 7f6bb7e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6bb8154890 con 0x7f6b9c003a50 2024-09-21T03:14:54.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.684+0000 7f6bae000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6bb81ecec0 0x7f6bb81ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:54.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.684+0000 7f6bae000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6bb81ecec0 0x7f6bb81ed2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49944/0 (socket says 172.21.15.90:49944) 2024-09-21T03:14:54.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.684+0000 7f6bae000640 1 -- 172.21.15.90:0/727989410 learned_addr learned my addr 172.21.15.90:0/727989410 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:54.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.684+0000 7f6bae000640 1 -- 172.21.15.90:0/727989410 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b9c003a50 msgr2=0x7f6bb80c16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:54.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.684+0000 7f6bae000640 1 --2- 172.21.15.90:0/727989410 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b9c003a50 0x7f6bb80c16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:54.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.684+0000 7f6bae000640 1 -- 172.21.15.90:0/727989410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bb8146470 msgr2=0x7f6bb8146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:54.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.684+0000 7f6bae000640 1 --2- 172.21.15.90:0/727989410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bb8146470 0x7f6bb8146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:54.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.684+0000 7f6bae000640 1 -- 172.21.15.90:0/727989410 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb8148b20 con 0x7f6bb81ecec0 2024-09-21T03:14:54.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.685+0000 7f6bae000640 1 --2- 172.21.15.90:0/727989410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6bb81ecec0 0x7f6bb81ed2d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0006680 tx=0x7f6ba00039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:54.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.685+0000 7f6baf400640 1 -- 172.21.15.90:0/727989410 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0015070 con 0x7f6bb81ecec0 2024-09-21T03:14:54.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.685+0000 7f6baf400640 1 -- 172.21.15.90:0/727989410 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ba0011860 con 0x7f6bb81ecec0 2024-09-21T03:14:54.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.685+0000 7f6bb7e00640 1 -- 172.21.15.90:0/727989410 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb8148e00 con 0x7f6bb81ecec0 2024-09-21T03:14:54.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.685+0000 7f6baf400640 1 -- 172.21.15.90:0/727989410 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0011cb0 con 0x7f6bb81ecec0 2024-09-21T03:14:54.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.685+0000 7f6bb7e00640 1 -- 172.21.15.90:0/727989410 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb81ec9a0 con 0x7f6bb81ecec0 2024-09-21T03:14:54.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.686+0000 7f6bb7e00640 1 -- 172.21.15.90:0/727989410 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb81ec7b0 con 0x7f6bb81ecec0 2024-09-21T03:14:54.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.687+0000 7f6baf400640 1 -- 172.21.15.90:0/727989410 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ba0018070 con 0x7f6bb81ecec0 2024-09-21T03:14:54.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.688+0000 7f6baf400640 1 --2- 172.21.15.90:0/727989410 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6b94078bc0 0x7f6b9407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:54.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.688+0000 7f6baf400640 1 -- 172.21.15.90:0/727989410 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f6ba009bce0 con 0x7f6bb81ecec0 2024-09-21T03:14:54.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.689+0000 7f6bb6a00640 1 --2- 172.21.15.90:0/727989410 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6b94078bc0 0x7f6b9407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:54.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.689+0000 7f6bb6a00640 1 --2- 172.21.15.90:0/727989410 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6b94078bc0 0x7f6b9407b0d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8032000 tx=0x7f6ba8001120 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:54.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.693+0000 7f6baf400640 1 -- 172.21.15.90:0/727989410 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6ba0063e70 con 0x7f6bb81ecec0 2024-09-21T03:14:54.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.880+0000 7f6bb7e00640 1 -- 172.21.15.90:0/727989410 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6bb8155360 con 0x7f6bb81ecec0 2024-09-21T03:14:54.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.881+0000 7f6baf400640 1 -- 172.21.15.90:0/727989410 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20407 (secure 0 0 0) 0x7f6ba0063770 con 0x7f6bb81ecec0 2024-09-21T03:14:54.883 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:54.884 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":25,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","created":"2024-09-21T03:14:09.323302+0000","modified":"2024-09-21T03:14:48.547226+0000","last_up_change":"2024-09-21T03:14:25.329650+0000","last_in_change":"2024-09-21T03:14:15.386953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:14:24.511246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-21T03:14:35.815250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-21T03:14:36.914615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-21T03:14:45.298287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-21T03:14:45.977111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ceaacfab-e71c-45e2-ac50-4597dfd460bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6809","nonce":3187794863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6811","nonce":3187794863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6815","nonce":3187794863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6813","nonce":3187794863}]},"public_addr":"172.21.15.90:6809/3187794863","cluster_addr":"172.21.15.90:6811/3187794863","heartbeat_back_addr":"172.21.15.90:6815/3187794863","heartbeat_front_addr":"172.21.15.90:6813/3187794863","state":["exists","up"]},{"osd":1,"uuid":"86f91523-232b-4e80-ada7-d9e12770adb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6801","nonce":3769758484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6803","nonce":3769758484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6807","nonce":3769758484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6805","nonce":3769758484}]},"public_addr":"172.21.15.90:6801/3769758484","cluster_addr":"172.21.15.90:6803/3769758484","heartbeat_back_addr":"172.21.15.90:6807/3769758484","heartbeat_front_addr":"172.21.15.90:6805/3769758484","state":["exists","up"]},{"osd":2,"uuid":"6eb0f47b-e767-49c0-8d72-07f71b9c2e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6825","nonce":1025535744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6827","nonce":1025535744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6831","nonce":1025535744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6829","nonce":1025535744}]},"public_addr":"172.21.15.90:6825/1025535744","cluster_addr":"172.21.15.90:6827/1025535744","heartbeat_back_addr":"172.21.15.90:6831/1025535744","heartbeat_front_addr":"172.21.15.90:6829/1025535744","state":["exists","up"]},{"osd":3,"uuid":"64418862-beef-479c-be11-dfe0e515e09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6817","nonce":1515884437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6819","nonce":1515884437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6823","nonce":1515884437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6821","nonce":1515884437}]},"public_addr":"172.21.15.90:6817/1515884437","cluster_addr":"172.21.15.90:6819/1515884437","heartbeat_back_addr":"172.21.15.90:6823/1515884437","heartbeat_front_addr":"172.21.15.90:6821/1515884437","state":["exists","up"]},{"osd":4,"uuid":"a05b63f4-ec0a-426c-9d60-285e2680a897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6816","nonce":4278726553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6820","nonce":4278726553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6825","nonce":4278726553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6823","nonce":4278726553}]},"public_addr":"172.21.15.149:6816/4278726553","cluster_addr":"172.21.15.149:6820/4278726553","heartbeat_back_addr":"172.21.15.149:6825/4278726553","heartbeat_front_addr":"172.21.15.149:6823/4278726553","state":["exists","up"]},{"osd":5,"uuid":"3a1bab89-963c-4fe7-b14f-3080c5cf7830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6827","nonce":1341677333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6829","nonce":1341677333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6833","nonce":1341677333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6831","nonce":1341677333}]},"public_addr":"172.21.15.149:6827/1341677333","cluster_addr":"172.21.15.149:6829/1341677333","heartbeat_back_addr":"172.21.15.149:6833/1341677333","heartbeat_front_addr":"172.21.15.149:6831/1341677333","state":["exists","up"]},{"osd":6,"uuid":"bfcd1596-2688-4deb-be2e-55f305a5b4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6811","nonce":821196931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6813","nonce":821196931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6821","nonce":821196931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6817","nonce":821196931}]},"public_addr":"172.21.15.149:6811/821196931","cluster_addr":"172.21.15.149:6813/821196931","heartbeat_back_addr":"172.21.15.149:6821/821196931","heartbeat_front_addr":"172.21.15.149:6817/821196931","state":["exists","up"]},{"osd":7,"uuid":"58b19790-4006-4f07-966c-911b938cc1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6803","nonce":1657326880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6805","nonce":1657326880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6809","nonce":1657326880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6807","nonce":1657326880}]},"public_addr":"172.21.15.149:6803/1657326880","cluster_addr":"172.21.15.149:6805/1657326880","heartbeat_back_addr":"172.21.15.149:6809/1657326880","heartbeat_front_addr":"172.21.15.149:6807/1657326880","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.399701+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.051745+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.190159+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:23.240143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.446570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.259974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:21.990407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.459259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:14:54.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.884+0000 7f6bb7e00640 1 -- 172.21.15.90:0/727989410 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6b94078bc0 msgr2=0x7f6b9407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:54.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.884+0000 7f6bb7e00640 1 --2- 172.21.15.90:0/727989410 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6b94078bc0 0x7f6b9407b0d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8032000 tx=0x7f6ba8001120 comp rx=0 tx=0).stop 2024-09-21T03:14:54.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.884+0000 7f6bb7e00640 1 -- 172.21.15.90:0/727989410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6bb81ecec0 msgr2=0x7f6bb81ed2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:54.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.884+0000 7f6bb7e00640 1 --2- 172.21.15.90:0/727989410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6bb81ecec0 0x7f6bb81ed2d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0006680 tx=0x7f6ba00039c0 comp rx=0 tx=0).stop 2024-09-21T03:14:54.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.884+0000 7f6bb7e00640 1 -- 172.21.15.90:0/727989410 shutdown_connections 2024-09-21T03:14:54.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.884+0000 7f6bb7e00640 1 --2- 172.21.15.90:0/727989410 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6b94078bc0 0x7f6b9407b0d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:54.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.884+0000 7f6bb7e00640 1 --2- 172.21.15.90:0/727989410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bb8146470 0x7f6bb8146880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:54.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.884+0000 7f6bb7e00640 1 --2- 172.21.15.90:0/727989410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6bb81ecec0 0x7f6bb81ed2d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:54.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.884+0000 7f6bb7e00640 1 --2- 172.21.15.90:0/727989410 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b9c003a50 0x7f6bb80c16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:54.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.884+0000 7f6bb7e00640 1 -- 172.21.15.90:0/727989410 >> 172.21.15.90:0/727989410 conn(0x7f6bb80c84c0 msgr2=0x7f6bb8076670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:54.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.884+0000 7f6bb7e00640 1 -- 172.21.15.90:0/727989410 shutdown_connections 2024-09-21T03:14:54.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:54.884+0000 7f6bb7e00640 1 -- 172.21.15.90:0/727989410 wait complete. 2024-09-21T03:14:54.910 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-21T03:14:54.910 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:14:55.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.128+0000 7f326b200640 1 -- 172.21.15.90:0/700775830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32640c4210 msgr2=0x7f32640749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.128+0000 7f326b200640 1 --2- 172.21.15.90:0/700775830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32640c4210 0x7f32640749a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3264072a20 tx=0x7f324c02a560 comp rx=0 tx=0).stop 2024-09-21T03:14:55.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.128+0000 7f326b200640 1 -- 172.21.15.90:0/700775830 shutdown_connections 2024-09-21T03:14:55.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.128+0000 7f326b200640 1 --2- 172.21.15.90:0/700775830 >> v2:172.21.15.149:3300/0 conn(0x7f32640ac200 0x7f32640ac610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.128+0000 7f326b200640 1 --2- 172.21.15.90:0/700775830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32640c4210 0x7f32640749a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.128+0000 7f326b200640 1 -- 172.21.15.90:0/700775830 >> 172.21.15.90:0/700775830 conn(0x7f32640c8ba0 msgr2=0x7f326406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:55.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.128+0000 7f326b200640 1 -- 172.21.15.90:0/700775830 shutdown_connections 2024-09-21T03:14:55.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.128+0000 7f326b200640 1 -- 172.21.15.90:0/700775830 wait complete. 2024-09-21T03:14:55.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.130+0000 7f326b200640 1 Processor -- start 2024-09-21T03:14:55.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.131+0000 7f326b200640 1 -- start start 2024-09-21T03:14:55.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.132+0000 7f326b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3264072a70 0x7f32640c3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.132+0000 7f326b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32640ac200 0x7f3264151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.132+0000 7f326b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32640c4210 0x7f32640c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.132+0000 7f326b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3264073c70 con 0x7f32640c4210 2024-09-21T03:14:55.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.132+0000 7f326b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f32641556a0 con 0x7f32640ac200 2024-09-21T03:14:55.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.132+0000 7f326b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3264073df0 con 0x7f3264072a70 2024-09-21T03:14:55.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.132+0000 7f3269200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32640c4210 0x7f32640c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.132+0000 7f3269200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32640c4210 0x7f32640c1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33248/0 (socket says 172.21.15.90:33248) 2024-09-21T03:14:55.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.132+0000 7f3269200640 1 -- 172.21.15.90:0/568974250 learned_addr learned my addr 172.21.15.90:0/568974250 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:55.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.132+0000 7f325be00640 1 --2- 172.21.15.90:0/568974250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32640ac200 0x7f3264151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.132+0000 7f3263e00640 1 --2- 172.21.15.90:0/568974250 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3264072a70 0x7f32640c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.133+0000 7f3269200640 1 -- 172.21.15.90:0/568974250 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3264072a70 msgr2=0x7f32640c3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.133+0000 7f3269200640 1 --2- 172.21.15.90:0/568974250 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3264072a70 0x7f32640c3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.133+0000 7f3269200640 1 -- 172.21.15.90:0/568974250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32640ac200 msgr2=0x7f3264151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.133+0000 7f3269200640 1 --2- 172.21.15.90:0/568974250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32640ac200 0x7f3264151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.133+0000 7f3269200640 1 -- 172.21.15.90:0/568974250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3264150790 con 0x7f32640c4210 2024-09-21T03:14:55.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.133+0000 7f3269200640 1 --2- 172.21.15.90:0/568974250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32640c4210 0x7f32640c1da0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f325c00ea40 tx=0x7f325c00ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.133+0000 7f3260c00640 1 -- 172.21.15.90:0/568974250 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c00ce40 con 0x7f32640c4210 2024-09-21T03:14:55.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.133+0000 7f3260c00640 1 -- 172.21.15.90:0/568974250 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f325c004c10 con 0x7f32640c4210 2024-09-21T03:14:55.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.133+0000 7f326b200640 1 -- 172.21.15.90:0/568974250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3264150a70 con 0x7f32640c4210 2024-09-21T03:14:55.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.133+0000 7f3260c00640 1 -- 172.21.15.90:0/568974250 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c005020 con 0x7f32640c4210 2024-09-21T03:14:55.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.133+0000 7f326b200640 1 -- 172.21.15.90:0/568974250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32641eabe0 con 0x7f32640c4210 2024-09-21T03:14:55.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.134+0000 7f326b200640 1 -- 172.21.15.90:0/568974250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32641ed180 con 0x7f32640c4210 2024-09-21T03:14:55.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.136+0000 7f3260c00640 1 -- 172.21.15.90:0/568974250 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f325c0051c0 con 0x7f32640c4210 2024-09-21T03:14:55.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.137+0000 7f3260c00640 1 --2- 172.21.15.90:0/568974250 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3240078bc0 0x7f324007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.137+0000 7f3260c00640 1 -- 172.21.15.90:0/568974250 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f325c09bdd0 con 0x7f32640c4210 2024-09-21T03:14:55.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.137+0000 7f3263e00640 1 --2- 172.21.15.90:0/568974250 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3240078bc0 0x7f324007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.138+0000 7f3263e00640 1 --2- 172.21.15.90:0/568974250 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3240078bc0 0x7f324007b0d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3254001720 tx=0x7f3254009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.141+0000 7f3260c00640 1 -- 172.21.15.90:0/568974250 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f325c0637f0 con 0x7f32640c4210 2024-09-21T03:14:55.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.327+0000 7f326b200640 1 -- 172.21.15.90:0/568974250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32640ac610 con 0x7f32640c4210 2024-09-21T03:14:55.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.328+0000 7f3260c00640 1 -- 172.21.15.90:0/568974250 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20407 (secure 0 0 0) 0x7f325c068220 con 0x7f32640c4210 2024-09-21T03:14:55.330 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:55.330 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":25,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","created":"2024-09-21T03:14:09.323302+0000","modified":"2024-09-21T03:14:48.547226+0000","last_up_change":"2024-09-21T03:14:25.329650+0000","last_in_change":"2024-09-21T03:14:15.386953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:14:24.511246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-21T03:14:35.815250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-21T03:14:36.914615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-21T03:14:45.298287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-21T03:14:45.977111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ceaacfab-e71c-45e2-ac50-4597dfd460bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6809","nonce":3187794863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6811","nonce":3187794863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6815","nonce":3187794863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6813","nonce":3187794863}]},"public_addr":"172.21.15.90:6809/3187794863","cluster_addr":"172.21.15.90:6811/3187794863","heartbeat_back_addr":"172.21.15.90:6815/3187794863","heartbeat_front_addr":"172.21.15.90:6813/3187794863","state":["exists","up"]},{"osd":1,"uuid":"86f91523-232b-4e80-ada7-d9e12770adb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6801","nonce":3769758484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6803","nonce":3769758484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6807","nonce":3769758484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6805","nonce":3769758484}]},"public_addr":"172.21.15.90:6801/3769758484","cluster_addr":"172.21.15.90:6803/3769758484","heartbeat_back_addr":"172.21.15.90:6807/3769758484","heartbeat_front_addr":"172.21.15.90:6805/3769758484","state":["exists","up"]},{"osd":2,"uuid":"6eb0f47b-e767-49c0-8d72-07f71b9c2e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6825","nonce":1025535744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6827","nonce":1025535744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6831","nonce":1025535744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6829","nonce":1025535744}]},"public_addr":"172.21.15.90:6825/1025535744","cluster_addr":"172.21.15.90:6827/1025535744","heartbeat_back_addr":"172.21.15.90:6831/1025535744","heartbeat_front_addr":"172.21.15.90:6829/1025535744","state":["exists","up"]},{"osd":3,"uuid":"64418862-beef-479c-be11-dfe0e515e09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6817","nonce":1515884437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6819","nonce":1515884437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6823","nonce":1515884437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6821","nonce":1515884437}]},"public_addr":"172.21.15.90:6817/1515884437","cluster_addr":"172.21.15.90:6819/1515884437","heartbeat_back_addr":"172.21.15.90:6823/1515884437","heartbeat_front_addr":"172.21.15.90:6821/1515884437","state":["exists","up"]},{"osd":4,"uuid":"a05b63f4-ec0a-426c-9d60-285e2680a897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6816","nonce":4278726553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6820","nonce":4278726553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6825","nonce":4278726553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6823","nonce":4278726553}]},"public_addr":"172.21.15.149:6816/4278726553","cluster_addr":"172.21.15.149:6820/4278726553","heartbeat_back_addr":"172.21.15.149:6825/4278726553","heartbeat_front_addr":"172.21.15.149:6823/4278726553","state":["exists","up"]},{"osd":5,"uuid":"3a1bab89-963c-4fe7-b14f-3080c5cf7830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6827","nonce":1341677333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6829","nonce":1341677333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6833","nonce":1341677333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6831","nonce":1341677333}]},"public_addr":"172.21.15.149:6827/1341677333","cluster_addr":"172.21.15.149:6829/1341677333","heartbeat_back_addr":"172.21.15.149:6833/1341677333","heartbeat_front_addr":"172.21.15.149:6831/1341677333","state":["exists","up"]},{"osd":6,"uuid":"bfcd1596-2688-4deb-be2e-55f305a5b4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6811","nonce":821196931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6813","nonce":821196931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6821","nonce":821196931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6817","nonce":821196931}]},"public_addr":"172.21.15.149:6811/821196931","cluster_addr":"172.21.15.149:6813/821196931","heartbeat_back_addr":"172.21.15.149:6821/821196931","heartbeat_front_addr":"172.21.15.149:6817/821196931","state":["exists","up"]},{"osd":7,"uuid":"58b19790-4006-4f07-966c-911b938cc1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6803","nonce":1657326880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6805","nonce":1657326880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6809","nonce":1657326880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6807","nonce":1657326880}]},"public_addr":"172.21.15.149:6803/1657326880","cluster_addr":"172.21.15.149:6805/1657326880","heartbeat_back_addr":"172.21.15.149:6809/1657326880","heartbeat_front_addr":"172.21.15.149:6807/1657326880","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.399701+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.051745+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.190159+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:23.240143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.446570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.259974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:21.990407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.459259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:14:55.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.331+0000 7f326b200640 1 -- 172.21.15.90:0/568974250 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3240078bc0 msgr2=0x7f324007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.331+0000 7f326b200640 1 --2- 172.21.15.90:0/568974250 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3240078bc0 0x7f324007b0d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3254001720 tx=0x7f3254009040 comp rx=0 tx=0).stop 2024-09-21T03:14:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.331+0000 7f326b200640 1 -- 172.21.15.90:0/568974250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32640c4210 msgr2=0x7f32640c1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.331+0000 7f326b200640 1 --2- 172.21.15.90:0/568974250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32640c4210 0x7f32640c1da0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f325c00ea40 tx=0x7f325c00ef00 comp rx=0 tx=0).stop 2024-09-21T03:14:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.331+0000 7f326b200640 1 -- 172.21.15.90:0/568974250 shutdown_connections 2024-09-21T03:14:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.331+0000 7f326b200640 1 --2- 172.21.15.90:0/568974250 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3240078bc0 0x7f324007b0d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.331+0000 7f326b200640 1 --2- 172.21.15.90:0/568974250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32640c4210 0x7f32640c1da0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.331+0000 7f326b200640 1 --2- 172.21.15.90:0/568974250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32640ac200 0x7f3264151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.331+0000 7f326b200640 1 --2- 172.21.15.90:0/568974250 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3264072a70 0x7f32640c3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.331+0000 7f326b200640 1 -- 172.21.15.90:0/568974250 >> 172.21.15.90:0/568974250 conn(0x7f32640c8ba0 msgr2=0x7f326414d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.331+0000 7f326b200640 1 -- 172.21.15.90:0/568974250 shutdown_connections 2024-09-21T03:14:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.331+0000 7f326b200640 1 -- 172.21.15.90:0/568974250 wait complete. 2024-09-21T03:14:55.357 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-21T03:14:55.358 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-21T03:14:55.358 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-21T03:14:55.359 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-21T03:14:55.359 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-21T03:14:55.360 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-21T03:14:55.360 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-21T03:14:55.360 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-21T03:14:55.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.758+0000 7ff73f800640 1 -- 172.21.15.90:0/2358757418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff73004cc80 msgr2=0x7ff7300d8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.758+0000 7ff73f800640 1 --2- 172.21.15.90:0/2358757418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff73004cc80 0x7ff7300d8640 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff73000a980 tx=0x7ff72c02a440 comp rx=0 tx=0).stop 2024-09-21T03:14:55.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.758+0000 7f3e4ee00640 1 -- 172.21.15.90:0/887167596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e48072c00 msgr2=0x7f3e48158700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.758+0000 7f3e4ee00640 1 --2- 172.21.15.90:0/887167596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e48072c00 0x7f3e48158700 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3e34005fd0 tx=0x7f3e3402a4b0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.758+0000 7f3c78e00640 1 -- 172.21.15.90:0/3288019508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c74150d40 msgr2=0x7f3c74151150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.758+0000 7f3c78e00640 1 --2- 172.21.15.90:0/3288019508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c74150d40 0x7f3c74151150 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3c740aab60 tx=0x7f3c5c02a4a0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.759+0000 7f3c78e00640 1 -- 172.21.15.90:0/3288019508 shutdown_connections 2024-09-21T03:14:55.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.759+0000 7f3c78e00640 1 --2- 172.21.15.90:0/3288019508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c74150d40 0x7f3c74151150 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.759+0000 7f3c78e00640 1 -- 172.21.15.90:0/3288019508 >> 172.21.15.90:0/3288019508 conn(0x7f3c740c8940 msgr2=0x7f3c740c4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:55.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.759+0000 7f3c78e00640 1 -- 172.21.15.90:0/3288019508 shutdown_connections 2024-09-21T03:14:55.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.759+0000 7f3e4ee00640 1 -- 172.21.15.90:0/887167596 shutdown_connections 2024-09-21T03:14:55.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.759+0000 7f3e4ee00640 1 --2- 172.21.15.90:0/887167596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e48072c00 0x7f3e48158700 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.759+0000 7f3e4ee00640 1 -- 172.21.15.90:0/887167596 >> 172.21.15.90:0/887167596 conn(0x7f3e4806d200 msgr2=0x7f3e4806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:55.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.759+0000 7f3c78e00640 1 -- 172.21.15.90:0/3288019508 wait complete. 2024-09-21T03:14:55.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.760+0000 7ff73f800640 1 -- 172.21.15.90:0/2358757418 shutdown_connections 2024-09-21T03:14:55.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.760+0000 7ff73f800640 1 --2- 172.21.15.90:0/2358757418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff73004cc80 0x7ff7300d8640 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.760+0000 7ff73f800640 1 -- 172.21.15.90:0/2358757418 >> 172.21.15.90:0/2358757418 conn(0x7ff73000a4e0 msgr2=0x7ff73004d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:55.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.760+0000 7ff73f800640 1 -- 172.21.15.90:0/2358757418 shutdown_connections 2024-09-21T03:14:55.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.759+0000 7f3e4ee00640 1 -- 172.21.15.90:0/887167596 shutdown_connections 2024-09-21T03:14:55.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.759+0000 7f3e4ee00640 1 -- 172.21.15.90:0/887167596 wait complete. 2024-09-21T03:14:55.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.763+0000 7f3e4ee00640 1 Processor -- start 2024-09-21T03:14:55.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.760+0000 7ff73f800640 1 -- 172.21.15.90:0/2358757418 wait complete. 2024-09-21T03:14:55.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.763+0000 7f3e4ee00640 1 -- start start 2024-09-21T03:14:55.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.763+0000 7f3c78e00640 1 Processor -- start 2024-09-21T03:14:55.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.764+0000 7f3c78e00640 1 -- start start 2024-09-21T03:14:55.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.764+0000 7ff73f800640 1 Processor -- start 2024-09-21T03:14:55.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.766+0000 7f3e4ee00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3e48072c00 0x7f3e480c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.766+0000 7f3c78e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c740ada40 0x7f3c741438e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.766+0000 7f3e4ee00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e480c4ec0 0x7f3e481f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.766+0000 7f3e4ee00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e480c52d0 0x7f3e4814ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.766+0000 7f3e4ee00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3e48158c40 con 0x7f3e480c4ec0 2024-09-21T03:14:55.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.766+0000 7f3e4ee00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3e480c34a0 con 0x7f3e480c52d0 2024-09-21T03:14:55.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.766+0000 7f3e4ee00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3e48072990 con 0x7f3e48072c00 2024-09-21T03:14:55.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.766+0000 7f3c78e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c74150d40 0x7f3c740c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.766+0000 7f3e4da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3e48072c00 0x7f3e480c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.766+0000 7f3c78e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c74153910 0x7f3c74165830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.766+0000 7f3c78e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3c74157cd0 con 0x7f3c74150d40 2024-09-21T03:14:55.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.766+0000 7f3c78e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3c740aac30 con 0x7f3c740ada40 2024-09-21T03:14:55.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.766+0000 7f3c78e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3c740c7a30 con 0x7f3c74153910 2024-09-21T03:14:55.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.766+0000 7f3e4d000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e480c4ec0 0x7f3e481f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.766+0000 7f3e4da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3e48072c00 0x7f3e480c6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:39846/0 (socket says 172.21.15.90:39846) 2024-09-21T03:14:55.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.766+0000 7f3e4da00640 1 -- 172.21.15.90:0/1370306237 learned_addr learned my addr 172.21.15.90:0/1370306237 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:55.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.764+0000 7ff73f800640 1 -- start start 2024-09-21T03:14:55.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.766+0000 7ff73f800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff730048920 0x7ff730175c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.766+0000 7ff73f800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff73004cc80 0x7ff7300d3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.766+0000 7ff73f800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7300d5490 0x7ff730041640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.766+0000 7ff73f800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff73004d090 con 0x7ff7300d5490 2024-09-21T03:14:55.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.767+0000 7ff73f800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff73002f630 con 0x7ff73004cc80 2024-09-21T03:14:55.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.767+0000 7ff73f800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff7300dc340 con 0x7ff730048920 2024-09-21T03:14:55.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.767+0000 7f3e4e400640 1 --2- 172.21.15.90:0/1370306237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e480c52d0 0x7f3e4814ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.767+0000 7f3e4da00640 1 -- 172.21.15.90:0/1370306237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e480c52d0 msgr2=0x7f3e4814ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.767+0000 7f3e4da00640 1 --2- 172.21.15.90:0/1370306237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e480c52d0 0x7f3e4814ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.767+0000 7f3e4da00640 1 -- 172.21.15.90:0/1370306237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e480c4ec0 msgr2=0x7f3e481f46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.767+0000 7f3e4da00640 1 --2- 172.21.15.90:0/1370306237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e480c4ec0 0x7f3e481f46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.767+0000 7f3e4da00640 1 -- 172.21.15.90:0/1370306237 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e480c8910 con 0x7f3e48072c00 2024-09-21T03:14:55.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.767+0000 7f3c71e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c740ada40 0x7f3c741438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.767+0000 7f3c72800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c74153910 0x7f3c74165830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.767+0000 7f3c71e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c740ada40 0x7f3c741438e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:37360/0 (socket says 172.21.15.90:37360) 2024-09-21T03:14:55.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.767+0000 7f3c71e00640 1 -- 172.21.15.90:0/412881006 learned_addr learned my addr 172.21.15.90:0/412881006 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:55.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.767+0000 7ff73ce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff730048920 0x7ff730175c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.768+0000 7ff737e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff73004cc80 0x7ff7300d3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.768+0000 7f3e4da00640 1 --2- 172.21.15.90:0/1370306237 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3e48072c00 0x7f3e480c6480 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3e34006010 tx=0x7f3e34003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.768+0000 7ff737e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff73004cc80 0x7ff7300d3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:37366/0 (socket says 172.21.15.90:37366) 2024-09-21T03:14:55.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.768+0000 7f3e45600640 1 -- 172.21.15.90:0/1370306237 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3403e030 con 0x7f3e48072c00 2024-09-21T03:14:55.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.768+0000 7f2b98e00640 1 -- 172.21.15.90:0/3252579511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b8c0d7920 msgr2=0x7f2b8c0319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.768+0000 7f2b98e00640 1 --2- 172.21.15.90:0/3252579511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b8c0d7920 0x7f2b8c0319f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009830 tx=0x7f2b8802a5f0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.768+0000 7f3e4ee00640 1 -- 172.21.15.90:0/1370306237 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e481f50a0 con 0x7f3e48072c00 2024-09-21T03:14:55.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.768+0000 7f3c71e00640 1 -- 172.21.15.90:0/412881006 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c74153910 msgr2=0x7f3c74165830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.768+0000 7f3c71e00640 1 --2- 172.21.15.90:0/412881006 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c74153910 0x7f3c74165830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.768+0000 7f3c71e00640 1 -- 172.21.15.90:0/412881006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c74150d40 msgr2=0x7f3c740c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.768+0000 7f3c71e00640 1 --2- 172.21.15.90:0/412881006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c74150d40 0x7f3c740c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.768+0000 7f3c71e00640 1 -- 172.21.15.90:0/412881006 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c741face0 con 0x7f3c740ada40 2024-09-21T03:14:55.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.768+0000 7f3e4ee00640 1 -- 172.21.15.90:0/1370306237 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e481f5380 con 0x7f3e48072c00 2024-09-21T03:14:55.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.768+0000 7ff737e00640 1 -- 172.21.15.90:0/250649679 learned_addr learned my addr 172.21.15.90:0/250649679 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:55.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.768+0000 7f2b98e00640 1 -- 172.21.15.90:0/3252579511 shutdown_connections 2024-09-21T03:14:55.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.768+0000 7f2b98e00640 1 --2- 172.21.15.90:0/3252579511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b8c0d7920 0x7f2b8c0319f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.768+0000 7f2b98e00640 1 -- 172.21.15.90:0/3252579511 >> 172.21.15.90:0/3252579511 conn(0x7f2b8c04c8a0 msgr2=0x7f2b8c0312e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:55.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.768+0000 7f3e45600640 1 -- 172.21.15.90:0/1370306237 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e340047a0 con 0x7f3e48072c00 2024-09-21T03:14:55.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.768+0000 7f3e45600640 1 -- 172.21.15.90:0/1370306237 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3403e030 con 0x7f3e48072c00 2024-09-21T03:14:55.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.769+0000 7f2b98e00640 1 -- 172.21.15.90:0/3252579511 shutdown_connections 2024-09-21T03:14:55.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.769+0000 7ff73d800640 1 --2- 172.21.15.90:0/250649679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7300d5490 0x7ff730041640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.770+0000 7f3c71e00640 1 --2- 172.21.15.90:0/412881006 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c740ada40 0x7f3c741438e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400c750 tx=0x7f3c6400cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.770+0000 7ff737e00640 1 -- 172.21.15.90:0/250649679 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff730048920 msgr2=0x7ff730175c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.771+0000 7ff737e00640 1 --2- 172.21.15.90:0/250649679 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff730048920 0x7ff730175c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.771+0000 7f3c6aa00640 1 -- 172.21.15.90:0/412881006 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6400ce60 con 0x7f3c740ada40 2024-09-21T03:14:55.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.771+0000 7f3c6aa00640 1 -- 172.21.15.90:0/412881006 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c64003b70 con 0x7f3c740ada40 2024-09-21T03:14:55.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.771+0000 7f3c78e00640 1 -- 172.21.15.90:0/412881006 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c74154050 con 0x7f3c740ada40 2024-09-21T03:14:55.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.771+0000 7f3c78e00640 1 -- 172.21.15.90:0/412881006 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c741faa00 con 0x7f3c740ada40 2024-09-21T03:14:55.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.771+0000 7f3e45600640 1 -- 172.21.15.90:0/1370306237 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3e34041030 con 0x7f3e48072c00 2024-09-21T03:14:55.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.771+0000 7ff737e00640 1 -- 172.21.15.90:0/250649679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7300d5490 msgr2=0x7ff730041640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.771+0000 7ff737e00640 1 --2- 172.21.15.90:0/250649679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7300d5490 0x7ff730041640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.772+0000 7ff737e00640 1 -- 172.21.15.90:0/250649679 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7300ce9d0 con 0x7ff73004cc80 2024-09-21T03:14:55.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.772+0000 7ff73ce00640 1 --2- 172.21.15.90:0/250649679 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff730048920 0x7ff730175c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:14:55.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.772+0000 7ff73d800640 1 --2- 172.21.15.90:0/250649679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7300d5490 0x7ff730041640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:14:55.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.772+0000 7ff737e00640 1 --2- 172.21.15.90:0/250649679 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff73004cc80 0x7ff7300d3f70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff738000b60 tx=0x7ff7380767a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.769+0000 7f2b98e00640 1 -- 172.21.15.90:0/3252579511 wait complete. 2024-09-21T03:14:55.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.772+0000 7f3c6aa00640 1 -- 172.21.15.90:0/412881006 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6400a7f0 con 0x7f3c740ada40 2024-09-21T03:14:55.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.772+0000 7f3e45600640 1 --2- 172.21.15.90:0/1370306237 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3e28078dc0 0x7f3e2807b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.773+0000 7f2b98e00640 1 Processor -- start 2024-09-21T03:14:55.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.773+0000 7f3e4ee00640 1 -- 172.21.15.90:0/1370306237 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3e24001030 con 0x7f3e48072c00 2024-09-21T03:14:55.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.773+0000 7f3e45600640 1 -- 172.21.15.90:0/1370306237 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f3e340bb260 con 0x7f3e48072c00 2024-09-21T03:14:55.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.773+0000 7ff734c00640 1 -- 172.21.15.90:0/250649679 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7380751c0 con 0x7ff73004cc80 2024-09-21T03:14:55.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.773+0000 7f2b98e00640 1 -- start start 2024-09-21T03:14:55.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.773+0000 7ff734c00640 1 -- 172.21.15.90:0/250649679 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff738063800 con 0x7ff73004cc80 2024-09-21T03:14:55.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.773+0000 7ff734c00640 1 -- 172.21.15.90:0/250649679 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738075450 con 0x7ff73004cc80 2024-09-21T03:14:55.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.773+0000 7f3e4d000640 1 --2- 172.21.15.90:0/1370306237 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3e28078dc0 0x7f3e2807b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.773+0000 7f3e45600640 1 --2- 172.21.15.90:0/1370306237 >> [v2:172.21.15.149:6814/4278726553,v1:172.21.15.149:6816/4278726553] conn(0x7f3e280835b0 0x7f3e28085a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.773+0000 7f3e45600640 1 -- 172.21.15.90:0/1370306237 --> [v2:172.21.15.149:6814/4278726553,v1:172.21.15.149:6816/4278726553] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e3400b0b0 con 0x7f3e280835b0 2024-09-21T03:14:55.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.773+0000 7f3e45600640 1 -- 172.21.15.90:0/1370306237 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3e34035050 con 0x7f3e48072c00 2024-09-21T03:14:55.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.773+0000 7f3e4e400640 1 --2- 172.21.15.90:0/1370306237 >> [v2:172.21.15.149:6814/4278726553,v1:172.21.15.149:6816/4278726553] conn(0x7f3e280835b0 0x7f3e28085a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.774+0000 7ff73f800640 1 -- 172.21.15.90:0/250649679 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7300cec70 con 0x7ff73004cc80 2024-09-21T03:14:55.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.774+0000 7fe59f200640 1 -- 172.21.15.90:0/1225032329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe584005350 msgr2=0x7fe58400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.774+0000 7fe59f200640 1 --2- 172.21.15.90:0/1225032329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe584005350 0x7fe58400b9c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe590006fc0 tx=0x7fe584005830 comp rx=0 tx=0).stop 2024-09-21T03:14:55.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.774+0000 7ff73f800640 1 -- 172.21.15.90:0/250649679 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7300d6b30 con 0x7ff73004cc80 2024-09-21T03:14:55.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.774+0000 7f3e4d000640 1 --2- 172.21.15.90:0/1370306237 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3e28078dc0 0x7f3e2807b2d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c006fd0 tx=0x7f3e3c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.774+0000 7fe59f200640 1 -- 172.21.15.90:0/1225032329 shutdown_connections 2024-09-21T03:14:55.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.774+0000 7fe59f200640 1 --2- 172.21.15.90:0/1225032329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe584005350 0x7fe58400b9c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.774+0000 7fe59f200640 1 -- 172.21.15.90:0/1225032329 >> 172.21.15.90:0/1225032329 conn(0x7fe5980312e0 msgr2=0x7fe5980316f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:55.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.775+0000 7f3e4e400640 1 --2- 172.21.15.90:0/1370306237 >> [v2:172.21.15.149:6814/4278726553,v1:172.21.15.149:6816/4278726553] conn(0x7f3e280835b0 0x7f3e28085a00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.776+0000 7ff73f800640 1 -- 172.21.15.90:0/250649679 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff730040c80 con 0x7ff73004cc80 2024-09-21T03:14:55.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.775+0000 7fe59f200640 1 -- 172.21.15.90:0/1225032329 shutdown_connections 2024-09-21T03:14:55.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.775+0000 7fe59f200640 1 -- 172.21.15.90:0/1225032329 wait complete. 2024-09-21T03:14:55.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.776+0000 7f3e45600640 1 -- 172.21.15.90:0/1370306237 <== osd.4 v2:172.21.15.149:6814/4278726553 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3e3400b0b0 con 0x7f3e280835b0 2024-09-21T03:14:55.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.776+0000 7f2b98e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b8c031f30 0x7f2b8c006c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.777+0000 7f2b98e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b8c0d7920 0x7f2b8c045e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.777+0000 7f3c63400640 1 -- 172.21.15.90:0/412881006 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3c740ae010 con 0x7f3c740ada40 2024-09-21T03:14:55.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.777+0000 7f2b98e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b8c0ddfe0 0x7f2b8c0d92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.777+0000 7f2b92a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b8c0d7920 0x7f2b8c045e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.777+0000 7f2b92a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b8c0d7920 0x7f2b8c045e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:37384/0 (socket says 172.21.15.90:37384) 2024-09-21T03:14:55.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.778+0000 7f2b92a00640 1 -- 172.21.15.90:0/4167390788 learned_addr learned my addr 172.21.15.90:0/4167390788 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:55.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.778+0000 7fe59f200640 1 Processor -- start 2024-09-21T03:14:55.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.778+0000 7f2b98e00640 1 -- 172.21.15.90:0/4167390788 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8c04a740 con 0x7f2b8c0ddfe0 2024-09-21T03:14:55.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.779+0000 7f2b98e00640 1 -- 172.21.15.90:0/4167390788 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8c0d7d30 con 0x7f2b8c0d7920 2024-09-21T03:14:55.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.779+0000 7f2b98e00640 1 -- 172.21.15.90:0/4167390788 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2b8c04a8c0 con 0x7f2b8c031f30 2024-09-21T03:14:55.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.779+0000 7f3c6aa00640 1 -- 172.21.15.90:0/412881006 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3c6400a990 con 0x7f3c740ada40 2024-09-21T03:14:55.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.779+0000 7fe59f200640 1 -- start start 2024-09-21T03:14:55.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.779+0000 7f2b93e00640 1 --2- 172.21.15.90:0/4167390788 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b8c0ddfe0 0x7f2b8c0d92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.780+0000 7f2b93400640 1 --2- 172.21.15.90:0/4167390788 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b8c031f30 0x7f2b8c006c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.781+0000 7fb6a2200640 1 -- 172.21.15.90:0/4247847977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb69c0c81b0 msgr2=0x7fb69c1541c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.781+0000 7fb6a2200640 1 --2- 172.21.15.90:0/4247847977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb69c0c81b0 0x7fb69c1541c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb68c009930 tx=0x7fb68c02a510 comp rx=0 tx=0).stop 2024-09-21T03:14:55.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.781+0000 7fb6a2200640 1 -- 172.21.15.90:0/4247847977 shutdown_connections 2024-09-21T03:14:55.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.781+0000 7fb6a2200640 1 --2- 172.21.15.90:0/4247847977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb69c0c81b0 0x7fb69c1541c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.781+0000 7fb6a2200640 1 -- 172.21.15.90:0/4247847977 >> 172.21.15.90:0/4247847977 conn(0x7fb69c0c8e40 msgr2=0x7fb69c0c9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:55.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.781+0000 7f3c6aa00640 1 --2- 172.21.15.90:0/412881006 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3c50078c90 0x7f3c5007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.781+0000 7f3c6aa00640 1 -- 172.21.15.90:0/412881006 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f3c6409ad90 con 0x7f3c740ada40 2024-09-21T03:14:55.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.781+0000 7f3c6aa00640 1 --2- 172.21.15.90:0/412881006 >> [v2:172.21.15.90:6808/3187794863,v1:172.21.15.90:6809/3187794863] conn(0x7f3c500834f0 0x7f3c50085940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.781+0000 7f3c6aa00640 1 -- 172.21.15.90:0/412881006 --> [v2:172.21.15.90:6808/3187794863,v1:172.21.15.90:6809/3187794863] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c64003b70 con 0x7f3c500834f0 2024-09-21T03:14:55.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.781+0000 7fb6a2200640 1 -- 172.21.15.90:0/4247847977 shutdown_connections 2024-09-21T03:14:55.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.781+0000 7f3c6aa00640 1 -- 172.21.15.90:0/412881006 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3c6409e020 con 0x7f3c740ada40 2024-09-21T03:14:55.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.782+0000 7fb6a2200640 1 -- 172.21.15.90:0/4247847977 wait complete. 2024-09-21T03:14:55.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.782+0000 7f3c72800640 1 --2- 172.21.15.90:0/412881006 >> [v2:172.21.15.90:6808/3187794863,v1:172.21.15.90:6809/3187794863] conn(0x7f3c500834f0 0x7f3c50085940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.782+0000 7f7fc8e00640 1 -- 172.21.15.90:0/1498231519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fc40c93c0 msgr2=0x7f7fc4156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.782+0000 7f3c69400640 1 --2- 172.21.15.90:0/412881006 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3c50078c90 0x7f3c5007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.782+0000 7f7fc8e00640 1 --2- 172.21.15.90:0/1498231519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fc40c93c0 0x7f7fc4156c30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc005fd0 tx=0x7f7fbc02a820 comp rx=0 tx=0).stop 2024-09-21T03:14:55.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.782+0000 7ff734c00640 1 -- 172.21.15.90:0/250649679 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff738063bd0 con 0x7ff73004cc80 2024-09-21T03:14:55.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.782+0000 7fe59f200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe584005350 0x7fe598174b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.782+0000 7f7fc8e00640 1 -- 172.21.15.90:0/1498231519 shutdown_connections 2024-09-21T03:14:55.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.782+0000 7f7fc8e00640 1 --2- 172.21.15.90:0/1498231519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fc40c93c0 0x7f7fc4156c30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.782+0000 7f7fc8e00640 1 -- 172.21.15.90:0/1498231519 >> 172.21.15.90:0/1498231519 conn(0x7f7fc40750a0 msgr2=0x7f7fc40cc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:55.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.782+0000 7f2b92a00640 1 -- 172.21.15.90:0/4167390788 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b8c031f30 msgr2=0x7f2b8c006c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.782+0000 7f2b92a00640 1 --2- 172.21.15.90:0/4167390788 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b8c031f30 0x7f2b8c006c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.782+0000 7f2b92a00640 1 -- 172.21.15.90:0/4167390788 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b8c0ddfe0 msgr2=0x7f2b8c0d92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.782+0000 7f2b92a00640 1 --2- 172.21.15.90:0/4167390788 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b8c0ddfe0 0x7f2b8c0d92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.783+0000 7f2b92a00640 1 -- 172.21.15.90:0/4167390788 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8c1746a0 con 0x7f2b8c0d7920 2024-09-21T03:14:55.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.783+0000 7f2b93400640 1 --2- 172.21.15.90:0/4167390788 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b8c031f30 0x7f2b8c006c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:14:55.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.783+0000 7ff734c00640 1 --2- 172.21.15.90:0/250649679 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff718078c90 0x7ff71807b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.783+0000 7f7fc8e00640 1 -- 172.21.15.90:0/1498231519 shutdown_connections 2024-09-21T03:14:55.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.783+0000 7f3c72800640 1 --2- 172.21.15.90:0/412881006 >> [v2:172.21.15.90:6808/3187794863,v1:172.21.15.90:6809/3187794863] conn(0x7f3c500834f0 0x7f3c50085940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.783+0000 7fe59f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5980d6f20 0x7fe5980dc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.783+0000 7fe59f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe598178a10 0x7fe5980d6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.784+0000 7fe59f200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe59804e480 con 0x7fe584005350 2024-09-21T03:14:55.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.784+0000 7fe59f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe59804e300 con 0x7fe5980d6f20 2024-09-21T03:14:55.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.784+0000 7fe59f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe598007350 con 0x7fe598178a10 2024-09-21T03:14:55.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.784+0000 7fe59e800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe598178a10 0x7fe5980d6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.784+0000 7fe59e800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe598178a10 0x7fe5980d6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:39886/0 (socket says 172.21.15.90:39886) 2024-09-21T03:14:55.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.784+0000 7fe59e800640 1 -- 172.21.15.90:0/257150459 learned_addr learned my addr 172.21.15.90:0/257150459 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:55.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.783+0000 7ff734c00640 1 -- 172.21.15.90:0/250649679 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7ff738117a10 con 0x7ff73004cc80 2024-09-21T03:14:55.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.784+0000 7ff734c00640 1 --2- 172.21.15.90:0/250649679 >> [v2:172.21.15.90:6824/1025535744,v1:172.21.15.90:6825/1025535744] conn(0x7ff718083570 0x7ff7180859c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.784+0000 7ff734c00640 1 -- 172.21.15.90:0/250649679 --> [v2:172.21.15.90:6824/1025535744,v1:172.21.15.90:6825/1025535744] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff738096e70 con 0x7ff718083570 2024-09-21T03:14:55.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.783+0000 7f2b92a00640 1 --2- 172.21.15.90:0/4167390788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b8c0d7920 0x7f2b8c045e50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2b94075800 tx=0x7f2b9406a1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.784+0000 7f2b87400640 1 -- 172.21.15.90:0/4167390788 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b94076b20 con 0x7f2b8c0d7920 2024-09-21T03:14:55.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.784+0000 7f2b87400640 1 -- 172.21.15.90:0/4167390788 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b94076db0 con 0x7f2b8c0d7920 2024-09-21T03:14:55.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.784+0000 7f2b98e00640 1 -- 172.21.15.90:0/4167390788 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b8c174030 con 0x7f2b8c0d7920 2024-09-21T03:14:55.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.784+0000 7f2b98e00640 1 -- 172.21.15.90:0/4167390788 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b8c17d330 con 0x7f2b8c0d7920 2024-09-21T03:14:55.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.784+0000 7f2b87400640 1 -- 172.21.15.90:0/4167390788 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b94094660 con 0x7f2b8c0d7920 2024-09-21T03:14:55.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.784+0000 7ff734c00640 1 -- 172.21.15.90:0/250649679 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff738117e00 con 0x7ff73004cc80 2024-09-21T03:14:55.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.784+0000 7fe59de00640 1 --2- 172.21.15.90:0/257150459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe584005350 0x7fe598174b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.784+0000 7fe59d400640 1 --2- 172.21.15.90:0/257150459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5980d6f20 0x7fe5980dc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.785+0000 7fb6a2200640 1 Processor -- start 2024-09-21T03:14:55.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.784+0000 7f7fc8e00640 1 -- 172.21.15.90:0/1498231519 wait complete. 2024-09-21T03:14:55.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.785+0000 7ff73ce00640 1 --2- 172.21.15.90:0/250649679 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff718078c90 0x7ff71807b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.785+0000 7fb6a2200640 1 -- start start 2024-09-21T03:14:55.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.785+0000 7fe59de00640 1 -- 172.21.15.90:0/257150459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe598178a10 msgr2=0x7fe5980d6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.785+0000 7fe59de00640 1 --2- 172.21.15.90:0/257150459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe598178a10 0x7fe5980d6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.785+0000 7fe59de00640 1 -- 172.21.15.90:0/257150459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5980d6f20 msgr2=0x7fe5980dc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.785+0000 7fe59de00640 1 --2- 172.21.15.90:0/257150459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5980d6f20 0x7fe5980dc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.786+0000 7f3c69400640 1 --2- 172.21.15.90:0/412881006 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3c50078c90 0x7f3c5007b1a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c034000 tx=0x7f3c5c0046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.786+0000 7f3c6aa00640 1 -- 172.21.15.90:0/412881006 <== osd.0 v2:172.21.15.90:6808/3187794863 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3c64003b70 con 0x7f3c500834f0 2024-09-21T03:14:55.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.785+0000 7fe59de00640 1 -- 172.21.15.90:0/257150459 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe59816a4e0 con 0x7fe584005350 2024-09-21T03:14:55.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.785+0000 7fe59d400640 1 --2- 172.21.15.90:0/257150459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5980d6f20 0x7fe5980dc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:14:55.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.786+0000 7fe59de00640 1 --2- 172.21.15.90:0/257150459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe584005350 0x7fe598174b70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0075920 tx=0x7fe5a0075400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.787+0000 7fe596000640 1 -- 172.21.15.90:0/257150459 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a00714e0 con 0x7fe584005350 2024-09-21T03:14:55.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.787+0000 7fe596000640 1 -- 172.21.15.90:0/257150459 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5a00716a0 con 0x7fe584005350 2024-09-21T03:14:55.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.787+0000 7fe596000640 1 -- 172.21.15.90:0/257150459 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0071af0 con 0x7fe584005350 2024-09-21T03:14:55.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.787+0000 7fe59f200640 1 -- 172.21.15.90:0/257150459 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5980d4cc0 con 0x7fe584005350 2024-09-21T03:14:55.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.787+0000 7fe59f200640 1 -- 172.21.15.90:0/257150459 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe598178210 con 0x7fe584005350 2024-09-21T03:14:55.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.786+0000 7ff73d800640 1 --2- 172.21.15.90:0/250649679 >> [v2:172.21.15.90:6824/1025535744,v1:172.21.15.90:6825/1025535744] conn(0x7ff718083570 0x7ff7180859c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.787+0000 7fb6a2200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb69c0c7420 0x7fb69c159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.787+0000 7fb6a2200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb69c0c81b0 0x7fb69c0ad260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.786+0000 7f2b98e00640 1 -- 172.21.15.90:0/4167390788 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2b70001030 con 0x7f2b8c0d7920 2024-09-21T03:14:55.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.788+0000 7ff73ce00640 1 --2- 172.21.15.90:0/250649679 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff718078c90 0x7ff71807b1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff724007f20 tx=0x7ff724007eb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.788+0000 7ff73d800640 1 --2- 172.21.15.90:0/250649679 >> [v2:172.21.15.90:6824/1025535744,v1:172.21.15.90:6825/1025535744] conn(0x7ff718083570 0x7ff7180859c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.789+0000 7f7fc8e00640 1 Processor -- start 2024-09-21T03:14:55.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.789+0000 7f2b87400640 1 -- 172.21.15.90:0/4167390788 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2b94094800 con 0x7f2b8c0d7920 2024-09-21T03:14:55.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.789+0000 7ff734c00640 1 -- 172.21.15.90:0/250649679 <== osd.2 v2:172.21.15.90:6824/1025535744 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff738096e70 con 0x7ff718083570 2024-09-21T03:14:55.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.789+0000 7f7fc8e00640 1 -- start start 2024-09-21T03:14:55.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.787+0000 7fb6a2200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb69c0ca2c0 0x7fb69c1e1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.788+0000 7fb6a2200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb69c0ca6d0 con 0x7fb69c0c81b0 2024-09-21T03:14:55.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.788+0000 7fb6a2200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb69c157bd0 con 0x7fb69c0ca2c0 2024-09-21T03:14:55.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.788+0000 7fb6a2200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb69c0ca850 con 0x7fb69c0c7420 2024-09-21T03:14:55.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.788+0000 7fb69b400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb69c0c7420 0x7fb69c159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.788+0000 7fb69be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb69c0ca2c0 0x7fb69c1e1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.788+0000 7fb69be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb69c0ca2c0 0x7fb69c1e1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:37390/0 (socket says 172.21.15.90:37390) 2024-09-21T03:14:55.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.788+0000 7fb69be00640 1 -- 172.21.15.90:0/492506540 learned_addr learned my addr 172.21.15.90:0/492506540 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:55.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.789+0000 7fb69b400640 1 -- 172.21.15.90:0/492506540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb69c0ca2c0 msgr2=0x7fb69c1e1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.789+0000 7fb69b400640 1 --2- 172.21.15.90:0/492506540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb69c0ca2c0 0x7fb69c1e1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.789+0000 7fb69b400640 1 -- 172.21.15.90:0/492506540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb69c0c81b0 msgr2=0x7fb69c0ad260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.789+0000 7fb69b400640 1 --2- 172.21.15.90:0/492506540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb69c0c81b0 0x7fb69c0ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.789+0000 7fb69b400640 1 -- 172.21.15.90:0/492506540 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69c1e3430 con 0x7fb69c0c7420 2024-09-21T03:14:55.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.790+0000 7fb69b400640 1 --2- 172.21.15.90:0/492506540 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb69c0c7420 0x7fb69c159910 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb68c031000 tx=0x7fb68c003910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.790+0000 7fee2a800640 1 -- 172.21.15.90:0/2490571264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee24157270 msgr2=0x7fee24157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.790+0000 7fb693400640 1 -- 172.21.15.90:0/492506540 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c03e030 con 0x7fb69c0c7420 2024-09-21T03:14:55.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.790+0000 7fee2a800640 1 --2- 172.21.15.90:0/2490571264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee24157270 0x7fee24157680 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fee240bfbc0 tx=0x7fee1c02a750 comp rx=0 tx=0).stop 2024-09-21T03:14:55.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.790+0000 7fb693400640 1 -- 172.21.15.90:0/492506540 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb68c003e00 con 0x7fb69c0c7420 2024-09-21T03:14:55.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.791+0000 7fee2a800640 1 -- 172.21.15.90:0/2490571264 shutdown_connections 2024-09-21T03:14:55.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.791+0000 7fee2a800640 1 --2- 172.21.15.90:0/2490571264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee24157270 0x7fee24157680 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.791+0000 7fee2a800640 1 --2- 172.21.15.90:0/2490571264 >> v2:172.21.15.90:3300/0 conn(0x7fee240c7840 0x7fee2415ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.791+0000 7fee2a800640 1 -- 172.21.15.90:0/2490571264 >> 172.21.15.90:0/2490571264 conn(0x7fee24074ca0 msgr2=0x7fee240cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:55.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.791+0000 7fee2a800640 1 -- 172.21.15.90:0/2490571264 shutdown_connections 2024-09-21T03:14:55.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.791+0000 7fee2a800640 1 -- 172.21.15.90:0/2490571264 wait complete. 2024-09-21T03:14:55.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.791+0000 7f2b87400640 1 --2- 172.21.15.90:0/4167390788 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2b74078c10 0x7f2b7407b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.791+0000 7f2b87400640 1 -- 172.21.15.90:0/4167390788 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f2b941171d0 con 0x7f2b8c0d7920 2024-09-21T03:14:55.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.792+0000 7f2b93400640 1 --2- 172.21.15.90:0/4167390788 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2b74078c10 0x7f2b7407b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.792+0000 7f2b87400640 1 --2- 172.21.15.90:0/4167390788 >> [v2:172.21.15.90:6816/1515884437,v1:172.21.15.90:6817/1515884437] conn(0x7f2b740834f0 0x7f2b74085940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.792+0000 7f2b87400640 1 -- 172.21.15.90:0/4167390788 --> [v2:172.21.15.90:6816/1515884437,v1:172.21.15.90:6817/1515884437] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b74086010 con 0x7f2b740834f0 2024-09-21T03:14:55.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.792+0000 7f2b87400640 1 -- 172.21.15.90:0/4167390788 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2b9411e050 con 0x7f2b8c0d7920 2024-09-21T03:14:55.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.791+0000 7f7fc8e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc40c8fb0 0x7f7fc40acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.790+0000 7fb693400640 1 -- 172.21.15.90:0/492506540 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c035040 con 0x7fb69c0c7420 2024-09-21T03:14:55.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.792+0000 7fb6a2200640 1 -- 172.21.15.90:0/492506540 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb69c1e0dc0 con 0x7fb69c0c7420 2024-09-21T03:14:55.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.792+0000 7fb6a2200640 1 -- 172.21.15.90:0/492506540 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb69c1e2c30 con 0x7fb69c0c7420 2024-09-21T03:14:55.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.792+0000 7f2b93400640 1 --2- 172.21.15.90:0/4167390788 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2b74078c10 0x7f2b7407b120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2b88034000 tx=0x7f2b88004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.793+0000 7f2b93e00640 1 --2- 172.21.15.90:0/4167390788 >> [v2:172.21.15.90:6816/1515884437,v1:172.21.15.90:6817/1515884437] conn(0x7f2b740834f0 0x7f2b74085940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.791+0000 7fe596000640 1 -- 172.21.15.90:0/257150459 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe5a0071c90 con 0x7fe584005350 2024-09-21T03:14:55.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.791+0000 7fe59f200640 1 -- 172.21.15.90:0/257150459 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe59804d3c0 con 0x7fe584005350 2024-09-21T03:14:55.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.792+0000 7fe596000640 1 --2- 172.21.15.90:0/257150459 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe580078b90 0x7fe58007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.792+0000 7fe596000640 1 -- 172.21.15.90:0/257150459 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fe5a0117f40 con 0x7fe584005350 2024-09-21T03:14:55.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.793+0000 7fe596000640 1 --2- 172.21.15.90:0/257150459 >> [v2:172.21.15.90:6800/3769758484,v1:172.21.15.90:6801/3769758484] conn(0x7fe5800833f0 0x7fe580085840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.793+0000 7fe596000640 1 -- 172.21.15.90:0/257150459 --> [v2:172.21.15.90:6800/3769758484,v1:172.21.15.90:6801/3769758484] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe580085f10 con 0x7fe5800833f0 2024-09-21T03:14:55.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.793+0000 7f7fc8e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fc40caca0 0x7f7fc4153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.793+0000 7f7fc8e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fc414bca0 0x7f7fc41effa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.793+0000 7f7fc8e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc4151060 con 0x7f7fc414bca0 2024-09-21T03:14:55.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.793+0000 7f7fc8e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc4150ee0 con 0x7f7fc40caca0 2024-09-21T03:14:55.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.793+0000 7f7fc8e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc4157170 con 0x7f7fc40c8fb0 2024-09-21T03:14:55.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.793+0000 7fb6a2200640 1 -- 172.21.15.90:0/492506540 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb69c1e2740 con 0x7fb69c0c7420 2024-09-21T03:14:55.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.794+0000 7f7fc1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc40c8fb0 0x7f7fc40acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.794+0000 7f7fc1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc40c8fb0 0x7f7fc40acb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:39906/0 (socket says 172.21.15.90:39906) 2024-09-21T03:14:55.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.794+0000 7f7fc1e00640 1 -- 172.21.15.90:0/115525057 learned_addr learned my addr 172.21.15.90:0/115525057 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:55.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.794+0000 7f7fc1400640 1 --2- 172.21.15.90:0/115525057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fc40caca0 0x7f7fc4153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.794+0000 7f2b93e00640 1 --2- 172.21.15.90:0/4167390788 >> [v2:172.21.15.90:6816/1515884437,v1:172.21.15.90:6817/1515884437] conn(0x7f2b740834f0 0x7f2b74085940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.795+0000 7fe59d400640 1 --2- 172.21.15.90:0/257150459 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe580078b90 0x7fe58007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.795+0000 7f7fc1400640 1 -- 172.21.15.90:0/115525057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc40c8fb0 msgr2=0x7f7fc40acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.795+0000 7f7fc1400640 1 --2- 172.21.15.90:0/115525057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc40c8fb0 0x7f7fc40acb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.795+0000 7fb693400640 1 -- 172.21.15.90:0/492506540 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb68c041030 con 0x7fb69c0c7420 2024-09-21T03:14:55.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.795+0000 7f7fc1400640 1 -- 172.21.15.90:0/115525057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fc414bca0 msgr2=0x7f7fc41effa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.795+0000 7f7fc1400640 1 --2- 172.21.15.90:0/115525057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fc414bca0 0x7f7fc41effa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.795+0000 7f7fc1400640 1 -- 172.21.15.90:0/115525057 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc40bfc50 con 0x7f7fc40caca0 2024-09-21T03:14:55.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.795+0000 7fee2a800640 1 Processor -- start 2024-09-21T03:14:55.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.795+0000 7fee2a800640 1 -- start start 2024-09-21T03:14:55.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.796+0000 7f7fc1400640 1 --2- 172.21.15.90:0/115525057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fc40caca0 0x7f7fc4153a40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4157d30 tx=0x7f7fb000b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.796+0000 7f2b87400640 1 -- 172.21.15.90:0/4167390788 <== osd.3 v2:172.21.15.90:6816/1515884437 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2b74086010 con 0x7f2b740834f0 2024-09-21T03:14:55.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.796+0000 7fe59e800640 1 --2- 172.21.15.90:0/257150459 >> [v2:172.21.15.90:6800/3769758484,v1:172.21.15.90:6801/3769758484] conn(0x7fe5800833f0 0x7fe580085840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.798+0000 7f7fba000640 1 -- 172.21.15.90:0/115525057 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0015030 con 0x7f7fc40caca0 2024-09-21T03:14:55.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.798+0000 7f7fba000640 1 -- 172.21.15.90:0/115525057 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fb0004110 con 0x7f7fc40caca0 2024-09-21T03:14:55.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.798+0000 7f7fba000640 1 -- 172.21.15.90:0/115525057 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0011630 con 0x7f7fc40caca0 2024-09-21T03:14:55.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.798+0000 7f7fc8e00640 1 -- 172.21.15.90:0/115525057 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc40ad050 con 0x7f7fc40caca0 2024-09-21T03:14:55.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.797+0000 7fe59e800640 1 --2- 172.21.15.90:0/257150459 >> [v2:172.21.15.90:6800/3769758484,v1:172.21.15.90:6801/3769758484] conn(0x7fe5800833f0 0x7fe580085840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.797+0000 7fe596000640 1 -- 172.21.15.90:0/257150459 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe5a00dc020 con 0x7fe584005350 2024-09-21T03:14:55.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.798+0000 7fe596000640 1 -- 172.21.15.90:0/257150459 <== osd.1 v2:172.21.15.90:6800/3769758484 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe580085f10 con 0x7fe5800833f0 2024-09-21T03:14:55.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.798+0000 7fe59d400640 1 --2- 172.21.15.90:0/257150459 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe580078b90 0x7fe58007b0a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe58c005940 tx=0x7fe58c0058d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.798+0000 7f7fc8e00640 1 -- 172.21.15.90:0/115525057 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc40bf970 con 0x7f7fc40caca0 2024-09-21T03:14:55.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.798+0000 7fee2a800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee240c7840 0x7fee2415a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.799+0000 7fb693400640 1 --2- 172.21.15.90:0/492506540 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb678078b90 0x7fb67807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.799+0000 7fb693400640 1 -- 172.21.15.90:0/492506540 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fb68c0bb730 con 0x7fb69c0c7420 2024-09-21T03:14:55.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.799+0000 7fb693400640 1 --2- 172.21.15.90:0/492506540 >> [v2:172.21.15.149:6802/1657326880,v1:172.21.15.149:6803/1657326880] conn(0x7fb678083470 0x7fb6780858c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.799+0000 7fb693400640 1 -- 172.21.15.90:0/492506540 --> [v2:172.21.15.149:6802/1657326880,v1:172.21.15.149:6803/1657326880] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb68c005310 con 0x7fb678083470 2024-09-21T03:14:55.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.799+0000 7fee2a800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee24154790 0x7fee24152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.799+0000 7fb693400640 1 -- 172.21.15.90:0/492506540 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb68c0c2050 con 0x7fb69c0c7420 2024-09-21T03:14:55.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.799+0000 7fee23400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee240c7840 0x7fee2415a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.799+0000 7fee23400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee240c7840 0x7fee2415a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:39908/0 (socket says 172.21.15.90:39908) 2024-09-21T03:14:55.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.799+0000 7fb693e00640 1 --2- 172.21.15.90:0/492506540 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb678078b90 0x7fb67807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.800+0000 7fb69be00640 1 --2- 172.21.15.90:0/492506540 >> [v2:172.21.15.149:6802/1657326880,v1:172.21.15.149:6803/1657326880] conn(0x7fb678083470 0x7fb6780858c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.800+0000 7fee23400640 1 -- 172.21.15.90:0/204384403 learned_addr learned my addr 172.21.15.90:0/204384403 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:55.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.800+0000 7fee2a800640 1 --2- 172.21.15.90:0/204384403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee24157270 0x7fee241f1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.800+0000 7fee2a800640 1 -- 172.21.15.90:0/204384403 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fee240ae640 con 0x7fee24154790 2024-09-21T03:14:55.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.800+0000 7fee2a800640 1 -- 172.21.15.90:0/204384403 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fee240cc030 con 0x7fee24157270 2024-09-21T03:14:55.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.800+0000 7fee2a800640 1 -- 172.21.15.90:0/204384403 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fee240ae7c0 con 0x7fee240c7840 2024-09-21T03:14:55.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.800+0000 7fb693e00640 1 --2- 172.21.15.90:0/492506540 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb678078b90 0x7fb67807b0a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb69c1570c0 tx=0x7fb684006ba0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.801+0000 7fb69be00640 1 --2- 172.21.15.90:0/492506540 >> [v2:172.21.15.149:6802/1657326880,v1:172.21.15.149:6803/1657326880] conn(0x7fb678083470 0x7fb6780858c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.801+0000 7fee23e00640 1 --2- 172.21.15.90:0/204384403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee24157270 0x7fee241f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.801+0000 7fee22a00640 1 --2- 172.21.15.90:0/204384403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee24154790 0x7fee24152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.801+0000 7fee23400640 1 -- 172.21.15.90:0/204384403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee24157270 msgr2=0x7fee241f1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.802+0000 7fee23400640 1 --2- 172.21.15.90:0/204384403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee24157270 0x7fee241f1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.802+0000 7fee23400640 1 -- 172.21.15.90:0/204384403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee24154790 msgr2=0x7fee24152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.802+0000 7fee23400640 1 --2- 172.21.15.90:0/204384403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee24154790 0x7fee24152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.802+0000 7fee23400640 1 -- 172.21.15.90:0/204384403 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee241f4f10 con 0x7fee240c7840 2024-09-21T03:14:55.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.802+0000 7fee22a00640 1 --2- 172.21.15.90:0/204384403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee24154790 0x7fee24152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:55.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.803+0000 7fee23400640 1 --2- 172.21.15.90:0/204384403 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee240c7840 0x7fee2415a520 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fee1400b3f0 tx=0x7fee1400b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.802+0000 7f7fc8e00640 1 -- 172.21.15.90:0/115525057 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7fc414bac0 con 0x7f7fc40caca0 2024-09-21T03:14:55.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.803+0000 7f7fba000640 1 -- 172.21.15.90:0/115525057 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7fb0018070 con 0x7f7fc40caca0 2024-09-21T03:14:55.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.804+0000 7fb693400640 1 -- 172.21.15.90:0/492506540 <== osd.7 v2:172.21.15.149:6802/1657326880 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb68c005310 con 0x7fb678083470 2024-09-21T03:14:55.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.804+0000 7fee1b400640 1 -- 172.21.15.90:0/204384403 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14015020 con 0x7fee240c7840 2024-09-21T03:14:55.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.804+0000 7fee1b400640 1 -- 172.21.15.90:0/204384403 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee14011920 con 0x7fee240c7840 2024-09-21T03:14:55.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.804+0000 7fee2a800640 1 -- 172.21.15.90:0/204384403 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee241f51b0 con 0x7fee240c7840 2024-09-21T03:14:55.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.805+0000 7f7fba000640 1 --2- 172.21.15.90:0/115525057 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7fa4078c10 0x7f7fa407b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.805+0000 7f7fba000640 1 -- 172.21.15.90:0/115525057 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f7fb009aa20 con 0x7f7fc40caca0 2024-09-21T03:14:55.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.805+0000 7f7fba000640 1 --2- 172.21.15.90:0/115525057 >> [v2:172.21.15.149:6810/821196931,v1:172.21.15.149:6811/821196931] conn(0x7f7fa40834f0 0x7f7fa4085940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.805+0000 7f7fba000640 1 -- 172.21.15.90:0/115525057 --> [v2:172.21.15.149:6810/821196931,v1:172.21.15.149:6811/821196931] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7fb000de50 con 0x7f7fa40834f0 2024-09-21T03:14:55.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.805+0000 7f7fba000640 1 -- 172.21.15.90:0/115525057 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7fb009f2a0 con 0x7f7fc40caca0 2024-09-21T03:14:55.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.804+0000 7fee2a800640 1 -- 172.21.15.90:0/204384403 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fee241538a0 con 0x7fee240c7840 2024-09-21T03:14:55.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.804+0000 7fee1b400640 1 -- 172.21.15.90:0/204384403 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14011d50 con 0x7fee240c7840 2024-09-21T03:14:55.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.806+0000 7f7fc2800640 1 --2- 172.21.15.90:0/115525057 >> [v2:172.21.15.149:6810/821196931,v1:172.21.15.149:6811/821196931] conn(0x7f7fa40834f0 0x7f7fa4085940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.806+0000 7f7fc1e00640 1 --2- 172.21.15.90:0/115525057 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7fa4078c10 0x7f7fa407b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.805+0000 7fee2a800640 1 -- 172.21.15.90:0/204384403 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fedfc001030 con 0x7fee240c7840 2024-09-21T03:14:55.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.806+0000 7f3e4ee00640 1 -- 172.21.15.90:0/1370306237 --> [v2:172.21.15.149:6814/4278726553,v1:172.21.15.149:6816/4278726553] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3e24002dd0 con 0x7f3e280835b0 2024-09-21T03:14:55.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.806+0000 7f7fc2800640 1 --2- 172.21.15.90:0/115525057 >> [v2:172.21.15.149:6810/821196931,v1:172.21.15.149:6811/821196931] conn(0x7f7fa40834f0 0x7f7fa4085940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.807+0000 7f7fc1e00640 1 --2- 172.21.15.90:0/115525057 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7fa4078c10 0x7f7fa407b120 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4001730 tx=0x7f7fb4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.807+0000 7f3e45600640 1 -- 172.21.15.90:0/1370306237 <== osd.4 v2:172.21.15.149:6814/4278726553 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3e24002dd0 con 0x7f3e280835b0 2024-09-21T03:14:55.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.808+0000 7f7fba000640 1 -- 172.21.15.90:0/115525057 <== osd.6 v2:172.21.15.149:6810/821196931 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7fb000de50 con 0x7f7fa40834f0 2024-09-21T03:14:55.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.810+0000 7f3e4ee00640 1 -- 172.21.15.90:0/1370306237 >> [v2:172.21.15.149:6814/4278726553,v1:172.21.15.149:6816/4278726553] conn(0x7f3e280835b0 msgr2=0x7f3e28085a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.810+0000 7f3e4ee00640 1 --2- 172.21.15.90:0/1370306237 >> [v2:172.21.15.149:6814/4278726553,v1:172.21.15.149:6816/4278726553] conn(0x7f3e280835b0 0x7f3e28085a00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.810+0000 7fee1b400640 1 -- 172.21.15.90:0/204384403 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fee14018020 con 0x7fee240c7840 2024-09-21T03:14:55.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.812+0000 7f3e4ee00640 1 -- 172.21.15.90:0/1370306237 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3e28078dc0 msgr2=0x7f3e2807b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.812+0000 7f3e4ee00640 1 --2- 172.21.15.90:0/1370306237 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3e28078dc0 0x7f3e2807b2d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c006fd0 tx=0x7f3e3c008040 comp rx=0 tx=0).stop 2024-09-21T03:14:55.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.812+0000 7f3e4ee00640 1 -- 172.21.15.90:0/1370306237 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3e48072c00 msgr2=0x7f3e480c6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.812+0000 7f3e4ee00640 1 --2- 172.21.15.90:0/1370306237 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3e48072c00 0x7f3e480c6480 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3e34006010 tx=0x7f3e34003b90 comp rx=0 tx=0).stop 2024-09-21T03:14:55.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.812+0000 7f3e4e400640 1 -- 172.21.15.90:0/1370306237 reap_dead start 2024-09-21T03:14:55.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.812+0000 7fee1b400640 1 --2- 172.21.15.90:0/204384403 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fee04078c60 0x7fee0407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.812+0000 7f3e4ee00640 1 -- 172.21.15.90:0/1370306237 shutdown_connections 2024-09-21T03:14:55.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.812+0000 7f3e4ee00640 1 -- 172.21.15.90:0/1370306237 >> 172.21.15.90:0/1370306237 conn(0x7f3e4806d200 msgr2=0x7f3e4806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:55.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.812+0000 7fee1b400640 1 -- 172.21.15.90:0/204384403 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fee1409b420 con 0x7fee240c7840 2024-09-21T03:14:55.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.813+0000 7fee22a00640 1 --2- 172.21.15.90:0/204384403 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fee04078c60 0x7fee0407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.813+0000 7fee1b400640 1 --2- 172.21.15.90:0/204384403 >> [v2:172.21.15.149:6826/1341677333,v1:172.21.15.149:6827/1341677333] conn(0x7fee04083550 0x7fee040859a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:55.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.813+0000 7fee1b400640 1 -- 172.21.15.90:0/204384403 --> [v2:172.21.15.149:6826/1341677333,v1:172.21.15.149:6827/1341677333] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fee1401deb0 con 0x7fee04083550 2024-09-21T03:14:55.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.813+0000 7fee1b400640 1 -- 172.21.15.90:0/204384403 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fee1409b810 con 0x7fee240c7840 2024-09-21T03:14:55.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.813+0000 7fee23e00640 1 --2- 172.21.15.90:0/204384403 >> [v2:172.21.15.149:6826/1341677333,v1:172.21.15.149:6827/1341677333] conn(0x7fee04083550 0x7fee040859a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:55.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.814+0000 7fee22a00640 1 --2- 172.21.15.90:0/204384403 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fee04078c60 0x7fee0407b170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fee240beec0 tx=0x7fee10009260 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.814+0000 7fee23e00640 1 --2- 172.21.15.90:0/204384403 >> [v2:172.21.15.149:6826/1341677333,v1:172.21.15.149:6827/1341677333] conn(0x7fee04083550 0x7fee040859a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:55.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.815+0000 7f3e4ee00640 1 -- 172.21.15.90:0/1370306237 shutdown_connections 2024-09-21T03:14:55.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.815+0000 7f3e4ee00640 1 -- 172.21.15.90:0/1370306237 wait complete. 2024-09-21T03:14:55.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.815+0000 7fee1b400640 1 -- 172.21.15.90:0/204384403 <== osd.5 v2:172.21.15.149:6826/1341677333 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fee1401deb0 con 0x7fee04083550 2024-09-21T03:14:55.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.818+0000 7fe59f200640 1 -- 172.21.15.90:0/257150459 --> [v2:172.21.15.90:6800/3769758484,v1:172.21.15.90:6801/3769758484] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe59800fb30 con 0x7fe5800833f0 2024-09-21T03:14:55.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.818+0000 7fe596000640 1 -- 172.21.15.90:0/257150459 <== osd.1 v2:172.21.15.90:6800/3769758484 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe59800fb30 con 0x7fe5800833f0 2024-09-21T03:14:55.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.819+0000 7fe59f200640 1 -- 172.21.15.90:0/257150459 >> [v2:172.21.15.90:6800/3769758484,v1:172.21.15.90:6801/3769758484] conn(0x7fe5800833f0 msgr2=0x7fe580085840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.819+0000 7fe59f200640 1 --2- 172.21.15.90:0/257150459 >> [v2:172.21.15.90:6800/3769758484,v1:172.21.15.90:6801/3769758484] conn(0x7fe5800833f0 0x7fe580085840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.819+0000 7fe59f200640 1 -- 172.21.15.90:0/257150459 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe580078b90 msgr2=0x7fe58007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.819+0000 7fe59f200640 1 --2- 172.21.15.90:0/257150459 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe580078b90 0x7fe58007b0a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe58c005940 tx=0x7fe58c0058d0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.819+0000 7fe59f200640 1 -- 172.21.15.90:0/257150459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe584005350 msgr2=0x7fe598174b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.819+0000 7fe59f200640 1 --2- 172.21.15.90:0/257150459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe584005350 0x7fe598174b70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0075920 tx=0x7fe5a0075400 comp rx=0 tx=0).stop 2024-09-21T03:14:55.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.820+0000 7fe59e800640 1 -- 172.21.15.90:0/257150459 reap_dead start 2024-09-21T03:14:55.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.820+0000 7fe59f200640 1 -- 172.21.15.90:0/257150459 shutdown_connections 2024-09-21T03:14:55.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.820+0000 7fe59f200640 1 -- 172.21.15.90:0/257150459 >> 172.21.15.90:0/257150459 conn(0x7fe5980312e0 msgr2=0x7fe5980da300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:55.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.820+0000 7fe59f200640 1 -- 172.21.15.90:0/257150459 shutdown_connections 2024-09-21T03:14:55.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.820+0000 7fe59f200640 1 -- 172.21.15.90:0/257150459 wait complete. 2024-09-21T03:14:55.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.822+0000 7f3c63400640 1 -- 172.21.15.90:0/412881006 --> [v2:172.21.15.90:6808/3187794863,v1:172.21.15.90:6809/3187794863] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3c740c6a10 con 0x7f3c500834f0 2024-09-21T03:14:55.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.823+0000 7f3c6aa00640 1 -- 172.21.15.90:0/412881006 <== osd.0 v2:172.21.15.90:6808/3187794863 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3c6c0013c0 con 0x7f3c500834f0 2024-09-21T03:14:55.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.824+0000 7ff73f800640 1 -- 172.21.15.90:0/250649679 --> [v2:172.21.15.90:6824/1025535744,v1:172.21.15.90:6825/1025535744] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff7300478a0 con 0x7ff718083570 2024-09-21T03:14:55.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.824+0000 7f3c63400640 1 -- 172.21.15.90:0/412881006 >> [v2:172.21.15.90:6808/3187794863,v1:172.21.15.90:6809/3187794863] conn(0x7f3c500834f0 msgr2=0x7f3c50085940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.824+0000 7f3c63400640 1 --2- 172.21.15.90:0/412881006 >> [v2:172.21.15.90:6808/3187794863,v1:172.21.15.90:6809/3187794863] conn(0x7f3c500834f0 0x7f3c50085940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.825+0000 7f3c63400640 1 -- 172.21.15.90:0/412881006 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3c50078c90 msgr2=0x7f3c5007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.825+0000 7f3c63400640 1 --2- 172.21.15.90:0/412881006 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3c50078c90 0x7f3c5007b1a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c034000 tx=0x7f3c5c0046c0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.825+0000 7f3c63400640 1 -- 172.21.15.90:0/412881006 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c740ada40 msgr2=0x7f3c741438e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.825+0000 7f3c63400640 1 --2- 172.21.15.90:0/412881006 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c740ada40 0x7f3c741438e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400c750 tx=0x7f3c6400cc10 comp rx=0 tx=0).stop 2024-09-21T03:14:55.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.825+0000 7f3c72800640 1 -- 172.21.15.90:0/412881006 reap_dead start 2024-09-21T03:14:55.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.825+0000 7f3c63400640 1 -- 172.21.15.90:0/412881006 shutdown_connections 2024-09-21T03:14:55.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.825+0000 7f3c63400640 1 -- 172.21.15.90:0/412881006 >> 172.21.15.90:0/412881006 conn(0x7f3c740c8940 msgr2=0x7f3c7406ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:55.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.825+0000 7ff734c00640 1 -- 172.21.15.90:0/250649679 <== osd.2 v2:172.21.15.90:6824/1025535744 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff7300478a0 con 0x7ff718083570 2024-09-21T03:14:55.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.827+0000 7ff72a000640 1 -- 172.21.15.90:0/250649679 >> [v2:172.21.15.90:6824/1025535744,v1:172.21.15.90:6825/1025535744] conn(0x7ff718083570 msgr2=0x7ff7180859c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.826+0000 7f3c63400640 1 -- 172.21.15.90:0/412881006 shutdown_connections 2024-09-21T03:14:55.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.827+0000 7f3c63400640 1 -- 172.21.15.90:0/412881006 wait complete. 2024-09-21T03:14:55.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.827+0000 7ff72a000640 1 --2- 172.21.15.90:0/250649679 >> [v2:172.21.15.90:6824/1025535744,v1:172.21.15.90:6825/1025535744] conn(0x7ff718083570 0x7ff7180859c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.827+0000 7ff72a000640 1 -- 172.21.15.90:0/250649679 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff718078c90 msgr2=0x7ff71807b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.827+0000 7ff72a000640 1 --2- 172.21.15.90:0/250649679 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff718078c90 0x7ff71807b1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff724007f20 tx=0x7ff724007eb0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.828+0000 7ff72a000640 1 -- 172.21.15.90:0/250649679 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff73004cc80 msgr2=0x7ff7300d3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.828+0000 7ff72a000640 1 --2- 172.21.15.90:0/250649679 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff73004cc80 0x7ff7300d3f70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff738000b60 tx=0x7ff7380767a0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.828+0000 7ff73d800640 1 -- 172.21.15.90:0/250649679 reap_dead start 2024-09-21T03:14:55.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.828+0000 7ff72a000640 1 -- 172.21.15.90:0/250649679 shutdown_connections 2024-09-21T03:14:55.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.828+0000 7ff72a000640 1 -- 172.21.15.90:0/250649679 >> 172.21.15.90:0/250649679 conn(0x7ff73000a4e0 msgr2=0x7ff73004bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:55.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.828+0000 7ff72a000640 1 -- 172.21.15.90:0/250649679 shutdown_connections 2024-09-21T03:14:55.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.829+0000 7ff72a000640 1 -- 172.21.15.90:0/250649679 wait complete. 2024-09-21T03:14:55.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.830+0000 7f2b98e00640 1 -- 172.21.15.90:0/4167390788 --> [v2:172.21.15.90:6816/1515884437,v1:172.21.15.90:6817/1515884437] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2b70002dd0 con 0x7f2b740834f0 2024-09-21T03:14:55.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.832+0000 7f2b87400640 1 -- 172.21.15.90:0/4167390788 <== osd.3 v2:172.21.15.90:6816/1515884437 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2b70002dd0 con 0x7f2b740834f0 2024-09-21T03:14:55.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.832+0000 7f2b98e00640 1 -- 172.21.15.90:0/4167390788 >> [v2:172.21.15.90:6816/1515884437,v1:172.21.15.90:6817/1515884437] conn(0x7f2b740834f0 msgr2=0x7f2b74085940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.832+0000 7f2b98e00640 1 --2- 172.21.15.90:0/4167390788 >> [v2:172.21.15.90:6816/1515884437,v1:172.21.15.90:6817/1515884437] conn(0x7f2b740834f0 0x7f2b74085940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.833+0000 7fb6a2200640 1 -- 172.21.15.90:0/492506540 --> [v2:172.21.15.149:6802/1657326880,v1:172.21.15.149:6803/1657326880] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb69c0c7830 con 0x7fb678083470 2024-09-21T03:14:55.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.833+0000 7f2b98e00640 1 -- 172.21.15.90:0/4167390788 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2b74078c10 msgr2=0x7f2b7407b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.833+0000 7f2b98e00640 1 --2- 172.21.15.90:0/4167390788 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2b74078c10 0x7f2b7407b120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2b88034000 tx=0x7f2b88004730 comp rx=0 tx=0).stop 2024-09-21T03:14:55.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.833+0000 7f2b98e00640 1 -- 172.21.15.90:0/4167390788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b8c0d7920 msgr2=0x7f2b8c045e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.833+0000 7f2b98e00640 1 --2- 172.21.15.90:0/4167390788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b8c0d7920 0x7f2b8c045e50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2b94075800 tx=0x7f2b9406a1d0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.833+0000 7f2b93e00640 1 -- 172.21.15.90:0/4167390788 reap_dead start 2024-09-21T03:14:55.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.834+0000 7f2b98e00640 1 -- 172.21.15.90:0/4167390788 shutdown_connections 2024-09-21T03:14:55.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.834+0000 7f2b98e00640 1 -- 172.21.15.90:0/4167390788 >> 172.21.15.90:0/4167390788 conn(0x7f2b8c04c8a0 msgr2=0x7f2b8c0da2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:55.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.834+0000 7fb693400640 1 -- 172.21.15.90:0/492506540 <== osd.7 v2:172.21.15.149:6802/1657326880 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb69c0c7830 con 0x7fb678083470 2024-09-21T03:14:55.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.834+0000 7f2b98e00640 1 -- 172.21.15.90:0/4167390788 shutdown_connections 2024-09-21T03:14:55.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.834+0000 7f2b98e00640 1 -- 172.21.15.90:0/4167390788 wait complete. 2024-09-21T03:14:55.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.835+0000 7fb6a2200640 1 -- 172.21.15.90:0/492506540 >> [v2:172.21.15.149:6802/1657326880,v1:172.21.15.149:6803/1657326880] conn(0x7fb678083470 msgr2=0x7fb6780858c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.835+0000 7fb6a2200640 1 --2- 172.21.15.90:0/492506540 >> [v2:172.21.15.149:6802/1657326880,v1:172.21.15.149:6803/1657326880] conn(0x7fb678083470 0x7fb6780858c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.835+0000 7fb6a2200640 1 -- 172.21.15.90:0/492506540 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb678078b90 msgr2=0x7fb67807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.835+0000 7fb6a2200640 1 --2- 172.21.15.90:0/492506540 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb678078b90 0x7fb67807b0a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb69c1570c0 tx=0x7fb684006ba0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.835+0000 7fb6a2200640 1 -- 172.21.15.90:0/492506540 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb69c0c7420 msgr2=0x7fb69c159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.835+0000 7fb6a2200640 1 --2- 172.21.15.90:0/492506540 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb69c0c7420 0x7fb69c159910 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb68c031000 tx=0x7fb68c003910 comp rx=0 tx=0).stop 2024-09-21T03:14:55.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.835+0000 7fb69be00640 1 -- 172.21.15.90:0/492506540 reap_dead start 2024-09-21T03:14:55.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.835+0000 7fb6a2200640 1 -- 172.21.15.90:0/492506540 shutdown_connections 2024-09-21T03:14:55.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.835+0000 7fb6a2200640 1 -- 172.21.15.90:0/492506540 >> 172.21.15.90:0/492506540 conn(0x7fb69c0c8e40 msgr2=0x7fb69c14d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:55.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.836+0000 7fb6a2200640 1 -- 172.21.15.90:0/492506540 shutdown_connections 2024-09-21T03:14:55.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.836+0000 7fb6a2200640 1 -- 172.21.15.90:0/492506540 wait complete. 2024-09-21T03:14:55.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.839+0000 7f7fc8e00640 1 -- 172.21.15.90:0/115525057 --> [v2:172.21.15.149:6810/821196931,v1:172.21.15.149:6811/821196931] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7fc414b870 con 0x7f7fa40834f0 2024-09-21T03:14:55.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.840+0000 7f7fba000640 1 -- 172.21.15.90:0/115525057 <== osd.6 v2:172.21.15.149:6810/821196931 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7fc414b870 con 0x7f7fa40834f0 2024-09-21T03:14:55.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.840+0000 7f7fc8e00640 1 -- 172.21.15.90:0/115525057 >> [v2:172.21.15.149:6810/821196931,v1:172.21.15.149:6811/821196931] conn(0x7f7fa40834f0 msgr2=0x7f7fa4085940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.840+0000 7f7fc8e00640 1 --2- 172.21.15.90:0/115525057 >> [v2:172.21.15.149:6810/821196931,v1:172.21.15.149:6811/821196931] conn(0x7f7fa40834f0 0x7f7fa4085940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.841+0000 7f7fc8e00640 1 -- 172.21.15.90:0/115525057 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7fa4078c10 msgr2=0x7f7fa407b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.841+0000 7f7fc8e00640 1 --2- 172.21.15.90:0/115525057 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7fa4078c10 0x7f7fa407b120 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4001730 tx=0x7f7fb4009040 comp rx=0 tx=0).stop 2024-09-21T03:14:55.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.841+0000 7f7fc8e00640 1 -- 172.21.15.90:0/115525057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fc40caca0 msgr2=0x7f7fc4153a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.841+0000 7f7fc8e00640 1 --2- 172.21.15.90:0/115525057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fc40caca0 0x7f7fc4153a40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4157d30 tx=0x7f7fb000b870 comp rx=0 tx=0).stop 2024-09-21T03:14:55.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.841+0000 7f7fc2800640 1 -- 172.21.15.90:0/115525057 reap_dead start 2024-09-21T03:14:55.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.841+0000 7f7fc8e00640 1 -- 172.21.15.90:0/115525057 shutdown_connections 2024-09-21T03:14:55.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.841+0000 7f7fc8e00640 1 -- 172.21.15.90:0/115525057 >> 172.21.15.90:0/115525057 conn(0x7f7fc40750a0 msgr2=0x7f7fc4154aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:55.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.841+0000 7f7fc8e00640 1 -- 172.21.15.90:0/115525057 shutdown_connections 2024-09-21T03:14:55.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.841+0000 7f7fc8e00640 1 -- 172.21.15.90:0/115525057 wait complete. 2024-09-21T03:14:55.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.845+0000 7fee2a800640 1 -- 172.21.15.90:0/204384403 --> [v2:172.21.15.149:6826/1341677333,v1:172.21.15.149:6827/1341677333] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fedfc002dd0 con 0x7fee04083550 2024-09-21T03:14:55.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.845+0000 7fee1b400640 1 -- 172.21.15.90:0/204384403 <== osd.5 v2:172.21.15.149:6826/1341677333 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fedfc002dd0 con 0x7fee04083550 2024-09-21T03:14:55.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.848+0000 7fee18c00640 1 -- 172.21.15.90:0/204384403 >> [v2:172.21.15.149:6826/1341677333,v1:172.21.15.149:6827/1341677333] conn(0x7fee04083550 msgr2=0x7fee040859a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.848+0000 7fee18c00640 1 --2- 172.21.15.90:0/204384403 >> [v2:172.21.15.149:6826/1341677333,v1:172.21.15.149:6827/1341677333] conn(0x7fee04083550 0x7fee040859a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.851+0000 7fee18c00640 1 -- 172.21.15.90:0/204384403 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fee04078c60 msgr2=0x7fee0407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.851+0000 7fee18c00640 1 --2- 172.21.15.90:0/204384403 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fee04078c60 0x7fee0407b170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fee240beec0 tx=0x7fee10009260 comp rx=0 tx=0).stop 2024-09-21T03:14:55.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.851+0000 7fee18c00640 1 -- 172.21.15.90:0/204384403 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee240c7840 msgr2=0x7fee2415a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:55.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.851+0000 7fee18c00640 1 --2- 172.21.15.90:0/204384403 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee240c7840 0x7fee2415a520 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fee1400b3f0 tx=0x7fee1400b8b0 comp rx=0 tx=0).stop 2024-09-21T03:14:55.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.851+0000 7fee23e00640 1 -- 172.21.15.90:0/204384403 reap_dead start 2024-09-21T03:14:55.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.851+0000 7fee18c00640 1 -- 172.21.15.90:0/204384403 shutdown_connections 2024-09-21T03:14:55.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.851+0000 7fee18c00640 1 -- 172.21.15.90:0/204384403 >> 172.21.15.90:0/204384403 conn(0x7fee24074ca0 msgr2=0x7fee240ca540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:55.855 INFO:teuthology.orchestra.run.smithi090.stdout:64424509449 2024-09-21T03:14:55.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.852+0000 7fee18c00640 1 -- 172.21.15.90:0/204384403 shutdown_connections 2024-09-21T03:14:55.856 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T03:14:55.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:55.852+0000 7fee18c00640 1 -- 172.21.15.90:0/204384403 wait complete. 2024-09-21T03:14:55.866 INFO:teuthology.orchestra.run.smithi090.stdout:64424509448 2024-09-21T03:14:55.866 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T03:14:55.869 INFO:teuthology.orchestra.run.smithi090.stdout:64424509450 2024-09-21T03:14:55.870 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T03:14:55.870 INFO:teuthology.orchestra.run.smithi090.stdout:64424509449 2024-09-21T03:14:55.871 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T03:14:55.880 INFO:teuthology.orchestra.run.smithi090.stdout:60129542153 2024-09-21T03:14:55.880 INFO:teuthology.orchestra.run.smithi090.stdout:60129542154 2024-09-21T03:14:55.881 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T03:14:55.881 INFO:teuthology.orchestra.run.smithi090.stdout:64424509449 2024-09-21T03:14:55.882 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T03:14:55.882 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T03:14:55.892 INFO:teuthology.orchestra.run.smithi090.stdout:64424509449 2024-09-21T03:14:55.893 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T03:14:56.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.240+0000 7f07a5c00640 1 -- 172.21.15.90:0/4194391103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0798049730 msgr2=0x7f0798046930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.241+0000 7f079d600640 1 -- 172.21.15.90:0/4194391103 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0790037070 con 0x7f0798049730 2024-09-21T03:14:56.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.241+0000 7f07a5c00640 1 --2- 172.21.15.90:0/4194391103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0798049730 0x7f0798046930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f07980423c0 tx=0x7f079002a380 comp rx=0 tx=0).stop 2024-09-21T03:14:56.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.242+0000 7f07a5c00640 1 -- 172.21.15.90:0/4194391103 shutdown_connections 2024-09-21T03:14:56.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.242+0000 7f07a5c00640 1 --2- 172.21.15.90:0/4194391103 >> v2:172.21.15.149:3300/0 conn(0x7f079802d7b0 0x7f07980d3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.242+0000 7f07a5c00640 1 --2- 172.21.15.90:0/4194391103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0798049730 0x7f0798046930 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.242+0000 7f07a5c00640 1 -- 172.21.15.90:0/4194391103 >> 172.21.15.90:0/4194391103 conn(0x7f0798048640 msgr2=0x7f079802cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:56.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.242+0000 7f07a5c00640 1 -- 172.21.15.90:0/4194391103 shutdown_connections 2024-09-21T03:14:56.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.242+0000 7f07a5c00640 1 -- 172.21.15.90:0/4194391103 wait complete. 2024-09-21T03:14:56.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.247+0000 7f07a5c00640 1 Processor -- start 2024-09-21T03:14:56.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.248+0000 7f07a5c00640 1 -- start start 2024-09-21T03:14:56.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.251+0000 7f07a5c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f079802d7b0 0x7f07980427b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.251+0000 7f507d600640 1 -- 172.21.15.90:0/1225984490 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50780ca1a0 msgr2=0x7f507806df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.251+0000 7f507d600640 1 --2- 172.21.15.90:0/1225984490 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50780ca1a0 0x7f507806df00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f507806a110 tx=0x7f506802a560 comp rx=0 tx=0).stop 2024-09-21T03:14:56.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.251+0000 7f07a5c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f079802dbc0 0x7f07980d2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.251+0000 7f507d600640 1 -- 172.21.15.90:0/1225984490 shutdown_connections 2024-09-21T03:14:56.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.251+0000 7f507d600640 1 --2- 172.21.15.90:0/1225984490 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50780ca1a0 0x7f507806df00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.251+0000 7f507d600640 1 --2- 172.21.15.90:0/1225984490 >> v2:172.21.15.149:3300/0 conn(0x7f50780c8760 0x7f50781540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.251+0000 7f507d600640 1 -- 172.21.15.90:0/1225984490 >> 172.21.15.90:0/1225984490 conn(0x7f50780c8d20 msgr2=0x7f50780c9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:56.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.251+0000 7f507d600640 1 -- 172.21.15.90:0/1225984490 shutdown_connections 2024-09-21T03:14:56.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.251+0000 7f5912800640 1 -- 172.21.15.90:0/2149122861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f590c149580 msgr2=0x7f590c153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.251+0000 7f5912800640 1 --2- 172.21.15.90:0/2149122861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f590c149580 0x7f590c153460 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f58f8005fd0 tx=0x7f58f802b700 comp rx=0 tx=0).stop 2024-09-21T03:14:56.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.251+0000 7f079ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f079802d7b0 0x7f07980427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.251+0000 7f079ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f079802d7b0 0x7f07980427b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:39934/0 (socket says 172.21.15.90:39934) 2024-09-21T03:14:56.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.252+0000 7f079ea00640 1 -- 172.21.15.90:0/1561289199 learned_addr learned my addr 172.21.15.90:0/1561289199 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:56.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.252+0000 7f07a5c00640 1 --2- 172.21.15.90:0/1561289199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0798049730 0x7f0798042d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.252+0000 7f5912800640 1 -- 172.21.15.90:0/2149122861 shutdown_connections 2024-09-21T03:14:56.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.252+0000 7f5912800640 1 --2- 172.21.15.90:0/2149122861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f590c149580 0x7f590c153460 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.252+0000 7f5912800640 1 --2- 172.21.15.90:0/2149122861 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f590c0728e0 0x7f590c156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.252+0000 7f5912800640 1 -- 172.21.15.90:0/2149122861 >> 172.21.15.90:0/2149122861 conn(0x7f590c06d200 msgr2=0x7f590c06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:56.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.252+0000 7f5912800640 1 -- 172.21.15.90:0/2149122861 shutdown_connections 2024-09-21T03:14:56.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.252+0000 7f5912800640 1 -- 172.21.15.90:0/2149122861 wait complete. 2024-09-21T03:14:56.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.251+0000 7f507d600640 1 -- 172.21.15.90:0/1225984490 wait complete. 2024-09-21T03:14:56.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.253+0000 7f079e000640 1 --2- 172.21.15.90:0/1561289199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f079802dbc0 0x7f07980d2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.253+0000 7f07a5c00640 1 -- 172.21.15.90:0/1561289199 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f07980d3cd0 con 0x7f0798049730 2024-09-21T03:14:56.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.253+0000 7f07a5c00640 1 -- 172.21.15.90:0/1561289199 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f079800bae0 con 0x7f079802dbc0 2024-09-21T03:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.253+0000 7f07a5c00640 1 -- 172.21.15.90:0/1561289199 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f07980d3e50 con 0x7f079802d7b0 2024-09-21T03:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.254+0000 7f079f400640 1 --2- 172.21.15.90:0/1561289199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0798049730 0x7f0798042d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.254+0000 7f079e000640 1 -- 172.21.15.90:0/1561289199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f079802d7b0 msgr2=0x7f07980427b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.254+0000 7f079e000640 1 --2- 172.21.15.90:0/1561289199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f079802d7b0 0x7f07980427b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.254+0000 7f079e000640 1 -- 172.21.15.90:0/1561289199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0798049730 msgr2=0x7f0798042d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.254+0000 7f079e000640 1 --2- 172.21.15.90:0/1561289199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0798049730 0x7f0798042d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.254+0000 7f079e000640 1 -- 172.21.15.90:0/1561289199 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0798044140 con 0x7f079802dbc0 2024-09-21T03:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.255+0000 7f079f400640 1 --2- 172.21.15.90:0/1561289199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0798049730 0x7f0798042d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.255+0000 7f079e000640 1 --2- 172.21.15.90:0/1561289199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f079802dbc0 0x7f07980d2c60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07a006ae60 tx=0x7f07a006a1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:56.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.255+0000 7f507d600640 1 Processor -- start 2024-09-21T03:14:56.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.256+0000 7f0796a00640 1 -- 172.21.15.90:0/1561289199 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a0092070 con 0x7f079802dbc0 2024-09-21T03:14:56.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.256+0000 7f0796a00640 1 -- 172.21.15.90:0/1561289199 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07a0074910 con 0x7f079802dbc0 2024-09-21T03:14:56.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.256+0000 7f07a5c00640 1 -- 172.21.15.90:0/1561289199 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07980446c0 con 0x7f079802dbc0 2024-09-21T03:14:56.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.256+0000 7f07a5c00640 1 -- 172.21.15.90:0/1561289199 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07980443e0 con 0x7f079802dbc0 2024-09-21T03:14:56.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.256+0000 7f5912800640 1 Processor -- start 2024-09-21T03:14:56.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.256+0000 7f5912800640 1 -- start start 2024-09-21T03:14:56.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.258+0000 7f0796a00640 1 -- 172.21.15.90:0/1561289199 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a0074cc0 con 0x7f079802dbc0 2024-09-21T03:14:56.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.256+0000 7f507d600640 1 -- start start 2024-09-21T03:14:56.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.258+0000 7f507d600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f507806e440 0x7f5078155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.258+0000 7f507d600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50780c8760 0x7f50780c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.258+0000 7f507d600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50780ca1a0 0x7f50780c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.258+0000 7f5912800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f590c0728e0 0x7f590c14d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.258+0000 7f5912800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f590c0c5160 0x7f590c1ef7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.258+0000 7f5912800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f590c149580 0x7f590c1f09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.259+0000 7f5910a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f590c0c5160 0x7f590c1ef7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.259+0000 7f5076000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50780c8760 0x7f50780c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.259+0000 7f5076a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f507806e440 0x7f5078155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.259+0000 7f5076a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f507806e440 0x7f5078155740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:37432/0 (socket says 172.21.15.90:37432) 2024-09-21T03:14:56.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.259+0000 7f5910a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f590c0c5160 0x7f590c1ef7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33422/0 (socket says 172.21.15.90:33422) 2024-09-21T03:14:56.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.259+0000 7f5911400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f590c0728e0 0x7f590c14d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.259+0000 7f5077400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50780ca1a0 0x7f50780c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.259+0000 7f5076000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50780c8760 0x7f50780c45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33418/0 (socket says 172.21.15.90:33418) 2024-09-21T03:14:56.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.259+0000 7f5077400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50780ca1a0 0x7f50780c0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:39954/0 (socket says 172.21.15.90:39954) 2024-09-21T03:14:56.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.259+0000 7f5911400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f590c0728e0 0x7f590c14d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:39940/0 (socket says 172.21.15.90:39940) 2024-09-21T03:14:56.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.259+0000 7f5076a00640 1 -- 172.21.15.90:0/2182939195 learned_addr learned my addr 172.21.15.90:0/2182939195 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:56.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.259+0000 7f5910a00640 1 -- 172.21.15.90:0/3244757744 learned_addr learned my addr 172.21.15.90:0/3244757744 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:56.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.259+0000 7f507d600640 1 -- 172.21.15.90:0/2182939195 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f50780c7a10 con 0x7f50780c8760 2024-09-21T03:14:56.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.260+0000 7f507d600640 1 -- 172.21.15.90:0/2182939195 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f50780c7fc0 con 0x7f507806e440 2024-09-21T03:14:56.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.260+0000 7f507d600640 1 -- 172.21.15.90:0/2182939195 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f50780c7b90 con 0x7f50780ca1a0 2024-09-21T03:14:56.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.260+0000 7f5911e00640 1 --2- 172.21.15.90:0/3244757744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f590c149580 0x7f590c1f09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.260+0000 7f5912800640 1 -- 172.21.15.90:0/3244757744 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f590c0c3b00 con 0x7f590c0c5160 2024-09-21T03:14:56.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.260+0000 7f5912800640 1 -- 172.21.15.90:0/3244757744 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f590c0aa690 con 0x7f590c149580 2024-09-21T03:14:56.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.260+0000 7f5912800640 1 -- 172.21.15.90:0/3244757744 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f590c150770 con 0x7f590c0728e0 2024-09-21T03:14:56.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.261+0000 7f5076a00640 1 -- 172.21.15.90:0/2182939195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50780ca1a0 msgr2=0x7f50780c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.261+0000 7f5076a00640 1 --2- 172.21.15.90:0/2182939195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50780ca1a0 0x7f50780c0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.261+0000 7f5076a00640 1 -- 172.21.15.90:0/2182939195 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50780c8760 msgr2=0x7f50780c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.261+0000 7f5076a00640 1 --2- 172.21.15.90:0/2182939195 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50780c8760 0x7f50780c45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.261+0000 7f5076a00640 1 -- 172.21.15.90:0/2182939195 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50780c24e0 con 0x7f507806e440 2024-09-21T03:14:56.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.261+0000 7f5910a00640 1 -- 172.21.15.90:0/3244757744 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f590c0728e0 msgr2=0x7f590c14d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.261+0000 7f078be00640 1 -- 172.21.15.90:0/1561289199 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0778005290 con 0x7f079802dbc0 2024-09-21T03:14:56.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.262+0000 7f5910a00640 1 --2- 172.21.15.90:0/3244757744 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f590c0728e0 0x7f590c14d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.262+0000 7f5076a00640 1 --2- 172.21.15.90:0/2182939195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f507806e440 0x7f5078155740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f506000e9c0 tx=0x7f506000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:56.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.262+0000 7f5910a00640 1 -- 172.21.15.90:0/3244757744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f590c149580 msgr2=0x7f590c1f09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.262+0000 7f5910a00640 1 --2- 172.21.15.90:0/3244757744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f590c149580 0x7f590c1f09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.262+0000 7f5910a00640 1 -- 172.21.15.90:0/3244757744 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f590c1ee730 con 0x7f590c0c5160 2024-09-21T03:14:56.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.262+0000 7f5911400640 1 --2- 172.21.15.90:0/3244757744 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f590c0728e0 0x7f590c14d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:14:56.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.262+0000 7f506ea00640 1 -- 172.21.15.90:0/2182939195 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506000cd80 con 0x7f507806e440 2024-09-21T03:14:56.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.262+0000 7f506ea00640 1 -- 172.21.15.90:0/2182939195 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5060004020 con 0x7f507806e440 2024-09-21T03:14:56.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.262+0000 7f506ea00640 1 -- 172.21.15.90:0/2182939195 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060004450 con 0x7f507806e440 2024-09-21T03:14:56.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.262+0000 7f507d600640 1 -- 172.21.15.90:0/2182939195 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5078155c80 con 0x7f507806e440 2024-09-21T03:14:56.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.262+0000 7f507d600640 1 -- 172.21.15.90:0/2182939195 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50780c0150 con 0x7f507806e440 2024-09-21T03:14:56.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.263+0000 7f5910a00640 1 --2- 172.21.15.90:0/3244757744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f590c0c5160 0x7f590c1ef7d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f58f8000c00 tx=0x7f58f8003f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:56.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.264+0000 7f0796a00640 1 -- 172.21.15.90:0/1561289199 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f07a0097460 con 0x7f079802dbc0 2024-09-21T03:14:56.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.264+0000 7f5909600640 1 -- 172.21.15.90:0/3244757744 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f803f020 con 0x7f590c0c5160 2024-09-21T03:14:56.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.264+0000 7f5909600640 1 -- 172.21.15.90:0/3244757744 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58f80048b0 con 0x7f590c0c5160 2024-09-21T03:14:56.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.264+0000 7f5909600640 1 -- 172.21.15.90:0/3244757744 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f8036030 con 0x7f590c0c5160 2024-09-21T03:14:56.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.264+0000 7f5912800640 1 -- 172.21.15.90:0/3244757744 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f590c1eea10 con 0x7f590c0c5160 2024-09-21T03:14:56.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.264+0000 7f5912800640 1 -- 172.21.15.90:0/3244757744 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f590c1eefd0 con 0x7f590c0c5160 2024-09-21T03:14:56.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.266+0000 7f0796a00640 1 --2- 172.21.15.90:0/1561289199 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0780078b90 0x7f078007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.266+0000 7f0796a00640 1 -- 172.21.15.90:0/1561289199 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f07a0117ce0 con 0x7f079802dbc0 2024-09-21T03:14:56.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.266+0000 7f079ea00640 1 --2- 172.21.15.90:0/1561289199 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0780078b90 0x7f078007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.267+0000 7f079ea00640 1 --2- 172.21.15.90:0/1561289199 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0780078b90 0x7f078007b0a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0790035040 tx=0x7f07900046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:56.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.266+0000 7f507d600640 1 -- 172.21.15.90:0/2182939195 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50781540e0 con 0x7f507806e440 2024-09-21T03:14:56.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.268+0000 7f5912800640 1 -- 172.21.15.90:0/3244757744 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f590c0c47c0 con 0x7f590c0c5160 2024-09-21T03:14:56.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.268+0000 7f506ea00640 1 -- 172.21.15.90:0/2182939195 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f50600035f0 con 0x7f507806e440 2024-09-21T03:14:56.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.269+0000 7f5909600640 1 -- 172.21.15.90:0/3244757744 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f58f8042020 con 0x7f590c0c5160 2024-09-21T03:14:56.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.270+0000 7fbdf9800640 1 -- 172.21.15.90:0/2094990435 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdf408c9a0 msgr2=0x7fbdf4070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.270+0000 7fbdf9800640 1 --2- 172.21.15.90:0/2094990435 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdf408c9a0 0x7fbdf4070590 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbde400a9a0 tx=0x7fbde402b880 comp rx=0 tx=0).stop 2024-09-21T03:14:56.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.270+0000 7fbdf9800640 1 -- 172.21.15.90:0/2094990435 shutdown_connections 2024-09-21T03:14:56.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.270+0000 7fbdf9800640 1 --2- 172.21.15.90:0/2094990435 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdf408c9a0 0x7fbdf4070590 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbde400a9a0 tx=0x7fbde402b880 comp rx=0 tx=0).stop 2024-09-21T03:14:56.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.270+0000 7fbdf9800640 1 -- 172.21.15.90:0/2094990435 >> 172.21.15.90:0/2094990435 conn(0x7fbdf40c81b0 msgr2=0x7fbdf40c85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:56.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.271+0000 7f0796a00640 1 -- 172.21.15.90:0/1561289199 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f07a00dfe70 con 0x7f079802dbc0 2024-09-21T03:14:56.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.270+0000 7f506ea00640 1 --2- 172.21.15.90:0/2182939195 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5054078b90 0x7f505407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.271+0000 7f5076000640 1 --2- 172.21.15.90:0/2182939195 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5054078b90 0x7f505407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.271+0000 7f506ea00640 1 -- 172.21.15.90:0/2182939195 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f506009b8c0 con 0x7f507806e440 2024-09-21T03:14:56.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.272+0000 7fbdf9800640 1 -- 172.21.15.90:0/2094990435 shutdown_connections 2024-09-21T03:14:56.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.271+0000 7f5909600640 1 --2- 172.21.15.90:0/3244757744 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f58ec078bc0 0x7f58ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.271+0000 7f5909600640 1 -- 172.21.15.90:0/3244757744 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f58f80bbe60 con 0x7f590c0c5160 2024-09-21T03:14:56.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.272+0000 7f5911400640 1 --2- 172.21.15.90:0/3244757744 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f58ec078bc0 0x7f58ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.272+0000 7fbdf9800640 1 -- 172.21.15.90:0/2094990435 wait complete. 2024-09-21T03:14:56.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.273+0000 7f5076000640 1 --2- 172.21.15.90:0/2182939195 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5054078b90 0x7f505407b0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5068034000 tx=0x7f5068004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:56.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.274+0000 7f5911400640 1 --2- 172.21.15.90:0/3244757744 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f58ec078bc0 0x7f58ec07b0d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5900009b80 tx=0x7f5900005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:56.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.275+0000 7fbdf9800640 1 Processor -- start 2024-09-21T03:14:56.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.276+0000 7fbdf9800640 1 -- start start 2024-09-21T03:14:56.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.276+0000 7f506ea00640 1 -- 172.21.15.90:0/2182939195 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5060063400 con 0x7f507806e440 2024-09-21T03:14:56.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.279+0000 7fbdf9800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdf406f0c0 0x7fbdf4206550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.279+0000 7fbdf9800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdf406f540 0x7fbdf415da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.279+0000 7fbdf9800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdf40ab660 0x7fbdf4165480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.279+0000 7fbdf9800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf4161350 con 0x7fbdf40ab660 2024-09-21T03:14:56.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.279+0000 7fbdf9800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf4167a70 con 0x7fbdf406f540 2024-09-21T03:14:56.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.279+0000 7fbdf9800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbdf41614d0 con 0x7fbdf406f0c0 2024-09-21T03:14:56.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.280+0000 7fbdf3400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdf40ab660 0x7fbdf4165480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.280+0000 7fbdf3400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdf40ab660 0x7fbdf4165480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33442/0 (socket says 172.21.15.90:33442) 2024-09-21T03:14:56.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.280+0000 7fbdf3400640 1 -- 172.21.15.90:0/2266053323 learned_addr learned my addr 172.21.15.90:0/2266053323 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:56.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.280+0000 7fbdf2a00640 1 --2- 172.21.15.90:0/2266053323 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdf406f0c0 0x7fbdf4206550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.281+0000 7fbdf3400640 1 -- 172.21.15.90:0/2266053323 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdf406f0c0 msgr2=0x7fbdf4206550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.281+0000 7fbdf3400640 1 --2- 172.21.15.90:0/2266053323 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdf406f0c0 0x7fbdf4206550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.281+0000 7fbdf2000640 1 --2- 172.21.15.90:0/2266053323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdf406f540 0x7fbdf415da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.281+0000 7fbdf3400640 1 -- 172.21.15.90:0/2266053323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdf406f540 msgr2=0x7fbdf415da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.281+0000 7f5909600640 1 -- 172.21.15.90:0/3244757744 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f58f8049030 con 0x7f590c0c5160 2024-09-21T03:14:56.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.281+0000 7fbdf3400640 1 --2- 172.21.15.90:0/2266053323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdf406f540 0x7fbdf415da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.281+0000 7fbdf3400640 1 -- 172.21.15.90:0/2266053323 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf41f2de0 con 0x7fbdf40ab660 2024-09-21T03:14:56.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.282+0000 7fbdf3400640 1 --2- 172.21.15.90:0/2266053323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdf40ab660 0x7fbdf4165480 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbde000c3f0 tx=0x7fbde000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:56.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.282+0000 7fbdeaa00640 1 -- 172.21.15.90:0/2266053323 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde0017070 con 0x7fbdf40ab660 2024-09-21T03:14:56.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.282+0000 7f6232200640 1 -- 172.21.15.90:0/4011461819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f622404df40 msgr2=0x7f62240dd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.282+0000 7f6232200640 1 --2- 172.21.15.90:0/4011461819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f622404df40 0x7f62240dd6b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f62240db0f0 tx=0x7f622002a4b0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.282+0000 7fbdeaa00640 1 -- 172.21.15.90:0/2266053323 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbde00035f0 con 0x7fbdf40ab660 2024-09-21T03:14:56.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.283+0000 7f6232200640 1 -- 172.21.15.90:0/4011461819 shutdown_connections 2024-09-21T03:14:56.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.283+0000 7f6232200640 1 --2- 172.21.15.90:0/4011461819 >> v2:172.21.15.149:3300/0 conn(0x7f6224007110 0x7f6224007520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.282+0000 7fbdeaa00640 1 -- 172.21.15.90:0/2266053323 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde0003a40 con 0x7fbdf40ab660 2024-09-21T03:14:56.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.283+0000 7f6232200640 1 --2- 172.21.15.90:0/4011461819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f622404df40 0x7f62240dd6b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.283+0000 7f6232200640 1 -- 172.21.15.90:0/4011461819 >> 172.21.15.90:0/4011461819 conn(0x7f62240314b0 msgr2=0x7f62240318c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:56.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.283+0000 7fbdf9800640 1 -- 172.21.15.90:0/2266053323 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf41f2b00 con 0x7fbdf40ab660 2024-09-21T03:14:56.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.283+0000 7fbdf9800640 1 -- 172.21.15.90:0/2266053323 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf4166910 con 0x7fbdf40ab660 2024-09-21T03:14:56.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.286+0000 7fbdf9800640 1 -- 172.21.15.90:0/2266053323 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdf4070590 con 0x7fbdf40ab660 2024-09-21T03:14:56.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.286+0000 7f6232200640 1 -- 172.21.15.90:0/4011461819 shutdown_connections 2024-09-21T03:14:56.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.286+0000 7f6232200640 1 -- 172.21.15.90:0/4011461819 wait complete. 2024-09-21T03:14:56.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.289+0000 7f6232200640 1 Processor -- start 2024-09-21T03:14:56.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.290+0000 7f6232200640 1 -- start start 2024-09-21T03:14:56.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.288+0000 7fbdeaa00640 1 -- 172.21.15.90:0/2266053323 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbde001a070 con 0x7fbdf40ab660 2024-09-21T03:14:56.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.290+0000 7fbdeaa00640 1 --2- 172.21.15.90:0/2266053323 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbdd4078be0 0x7fbdd407b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.290+0000 7fbdeaa00640 1 -- 172.21.15.90:0/2266053323 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fbde009a170 con 0x7fbdf40ab660 2024-09-21T03:14:56.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.291+0000 7fbdf2a00640 1 --2- 172.21.15.90:0/2266053323 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbdd4078be0 0x7fbdd407b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.293+0000 7f6232200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6224007110 0x7f6224171e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.293+0000 7f3bcfc00640 1 -- 172.21.15.90:0/39392645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bc8151130 msgr2=0x7f3bc8154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.293+0000 7f3bcfc00640 1 --2- 172.21.15.90:0/39392645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bc8151130 0x7f3bc8154410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80c7100 tx=0x7f3bbc02a560 comp rx=0 tx=0).stop 2024-09-21T03:14:56.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.294+0000 7f3bcfc00640 1 -- 172.21.15.90:0/39392645 shutdown_connections 2024-09-21T03:14:56.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.294+0000 7f3bcfc00640 1 --2- 172.21.15.90:0/39392645 >> v2:172.21.15.90:3300/0 conn(0x7f3bc80c76f0 0x7f3bc80c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.294+0000 7fbdf2a00640 1 --2- 172.21.15.90:0/2266053323 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbdd4078be0 0x7fbdd407b0f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbdec007fd0 tx=0x7fbdec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:56.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.294+0000 7f3bcfc00640 1 --2- 172.21.15.90:0/39392645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bc8151130 0x7f3bc8154410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.294+0000 7f3bcfc00640 1 -- 172.21.15.90:0/39392645 >> 172.21.15.90:0/39392645 conn(0x7f3bc80c96d0 msgr2=0x7f3bc80c5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:56.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.294+0000 7f6232200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f622404df40 0x7f6224177d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.294+0000 7f6232200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f622404e610 0x7f62240d6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.294+0000 7f6232200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6224043170 con 0x7f622404df40 2024-09-21T03:14:56.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.294+0000 7f6232200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f622404f5c0 con 0x7f6224007110 2024-09-21T03:14:56.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.294+0000 7f6232200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f622404ad50 con 0x7f622404e610 2024-09-21T03:14:56.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.295+0000 7f622b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6224007110 0x7f6224171e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.295+0000 7f622aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f622404df40 0x7f6224177d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.295+0000 7f622aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f622404df40 0x7f6224177d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33470/0 (socket says 172.21.15.90:33470) 2024-09-21T03:14:56.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.295+0000 7f622aa00640 1 -- 172.21.15.90:0/4191357867 learned_addr learned my addr 172.21.15.90:0/4191357867 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:56.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.295+0000 7f6230c00640 1 --2- 172.21.15.90:0/4191357867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f622404e610 0x7f62240d6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.296+0000 7f6230c00640 1 -- 172.21.15.90:0/4191357867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6224007110 msgr2=0x7f6224171e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.296+0000 7f6230c00640 1 --2- 172.21.15.90:0/4191357867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6224007110 0x7f6224171e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.296+0000 7f6230c00640 1 -- 172.21.15.90:0/4191357867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f622404df40 msgr2=0x7f6224177d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.296+0000 7f6230c00640 1 --2- 172.21.15.90:0/4191357867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f622404df40 0x7f6224177d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.296+0000 7f6230c00640 1 -- 172.21.15.90:0/4191357867 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62240d3a80 con 0x7f622404e610 2024-09-21T03:14:56.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.297+0000 7f622aa00640 1 --2- 172.21.15.90:0/4191357867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f622404df40 0x7f6224177d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:14:56.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.297+0000 7f622b400640 1 --2- 172.21.15.90:0/4191357867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6224007110 0x7f6224171e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:14:56.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.297+0000 7f3bcfc00640 1 -- 172.21.15.90:0/39392645 shutdown_connections 2024-09-21T03:14:56.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.297+0000 7f6230c00640 1 --2- 172.21.15.90:0/4191357867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f622404e610 0x7f62240d6130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f621800e670 tx=0x7f621800eb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:56.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.297+0000 7f3bcfc00640 1 -- 172.21.15.90:0/39392645 wait complete. 2024-09-21T03:14:56.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.299+0000 7fbdeaa00640 1 -- 172.21.15.90:0/2266053323 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbde00623f0 con 0x7fbdf40ab660 2024-09-21T03:14:56.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.298+0000 7f621f400640 1 -- 172.21.15.90:0/4191357867 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6218004220 con 0x7f622404e610 2024-09-21T03:14:56.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.298+0000 7f621f400640 1 -- 172.21.15.90:0/4191357867 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62180043e0 con 0x7f622404e610 2024-09-21T03:14:56.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.298+0000 7f6232200640 1 -- 172.21.15.90:0/4191357867 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62240d2540 con 0x7f622404e610 2024-09-21T03:14:56.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.298+0000 7f6232200640 1 -- 172.21.15.90:0/4191357867 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f62240488c0 con 0x7f622404e610 2024-09-21T03:14:56.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.299+0000 7f621f400640 1 -- 172.21.15.90:0/4191357867 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621800cb10 con 0x7f622404e610 2024-09-21T03:14:56.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.301+0000 7f6232200640 1 -- 172.21.15.90:0/4191357867 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6208005290 con 0x7f622404e610 2024-09-21T03:14:56.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.301+0000 7f52a1e00640 1 -- 172.21.15.90:0/1529533274 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52940d7910 msgr2=0x7f52940319e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.301+0000 7f52a1e00640 1 --2- 172.21.15.90:0/1529533274 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52940d7910 0x7f52940319e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f528c005fd0 tx=0x7f528c02a5d0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.301+0000 7f52a1e00640 1 -- 172.21.15.90:0/1529533274 shutdown_connections 2024-09-21T03:14:56.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.301+0000 7f3bcfc00640 1 Processor -- start 2024-09-21T03:14:56.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.302+0000 7f3bcfc00640 1 -- start start 2024-09-21T03:14:56.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.301+0000 7f52a1e00640 1 --2- 172.21.15.90:0/1529533274 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52940ddfd0 0x7f52940e4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.303+0000 7f52a1e00640 1 --2- 172.21.15.90:0/1529533274 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52940d7910 0x7f52940319e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.303+0000 7f52a1e00640 1 -- 172.21.15.90:0/1529533274 >> 172.21.15.90:0/1529533274 conn(0x7f529404c890 msgr2=0x7f52940312d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:56.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.302+0000 7f621f400640 1 -- 172.21.15.90:0/4191357867 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f621800ccb0 con 0x7f622404e610 2024-09-21T03:14:56.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.303+0000 7f621f400640 1 --2- 172.21.15.90:0/4191357867 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f620c078be0 0x7f620c07b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.303+0000 7f621f400640 1 -- 172.21.15.90:0/4191357867 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f621809b400 con 0x7f622404e610 2024-09-21T03:14:56.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.304+0000 7f622b400640 1 --2- 172.21.15.90:0/4191357867 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f620c078be0 0x7f620c07b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.304+0000 7f52a1e00640 1 -- 172.21.15.90:0/1529533274 shutdown_connections 2024-09-21T03:14:56.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.304+0000 7f52a1e00640 1 -- 172.21.15.90:0/1529533274 wait complete. 2024-09-21T03:14:56.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.304+0000 7f622b400640 1 --2- 172.21.15.90:0/4191357867 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f620c078be0 0x7f620c07b0f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f622c0756e0 tx=0x7f622c070040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:56.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.305+0000 7f3bcfc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bc806fd00 0x7f3bc8147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.305+0000 7f3bcfc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bc80c76f0 0x7f3bc80c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.305+0000 7f3bcfc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3bc8151130 0x7f3bc814eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.305+0000 7f3bcfc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc80c6940 con 0x7f3bc80c76f0 2024-09-21T03:14:56.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.305+0000 7f3bcfc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc80c71d0 con 0x7f3bc806fd00 2024-09-21T03:14:56.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.305+0000 7f3bcfc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3bc814f840 con 0x7f3bc8151130 2024-09-21T03:14:56.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.305+0000 7f3bcd200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bc806fd00 0x7f3bc8147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.305+0000 7f3bcd200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bc806fd00 0x7f3bc8147c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:37476/0 (socket says 172.21.15.90:37476) 2024-09-21T03:14:56.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.305+0000 7f3bcd200640 1 -- 172.21.15.90:0/1516400318 learned_addr learned my addr 172.21.15.90:0/1516400318 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:56.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.306+0000 7f3bcdc00640 1 --2- 172.21.15.90:0/1516400318 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3bc8151130 0x7f3bc814eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.306+0000 7f3bcd200640 1 -- 172.21.15.90:0/1516400318 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3bc8151130 msgr2=0x7f3bc814eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.306+0000 7f3bcd200640 1 --2- 172.21.15.90:0/1516400318 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3bc8151130 0x7f3bc814eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.306+0000 7f3bcd200640 1 -- 172.21.15.90:0/1516400318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bc80c76f0 msgr2=0x7f3bc80c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.306+0000 7f3bcd200640 1 --2- 172.21.15.90:0/1516400318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bc80c76f0 0x7f3bc80c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.306+0000 7f3bcd200640 1 -- 172.21.15.90:0/1516400318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc80c3110 con 0x7f3bc806fd00 2024-09-21T03:14:56.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.306+0000 7f3bcd200640 1 --2- 172.21.15.90:0/1516400318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bc806fd00 0x7f3bc8147c40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc034040 tx=0x7f3bbc003910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:56.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.307+0000 7f3bc4c00640 1 -- 172.21.15.90:0/1516400318 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc03e030 con 0x7f3bc806fd00 2024-09-21T03:14:56.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.307+0000 7f3bc4c00640 1 -- 172.21.15.90:0/1516400318 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bbc003e00 con 0x7f3bc806fd00 2024-09-21T03:14:56.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.307+0000 7f3bc4c00640 1 -- 172.21.15.90:0/1516400318 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc035040 con 0x7f3bc806fd00 2024-09-21T03:14:56.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.308+0000 7f52a1e00640 1 Processor -- start 2024-09-21T03:14:56.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.308+0000 7f3bcfc00640 1 -- 172.21.15.90:0/1516400318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc81f1680 con 0x7f3bc806fd00 2024-09-21T03:14:56.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.309+0000 7f3bcfc00640 1 -- 172.21.15.90:0/1516400318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc81f1c40 con 0x7f3bc806fd00 2024-09-21T03:14:56.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.310+0000 7f621f400640 1 -- 172.21.15.90:0/4191357867 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f62240d3a80 con 0x7f622404e610 2024-09-21T03:14:56.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.310+0000 7f3bcfc00640 1 -- 172.21.15.90:0/1516400318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bc8069780 con 0x7f3bc806fd00 2024-09-21T03:14:56.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.309+0000 7f52a1e00640 1 -- start start 2024-09-21T03:14:56.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.311+0000 7f52a1e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5294031f20 0x7f52940489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.311+0000 7f52a1e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52940d7910 0x7f52940493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.311+0000 7f52a1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52940ddfd0 0x7f5294030750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.311+0000 7f52a1e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f529404a730 con 0x7f52940d7910 2024-09-21T03:14:56.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.311+0000 7f52a1e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f52940d7d20 con 0x7f5294031f20 2024-09-21T03:14:56.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.311+0000 7f52a1e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f529404a8b0 con 0x7f52940ddfd0 2024-09-21T03:14:56.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.312+0000 7f529b400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52940ddfd0 0x7f5294030750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.312+0000 7f529aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5294031f20 0x7f52940489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.312+0000 7f529aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5294031f20 0x7f52940489e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:37482/0 (socket says 172.21.15.90:37482) 2024-09-21T03:14:56.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.312+0000 7f529aa00640 1 -- 172.21.15.90:0/1187963737 learned_addr learned my addr 172.21.15.90:0/1187963737 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:56.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.312+0000 7f529a000640 1 --2- 172.21.15.90:0/1187963737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52940d7910 0x7f52940493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.313+0000 7f3bc4c00640 1 -- 172.21.15.90:0/1516400318 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3bbc041030 con 0x7f3bc806fd00 2024-09-21T03:14:56.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.314+0000 7f529b400640 1 -- 172.21.15.90:0/1187963737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5294031f20 msgr2=0x7f52940489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.314+0000 7f529b400640 1 --2- 172.21.15.90:0/1187963737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5294031f20 0x7f52940489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.314+0000 7f529b400640 1 -- 172.21.15.90:0/1187963737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52940d7910 msgr2=0x7f52940493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.314+0000 7f529b400640 1 --2- 172.21.15.90:0/1187963737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52940d7910 0x7f52940493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.315+0000 7f529b400640 1 -- 172.21.15.90:0/1187963737 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52940070f0 con 0x7f52940ddfd0 2024-09-21T03:14:56.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.315+0000 7f529a000640 1 --2- 172.21.15.90:0/1187963737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52940d7910 0x7f52940493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:14:56.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.315+0000 7f529b400640 1 --2- 172.21.15.90:0/1187963737 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52940ddfd0 0x7f5294030750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f529c066360 tx=0x7f529c075420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:56.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.315+0000 7f3bc4c00640 1 --2- 172.21.15.90:0/1516400318 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3ba8078be0 0x7f3ba807b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.315+0000 7f529aa00640 1 --2- 172.21.15.90:0/1187963737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5294031f20 0x7f52940489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:14:56.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.316+0000 7f5293400640 1 -- 172.21.15.90:0/1187963737 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c099070 con 0x7f52940ddfd0 2024-09-21T03:14:56.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.316+0000 7f3bc4c00640 1 -- 172.21.15.90:0/1516400318 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f3bbc0bb960 con 0x7f3bc806fd00 2024-09-21T03:14:56.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.316+0000 7f5293400640 1 -- 172.21.15.90:0/1187963737 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f529c071890 con 0x7f52940ddfd0 2024-09-21T03:14:56.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.316+0000 7f5293400640 1 -- 172.21.15.90:0/1187963737 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c071ca0 con 0x7f52940ddfd0 2024-09-21T03:14:56.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.316+0000 7f52a1e00640 1 -- 172.21.15.90:0/1187963737 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52940469e0 con 0x7f52940ddfd0 2024-09-21T03:14:56.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.317+0000 7f52a1e00640 1 -- 172.21.15.90:0/1187963737 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f52941787d0 con 0x7f52940ddfd0 2024-09-21T03:14:56.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.317+0000 7f3bc4c00640 1 -- 172.21.15.90:0/1516400318 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3bbc083b70 con 0x7f3bc806fd00 2024-09-21T03:14:56.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.317+0000 7f3bc7e00640 1 --2- 172.21.15.90:0/1516400318 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3ba8078be0 0x7f3ba807b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.318+0000 7f52a1e00640 1 -- 172.21.15.90:0/1187963737 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52940de520 con 0x7f52940ddfd0 2024-09-21T03:14:56.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.319+0000 7f3bc7e00640 1 --2- 172.21.15.90:0/1516400318 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3ba8078be0 0x7f3ba807b0f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4000f60 tx=0x7f3bb40079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:56.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.320+0000 7f5293400640 1 -- 172.21.15.90:0/1187963737 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f529c09c070 con 0x7f52940ddfd0 2024-09-21T03:14:56.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.322+0000 7f5293400640 1 --2- 172.21.15.90:0/1187963737 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f527c078c90 0x7f527c07b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.323+0000 7f5293400640 1 -- 172.21.15.90:0/1187963737 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f529c117810 con 0x7f52940ddfd0 2024-09-21T03:14:56.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.323+0000 7f529aa00640 1 --2- 172.21.15.90:0/1187963737 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f527c078c90 0x7f527c07b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.323+0000 7f529aa00640 1 --2- 172.21.15.90:0/1187963737 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f527c078c90 0x7f527c07b1a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f528c009230 tx=0x7f528c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:56.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.327+0000 7f5293400640 1 -- 172.21.15.90:0/1187963737 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f529c091070 con 0x7f52940ddfd0 2024-09-21T03:14:56.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.350+0000 7f13c5200640 1 -- 172.21.15.90:0/2899262828 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13c00c7120 msgr2=0x7f13c0154070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.350+0000 7f13c5200640 1 --2- 172.21.15.90:0/2899262828 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13c00c7120 0x7f13c0154070 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009860 tx=0x7f13ac02a320 comp rx=0 tx=0).stop 2024-09-21T03:14:56.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.350+0000 7f13c5200640 1 -- 172.21.15.90:0/2899262828 shutdown_connections 2024-09-21T03:14:56.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.350+0000 7f13c5200640 1 --2- 172.21.15.90:0/2899262828 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13c00c7120 0x7f13c0154070 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.350+0000 7f13c5200640 1 -- 172.21.15.90:0/2899262828 >> 172.21.15.90:0/2899262828 conn(0x7f13c00cc270 msgr2=0x7f13c00cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:56.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.350+0000 7f13c5200640 1 -- 172.21.15.90:0/2899262828 shutdown_connections 2024-09-21T03:14:56.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.352+0000 7f13c5200640 1 -- 172.21.15.90:0/2899262828 wait complete. 2024-09-21T03:14:56.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.355+0000 7f13c5200640 1 Processor -- start 2024-09-21T03:14:56.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.356+0000 7f13c5200640 1 -- start start 2024-09-21T03:14:56.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.358+0000 7f13c5200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13c00c7120 0x7f13c0156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.358+0000 7f13c5200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13c00c8c50 0x7f13c015a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.359+0000 7f13c5200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13c00c9060 0x7f13c0159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.359+0000 7f13bf400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13c00c7120 0x7f13c0156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.359+0000 7f13c5200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f13c0154680 con 0x7f13c00c8c50 2024-09-21T03:14:56.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.359+0000 7f13bf400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13c00c7120 0x7f13c0156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:40002/0 (socket says 172.21.15.90:40002) 2024-09-21T03:14:56.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.359+0000 7f13bf400640 1 -- 172.21.15.90:0/26083967 learned_addr learned my addr 172.21.15.90:0/26083967 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:56.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.359+0000 7f13bfe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13c00c9060 0x7f13c0159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.359+0000 7f13c5200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f13c00cba00 con 0x7f13c00c9060 2024-09-21T03:14:56.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.359+0000 7f13c5200640 1 -- 172.21.15.90:0/26083967 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f13c00c8840 con 0x7f13c00c7120 2024-09-21T03:14:56.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.360+0000 7f13bea00640 1 --2- 172.21.15.90:0/26083967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13c00c8c50 0x7f13c015a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.361+0000 7f13bea00640 1 -- 172.21.15.90:0/26083967 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13c00c7120 msgr2=0x7f13c0156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.361+0000 7f13bea00640 1 --2- 172.21.15.90:0/26083967 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13c00c7120 0x7f13c0156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.361+0000 7f13bea00640 1 -- 172.21.15.90:0/26083967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13c00c9060 msgr2=0x7f13c0159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.361+0000 7f13bea00640 1 --2- 172.21.15.90:0/26083967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13c00c9060 0x7f13c0159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.361+0000 7f13bea00640 1 -- 172.21.15.90:0/26083967 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c01e1ab0 con 0x7f13c00c8c50 2024-09-21T03:14:56.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.361+0000 7f13bf400640 1 --2- 172.21.15.90:0/26083967 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13c00c7120 0x7f13c0156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:14:56.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.361+0000 7f13bea00640 1 --2- 172.21.15.90:0/26083967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13c00c8c50 0x7f13c015a6b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f13b000c3e0 tx=0x7f13b000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:56.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.363+0000 7f13b7400640 1 -- 172.21.15.90:0/26083967 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b0017070 con 0x7f13c00c8c50 2024-09-21T03:14:56.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.363+0000 7f13b7400640 1 -- 172.21.15.90:0/26083967 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13b00035f0 con 0x7f13c00c8c50 2024-09-21T03:14:56.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.363+0000 7f13b7400640 1 -- 172.21.15.90:0/26083967 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b0003a40 con 0x7f13c00c8c50 2024-09-21T03:14:56.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.363+0000 7f13c5200640 1 -- 172.21.15.90:0/26083967 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c0073950 con 0x7f13c00c8c50 2024-09-21T03:14:56.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.363+0000 7f13c5200640 1 -- 172.21.15.90:0/26083967 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c0157ff0 con 0x7f13c00c8c50 2024-09-21T03:14:56.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.365+0000 7f13c5200640 1 -- 172.21.15.90:0/26083967 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c0154070 con 0x7f13c00c8c50 2024-09-21T03:14:56.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.367+0000 7f13b7400640 1 -- 172.21.15.90:0/26083967 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f13b001a070 con 0x7f13c00c8c50 2024-09-21T03:14:56.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.369+0000 7f13b7400640 1 --2- 172.21.15.90:0/26083967 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f13a0078b90 0x7f13a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:56.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.369+0000 7f13b7400640 1 -- 172.21.15.90:0/26083967 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f13b009a2c0 con 0x7f13c00c8c50 2024-09-21T03:14:56.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.373+0000 7f13bf400640 1 --2- 172.21.15.90:0/26083967 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f13a0078b90 0x7f13a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:56.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.374+0000 7f13bf400640 1 --2- 172.21.15.90:0/26083967 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f13a0078b90 0x7f13a007b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f13ac02afd0 tx=0x7f13ac02c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:56.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.378+0000 7f13b7400640 1 -- 172.21.15.90:0/26083967 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f13b0061ec0 con 0x7f13c00c8c50 2024-09-21T03:14:56.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.683+0000 7f078be00640 1 -- 172.21.15.90:0/1561289199 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f0778005580 con 0x7f079802dbc0 2024-09-21T03:14:56.690 INFO:teuthology.orchestra.run.smithi090.stdout:64424509450 2024-09-21T03:14:56.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.685+0000 7f0796a00640 1 -- 172.21.15.90:0/1561289199 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f07a00df770 con 0x7f079802dbc0 2024-09-21T03:14:56.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.691+0000 7f07a5c00640 1 -- 172.21.15.90:0/1561289199 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0780078b90 msgr2=0x7f078007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.691+0000 7f07a5c00640 1 --2- 172.21.15.90:0/1561289199 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0780078b90 0x7f078007b0a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0790035040 tx=0x7f07900046c0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.691+0000 7f07a5c00640 1 -- 172.21.15.90:0/1561289199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f079802dbc0 msgr2=0x7f07980d2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.691+0000 7f07a5c00640 1 --2- 172.21.15.90:0/1561289199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f079802dbc0 0x7f07980d2c60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07a006ae60 tx=0x7f07a006a1d0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.691+0000 7f07a5c00640 1 -- 172.21.15.90:0/1561289199 shutdown_connections 2024-09-21T03:14:56.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.691+0000 7f07a5c00640 1 --2- 172.21.15.90:0/1561289199 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0780078b90 0x7f078007b0a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.691+0000 7f07a5c00640 1 --2- 172.21.15.90:0/1561289199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0798049730 0x7f0798042d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.691+0000 7f07a5c00640 1 --2- 172.21.15.90:0/1561289199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f079802dbc0 0x7f07980d2c60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.691+0000 7f07a5c00640 1 --2- 172.21.15.90:0/1561289199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f079802d7b0 0x7f07980427b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.691+0000 7f07a5c00640 1 -- 172.21.15.90:0/1561289199 >> 172.21.15.90:0/1561289199 conn(0x7f0798048640 msgr2=0x7f0798006060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:56.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.692+0000 7f07a5c00640 1 -- 172.21.15.90:0/1561289199 shutdown_connections 2024-09-21T03:14:56.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.692+0000 7f07a5c00640 1 -- 172.21.15.90:0/1561289199 wait complete. 2024-09-21T03:14:56.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.698+0000 7f5912800640 1 -- 172.21.15.90:0/3244757744 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f590c0c2680 con 0x7f590c0c5160 2024-09-21T03:14:56.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.698+0000 7f5909600640 1 -- 172.21.15.90:0/3244757744 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f58f8084010 con 0x7f590c0c5160 2024-09-21T03:14:56.701 INFO:teuthology.orchestra.run.smithi090.stdout:64424509451 2024-09-21T03:14:56.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.706+0000 7f5912800640 1 -- 172.21.15.90:0/3244757744 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f58ec078bc0 msgr2=0x7f58ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.706+0000 7f5912800640 1 --2- 172.21.15.90:0/3244757744 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f58ec078bc0 0x7f58ec07b0d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5900009b80 tx=0x7f5900005f90 comp rx=0 tx=0).stop 2024-09-21T03:14:56.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.706+0000 7f5912800640 1 -- 172.21.15.90:0/3244757744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f590c0c5160 msgr2=0x7f590c1ef7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.706+0000 7f5912800640 1 --2- 172.21.15.90:0/3244757744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f590c0c5160 0x7f590c1ef7d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f58f8000c00 tx=0x7f58f8003f00 comp rx=0 tx=0).stop 2024-09-21T03:14:56.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.706+0000 7f5912800640 1 -- 172.21.15.90:0/3244757744 shutdown_connections 2024-09-21T03:14:56.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.706+0000 7f5912800640 1 --2- 172.21.15.90:0/3244757744 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f58ec078bc0 0x7f58ec07b0d0 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5900009b80 tx=0x7f5900005f90 comp rx=0 tx=0).stop 2024-09-21T03:14:56.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.706+0000 7f5912800640 1 --2- 172.21.15.90:0/3244757744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f590c149580 0x7f590c1f09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.706+0000 7f5912800640 1 --2- 172.21.15.90:0/3244757744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f590c0c5160 0x7f590c1ef7d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.706+0000 7f5912800640 1 --2- 172.21.15.90:0/3244757744 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f590c0728e0 0x7f590c14d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.706+0000 7f5912800640 1 -- 172.21.15.90:0/3244757744 >> 172.21.15.90:0/3244757744 conn(0x7f590c06d200 msgr2=0x7f590c1489f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:56.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.707+0000 7f5912800640 1 -- 172.21.15.90:0/3244757744 shutdown_connections 2024-09-21T03:14:56.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.707+0000 7f5912800640 1 -- 172.21.15.90:0/3244757744 wait complete. 2024-09-21T03:14:56.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.717+0000 7f507d600640 1 -- 172.21.15.90:0/2182939195 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f50780c70e0 con 0x7f507806e440 2024-09-21T03:14:56.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.718+0000 7f506ea00640 1 -- 172.21.15.90:0/2182939195 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5060067e30 con 0x7f507806e440 2024-09-21T03:14:56.721 INFO:teuthology.orchestra.run.smithi090.stdout:64424509449 2024-09-21T03:14:56.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.723+0000 7f507d600640 1 -- 172.21.15.90:0/2182939195 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5054078b90 msgr2=0x7f505407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.723+0000 7f507d600640 1 --2- 172.21.15.90:0/2182939195 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5054078b90 0x7f505407b0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5068034000 tx=0x7f5068004730 comp rx=0 tx=0).stop 2024-09-21T03:14:56.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.723+0000 7f507d600640 1 -- 172.21.15.90:0/2182939195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f507806e440 msgr2=0x7f5078155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.723+0000 7f507d600640 1 --2- 172.21.15.90:0/2182939195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f507806e440 0x7f5078155740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f506000e9c0 tx=0x7f506000ee80 comp rx=0 tx=0).stop 2024-09-21T03:14:56.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.723+0000 7f507d600640 1 -- 172.21.15.90:0/2182939195 shutdown_connections 2024-09-21T03:14:56.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.724+0000 7f507d600640 1 --2- 172.21.15.90:0/2182939195 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5054078b90 0x7f505407b0a0 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5068034000 tx=0x7f5068004730 comp rx=0 tx=0).stop 2024-09-21T03:14:56.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.724+0000 7f507d600640 1 --2- 172.21.15.90:0/2182939195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50780ca1a0 0x7f50780c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.724+0000 7f507d600640 1 --2- 172.21.15.90:0/2182939195 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50780c8760 0x7f50780c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.724+0000 7f507d600640 1 --2- 172.21.15.90:0/2182939195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f507806e440 0x7f5078155740 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.724+0000 7f507d600640 1 -- 172.21.15.90:0/2182939195 >> 172.21.15.90:0/2182939195 conn(0x7f50780c8d20 msgr2=0x7f50780c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:56.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.724+0000 7f507d600640 1 -- 172.21.15.90:0/2182939195 shutdown_connections 2024-09-21T03:14:56.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.725+0000 7f507d600640 1 -- 172.21.15.90:0/2182939195 wait complete. 2024-09-21T03:14:56.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.4 2024-09-21T03:14:56.734 DEBUG:teuthology.parallel:result is None 2024-09-21T03:14:56.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.0 2024-09-21T03:14:56.747 DEBUG:teuthology.parallel:result is None 2024-09-21T03:14:56.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.749+0000 7fbdf9800640 1 -- 172.21.15.90:0/2266053323 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fbdf415cef0 con 0x7fbdf40ab660 2024-09-21T03:14:56.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.750+0000 7fbdeaa00640 1 -- 172.21.15.90:0/2266053323 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbde0061cf0 con 0x7fbdf40ab660 2024-09-21T03:14:56.752 INFO:teuthology.orchestra.run.smithi090.stdout:64424509450 2024-09-21T03:14:56.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.754+0000 7fbdf9800640 1 -- 172.21.15.90:0/2266053323 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbdd4078be0 msgr2=0x7fbdd407b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.754+0000 7fbdf9800640 1 --2- 172.21.15.90:0/2266053323 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbdd4078be0 0x7fbdd407b0f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbdec007fd0 tx=0x7fbdec009040 comp rx=0 tx=0).stop 2024-09-21T03:14:56.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.754+0000 7fbdf9800640 1 -- 172.21.15.90:0/2266053323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdf40ab660 msgr2=0x7fbdf4165480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.754+0000 7fbdf9800640 1 --2- 172.21.15.90:0/2266053323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdf40ab660 0x7fbdf4165480 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbde000c3f0 tx=0x7fbde000c8b0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.754+0000 7fbdf9800640 1 -- 172.21.15.90:0/2266053323 shutdown_connections 2024-09-21T03:14:56.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.754+0000 7fbdf9800640 1 --2- 172.21.15.90:0/2266053323 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbdd4078be0 0x7fbdd407b0f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.754+0000 7fbdf9800640 1 --2- 172.21.15.90:0/2266053323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdf40ab660 0x7fbdf4165480 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.754+0000 7fbdf9800640 1 --2- 172.21.15.90:0/2266053323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdf406f540 0x7fbdf415da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.754+0000 7fbdf9800640 1 --2- 172.21.15.90:0/2266053323 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdf406f0c0 0x7fbdf4206550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.754+0000 7fbdf9800640 1 -- 172.21.15.90:0/2266053323 >> 172.21.15.90:0/2266053323 conn(0x7fbdf40c81b0 msgr2=0x7fbdf415ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:56.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.754+0000 7fbdf9800640 1 -- 172.21.15.90:0/2266053323 shutdown_connections 2024-09-21T03:14:56.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.755+0000 7fbdf9800640 1 -- 172.21.15.90:0/2266053323 wait complete. 2024-09-21T03:14:56.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.757+0000 7f6232200640 1 -- 172.21.15.90:0/4191357867 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f6208005580 con 0x7f622404e610 2024-09-21T03:14:56.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.757+0000 7f52a1e00640 1 -- 172.21.15.90:0/1187963737 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5294178bb0 con 0x7f52940ddfd0 2024-09-21T03:14:56.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.758+0000 7f621f400640 1 -- 172.21.15.90:0/4191357867 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6218063580 con 0x7f622404e610 2024-09-21T03:14:56.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.758+0000 7f5293400640 1 -- 172.21.15.90:0/1187963737 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f529c0df340 con 0x7f52940ddfd0 2024-09-21T03:14:56.760 INFO:teuthology.orchestra.run.smithi090.stdout:60129542153 2024-09-21T03:14:56.760 INFO:teuthology.orchestra.run.smithi090.stdout:64424509450 2024-09-21T03:14:56.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.761+0000 7f3bcfc00640 1 -- 172.21.15.90:0/1516400318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f3bc8070b00 con 0x7f3bc806fd00 2024-09-21T03:14:56.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.761+0000 7f6232200640 1 -- 172.21.15.90:0/4191357867 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f620c078be0 msgr2=0x7f620c07b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.761+0000 7f6232200640 1 --2- 172.21.15.90:0/4191357867 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f620c078be0 0x7f620c07b0f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f622c0756e0 tx=0x7f622c070040 comp rx=0 tx=0).stop 2024-09-21T03:14:56.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.761+0000 7f6232200640 1 -- 172.21.15.90:0/4191357867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f622404e610 msgr2=0x7f62240d6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.761+0000 7f6232200640 1 --2- 172.21.15.90:0/4191357867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f622404e610 0x7f62240d6130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f621800e670 tx=0x7f621800eb30 comp rx=0 tx=0).stop 2024-09-21T03:14:56.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.761+0000 7f6232200640 1 -- 172.21.15.90:0/4191357867 shutdown_connections 2024-09-21T03:14:56.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.761+0000 7f6232200640 1 --2- 172.21.15.90:0/4191357867 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f620c078be0 0x7f620c07b0f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.761+0000 7f6232200640 1 --2- 172.21.15.90:0/4191357867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f622404e610 0x7f62240d6130 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.761+0000 7f6232200640 1 --2- 172.21.15.90:0/4191357867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f622404df40 0x7f6224177d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.761+0000 7f6232200640 1 --2- 172.21.15.90:0/4191357867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6224007110 0x7f6224171e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.761+0000 7f6232200640 1 -- 172.21.15.90:0/4191357867 >> 172.21.15.90:0/4191357867 conn(0x7f62240314b0 msgr2=0x7f62240d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:56.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.761+0000 7f6232200640 1 -- 172.21.15.90:0/4191357867 shutdown_connections 2024-09-21T03:14:56.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.762+0000 7f6232200640 1 -- 172.21.15.90:0/4191357867 wait complete. 2024-09-21T03:14:56.764 INFO:teuthology.orchestra.run.smithi090.stdout:60129542154 2024-09-21T03:14:56.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.762+0000 7f3bc4c00640 1 -- 172.21.15.90:0/1516400318 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3bbc083470 con 0x7f3bc806fd00 2024-09-21T03:14:56.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.762+0000 7f52a1e00640 1 -- 172.21.15.90:0/1187963737 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f527c078c90 msgr2=0x7f527c07b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.762+0000 7f52a1e00640 1 --2- 172.21.15.90:0/1187963737 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f527c078c90 0x7f527c07b1a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f528c009230 tx=0x7f528c004730 comp rx=0 tx=0).stop 2024-09-21T03:14:56.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.762+0000 7f52a1e00640 1 -- 172.21.15.90:0/1187963737 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52940ddfd0 msgr2=0x7f5294030750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.762+0000 7f52a1e00640 1 --2- 172.21.15.90:0/1187963737 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52940ddfd0 0x7f5294030750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f529c066360 tx=0x7f529c075420 comp rx=0 tx=0).stop 2024-09-21T03:14:56.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.762+0000 7f52a1e00640 1 -- 172.21.15.90:0/1187963737 shutdown_connections 2024-09-21T03:14:56.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.762+0000 7f52a1e00640 1 --2- 172.21.15.90:0/1187963737 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f527c078c90 0x7f527c07b1a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.762+0000 7f52a1e00640 1 --2- 172.21.15.90:0/1187963737 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52940ddfd0 0x7f5294030750 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.762+0000 7f52a1e00640 1 --2- 172.21.15.90:0/1187963737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52940d7910 0x7f52940493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.762+0000 7f52a1e00640 1 --2- 172.21.15.90:0/1187963737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5294031f20 0x7f52940489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.762+0000 7f52a1e00640 1 -- 172.21.15.90:0/1187963737 >> 172.21.15.90:0/1187963737 conn(0x7f529404c890 msgr2=0x7f52940d7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:56.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.1 2024-09-21T03:14:56.766 DEBUG:teuthology.parallel:result is None 2024-09-21T03:14:56.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.762+0000 7f52a1e00640 1 -- 172.21.15.90:0/1187963737 shutdown_connections 2024-09-21T03:14:56.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.762+0000 7f52a1e00640 1 -- 172.21.15.90:0/1187963737 wait complete. 2024-09-21T03:14:56.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.765+0000 7f3bcfc00640 1 -- 172.21.15.90:0/1516400318 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3ba8078be0 msgr2=0x7f3ba807b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.765+0000 7f3bcfc00640 1 --2- 172.21.15.90:0/1516400318 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3ba8078be0 0x7f3ba807b0f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4000f60 tx=0x7f3bb40079b0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.765+0000 7f3bcfc00640 1 -- 172.21.15.90:0/1516400318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bc806fd00 msgr2=0x7f3bc8147c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.765+0000 7f3bcfc00640 1 --2- 172.21.15.90:0/1516400318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bc806fd00 0x7f3bc8147c40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc034040 tx=0x7f3bbc003910 comp rx=0 tx=0).stop 2024-09-21T03:14:56.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.765+0000 7f3bcfc00640 1 -- 172.21.15.90:0/1516400318 shutdown_connections 2024-09-21T03:14:56.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.765+0000 7f3bcfc00640 1 --2- 172.21.15.90:0/1516400318 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3ba8078be0 0x7f3ba807b0f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.765+0000 7f3bcfc00640 1 --2- 172.21.15.90:0/1516400318 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3bc8151130 0x7f3bc814eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.765+0000 7f3bcfc00640 1 --2- 172.21.15.90:0/1516400318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bc80c76f0 0x7f3bc80c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.765+0000 7f3bcfc00640 1 --2- 172.21.15.90:0/1516400318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bc806fd00 0x7f3bc8147c40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.765+0000 7f3bcfc00640 1 -- 172.21.15.90:0/1516400318 >> 172.21.15.90:0/1516400318 conn(0x7f3bc80c96d0 msgr2=0x7f3bc8073aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:56.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.766+0000 7f3bcfc00640 1 -- 172.21.15.90:0/1516400318 shutdown_connections 2024-09-21T03:14:56.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.766+0000 7f3bcfc00640 1 -- 172.21.15.90:0/1516400318 wait complete. 2024-09-21T03:14:56.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.773+0000 7f13c5200640 1 -- 172.21.15.90:0/26083967 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f13c00ca2b0 con 0x7f13c00c8c50 2024-09-21T03:14:56.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.773+0000 7f13b7400640 1 -- 172.21.15.90:0/26083967 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f13b00668f0 con 0x7f13c00c8c50 2024-09-21T03:14:56.775 INFO:teuthology.orchestra.run.smithi090.stdout:64424509450 2024-09-21T03:14:56.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.776+0000 7f13c5200640 1 -- 172.21.15.90:0/26083967 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f13a0078b90 msgr2=0x7f13a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.776+0000 7f13c5200640 1 --2- 172.21.15.90:0/26083967 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f13a0078b90 0x7f13a007b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f13ac02afd0 tx=0x7f13ac02c040 comp rx=0 tx=0).stop 2024-09-21T03:14:56.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.776+0000 7f13c5200640 1 -- 172.21.15.90:0/26083967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13c00c8c50 msgr2=0x7f13c015a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:56.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.776+0000 7f13c5200640 1 --2- 172.21.15.90:0/26083967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13c00c8c50 0x7f13c015a6b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f13b000c3e0 tx=0x7f13b000c8a0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.776+0000 7f13c5200640 1 -- 172.21.15.90:0/26083967 shutdown_connections 2024-09-21T03:14:56.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.776+0000 7f13c5200640 1 --2- 172.21.15.90:0/26083967 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f13a0078b90 0x7f13a007b0a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.776+0000 7f13c5200640 1 --2- 172.21.15.90:0/26083967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13c00c9060 0x7f13c0159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.776+0000 7f13c5200640 1 --2- 172.21.15.90:0/26083967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13c00c8c50 0x7f13c015a6b0 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f13b000c3e0 tx=0x7f13b000c8a0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.776+0000 7f13c5200640 1 --2- 172.21.15.90:0/26083967 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13c00c7120 0x7f13c0156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:56.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.776+0000 7f13c5200640 1 -- 172.21.15.90:0/26083967 >> 172.21.15.90:0/26083967 conn(0x7f13c00cc270 msgr2=0x7f13c00cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:56.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.776+0000 7f13c5200640 1 -- 172.21.15.90:0/26083967 shutdown_connections 2024-09-21T03:14:56.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:56.776+0000 7f13c5200640 1 -- 172.21.15.90:0/26083967 wait complete. 2024-09-21T03:14:56.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.2 2024-09-21T03:14:56.784 DEBUG:teuthology.parallel:result is None 2024-09-21T03:14:56.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.7 2024-09-21T03:14:56.793 DEBUG:teuthology.parallel:result is None 2024-09-21T03:14:56.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.3 2024-09-21T03:14:56.802 DEBUG:teuthology.parallel:result is None 2024-09-21T03:14:56.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.5 2024-09-21T03:14:56.803 DEBUG:teuthology.parallel:result is None 2024-09-21T03:14:56.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.6 2024-09-21T03:14:56.803 DEBUG:teuthology.parallel:result is None 2024-09-21T03:14:56.803 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T03:14:56.803 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:14:57.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.060+0000 7f0b30a00640 1 -- 172.21.15.90:0/662480642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b2c14b260 msgr2=0x7f0b2c0c50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:57.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.060+0000 7f0b30a00640 1 --2- 172.21.15.90:0/662480642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b2c14b260 0x7f0b2c0c50a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c071980 tx=0x7f0b1402a540 comp rx=0 tx=0).stop 2024-09-21T03:14:57.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.061+0000 7f0b30a00640 1 -- 172.21.15.90:0/662480642 shutdown_connections 2024-09-21T03:14:57.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.061+0000 7f0b30a00640 1 --2- 172.21.15.90:0/662480642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b2c14b260 0x7f0b2c0c50a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:57.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.061+0000 7f0b30a00640 1 --2- 172.21.15.90:0/662480642 >> v2:172.21.15.149:3300/0 conn(0x7f0b2c0ab1c0 0x7f0b2c155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:57.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.061+0000 7f0b30a00640 1 -- 172.21.15.90:0/662480642 >> 172.21.15.90:0/662480642 conn(0x7f0b2c0c84c0 msgr2=0x7f0b2c0c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:57.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.061+0000 7f0b30a00640 1 -- 172.21.15.90:0/662480642 shutdown_connections 2024-09-21T03:14:57.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.061+0000 7f0b30a00640 1 -- 172.21.15.90:0/662480642 wait complete. 2024-09-21T03:14:57.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.063+0000 7f0b30a00640 1 Processor -- start 2024-09-21T03:14:57.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.063+0000 7f0b30a00640 1 -- start start 2024-09-21T03:14:57.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.064+0000 7f0b30a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b2c0ab1c0 0x7f0b2c0c1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:57.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.064+0000 7f0b30a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b2c0c55e0 0x7f0b2c153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:57.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.064+0000 7f0b30a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b2c14b260 0x7f0b2c1529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:57.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.064+0000 7f0b30a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c14b670 con 0x7f0b2c0ab1c0 2024-09-21T03:14:57.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.064+0000 7f0b30a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c0c4740 con 0x7f0b2c0c55e0 2024-09-21T03:14:57.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.064+0000 7f0b30a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0b2c14b7f0 con 0x7f0b2c14b260 2024-09-21T03:14:57.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.065+0000 7f0b2a800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b2c0ab1c0 0x7f0b2c0c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:57.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.065+0000 7f0b2a800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b2c0ab1c0 0x7f0b2c0c1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33520/0 (socket says 172.21.15.90:33520) 2024-09-21T03:14:57.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.065+0000 7f0b2a800640 1 -- 172.21.15.90:0/2985709313 learned_addr learned my addr 172.21.15.90:0/2985709313 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:57.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.065+0000 7f0b21e00640 1 --2- 172.21.15.90:0/2985709313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b2c0c55e0 0x7f0b2c153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:57.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.065+0000 7f0b2b200640 1 --2- 172.21.15.90:0/2985709313 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b2c14b260 0x7f0b2c1529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:57.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.065+0000 7f0b2a800640 1 -- 172.21.15.90:0/2985709313 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b2c14b260 msgr2=0x7f0b2c1529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:57.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.065+0000 7f0b2a800640 1 --2- 172.21.15.90:0/2985709313 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b2c14b260 0x7f0b2c1529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:57.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.065+0000 7f0b2a800640 1 -- 172.21.15.90:0/2985709313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b2c0c55e0 msgr2=0x7f0b2c153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:57.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.065+0000 7f0b2a800640 1 --2- 172.21.15.90:0/2985709313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b2c0c55e0 0x7f0b2c153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:57.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.065+0000 7f0b2a800640 1 -- 172.21.15.90:0/2985709313 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2c0c6f00 con 0x7f0b2c0ab1c0 2024-09-21T03:14:57.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.065+0000 7f0b2b200640 1 --2- 172.21.15.90:0/2985709313 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b2c14b260 0x7f0b2c1529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:14:57.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.065+0000 7f0b2a800640 1 --2- 172.21.15.90:0/2985709313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b2c0ab1c0 0x7f0b2c0c1770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c009fd0 tx=0x7f0b1c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:57.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.065+0000 7f0b23400640 1 -- 172.21.15.90:0/2985709313 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00ccc0 con 0x7f0b2c0ab1c0 2024-09-21T03:14:57.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.066+0000 7f0b23400640 1 -- 172.21.15.90:0/2985709313 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b1c00ee70 con 0x7f0b2c0ab1c0 2024-09-21T03:14:57.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.066+0000 7f0b23400640 1 -- 172.21.15.90:0/2985709313 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00ce60 con 0x7f0b2c0ab1c0 2024-09-21T03:14:57.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.066+0000 7f0b30a00640 1 -- 172.21.15.90:0/2985709313 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b2c0c7420 con 0x7f0b2c0ab1c0 2024-09-21T03:14:57.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.066+0000 7f0b30a00640 1 -- 172.21.15.90:0/2985709313 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b2c0c6110 con 0x7f0b2c0ab1c0 2024-09-21T03:14:57.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.067+0000 7f0b30a00640 1 -- 172.21.15.90:0/2985709313 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b2c073f50 con 0x7f0b2c0ab1c0 2024-09-21T03:14:57.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.068+0000 7f0b23400640 1 -- 172.21.15.90:0/2985709313 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0b1c004280 con 0x7f0b2c0ab1c0 2024-09-21T03:14:57.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.069+0000 7f0b23400640 1 --2- 172.21.15.90:0/2985709313 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0b08078b90 0x7f0b0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:57.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.069+0000 7f0b23400640 1 -- 172.21.15.90:0/2985709313 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f0b1c09bb50 con 0x7f0b2c0ab1c0 2024-09-21T03:14:57.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.069+0000 7f0b21e00640 1 --2- 172.21.15.90:0/2985709313 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0b08078b90 0x7f0b0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:57.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.070+0000 7f0b21e00640 1 --2- 172.21.15.90:0/2985709313 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0b08078b90 0x7f0b0807b0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0b14034000 tx=0x7f0b14004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:57.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.073+0000 7f0b23400640 1 -- 172.21.15.90:0/2985709313 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0b1c063bc0 con 0x7f0b2c0ab1c0 2024-09-21T03:14:57.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.259+0000 7f0b30a00640 1 -- 172.21.15.90:0/2985709313 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0b2c06da90 con 0x7f0b08078b90 2024-09-21T03:14:57.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.268+0000 7f0b23400640 1 -- 172.21.15.90:0/2985709313 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490296 (secure 0 0 0) 0x7f0b2c06da90 con 0x7f0b08078b90 2024-09-21T03:14:57.275 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:57.278 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-21T03:14:57.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.274+0000 7f0b30a00640 1 -- 172.21.15.90:0/2985709313 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0b08078b90 msgr2=0x7f0b0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:57.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.274+0000 7f0b30a00640 1 --2- 172.21.15.90:0/2985709313 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0b08078b90 0x7f0b0807b0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0b14034000 tx=0x7f0b14004730 comp rx=0 tx=0).stop 2024-09-21T03:14:57.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.275+0000 7f0b30a00640 1 -- 172.21.15.90:0/2985709313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b2c0ab1c0 msgr2=0x7f0b2c0c1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:57.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.275+0000 7f0b30a00640 1 --2- 172.21.15.90:0/2985709313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b2c0ab1c0 0x7f0b2c0c1770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c009fd0 tx=0x7f0b1c00ec20 comp rx=0 tx=0).stop 2024-09-21T03:14:57.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.275+0000 7f0b30a00640 1 -- 172.21.15.90:0/2985709313 shutdown_connections 2024-09-21T03:14:57.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.275+0000 7f0b30a00640 1 --2- 172.21.15.90:0/2985709313 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0b08078b90 0x7f0b0807b0a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:57.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.275+0000 7f0b30a00640 1 --2- 172.21.15.90:0/2985709313 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b2c14b260 0x7f0b2c1529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:57.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.275+0000 7f0b30a00640 1 --2- 172.21.15.90:0/2985709313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b2c0c55e0 0x7f0b2c153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:57.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.275+0000 7f0b30a00640 1 --2- 172.21.15.90:0/2985709313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b2c0ab1c0 0x7f0b2c0c1770 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:57.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.275+0000 7f0b30a00640 1 -- 172.21.15.90:0/2985709313 >> 172.21.15.90:0/2985709313 conn(0x7f0b2c0c84c0 msgr2=0x7f0b2c0acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:57.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.275+0000 7f0b30a00640 1 -- 172.21.15.90:0/2985709313 shutdown_connections 2024-09-21T03:14:57.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.275+0000 7f0b30a00640 1 -- 172.21.15.90:0/2985709313 wait complete. 2024-09-21T03:14:57.298 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-21T03:14:56.478084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":191,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219552,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755168,"statfs":{"total":773094113280,"available":772869292032,"internally_reserved":0,"allocated":3383296,"data_stored":1994552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.944534"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.576924+0000","last_change":"2024-09-21T03:14:47.552762+0000","last_active":"2024-09-21T03:14:48.576924+0000","last_peered":"2024-09-21T03:14:48.576924+0000","last_clean":"2024-09-21T03:14:48.576924+0000","last_became_active":"2024-09-21T03:14:47.551883+0000","last_became_peered":"2024-09-21T03:14:47.551883+0000","last_unstale":"2024-09-21T03:14:48.576924+0000","last_undegraded":"2024-09-21T03:14:48.576924+0000","last_fullsized":"2024-09-21T03:14:48.576924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:51.935797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578270+0000","last_change":"2024-09-21T03:14:37.471004+0000","last_active":"2024-09-21T03:14:48.578270+0000","last_peered":"2024-09-21T03:14:48.578270+0000","last_clean":"2024-09-21T03:14:48.578270+0000","last_became_active":"2024-09-21T03:14:37.470563+0000","last_became_peered":"2024-09-21T03:14:37.470563+0000","last_unstale":"2024-09-21T03:14:48.578270+0000","last_undegraded":"2024-09-21T03:14:48.578270+0000","last_fullsized":"2024-09-21T03:14:48.578270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.422826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558700+0000","last_change":"2024-09-21T03:14:38.496252+0000","last_active":"2024-09-21T03:14:48.558700+0000","last_peered":"2024-09-21T03:14:48.558700+0000","last_clean":"2024-09-21T03:14:48.558700+0000","last_became_active":"2024-09-21T03:14:38.488292+0000","last_became_peered":"2024-09-21T03:14:38.488292+0000","last_unstale":"2024-09-21T03:14:48.558700+0000","last_undegraded":"2024-09-21T03:14:48.558700+0000","last_fullsized":"2024-09-21T03:14:48.558700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:57.409792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566258+0000","last_change":"2024-09-21T03:14:46.549877+0000","last_active":"2024-09-21T03:14:48.566258+0000","last_peered":"2024-09-21T03:14:48.566258+0000","last_clean":"2024-09-21T03:14:48.566258+0000","last_became_active":"2024-09-21T03:14:46.549536+0000","last_became_peered":"2024-09-21T03:14:46.549536+0000","last_unstale":"2024-09-21T03:14:48.566258+0000","last_undegraded":"2024-09-21T03:14:48.566258+0000","last_fullsized":"2024-09-21T03:14:48.566258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:57.491042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577064+0000","last_change":"2024-09-21T03:14:47.560303+0000","last_active":"2024-09-21T03:14:48.577064+0000","last_peered":"2024-09-21T03:14:48.577064+0000","last_clean":"2024-09-21T03:14:48.577064+0000","last_became_active":"2024-09-21T03:14:47.559659+0000","last_became_peered":"2024-09-21T03:14:47.559659+0000","last_unstale":"2024-09-21T03:14:48.577064+0000","last_undegraded":"2024-09-21T03:14:48.577064+0000","last_fullsized":"2024-09-21T03:14:48.577064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:49.328036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558972+0000","last_change":"2024-09-21T03:14:37.467448+0000","last_active":"2024-09-21T03:14:48.558972+0000","last_peered":"2024-09-21T03:14:48.558972+0000","last_clean":"2024-09-21T03:14:48.558972+0000","last_became_active":"2024-09-21T03:14:37.467146+0000","last_became_peered":"2024-09-21T03:14:37.467146+0000","last_unstale":"2024-09-21T03:14:48.558972+0000","last_undegraded":"2024-09-21T03:14:48.558972+0000","last_fullsized":"2024-09-21T03:14:48.558972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:53.475083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558357+0000","last_change":"2024-09-21T03:14:38.486401+0000","last_active":"2024-09-21T03:14:48.558357+0000","last_peered":"2024-09-21T03:14:48.558357+0000","last_clean":"2024-09-21T03:14:48.558357+0000","last_became_active":"2024-09-21T03:14:38.486090+0000","last_became_peered":"2024-09-21T03:14:38.486090+0000","last_unstale":"2024-09-21T03:14:48.558357+0000","last_undegraded":"2024-09-21T03:14:48.558357+0000","last_fullsized":"2024-09-21T03:14:48.558357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:44.085100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556977+0000","last_change":"2024-09-21T03:14:46.541705+0000","last_active":"2024-09-21T03:14:48.556977+0000","last_peered":"2024-09-21T03:14:48.556977+0000","last_clean":"2024-09-21T03:14:48.556977+0000","last_became_active":"2024-09-21T03:14:46.541357+0000","last_became_peered":"2024-09-21T03:14:46.541357+0000","last_unstale":"2024-09-21T03:14:48.556977+0000","last_undegraded":"2024-09-21T03:14:48.556977+0000","last_fullsized":"2024-09-21T03:14:48.556977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:31.082059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577964+0000","last_change":"2024-09-21T03:14:47.556183+0000","last_active":"2024-09-21T03:14:48.577964+0000","last_peered":"2024-09-21T03:14:48.577964+0000","last_clean":"2024-09-21T03:14:48.577964+0000","last_became_active":"2024-09-21T03:14:47.553312+0000","last_became_peered":"2024-09-21T03:14:47.553312+0000","last_unstale":"2024-09-21T03:14:48.577964+0000","last_undegraded":"2024-09-21T03:14:48.577964+0000","last_fullsized":"2024-09-21T03:14:48.577964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:07.314491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579685+0000","last_change":"2024-09-21T03:14:37.478711+0000","last_active":"2024-09-21T03:14:48.579685+0000","last_peered":"2024-09-21T03:14:48.579685+0000","last_clean":"2024-09-21T03:14:48.579685+0000","last_became_active":"2024-09-21T03:14:37.477910+0000","last_became_peered":"2024-09-21T03:14:37.477910+0000","last_unstale":"2024-09-21T03:14:48.579685+0000","last_undegraded":"2024-09-21T03:14:48.579685+0000","last_fullsized":"2024-09-21T03:14:48.579685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:40.166966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578888+0000","last_change":"2024-09-21T03:14:38.472992+0000","last_active":"2024-09-21T03:14:48.578888+0000","last_peered":"2024-09-21T03:14:48.578888+0000","last_clean":"2024-09-21T03:14:48.578888+0000","last_became_active":"2024-09-21T03:14:38.472426+0000","last_became_peered":"2024-09-21T03:14:38.472426+0000","last_unstale":"2024-09-21T03:14:48.578888+0000","last_undegraded":"2024-09-21T03:14:48.578888+0000","last_fullsized":"2024-09-21T03:14:48.578888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:36.825612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556418+0000","last_change":"2024-09-21T03:14:46.526996+0000","last_active":"2024-09-21T03:14:48.556418+0000","last_peered":"2024-09-21T03:14:48.556418+0000","last_clean":"2024-09-21T03:14:48.556418+0000","last_became_active":"2024-09-21T03:14:46.525587+0000","last_became_peered":"2024-09-21T03:14:46.525587+0000","last_unstale":"2024-09-21T03:14:48.556418+0000","last_undegraded":"2024-09-21T03:14:48.556418+0000","last_fullsized":"2024-09-21T03:14:48.556418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:56.977126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556369+0000","last_change":"2024-09-21T03:14:47.554143+0000","last_active":"2024-09-21T03:14:48.556369+0000","last_peered":"2024-09-21T03:14:48.556369+0000","last_clean":"2024-09-21T03:14:48.556369+0000","last_became_active":"2024-09-21T03:14:47.553802+0000","last_became_peered":"2024-09-21T03:14:47.553802+0000","last_unstale":"2024-09-21T03:14:48.556369+0000","last_undegraded":"2024-09-21T03:14:48.556369+0000","last_fullsized":"2024-09-21T03:14:48.556369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:37.963442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578752+0000","last_change":"2024-09-21T03:14:37.479842+0000","last_active":"2024-09-21T03:14:48.578752+0000","last_peered":"2024-09-21T03:14:48.578752+0000","last_clean":"2024-09-21T03:14:48.578752+0000","last_became_active":"2024-09-21T03:14:37.478893+0000","last_became_peered":"2024-09-21T03:14:37.478893+0000","last_unstale":"2024-09-21T03:14:48.578752+0000","last_undegraded":"2024-09-21T03:14:48.578752+0000","last_fullsized":"2024-09-21T03:14:48.578752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:27.916133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581255+0000","last_change":"2024-09-21T03:14:38.468756+0000","last_active":"2024-09-21T03:14:48.581255+0000","last_peered":"2024-09-21T03:14:48.581255+0000","last_clean":"2024-09-21T03:14:48.581255+0000","last_became_active":"2024-09-21T03:14:38.467570+0000","last_became_peered":"2024-09-21T03:14:38.467570+0000","last_unstale":"2024-09-21T03:14:48.581255+0000","last_undegraded":"2024-09-21T03:14:48.581255+0000","last_fullsized":"2024-09-21T03:14:48.581255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:24.784157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556546+0000","last_change":"2024-09-21T03:14:46.529932+0000","last_active":"2024-09-21T03:14:48.556546+0000","last_peered":"2024-09-21T03:14:48.556546+0000","last_clean":"2024-09-21T03:14:48.556546+0000","last_became_active":"2024-09-21T03:14:46.529629+0000","last_became_peered":"2024-09-21T03:14:46.529629+0000","last_unstale":"2024-09-21T03:14:48.556546+0000","last_undegraded":"2024-09-21T03:14:48.556546+0000","last_fullsized":"2024-09-21T03:14:48.556546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:39.808494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558854+0000","last_change":"2024-09-21T03:14:47.547724+0000","last_active":"2024-09-21T03:14:48.558854+0000","last_peered":"2024-09-21T03:14:48.558854+0000","last_clean":"2024-09-21T03:14:48.558854+0000","last_became_active":"2024-09-21T03:14:47.546770+0000","last_became_peered":"2024-09-21T03:14:47.546770+0000","last_unstale":"2024-09-21T03:14:48.558854+0000","last_undegraded":"2024-09-21T03:14:48.558854+0000","last_fullsized":"2024-09-21T03:14:48.558854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:31.476710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580313+0000","last_change":"2024-09-21T03:14:38.476747+0000","last_active":"2024-09-21T03:14:48.580313+0000","last_peered":"2024-09-21T03:14:48.580313+0000","last_clean":"2024-09-21T03:14:48.580313+0000","last_became_active":"2024-09-21T03:14:38.476386+0000","last_became_peered":"2024-09-21T03:14:38.476386+0000","last_unstale":"2024-09-21T03:14:48.580313+0000","last_undegraded":"2024-09-21T03:14:48.580313+0000","last_fullsized":"2024-09-21T03:14:48.580313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:28.751991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580177+0000","last_change":"2024-09-21T03:14:37.463164+0000","last_active":"2024-09-21T03:14:48.580177+0000","last_peered":"2024-09-21T03:14:48.580177+0000","last_clean":"2024-09-21T03:14:48.580177+0000","last_became_active":"2024-09-21T03:14:37.461409+0000","last_became_peered":"2024-09-21T03:14:37.461409+0000","last_unstale":"2024-09-21T03:14:48.580177+0000","last_undegraded":"2024-09-21T03:14:48.580177+0000","last_fullsized":"2024-09-21T03:14:48.580177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:51.126291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581202+0000","last_change":"2024-09-21T03:14:46.538480+0000","last_active":"2024-09-21T03:14:48.581202+0000","last_peered":"2024-09-21T03:14:48.581202+0000","last_clean":"2024-09-21T03:14:48.581202+0000","last_became_active":"2024-09-21T03:14:46.537493+0000","last_became_peered":"2024-09-21T03:14:46.537493+0000","last_unstale":"2024-09-21T03:14:48.581202+0000","last_undegraded":"2024-09-21T03:14:48.581202+0000","last_fullsized":"2024-09-21T03:14:48.581202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:52.769190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566771+0000","last_change":"2024-09-21T03:14:47.580512+0000","last_active":"2024-09-21T03:14:48.566771+0000","last_peered":"2024-09-21T03:14:48.566771+0000","last_clean":"2024-09-21T03:14:48.566771+0000","last_became_active":"2024-09-21T03:14:47.580210+0000","last_became_peered":"2024-09-21T03:14:47.580210+0000","last_unstale":"2024-09-21T03:14:48.566771+0000","last_undegraded":"2024-09-21T03:14:48.566771+0000","last_fullsized":"2024-09-21T03:14:48.566771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:20.192190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566435+0000","last_change":"2024-09-21T03:14:38.494021+0000","last_active":"2024-09-21T03:14:48.566435+0000","last_peered":"2024-09-21T03:14:48.566435+0000","last_clean":"2024-09-21T03:14:48.566435+0000","last_became_active":"2024-09-21T03:14:38.486802+0000","last_became_peered":"2024-09-21T03:14:38.486802+0000","last_unstale":"2024-09-21T03:14:48.566435+0000","last_undegraded":"2024-09-21T03:14:48.566435+0000","last_fullsized":"2024-09-21T03:14:48.566435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:31.817505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558034+0000","last_change":"2024-09-21T03:14:37.465907+0000","last_active":"2024-09-21T03:14:48.558034+0000","last_peered":"2024-09-21T03:14:48.558034+0000","last_clean":"2024-09-21T03:14:48.558034+0000","last_became_active":"2024-09-21T03:14:37.465551+0000","last_became_peered":"2024-09-21T03:14:37.465551+0000","last_unstale":"2024-09-21T03:14:48.558034+0000","last_undegraded":"2024-09-21T03:14:48.558034+0000","last_fullsized":"2024-09-21T03:14:48.558034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:10.599687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578561+0000","last_change":"2024-09-21T03:14:46.546737+0000","last_active":"2024-09-21T03:14:48.578561+0000","last_peered":"2024-09-21T03:14:48.578561+0000","last_clean":"2024-09-21T03:14:48.578561+0000","last_became_active":"2024-09-21T03:14:46.546312+0000","last_became_peered":"2024-09-21T03:14:46.546312+0000","last_unstale":"2024-09-21T03:14:48.578561+0000","last_undegraded":"2024-09-21T03:14:48.578561+0000","last_fullsized":"2024-09-21T03:14:48.578561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:03.939168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580853+0000","last_change":"2024-09-21T03:14:47.558742+0000","last_active":"2024-09-21T03:14:48.580853+0000","last_peered":"2024-09-21T03:14:48.580853+0000","last_clean":"2024-09-21T03:14:48.580853+0000","last_became_active":"2024-09-21T03:14:47.558431+0000","last_became_peered":"2024-09-21T03:14:47.558431+0000","last_unstale":"2024-09-21T03:14:48.580853+0000","last_undegraded":"2024-09-21T03:14:48.580853+0000","last_fullsized":"2024-09-21T03:14:48.580853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:32.053674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.576948+0000","last_change":"2024-09-21T03:14:38.479370+0000","last_active":"2024-09-21T03:14:48.576948+0000","last_peered":"2024-09-21T03:14:48.576948+0000","last_clean":"2024-09-21T03:14:48.576948+0000","last_became_active":"2024-09-21T03:14:38.476976+0000","last_became_peered":"2024-09-21T03:14:38.476976+0000","last_unstale":"2024-09-21T03:14:48.576948+0000","last_undegraded":"2024-09-21T03:14:48.576948+0000","last_fullsized":"2024-09-21T03:14:48.576948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:14.695819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577301+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:14:48.577301+0000","last_peered":"2024-09-21T03:14:48.577301+0000","last_clean":"2024-09-21T03:14:48.577301+0000","last_became_active":"2024-09-21T03:14:37.478840+0000","last_became_peered":"2024-09-21T03:14:37.478840+0000","last_unstale":"2024-09-21T03:14:48.577301+0000","last_undegraded":"2024-09-21T03:14:48.577301+0000","last_fullsized":"2024-09-21T03:14:48.577301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:00.964354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566781+0000","last_change":"2024-09-21T03:14:46.543085+0000","last_active":"2024-09-21T03:14:48.566781+0000","last_peered":"2024-09-21T03:14:48.566781+0000","last_clean":"2024-09-21T03:14:48.566781+0000","last_became_active":"2024-09-21T03:14:46.542721+0000","last_became_peered":"2024-09-21T03:14:46.542721+0000","last_unstale":"2024-09-21T03:14:48.566781+0000","last_undegraded":"2024-09-21T03:14:48.566781+0000","last_fullsized":"2024-09-21T03:14:48.566781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:05.590871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579821+0000","last_change":"2024-09-21T03:14:47.566806+0000","last_active":"2024-09-21T03:14:48.579821+0000","last_peered":"2024-09-21T03:14:48.579821+0000","last_clean":"2024-09-21T03:14:48.579821+0000","last_became_active":"2024-09-21T03:14:47.566634+0000","last_became_peered":"2024-09-21T03:14:47.566634+0000","last_unstale":"2024-09-21T03:14:48.579821+0000","last_undegraded":"2024-09-21T03:14:48.579821+0000","last_fullsized":"2024-09-21T03:14:48.579821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:03.997294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579153+0000","last_change":"2024-09-21T03:14:38.482658+0000","last_active":"2024-09-21T03:14:48.579153+0000","last_peered":"2024-09-21T03:14:48.579153+0000","last_clean":"2024-09-21T03:14:48.579153+0000","last_became_active":"2024-09-21T03:14:38.482369+0000","last_became_peered":"2024-09-21T03:14:38.482369+0000","last_unstale":"2024-09-21T03:14:48.579153+0000","last_undegraded":"2024-09-21T03:14:48.579153+0000","last_fullsized":"2024-09-21T03:14:48.579153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:36.682534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577485+0000","last_change":"2024-09-21T03:14:37.472962+0000","last_active":"2024-09-21T03:14:48.577485+0000","last_peered":"2024-09-21T03:14:48.577485+0000","last_clean":"2024-09-21T03:14:48.577485+0000","last_became_active":"2024-09-21T03:14:37.472271+0000","last_became_peered":"2024-09-21T03:14:37.472271+0000","last_unstale":"2024-09-21T03:14:48.577485+0000","last_undegraded":"2024-09-21T03:14:48.577485+0000","last_fullsized":"2024-09-21T03:14:48.577485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:54.952223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557189+0000","last_change":"2024-09-21T03:14:46.537137+0000","last_active":"2024-09-21T03:14:48.557189+0000","last_peered":"2024-09-21T03:14:48.557189+0000","last_clean":"2024-09-21T03:14:48.557189+0000","last_became_active":"2024-09-21T03:14:46.536791+0000","last_became_peered":"2024-09-21T03:14:46.536791+0000","last_unstale":"2024-09-21T03:14:48.557189+0000","last_undegraded":"2024-09-21T03:14:48.557189+0000","last_fullsized":"2024-09-21T03:14:48.557189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:43.186807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577598+0000","last_change":"2024-09-21T03:14:47.555605+0000","last_active":"2024-09-21T03:14:48.577598+0000","last_peered":"2024-09-21T03:14:48.577598+0000","last_clean":"2024-09-21T03:14:48.577598+0000","last_became_active":"2024-09-21T03:14:47.555329+0000","last_became_peered":"2024-09-21T03:14:47.555329+0000","last_unstale":"2024-09-21T03:14:48.577598+0000","last_undegraded":"2024-09-21T03:14:48.577598+0000","last_fullsized":"2024-09-21T03:14:48.577598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:24.271656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577873+0000","last_change":"2024-09-21T03:14:38.479133+0000","last_active":"2024-09-21T03:14:48.577873+0000","last_peered":"2024-09-21T03:14:48.577873+0000","last_clean":"2024-09-21T03:14:48.577873+0000","last_became_active":"2024-09-21T03:14:38.478077+0000","last_became_peered":"2024-09-21T03:14:38.478077+0000","last_unstale":"2024-09-21T03:14:48.577873+0000","last_undegraded":"2024-09-21T03:14:48.577873+0000","last_fullsized":"2024-09-21T03:14:48.577873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:56.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581077+0000","last_change":"2024-09-21T03:14:37.480508+0000","last_active":"2024-09-21T03:14:48.581077+0000","last_peered":"2024-09-21T03:14:48.581077+0000","last_clean":"2024-09-21T03:14:48.581077+0000","last_became_active":"2024-09-21T03:14:37.480218+0000","last_became_peered":"2024-09-21T03:14:37.480218+0000","last_unstale":"2024-09-21T03:14:48.581077+0000","last_undegraded":"2024-09-21T03:14:48.581077+0000","last_fullsized":"2024-09-21T03:14:48.581077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:01.851380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556442+0000","last_change":"2024-09-21T03:14:46.531615+0000","last_active":"2024-09-21T03:14:48.556442+0000","last_peered":"2024-09-21T03:14:48.556442+0000","last_clean":"2024-09-21T03:14:48.556442+0000","last_became_active":"2024-09-21T03:14:46.531289+0000","last_became_peered":"2024-09-21T03:14:46.531289+0000","last_unstale":"2024-09-21T03:14:48.556442+0000","last_undegraded":"2024-09-21T03:14:48.556442+0000","last_fullsized":"2024-09-21T03:14:48.556442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:10.145489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579006+0000","last_change":"2024-09-21T03:14:47.552705+0000","last_active":"2024-09-21T03:14:48.579006+0000","last_peered":"2024-09-21T03:14:48.579006+0000","last_clean":"2024-09-21T03:14:48.579006+0000","last_became_active":"2024-09-21T03:14:47.552367+0000","last_became_peered":"2024-09-21T03:14:47.552367+0000","last_unstale":"2024-09-21T03:14:48.579006+0000","last_undegraded":"2024-09-21T03:14:48.579006+0000","last_fullsized":"2024-09-21T03:14:48.579006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:45.379581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577998+0000","last_change":"2024-09-21T03:14:38.475318+0000","last_active":"2024-09-21T03:14:48.577998+0000","last_peered":"2024-09-21T03:14:48.577998+0000","last_clean":"2024-09-21T03:14:48.577998+0000","last_became_active":"2024-09-21T03:14:38.474978+0000","last_became_peered":"2024-09-21T03:14:38.474978+0000","last_unstale":"2024-09-21T03:14:48.577998+0000","last_undegraded":"2024-09-21T03:14:48.577998+0000","last_fullsized":"2024-09-21T03:14:48.577998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:38.209624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578286+0000","last_change":"2024-09-21T03:14:37.479651+0000","last_active":"2024-09-21T03:14:48.578286+0000","last_peered":"2024-09-21T03:14:48.578286+0000","last_clean":"2024-09-21T03:14:48.578286+0000","last_became_active":"2024-09-21T03:14:37.478833+0000","last_became_peered":"2024-09-21T03:14:37.478833+0000","last_unstale":"2024-09-21T03:14:48.578286+0000","last_undegraded":"2024-09-21T03:14:48.578286+0000","last_fullsized":"2024-09-21T03:14:48.578286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:48.578637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.576901+0000","last_change":"2024-09-21T03:14:46.536054+0000","last_active":"2024-09-21T03:14:48.576901+0000","last_peered":"2024-09-21T03:14:48.576901+0000","last_clean":"2024-09-21T03:14:48.576901+0000","last_became_active":"2024-09-21T03:14:46.535569+0000","last_became_peered":"2024-09-21T03:14:46.535569+0000","last_unstale":"2024-09-21T03:14:48.576901+0000","last_undegraded":"2024-09-21T03:14:48.576901+0000","last_fullsized":"2024-09-21T03:14:48.576901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:04.556059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577758+0000","last_change":"2024-09-21T03:14:47.571889+0000","last_active":"2024-09-21T03:14:48.577758+0000","last_peered":"2024-09-21T03:14:48.577758+0000","last_clean":"2024-09-21T03:14:48.577758+0000","last_became_active":"2024-09-21T03:14:47.571620+0000","last_became_peered":"2024-09-21T03:14:47.571620+0000","last_unstale":"2024-09-21T03:14:48.577758+0000","last_undegraded":"2024-09-21T03:14:48.577758+0000","last_fullsized":"2024-09-21T03:14:48.577758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:23.103973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558656+0000","last_change":"2024-09-21T03:14:38.493350+0000","last_active":"2024-09-21T03:14:48.558656+0000","last_peered":"2024-09-21T03:14:48.558656+0000","last_clean":"2024-09-21T03:14:48.558656+0000","last_became_active":"2024-09-21T03:14:38.492830+0000","last_became_peered":"2024-09-21T03:14:38.492830+0000","last_unstale":"2024-09-21T03:14:48.558656+0000","last_undegraded":"2024-09-21T03:14:48.558656+0000","last_fullsized":"2024-09-21T03:14:48.558656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:19.946319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581436+0000","last_change":"2024-09-21T03:14:37.473484+0000","last_active":"2024-09-21T03:14:48.581436+0000","last_peered":"2024-09-21T03:14:48.581436+0000","last_clean":"2024-09-21T03:14:48.581436+0000","last_became_active":"2024-09-21T03:14:37.473218+0000","last_became_peered":"2024-09-21T03:14:37.473218+0000","last_unstale":"2024-09-21T03:14:48.581436+0000","last_undegraded":"2024-09-21T03:14:48.581436+0000","last_fullsized":"2024-09-21T03:14:48.581436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:49.006579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558777+0000","last_change":"2024-09-21T03:14:46.548858+0000","last_active":"2024-09-21T03:14:48.558777+0000","last_peered":"2024-09-21T03:14:48.558777+0000","last_clean":"2024-09-21T03:14:48.558777+0000","last_became_active":"2024-09-21T03:14:46.548166+0000","last_became_peered":"2024-09-21T03:14:46.548166+0000","last_unstale":"2024-09-21T03:14:48.558777+0000","last_undegraded":"2024-09-21T03:14:48.558777+0000","last_fullsized":"2024-09-21T03:14:48.558777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:41.470072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577431+0000","last_change":"2024-09-21T03:14:47.555787+0000","last_active":"2024-09-21T03:14:48.577431+0000","last_peered":"2024-09-21T03:14:48.577431+0000","last_clean":"2024-09-21T03:14:48.577431+0000","last_became_active":"2024-09-21T03:14:47.555420+0000","last_became_peered":"2024-09-21T03:14:47.555420+0000","last_unstale":"2024-09-21T03:14:48.577431+0000","last_undegraded":"2024-09-21T03:14:48.577431+0000","last_fullsized":"2024-09-21T03:14:48.577431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:45.769786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556963+0000","last_change":"2024-09-21T03:14:38.479657+0000","last_active":"2024-09-21T03:14:48.556963+0000","last_peered":"2024-09-21T03:14:48.556963+0000","last_clean":"2024-09-21T03:14:48.556963+0000","last_became_active":"2024-09-21T03:14:38.479439+0000","last_became_peered":"2024-09-21T03:14:38.479439+0000","last_unstale":"2024-09-21T03:14:48.556963+0000","last_undegraded":"2024-09-21T03:14:48.556963+0000","last_fullsized":"2024-09-21T03:14:48.556963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.107215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.559008+0000","last_change":"2024-09-21T03:14:37.469799+0000","last_active":"2024-09-21T03:14:48.559008+0000","last_peered":"2024-09-21T03:14:48.559008+0000","last_clean":"2024-09-21T03:14:48.559008+0000","last_became_active":"2024-09-21T03:14:37.469495+0000","last_became_peered":"2024-09-21T03:14:37.469495+0000","last_unstale":"2024-09-21T03:14:48.559008+0000","last_undegraded":"2024-09-21T03:14:48.559008+0000","last_fullsized":"2024-09-21T03:14:48.559008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:50.247050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557375+0000","last_change":"2024-09-21T03:14:46.544320+0000","last_active":"2024-09-21T03:14:48.557375+0000","last_peered":"2024-09-21T03:14:48.557375+0000","last_clean":"2024-09-21T03:14:48.557375+0000","last_became_active":"2024-09-21T03:14:46.544038+0000","last_became_peered":"2024-09-21T03:14:46.544038+0000","last_unstale":"2024-09-21T03:14:48.557375+0000","last_undegraded":"2024-09-21T03:14:48.557375+0000","last_fullsized":"2024-09-21T03:14:48.557375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:57.457687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.567034+0000","last_change":"2024-09-21T03:14:47.579698+0000","last_active":"2024-09-21T03:14:48.567034+0000","last_peered":"2024-09-21T03:14:48.567034+0000","last_clean":"2024-09-21T03:14:48.567034+0000","last_became_active":"2024-09-21T03:14:47.579324+0000","last_became_peered":"2024-09-21T03:14:47.579324+0000","last_unstale":"2024-09-21T03:14:48.567034+0000","last_undegraded":"2024-09-21T03:14:48.567034+0000","last_fullsized":"2024-09-21T03:14:48.567034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:37.656859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578191+0000","last_change":"2024-09-21T03:14:38.476763+0000","last_active":"2024-09-21T03:14:48.578191+0000","last_peered":"2024-09-21T03:14:48.578191+0000","last_clean":"2024-09-21T03:14:48.578191+0000","last_became_active":"2024-09-21T03:14:38.474299+0000","last_became_peered":"2024-09-21T03:14:38.474299+0000","last_unstale":"2024-09-21T03:14:48.578191+0000","last_undegraded":"2024-09-21T03:14:48.578191+0000","last_fullsized":"2024-09-21T03:14:48.578191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:46.544930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580641+0000","last_change":"2024-09-21T03:14:37.466857+0000","last_active":"2024-09-21T03:14:48.580641+0000","last_peered":"2024-09-21T03:14:48.580641+0000","last_clean":"2024-09-21T03:14:48.580641+0000","last_became_active":"2024-09-21T03:14:37.466256+0000","last_became_peered":"2024-09-21T03:14:37.466256+0000","last_unstale":"2024-09-21T03:14:48.580641+0000","last_undegraded":"2024-09-21T03:14:48.580641+0000","last_fullsized":"2024-09-21T03:14:48.580641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:02.240461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558502+0000","last_change":"2024-09-21T03:14:46.537315+0000","last_active":"2024-09-21T03:14:48.558502+0000","last_peered":"2024-09-21T03:14:48.558502+0000","last_clean":"2024-09-21T03:14:48.558502+0000","last_became_active":"2024-09-21T03:14:46.536975+0000","last_became_peered":"2024-09-21T03:14:46.536975+0000","last_unstale":"2024-09-21T03:14:48.558502+0000","last_undegraded":"2024-09-21T03:14:48.558502+0000","last_fullsized":"2024-09-21T03:14:48.558502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:42.529591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566848+0000","last_change":"2024-09-21T03:14:47.573009+0000","last_active":"2024-09-21T03:14:48.566848+0000","last_peered":"2024-09-21T03:14:48.566848+0000","last_clean":"2024-09-21T03:14:48.566848+0000","last_became_active":"2024-09-21T03:14:47.572395+0000","last_became_peered":"2024-09-21T03:14:47.572395+0000","last_unstale":"2024-09-21T03:14:48.566848+0000","last_undegraded":"2024-09-21T03:14:48.566848+0000","last_fullsized":"2024-09-21T03:14:48.566848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:41.733447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556923+0000","last_change":"2024-09-21T03:14:38.481801+0000","last_active":"2024-09-21T03:14:48.556923+0000","last_peered":"2024-09-21T03:14:48.556923+0000","last_clean":"2024-09-21T03:14:48.556923+0000","last_became_active":"2024-09-21T03:14:38.481186+0000","last_became_peered":"2024-09-21T03:14:38.481186+0000","last_unstale":"2024-09-21T03:14:48.556923+0000","last_undegraded":"2024-09-21T03:14:48.556923+0000","last_fullsized":"2024-09-21T03:14:48.556923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:54.271470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566292+0000","last_change":"2024-09-21T03:14:37.474798+0000","last_active":"2024-09-21T03:14:48.566292+0000","last_peered":"2024-09-21T03:14:48.566292+0000","last_clean":"2024-09-21T03:14:48.566292+0000","last_became_active":"2024-09-21T03:14:37.473829+0000","last_became_peered":"2024-09-21T03:14:37.473829+0000","last_unstale":"2024-09-21T03:14:48.566292+0000","last_undegraded":"2024-09-21T03:14:48.566292+0000","last_fullsized":"2024-09-21T03:14:48.566292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:11.571814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558227+0000","last_change":"2024-09-21T03:14:46.542495+0000","last_active":"2024-09-21T03:14:48.558227+0000","last_peered":"2024-09-21T03:14:48.558227+0000","last_clean":"2024-09-21T03:14:48.558227+0000","last_became_active":"2024-09-21T03:14:46.542181+0000","last_became_peered":"2024-09-21T03:14:46.542181+0000","last_unstale":"2024-09-21T03:14:48.558227+0000","last_undegraded":"2024-09-21T03:14:48.558227+0000","last_fullsized":"2024-09-21T03:14:48.558227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:22.481477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580850+0000","last_change":"2024-09-21T03:14:47.569409+0000","last_active":"2024-09-21T03:14:48.580850+0000","last_peered":"2024-09-21T03:14:48.580850+0000","last_clean":"2024-09-21T03:14:48.580850+0000","last_became_active":"2024-09-21T03:14:47.569212+0000","last_became_peered":"2024-09-21T03:14:47.569212+0000","last_unstale":"2024-09-21T03:14:48.580850+0000","last_undegraded":"2024-09-21T03:14:48.580850+0000","last_fullsized":"2024-09-21T03:14:48.580850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.851943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557644+0000","last_change":"2024-09-21T03:14:38.480026+0000","last_active":"2024-09-21T03:14:48.557644+0000","last_peered":"2024-09-21T03:14:48.557644+0000","last_clean":"2024-09-21T03:14:48.557644+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:14:48.557644+0000","last_undegraded":"2024-09-21T03:14:48.557644+0000","last_fullsized":"2024-09-21T03:14:48.557644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:20.481816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578131+0000","last_change":"2024-09-21T03:14:37.464554+0000","last_active":"2024-09-21T03:14:48.578131+0000","last_peered":"2024-09-21T03:14:48.578131+0000","last_clean":"2024-09-21T03:14:48.578131+0000","last_became_active":"2024-09-21T03:14:37.464228+0000","last_became_peered":"2024-09-21T03:14:37.464228+0000","last_unstale":"2024-09-21T03:14:48.578131+0000","last_undegraded":"2024-09-21T03:14:48.578131+0000","last_fullsized":"2024-09-21T03:14:48.578131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:32.529512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558894+0000","last_change":"2024-09-21T03:14:46.538538+0000","last_active":"2024-09-21T03:14:48.558894+0000","last_peered":"2024-09-21T03:14:48.558894+0000","last_clean":"2024-09-21T03:14:48.558894+0000","last_became_active":"2024-09-21T03:14:46.537815+0000","last_became_peered":"2024-09-21T03:14:46.537815+0000","last_unstale":"2024-09-21T03:14:48.558894+0000","last_undegraded":"2024-09-21T03:14:48.558894+0000","last_fullsized":"2024-09-21T03:14:48.558894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:42.264439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578432+0000","last_change":"2024-09-21T03:14:47.558861+0000","last_active":"2024-09-21T03:14:48.578432+0000","last_peered":"2024-09-21T03:14:48.578432+0000","last_clean":"2024-09-21T03:14:48.578432+0000","last_became_active":"2024-09-21T03:14:47.557305+0000","last_became_peered":"2024-09-21T03:14:47.557305+0000","last_unstale":"2024-09-21T03:14:48.578432+0000","last_undegraded":"2024-09-21T03:14:48.578432+0000","last_fullsized":"2024-09-21T03:14:48.578432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:45.962367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577698+0000","last_change":"2024-09-21T03:14:38.479181+0000","last_active":"2024-09-21T03:14:48.577698+0000","last_peered":"2024-09-21T03:14:48.577698+0000","last_clean":"2024-09-21T03:14:48.577698+0000","last_became_active":"2024-09-21T03:14:38.478842+0000","last_became_peered":"2024-09-21T03:14:38.478842+0000","last_unstale":"2024-09-21T03:14:48.577698+0000","last_undegraded":"2024-09-21T03:14:48.577698+0000","last_fullsized":"2024-09-21T03:14:48.577698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:08.664381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580210+0000","last_change":"2024-09-21T03:14:37.463990+0000","last_active":"2024-09-21T03:14:48.580210+0000","last_peered":"2024-09-21T03:14:48.580210+0000","last_clean":"2024-09-21T03:14:48.580210+0000","last_became_active":"2024-09-21T03:14:37.463674+0000","last_became_peered":"2024-09-21T03:14:37.463674+0000","last_unstale":"2024-09-21T03:14:48.580210+0000","last_undegraded":"2024-09-21T03:14:48.580210+0000","last_fullsized":"2024-09-21T03:14:48.580210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:35.391985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577246+0000","last_change":"2024-09-21T03:14:26.342355+0000","last_active":"2024-09-21T03:14:48.577246+0000","last_peered":"2024-09-21T03:14:48.577246+0000","last_clean":"2024-09-21T03:14:48.577246+0000","last_became_active":"2024-09-21T03:14:26.341929+0000","last_became_peered":"2024-09-21T03:14:26.341929+0000","last_unstale":"2024-09-21T03:14:48.577246+0000","last_undegraded":"2024-09-21T03:14:48.577246+0000","last_fullsized":"2024-09-21T03:14:48.577246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_clean_scrub_stamp":"2024-09-21T03:14:25.329650+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:45.390822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581358+0000","last_change":"2024-09-21T03:14:46.538184+0000","last_active":"2024-09-21T03:14:48.581358+0000","last_peered":"2024-09-21T03:14:48.581358+0000","last_clean":"2024-09-21T03:14:48.581358+0000","last_became_active":"2024-09-21T03:14:46.536753+0000","last_became_peered":"2024-09-21T03:14:46.536753+0000","last_unstale":"2024-09-21T03:14:48.581358+0000","last_undegraded":"2024-09-21T03:14:48.581358+0000","last_fullsized":"2024-09-21T03:14:48.581358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:49.078638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558519+0000","last_change":"2024-09-21T03:14:47.552966+0000","last_active":"2024-09-21T03:14:48.558519+0000","last_peered":"2024-09-21T03:14:48.558519+0000","last_clean":"2024-09-21T03:14:48.558519+0000","last_became_active":"2024-09-21T03:14:47.552642+0000","last_became_peered":"2024-09-21T03:14:47.552642+0000","last_unstale":"2024-09-21T03:14:48.558519+0000","last_undegraded":"2024-09-21T03:14:48.558519+0000","last_fullsized":"2024-09-21T03:14:48.558519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:15.928026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581346+0000","last_change":"2024-09-21T03:14:38.478414+0000","last_active":"2024-09-21T03:14:48.581346+0000","last_peered":"2024-09-21T03:14:48.581346+0000","last_clean":"2024-09-21T03:14:48.581346+0000","last_became_active":"2024-09-21T03:14:38.478116+0000","last_became_peered":"2024-09-21T03:14:38.478116+0000","last_unstale":"2024-09-21T03:14:48.581346+0000","last_undegraded":"2024-09-21T03:14:48.581346+0000","last_fullsized":"2024-09-21T03:14:48.581346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:29.618008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558850+0000","last_change":"2024-09-21T03:14:37.479578+0000","last_active":"2024-09-21T03:14:48.558850+0000","last_peered":"2024-09-21T03:14:48.558850+0000","last_clean":"2024-09-21T03:14:48.558850+0000","last_became_active":"2024-09-21T03:14:37.479284+0000","last_became_peered":"2024-09-21T03:14:37.479284+0000","last_unstale":"2024-09-21T03:14:48.558850+0000","last_undegraded":"2024-09-21T03:14:48.558850+0000","last_fullsized":"2024-09-21T03:14:48.558850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:15.732230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556655+0000","last_change":"2024-09-21T03:14:46.531536+0000","last_active":"2024-09-21T03:14:48.556655+0000","last_peered":"2024-09-21T03:14:48.556655+0000","last_clean":"2024-09-21T03:14:48.556655+0000","last_became_active":"2024-09-21T03:14:46.531069+0000","last_became_peered":"2024-09-21T03:14:46.531069+0000","last_unstale":"2024-09-21T03:14:48.556655+0000","last_undegraded":"2024-09-21T03:14:48.556655+0000","last_fullsized":"2024-09-21T03:14:48.556655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:14.050618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557238+0000","last_change":"2024-09-21T03:14:47.553039+0000","last_active":"2024-09-21T03:14:48.557238+0000","last_peered":"2024-09-21T03:14:48.557238+0000","last_clean":"2024-09-21T03:14:48.557238+0000","last_became_active":"2024-09-21T03:14:47.552712+0000","last_became_peered":"2024-09-21T03:14:47.552712+0000","last_unstale":"2024-09-21T03:14:48.557238+0000","last_undegraded":"2024-09-21T03:14:48.557238+0000","last_fullsized":"2024-09-21T03:14:48.557238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:32.630319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578701+0000","last_change":"2024-09-21T03:14:38.488259+0000","last_active":"2024-09-21T03:14:48.578701+0000","last_peered":"2024-09-21T03:14:48.578701+0000","last_clean":"2024-09-21T03:14:48.578701+0000","last_became_active":"2024-09-21T03:14:38.487420+0000","last_became_peered":"2024-09-21T03:14:38.487420+0000","last_unstale":"2024-09-21T03:14:48.578701+0000","last_undegraded":"2024-09-21T03:14:48.578701+0000","last_fullsized":"2024-09-21T03:14:48.578701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:48.003893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.559532+0000","last_change":"2024-09-21T03:14:37.460763+0000","last_active":"2024-09-21T03:14:48.559532+0000","last_peered":"2024-09-21T03:14:48.559532+0000","last_clean":"2024-09-21T03:14:48.559532+0000","last_became_active":"2024-09-21T03:14:37.460320+0000","last_became_peered":"2024-09-21T03:14:37.460320+0000","last_unstale":"2024-09-21T03:14:48.559532+0000","last_undegraded":"2024-09-21T03:14:48.559532+0000","last_fullsized":"2024-09-21T03:14:48.559532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.907794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558692+0000","last_change":"2024-09-21T03:14:46.540901+0000","last_active":"2024-09-21T03:14:48.558692+0000","last_peered":"2024-09-21T03:14:48.558692+0000","last_clean":"2024-09-21T03:14:48.558692+0000","last_became_active":"2024-09-21T03:14:46.540182+0000","last_became_peered":"2024-09-21T03:14:46.540182+0000","last_unstale":"2024-09-21T03:14:48.558692+0000","last_undegraded":"2024-09-21T03:14:48.558692+0000","last_fullsized":"2024-09-21T03:14:48.558692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:38.416663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577089+0000","last_change":"2024-09-21T03:14:47.553810+0000","last_active":"2024-09-21T03:14:48.577089+0000","last_peered":"2024-09-21T03:14:48.577089+0000","last_clean":"2024-09-21T03:14:48.577089+0000","last_became_active":"2024-09-21T03:14:47.552371+0000","last_became_peered":"2024-09-21T03:14:47.552371+0000","last_unstale":"2024-09-21T03:14:48.577089+0000","last_undegraded":"2024-09-21T03:14:48.577089+0000","last_fullsized":"2024-09-21T03:14:48.577089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:38.659512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579745+0000","last_change":"2024-09-21T03:14:38.480629+0000","last_active":"2024-09-21T03:14:48.579745+0000","last_peered":"2024-09-21T03:14:48.579745+0000","last_clean":"2024-09-21T03:14:48.579745+0000","last_became_active":"2024-09-21T03:14:38.474135+0000","last_became_peered":"2024-09-21T03:14:38.474135+0000","last_unstale":"2024-09-21T03:14:48.579745+0000","last_undegraded":"2024-09-21T03:14:48.579745+0000","last_fullsized":"2024-09-21T03:14:48.579745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:36.171044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578278+0000","last_change":"2024-09-21T03:14:37.472491+0000","last_active":"2024-09-21T03:14:48.578278+0000","last_peered":"2024-09-21T03:14:48.578278+0000","last_clean":"2024-09-21T03:14:48.578278+0000","last_became_active":"2024-09-21T03:14:37.472164+0000","last_became_peered":"2024-09-21T03:14:37.472164+0000","last_unstale":"2024-09-21T03:14:48.578278+0000","last_undegraded":"2024-09-21T03:14:48.578278+0000","last_fullsized":"2024-09-21T03:14:48.578278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.498178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577656+0000","last_change":"2024-09-21T03:14:46.544828+0000","last_active":"2024-09-21T03:14:48.577656+0000","last_peered":"2024-09-21T03:14:48.577656+0000","last_clean":"2024-09-21T03:14:48.577656+0000","last_became_active":"2024-09-21T03:14:46.535901+0000","last_became_peered":"2024-09-21T03:14:46.535901+0000","last_unstale":"2024-09-21T03:14:48.577656+0000","last_undegraded":"2024-09-21T03:14:48.577656+0000","last_fullsized":"2024-09-21T03:14:48.577656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:08.608530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557424+0000","last_change":"2024-09-21T03:14:47.556478+0000","last_active":"2024-09-21T03:14:48.557424+0000","last_peered":"2024-09-21T03:14:48.557424+0000","last_clean":"2024-09-21T03:14:48.557424+0000","last_became_active":"2024-09-21T03:14:47.556145+0000","last_became_peered":"2024-09-21T03:14:47.556145+0000","last_unstale":"2024-09-21T03:14:48.557424+0000","last_undegraded":"2024-09-21T03:14:48.557424+0000","last_fullsized":"2024-09-21T03:14:48.557424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:59.004648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557482+0000","last_change":"2024-09-21T03:14:38.469502+0000","last_active":"2024-09-21T03:14:48.557482+0000","last_peered":"2024-09-21T03:14:48.557482+0000","last_clean":"2024-09-21T03:14:48.557482+0000","last_became_active":"2024-09-21T03:14:38.468972+0000","last_became_peered":"2024-09-21T03:14:38.468972+0000","last_unstale":"2024-09-21T03:14:48.557482+0000","last_undegraded":"2024-09-21T03:14:48.557482+0000","last_fullsized":"2024-09-21T03:14:48.557482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579796+0000","last_change":"2024-09-21T03:14:37.480905+0000","last_active":"2024-09-21T03:14:48.579796+0000","last_peered":"2024-09-21T03:14:48.579796+0000","last_clean":"2024-09-21T03:14:48.579796+0000","last_became_active":"2024-09-21T03:14:37.478227+0000","last_became_peered":"2024-09-21T03:14:37.478227+0000","last_unstale":"2024-09-21T03:14:48.579796+0000","last_undegraded":"2024-09-21T03:14:48.579796+0000","last_fullsized":"2024-09-21T03:14:48.579796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:42.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577322+0000","last_change":"2024-09-21T03:14:46.536103+0000","last_active":"2024-09-21T03:14:48.577322+0000","last_peered":"2024-09-21T03:14:48.577322+0000","last_clean":"2024-09-21T03:14:48.577322+0000","last_became_active":"2024-09-21T03:14:46.535445+0000","last_became_peered":"2024-09-21T03:14:46.535445+0000","last_unstale":"2024-09-21T03:14:48.577322+0000","last_undegraded":"2024-09-21T03:14:48.577322+0000","last_fullsized":"2024-09-21T03:14:48.577322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:59.078000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578149+0000","last_change":"2024-09-21T03:14:47.557503+0000","last_active":"2024-09-21T03:14:48.578149+0000","last_peered":"2024-09-21T03:14:48.578149+0000","last_clean":"2024-09-21T03:14:48.578149+0000","last_became_active":"2024-09-21T03:14:47.554366+0000","last_became_peered":"2024-09-21T03:14:47.554366+0000","last_unstale":"2024-09-21T03:14:48.578149+0000","last_undegraded":"2024-09-21T03:14:48.578149+0000","last_fullsized":"2024-09-21T03:14:48.578149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.994560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579154+0000","last_change":"2024-09-21T03:14:38.479516+0000","last_active":"2024-09-21T03:14:48.579154+0000","last_peered":"2024-09-21T03:14:48.579154+0000","last_clean":"2024-09-21T03:14:48.579154+0000","last_became_active":"2024-09-21T03:14:38.474826+0000","last_became_peered":"2024-09-21T03:14:38.474826+0000","last_unstale":"2024-09-21T03:14:48.579154+0000","last_undegraded":"2024-09-21T03:14:48.579154+0000","last_fullsized":"2024-09-21T03:14:48.579154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:22.181411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577156+0000","last_change":"2024-09-21T03:14:37.471063+0000","last_active":"2024-09-21T03:14:48.577156+0000","last_peered":"2024-09-21T03:14:48.577156+0000","last_clean":"2024-09-21T03:14:48.577156+0000","last_became_active":"2024-09-21T03:14:37.470720+0000","last_became_peered":"2024-09-21T03:14:37.470720+0000","last_unstale":"2024-09-21T03:14:48.577156+0000","last_undegraded":"2024-09-21T03:14:48.577156+0000","last_fullsized":"2024-09-21T03:14:48.577156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:00.054692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558350+0000","last_change":"2024-09-21T03:14:46.538665+0000","last_active":"2024-09-21T03:14:48.558350+0000","last_peered":"2024-09-21T03:14:48.558350+0000","last_clean":"2024-09-21T03:14:48.558350+0000","last_became_active":"2024-09-21T03:14:46.537774+0000","last_became_peered":"2024-09-21T03:14:46.537774+0000","last_unstale":"2024-09-21T03:14:48.558350+0000","last_undegraded":"2024-09-21T03:14:48.558350+0000","last_fullsized":"2024-09-21T03:14:48.558350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:07.736404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580727+0000","last_change":"2024-09-21T03:14:47.553011+0000","last_active":"2024-09-21T03:14:48.580727+0000","last_peered":"2024-09-21T03:14:48.580727+0000","last_clean":"2024-09-21T03:14:48.580727+0000","last_became_active":"2024-09-21T03:14:47.552700+0000","last_became_peered":"2024-09-21T03:14:47.552700+0000","last_unstale":"2024-09-21T03:14:48.580727+0000","last_undegraded":"2024-09-21T03:14:48.580727+0000","last_fullsized":"2024-09-21T03:14:48.580727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:58.780132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577072+0000","last_change":"2024-09-21T03:14:38.472906+0000","last_active":"2024-09-21T03:14:48.577072+0000","last_peered":"2024-09-21T03:14:48.577072+0000","last_clean":"2024-09-21T03:14:48.577072+0000","last_became_active":"2024-09-21T03:14:38.471933+0000","last_became_peered":"2024-09-21T03:14:38.471933+0000","last_unstale":"2024-09-21T03:14:48.577072+0000","last_undegraded":"2024-09-21T03:14:48.577072+0000","last_fullsized":"2024-09-21T03:14:48.577072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:05.395821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577473+0000","last_change":"2024-09-21T03:14:37.478714+0000","last_active":"2024-09-21T03:14:48.577473+0000","last_peered":"2024-09-21T03:14:48.577473+0000","last_clean":"2024-09-21T03:14:48.577473+0000","last_became_active":"2024-09-21T03:14:37.477951+0000","last_became_peered":"2024-09-21T03:14:37.477951+0000","last_unstale":"2024-09-21T03:14:48.577473+0000","last_undegraded":"2024-09-21T03:14:48.577473+0000","last_fullsized":"2024-09-21T03:14:48.577473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:42.529545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557789+0000","last_change":"2024-09-21T03:14:46.546142+0000","last_active":"2024-09-21T03:14:48.557789+0000","last_peered":"2024-09-21T03:14:48.557789+0000","last_clean":"2024-09-21T03:14:48.557789+0000","last_became_active":"2024-09-21T03:14:46.545865+0000","last_became_peered":"2024-09-21T03:14:46.545865+0000","last_unstale":"2024-09-21T03:14:48.557789+0000","last_undegraded":"2024-09-21T03:14:48.557789+0000","last_fullsized":"2024-09-21T03:14:48.557789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:11.705309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580406+0000","last_change":"2024-09-21T03:14:47.568961+0000","last_active":"2024-09-21T03:14:48.580406+0000","last_peered":"2024-09-21T03:14:48.580406+0000","last_clean":"2024-09-21T03:14:48.580406+0000","last_became_active":"2024-09-21T03:14:47.568656+0000","last_became_peered":"2024-09-21T03:14:47.568656+0000","last_unstale":"2024-09-21T03:14:48.580406+0000","last_undegraded":"2024-09-21T03:14:48.580406+0000","last_fullsized":"2024-09-21T03:14:48.580406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.041710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580087+0000","last_change":"2024-09-21T03:14:38.485454+0000","last_active":"2024-09-21T03:14:48.580087+0000","last_peered":"2024-09-21T03:14:48.580087+0000","last_clean":"2024-09-21T03:14:48.580087+0000","last_became_active":"2024-09-21T03:14:38.485235+0000","last_became_peered":"2024-09-21T03:14:38.485235+0000","last_unstale":"2024-09-21T03:14:48.580087+0000","last_undegraded":"2024-09-21T03:14:48.580087+0000","last_fullsized":"2024-09-21T03:14:48.580087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:11.585637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580507+0000","last_change":"2024-09-21T03:14:37.466544+0000","last_active":"2024-09-21T03:14:48.580507+0000","last_peered":"2024-09-21T03:14:48.580507+0000","last_clean":"2024-09-21T03:14:48.580507+0000","last_became_active":"2024-09-21T03:14:37.465817+0000","last_became_peered":"2024-09-21T03:14:37.465817+0000","last_unstale":"2024-09-21T03:14:48.580507+0000","last_undegraded":"2024-09-21T03:14:48.580507+0000","last_fullsized":"2024-09-21T03:14:48.580507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:36.113483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558395+0000","last_change":"2024-09-21T03:14:46.549921+0000","last_active":"2024-09-21T03:14:48.558395+0000","last_peered":"2024-09-21T03:14:48.558395+0000","last_clean":"2024-09-21T03:14:48.558395+0000","last_became_active":"2024-09-21T03:14:46.549119+0000","last_became_peered":"2024-09-21T03:14:46.549119+0000","last_unstale":"2024-09-21T03:14:48.558395+0000","last_undegraded":"2024-09-21T03:14:48.558395+0000","last_fullsized":"2024-09-21T03:14:48.558395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:09.622498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577943+0000","last_change":"2024-09-21T03:14:47.577090+0000","last_active":"2024-09-21T03:14:48.577943+0000","last_peered":"2024-09-21T03:14:48.577943+0000","last_clean":"2024-09-21T03:14:48.577943+0000","last_became_active":"2024-09-21T03:14:47.576098+0000","last_became_peered":"2024-09-21T03:14:47.576098+0000","last_unstale":"2024-09-21T03:14:48.577943+0000","last_undegraded":"2024-09-21T03:14:48.577943+0000","last_fullsized":"2024-09-21T03:14:48.577943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:33.414103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557891+0000","last_change":"2024-09-21T03:14:38.482528+0000","last_active":"2024-09-21T03:14:48.557891+0000","last_peered":"2024-09-21T03:14:48.557891+0000","last_clean":"2024-09-21T03:14:48.557891+0000","last_became_active":"2024-09-21T03:14:38.482241+0000","last_became_peered":"2024-09-21T03:14:38.482241+0000","last_unstale":"2024-09-21T03:14:48.557891+0000","last_undegraded":"2024-09-21T03:14:48.557891+0000","last_fullsized":"2024-09-21T03:14:48.557891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:23.110703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566561+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:14:48.566561+0000","last_peered":"2024-09-21T03:14:48.566561+0000","last_clean":"2024-09-21T03:14:48.566561+0000","last_became_active":"2024-09-21T03:14:37.478882+0000","last_became_peered":"2024-09-21T03:14:37.478882+0000","last_unstale":"2024-09-21T03:14:48.566561+0000","last_undegraded":"2024-09-21T03:14:48.566561+0000","last_fullsized":"2024-09-21T03:14:48.566561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:11.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581263+0000","last_change":"2024-09-21T03:14:46.538817+0000","last_active":"2024-09-21T03:14:48.581263+0000","last_peered":"2024-09-21T03:14:48.581263+0000","last_clean":"2024-09-21T03:14:48.581263+0000","last_became_active":"2024-09-21T03:14:46.537835+0000","last_became_peered":"2024-09-21T03:14:46.537835+0000","last_unstale":"2024-09-21T03:14:48.581263+0000","last_undegraded":"2024-09-21T03:14:48.581263+0000","last_fullsized":"2024-09-21T03:14:48.581263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:08.236663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577368+0000","last_change":"2024-09-21T03:14:47.566534+0000","last_active":"2024-09-21T03:14:48.577368+0000","last_peered":"2024-09-21T03:14:48.577368+0000","last_clean":"2024-09-21T03:14:48.577368+0000","last_became_active":"2024-09-21T03:14:47.566157+0000","last_became_peered":"2024-09-21T03:14:47.566157+0000","last_unstale":"2024-09-21T03:14:48.577368+0000","last_undegraded":"2024-09-21T03:14:48.577368+0000","last_fullsized":"2024-09-21T03:14:48.577368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:35.557811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579586+0000","last_change":"2024-09-21T03:14:38.478509+0000","last_active":"2024-09-21T03:14:48.579586+0000","last_peered":"2024-09-21T03:14:48.579586+0000","last_clean":"2024-09-21T03:14:48.579586+0000","last_became_active":"2024-09-21T03:14:38.478197+0000","last_became_peered":"2024-09-21T03:14:38.478197+0000","last_unstale":"2024-09-21T03:14:48.579586+0000","last_undegraded":"2024-09-21T03:14:48.579586+0000","last_fullsized":"2024-09-21T03:14:48.579586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.411134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557313+0000","last_change":"2024-09-21T03:14:37.472695+0000","last_active":"2024-09-21T03:14:48.557313+0000","last_peered":"2024-09-21T03:14:48.557313+0000","last_clean":"2024-09-21T03:14:48.557313+0000","last_became_active":"2024-09-21T03:14:37.472374+0000","last_became_peered":"2024-09-21T03:14:37.472374+0000","last_unstale":"2024-09-21T03:14:48.557313+0000","last_undegraded":"2024-09-21T03:14:48.557313+0000","last_fullsized":"2024-09-21T03:14:48.557313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:11.245914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577140+0000","last_change":"2024-09-21T03:14:46.547433+0000","last_active":"2024-09-21T03:14:48.577140+0000","last_peered":"2024-09-21T03:14:48.577140+0000","last_clean":"2024-09-21T03:14:48.577140+0000","last_became_active":"2024-09-21T03:14:46.547192+0000","last_became_peered":"2024-09-21T03:14:46.547192+0000","last_unstale":"2024-09-21T03:14:48.577140+0000","last_undegraded":"2024-09-21T03:14:48.577140+0000","last_fullsized":"2024-09-21T03:14:48.577140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:03.238245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557599+0000","last_change":"2024-09-21T03:14:47.545827+0000","last_active":"2024-09-21T03:14:48.557599+0000","last_peered":"2024-09-21T03:14:48.557599+0000","last_clean":"2024-09-21T03:14:48.557599+0000","last_became_active":"2024-09-21T03:14:47.545440+0000","last_became_peered":"2024-09-21T03:14:47.545440+0000","last_unstale":"2024-09-21T03:14:48.557599+0000","last_undegraded":"2024-09-21T03:14:48.557599+0000","last_fullsized":"2024-09-21T03:14:48.557599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:20.532645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580151+0000","last_change":"2024-09-21T03:14:38.476564+0000","last_active":"2024-09-21T03:14:48.580151+0000","last_peered":"2024-09-21T03:14:48.580151+0000","last_clean":"2024-09-21T03:14:48.580151+0000","last_became_active":"2024-09-21T03:14:38.476158+0000","last_became_peered":"2024-09-21T03:14:38.476158+0000","last_unstale":"2024-09-21T03:14:48.580151+0000","last_undegraded":"2024-09-21T03:14:48.580151+0000","last_fullsized":"2024-09-21T03:14:48.580151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:26.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.567071+0000","last_change":"2024-09-21T03:14:37.473709+0000","last_active":"2024-09-21T03:14:48.567071+0000","last_peered":"2024-09-21T03:14:48.567071+0000","last_clean":"2024-09-21T03:14:48.567071+0000","last_became_active":"2024-09-21T03:14:37.472544+0000","last_became_peered":"2024-09-21T03:14:37.472544+0000","last_unstale":"2024-09-21T03:14:48.567071+0000","last_undegraded":"2024-09-21T03:14:48.567071+0000","last_fullsized":"2024-09-21T03:14:48.567071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:47.892146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556540+0000","last_change":"2024-09-21T03:14:46.534201+0000","last_active":"2024-09-21T03:14:48.556540+0000","last_peered":"2024-09-21T03:14:48.556540+0000","last_clean":"2024-09-21T03:14:48.556540+0000","last_became_active":"2024-09-21T03:14:46.533891+0000","last_became_peered":"2024-09-21T03:14:46.533891+0000","last_unstale":"2024-09-21T03:14:48.556540+0000","last_undegraded":"2024-09-21T03:14:48.556540+0000","last_fullsized":"2024-09-21T03:14:48.556540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:06.645173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579059+0000","last_change":"2024-09-21T03:14:47.552016+0000","last_active":"2024-09-21T03:14:48.579059+0000","last_peered":"2024-09-21T03:14:48.579059+0000","last_clean":"2024-09-21T03:14:48.579059+0000","last_became_active":"2024-09-21T03:14:47.551622+0000","last_became_peered":"2024-09-21T03:14:47.551622+0000","last_unstale":"2024-09-21T03:14:48.579059+0000","last_undegraded":"2024-09-21T03:14:48.579059+0000","last_fullsized":"2024-09-21T03:14:48.579059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:56:04.849535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558475+0000","last_change":"2024-09-21T03:14:38.484757+0000","last_active":"2024-09-21T03:14:48.558475+0000","last_peered":"2024-09-21T03:14:48.558475+0000","last_clean":"2024-09-21T03:14:48.558475+0000","last_became_active":"2024-09-21T03:14:38.483348+0000","last_became_peered":"2024-09-21T03:14:38.483348+0000","last_unstale":"2024-09-21T03:14:48.558475+0000","last_undegraded":"2024-09-21T03:14:48.558475+0000","last_fullsized":"2024-09-21T03:14:48.558475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:57.697723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579637+0000","last_change":"2024-09-21T03:14:37.479047+0000","last_active":"2024-09-21T03:14:48.579637+0000","last_peered":"2024-09-21T03:14:48.579637+0000","last_clean":"2024-09-21T03:14:48.579637+0000","last_became_active":"2024-09-21T03:14:37.478700+0000","last_became_peered":"2024-09-21T03:14:37.478700+0000","last_unstale":"2024-09-21T03:14:48.579637+0000","last_undegraded":"2024-09-21T03:14:48.579637+0000","last_fullsized":"2024-09-21T03:14:48.579637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:31.702450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566046+0000","last_change":"2024-09-21T03:14:46.547287+0000","last_active":"2024-09-21T03:14:48.566046+0000","last_peered":"2024-09-21T03:14:48.566046+0000","last_clean":"2024-09-21T03:14:48.566046+0000","last_became_active":"2024-09-21T03:14:46.546867+0000","last_became_peered":"2024-09-21T03:14:46.546867+0000","last_unstale":"2024-09-21T03:14:48.566046+0000","last_undegraded":"2024-09-21T03:14:48.566046+0000","last_fullsized":"2024-09-21T03:14:48.566046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:54.119841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556239+0000","last_change":"2024-09-21T03:14:47.558571+0000","last_active":"2024-09-21T03:14:48.556239+0000","last_peered":"2024-09-21T03:14:48.556239+0000","last_clean":"2024-09-21T03:14:48.556239+0000","last_became_active":"2024-09-21T03:14:47.558037+0000","last_became_peered":"2024-09-21T03:14:47.558037+0000","last_unstale":"2024-09-21T03:14:48.556239+0000","last_undegraded":"2024-09-21T03:14:48.556239+0000","last_fullsized":"2024-09-21T03:14:48.556239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:42.564181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557395+0000","last_change":"2024-09-21T03:14:38.488227+0000","last_active":"2024-09-21T03:14:48.557395+0000","last_peered":"2024-09-21T03:14:48.557395+0000","last_clean":"2024-09-21T03:14:48.557395+0000","last_became_active":"2024-09-21T03:14:38.482370+0000","last_became_peered":"2024-09-21T03:14:38.482370+0000","last_unstale":"2024-09-21T03:14:48.557395+0000","last_undegraded":"2024-09-21T03:14:48.557395+0000","last_fullsized":"2024-09-21T03:14:48.557395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:52.561391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580228+0000","last_change":"2024-09-21T03:14:37.471363+0000","last_active":"2024-09-21T03:14:48.580228+0000","last_peered":"2024-09-21T03:14:48.580228+0000","last_clean":"2024-09-21T03:14:48.580228+0000","last_became_active":"2024-09-21T03:14:37.471002+0000","last_became_peered":"2024-09-21T03:14:37.471002+0000","last_unstale":"2024-09-21T03:14:48.580228+0000","last_undegraded":"2024-09-21T03:14:48.580228+0000","last_fullsized":"2024-09-21T03:14:48.580228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:25.922368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.576862+0000","last_change":"2024-09-21T03:14:46.545186+0000","last_active":"2024-09-21T03:14:48.576862+0000","last_peered":"2024-09-21T03:14:48.576862+0000","last_clean":"2024-09-21T03:14:48.576862+0000","last_became_active":"2024-09-21T03:14:46.543647+0000","last_became_peered":"2024-09-21T03:14:46.543647+0000","last_unstale":"2024-09-21T03:14:48.576862+0000","last_undegraded":"2024-09-21T03:14:48.576862+0000","last_fullsized":"2024-09-21T03:14:48.576862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:03.097368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557625+0000","last_change":"2024-09-21T03:14:47.554766+0000","last_active":"2024-09-21T03:14:48.557625+0000","last_peered":"2024-09-21T03:14:48.557625+0000","last_clean":"2024-09-21T03:14:48.557625+0000","last_became_active":"2024-09-21T03:14:47.551563+0000","last_became_peered":"2024-09-21T03:14:47.551563+0000","last_unstale":"2024-09-21T03:14:48.557625+0000","last_undegraded":"2024-09-21T03:14:48.557625+0000","last_fullsized":"2024-09-21T03:14:48.557625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:08.790725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577735+0000","last_change":"2024-09-21T03:14:46.542659+0000","last_active":"2024-09-21T03:14:48.577735+0000","last_peered":"2024-09-21T03:14:48.577735+0000","last_clean":"2024-09-21T03:14:48.577735+0000","last_became_active":"2024-09-21T03:14:46.541771+0000","last_became_peered":"2024-09-21T03:14:46.541771+0000","last_unstale":"2024-09-21T03:14:48.577735+0000","last_undegraded":"2024-09-21T03:14:48.577735+0000","last_fullsized":"2024-09-21T03:14:48.577735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:45.543904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577243+0000","last_change":"2024-09-21T03:14:38.481837+0000","last_active":"2024-09-21T03:14:48.577243+0000","last_peered":"2024-09-21T03:14:48.577243+0000","last_clean":"2024-09-21T03:14:48.577243+0000","last_became_active":"2024-09-21T03:14:38.478400+0000","last_became_peered":"2024-09-21T03:14:38.478400+0000","last_unstale":"2024-09-21T03:14:48.577243+0000","last_undegraded":"2024-09-21T03:14:48.577243+0000","last_fullsized":"2024-09-21T03:14:48.577243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.702185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578051+0000","last_change":"2024-09-21T03:14:37.459351+0000","last_active":"2024-09-21T03:14:48.578051+0000","last_peered":"2024-09-21T03:14:48.578051+0000","last_clean":"2024-09-21T03:14:48.578051+0000","last_became_active":"2024-09-21T03:14:37.458676+0000","last_became_peered":"2024-09-21T03:14:37.458676+0000","last_unstale":"2024-09-21T03:14:48.578051+0000","last_undegraded":"2024-09-21T03:14:48.578051+0000","last_fullsized":"2024-09-21T03:14:48.578051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:42.671520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558462+0000","last_change":"2024-09-21T03:14:47.561232+0000","last_active":"2024-09-21T03:14:48.558462+0000","last_peered":"2024-09-21T03:14:48.558462+0000","last_clean":"2024-09-21T03:14:48.558462+0000","last_became_active":"2024-09-21T03:14:47.557224+0000","last_became_peered":"2024-09-21T03:14:47.557224+0000","last_unstale":"2024-09-21T03:14:48.558462+0000","last_undegraded":"2024-09-21T03:14:48.558462+0000","last_fullsized":"2024-09-21T03:14:48.558462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:09.611235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580814+0000","last_change":"2024-09-21T03:14:46.543157+0000","last_active":"2024-09-21T03:14:48.580814+0000","last_peered":"2024-09-21T03:14:48.580814+0000","last_clean":"2024-09-21T03:14:48.580814+0000","last_became_active":"2024-09-21T03:14:46.542746+0000","last_became_peered":"2024-09-21T03:14:46.542746+0000","last_unstale":"2024-09-21T03:14:48.580814+0000","last_undegraded":"2024-09-21T03:14:48.580814+0000","last_fullsized":"2024-09-21T03:14:48.580814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:30.644843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557713+0000","last_change":"2024-09-21T03:14:38.480723+0000","last_active":"2024-09-21T03:14:48.557713+0000","last_peered":"2024-09-21T03:14:48.557713+0000","last_clean":"2024-09-21T03:14:48.557713+0000","last_became_active":"2024-09-21T03:14:38.472823+0000","last_became_peered":"2024-09-21T03:14:38.472823+0000","last_unstale":"2024-09-21T03:14:48.557713+0000","last_undegraded":"2024-09-21T03:14:48.557713+0000","last_fullsized":"2024-09-21T03:14:48.557713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:59.862592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557827+0000","last_change":"2024-09-21T03:14:37.472209+0000","last_active":"2024-09-21T03:14:48.557827+0000","last_peered":"2024-09-21T03:14:48.557827+0000","last_clean":"2024-09-21T03:14:48.557827+0000","last_became_active":"2024-09-21T03:14:37.471771+0000","last_became_peered":"2024-09-21T03:14:37.471771+0000","last_unstale":"2024-09-21T03:14:48.557827+0000","last_undegraded":"2024-09-21T03:14:48.557827+0000","last_fullsized":"2024-09-21T03:14:48.557827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:30.648010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577935+0000","last_change":"2024-09-21T03:14:47.570651+0000","last_active":"2024-09-21T03:14:48.577935+0000","last_peered":"2024-09-21T03:14:48.577935+0000","last_clean":"2024-09-21T03:14:48.577935+0000","last_became_active":"2024-09-21T03:14:47.568081+0000","last_became_peered":"2024-09-21T03:14:47.568081+0000","last_unstale":"2024-09-21T03:14:48.577935+0000","last_undegraded":"2024-09-21T03:14:48.577935+0000","last_fullsized":"2024-09-21T03:14:48.577935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:45.036938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580418+0000","last_change":"2024-09-21T03:14:37.475076+0000","last_active":"2024-09-21T03:14:48.580418+0000","last_peered":"2024-09-21T03:14:48.580418+0000","last_clean":"2024-09-21T03:14:48.580418+0000","last_became_active":"2024-09-21T03:14:37.474595+0000","last_became_peered":"2024-09-21T03:14:37.474595+0000","last_unstale":"2024-09-21T03:14:48.580418+0000","last_undegraded":"2024-09-21T03:14:48.580418+0000","last_fullsized":"2024-09-21T03:14:48.580418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:16.880647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577631+0000","last_change":"2024-09-21T03:14:38.483226+0000","last_active":"2024-09-21T03:14:48.577631+0000","last_peered":"2024-09-21T03:14:48.577631+0000","last_clean":"2024-09-21T03:14:48.577631+0000","last_became_active":"2024-09-21T03:14:38.482354+0000","last_became_peered":"2024-09-21T03:14:38.482354+0000","last_unstale":"2024-09-21T03:14:48.577631+0000","last_undegraded":"2024-09-21T03:14:48.577631+0000","last_fullsized":"2024-09-21T03:14:48.577631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:51.488594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578124+0000","last_change":"2024-09-21T03:14:46.551282+0000","last_active":"2024-09-21T03:14:48.578124+0000","last_peered":"2024-09-21T03:14:48.578124+0000","last_clean":"2024-09-21T03:14:48.578124+0000","last_became_active":"2024-09-21T03:14:46.550191+0000","last_became_peered":"2024-09-21T03:14:46.550191+0000","last_unstale":"2024-09-21T03:14:48.578124+0000","last_undegraded":"2024-09-21T03:14:48.578124+0000","last_fullsized":"2024-09-21T03:14:48.578124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:32.136739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557152+0000","last_change":"2024-09-21T03:14:47.561737+0000","last_active":"2024-09-21T03:14:48.557152+0000","last_peered":"2024-09-21T03:14:48.557152+0000","last_clean":"2024-09-21T03:14:48.557152+0000","last_became_active":"2024-09-21T03:14:47.557518+0000","last_became_peered":"2024-09-21T03:14:47.557518+0000","last_unstale":"2024-09-21T03:14:48.557152+0000","last_undegraded":"2024-09-21T03:14:48.557152+0000","last_fullsized":"2024-09-21T03:14:48.557152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:00.342378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.559033+0000","last_change":"2024-09-21T03:14:37.465536+0000","last_active":"2024-09-21T03:14:48.559033+0000","last_peered":"2024-09-21T03:14:48.559033+0000","last_clean":"2024-09-21T03:14:48.559033+0000","last_became_active":"2024-09-21T03:14:37.465240+0000","last_became_peered":"2024-09-21T03:14:37.465240+0000","last_unstale":"2024-09-21T03:14:48.559033+0000","last_undegraded":"2024-09-21T03:14:48.559033+0000","last_fullsized":"2024-09-21T03:14:48.559033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:34.780298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578325+0000","last_change":"2024-09-21T03:14:38.474516+0000","last_active":"2024-09-21T03:14:48.578325+0000","last_peered":"2024-09-21T03:14:48.578325+0000","last_clean":"2024-09-21T03:14:48.578325+0000","last_became_active":"2024-09-21T03:14:38.472225+0000","last_became_peered":"2024-09-21T03:14:38.472225+0000","last_unstale":"2024-09-21T03:14:48.578325+0000","last_undegraded":"2024-09-21T03:14:48.578325+0000","last_fullsized":"2024-09-21T03:14:48.578325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:47.504910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566849+0000","last_change":"2024-09-21T03:14:46.544072+0000","last_active":"2024-09-21T03:14:48.566849+0000","last_peered":"2024-09-21T03:14:48.566849+0000","last_clean":"2024-09-21T03:14:48.566849+0000","last_became_active":"2024-09-21T03:14:46.543729+0000","last_became_peered":"2024-09-21T03:14:46.543729+0000","last_unstale":"2024-09-21T03:14:48.566849+0000","last_undegraded":"2024-09-21T03:14:48.566849+0000","last_fullsized":"2024-09-21T03:14:48.566849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:18.560012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578210+0000","last_change":"2024-09-21T03:14:47.563764+0000","last_active":"2024-09-21T03:14:48.578210+0000","last_peered":"2024-09-21T03:14:48.578210+0000","last_clean":"2024-09-21T03:14:48.578210+0000","last_became_active":"2024-09-21T03:14:47.562943+0000","last_became_peered":"2024-09-21T03:14:47.562943+0000","last_unstale":"2024-09-21T03:14:48.578210+0000","last_undegraded":"2024-09-21T03:14:48.578210+0000","last_fullsized":"2024-09-21T03:14:48.578210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:39.284350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556697+0000","last_change":"2024-09-21T03:14:38.484311+0000","last_active":"2024-09-21T03:14:48.556697+0000","last_peered":"2024-09-21T03:14:48.556697+0000","last_clean":"2024-09-21T03:14:48.556697+0000","last_became_active":"2024-09-21T03:14:38.483975+0000","last_became_peered":"2024-09-21T03:14:38.483975+0000","last_unstale":"2024-09-21T03:14:48.556697+0000","last_undegraded":"2024-09-21T03:14:48.556697+0000","last_fullsized":"2024-09-21T03:14:48.556697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:31.145431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578221+0000","last_change":"2024-09-21T03:14:47.566252+0000","last_active":"2024-09-21T03:14:48.578221+0000","last_peered":"2024-09-21T03:14:48.578221+0000","last_clean":"2024-09-21T03:14:48.578221+0000","last_became_active":"2024-09-21T03:14:47.560282+0000","last_became_peered":"2024-09-21T03:14:47.560282+0000","last_unstale":"2024-09-21T03:14:48.578221+0000","last_undegraded":"2024-09-21T03:14:48.578221+0000","last_fullsized":"2024-09-21T03:14:48.578221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:23.553847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566179+0000","last_change":"2024-09-21T03:14:38.477183+0000","last_active":"2024-09-21T03:14:48.566179+0000","last_peered":"2024-09-21T03:14:48.566179+0000","last_clean":"2024-09-21T03:14:48.566179+0000","last_became_active":"2024-09-21T03:14:38.476657+0000","last_became_peered":"2024-09-21T03:14:38.476657+0000","last_unstale":"2024-09-21T03:14:48.566179+0000","last_undegraded":"2024-09-21T03:14:48.566179+0000","last_fullsized":"2024-09-21T03:14:48.566179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:36.801764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557242+0000","last_change":"2024-09-21T03:14:47.574339+0000","last_active":"2024-09-21T03:14:48.557242+0000","last_peered":"2024-09-21T03:14:48.557242+0000","last_clean":"2024-09-21T03:14:48.557242+0000","last_became_active":"2024-09-21T03:14:47.565732+0000","last_became_peered":"2024-09-21T03:14:47.565732+0000","last_unstale":"2024-09-21T03:14:48.557242+0000","last_undegraded":"2024-09-21T03:14:48.557242+0000","last_fullsized":"2024-09-21T03:14:48.557242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:57.896810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580141+0000","last_change":"2024-09-21T03:14:38.472860+0000","last_active":"2024-09-21T03:14:48.580141+0000","last_peered":"2024-09-21T03:14:48.580141+0000","last_clean":"2024-09-21T03:14:48.580141+0000","last_became_active":"2024-09-21T03:14:38.472548+0000","last_became_peered":"2024-09-21T03:14:38.472548+0000","last_unstale":"2024-09-21T03:14:48.580141+0000","last_undegraded":"2024-09-21T03:14:48.580141+0000","last_fullsized":"2024-09-21T03:14:48.580141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:16.071692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.559519+0000","last_change":"2024-09-21T03:14:47.557402+0000","last_active":"2024-09-21T03:14:48.559519+0000","last_peered":"2024-09-21T03:14:48.559519+0000","last_clean":"2024-09-21T03:14:48.559519+0000","last_became_active":"2024-09-21T03:14:47.557047+0000","last_became_peered":"2024-09-21T03:14:47.557047+0000","last_unstale":"2024-09-21T03:14:48.559519+0000","last_undegraded":"2024-09-21T03:14:48.559519+0000","last_fullsized":"2024-09-21T03:14:48.559519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:29.792514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558904+0000","last_change":"2024-09-21T03:14:38.481039+0000","last_active":"2024-09-21T03:14:48.558904+0000","last_peered":"2024-09-21T03:14:48.558904+0000","last_clean":"2024-09-21T03:14:48.558904+0000","last_became_active":"2024-09-21T03:14:38.480686+0000","last_became_peered":"2024-09-21T03:14:38.480686+0000","last_unstale":"2024-09-21T03:14:48.558904+0000","last_undegraded":"2024-09-21T03:14:48.558904+0000","last_fullsized":"2024-09-21T03:14:48.558904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:18.603386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577036+0000","last_change":"2024-09-21T03:14:47.565697+0000","last_active":"2024-09-21T03:14:48.577036+0000","last_peered":"2024-09-21T03:14:48.577036+0000","last_clean":"2024-09-21T03:14:48.577036+0000","last_became_active":"2024-09-21T03:14:47.565393+0000","last_became_peered":"2024-09-21T03:14:47.565393+0000","last_unstale":"2024-09-21T03:14:48.577036+0000","last_undegraded":"2024-09-21T03:14:48.577036+0000","last_fullsized":"2024-09-21T03:14:48.577036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:35.421803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558553+0000","last_change":"2024-09-21T03:14:38.473900+0000","last_active":"2024-09-21T03:14:48.558553+0000","last_peered":"2024-09-21T03:14:48.558553+0000","last_clean":"2024-09-21T03:14:48.558553+0000","last_became_active":"2024-09-21T03:14:38.471325+0000","last_became_peered":"2024-09-21T03:14:38.471325+0000","last_unstale":"2024-09-21T03:14:48.558553+0000","last_undegraded":"2024-09-21T03:14:48.558553+0000","last_fullsized":"2024-09-21T03:14:48.558553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:47.556293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578046+0000","last_change":"2024-09-21T03:14:47.573726+0000","last_active":"2024-09-21T03:14:48.578046+0000","last_peered":"2024-09-21T03:14:48.578046+0000","last_clean":"2024-09-21T03:14:48.578046+0000","last_became_active":"2024-09-21T03:14:47.571074+0000","last_became_peered":"2024-09-21T03:14:47.571074+0000","last_unstale":"2024-09-21T03:14:48.578046+0000","last_undegraded":"2024-09-21T03:14:48.578046+0000","last_fullsized":"2024-09-21T03:14:48.578046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:53.755098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557408+0000","last_change":"2024-09-21T03:14:38.478099+0000","last_active":"2024-09-21T03:14:48.557408+0000","last_peered":"2024-09-21T03:14:48.557408+0000","last_clean":"2024-09-21T03:14:48.557408+0000","last_became_active":"2024-09-21T03:14:38.475894+0000","last_became_peered":"2024-09-21T03:14:38.475894+0000","last_unstale":"2024-09-21T03:14:48.557408+0000","last_undegraded":"2024-09-21T03:14:48.557408+0000","last_fullsized":"2024-09-21T03:14:48.557408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:49.876430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577542+0000","last_change":"2024-09-21T03:14:47.556933+0000","last_active":"2024-09-21T03:14:48.577542+0000","last_peered":"2024-09-21T03:14:48.577542+0000","last_clean":"2024-09-21T03:14:48.577542+0000","last_became_active":"2024-09-21T03:14:47.556615+0000","last_became_peered":"2024-09-21T03:14:47.556615+0000","last_unstale":"2024-09-21T03:14:48.577542+0000","last_undegraded":"2024-09-21T03:14:48.577542+0000","last_fullsized":"2024-09-21T03:14:48.577542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:27.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557365+0000","last_change":"2024-09-21T03:14:38.484198+0000","last_active":"2024-09-21T03:14:48.557365+0000","last_peered":"2024-09-21T03:14:48.557365+0000","last_clean":"2024-09-21T03:14:48.557365+0000","last_became_active":"2024-09-21T03:14:38.483893+0000","last_became_peered":"2024-09-21T03:14:38.483893+0000","last_unstale":"2024-09-21T03:14:48.557365+0000","last_undegraded":"2024-09-21T03:14:48.557365+0000","last_fullsized":"2024-09-21T03:14:48.557365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:56.665359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556286+0000","last_change":"2024-09-21T03:14:47.553479+0000","last_active":"2024-09-21T03:14:48.556286+0000","last_peered":"2024-09-21T03:14:48.556286+0000","last_clean":"2024-09-21T03:14:48.556286+0000","last_became_active":"2024-09-21T03:14:47.553144+0000","last_became_peered":"2024-09-21T03:14:47.553144+0000","last_unstale":"2024-09-21T03:14:48.556286+0000","last_undegraded":"2024-09-21T03:14:48.556286+0000","last_fullsized":"2024-09-21T03:14:48.556286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:26.321488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558236+0000","last_change":"2024-09-21T03:14:38.487093+0000","last_active":"2024-09-21T03:14:48.558236+0000","last_peered":"2024-09-21T03:14:48.558236+0000","last_clean":"2024-09-21T03:14:48.558236+0000","last_became_active":"2024-09-21T03:14:38.486204+0000","last_became_peered":"2024-09-21T03:14:38.486204+0000","last_unstale":"2024-09-21T03:14:48.558236+0000","last_undegraded":"2024-09-21T03:14:48.558236+0000","last_fullsized":"2024-09-21T03:14:48.558236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:55.531046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566794+0000","last_change":"2024-09-21T03:14:47.573375+0000","last_active":"2024-09-21T03:14:48.566794+0000","last_peered":"2024-09-21T03:14:48.566794+0000","last_clean":"2024-09-21T03:14:48.566794+0000","last_became_active":"2024-09-21T03:14:47.572717+0000","last_became_peered":"2024-09-21T03:14:47.572717+0000","last_unstale":"2024-09-21T03:14:48.566794+0000","last_undegraded":"2024-09-21T03:14:48.566794+0000","last_fullsized":"2024-09-21T03:14:48.566794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:44.673283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577931+0000","last_change":"2024-09-21T03:14:38.471959+0000","last_active":"2024-09-21T03:14:48.577931+0000","last_peered":"2024-09-21T03:14:48.577931+0000","last_clean":"2024-09-21T03:14:48.577931+0000","last_became_active":"2024-09-21T03:14:38.471625+0000","last_became_peered":"2024-09-21T03:14:38.471625+0000","last_unstale":"2024-09-21T03:14:48.577931+0000","last_undegraded":"2024-09-21T03:14:48.577931+0000","last_fullsized":"2024-09-21T03:14:48.577931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:17.761951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581065+0000","last_change":"2024-09-21T03:14:47.564597+0000","last_active":"2024-09-21T03:14:48.581065+0000","last_peered":"2024-09-21T03:14:48.581065+0000","last_clean":"2024-09-21T03:14:48.581065+0000","last_became_active":"2024-09-21T03:14:47.563816+0000","last_became_peered":"2024-09-21T03:14:47.563816+0000","last_unstale":"2024-09-21T03:14:48.581065+0000","last_undegraded":"2024-09-21T03:14:48.581065+0000","last_fullsized":"2024-09-21T03:14:48.581065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:33.061271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557771+0000","last_change":"2024-09-21T03:14:38.491888+0000","last_active":"2024-09-21T03:14:48.557771+0000","last_peered":"2024-09-21T03:14:48.557771+0000","last_clean":"2024-09-21T03:14:48.557771+0000","last_became_active":"2024-09-21T03:14:38.491510+0000","last_became_peered":"2024-09-21T03:14:38.491510+0000","last_unstale":"2024-09-21T03:14:48.557771+0000","last_undegraded":"2024-09-21T03:14:48.557771+0000","last_fullsized":"2024-09-21T03:14:48.557771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:26.740304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558275+0000","last_change":"2024-09-21T03:14:47.564310+0000","last_active":"2024-09-21T03:14:48.558275+0000","last_peered":"2024-09-21T03:14:48.558275+0000","last_clean":"2024-09-21T03:14:48.558275+0000","last_became_active":"2024-09-21T03:14:47.564003+0000","last_became_peered":"2024-09-21T03:14:47.564003+0000","last_unstale":"2024-09-21T03:14:48.558275+0000","last_undegraded":"2024-09-21T03:14:48.558275+0000","last_fullsized":"2024-09-21T03:14:48.558275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:45.016321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578256+0000","last_change":"2024-09-21T03:14:38.470991+0000","last_active":"2024-09-21T03:14:48.578256+0000","last_peered":"2024-09-21T03:14:48.578256+0000","last_clean":"2024-09-21T03:14:48.578256+0000","last_became_active":"2024-09-21T03:14:38.470666+0000","last_became_peered":"2024-09-21T03:14:38.470666+0000","last_unstale":"2024-09-21T03:14:48.578256+0000","last_undegraded":"2024-09-21T03:14:48.578256+0000","last_fullsized":"2024-09-21T03:14:48.578256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:25.477992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566757+0000","last_change":"2024-09-21T03:14:47.575212+0000","last_active":"2024-09-21T03:14:48.566757+0000","last_peered":"2024-09-21T03:14:48.566757+0000","last_clean":"2024-09-21T03:14:48.566757+0000","last_became_active":"2024-09-21T03:14:47.574895+0000","last_became_peered":"2024-09-21T03:14:47.574895+0000","last_unstale":"2024-09-21T03:14:48.566757+0000","last_undegraded":"2024-09-21T03:14:48.566757+0000","last_fullsized":"2024-09-21T03:14:48.566757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:04.240949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577570+0000","last_change":"2024-09-21T03:14:38.482681+0000","last_active":"2024-09-21T03:14:48.577570+0000","last_peered":"2024-09-21T03:14:48.577570+0000","last_clean":"2024-09-21T03:14:48.577570+0000","last_became_active":"2024-09-21T03:14:38.477816+0000","last_became_peered":"2024-09-21T03:14:38.477816+0000","last_unstale":"2024-09-21T03:14:48.577570+0000","last_undegraded":"2024-09-21T03:14:48.577570+0000","last_fullsized":"2024-09-21T03:14:48.577570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:18.675641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557132+0000","last_change":"2024-09-21T03:14:47.555329+0000","last_active":"2024-09-21T03:14:48.557132+0000","last_peered":"2024-09-21T03:14:48.557132+0000","last_clean":"2024-09-21T03:14:48.557132+0000","last_became_active":"2024-09-21T03:14:47.555033+0000","last_became_peered":"2024-09-21T03:14:47.555033+0000","last_unstale":"2024-09-21T03:14:48.557132+0000","last_undegraded":"2024-09-21T03:14:48.557132+0000","last_fullsized":"2024-09-21T03:14:48.557132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:49.060834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578610+0000","last_change":"2024-09-21T03:14:38.480638+0000","last_active":"2024-09-21T03:14:48.578610+0000","last_peered":"2024-09-21T03:14:48.578610+0000","last_clean":"2024-09-21T03:14:48.578610+0000","last_became_active":"2024-09-21T03:14:38.477739+0000","last_became_peered":"2024-09-21T03:14:38.477739+0000","last_unstale":"2024-09-21T03:14:48.578610+0000","last_undegraded":"2024-09-21T03:14:48.578610+0000","last_fullsized":"2024-09-21T03:14:48.578610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:35.097761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577900+0000","last_change":"2024-09-21T03:14:47.573659+0000","last_active":"2024-09-21T03:14:48.577900+0000","last_peered":"2024-09-21T03:14:48.577900+0000","last_clean":"2024-09-21T03:14:48.577900+0000","last_became_active":"2024-09-21T03:14:47.572756+0000","last_became_peered":"2024-09-21T03:14:47.572756+0000","last_unstale":"2024-09-21T03:14:48.577900+0000","last_undegraded":"2024-09-21T03:14:48.577900+0000","last_fullsized":"2024-09-21T03:14:48.577900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:21.986681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581406+0000","last_change":"2024-09-21T03:14:38.478039+0000","last_active":"2024-09-21T03:14:48.581406+0000","last_peered":"2024-09-21T03:14:48.581406+0000","last_clean":"2024-09-21T03:14:48.581406+0000","last_became_active":"2024-09-21T03:14:38.473843+0000","last_became_peered":"2024-09-21T03:14:38.473843+0000","last_unstale":"2024-09-21T03:14:48.581406+0000","last_undegraded":"2024-09-21T03:14:48.581406+0000","last_fullsized":"2024-09-21T03:14:48.581406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:27.072406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556166+0000","last_change":"2024-09-21T03:14:47.555386+0000","last_active":"2024-09-21T03:14:48.556166+0000","last_peered":"2024-09-21T03:14:48.556166+0000","last_clean":"2024-09-21T03:14:48.556166+0000","last_became_active":"2024-09-21T03:14:47.554758+0000","last_became_peered":"2024-09-21T03:14:47.554758+0000","last_unstale":"2024-09-21T03:14:48.556166+0000","last_undegraded":"2024-09-21T03:14:48.556166+0000","last_fullsized":"2024-09-21T03:14:48.556166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:47.574672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566912+0000","last_change":"2024-09-21T03:14:38.494878+0000","last_active":"2024-09-21T03:14:48.566912+0000","last_peered":"2024-09-21T03:14:48.566912+0000","last_clean":"2024-09-21T03:14:48.566912+0000","last_became_active":"2024-09-21T03:14:38.492813+0000","last_became_peered":"2024-09-21T03:14:38.492813+0000","last_unstale":"2024-09-21T03:14:48.566912+0000","last_undegraded":"2024-09-21T03:14:48.566912+0000","last_fullsized":"2024-09-21T03:14:48.566912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:55.064844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557554+0000","last_change":"2024-09-21T03:14:47.544806+0000","last_active":"2024-09-21T03:14:48.557554+0000","last_peered":"2024-09-21T03:14:48.557554+0000","last_clean":"2024-09-21T03:14:48.557554+0000","last_became_active":"2024-09-21T03:14:47.544431+0000","last_became_peered":"2024-09-21T03:14:47.544431+0000","last_unstale":"2024-09-21T03:14:48.557554+0000","last_undegraded":"2024-09-21T03:14:48.557554+0000","last_fullsized":"2024-09-21T03:14:48.557554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:01.463573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581015+0000","last_change":"2024-09-21T03:14:38.474462+0000","last_active":"2024-09-21T03:14:48.581015+0000","last_peered":"2024-09-21T03:14:48.581015+0000","last_clean":"2024-09-21T03:14:48.581015+0000","last_became_active":"2024-09-21T03:14:38.474156+0000","last_became_peered":"2024-09-21T03:14:38.474156+0000","last_unstale":"2024-09-21T03:14:48.581015+0000","last_undegraded":"2024-09-21T03:14:48.581015+0000","last_fullsized":"2024-09-21T03:14:48.581015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:55.329945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578169+0000","last_change":"2024-09-21T03:14:47.563297+0000","last_active":"2024-09-21T03:14:48.578169+0000","last_peered":"2024-09-21T03:14:48.578169+0000","last_clean":"2024-09-21T03:14:48.578169+0000","last_became_active":"2024-09-21T03:14:47.562519+0000","last_became_peered":"2024-09-21T03:14:47.562519+0000","last_unstale":"2024-09-21T03:14:48.578169+0000","last_undegraded":"2024-09-21T03:14:48.578169+0000","last_fullsized":"2024-09-21T03:14:48.578169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:47.959373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577713+0000","last_change":"2024-09-21T03:14:38.474262+0000","last_active":"2024-09-21T03:14:48.577713+0000","last_peered":"2024-09-21T03:14:48.577713+0000","last_clean":"2024-09-21T03:14:48.577713+0000","last_became_active":"2024-09-21T03:14:38.473856+0000","last_became_peered":"2024-09-21T03:14:38.473856+0000","last_unstale":"2024-09-21T03:14:48.577713+0000","last_undegraded":"2024-09-21T03:14:48.577713+0000","last_fullsized":"2024-09-21T03:14:48.577713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579491+0000","last_change":"2024-09-21T03:14:47.558732+0000","last_active":"2024-09-21T03:14:48.579491+0000","last_peered":"2024-09-21T03:14:48.579491+0000","last_clean":"2024-09-21T03:14:48.579491+0000","last_became_active":"2024-09-21T03:14:47.558403+0000","last_became_peered":"2024-09-21T03:14:47.558403+0000","last_unstale":"2024-09-21T03:14:48.579491+0000","last_undegraded":"2024-09-21T03:14:48.579491+0000","last_fullsized":"2024-09-21T03:14:48.579491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:46.054565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557583+0000","last_change":"2024-09-21T03:14:38.469736+0000","last_active":"2024-09-21T03:14:48.557583+0000","last_peered":"2024-09-21T03:14:48.557583+0000","last_clean":"2024-09-21T03:14:48.557583+0000","last_became_active":"2024-09-21T03:14:38.469240+0000","last_became_peered":"2024-09-21T03:14:38.469240+0000","last_unstale":"2024-09-21T03:14:48.557583+0000","last_undegraded":"2024-09-21T03:14:48.557583+0000","last_fullsized":"2024-09-21T03:14:48.557583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:04.258761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578598+0000","last_change":"2024-09-21T03:14:47.550684+0000","last_active":"2024-09-21T03:14:48.578598+0000","last_peered":"2024-09-21T03:14:48.578598+0000","last_clean":"2024-09-21T03:14:48.578598+0000","last_became_active":"2024-09-21T03:14:47.550375+0000","last_became_peered":"2024-09-21T03:14:47.550375+0000","last_unstale":"2024-09-21T03:14:48.578598+0000","last_undegraded":"2024-09-21T03:14:48.578598+0000","last_fullsized":"2024-09-21T03:14:48.578598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:05.268160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557691+0000","last_change":"2024-09-21T03:14:38.487983+0000","last_active":"2024-09-21T03:14:48.557691+0000","last_peered":"2024-09-21T03:14:48.557691+0000","last_clean":"2024-09-21T03:14:48.557691+0000","last_became_active":"2024-09-21T03:14:38.487676+0000","last_became_peered":"2024-09-21T03:14:38.487676+0000","last_unstale":"2024-09-21T03:14:48.557691+0000","last_undegraded":"2024-09-21T03:14:48.557691+0000","last_fullsized":"2024-09-21T03:14:48.557691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:35.320169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580600+0000","last_change":"2024-09-21T03:14:47.561566+0000","last_active":"2024-09-21T03:14:48.580600+0000","last_peered":"2024-09-21T03:14:48.580600+0000","last_clean":"2024-09-21T03:14:48.580600+0000","last_became_active":"2024-09-21T03:14:47.561229+0000","last_became_peered":"2024-09-21T03:14:47.561229+0000","last_unstale":"2024-09-21T03:14:48.580600+0000","last_undegraded":"2024-09-21T03:14:48.580600+0000","last_fullsized":"2024-09-21T03:14:48.580600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:07.280356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558891+0000","last_change":"2024-09-21T03:14:38.478853+0000","last_active":"2024-09-21T03:14:48.558891+0000","last_peered":"2024-09-21T03:14:48.558891+0000","last_clean":"2024-09-21T03:14:48.558891+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:14:48.558891+0000","last_undegraded":"2024-09-21T03:14:48.558891+0000","last_fullsized":"2024-09-21T03:14:48.558891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:31.427596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577155+0000","last_change":"2024-09-21T03:14:47.553172+0000","last_active":"2024-09-21T03:14:48.577155+0000","last_peered":"2024-09-21T03:14:48.577155+0000","last_clean":"2024-09-21T03:14:48.577155+0000","last_became_active":"2024-09-21T03:14:47.552659+0000","last_became_peered":"2024-09-21T03:14:47.552659+0000","last_unstale":"2024-09-21T03:14:48.577155+0000","last_undegraded":"2024-09-21T03:14:48.577155+0000","last_fullsized":"2024-09-21T03:14:48.577155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:16:20.114663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578509+0000","last_change":"2024-09-21T03:14:38.481308+0000","last_active":"2024-09-21T03:14:48.578509+0000","last_peered":"2024-09-21T03:14:48.578509+0000","last_clean":"2024-09-21T03:14:48.578509+0000","last_became_active":"2024-09-21T03:14:38.480923+0000","last_became_peered":"2024-09-21T03:14:38.480923+0000","last_unstale":"2024-09-21T03:14:48.578509+0000","last_undegraded":"2024-09-21T03:14:48.578509+0000","last_fullsized":"2024-09-21T03:14:48.578509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:40.689231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557324+0000","last_change":"2024-09-21T03:14:47.561972+0000","last_active":"2024-09-21T03:14:48.557324+0000","last_peered":"2024-09-21T03:14:48.557324+0000","last_clean":"2024-09-21T03:14:48.557324+0000","last_became_active":"2024-09-21T03:14:47.561645+0000","last_became_peered":"2024-09-21T03:14:47.561645+0000","last_unstale":"2024-09-21T03:14:48.557324+0000","last_undegraded":"2024-09-21T03:14:48.557324+0000","last_fullsized":"2024-09-21T03:14:48.557324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:57.526787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579480+0000","last_change":"2024-09-21T03:14:38.473907+0000","last_active":"2024-09-21T03:14:48.579480+0000","last_peered":"2024-09-21T03:14:48.579480+0000","last_clean":"2024-09-21T03:14:48.579480+0000","last_became_active":"2024-09-21T03:14:38.473579+0000","last_became_peered":"2024-09-21T03:14:38.473579+0000","last_unstale":"2024-09-21T03:14:48.579480+0000","last_undegraded":"2024-09-21T03:14:48.579480+0000","last_fullsized":"2024-09-21T03:14:48.579480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:32.273503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577349+0000","last_change":"2024-09-21T03:14:47.566089+0000","last_active":"2024-09-21T03:14:48.577349+0000","last_peered":"2024-09-21T03:14:48.577349+0000","last_clean":"2024-09-21T03:14:48.577349+0000","last_became_active":"2024-09-21T03:14:47.565681+0000","last_became_peered":"2024-09-21T03:14:47.565681+0000","last_unstale":"2024-09-21T03:14:48.577349+0000","last_undegraded":"2024-09-21T03:14:48.577349+0000","last_fullsized":"2024-09-21T03:14:48.577349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.208933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579474+0000","last_change":"2024-09-21T03:14:38.474326+0000","last_active":"2024-09-21T03:14:48.579474+0000","last_peered":"2024-09-21T03:14:48.579474+0000","last_clean":"2024-09-21T03:14:48.579474+0000","last_became_active":"2024-09-21T03:14:38.470430+0000","last_became_peered":"2024-09-21T03:14:38.470430+0000","last_unstale":"2024-09-21T03:14:48.579474+0000","last_undegraded":"2024-09-21T03:14:48.579474+0000","last_fullsized":"2024-09-21T03:14:48.579474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:09.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577186+0000","last_change":"2024-09-21T03:14:47.571487+0000","last_active":"2024-09-21T03:14:48.577186+0000","last_peered":"2024-09-21T03:14:48.577186+0000","last_clean":"2024-09-21T03:14:48.577186+0000","last_became_active":"2024-09-21T03:14:47.571126+0000","last_became_peered":"2024-09-21T03:14:47.571126+0000","last_unstale":"2024-09-21T03:14:48.577186+0000","last_undegraded":"2024-09-21T03:14:48.577186+0000","last_fullsized":"2024-09-21T03:14:48.577186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:57.128853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580122+0000","last_change":"2024-09-21T03:14:38.483370+0000","last_active":"2024-09-21T03:14:48.580122+0000","last_peered":"2024-09-21T03:14:48.580122+0000","last_clean":"2024-09-21T03:14:48.580122+0000","last_became_active":"2024-09-21T03:14:38.483019+0000","last_became_peered":"2024-09-21T03:14:38.483019+0000","last_unstale":"2024-09-21T03:14:48.580122+0000","last_undegraded":"2024-09-21T03:14:48.580122+0000","last_fullsized":"2024-09-21T03:14:48.580122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:55.085422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558300+0000","last_change":"2024-09-21T03:14:47.555777+0000","last_active":"2024-09-21T03:14:48.558300+0000","last_peered":"2024-09-21T03:14:48.558300+0000","last_clean":"2024-09-21T03:14:48.558300+0000","last_became_active":"2024-09-21T03:14:47.555465+0000","last_became_peered":"2024-09-21T03:14:47.555465+0000","last_unstale":"2024-09-21T03:14:48.558300+0000","last_undegraded":"2024-09-21T03:14:48.558300+0000","last_fullsized":"2024-09-21T03:14:48.558300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:27.123740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556793+0000","last_change":"2024-09-21T03:14:38.465771+0000","last_active":"2024-09-21T03:14:48.556793+0000","last_peered":"2024-09-21T03:14:48.556793+0000","last_clean":"2024-09-21T03:14:48.556793+0000","last_became_active":"2024-09-21T03:14:38.465479+0000","last_became_peered":"2024-09-21T03:14:38.465479+0000","last_unstale":"2024-09-21T03:14:48.556793+0000","last_undegraded":"2024-09-21T03:14:48.556793+0000","last_fullsized":"2024-09-21T03:14:48.556793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.754315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557657+0000","last_change":"2024-09-21T03:14:47.567695+0000","last_active":"2024-09-21T03:14:48.557657+0000","last_peered":"2024-09-21T03:14:48.557657+0000","last_clean":"2024-09-21T03:14:48.557657+0000","last_became_active":"2024-09-21T03:14:47.566936+0000","last_became_peered":"2024-09-21T03:14:47.566936+0000","last_unstale":"2024-09-21T03:14:48.557657+0000","last_undegraded":"2024-09-21T03:14:48.557657+0000","last_fullsized":"2024-09-21T03:14:48.557657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:48.182523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577444+0000","last_change":"2024-09-21T03:14:38.482620+0000","last_active":"2024-09-21T03:14:48.577444+0000","last_peered":"2024-09-21T03:14:48.577444+0000","last_clean":"2024-09-21T03:14:48.577444+0000","last_became_active":"2024-09-21T03:14:38.482346+0000","last_became_peered":"2024-09-21T03:14:38.482346+0000","last_unstale":"2024-09-21T03:14:48.577444+0000","last_undegraded":"2024-09-21T03:14:48.577444+0000","last_fullsized":"2024-09-21T03:14:48.577444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:52.977725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577748+0000","last_change":"2024-09-21T03:14:47.580314+0000","last_active":"2024-09-21T03:14:48.577748+0000","last_peered":"2024-09-21T03:14:48.577748+0000","last_clean":"2024-09-21T03:14:48.577748+0000","last_became_active":"2024-09-21T03:14:47.576499+0000","last_became_peered":"2024-09-21T03:14:47.576499+0000","last_unstale":"2024-09-21T03:14:48.577748+0000","last_undegraded":"2024-09-21T03:14:48.577748+0000","last_fullsized":"2024-09-21T03:14:48.577748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:46.154586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557118+0000","last_change":"2024-09-21T03:14:38.471270+0000","last_active":"2024-09-21T03:14:48.557118+0000","last_peered":"2024-09-21T03:14:48.557118+0000","last_clean":"2024-09-21T03:14:48.557118+0000","last_became_active":"2024-09-21T03:14:38.470708+0000","last_became_peered":"2024-09-21T03:14:38.470708+0000","last_unstale":"2024-09-21T03:14:48.557118+0000","last_undegraded":"2024-09-21T03:14:48.557118+0000","last_fullsized":"2024-09-21T03:14:48.557118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.122804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578504+0000","last_change":"2024-09-21T03:14:47.554180+0000","last_active":"2024-09-21T03:14:48.578504+0000","last_peered":"2024-09-21T03:14:48.578504+0000","last_clean":"2024-09-21T03:14:48.578504+0000","last_became_active":"2024-09-21T03:14:47.552808+0000","last_became_peered":"2024-09-21T03:14:47.552808+0000","last_unstale":"2024-09-21T03:14:48.578504+0000","last_undegraded":"2024-09-21T03:14:48.578504+0000","last_fullsized":"2024-09-21T03:14:48.578504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:07.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578111+0000","last_change":"2024-09-21T03:14:38.466077+0000","last_active":"2024-09-21T03:14:48.578111+0000","last_peered":"2024-09-21T03:14:48.578111+0000","last_clean":"2024-09-21T03:14:48.578111+0000","last_became_active":"2024-09-21T03:14:38.465818+0000","last_became_peered":"2024-09-21T03:14:38.465818+0000","last_unstale":"2024-09-21T03:14:48.578111+0000","last_undegraded":"2024-09-21T03:14:48.578111+0000","last_fullsized":"2024-09-21T03:14:48.578111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:34.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566406+0000","last_change":"2024-09-21T03:14:47.577228+0000","last_active":"2024-09-21T03:14:48.566406+0000","last_peered":"2024-09-21T03:14:48.566406+0000","last_clean":"2024-09-21T03:14:48.566406+0000","last_became_active":"2024-09-21T03:14:47.576843+0000","last_became_peered":"2024-09-21T03:14:47.576843+0000","last_unstale":"2024-09-21T03:14:48.566406+0000","last_undegraded":"2024-09-21T03:14:48.566406+0000","last_fullsized":"2024-09-21T03:14:48.566406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:56.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557247+0000","last_change":"2024-09-21T03:14:38.481389+0000","last_active":"2024-09-21T03:14:48.557247+0000","last_peered":"2024-09-21T03:14:48.557247+0000","last_clean":"2024-09-21T03:14:48.557247+0000","last_became_active":"2024-09-21T03:14:38.470907+0000","last_became_peered":"2024-09-21T03:14:38.470907+0000","last_unstale":"2024-09-21T03:14:48.557247+0000","last_undegraded":"2024-09-21T03:14:48.557247+0000","last_fullsized":"2024-09-21T03:14:48.557247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:30.068915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558355+0000","last_change":"2024-09-21T03:14:47.551766+0000","last_active":"2024-09-21T03:14:48.558355+0000","last_peered":"2024-09-21T03:14:48.558355+0000","last_clean":"2024-09-21T03:14:48.558355+0000","last_became_active":"2024-09-21T03:14:47.551420+0000","last_became_peered":"2024-09-21T03:14:47.551420+0000","last_unstale":"2024-09-21T03:14:48.558355+0000","last_undegraded":"2024-09-21T03:14:48.558355+0000","last_fullsized":"2024-09-21T03:14:48.558355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:56.255472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.559417+0000","last_change":"2024-09-21T03:14:38.482605+0000","last_active":"2024-09-21T03:14:48.559417+0000","last_peered":"2024-09-21T03:14:48.559417+0000","last_clean":"2024-09-21T03:14:48.559417+0000","last_became_active":"2024-09-21T03:14:38.482306+0000","last_became_peered":"2024-09-21T03:14:38.482306+0000","last_unstale":"2024-09-21T03:14:48.559417+0000","last_undegraded":"2024-09-21T03:14:48.559417+0000","last_fullsized":"2024-09-21T03:14:48.559417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:40.482635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556625+0000","last_change":"2024-09-21T03:14:47.555070+0000","last_active":"2024-09-21T03:14:48.556625+0000","last_peered":"2024-09-21T03:14:48.556625+0000","last_clean":"2024-09-21T03:14:48.556625+0000","last_became_active":"2024-09-21T03:14:47.554363+0000","last_became_peered":"2024-09-21T03:14:47.554363+0000","last_unstale":"2024-09-21T03:14:48.556625+0000","last_undegraded":"2024-09-21T03:14:48.556625+0000","last_fullsized":"2024-09-21T03:14:48.556625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:40.027266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558524+0000","last_change":"2024-09-21T03:14:38.496218+0000","last_active":"2024-09-21T03:14:48.558524+0000","last_peered":"2024-09-21T03:14:48.558524+0000","last_clean":"2024-09-21T03:14:48.558524+0000","last_became_active":"2024-09-21T03:14:38.488537+0000","last_became_peered":"2024-09-21T03:14:38.488537+0000","last_unstale":"2024-09-21T03:14:48.558524+0000","last_undegraded":"2024-09-21T03:14:48.558524+0000","last_fullsized":"2024-09-21T03:14:48.558524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:59.667392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556307+0000","last_change":"2024-09-21T03:14:47.564250+0000","last_active":"2024-09-21T03:14:48.556307+0000","last_peered":"2024-09-21T03:14:48.556307+0000","last_clean":"2024-09-21T03:14:48.556307+0000","last_became_active":"2024-09-21T03:14:47.563745+0000","last_became_peered":"2024-09-21T03:14:47.563745+0000","last_unstale":"2024-09-21T03:14:48.556307+0000","last_undegraded":"2024-09-21T03:14:48.556307+0000","last_fullsized":"2024-09-21T03:14:48.556307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:31.282910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579673+0000","last_change":"2024-09-21T03:14:38.490309+0000","last_active":"2024-09-21T03:14:48.579673+0000","last_peered":"2024-09-21T03:14:48.579673+0000","last_clean":"2024-09-21T03:14:48.579673+0000","last_became_active":"2024-09-21T03:14:38.489167+0000","last_became_peered":"2024-09-21T03:14:38.489167+0000","last_unstale":"2024-09-21T03:14:48.579673+0000","last_undegraded":"2024-09-21T03:14:48.579673+0000","last_fullsized":"2024-09-21T03:14:48.579673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:07.725691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":100668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":691564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":104440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":102168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":860160,"data_stored":691030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":100668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":102134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":101880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:14:57.305 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:14:57.537 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:14:57.541 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:14:57.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.556+0000 7fdf2b200640 1 -- 172.21.15.90:0/2017291606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf2c06e380 msgr2=0x7fdf2c1615a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:57.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.556+0000 7fdf2b200640 1 --2- 172.21.15.90:0/2017291606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf2c06e380 0x7fdf2c1615a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0c9dd0 tx=0x7fdf2402a8b0 comp rx=0 tx=0).stop 2024-09-21T03:14:57.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.556+0000 7fdf2b200640 1 -- 172.21.15.90:0/2017291606 shutdown_connections 2024-09-21T03:14:57.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.556+0000 7fdf2b200640 1 --2- 172.21.15.90:0/2017291606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf2c06e380 0x7fdf2c1615a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:57.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.556+0000 7fdf2b200640 1 --2- 172.21.15.90:0/2017291606 >> v2:172.21.15.149:3300/0 conn(0x7fdf2c0c7900 0x7fdf2c0c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:57.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.556+0000 7fdf2b200640 1 -- 172.21.15.90:0/2017291606 >> 172.21.15.90:0/2017291606 conn(0x7fdf2c0c8d90 msgr2=0x7fdf2c0c91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:57.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.556+0000 7fdf2b200640 1 -- 172.21.15.90:0/2017291606 shutdown_connections 2024-09-21T03:14:57.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.556+0000 7fdf2b200640 1 -- 172.21.15.90:0/2017291606 wait complete. 2024-09-21T03:14:57.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.559+0000 7fdf2b200640 1 Processor -- start 2024-09-21T03:14:57.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.559+0000 7fdf2b200640 1 -- start start 2024-09-21T03:14:57.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.560+0000 7fdf2b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf2c06e380 0x7fdf2c0c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:57.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.560+0000 7fdf2b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf2c0c7900 0x7fdf2c0c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:57.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.560+0000 7fdf2b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf2c1545f0 0x7fdf2c1515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:57.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.560+0000 7fdf2b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c157b10 con 0x7fdf2c1545f0 2024-09-21T03:14:57.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.560+0000 7fdf2b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c0c75e0 con 0x7fdf2c0c7900 2024-09-21T03:14:57.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.560+0000 7fdf2b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdf2c0c89e0 con 0x7fdf2c06e380 2024-09-21T03:14:57.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.560+0000 7fdf2a800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf2c1545f0 0x7fdf2c1515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:57.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.560+0000 7fdf2a800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf2c1545f0 0x7fdf2c1515e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33530/0 (socket says 172.21.15.90:33530) 2024-09-21T03:14:57.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.560+0000 7fdf2a800640 1 -- 172.21.15.90:0/3390632286 learned_addr learned my addr 172.21.15.90:0/3390632286 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:57.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.560+0000 7fdf29e00640 1 --2- 172.21.15.90:0/3390632286 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf2c06e380 0x7fdf2c0c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:57.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.560+0000 7fdf23e00640 1 --2- 172.21.15.90:0/3390632286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf2c0c7900 0x7fdf2c0c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:57.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.561+0000 7fdf2a800640 1 -- 172.21.15.90:0/3390632286 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf2c06e380 msgr2=0x7fdf2c0c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:57.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.561+0000 7fdf2a800640 1 --2- 172.21.15.90:0/3390632286 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf2c06e380 0x7fdf2c0c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:57.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.561+0000 7fdf2a800640 1 -- 172.21.15.90:0/3390632286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf2c0c7900 msgr2=0x7fdf2c0c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:57.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.561+0000 7fdf2a800640 1 --2- 172.21.15.90:0/3390632286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf2c0c7900 0x7fdf2c0c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:57.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.561+0000 7fdf2a800640 1 -- 172.21.15.90:0/3390632286 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2c1eda20 con 0x7fdf2c1545f0 2024-09-21T03:14:57.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.561+0000 7fdf2a800640 1 --2- 172.21.15.90:0/3390632286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf2c1545f0 0x7fdf2c1515e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdf2402aea0 tx=0x7fdf24033f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:57.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.561+0000 7fdf22000640 1 -- 172.21.15.90:0/3390632286 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf24031990 con 0x7fdf2c1545f0 2024-09-21T03:14:57.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.561+0000 7fdf22000640 1 -- 172.21.15.90:0/3390632286 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf24031c20 con 0x7fdf2c1545f0 2024-09-21T03:14:57.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.561+0000 7fdf22000640 1 -- 172.21.15.90:0/3390632286 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf240330d0 con 0x7fdf2c1545f0 2024-09-21T03:14:57.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.561+0000 7fdf2b200640 1 -- 172.21.15.90:0/3390632286 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf2c1edc90 con 0x7fdf2c1545f0 2024-09-21T03:14:57.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.562+0000 7fdf2b200640 1 -- 172.21.15.90:0/3390632286 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf2c1eaab0 con 0x7fdf2c1545f0 2024-09-21T03:14:57.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.563+0000 7fdf2b200640 1 -- 172.21.15.90:0/3390632286 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf2c0c6e00 con 0x7fdf2c1545f0 2024-09-21T03:14:57.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.564+0000 7fdf22000640 1 -- 172.21.15.90:0/3390632286 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdf24033270 con 0x7fdf2c1545f0 2024-09-21T03:14:57.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.565+0000 7fdf22000640 1 --2- 172.21.15.90:0/3390632286 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdf08078b90 0x7fdf0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:57.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.565+0000 7fdf22000640 1 -- 172.21.15.90:0/3390632286 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fdf240bc3e0 con 0x7fdf2c1545f0 2024-09-21T03:14:57.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.565+0000 7fdf29e00640 1 --2- 172.21.15.90:0/3390632286 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdf08078b90 0x7fdf0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:57.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.566+0000 7fdf29e00640 1 --2- 172.21.15.90:0/3390632286 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdf08078b90 0x7fdf0807b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c009b30 tx=0x7fdf1c005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:57.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.570+0000 7fdf22000640 1 -- 172.21.15.90:0/3390632286 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdf2403f030 con 0x7fdf2c1545f0 2024-09-21T03:14:57.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.757+0000 7fdf2b200640 1 -- 172.21.15.90:0/3390632286 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdf2c0c9520 con 0x7fdf08078b90 2024-09-21T03:14:57.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.765+0000 7fdf22000640 1 -- 172.21.15.90:0/3390632286 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490296 (secure 0 0 0) 0x7fdf2c0c9520 con 0x7fdf08078b90 2024-09-21T03:14:57.773 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-21T03:14:57.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.771+0000 7fdf2b200640 1 -- 172.21.15.90:0/3390632286 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdf08078b90 msgr2=0x7fdf0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:57.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.771+0000 7fdf2b200640 1 --2- 172.21.15.90:0/3390632286 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdf08078b90 0x7fdf0807b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c009b30 tx=0x7fdf1c005f90 comp rx=0 tx=0).stop 2024-09-21T03:14:57.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.771+0000 7fdf2b200640 1 -- 172.21.15.90:0/3390632286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf2c1545f0 msgr2=0x7fdf2c1515e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:57.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.771+0000 7fdf2b200640 1 --2- 172.21.15.90:0/3390632286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf2c1545f0 0x7fdf2c1515e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdf2402aea0 tx=0x7fdf24033f70 comp rx=0 tx=0).stop 2024-09-21T03:14:57.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.771+0000 7fdf2b200640 1 -- 172.21.15.90:0/3390632286 shutdown_connections 2024-09-21T03:14:57.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.771+0000 7fdf2b200640 1 --2- 172.21.15.90:0/3390632286 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdf08078b90 0x7fdf0807b0a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:57.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.771+0000 7fdf2b200640 1 --2- 172.21.15.90:0/3390632286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf2c1545f0 0x7fdf2c1515e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:57.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.771+0000 7fdf2b200640 1 --2- 172.21.15.90:0/3390632286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf2c0c7900 0x7fdf2c0c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:57.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.771+0000 7fdf2b200640 1 --2- 172.21.15.90:0/3390632286 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf2c06e380 0x7fdf2c0c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:57.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.771+0000 7fdf2b200640 1 -- 172.21.15.90:0/3390632286 >> 172.21.15.90:0/3390632286 conn(0x7fdf2c0c8d90 msgr2=0x7fdf2c0763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:57.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.771+0000 7fdf2b200640 1 -- 172.21.15.90:0/3390632286 shutdown_connections 2024-09-21T03:14:57.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:57.771+0000 7fdf2b200640 1 -- 172.21.15.90:0/3390632286 wait complete. 2024-09-21T03:14:57.797 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-21T03:14:56.478084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":191,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219552,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755168,"statfs":{"total":773094113280,"available":772869292032,"internally_reserved":0,"allocated":3383296,"data_stored":1994552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.944534"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.576924+0000","last_change":"2024-09-21T03:14:47.552762+0000","last_active":"2024-09-21T03:14:48.576924+0000","last_peered":"2024-09-21T03:14:48.576924+0000","last_clean":"2024-09-21T03:14:48.576924+0000","last_became_active":"2024-09-21T03:14:47.551883+0000","last_became_peered":"2024-09-21T03:14:47.551883+0000","last_unstale":"2024-09-21T03:14:48.576924+0000","last_undegraded":"2024-09-21T03:14:48.576924+0000","last_fullsized":"2024-09-21T03:14:48.576924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:51.935797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578270+0000","last_change":"2024-09-21T03:14:37.471004+0000","last_active":"2024-09-21T03:14:48.578270+0000","last_peered":"2024-09-21T03:14:48.578270+0000","last_clean":"2024-09-21T03:14:48.578270+0000","last_became_active":"2024-09-21T03:14:37.470563+0000","last_became_peered":"2024-09-21T03:14:37.470563+0000","last_unstale":"2024-09-21T03:14:48.578270+0000","last_undegraded":"2024-09-21T03:14:48.578270+0000","last_fullsized":"2024-09-21T03:14:48.578270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.422826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558700+0000","last_change":"2024-09-21T03:14:38.496252+0000","last_active":"2024-09-21T03:14:48.558700+0000","last_peered":"2024-09-21T03:14:48.558700+0000","last_clean":"2024-09-21T03:14:48.558700+0000","last_became_active":"2024-09-21T03:14:38.488292+0000","last_became_peered":"2024-09-21T03:14:38.488292+0000","last_unstale":"2024-09-21T03:14:48.558700+0000","last_undegraded":"2024-09-21T03:14:48.558700+0000","last_fullsized":"2024-09-21T03:14:48.558700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:57.409792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566258+0000","last_change":"2024-09-21T03:14:46.549877+0000","last_active":"2024-09-21T03:14:48.566258+0000","last_peered":"2024-09-21T03:14:48.566258+0000","last_clean":"2024-09-21T03:14:48.566258+0000","last_became_active":"2024-09-21T03:14:46.549536+0000","last_became_peered":"2024-09-21T03:14:46.549536+0000","last_unstale":"2024-09-21T03:14:48.566258+0000","last_undegraded":"2024-09-21T03:14:48.566258+0000","last_fullsized":"2024-09-21T03:14:48.566258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:57.491042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577064+0000","last_change":"2024-09-21T03:14:47.560303+0000","last_active":"2024-09-21T03:14:48.577064+0000","last_peered":"2024-09-21T03:14:48.577064+0000","last_clean":"2024-09-21T03:14:48.577064+0000","last_became_active":"2024-09-21T03:14:47.559659+0000","last_became_peered":"2024-09-21T03:14:47.559659+0000","last_unstale":"2024-09-21T03:14:48.577064+0000","last_undegraded":"2024-09-21T03:14:48.577064+0000","last_fullsized":"2024-09-21T03:14:48.577064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:49.328036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558972+0000","last_change":"2024-09-21T03:14:37.467448+0000","last_active":"2024-09-21T03:14:48.558972+0000","last_peered":"2024-09-21T03:14:48.558972+0000","last_clean":"2024-09-21T03:14:48.558972+0000","last_became_active":"2024-09-21T03:14:37.467146+0000","last_became_peered":"2024-09-21T03:14:37.467146+0000","last_unstale":"2024-09-21T03:14:48.558972+0000","last_undegraded":"2024-09-21T03:14:48.558972+0000","last_fullsized":"2024-09-21T03:14:48.558972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:53.475083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558357+0000","last_change":"2024-09-21T03:14:38.486401+0000","last_active":"2024-09-21T03:14:48.558357+0000","last_peered":"2024-09-21T03:14:48.558357+0000","last_clean":"2024-09-21T03:14:48.558357+0000","last_became_active":"2024-09-21T03:14:38.486090+0000","last_became_peered":"2024-09-21T03:14:38.486090+0000","last_unstale":"2024-09-21T03:14:48.558357+0000","last_undegraded":"2024-09-21T03:14:48.558357+0000","last_fullsized":"2024-09-21T03:14:48.558357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:44.085100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556977+0000","last_change":"2024-09-21T03:14:46.541705+0000","last_active":"2024-09-21T03:14:48.556977+0000","last_peered":"2024-09-21T03:14:48.556977+0000","last_clean":"2024-09-21T03:14:48.556977+0000","last_became_active":"2024-09-21T03:14:46.541357+0000","last_became_peered":"2024-09-21T03:14:46.541357+0000","last_unstale":"2024-09-21T03:14:48.556977+0000","last_undegraded":"2024-09-21T03:14:48.556977+0000","last_fullsized":"2024-09-21T03:14:48.556977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:31.082059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577964+0000","last_change":"2024-09-21T03:14:47.556183+0000","last_active":"2024-09-21T03:14:48.577964+0000","last_peered":"2024-09-21T03:14:48.577964+0000","last_clean":"2024-09-21T03:14:48.577964+0000","last_became_active":"2024-09-21T03:14:47.553312+0000","last_became_peered":"2024-09-21T03:14:47.553312+0000","last_unstale":"2024-09-21T03:14:48.577964+0000","last_undegraded":"2024-09-21T03:14:48.577964+0000","last_fullsized":"2024-09-21T03:14:48.577964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:07.314491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579685+0000","last_change":"2024-09-21T03:14:37.478711+0000","last_active":"2024-09-21T03:14:48.579685+0000","last_peered":"2024-09-21T03:14:48.579685+0000","last_clean":"2024-09-21T03:14:48.579685+0000","last_became_active":"2024-09-21T03:14:37.477910+0000","last_became_peered":"2024-09-21T03:14:37.477910+0000","last_unstale":"2024-09-21T03:14:48.579685+0000","last_undegraded":"2024-09-21T03:14:48.579685+0000","last_fullsized":"2024-09-21T03:14:48.579685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:40.166966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578888+0000","last_change":"2024-09-21T03:14:38.472992+0000","last_active":"2024-09-21T03:14:48.578888+0000","last_peered":"2024-09-21T03:14:48.578888+0000","last_clean":"2024-09-21T03:14:48.578888+0000","last_became_active":"2024-09-21T03:14:38.472426+0000","last_became_peered":"2024-09-21T03:14:38.472426+0000","last_unstale":"2024-09-21T03:14:48.578888+0000","last_undegraded":"2024-09-21T03:14:48.578888+0000","last_fullsized":"2024-09-21T03:14:48.578888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:36.825612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556418+0000","last_change":"2024-09-21T03:14:46.526996+0000","last_active":"2024-09-21T03:14:48.556418+0000","last_peered":"2024-09-21T03:14:48.556418+0000","last_clean":"2024-09-21T03:14:48.556418+0000","last_became_active":"2024-09-21T03:14:46.525587+0000","last_became_peered":"2024-09-21T03:14:46.525587+0000","last_unstale":"2024-09-21T03:14:48.556418+0000","last_undegraded":"2024-09-21T03:14:48.556418+0000","last_fullsized":"2024-09-21T03:14:48.556418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:56.977126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556369+0000","last_change":"2024-09-21T03:14:47.554143+0000","last_active":"2024-09-21T03:14:48.556369+0000","last_peered":"2024-09-21T03:14:48.556369+0000","last_clean":"2024-09-21T03:14:48.556369+0000","last_became_active":"2024-09-21T03:14:47.553802+0000","last_became_peered":"2024-09-21T03:14:47.553802+0000","last_unstale":"2024-09-21T03:14:48.556369+0000","last_undegraded":"2024-09-21T03:14:48.556369+0000","last_fullsized":"2024-09-21T03:14:48.556369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:37.963442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578752+0000","last_change":"2024-09-21T03:14:37.479842+0000","last_active":"2024-09-21T03:14:48.578752+0000","last_peered":"2024-09-21T03:14:48.578752+0000","last_clean":"2024-09-21T03:14:48.578752+0000","last_became_active":"2024-09-21T03:14:37.478893+0000","last_became_peered":"2024-09-21T03:14:37.478893+0000","last_unstale":"2024-09-21T03:14:48.578752+0000","last_undegraded":"2024-09-21T03:14:48.578752+0000","last_fullsized":"2024-09-21T03:14:48.578752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:27.916133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581255+0000","last_change":"2024-09-21T03:14:38.468756+0000","last_active":"2024-09-21T03:14:48.581255+0000","last_peered":"2024-09-21T03:14:48.581255+0000","last_clean":"2024-09-21T03:14:48.581255+0000","last_became_active":"2024-09-21T03:14:38.467570+0000","last_became_peered":"2024-09-21T03:14:38.467570+0000","last_unstale":"2024-09-21T03:14:48.581255+0000","last_undegraded":"2024-09-21T03:14:48.581255+0000","last_fullsized":"2024-09-21T03:14:48.581255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:24.784157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556546+0000","last_change":"2024-09-21T03:14:46.529932+0000","last_active":"2024-09-21T03:14:48.556546+0000","last_peered":"2024-09-21T03:14:48.556546+0000","last_clean":"2024-09-21T03:14:48.556546+0000","last_became_active":"2024-09-21T03:14:46.529629+0000","last_became_peered":"2024-09-21T03:14:46.529629+0000","last_unstale":"2024-09-21T03:14:48.556546+0000","last_undegraded":"2024-09-21T03:14:48.556546+0000","last_fullsized":"2024-09-21T03:14:48.556546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:39.808494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558854+0000","last_change":"2024-09-21T03:14:47.547724+0000","last_active":"2024-09-21T03:14:48.558854+0000","last_peered":"2024-09-21T03:14:48.558854+0000","last_clean":"2024-09-21T03:14:48.558854+0000","last_became_active":"2024-09-21T03:14:47.546770+0000","last_became_peered":"2024-09-21T03:14:47.546770+0000","last_unstale":"2024-09-21T03:14:48.558854+0000","last_undegraded":"2024-09-21T03:14:48.558854+0000","last_fullsized":"2024-09-21T03:14:48.558854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:31.476710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580313+0000","last_change":"2024-09-21T03:14:38.476747+0000","last_active":"2024-09-21T03:14:48.580313+0000","last_peered":"2024-09-21T03:14:48.580313+0000","last_clean":"2024-09-21T03:14:48.580313+0000","last_became_active":"2024-09-21T03:14:38.476386+0000","last_became_peered":"2024-09-21T03:14:38.476386+0000","last_unstale":"2024-09-21T03:14:48.580313+0000","last_undegraded":"2024-09-21T03:14:48.580313+0000","last_fullsized":"2024-09-21T03:14:48.580313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:28.751991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580177+0000","last_change":"2024-09-21T03:14:37.463164+0000","last_active":"2024-09-21T03:14:48.580177+0000","last_peered":"2024-09-21T03:14:48.580177+0000","last_clean":"2024-09-21T03:14:48.580177+0000","last_became_active":"2024-09-21T03:14:37.461409+0000","last_became_peered":"2024-09-21T03:14:37.461409+0000","last_unstale":"2024-09-21T03:14:48.580177+0000","last_undegraded":"2024-09-21T03:14:48.580177+0000","last_fullsized":"2024-09-21T03:14:48.580177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:51.126291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581202+0000","last_change":"2024-09-21T03:14:46.538480+0000","last_active":"2024-09-21T03:14:48.581202+0000","last_peered":"2024-09-21T03:14:48.581202+0000","last_clean":"2024-09-21T03:14:48.581202+0000","last_became_active":"2024-09-21T03:14:46.537493+0000","last_became_peered":"2024-09-21T03:14:46.537493+0000","last_unstale":"2024-09-21T03:14:48.581202+0000","last_undegraded":"2024-09-21T03:14:48.581202+0000","last_fullsized":"2024-09-21T03:14:48.581202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:52.769190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566771+0000","last_change":"2024-09-21T03:14:47.580512+0000","last_active":"2024-09-21T03:14:48.566771+0000","last_peered":"2024-09-21T03:14:48.566771+0000","last_clean":"2024-09-21T03:14:48.566771+0000","last_became_active":"2024-09-21T03:14:47.580210+0000","last_became_peered":"2024-09-21T03:14:47.580210+0000","last_unstale":"2024-09-21T03:14:48.566771+0000","last_undegraded":"2024-09-21T03:14:48.566771+0000","last_fullsized":"2024-09-21T03:14:48.566771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:20.192190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566435+0000","last_change":"2024-09-21T03:14:38.494021+0000","last_active":"2024-09-21T03:14:48.566435+0000","last_peered":"2024-09-21T03:14:48.566435+0000","last_clean":"2024-09-21T03:14:48.566435+0000","last_became_active":"2024-09-21T03:14:38.486802+0000","last_became_peered":"2024-09-21T03:14:38.486802+0000","last_unstale":"2024-09-21T03:14:48.566435+0000","last_undegraded":"2024-09-21T03:14:48.566435+0000","last_fullsized":"2024-09-21T03:14:48.566435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:31.817505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558034+0000","last_change":"2024-09-21T03:14:37.465907+0000","last_active":"2024-09-21T03:14:48.558034+0000","last_peered":"2024-09-21T03:14:48.558034+0000","last_clean":"2024-09-21T03:14:48.558034+0000","last_became_active":"2024-09-21T03:14:37.465551+0000","last_became_peered":"2024-09-21T03:14:37.465551+0000","last_unstale":"2024-09-21T03:14:48.558034+0000","last_undegraded":"2024-09-21T03:14:48.558034+0000","last_fullsized":"2024-09-21T03:14:48.558034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:10.599687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578561+0000","last_change":"2024-09-21T03:14:46.546737+0000","last_active":"2024-09-21T03:14:48.578561+0000","last_peered":"2024-09-21T03:14:48.578561+0000","last_clean":"2024-09-21T03:14:48.578561+0000","last_became_active":"2024-09-21T03:14:46.546312+0000","last_became_peered":"2024-09-21T03:14:46.546312+0000","last_unstale":"2024-09-21T03:14:48.578561+0000","last_undegraded":"2024-09-21T03:14:48.578561+0000","last_fullsized":"2024-09-21T03:14:48.578561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:03.939168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580853+0000","last_change":"2024-09-21T03:14:47.558742+0000","last_active":"2024-09-21T03:14:48.580853+0000","last_peered":"2024-09-21T03:14:48.580853+0000","last_clean":"2024-09-21T03:14:48.580853+0000","last_became_active":"2024-09-21T03:14:47.558431+0000","last_became_peered":"2024-09-21T03:14:47.558431+0000","last_unstale":"2024-09-21T03:14:48.580853+0000","last_undegraded":"2024-09-21T03:14:48.580853+0000","last_fullsized":"2024-09-21T03:14:48.580853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:32.053674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.576948+0000","last_change":"2024-09-21T03:14:38.479370+0000","last_active":"2024-09-21T03:14:48.576948+0000","last_peered":"2024-09-21T03:14:48.576948+0000","last_clean":"2024-09-21T03:14:48.576948+0000","last_became_active":"2024-09-21T03:14:38.476976+0000","last_became_peered":"2024-09-21T03:14:38.476976+0000","last_unstale":"2024-09-21T03:14:48.576948+0000","last_undegraded":"2024-09-21T03:14:48.576948+0000","last_fullsized":"2024-09-21T03:14:48.576948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:14.695819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577301+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:14:48.577301+0000","last_peered":"2024-09-21T03:14:48.577301+0000","last_clean":"2024-09-21T03:14:48.577301+0000","last_became_active":"2024-09-21T03:14:37.478840+0000","last_became_peered":"2024-09-21T03:14:37.478840+0000","last_unstale":"2024-09-21T03:14:48.577301+0000","last_undegraded":"2024-09-21T03:14:48.577301+0000","last_fullsized":"2024-09-21T03:14:48.577301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:00.964354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566781+0000","last_change":"2024-09-21T03:14:46.543085+0000","last_active":"2024-09-21T03:14:48.566781+0000","last_peered":"2024-09-21T03:14:48.566781+0000","last_clean":"2024-09-21T03:14:48.566781+0000","last_became_active":"2024-09-21T03:14:46.542721+0000","last_became_peered":"2024-09-21T03:14:46.542721+0000","last_unstale":"2024-09-21T03:14:48.566781+0000","last_undegraded":"2024-09-21T03:14:48.566781+0000","last_fullsized":"2024-09-21T03:14:48.566781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:05.590871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579821+0000","last_change":"2024-09-21T03:14:47.566806+0000","last_active":"2024-09-21T03:14:48.579821+0000","last_peered":"2024-09-21T03:14:48.579821+0000","last_clean":"2024-09-21T03:14:48.579821+0000","last_became_active":"2024-09-21T03:14:47.566634+0000","last_became_peered":"2024-09-21T03:14:47.566634+0000","last_unstale":"2024-09-21T03:14:48.579821+0000","last_undegraded":"2024-09-21T03:14:48.579821+0000","last_fullsized":"2024-09-21T03:14:48.579821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:03.997294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579153+0000","last_change":"2024-09-21T03:14:38.482658+0000","last_active":"2024-09-21T03:14:48.579153+0000","last_peered":"2024-09-21T03:14:48.579153+0000","last_clean":"2024-09-21T03:14:48.579153+0000","last_became_active":"2024-09-21T03:14:38.482369+0000","last_became_peered":"2024-09-21T03:14:38.482369+0000","last_unstale":"2024-09-21T03:14:48.579153+0000","last_undegraded":"2024-09-21T03:14:48.579153+0000","last_fullsized":"2024-09-21T03:14:48.579153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:36.682534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577485+0000","last_change":"2024-09-21T03:14:37.472962+0000","last_active":"2024-09-21T03:14:48.577485+0000","last_peered":"2024-09-21T03:14:48.577485+0000","last_clean":"2024-09-21T03:14:48.577485+0000","last_became_active":"2024-09-21T03:14:37.472271+0000","last_became_peered":"2024-09-21T03:14:37.472271+0000","last_unstale":"2024-09-21T03:14:48.577485+0000","last_undegraded":"2024-09-21T03:14:48.577485+0000","last_fullsized":"2024-09-21T03:14:48.577485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:54.952223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557189+0000","last_change":"2024-09-21T03:14:46.537137+0000","last_active":"2024-09-21T03:14:48.557189+0000","last_peered":"2024-09-21T03:14:48.557189+0000","last_clean":"2024-09-21T03:14:48.557189+0000","last_became_active":"2024-09-21T03:14:46.536791+0000","last_became_peered":"2024-09-21T03:14:46.536791+0000","last_unstale":"2024-09-21T03:14:48.557189+0000","last_undegraded":"2024-09-21T03:14:48.557189+0000","last_fullsized":"2024-09-21T03:14:48.557189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:43.186807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577598+0000","last_change":"2024-09-21T03:14:47.555605+0000","last_active":"2024-09-21T03:14:48.577598+0000","last_peered":"2024-09-21T03:14:48.577598+0000","last_clean":"2024-09-21T03:14:48.577598+0000","last_became_active":"2024-09-21T03:14:47.555329+0000","last_became_peered":"2024-09-21T03:14:47.555329+0000","last_unstale":"2024-09-21T03:14:48.577598+0000","last_undegraded":"2024-09-21T03:14:48.577598+0000","last_fullsized":"2024-09-21T03:14:48.577598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:24.271656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577873+0000","last_change":"2024-09-21T03:14:38.479133+0000","last_active":"2024-09-21T03:14:48.577873+0000","last_peered":"2024-09-21T03:14:48.577873+0000","last_clean":"2024-09-21T03:14:48.577873+0000","last_became_active":"2024-09-21T03:14:38.478077+0000","last_became_peered":"2024-09-21T03:14:38.478077+0000","last_unstale":"2024-09-21T03:14:48.577873+0000","last_undegraded":"2024-09-21T03:14:48.577873+0000","last_fullsized":"2024-09-21T03:14:48.577873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:56.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581077+0000","last_change":"2024-09-21T03:14:37.480508+0000","last_active":"2024-09-21T03:14:48.581077+0000","last_peered":"2024-09-21T03:14:48.581077+0000","last_clean":"2024-09-21T03:14:48.581077+0000","last_became_active":"2024-09-21T03:14:37.480218+0000","last_became_peered":"2024-09-21T03:14:37.480218+0000","last_unstale":"2024-09-21T03:14:48.581077+0000","last_undegraded":"2024-09-21T03:14:48.581077+0000","last_fullsized":"2024-09-21T03:14:48.581077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:01.851380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556442+0000","last_change":"2024-09-21T03:14:46.531615+0000","last_active":"2024-09-21T03:14:48.556442+0000","last_peered":"2024-09-21T03:14:48.556442+0000","last_clean":"2024-09-21T03:14:48.556442+0000","last_became_active":"2024-09-21T03:14:46.531289+0000","last_became_peered":"2024-09-21T03:14:46.531289+0000","last_unstale":"2024-09-21T03:14:48.556442+0000","last_undegraded":"2024-09-21T03:14:48.556442+0000","last_fullsized":"2024-09-21T03:14:48.556442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:10.145489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579006+0000","last_change":"2024-09-21T03:14:47.552705+0000","last_active":"2024-09-21T03:14:48.579006+0000","last_peered":"2024-09-21T03:14:48.579006+0000","last_clean":"2024-09-21T03:14:48.579006+0000","last_became_active":"2024-09-21T03:14:47.552367+0000","last_became_peered":"2024-09-21T03:14:47.552367+0000","last_unstale":"2024-09-21T03:14:48.579006+0000","last_undegraded":"2024-09-21T03:14:48.579006+0000","last_fullsized":"2024-09-21T03:14:48.579006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:45.379581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577998+0000","last_change":"2024-09-21T03:14:38.475318+0000","last_active":"2024-09-21T03:14:48.577998+0000","last_peered":"2024-09-21T03:14:48.577998+0000","last_clean":"2024-09-21T03:14:48.577998+0000","last_became_active":"2024-09-21T03:14:38.474978+0000","last_became_peered":"2024-09-21T03:14:38.474978+0000","last_unstale":"2024-09-21T03:14:48.577998+0000","last_undegraded":"2024-09-21T03:14:48.577998+0000","last_fullsized":"2024-09-21T03:14:48.577998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:38.209624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578286+0000","last_change":"2024-09-21T03:14:37.479651+0000","last_active":"2024-09-21T03:14:48.578286+0000","last_peered":"2024-09-21T03:14:48.578286+0000","last_clean":"2024-09-21T03:14:48.578286+0000","last_became_active":"2024-09-21T03:14:37.478833+0000","last_became_peered":"2024-09-21T03:14:37.478833+0000","last_unstale":"2024-09-21T03:14:48.578286+0000","last_undegraded":"2024-09-21T03:14:48.578286+0000","last_fullsized":"2024-09-21T03:14:48.578286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:48.578637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.576901+0000","last_change":"2024-09-21T03:14:46.536054+0000","last_active":"2024-09-21T03:14:48.576901+0000","last_peered":"2024-09-21T03:14:48.576901+0000","last_clean":"2024-09-21T03:14:48.576901+0000","last_became_active":"2024-09-21T03:14:46.535569+0000","last_became_peered":"2024-09-21T03:14:46.535569+0000","last_unstale":"2024-09-21T03:14:48.576901+0000","last_undegraded":"2024-09-21T03:14:48.576901+0000","last_fullsized":"2024-09-21T03:14:48.576901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:04.556059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577758+0000","last_change":"2024-09-21T03:14:47.571889+0000","last_active":"2024-09-21T03:14:48.577758+0000","last_peered":"2024-09-21T03:14:48.577758+0000","last_clean":"2024-09-21T03:14:48.577758+0000","last_became_active":"2024-09-21T03:14:47.571620+0000","last_became_peered":"2024-09-21T03:14:47.571620+0000","last_unstale":"2024-09-21T03:14:48.577758+0000","last_undegraded":"2024-09-21T03:14:48.577758+0000","last_fullsized":"2024-09-21T03:14:48.577758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:23.103973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558656+0000","last_change":"2024-09-21T03:14:38.493350+0000","last_active":"2024-09-21T03:14:48.558656+0000","last_peered":"2024-09-21T03:14:48.558656+0000","last_clean":"2024-09-21T03:14:48.558656+0000","last_became_active":"2024-09-21T03:14:38.492830+0000","last_became_peered":"2024-09-21T03:14:38.492830+0000","last_unstale":"2024-09-21T03:14:48.558656+0000","last_undegraded":"2024-09-21T03:14:48.558656+0000","last_fullsized":"2024-09-21T03:14:48.558656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:19.946319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581436+0000","last_change":"2024-09-21T03:14:37.473484+0000","last_active":"2024-09-21T03:14:48.581436+0000","last_peered":"2024-09-21T03:14:48.581436+0000","last_clean":"2024-09-21T03:14:48.581436+0000","last_became_active":"2024-09-21T03:14:37.473218+0000","last_became_peered":"2024-09-21T03:14:37.473218+0000","last_unstale":"2024-09-21T03:14:48.581436+0000","last_undegraded":"2024-09-21T03:14:48.581436+0000","last_fullsized":"2024-09-21T03:14:48.581436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:49.006579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558777+0000","last_change":"2024-09-21T03:14:46.548858+0000","last_active":"2024-09-21T03:14:48.558777+0000","last_peered":"2024-09-21T03:14:48.558777+0000","last_clean":"2024-09-21T03:14:48.558777+0000","last_became_active":"2024-09-21T03:14:46.548166+0000","last_became_peered":"2024-09-21T03:14:46.548166+0000","last_unstale":"2024-09-21T03:14:48.558777+0000","last_undegraded":"2024-09-21T03:14:48.558777+0000","last_fullsized":"2024-09-21T03:14:48.558777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:41.470072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577431+0000","last_change":"2024-09-21T03:14:47.555787+0000","last_active":"2024-09-21T03:14:48.577431+0000","last_peered":"2024-09-21T03:14:48.577431+0000","last_clean":"2024-09-21T03:14:48.577431+0000","last_became_active":"2024-09-21T03:14:47.555420+0000","last_became_peered":"2024-09-21T03:14:47.555420+0000","last_unstale":"2024-09-21T03:14:48.577431+0000","last_undegraded":"2024-09-21T03:14:48.577431+0000","last_fullsized":"2024-09-21T03:14:48.577431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:45.769786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556963+0000","last_change":"2024-09-21T03:14:38.479657+0000","last_active":"2024-09-21T03:14:48.556963+0000","last_peered":"2024-09-21T03:14:48.556963+0000","last_clean":"2024-09-21T03:14:48.556963+0000","last_became_active":"2024-09-21T03:14:38.479439+0000","last_became_peered":"2024-09-21T03:14:38.479439+0000","last_unstale":"2024-09-21T03:14:48.556963+0000","last_undegraded":"2024-09-21T03:14:48.556963+0000","last_fullsized":"2024-09-21T03:14:48.556963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.107215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.559008+0000","last_change":"2024-09-21T03:14:37.469799+0000","last_active":"2024-09-21T03:14:48.559008+0000","last_peered":"2024-09-21T03:14:48.559008+0000","last_clean":"2024-09-21T03:14:48.559008+0000","last_became_active":"2024-09-21T03:14:37.469495+0000","last_became_peered":"2024-09-21T03:14:37.469495+0000","last_unstale":"2024-09-21T03:14:48.559008+0000","last_undegraded":"2024-09-21T03:14:48.559008+0000","last_fullsized":"2024-09-21T03:14:48.559008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:50.247050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557375+0000","last_change":"2024-09-21T03:14:46.544320+0000","last_active":"2024-09-21T03:14:48.557375+0000","last_peered":"2024-09-21T03:14:48.557375+0000","last_clean":"2024-09-21T03:14:48.557375+0000","last_became_active":"2024-09-21T03:14:46.544038+0000","last_became_peered":"2024-09-21T03:14:46.544038+0000","last_unstale":"2024-09-21T03:14:48.557375+0000","last_undegraded":"2024-09-21T03:14:48.557375+0000","last_fullsized":"2024-09-21T03:14:48.557375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:57.457687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.567034+0000","last_change":"2024-09-21T03:14:47.579698+0000","last_active":"2024-09-21T03:14:48.567034+0000","last_peered":"2024-09-21T03:14:48.567034+0000","last_clean":"2024-09-21T03:14:48.567034+0000","last_became_active":"2024-09-21T03:14:47.579324+0000","last_became_peered":"2024-09-21T03:14:47.579324+0000","last_unstale":"2024-09-21T03:14:48.567034+0000","last_undegraded":"2024-09-21T03:14:48.567034+0000","last_fullsized":"2024-09-21T03:14:48.567034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:37.656859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578191+0000","last_change":"2024-09-21T03:14:38.476763+0000","last_active":"2024-09-21T03:14:48.578191+0000","last_peered":"2024-09-21T03:14:48.578191+0000","last_clean":"2024-09-21T03:14:48.578191+0000","last_became_active":"2024-09-21T03:14:38.474299+0000","last_became_peered":"2024-09-21T03:14:38.474299+0000","last_unstale":"2024-09-21T03:14:48.578191+0000","last_undegraded":"2024-09-21T03:14:48.578191+0000","last_fullsized":"2024-09-21T03:14:48.578191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:46.544930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580641+0000","last_change":"2024-09-21T03:14:37.466857+0000","last_active":"2024-09-21T03:14:48.580641+0000","last_peered":"2024-09-21T03:14:48.580641+0000","last_clean":"2024-09-21T03:14:48.580641+0000","last_became_active":"2024-09-21T03:14:37.466256+0000","last_became_peered":"2024-09-21T03:14:37.466256+0000","last_unstale":"2024-09-21T03:14:48.580641+0000","last_undegraded":"2024-09-21T03:14:48.580641+0000","last_fullsized":"2024-09-21T03:14:48.580641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:02.240461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558502+0000","last_change":"2024-09-21T03:14:46.537315+0000","last_active":"2024-09-21T03:14:48.558502+0000","last_peered":"2024-09-21T03:14:48.558502+0000","last_clean":"2024-09-21T03:14:48.558502+0000","last_became_active":"2024-09-21T03:14:46.536975+0000","last_became_peered":"2024-09-21T03:14:46.536975+0000","last_unstale":"2024-09-21T03:14:48.558502+0000","last_undegraded":"2024-09-21T03:14:48.558502+0000","last_fullsized":"2024-09-21T03:14:48.558502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:42.529591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566848+0000","last_change":"2024-09-21T03:14:47.573009+0000","last_active":"2024-09-21T03:14:48.566848+0000","last_peered":"2024-09-21T03:14:48.566848+0000","last_clean":"2024-09-21T03:14:48.566848+0000","last_became_active":"2024-09-21T03:14:47.572395+0000","last_became_peered":"2024-09-21T03:14:47.572395+0000","last_unstale":"2024-09-21T03:14:48.566848+0000","last_undegraded":"2024-09-21T03:14:48.566848+0000","last_fullsized":"2024-09-21T03:14:48.566848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:41.733447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556923+0000","last_change":"2024-09-21T03:14:38.481801+0000","last_active":"2024-09-21T03:14:48.556923+0000","last_peered":"2024-09-21T03:14:48.556923+0000","last_clean":"2024-09-21T03:14:48.556923+0000","last_became_active":"2024-09-21T03:14:38.481186+0000","last_became_peered":"2024-09-21T03:14:38.481186+0000","last_unstale":"2024-09-21T03:14:48.556923+0000","last_undegraded":"2024-09-21T03:14:48.556923+0000","last_fullsized":"2024-09-21T03:14:48.556923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:54.271470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566292+0000","last_change":"2024-09-21T03:14:37.474798+0000","last_active":"2024-09-21T03:14:48.566292+0000","last_peered":"2024-09-21T03:14:48.566292+0000","last_clean":"2024-09-21T03:14:48.566292+0000","last_became_active":"2024-09-21T03:14:37.473829+0000","last_became_peered":"2024-09-21T03:14:37.473829+0000","last_unstale":"2024-09-21T03:14:48.566292+0000","last_undegraded":"2024-09-21T03:14:48.566292+0000","last_fullsized":"2024-09-21T03:14:48.566292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:11.571814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558227+0000","last_change":"2024-09-21T03:14:46.542495+0000","last_active":"2024-09-21T03:14:48.558227+0000","last_peered":"2024-09-21T03:14:48.558227+0000","last_clean":"2024-09-21T03:14:48.558227+0000","last_became_active":"2024-09-21T03:14:46.542181+0000","last_became_peered":"2024-09-21T03:14:46.542181+0000","last_unstale":"2024-09-21T03:14:48.558227+0000","last_undegraded":"2024-09-21T03:14:48.558227+0000","last_fullsized":"2024-09-21T03:14:48.558227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:22.481477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580850+0000","last_change":"2024-09-21T03:14:47.569409+0000","last_active":"2024-09-21T03:14:48.580850+0000","last_peered":"2024-09-21T03:14:48.580850+0000","last_clean":"2024-09-21T03:14:48.580850+0000","last_became_active":"2024-09-21T03:14:47.569212+0000","last_became_peered":"2024-09-21T03:14:47.569212+0000","last_unstale":"2024-09-21T03:14:48.580850+0000","last_undegraded":"2024-09-21T03:14:48.580850+0000","last_fullsized":"2024-09-21T03:14:48.580850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.851943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557644+0000","last_change":"2024-09-21T03:14:38.480026+0000","last_active":"2024-09-21T03:14:48.557644+0000","last_peered":"2024-09-21T03:14:48.557644+0000","last_clean":"2024-09-21T03:14:48.557644+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:14:48.557644+0000","last_undegraded":"2024-09-21T03:14:48.557644+0000","last_fullsized":"2024-09-21T03:14:48.557644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:20.481816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578131+0000","last_change":"2024-09-21T03:14:37.464554+0000","last_active":"2024-09-21T03:14:48.578131+0000","last_peered":"2024-09-21T03:14:48.578131+0000","last_clean":"2024-09-21T03:14:48.578131+0000","last_became_active":"2024-09-21T03:14:37.464228+0000","last_became_peered":"2024-09-21T03:14:37.464228+0000","last_unstale":"2024-09-21T03:14:48.578131+0000","last_undegraded":"2024-09-21T03:14:48.578131+0000","last_fullsized":"2024-09-21T03:14:48.578131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:32.529512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558894+0000","last_change":"2024-09-21T03:14:46.538538+0000","last_active":"2024-09-21T03:14:48.558894+0000","last_peered":"2024-09-21T03:14:48.558894+0000","last_clean":"2024-09-21T03:14:48.558894+0000","last_became_active":"2024-09-21T03:14:46.537815+0000","last_became_peered":"2024-09-21T03:14:46.537815+0000","last_unstale":"2024-09-21T03:14:48.558894+0000","last_undegraded":"2024-09-21T03:14:48.558894+0000","last_fullsized":"2024-09-21T03:14:48.558894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:42.264439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578432+0000","last_change":"2024-09-21T03:14:47.558861+0000","last_active":"2024-09-21T03:14:48.578432+0000","last_peered":"2024-09-21T03:14:48.578432+0000","last_clean":"2024-09-21T03:14:48.578432+0000","last_became_active":"2024-09-21T03:14:47.557305+0000","last_became_peered":"2024-09-21T03:14:47.557305+0000","last_unstale":"2024-09-21T03:14:48.578432+0000","last_undegraded":"2024-09-21T03:14:48.578432+0000","last_fullsized":"2024-09-21T03:14:48.578432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:45.962367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577698+0000","last_change":"2024-09-21T03:14:38.479181+0000","last_active":"2024-09-21T03:14:48.577698+0000","last_peered":"2024-09-21T03:14:48.577698+0000","last_clean":"2024-09-21T03:14:48.577698+0000","last_became_active":"2024-09-21T03:14:38.478842+0000","last_became_peered":"2024-09-21T03:14:38.478842+0000","last_unstale":"2024-09-21T03:14:48.577698+0000","last_undegraded":"2024-09-21T03:14:48.577698+0000","last_fullsized":"2024-09-21T03:14:48.577698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:08.664381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580210+0000","last_change":"2024-09-21T03:14:37.463990+0000","last_active":"2024-09-21T03:14:48.580210+0000","last_peered":"2024-09-21T03:14:48.580210+0000","last_clean":"2024-09-21T03:14:48.580210+0000","last_became_active":"2024-09-21T03:14:37.463674+0000","last_became_peered":"2024-09-21T03:14:37.463674+0000","last_unstale":"2024-09-21T03:14:48.580210+0000","last_undegraded":"2024-09-21T03:14:48.580210+0000","last_fullsized":"2024-09-21T03:14:48.580210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:35.391985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577246+0000","last_change":"2024-09-21T03:14:26.342355+0000","last_active":"2024-09-21T03:14:48.577246+0000","last_peered":"2024-09-21T03:14:48.577246+0000","last_clean":"2024-09-21T03:14:48.577246+0000","last_became_active":"2024-09-21T03:14:26.341929+0000","last_became_peered":"2024-09-21T03:14:26.341929+0000","last_unstale":"2024-09-21T03:14:48.577246+0000","last_undegraded":"2024-09-21T03:14:48.577246+0000","last_fullsized":"2024-09-21T03:14:48.577246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_clean_scrub_stamp":"2024-09-21T03:14:25.329650+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:45.390822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581358+0000","last_change":"2024-09-21T03:14:46.538184+0000","last_active":"2024-09-21T03:14:48.581358+0000","last_peered":"2024-09-21T03:14:48.581358+0000","last_clean":"2024-09-21T03:14:48.581358+0000","last_became_active":"2024-09-21T03:14:46.536753+0000","last_became_peered":"2024-09-21T03:14:46.536753+0000","last_unstale":"2024-09-21T03:14:48.581358+0000","last_undegraded":"2024-09-21T03:14:48.581358+0000","last_fullsized":"2024-09-21T03:14:48.581358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:49.078638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558519+0000","last_change":"2024-09-21T03:14:47.552966+0000","last_active":"2024-09-21T03:14:48.558519+0000","last_peered":"2024-09-21T03:14:48.558519+0000","last_clean":"2024-09-21T03:14:48.558519+0000","last_became_active":"2024-09-21T03:14:47.552642+0000","last_became_peered":"2024-09-21T03:14:47.552642+0000","last_unstale":"2024-09-21T03:14:48.558519+0000","last_undegraded":"2024-09-21T03:14:48.558519+0000","last_fullsized":"2024-09-21T03:14:48.558519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:15.928026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581346+0000","last_change":"2024-09-21T03:14:38.478414+0000","last_active":"2024-09-21T03:14:48.581346+0000","last_peered":"2024-09-21T03:14:48.581346+0000","last_clean":"2024-09-21T03:14:48.581346+0000","last_became_active":"2024-09-21T03:14:38.478116+0000","last_became_peered":"2024-09-21T03:14:38.478116+0000","last_unstale":"2024-09-21T03:14:48.581346+0000","last_undegraded":"2024-09-21T03:14:48.581346+0000","last_fullsized":"2024-09-21T03:14:48.581346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:29.618008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558850+0000","last_change":"2024-09-21T03:14:37.479578+0000","last_active":"2024-09-21T03:14:48.558850+0000","last_peered":"2024-09-21T03:14:48.558850+0000","last_clean":"2024-09-21T03:14:48.558850+0000","last_became_active":"2024-09-21T03:14:37.479284+0000","last_became_peered":"2024-09-21T03:14:37.479284+0000","last_unstale":"2024-09-21T03:14:48.558850+0000","last_undegraded":"2024-09-21T03:14:48.558850+0000","last_fullsized":"2024-09-21T03:14:48.558850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:15.732230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556655+0000","last_change":"2024-09-21T03:14:46.531536+0000","last_active":"2024-09-21T03:14:48.556655+0000","last_peered":"2024-09-21T03:14:48.556655+0000","last_clean":"2024-09-21T03:14:48.556655+0000","last_became_active":"2024-09-21T03:14:46.531069+0000","last_became_peered":"2024-09-21T03:14:46.531069+0000","last_unstale":"2024-09-21T03:14:48.556655+0000","last_undegraded":"2024-09-21T03:14:48.556655+0000","last_fullsized":"2024-09-21T03:14:48.556655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:14.050618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557238+0000","last_change":"2024-09-21T03:14:47.553039+0000","last_active":"2024-09-21T03:14:48.557238+0000","last_peered":"2024-09-21T03:14:48.557238+0000","last_clean":"2024-09-21T03:14:48.557238+0000","last_became_active":"2024-09-21T03:14:47.552712+0000","last_became_peered":"2024-09-21T03:14:47.552712+0000","last_unstale":"2024-09-21T03:14:48.557238+0000","last_undegraded":"2024-09-21T03:14:48.557238+0000","last_fullsized":"2024-09-21T03:14:48.557238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:32.630319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578701+0000","last_change":"2024-09-21T03:14:38.488259+0000","last_active":"2024-09-21T03:14:48.578701+0000","last_peered":"2024-09-21T03:14:48.578701+0000","last_clean":"2024-09-21T03:14:48.578701+0000","last_became_active":"2024-09-21T03:14:38.487420+0000","last_became_peered":"2024-09-21T03:14:38.487420+0000","last_unstale":"2024-09-21T03:14:48.578701+0000","last_undegraded":"2024-09-21T03:14:48.578701+0000","last_fullsized":"2024-09-21T03:14:48.578701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:48.003893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.559532+0000","last_change":"2024-09-21T03:14:37.460763+0000","last_active":"2024-09-21T03:14:48.559532+0000","last_peered":"2024-09-21T03:14:48.559532+0000","last_clean":"2024-09-21T03:14:48.559532+0000","last_became_active":"2024-09-21T03:14:37.460320+0000","last_became_peered":"2024-09-21T03:14:37.460320+0000","last_unstale":"2024-09-21T03:14:48.559532+0000","last_undegraded":"2024-09-21T03:14:48.559532+0000","last_fullsized":"2024-09-21T03:14:48.559532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.907794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558692+0000","last_change":"2024-09-21T03:14:46.540901+0000","last_active":"2024-09-21T03:14:48.558692+0000","last_peered":"2024-09-21T03:14:48.558692+0000","last_clean":"2024-09-21T03:14:48.558692+0000","last_became_active":"2024-09-21T03:14:46.540182+0000","last_became_peered":"2024-09-21T03:14:46.540182+0000","last_unstale":"2024-09-21T03:14:48.558692+0000","last_undegraded":"2024-09-21T03:14:48.558692+0000","last_fullsized":"2024-09-21T03:14:48.558692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:38.416663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577089+0000","last_change":"2024-09-21T03:14:47.553810+0000","last_active":"2024-09-21T03:14:48.577089+0000","last_peered":"2024-09-21T03:14:48.577089+0000","last_clean":"2024-09-21T03:14:48.577089+0000","last_became_active":"2024-09-21T03:14:47.552371+0000","last_became_peered":"2024-09-21T03:14:47.552371+0000","last_unstale":"2024-09-21T03:14:48.577089+0000","last_undegraded":"2024-09-21T03:14:48.577089+0000","last_fullsized":"2024-09-21T03:14:48.577089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:38.659512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579745+0000","last_change":"2024-09-21T03:14:38.480629+0000","last_active":"2024-09-21T03:14:48.579745+0000","last_peered":"2024-09-21T03:14:48.579745+0000","last_clean":"2024-09-21T03:14:48.579745+0000","last_became_active":"2024-09-21T03:14:38.474135+0000","last_became_peered":"2024-09-21T03:14:38.474135+0000","last_unstale":"2024-09-21T03:14:48.579745+0000","last_undegraded":"2024-09-21T03:14:48.579745+0000","last_fullsized":"2024-09-21T03:14:48.579745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:36.171044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578278+0000","last_change":"2024-09-21T03:14:37.472491+0000","last_active":"2024-09-21T03:14:48.578278+0000","last_peered":"2024-09-21T03:14:48.578278+0000","last_clean":"2024-09-21T03:14:48.578278+0000","last_became_active":"2024-09-21T03:14:37.472164+0000","last_became_peered":"2024-09-21T03:14:37.472164+0000","last_unstale":"2024-09-21T03:14:48.578278+0000","last_undegraded":"2024-09-21T03:14:48.578278+0000","last_fullsized":"2024-09-21T03:14:48.578278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.498178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577656+0000","last_change":"2024-09-21T03:14:46.544828+0000","last_active":"2024-09-21T03:14:48.577656+0000","last_peered":"2024-09-21T03:14:48.577656+0000","last_clean":"2024-09-21T03:14:48.577656+0000","last_became_active":"2024-09-21T03:14:46.535901+0000","last_became_peered":"2024-09-21T03:14:46.535901+0000","last_unstale":"2024-09-21T03:14:48.577656+0000","last_undegraded":"2024-09-21T03:14:48.577656+0000","last_fullsized":"2024-09-21T03:14:48.577656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:08.608530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557424+0000","last_change":"2024-09-21T03:14:47.556478+0000","last_active":"2024-09-21T03:14:48.557424+0000","last_peered":"2024-09-21T03:14:48.557424+0000","last_clean":"2024-09-21T03:14:48.557424+0000","last_became_active":"2024-09-21T03:14:47.556145+0000","last_became_peered":"2024-09-21T03:14:47.556145+0000","last_unstale":"2024-09-21T03:14:48.557424+0000","last_undegraded":"2024-09-21T03:14:48.557424+0000","last_fullsized":"2024-09-21T03:14:48.557424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:59.004648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557482+0000","last_change":"2024-09-21T03:14:38.469502+0000","last_active":"2024-09-21T03:14:48.557482+0000","last_peered":"2024-09-21T03:14:48.557482+0000","last_clean":"2024-09-21T03:14:48.557482+0000","last_became_active":"2024-09-21T03:14:38.468972+0000","last_became_peered":"2024-09-21T03:14:38.468972+0000","last_unstale":"2024-09-21T03:14:48.557482+0000","last_undegraded":"2024-09-21T03:14:48.557482+0000","last_fullsized":"2024-09-21T03:14:48.557482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579796+0000","last_change":"2024-09-21T03:14:37.480905+0000","last_active":"2024-09-21T03:14:48.579796+0000","last_peered":"2024-09-21T03:14:48.579796+0000","last_clean":"2024-09-21T03:14:48.579796+0000","last_became_active":"2024-09-21T03:14:37.478227+0000","last_became_peered":"2024-09-21T03:14:37.478227+0000","last_unstale":"2024-09-21T03:14:48.579796+0000","last_undegraded":"2024-09-21T03:14:48.579796+0000","last_fullsized":"2024-09-21T03:14:48.579796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:42.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577322+0000","last_change":"2024-09-21T03:14:46.536103+0000","last_active":"2024-09-21T03:14:48.577322+0000","last_peered":"2024-09-21T03:14:48.577322+0000","last_clean":"2024-09-21T03:14:48.577322+0000","last_became_active":"2024-09-21T03:14:46.535445+0000","last_became_peered":"2024-09-21T03:14:46.535445+0000","last_unstale":"2024-09-21T03:14:48.577322+0000","last_undegraded":"2024-09-21T03:14:48.577322+0000","last_fullsized":"2024-09-21T03:14:48.577322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:59.078000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578149+0000","last_change":"2024-09-21T03:14:47.557503+0000","last_active":"2024-09-21T03:14:48.578149+0000","last_peered":"2024-09-21T03:14:48.578149+0000","last_clean":"2024-09-21T03:14:48.578149+0000","last_became_active":"2024-09-21T03:14:47.554366+0000","last_became_peered":"2024-09-21T03:14:47.554366+0000","last_unstale":"2024-09-21T03:14:48.578149+0000","last_undegraded":"2024-09-21T03:14:48.578149+0000","last_fullsized":"2024-09-21T03:14:48.578149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.994560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579154+0000","last_change":"2024-09-21T03:14:38.479516+0000","last_active":"2024-09-21T03:14:48.579154+0000","last_peered":"2024-09-21T03:14:48.579154+0000","last_clean":"2024-09-21T03:14:48.579154+0000","last_became_active":"2024-09-21T03:14:38.474826+0000","last_became_peered":"2024-09-21T03:14:38.474826+0000","last_unstale":"2024-09-21T03:14:48.579154+0000","last_undegraded":"2024-09-21T03:14:48.579154+0000","last_fullsized":"2024-09-21T03:14:48.579154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:22.181411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577156+0000","last_change":"2024-09-21T03:14:37.471063+0000","last_active":"2024-09-21T03:14:48.577156+0000","last_peered":"2024-09-21T03:14:48.577156+0000","last_clean":"2024-09-21T03:14:48.577156+0000","last_became_active":"2024-09-21T03:14:37.470720+0000","last_became_peered":"2024-09-21T03:14:37.470720+0000","last_unstale":"2024-09-21T03:14:48.577156+0000","last_undegraded":"2024-09-21T03:14:48.577156+0000","last_fullsized":"2024-09-21T03:14:48.577156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:00.054692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558350+0000","last_change":"2024-09-21T03:14:46.538665+0000","last_active":"2024-09-21T03:14:48.558350+0000","last_peered":"2024-09-21T03:14:48.558350+0000","last_clean":"2024-09-21T03:14:48.558350+0000","last_became_active":"2024-09-21T03:14:46.537774+0000","last_became_peered":"2024-09-21T03:14:46.537774+0000","last_unstale":"2024-09-21T03:14:48.558350+0000","last_undegraded":"2024-09-21T03:14:48.558350+0000","last_fullsized":"2024-09-21T03:14:48.558350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:07.736404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580727+0000","last_change":"2024-09-21T03:14:47.553011+0000","last_active":"2024-09-21T03:14:48.580727+0000","last_peered":"2024-09-21T03:14:48.580727+0000","last_clean":"2024-09-21T03:14:48.580727+0000","last_became_active":"2024-09-21T03:14:47.552700+0000","last_became_peered":"2024-09-21T03:14:47.552700+0000","last_unstale":"2024-09-21T03:14:48.580727+0000","last_undegraded":"2024-09-21T03:14:48.580727+0000","last_fullsized":"2024-09-21T03:14:48.580727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:58.780132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577072+0000","last_change":"2024-09-21T03:14:38.472906+0000","last_active":"2024-09-21T03:14:48.577072+0000","last_peered":"2024-09-21T03:14:48.577072+0000","last_clean":"2024-09-21T03:14:48.577072+0000","last_became_active":"2024-09-21T03:14:38.471933+0000","last_became_peered":"2024-09-21T03:14:38.471933+0000","last_unstale":"2024-09-21T03:14:48.577072+0000","last_undegraded":"2024-09-21T03:14:48.577072+0000","last_fullsized":"2024-09-21T03:14:48.577072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:05.395821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577473+0000","last_change":"2024-09-21T03:14:37.478714+0000","last_active":"2024-09-21T03:14:48.577473+0000","last_peered":"2024-09-21T03:14:48.577473+0000","last_clean":"2024-09-21T03:14:48.577473+0000","last_became_active":"2024-09-21T03:14:37.477951+0000","last_became_peered":"2024-09-21T03:14:37.477951+0000","last_unstale":"2024-09-21T03:14:48.577473+0000","last_undegraded":"2024-09-21T03:14:48.577473+0000","last_fullsized":"2024-09-21T03:14:48.577473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:42.529545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557789+0000","last_change":"2024-09-21T03:14:46.546142+0000","last_active":"2024-09-21T03:14:48.557789+0000","last_peered":"2024-09-21T03:14:48.557789+0000","last_clean":"2024-09-21T03:14:48.557789+0000","last_became_active":"2024-09-21T03:14:46.545865+0000","last_became_peered":"2024-09-21T03:14:46.545865+0000","last_unstale":"2024-09-21T03:14:48.557789+0000","last_undegraded":"2024-09-21T03:14:48.557789+0000","last_fullsized":"2024-09-21T03:14:48.557789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:11.705309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580406+0000","last_change":"2024-09-21T03:14:47.568961+0000","last_active":"2024-09-21T03:14:48.580406+0000","last_peered":"2024-09-21T03:14:48.580406+0000","last_clean":"2024-09-21T03:14:48.580406+0000","last_became_active":"2024-09-21T03:14:47.568656+0000","last_became_peered":"2024-09-21T03:14:47.568656+0000","last_unstale":"2024-09-21T03:14:48.580406+0000","last_undegraded":"2024-09-21T03:14:48.580406+0000","last_fullsized":"2024-09-21T03:14:48.580406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.041710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580087+0000","last_change":"2024-09-21T03:14:38.485454+0000","last_active":"2024-09-21T03:14:48.580087+0000","last_peered":"2024-09-21T03:14:48.580087+0000","last_clean":"2024-09-21T03:14:48.580087+0000","last_became_active":"2024-09-21T03:14:38.485235+0000","last_became_peered":"2024-09-21T03:14:38.485235+0000","last_unstale":"2024-09-21T03:14:48.580087+0000","last_undegraded":"2024-09-21T03:14:48.580087+0000","last_fullsized":"2024-09-21T03:14:48.580087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:11.585637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580507+0000","last_change":"2024-09-21T03:14:37.466544+0000","last_active":"2024-09-21T03:14:48.580507+0000","last_peered":"2024-09-21T03:14:48.580507+0000","last_clean":"2024-09-21T03:14:48.580507+0000","last_became_active":"2024-09-21T03:14:37.465817+0000","last_became_peered":"2024-09-21T03:14:37.465817+0000","last_unstale":"2024-09-21T03:14:48.580507+0000","last_undegraded":"2024-09-21T03:14:48.580507+0000","last_fullsized":"2024-09-21T03:14:48.580507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:36.113483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558395+0000","last_change":"2024-09-21T03:14:46.549921+0000","last_active":"2024-09-21T03:14:48.558395+0000","last_peered":"2024-09-21T03:14:48.558395+0000","last_clean":"2024-09-21T03:14:48.558395+0000","last_became_active":"2024-09-21T03:14:46.549119+0000","last_became_peered":"2024-09-21T03:14:46.549119+0000","last_unstale":"2024-09-21T03:14:48.558395+0000","last_undegraded":"2024-09-21T03:14:48.558395+0000","last_fullsized":"2024-09-21T03:14:48.558395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:09.622498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577943+0000","last_change":"2024-09-21T03:14:47.577090+0000","last_active":"2024-09-21T03:14:48.577943+0000","last_peered":"2024-09-21T03:14:48.577943+0000","last_clean":"2024-09-21T03:14:48.577943+0000","last_became_active":"2024-09-21T03:14:47.576098+0000","last_became_peered":"2024-09-21T03:14:47.576098+0000","last_unstale":"2024-09-21T03:14:48.577943+0000","last_undegraded":"2024-09-21T03:14:48.577943+0000","last_fullsized":"2024-09-21T03:14:48.577943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:33.414103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557891+0000","last_change":"2024-09-21T03:14:38.482528+0000","last_active":"2024-09-21T03:14:48.557891+0000","last_peered":"2024-09-21T03:14:48.557891+0000","last_clean":"2024-09-21T03:14:48.557891+0000","last_became_active":"2024-09-21T03:14:38.482241+0000","last_became_peered":"2024-09-21T03:14:38.482241+0000","last_unstale":"2024-09-21T03:14:48.557891+0000","last_undegraded":"2024-09-21T03:14:48.557891+0000","last_fullsized":"2024-09-21T03:14:48.557891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:23.110703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566561+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:14:48.566561+0000","last_peered":"2024-09-21T03:14:48.566561+0000","last_clean":"2024-09-21T03:14:48.566561+0000","last_became_active":"2024-09-21T03:14:37.478882+0000","last_became_peered":"2024-09-21T03:14:37.478882+0000","last_unstale":"2024-09-21T03:14:48.566561+0000","last_undegraded":"2024-09-21T03:14:48.566561+0000","last_fullsized":"2024-09-21T03:14:48.566561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:11.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581263+0000","last_change":"2024-09-21T03:14:46.538817+0000","last_active":"2024-09-21T03:14:48.581263+0000","last_peered":"2024-09-21T03:14:48.581263+0000","last_clean":"2024-09-21T03:14:48.581263+0000","last_became_active":"2024-09-21T03:14:46.537835+0000","last_became_peered":"2024-09-21T03:14:46.537835+0000","last_unstale":"2024-09-21T03:14:48.581263+0000","last_undegraded":"2024-09-21T03:14:48.581263+0000","last_fullsized":"2024-09-21T03:14:48.581263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:08.236663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577368+0000","last_change":"2024-09-21T03:14:47.566534+0000","last_active":"2024-09-21T03:14:48.577368+0000","last_peered":"2024-09-21T03:14:48.577368+0000","last_clean":"2024-09-21T03:14:48.577368+0000","last_became_active":"2024-09-21T03:14:47.566157+0000","last_became_peered":"2024-09-21T03:14:47.566157+0000","last_unstale":"2024-09-21T03:14:48.577368+0000","last_undegraded":"2024-09-21T03:14:48.577368+0000","last_fullsized":"2024-09-21T03:14:48.577368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:35.557811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579586+0000","last_change":"2024-09-21T03:14:38.478509+0000","last_active":"2024-09-21T03:14:48.579586+0000","last_peered":"2024-09-21T03:14:48.579586+0000","last_clean":"2024-09-21T03:14:48.579586+0000","last_became_active":"2024-09-21T03:14:38.478197+0000","last_became_peered":"2024-09-21T03:14:38.478197+0000","last_unstale":"2024-09-21T03:14:48.579586+0000","last_undegraded":"2024-09-21T03:14:48.579586+0000","last_fullsized":"2024-09-21T03:14:48.579586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.411134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557313+0000","last_change":"2024-09-21T03:14:37.472695+0000","last_active":"2024-09-21T03:14:48.557313+0000","last_peered":"2024-09-21T03:14:48.557313+0000","last_clean":"2024-09-21T03:14:48.557313+0000","last_became_active":"2024-09-21T03:14:37.472374+0000","last_became_peered":"2024-09-21T03:14:37.472374+0000","last_unstale":"2024-09-21T03:14:48.557313+0000","last_undegraded":"2024-09-21T03:14:48.557313+0000","last_fullsized":"2024-09-21T03:14:48.557313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:11.245914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577140+0000","last_change":"2024-09-21T03:14:46.547433+0000","last_active":"2024-09-21T03:14:48.577140+0000","last_peered":"2024-09-21T03:14:48.577140+0000","last_clean":"2024-09-21T03:14:48.577140+0000","last_became_active":"2024-09-21T03:14:46.547192+0000","last_became_peered":"2024-09-21T03:14:46.547192+0000","last_unstale":"2024-09-21T03:14:48.577140+0000","last_undegraded":"2024-09-21T03:14:48.577140+0000","last_fullsized":"2024-09-21T03:14:48.577140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:03.238245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557599+0000","last_change":"2024-09-21T03:14:47.545827+0000","last_active":"2024-09-21T03:14:48.557599+0000","last_peered":"2024-09-21T03:14:48.557599+0000","last_clean":"2024-09-21T03:14:48.557599+0000","last_became_active":"2024-09-21T03:14:47.545440+0000","last_became_peered":"2024-09-21T03:14:47.545440+0000","last_unstale":"2024-09-21T03:14:48.557599+0000","last_undegraded":"2024-09-21T03:14:48.557599+0000","last_fullsized":"2024-09-21T03:14:48.557599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:20.532645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580151+0000","last_change":"2024-09-21T03:14:38.476564+0000","last_active":"2024-09-21T03:14:48.580151+0000","last_peered":"2024-09-21T03:14:48.580151+0000","last_clean":"2024-09-21T03:14:48.580151+0000","last_became_active":"2024-09-21T03:14:38.476158+0000","last_became_peered":"2024-09-21T03:14:38.476158+0000","last_unstale":"2024-09-21T03:14:48.580151+0000","last_undegraded":"2024-09-21T03:14:48.580151+0000","last_fullsized":"2024-09-21T03:14:48.580151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:26.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.567071+0000","last_change":"2024-09-21T03:14:37.473709+0000","last_active":"2024-09-21T03:14:48.567071+0000","last_peered":"2024-09-21T03:14:48.567071+0000","last_clean":"2024-09-21T03:14:48.567071+0000","last_became_active":"2024-09-21T03:14:37.472544+0000","last_became_peered":"2024-09-21T03:14:37.472544+0000","last_unstale":"2024-09-21T03:14:48.567071+0000","last_undegraded":"2024-09-21T03:14:48.567071+0000","last_fullsized":"2024-09-21T03:14:48.567071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:47.892146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556540+0000","last_change":"2024-09-21T03:14:46.534201+0000","last_active":"2024-09-21T03:14:48.556540+0000","last_peered":"2024-09-21T03:14:48.556540+0000","last_clean":"2024-09-21T03:14:48.556540+0000","last_became_active":"2024-09-21T03:14:46.533891+0000","last_became_peered":"2024-09-21T03:14:46.533891+0000","last_unstale":"2024-09-21T03:14:48.556540+0000","last_undegraded":"2024-09-21T03:14:48.556540+0000","last_fullsized":"2024-09-21T03:14:48.556540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:06.645173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579059+0000","last_change":"2024-09-21T03:14:47.552016+0000","last_active":"2024-09-21T03:14:48.579059+0000","last_peered":"2024-09-21T03:14:48.579059+0000","last_clean":"2024-09-21T03:14:48.579059+0000","last_became_active":"2024-09-21T03:14:47.551622+0000","last_became_peered":"2024-09-21T03:14:47.551622+0000","last_unstale":"2024-09-21T03:14:48.579059+0000","last_undegraded":"2024-09-21T03:14:48.579059+0000","last_fullsized":"2024-09-21T03:14:48.579059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:56:04.849535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558475+0000","last_change":"2024-09-21T03:14:38.484757+0000","last_active":"2024-09-21T03:14:48.558475+0000","last_peered":"2024-09-21T03:14:48.558475+0000","last_clean":"2024-09-21T03:14:48.558475+0000","last_became_active":"2024-09-21T03:14:38.483348+0000","last_became_peered":"2024-09-21T03:14:38.483348+0000","last_unstale":"2024-09-21T03:14:48.558475+0000","last_undegraded":"2024-09-21T03:14:48.558475+0000","last_fullsized":"2024-09-21T03:14:48.558475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:57.697723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579637+0000","last_change":"2024-09-21T03:14:37.479047+0000","last_active":"2024-09-21T03:14:48.579637+0000","last_peered":"2024-09-21T03:14:48.579637+0000","last_clean":"2024-09-21T03:14:48.579637+0000","last_became_active":"2024-09-21T03:14:37.478700+0000","last_became_peered":"2024-09-21T03:14:37.478700+0000","last_unstale":"2024-09-21T03:14:48.579637+0000","last_undegraded":"2024-09-21T03:14:48.579637+0000","last_fullsized":"2024-09-21T03:14:48.579637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:31.702450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566046+0000","last_change":"2024-09-21T03:14:46.547287+0000","last_active":"2024-09-21T03:14:48.566046+0000","last_peered":"2024-09-21T03:14:48.566046+0000","last_clean":"2024-09-21T03:14:48.566046+0000","last_became_active":"2024-09-21T03:14:46.546867+0000","last_became_peered":"2024-09-21T03:14:46.546867+0000","last_unstale":"2024-09-21T03:14:48.566046+0000","last_undegraded":"2024-09-21T03:14:48.566046+0000","last_fullsized":"2024-09-21T03:14:48.566046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:54.119841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556239+0000","last_change":"2024-09-21T03:14:47.558571+0000","last_active":"2024-09-21T03:14:48.556239+0000","last_peered":"2024-09-21T03:14:48.556239+0000","last_clean":"2024-09-21T03:14:48.556239+0000","last_became_active":"2024-09-21T03:14:47.558037+0000","last_became_peered":"2024-09-21T03:14:47.558037+0000","last_unstale":"2024-09-21T03:14:48.556239+0000","last_undegraded":"2024-09-21T03:14:48.556239+0000","last_fullsized":"2024-09-21T03:14:48.556239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:42.564181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557395+0000","last_change":"2024-09-21T03:14:38.488227+0000","last_active":"2024-09-21T03:14:48.557395+0000","last_peered":"2024-09-21T03:14:48.557395+0000","last_clean":"2024-09-21T03:14:48.557395+0000","last_became_active":"2024-09-21T03:14:38.482370+0000","last_became_peered":"2024-09-21T03:14:38.482370+0000","last_unstale":"2024-09-21T03:14:48.557395+0000","last_undegraded":"2024-09-21T03:14:48.557395+0000","last_fullsized":"2024-09-21T03:14:48.557395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:52.561391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580228+0000","last_change":"2024-09-21T03:14:37.471363+0000","last_active":"2024-09-21T03:14:48.580228+0000","last_peered":"2024-09-21T03:14:48.580228+0000","last_clean":"2024-09-21T03:14:48.580228+0000","last_became_active":"2024-09-21T03:14:37.471002+0000","last_became_peered":"2024-09-21T03:14:37.471002+0000","last_unstale":"2024-09-21T03:14:48.580228+0000","last_undegraded":"2024-09-21T03:14:48.580228+0000","last_fullsized":"2024-09-21T03:14:48.580228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:25.922368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.576862+0000","last_change":"2024-09-21T03:14:46.545186+0000","last_active":"2024-09-21T03:14:48.576862+0000","last_peered":"2024-09-21T03:14:48.576862+0000","last_clean":"2024-09-21T03:14:48.576862+0000","last_became_active":"2024-09-21T03:14:46.543647+0000","last_became_peered":"2024-09-21T03:14:46.543647+0000","last_unstale":"2024-09-21T03:14:48.576862+0000","last_undegraded":"2024-09-21T03:14:48.576862+0000","last_fullsized":"2024-09-21T03:14:48.576862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:03.097368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557625+0000","last_change":"2024-09-21T03:14:47.554766+0000","last_active":"2024-09-21T03:14:48.557625+0000","last_peered":"2024-09-21T03:14:48.557625+0000","last_clean":"2024-09-21T03:14:48.557625+0000","last_became_active":"2024-09-21T03:14:47.551563+0000","last_became_peered":"2024-09-21T03:14:47.551563+0000","last_unstale":"2024-09-21T03:14:48.557625+0000","last_undegraded":"2024-09-21T03:14:48.557625+0000","last_fullsized":"2024-09-21T03:14:48.557625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:08.790725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577735+0000","last_change":"2024-09-21T03:14:46.542659+0000","last_active":"2024-09-21T03:14:48.577735+0000","last_peered":"2024-09-21T03:14:48.577735+0000","last_clean":"2024-09-21T03:14:48.577735+0000","last_became_active":"2024-09-21T03:14:46.541771+0000","last_became_peered":"2024-09-21T03:14:46.541771+0000","last_unstale":"2024-09-21T03:14:48.577735+0000","last_undegraded":"2024-09-21T03:14:48.577735+0000","last_fullsized":"2024-09-21T03:14:48.577735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:45.543904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577243+0000","last_change":"2024-09-21T03:14:38.481837+0000","last_active":"2024-09-21T03:14:48.577243+0000","last_peered":"2024-09-21T03:14:48.577243+0000","last_clean":"2024-09-21T03:14:48.577243+0000","last_became_active":"2024-09-21T03:14:38.478400+0000","last_became_peered":"2024-09-21T03:14:38.478400+0000","last_unstale":"2024-09-21T03:14:48.577243+0000","last_undegraded":"2024-09-21T03:14:48.577243+0000","last_fullsized":"2024-09-21T03:14:48.577243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.702185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578051+0000","last_change":"2024-09-21T03:14:37.459351+0000","last_active":"2024-09-21T03:14:48.578051+0000","last_peered":"2024-09-21T03:14:48.578051+0000","last_clean":"2024-09-21T03:14:48.578051+0000","last_became_active":"2024-09-21T03:14:37.458676+0000","last_became_peered":"2024-09-21T03:14:37.458676+0000","last_unstale":"2024-09-21T03:14:48.578051+0000","last_undegraded":"2024-09-21T03:14:48.578051+0000","last_fullsized":"2024-09-21T03:14:48.578051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:42.671520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558462+0000","last_change":"2024-09-21T03:14:47.561232+0000","last_active":"2024-09-21T03:14:48.558462+0000","last_peered":"2024-09-21T03:14:48.558462+0000","last_clean":"2024-09-21T03:14:48.558462+0000","last_became_active":"2024-09-21T03:14:47.557224+0000","last_became_peered":"2024-09-21T03:14:47.557224+0000","last_unstale":"2024-09-21T03:14:48.558462+0000","last_undegraded":"2024-09-21T03:14:48.558462+0000","last_fullsized":"2024-09-21T03:14:48.558462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:09.611235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580814+0000","last_change":"2024-09-21T03:14:46.543157+0000","last_active":"2024-09-21T03:14:48.580814+0000","last_peered":"2024-09-21T03:14:48.580814+0000","last_clean":"2024-09-21T03:14:48.580814+0000","last_became_active":"2024-09-21T03:14:46.542746+0000","last_became_peered":"2024-09-21T03:14:46.542746+0000","last_unstale":"2024-09-21T03:14:48.580814+0000","last_undegraded":"2024-09-21T03:14:48.580814+0000","last_fullsized":"2024-09-21T03:14:48.580814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:30.644843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557713+0000","last_change":"2024-09-21T03:14:38.480723+0000","last_active":"2024-09-21T03:14:48.557713+0000","last_peered":"2024-09-21T03:14:48.557713+0000","last_clean":"2024-09-21T03:14:48.557713+0000","last_became_active":"2024-09-21T03:14:38.472823+0000","last_became_peered":"2024-09-21T03:14:38.472823+0000","last_unstale":"2024-09-21T03:14:48.557713+0000","last_undegraded":"2024-09-21T03:14:48.557713+0000","last_fullsized":"2024-09-21T03:14:48.557713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:59.862592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557827+0000","last_change":"2024-09-21T03:14:37.472209+0000","last_active":"2024-09-21T03:14:48.557827+0000","last_peered":"2024-09-21T03:14:48.557827+0000","last_clean":"2024-09-21T03:14:48.557827+0000","last_became_active":"2024-09-21T03:14:37.471771+0000","last_became_peered":"2024-09-21T03:14:37.471771+0000","last_unstale":"2024-09-21T03:14:48.557827+0000","last_undegraded":"2024-09-21T03:14:48.557827+0000","last_fullsized":"2024-09-21T03:14:48.557827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:30.648010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577935+0000","last_change":"2024-09-21T03:14:47.570651+0000","last_active":"2024-09-21T03:14:48.577935+0000","last_peered":"2024-09-21T03:14:48.577935+0000","last_clean":"2024-09-21T03:14:48.577935+0000","last_became_active":"2024-09-21T03:14:47.568081+0000","last_became_peered":"2024-09-21T03:14:47.568081+0000","last_unstale":"2024-09-21T03:14:48.577935+0000","last_undegraded":"2024-09-21T03:14:48.577935+0000","last_fullsized":"2024-09-21T03:14:48.577935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:45.036938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580418+0000","last_change":"2024-09-21T03:14:37.475076+0000","last_active":"2024-09-21T03:14:48.580418+0000","last_peered":"2024-09-21T03:14:48.580418+0000","last_clean":"2024-09-21T03:14:48.580418+0000","last_became_active":"2024-09-21T03:14:37.474595+0000","last_became_peered":"2024-09-21T03:14:37.474595+0000","last_unstale":"2024-09-21T03:14:48.580418+0000","last_undegraded":"2024-09-21T03:14:48.580418+0000","last_fullsized":"2024-09-21T03:14:48.580418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:16.880647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577631+0000","last_change":"2024-09-21T03:14:38.483226+0000","last_active":"2024-09-21T03:14:48.577631+0000","last_peered":"2024-09-21T03:14:48.577631+0000","last_clean":"2024-09-21T03:14:48.577631+0000","last_became_active":"2024-09-21T03:14:38.482354+0000","last_became_peered":"2024-09-21T03:14:38.482354+0000","last_unstale":"2024-09-21T03:14:48.577631+0000","last_undegraded":"2024-09-21T03:14:48.577631+0000","last_fullsized":"2024-09-21T03:14:48.577631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:51.488594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578124+0000","last_change":"2024-09-21T03:14:46.551282+0000","last_active":"2024-09-21T03:14:48.578124+0000","last_peered":"2024-09-21T03:14:48.578124+0000","last_clean":"2024-09-21T03:14:48.578124+0000","last_became_active":"2024-09-21T03:14:46.550191+0000","last_became_peered":"2024-09-21T03:14:46.550191+0000","last_unstale":"2024-09-21T03:14:48.578124+0000","last_undegraded":"2024-09-21T03:14:48.578124+0000","last_fullsized":"2024-09-21T03:14:48.578124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:32.136739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557152+0000","last_change":"2024-09-21T03:14:47.561737+0000","last_active":"2024-09-21T03:14:48.557152+0000","last_peered":"2024-09-21T03:14:48.557152+0000","last_clean":"2024-09-21T03:14:48.557152+0000","last_became_active":"2024-09-21T03:14:47.557518+0000","last_became_peered":"2024-09-21T03:14:47.557518+0000","last_unstale":"2024-09-21T03:14:48.557152+0000","last_undegraded":"2024-09-21T03:14:48.557152+0000","last_fullsized":"2024-09-21T03:14:48.557152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:00.342378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.559033+0000","last_change":"2024-09-21T03:14:37.465536+0000","last_active":"2024-09-21T03:14:48.559033+0000","last_peered":"2024-09-21T03:14:48.559033+0000","last_clean":"2024-09-21T03:14:48.559033+0000","last_became_active":"2024-09-21T03:14:37.465240+0000","last_became_peered":"2024-09-21T03:14:37.465240+0000","last_unstale":"2024-09-21T03:14:48.559033+0000","last_undegraded":"2024-09-21T03:14:48.559033+0000","last_fullsized":"2024-09-21T03:14:48.559033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:34.780298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578325+0000","last_change":"2024-09-21T03:14:38.474516+0000","last_active":"2024-09-21T03:14:48.578325+0000","last_peered":"2024-09-21T03:14:48.578325+0000","last_clean":"2024-09-21T03:14:48.578325+0000","last_became_active":"2024-09-21T03:14:38.472225+0000","last_became_peered":"2024-09-21T03:14:38.472225+0000","last_unstale":"2024-09-21T03:14:48.578325+0000","last_undegraded":"2024-09-21T03:14:48.578325+0000","last_fullsized":"2024-09-21T03:14:48.578325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:47.504910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566849+0000","last_change":"2024-09-21T03:14:46.544072+0000","last_active":"2024-09-21T03:14:48.566849+0000","last_peered":"2024-09-21T03:14:48.566849+0000","last_clean":"2024-09-21T03:14:48.566849+0000","last_became_active":"2024-09-21T03:14:46.543729+0000","last_became_peered":"2024-09-21T03:14:46.543729+0000","last_unstale":"2024-09-21T03:14:48.566849+0000","last_undegraded":"2024-09-21T03:14:48.566849+0000","last_fullsized":"2024-09-21T03:14:48.566849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:18.560012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578210+0000","last_change":"2024-09-21T03:14:47.563764+0000","last_active":"2024-09-21T03:14:48.578210+0000","last_peered":"2024-09-21T03:14:48.578210+0000","last_clean":"2024-09-21T03:14:48.578210+0000","last_became_active":"2024-09-21T03:14:47.562943+0000","last_became_peered":"2024-09-21T03:14:47.562943+0000","last_unstale":"2024-09-21T03:14:48.578210+0000","last_undegraded":"2024-09-21T03:14:48.578210+0000","last_fullsized":"2024-09-21T03:14:48.578210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:39.284350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556697+0000","last_change":"2024-09-21T03:14:38.484311+0000","last_active":"2024-09-21T03:14:48.556697+0000","last_peered":"2024-09-21T03:14:48.556697+0000","last_clean":"2024-09-21T03:14:48.556697+0000","last_became_active":"2024-09-21T03:14:38.483975+0000","last_became_peered":"2024-09-21T03:14:38.483975+0000","last_unstale":"2024-09-21T03:14:48.556697+0000","last_undegraded":"2024-09-21T03:14:48.556697+0000","last_fullsized":"2024-09-21T03:14:48.556697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:31.145431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578221+0000","last_change":"2024-09-21T03:14:47.566252+0000","last_active":"2024-09-21T03:14:48.578221+0000","last_peered":"2024-09-21T03:14:48.578221+0000","last_clean":"2024-09-21T03:14:48.578221+0000","last_became_active":"2024-09-21T03:14:47.560282+0000","last_became_peered":"2024-09-21T03:14:47.560282+0000","last_unstale":"2024-09-21T03:14:48.578221+0000","last_undegraded":"2024-09-21T03:14:48.578221+0000","last_fullsized":"2024-09-21T03:14:48.578221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:23.553847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566179+0000","last_change":"2024-09-21T03:14:38.477183+0000","last_active":"2024-09-21T03:14:48.566179+0000","last_peered":"2024-09-21T03:14:48.566179+0000","last_clean":"2024-09-21T03:14:48.566179+0000","last_became_active":"2024-09-21T03:14:38.476657+0000","last_became_peered":"2024-09-21T03:14:38.476657+0000","last_unstale":"2024-09-21T03:14:48.566179+0000","last_undegraded":"2024-09-21T03:14:48.566179+0000","last_fullsized":"2024-09-21T03:14:48.566179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:36.801764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557242+0000","last_change":"2024-09-21T03:14:47.574339+0000","last_active":"2024-09-21T03:14:48.557242+0000","last_peered":"2024-09-21T03:14:48.557242+0000","last_clean":"2024-09-21T03:14:48.557242+0000","last_became_active":"2024-09-21T03:14:47.565732+0000","last_became_peered":"2024-09-21T03:14:47.565732+0000","last_unstale":"2024-09-21T03:14:48.557242+0000","last_undegraded":"2024-09-21T03:14:48.557242+0000","last_fullsized":"2024-09-21T03:14:48.557242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:57.896810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580141+0000","last_change":"2024-09-21T03:14:38.472860+0000","last_active":"2024-09-21T03:14:48.580141+0000","last_peered":"2024-09-21T03:14:48.580141+0000","last_clean":"2024-09-21T03:14:48.580141+0000","last_became_active":"2024-09-21T03:14:38.472548+0000","last_became_peered":"2024-09-21T03:14:38.472548+0000","last_unstale":"2024-09-21T03:14:48.580141+0000","last_undegraded":"2024-09-21T03:14:48.580141+0000","last_fullsized":"2024-09-21T03:14:48.580141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:16.071692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.559519+0000","last_change":"2024-09-21T03:14:47.557402+0000","last_active":"2024-09-21T03:14:48.559519+0000","last_peered":"2024-09-21T03:14:48.559519+0000","last_clean":"2024-09-21T03:14:48.559519+0000","last_became_active":"2024-09-21T03:14:47.557047+0000","last_became_peered":"2024-09-21T03:14:47.557047+0000","last_unstale":"2024-09-21T03:14:48.559519+0000","last_undegraded":"2024-09-21T03:14:48.559519+0000","last_fullsized":"2024-09-21T03:14:48.559519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:29.792514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558904+0000","last_change":"2024-09-21T03:14:38.481039+0000","last_active":"2024-09-21T03:14:48.558904+0000","last_peered":"2024-09-21T03:14:48.558904+0000","last_clean":"2024-09-21T03:14:48.558904+0000","last_became_active":"2024-09-21T03:14:38.480686+0000","last_became_peered":"2024-09-21T03:14:38.480686+0000","last_unstale":"2024-09-21T03:14:48.558904+0000","last_undegraded":"2024-09-21T03:14:48.558904+0000","last_fullsized":"2024-09-21T03:14:48.558904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:18.603386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577036+0000","last_change":"2024-09-21T03:14:47.565697+0000","last_active":"2024-09-21T03:14:48.577036+0000","last_peered":"2024-09-21T03:14:48.577036+0000","last_clean":"2024-09-21T03:14:48.577036+0000","last_became_active":"2024-09-21T03:14:47.565393+0000","last_became_peered":"2024-09-21T03:14:47.565393+0000","last_unstale":"2024-09-21T03:14:48.577036+0000","last_undegraded":"2024-09-21T03:14:48.577036+0000","last_fullsized":"2024-09-21T03:14:48.577036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:35.421803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558553+0000","last_change":"2024-09-21T03:14:38.473900+0000","last_active":"2024-09-21T03:14:48.558553+0000","last_peered":"2024-09-21T03:14:48.558553+0000","last_clean":"2024-09-21T03:14:48.558553+0000","last_became_active":"2024-09-21T03:14:38.471325+0000","last_became_peered":"2024-09-21T03:14:38.471325+0000","last_unstale":"2024-09-21T03:14:48.558553+0000","last_undegraded":"2024-09-21T03:14:48.558553+0000","last_fullsized":"2024-09-21T03:14:48.558553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:47.556293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578046+0000","last_change":"2024-09-21T03:14:47.573726+0000","last_active":"2024-09-21T03:14:48.578046+0000","last_peered":"2024-09-21T03:14:48.578046+0000","last_clean":"2024-09-21T03:14:48.578046+0000","last_became_active":"2024-09-21T03:14:47.571074+0000","last_became_peered":"2024-09-21T03:14:47.571074+0000","last_unstale":"2024-09-21T03:14:48.578046+0000","last_undegraded":"2024-09-21T03:14:48.578046+0000","last_fullsized":"2024-09-21T03:14:48.578046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:53.755098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557408+0000","last_change":"2024-09-21T03:14:38.478099+0000","last_active":"2024-09-21T03:14:48.557408+0000","last_peered":"2024-09-21T03:14:48.557408+0000","last_clean":"2024-09-21T03:14:48.557408+0000","last_became_active":"2024-09-21T03:14:38.475894+0000","last_became_peered":"2024-09-21T03:14:38.475894+0000","last_unstale":"2024-09-21T03:14:48.557408+0000","last_undegraded":"2024-09-21T03:14:48.557408+0000","last_fullsized":"2024-09-21T03:14:48.557408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:49.876430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577542+0000","last_change":"2024-09-21T03:14:47.556933+0000","last_active":"2024-09-21T03:14:48.577542+0000","last_peered":"2024-09-21T03:14:48.577542+0000","last_clean":"2024-09-21T03:14:48.577542+0000","last_became_active":"2024-09-21T03:14:47.556615+0000","last_became_peered":"2024-09-21T03:14:47.556615+0000","last_unstale":"2024-09-21T03:14:48.577542+0000","last_undegraded":"2024-09-21T03:14:48.577542+0000","last_fullsized":"2024-09-21T03:14:48.577542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:27.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557365+0000","last_change":"2024-09-21T03:14:38.484198+0000","last_active":"2024-09-21T03:14:48.557365+0000","last_peered":"2024-09-21T03:14:48.557365+0000","last_clean":"2024-09-21T03:14:48.557365+0000","last_became_active":"2024-09-21T03:14:38.483893+0000","last_became_peered":"2024-09-21T03:14:38.483893+0000","last_unstale":"2024-09-21T03:14:48.557365+0000","last_undegraded":"2024-09-21T03:14:48.557365+0000","last_fullsized":"2024-09-21T03:14:48.557365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:56.665359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556286+0000","last_change":"2024-09-21T03:14:47.553479+0000","last_active":"2024-09-21T03:14:48.556286+0000","last_peered":"2024-09-21T03:14:48.556286+0000","last_clean":"2024-09-21T03:14:48.556286+0000","last_became_active":"2024-09-21T03:14:47.553144+0000","last_became_peered":"2024-09-21T03:14:47.553144+0000","last_unstale":"2024-09-21T03:14:48.556286+0000","last_undegraded":"2024-09-21T03:14:48.556286+0000","last_fullsized":"2024-09-21T03:14:48.556286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:26.321488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558236+0000","last_change":"2024-09-21T03:14:38.487093+0000","last_active":"2024-09-21T03:14:48.558236+0000","last_peered":"2024-09-21T03:14:48.558236+0000","last_clean":"2024-09-21T03:14:48.558236+0000","last_became_active":"2024-09-21T03:14:38.486204+0000","last_became_peered":"2024-09-21T03:14:38.486204+0000","last_unstale":"2024-09-21T03:14:48.558236+0000","last_undegraded":"2024-09-21T03:14:48.558236+0000","last_fullsized":"2024-09-21T03:14:48.558236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:55.531046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566794+0000","last_change":"2024-09-21T03:14:47.573375+0000","last_active":"2024-09-21T03:14:48.566794+0000","last_peered":"2024-09-21T03:14:48.566794+0000","last_clean":"2024-09-21T03:14:48.566794+0000","last_became_active":"2024-09-21T03:14:47.572717+0000","last_became_peered":"2024-09-21T03:14:47.572717+0000","last_unstale":"2024-09-21T03:14:48.566794+0000","last_undegraded":"2024-09-21T03:14:48.566794+0000","last_fullsized":"2024-09-21T03:14:48.566794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:44.673283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577931+0000","last_change":"2024-09-21T03:14:38.471959+0000","last_active":"2024-09-21T03:14:48.577931+0000","last_peered":"2024-09-21T03:14:48.577931+0000","last_clean":"2024-09-21T03:14:48.577931+0000","last_became_active":"2024-09-21T03:14:38.471625+0000","last_became_peered":"2024-09-21T03:14:38.471625+0000","last_unstale":"2024-09-21T03:14:48.577931+0000","last_undegraded":"2024-09-21T03:14:48.577931+0000","last_fullsized":"2024-09-21T03:14:48.577931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:17.761951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581065+0000","last_change":"2024-09-21T03:14:47.564597+0000","last_active":"2024-09-21T03:14:48.581065+0000","last_peered":"2024-09-21T03:14:48.581065+0000","last_clean":"2024-09-21T03:14:48.581065+0000","last_became_active":"2024-09-21T03:14:47.563816+0000","last_became_peered":"2024-09-21T03:14:47.563816+0000","last_unstale":"2024-09-21T03:14:48.581065+0000","last_undegraded":"2024-09-21T03:14:48.581065+0000","last_fullsized":"2024-09-21T03:14:48.581065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:33.061271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557771+0000","last_change":"2024-09-21T03:14:38.491888+0000","last_active":"2024-09-21T03:14:48.557771+0000","last_peered":"2024-09-21T03:14:48.557771+0000","last_clean":"2024-09-21T03:14:48.557771+0000","last_became_active":"2024-09-21T03:14:38.491510+0000","last_became_peered":"2024-09-21T03:14:38.491510+0000","last_unstale":"2024-09-21T03:14:48.557771+0000","last_undegraded":"2024-09-21T03:14:48.557771+0000","last_fullsized":"2024-09-21T03:14:48.557771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:26.740304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558275+0000","last_change":"2024-09-21T03:14:47.564310+0000","last_active":"2024-09-21T03:14:48.558275+0000","last_peered":"2024-09-21T03:14:48.558275+0000","last_clean":"2024-09-21T03:14:48.558275+0000","last_became_active":"2024-09-21T03:14:47.564003+0000","last_became_peered":"2024-09-21T03:14:47.564003+0000","last_unstale":"2024-09-21T03:14:48.558275+0000","last_undegraded":"2024-09-21T03:14:48.558275+0000","last_fullsized":"2024-09-21T03:14:48.558275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:45.016321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578256+0000","last_change":"2024-09-21T03:14:38.470991+0000","last_active":"2024-09-21T03:14:48.578256+0000","last_peered":"2024-09-21T03:14:48.578256+0000","last_clean":"2024-09-21T03:14:48.578256+0000","last_became_active":"2024-09-21T03:14:38.470666+0000","last_became_peered":"2024-09-21T03:14:38.470666+0000","last_unstale":"2024-09-21T03:14:48.578256+0000","last_undegraded":"2024-09-21T03:14:48.578256+0000","last_fullsized":"2024-09-21T03:14:48.578256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:25.477992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566757+0000","last_change":"2024-09-21T03:14:47.575212+0000","last_active":"2024-09-21T03:14:48.566757+0000","last_peered":"2024-09-21T03:14:48.566757+0000","last_clean":"2024-09-21T03:14:48.566757+0000","last_became_active":"2024-09-21T03:14:47.574895+0000","last_became_peered":"2024-09-21T03:14:47.574895+0000","last_unstale":"2024-09-21T03:14:48.566757+0000","last_undegraded":"2024-09-21T03:14:48.566757+0000","last_fullsized":"2024-09-21T03:14:48.566757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:04.240949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577570+0000","last_change":"2024-09-21T03:14:38.482681+0000","last_active":"2024-09-21T03:14:48.577570+0000","last_peered":"2024-09-21T03:14:48.577570+0000","last_clean":"2024-09-21T03:14:48.577570+0000","last_became_active":"2024-09-21T03:14:38.477816+0000","last_became_peered":"2024-09-21T03:14:38.477816+0000","last_unstale":"2024-09-21T03:14:48.577570+0000","last_undegraded":"2024-09-21T03:14:48.577570+0000","last_fullsized":"2024-09-21T03:14:48.577570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:18.675641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557132+0000","last_change":"2024-09-21T03:14:47.555329+0000","last_active":"2024-09-21T03:14:48.557132+0000","last_peered":"2024-09-21T03:14:48.557132+0000","last_clean":"2024-09-21T03:14:48.557132+0000","last_became_active":"2024-09-21T03:14:47.555033+0000","last_became_peered":"2024-09-21T03:14:47.555033+0000","last_unstale":"2024-09-21T03:14:48.557132+0000","last_undegraded":"2024-09-21T03:14:48.557132+0000","last_fullsized":"2024-09-21T03:14:48.557132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:49.060834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578610+0000","last_change":"2024-09-21T03:14:38.480638+0000","last_active":"2024-09-21T03:14:48.578610+0000","last_peered":"2024-09-21T03:14:48.578610+0000","last_clean":"2024-09-21T03:14:48.578610+0000","last_became_active":"2024-09-21T03:14:38.477739+0000","last_became_peered":"2024-09-21T03:14:38.477739+0000","last_unstale":"2024-09-21T03:14:48.578610+0000","last_undegraded":"2024-09-21T03:14:48.578610+0000","last_fullsized":"2024-09-21T03:14:48.578610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:35.097761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577900+0000","last_change":"2024-09-21T03:14:47.573659+0000","last_active":"2024-09-21T03:14:48.577900+0000","last_peered":"2024-09-21T03:14:48.577900+0000","last_clean":"2024-09-21T03:14:48.577900+0000","last_became_active":"2024-09-21T03:14:47.572756+0000","last_became_peered":"2024-09-21T03:14:47.572756+0000","last_unstale":"2024-09-21T03:14:48.577900+0000","last_undegraded":"2024-09-21T03:14:48.577900+0000","last_fullsized":"2024-09-21T03:14:48.577900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:21.986681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581406+0000","last_change":"2024-09-21T03:14:38.478039+0000","last_active":"2024-09-21T03:14:48.581406+0000","last_peered":"2024-09-21T03:14:48.581406+0000","last_clean":"2024-09-21T03:14:48.581406+0000","last_became_active":"2024-09-21T03:14:38.473843+0000","last_became_peered":"2024-09-21T03:14:38.473843+0000","last_unstale":"2024-09-21T03:14:48.581406+0000","last_undegraded":"2024-09-21T03:14:48.581406+0000","last_fullsized":"2024-09-21T03:14:48.581406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:27.072406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556166+0000","last_change":"2024-09-21T03:14:47.555386+0000","last_active":"2024-09-21T03:14:48.556166+0000","last_peered":"2024-09-21T03:14:48.556166+0000","last_clean":"2024-09-21T03:14:48.556166+0000","last_became_active":"2024-09-21T03:14:47.554758+0000","last_became_peered":"2024-09-21T03:14:47.554758+0000","last_unstale":"2024-09-21T03:14:48.556166+0000","last_undegraded":"2024-09-21T03:14:48.556166+0000","last_fullsized":"2024-09-21T03:14:48.556166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:47.574672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566912+0000","last_change":"2024-09-21T03:14:38.494878+0000","last_active":"2024-09-21T03:14:48.566912+0000","last_peered":"2024-09-21T03:14:48.566912+0000","last_clean":"2024-09-21T03:14:48.566912+0000","last_became_active":"2024-09-21T03:14:38.492813+0000","last_became_peered":"2024-09-21T03:14:38.492813+0000","last_unstale":"2024-09-21T03:14:48.566912+0000","last_undegraded":"2024-09-21T03:14:48.566912+0000","last_fullsized":"2024-09-21T03:14:48.566912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:55.064844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557554+0000","last_change":"2024-09-21T03:14:47.544806+0000","last_active":"2024-09-21T03:14:48.557554+0000","last_peered":"2024-09-21T03:14:48.557554+0000","last_clean":"2024-09-21T03:14:48.557554+0000","last_became_active":"2024-09-21T03:14:47.544431+0000","last_became_peered":"2024-09-21T03:14:47.544431+0000","last_unstale":"2024-09-21T03:14:48.557554+0000","last_undegraded":"2024-09-21T03:14:48.557554+0000","last_fullsized":"2024-09-21T03:14:48.557554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:01.463573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.581015+0000","last_change":"2024-09-21T03:14:38.474462+0000","last_active":"2024-09-21T03:14:48.581015+0000","last_peered":"2024-09-21T03:14:48.581015+0000","last_clean":"2024-09-21T03:14:48.581015+0000","last_became_active":"2024-09-21T03:14:38.474156+0000","last_became_peered":"2024-09-21T03:14:38.474156+0000","last_unstale":"2024-09-21T03:14:48.581015+0000","last_undegraded":"2024-09-21T03:14:48.581015+0000","last_fullsized":"2024-09-21T03:14:48.581015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:55.329945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578169+0000","last_change":"2024-09-21T03:14:47.563297+0000","last_active":"2024-09-21T03:14:48.578169+0000","last_peered":"2024-09-21T03:14:48.578169+0000","last_clean":"2024-09-21T03:14:48.578169+0000","last_became_active":"2024-09-21T03:14:47.562519+0000","last_became_peered":"2024-09-21T03:14:47.562519+0000","last_unstale":"2024-09-21T03:14:48.578169+0000","last_undegraded":"2024-09-21T03:14:48.578169+0000","last_fullsized":"2024-09-21T03:14:48.578169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:47.959373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577713+0000","last_change":"2024-09-21T03:14:38.474262+0000","last_active":"2024-09-21T03:14:48.577713+0000","last_peered":"2024-09-21T03:14:48.577713+0000","last_clean":"2024-09-21T03:14:48.577713+0000","last_became_active":"2024-09-21T03:14:38.473856+0000","last_became_peered":"2024-09-21T03:14:38.473856+0000","last_unstale":"2024-09-21T03:14:48.577713+0000","last_undegraded":"2024-09-21T03:14:48.577713+0000","last_fullsized":"2024-09-21T03:14:48.577713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579491+0000","last_change":"2024-09-21T03:14:47.558732+0000","last_active":"2024-09-21T03:14:48.579491+0000","last_peered":"2024-09-21T03:14:48.579491+0000","last_clean":"2024-09-21T03:14:48.579491+0000","last_became_active":"2024-09-21T03:14:47.558403+0000","last_became_peered":"2024-09-21T03:14:47.558403+0000","last_unstale":"2024-09-21T03:14:48.579491+0000","last_undegraded":"2024-09-21T03:14:48.579491+0000","last_fullsized":"2024-09-21T03:14:48.579491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:46.054565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557583+0000","last_change":"2024-09-21T03:14:38.469736+0000","last_active":"2024-09-21T03:14:48.557583+0000","last_peered":"2024-09-21T03:14:48.557583+0000","last_clean":"2024-09-21T03:14:48.557583+0000","last_became_active":"2024-09-21T03:14:38.469240+0000","last_became_peered":"2024-09-21T03:14:38.469240+0000","last_unstale":"2024-09-21T03:14:48.557583+0000","last_undegraded":"2024-09-21T03:14:48.557583+0000","last_fullsized":"2024-09-21T03:14:48.557583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:04.258761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578598+0000","last_change":"2024-09-21T03:14:47.550684+0000","last_active":"2024-09-21T03:14:48.578598+0000","last_peered":"2024-09-21T03:14:48.578598+0000","last_clean":"2024-09-21T03:14:48.578598+0000","last_became_active":"2024-09-21T03:14:47.550375+0000","last_became_peered":"2024-09-21T03:14:47.550375+0000","last_unstale":"2024-09-21T03:14:48.578598+0000","last_undegraded":"2024-09-21T03:14:48.578598+0000","last_fullsized":"2024-09-21T03:14:48.578598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:05.268160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557691+0000","last_change":"2024-09-21T03:14:38.487983+0000","last_active":"2024-09-21T03:14:48.557691+0000","last_peered":"2024-09-21T03:14:48.557691+0000","last_clean":"2024-09-21T03:14:48.557691+0000","last_became_active":"2024-09-21T03:14:38.487676+0000","last_became_peered":"2024-09-21T03:14:38.487676+0000","last_unstale":"2024-09-21T03:14:48.557691+0000","last_undegraded":"2024-09-21T03:14:48.557691+0000","last_fullsized":"2024-09-21T03:14:48.557691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:35.320169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580600+0000","last_change":"2024-09-21T03:14:47.561566+0000","last_active":"2024-09-21T03:14:48.580600+0000","last_peered":"2024-09-21T03:14:48.580600+0000","last_clean":"2024-09-21T03:14:48.580600+0000","last_became_active":"2024-09-21T03:14:47.561229+0000","last_became_peered":"2024-09-21T03:14:47.561229+0000","last_unstale":"2024-09-21T03:14:48.580600+0000","last_undegraded":"2024-09-21T03:14:48.580600+0000","last_fullsized":"2024-09-21T03:14:48.580600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:07.280356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558891+0000","last_change":"2024-09-21T03:14:38.478853+0000","last_active":"2024-09-21T03:14:48.558891+0000","last_peered":"2024-09-21T03:14:48.558891+0000","last_clean":"2024-09-21T03:14:48.558891+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:14:48.558891+0000","last_undegraded":"2024-09-21T03:14:48.558891+0000","last_fullsized":"2024-09-21T03:14:48.558891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:31.427596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577155+0000","last_change":"2024-09-21T03:14:47.553172+0000","last_active":"2024-09-21T03:14:48.577155+0000","last_peered":"2024-09-21T03:14:48.577155+0000","last_clean":"2024-09-21T03:14:48.577155+0000","last_became_active":"2024-09-21T03:14:47.552659+0000","last_became_peered":"2024-09-21T03:14:47.552659+0000","last_unstale":"2024-09-21T03:14:48.577155+0000","last_undegraded":"2024-09-21T03:14:48.577155+0000","last_fullsized":"2024-09-21T03:14:48.577155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:16:20.114663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578509+0000","last_change":"2024-09-21T03:14:38.481308+0000","last_active":"2024-09-21T03:14:48.578509+0000","last_peered":"2024-09-21T03:14:48.578509+0000","last_clean":"2024-09-21T03:14:48.578509+0000","last_became_active":"2024-09-21T03:14:38.480923+0000","last_became_peered":"2024-09-21T03:14:38.480923+0000","last_unstale":"2024-09-21T03:14:48.578509+0000","last_undegraded":"2024-09-21T03:14:48.578509+0000","last_fullsized":"2024-09-21T03:14:48.578509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:40.689231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557324+0000","last_change":"2024-09-21T03:14:47.561972+0000","last_active":"2024-09-21T03:14:48.557324+0000","last_peered":"2024-09-21T03:14:48.557324+0000","last_clean":"2024-09-21T03:14:48.557324+0000","last_became_active":"2024-09-21T03:14:47.561645+0000","last_became_peered":"2024-09-21T03:14:47.561645+0000","last_unstale":"2024-09-21T03:14:48.557324+0000","last_undegraded":"2024-09-21T03:14:48.557324+0000","last_fullsized":"2024-09-21T03:14:48.557324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:57.526787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579480+0000","last_change":"2024-09-21T03:14:38.473907+0000","last_active":"2024-09-21T03:14:48.579480+0000","last_peered":"2024-09-21T03:14:48.579480+0000","last_clean":"2024-09-21T03:14:48.579480+0000","last_became_active":"2024-09-21T03:14:38.473579+0000","last_became_peered":"2024-09-21T03:14:38.473579+0000","last_unstale":"2024-09-21T03:14:48.579480+0000","last_undegraded":"2024-09-21T03:14:48.579480+0000","last_fullsized":"2024-09-21T03:14:48.579480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:32.273503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577349+0000","last_change":"2024-09-21T03:14:47.566089+0000","last_active":"2024-09-21T03:14:48.577349+0000","last_peered":"2024-09-21T03:14:48.577349+0000","last_clean":"2024-09-21T03:14:48.577349+0000","last_became_active":"2024-09-21T03:14:47.565681+0000","last_became_peered":"2024-09-21T03:14:47.565681+0000","last_unstale":"2024-09-21T03:14:48.577349+0000","last_undegraded":"2024-09-21T03:14:48.577349+0000","last_fullsized":"2024-09-21T03:14:48.577349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.208933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579474+0000","last_change":"2024-09-21T03:14:38.474326+0000","last_active":"2024-09-21T03:14:48.579474+0000","last_peered":"2024-09-21T03:14:48.579474+0000","last_clean":"2024-09-21T03:14:48.579474+0000","last_became_active":"2024-09-21T03:14:38.470430+0000","last_became_peered":"2024-09-21T03:14:38.470430+0000","last_unstale":"2024-09-21T03:14:48.579474+0000","last_undegraded":"2024-09-21T03:14:48.579474+0000","last_fullsized":"2024-09-21T03:14:48.579474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:09.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577186+0000","last_change":"2024-09-21T03:14:47.571487+0000","last_active":"2024-09-21T03:14:48.577186+0000","last_peered":"2024-09-21T03:14:48.577186+0000","last_clean":"2024-09-21T03:14:48.577186+0000","last_became_active":"2024-09-21T03:14:47.571126+0000","last_became_peered":"2024-09-21T03:14:47.571126+0000","last_unstale":"2024-09-21T03:14:48.577186+0000","last_undegraded":"2024-09-21T03:14:48.577186+0000","last_fullsized":"2024-09-21T03:14:48.577186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:57.128853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.580122+0000","last_change":"2024-09-21T03:14:38.483370+0000","last_active":"2024-09-21T03:14:48.580122+0000","last_peered":"2024-09-21T03:14:48.580122+0000","last_clean":"2024-09-21T03:14:48.580122+0000","last_became_active":"2024-09-21T03:14:38.483019+0000","last_became_peered":"2024-09-21T03:14:38.483019+0000","last_unstale":"2024-09-21T03:14:48.580122+0000","last_undegraded":"2024-09-21T03:14:48.580122+0000","last_fullsized":"2024-09-21T03:14:48.580122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:55.085422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558300+0000","last_change":"2024-09-21T03:14:47.555777+0000","last_active":"2024-09-21T03:14:48.558300+0000","last_peered":"2024-09-21T03:14:48.558300+0000","last_clean":"2024-09-21T03:14:48.558300+0000","last_became_active":"2024-09-21T03:14:47.555465+0000","last_became_peered":"2024-09-21T03:14:47.555465+0000","last_unstale":"2024-09-21T03:14:48.558300+0000","last_undegraded":"2024-09-21T03:14:48.558300+0000","last_fullsized":"2024-09-21T03:14:48.558300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:27.123740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556793+0000","last_change":"2024-09-21T03:14:38.465771+0000","last_active":"2024-09-21T03:14:48.556793+0000","last_peered":"2024-09-21T03:14:48.556793+0000","last_clean":"2024-09-21T03:14:48.556793+0000","last_became_active":"2024-09-21T03:14:38.465479+0000","last_became_peered":"2024-09-21T03:14:38.465479+0000","last_unstale":"2024-09-21T03:14:48.556793+0000","last_undegraded":"2024-09-21T03:14:48.556793+0000","last_fullsized":"2024-09-21T03:14:48.556793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.754315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557657+0000","last_change":"2024-09-21T03:14:47.567695+0000","last_active":"2024-09-21T03:14:48.557657+0000","last_peered":"2024-09-21T03:14:48.557657+0000","last_clean":"2024-09-21T03:14:48.557657+0000","last_became_active":"2024-09-21T03:14:47.566936+0000","last_became_peered":"2024-09-21T03:14:47.566936+0000","last_unstale":"2024-09-21T03:14:48.557657+0000","last_undegraded":"2024-09-21T03:14:48.557657+0000","last_fullsized":"2024-09-21T03:14:48.557657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:48.182523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577444+0000","last_change":"2024-09-21T03:14:38.482620+0000","last_active":"2024-09-21T03:14:48.577444+0000","last_peered":"2024-09-21T03:14:48.577444+0000","last_clean":"2024-09-21T03:14:48.577444+0000","last_became_active":"2024-09-21T03:14:38.482346+0000","last_became_peered":"2024-09-21T03:14:38.482346+0000","last_unstale":"2024-09-21T03:14:48.577444+0000","last_undegraded":"2024-09-21T03:14:48.577444+0000","last_fullsized":"2024-09-21T03:14:48.577444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:52.977725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.577748+0000","last_change":"2024-09-21T03:14:47.580314+0000","last_active":"2024-09-21T03:14:48.577748+0000","last_peered":"2024-09-21T03:14:48.577748+0000","last_clean":"2024-09-21T03:14:48.577748+0000","last_became_active":"2024-09-21T03:14:47.576499+0000","last_became_peered":"2024-09-21T03:14:47.576499+0000","last_unstale":"2024-09-21T03:14:48.577748+0000","last_undegraded":"2024-09-21T03:14:48.577748+0000","last_fullsized":"2024-09-21T03:14:48.577748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:46.154586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557118+0000","last_change":"2024-09-21T03:14:38.471270+0000","last_active":"2024-09-21T03:14:48.557118+0000","last_peered":"2024-09-21T03:14:48.557118+0000","last_clean":"2024-09-21T03:14:48.557118+0000","last_became_active":"2024-09-21T03:14:38.470708+0000","last_became_peered":"2024-09-21T03:14:38.470708+0000","last_unstale":"2024-09-21T03:14:48.557118+0000","last_undegraded":"2024-09-21T03:14:48.557118+0000","last_fullsized":"2024-09-21T03:14:48.557118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.122804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578504+0000","last_change":"2024-09-21T03:14:47.554180+0000","last_active":"2024-09-21T03:14:48.578504+0000","last_peered":"2024-09-21T03:14:48.578504+0000","last_clean":"2024-09-21T03:14:48.578504+0000","last_became_active":"2024-09-21T03:14:47.552808+0000","last_became_peered":"2024-09-21T03:14:47.552808+0000","last_unstale":"2024-09-21T03:14:48.578504+0000","last_undegraded":"2024-09-21T03:14:48.578504+0000","last_fullsized":"2024-09-21T03:14:48.578504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:07.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.578111+0000","last_change":"2024-09-21T03:14:38.466077+0000","last_active":"2024-09-21T03:14:48.578111+0000","last_peered":"2024-09-21T03:14:48.578111+0000","last_clean":"2024-09-21T03:14:48.578111+0000","last_became_active":"2024-09-21T03:14:38.465818+0000","last_became_peered":"2024-09-21T03:14:38.465818+0000","last_unstale":"2024-09-21T03:14:48.578111+0000","last_undegraded":"2024-09-21T03:14:48.578111+0000","last_fullsized":"2024-09-21T03:14:48.578111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:34.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.566406+0000","last_change":"2024-09-21T03:14:47.577228+0000","last_active":"2024-09-21T03:14:48.566406+0000","last_peered":"2024-09-21T03:14:48.566406+0000","last_clean":"2024-09-21T03:14:48.566406+0000","last_became_active":"2024-09-21T03:14:47.576843+0000","last_became_peered":"2024-09-21T03:14:47.576843+0000","last_unstale":"2024-09-21T03:14:48.566406+0000","last_undegraded":"2024-09-21T03:14:48.566406+0000","last_fullsized":"2024-09-21T03:14:48.566406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:56.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557247+0000","last_change":"2024-09-21T03:14:38.481389+0000","last_active":"2024-09-21T03:14:48.557247+0000","last_peered":"2024-09-21T03:14:48.557247+0000","last_clean":"2024-09-21T03:14:48.557247+0000","last_became_active":"2024-09-21T03:14:38.470907+0000","last_became_peered":"2024-09-21T03:14:38.470907+0000","last_unstale":"2024-09-21T03:14:48.557247+0000","last_undegraded":"2024-09-21T03:14:48.557247+0000","last_fullsized":"2024-09-21T03:14:48.557247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:30.068915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558355+0000","last_change":"2024-09-21T03:14:47.551766+0000","last_active":"2024-09-21T03:14:48.558355+0000","last_peered":"2024-09-21T03:14:48.558355+0000","last_clean":"2024-09-21T03:14:48.558355+0000","last_became_active":"2024-09-21T03:14:47.551420+0000","last_became_peered":"2024-09-21T03:14:47.551420+0000","last_unstale":"2024-09-21T03:14:48.558355+0000","last_undegraded":"2024-09-21T03:14:48.558355+0000","last_fullsized":"2024-09-21T03:14:48.558355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:56.255472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.559417+0000","last_change":"2024-09-21T03:14:38.482605+0000","last_active":"2024-09-21T03:14:48.559417+0000","last_peered":"2024-09-21T03:14:48.559417+0000","last_clean":"2024-09-21T03:14:48.559417+0000","last_became_active":"2024-09-21T03:14:38.482306+0000","last_became_peered":"2024-09-21T03:14:38.482306+0000","last_unstale":"2024-09-21T03:14:48.559417+0000","last_undegraded":"2024-09-21T03:14:48.559417+0000","last_fullsized":"2024-09-21T03:14:48.559417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:40.482635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556625+0000","last_change":"2024-09-21T03:14:47.555070+0000","last_active":"2024-09-21T03:14:48.556625+0000","last_peered":"2024-09-21T03:14:48.556625+0000","last_clean":"2024-09-21T03:14:48.556625+0000","last_became_active":"2024-09-21T03:14:47.554363+0000","last_became_peered":"2024-09-21T03:14:47.554363+0000","last_unstale":"2024-09-21T03:14:48.556625+0000","last_undegraded":"2024-09-21T03:14:48.556625+0000","last_fullsized":"2024-09-21T03:14:48.556625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:40.027266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558524+0000","last_change":"2024-09-21T03:14:38.496218+0000","last_active":"2024-09-21T03:14:48.558524+0000","last_peered":"2024-09-21T03:14:48.558524+0000","last_clean":"2024-09-21T03:14:48.558524+0000","last_became_active":"2024-09-21T03:14:38.488537+0000","last_became_peered":"2024-09-21T03:14:38.488537+0000","last_unstale":"2024-09-21T03:14:48.558524+0000","last_undegraded":"2024-09-21T03:14:48.558524+0000","last_fullsized":"2024-09-21T03:14:48.558524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:59.667392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.556307+0000","last_change":"2024-09-21T03:14:47.564250+0000","last_active":"2024-09-21T03:14:48.556307+0000","last_peered":"2024-09-21T03:14:48.556307+0000","last_clean":"2024-09-21T03:14:48.556307+0000","last_became_active":"2024-09-21T03:14:47.563745+0000","last_became_peered":"2024-09-21T03:14:47.563745+0000","last_unstale":"2024-09-21T03:14:48.556307+0000","last_undegraded":"2024-09-21T03:14:48.556307+0000","last_fullsized":"2024-09-21T03:14:48.556307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:31.282910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.579673+0000","last_change":"2024-09-21T03:14:38.490309+0000","last_active":"2024-09-21T03:14:48.579673+0000","last_peered":"2024-09-21T03:14:48.579673+0000","last_clean":"2024-09-21T03:14:48.579673+0000","last_became_active":"2024-09-21T03:14:38.489167+0000","last_became_peered":"2024-09-21T03:14:38.489167+0000","last_unstale":"2024-09-21T03:14:48.579673+0000","last_undegraded":"2024-09-21T03:14:48.579673+0000","last_fullsized":"2024-09-21T03:14:48.579673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:07.725691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":100668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":691564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":104440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":102168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":860160,"data_stored":691030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":100668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":102134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":101880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:14:57.805 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T03:14:57.806 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T03:14:57.806 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-21T03:14:57.806 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:14:58.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.053+0000 7fa0efe00640 1 -- 172.21.15.90:0/3396705043 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0f01545f0 msgr2=0x7fa0f0156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:58.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.053+0000 7fa0efe00640 1 --2- 172.21.15.90:0/3396705043 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0f01545f0 0x7fa0f0156c80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009830 tx=0x7fa0d802a5c0 comp rx=0 tx=0).stop 2024-09-21T03:14:58.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.054+0000 7fa0efe00640 1 -- 172.21.15.90:0/3396705043 shutdown_connections 2024-09-21T03:14:58.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.054+0000 7fa0efe00640 1 --2- 172.21.15.90:0/3396705043 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0f01545f0 0x7fa0f0156c80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:58.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.054+0000 7fa0efe00640 1 -- 172.21.15.90:0/3396705043 >> 172.21.15.90:0/3396705043 conn(0x7fa0f00c8d90 msgr2=0x7fa0f00c91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:58.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.054+0000 7fa0efe00640 1 -- 172.21.15.90:0/3396705043 shutdown_connections 2024-09-21T03:14:58.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.054+0000 7fa0efe00640 1 -- 172.21.15.90:0/3396705043 wait complete. 2024-09-21T03:14:58.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.056+0000 7fa0efe00640 1 Processor -- start 2024-09-21T03:14:58.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.056+0000 7fa0efe00640 1 -- start start 2024-09-21T03:14:58.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.057+0000 7fa0efe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0f006e380 0x7fa0f00c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.057+0000 7fa0efe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f00c7900 0x7fa0f01edce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.057+0000 7fa0efe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa0f01545f0 0x7fa0f0150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.057+0000 7fa0efe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f00c8780 con 0x7fa0f006e380 2024-09-21T03:14:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.057+0000 7fa0efe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f00c7150 con 0x7fa0f00c7900 2024-09-21T03:14:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.057+0000 7fa0efe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa0f0157b10 con 0x7fa0f01545f0 2024-09-21T03:14:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.057+0000 7fa0eea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0f006e380 0x7fa0f00c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.057+0000 7fa0eea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0f006e380 0x7fa0f00c5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33546/0 (socket says 172.21.15.90:33546) 2024-09-21T03:14:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.057+0000 7fa0eea00640 1 -- 172.21.15.90:0/3586054203 learned_addr learned my addr 172.21.15.90:0/3586054203 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.058+0000 7fa0e6000640 1 --2- 172.21.15.90:0/3586054203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f00c7900 0x7fa0f01edce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.058+0000 7fa0ef400640 1 --2- 172.21.15.90:0/3586054203 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa0f01545f0 0x7fa0f0150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.058+0000 7fa0eea00640 1 -- 172.21.15.90:0/3586054203 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa0f01545f0 msgr2=0x7fa0f0150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.058+0000 7fa0eea00640 1 --2- 172.21.15.90:0/3586054203 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa0f01545f0 0x7fa0f0150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.058+0000 7fa0eea00640 1 -- 172.21.15.90:0/3586054203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f00c7900 msgr2=0x7fa0f01edce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.058+0000 7fa0eea00640 1 --2- 172.21.15.90:0/3586054203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f00c7900 0x7fa0f01edce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.058+0000 7fa0eea00640 1 -- 172.21.15.90:0/3586054203 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f00c5eb0 con 0x7fa0f006e380 2024-09-21T03:14:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.058+0000 7fa0ef400640 1 --2- 172.21.15.90:0/3586054203 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa0f01545f0 0x7fa0f0150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:14:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.058+0000 7fa0eea00640 1 --2- 172.21.15.90:0/3586054203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0f006e380 0x7fa0f00c5100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000c3d0 tx=0x7fa0e000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.058+0000 7fa0e7400640 1 -- 172.21.15.90:0/3586054203 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0017070 con 0x7fa0f006e380 2024-09-21T03:14:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.058+0000 7fa0e7400640 1 -- 172.21.15.90:0/3586054203 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0e00053c0 con 0x7fa0f006e380 2024-09-21T03:14:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.059+0000 7fa0efe00640 1 -- 172.21.15.90:0/3586054203 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0f0151a30 con 0x7fa0f006e380 2024-09-21T03:14:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.059+0000 7fa0e7400640 1 -- 172.21.15.90:0/3586054203 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0003850 con 0x7fa0f006e380 2024-09-21T03:14:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.059+0000 7fa0efe00640 1 -- 172.21.15.90:0/3586054203 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0f00c21e0 con 0x7fa0f006e380 2024-09-21T03:14:58.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.060+0000 7fa0efe00640 1 -- 172.21.15.90:0/3586054203 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0f00c6e00 con 0x7fa0f006e380 2024-09-21T03:14:58.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.061+0000 7fa0e7400640 1 -- 172.21.15.90:0/3586054203 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa0e001a070 con 0x7fa0f006e380 2024-09-21T03:14:58.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.062+0000 7fa0e7400640 1 --2- 172.21.15.90:0/3586054203 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa0cc078bc0 0x7fa0cc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:58.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.062+0000 7fa0e7400640 1 -- 172.21.15.90:0/3586054203 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fa0e009a340 con 0x7fa0f006e380 2024-09-21T03:14:58.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.062+0000 7fa0e6000640 1 --2- 172.21.15.90:0/3586054203 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa0cc078bc0 0x7fa0cc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:58.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.063+0000 7fa0e6000640 1 --2- 172.21.15.90:0/3586054203 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa0cc078bc0 0x7fa0cc07b0d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8034000 tx=0x7fa0d8004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:58.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.066+0000 7fa0e7400640 1 -- 172.21.15.90:0/3586054203 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa0e0061e00 con 0x7fa0f006e380 2024-09-21T03:14:58.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.289+0000 7fa0efe00640 1 -- 172.21.15.90:0/3586054203 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa0f00c2410 con 0x7fa0f006e380 2024-09-21T03:14:58.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.289+0000 7fa0e7400640 1 -- 172.21.15.90:0/3586054203 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa0e0066830 con 0x7fa0f006e380 2024-09-21T03:14:58.291 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:58.291 INFO:teuthology.orchestra.run.smithi090.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T03:14:58.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.291+0000 7fa0efe00640 1 -- 172.21.15.90:0/3586054203 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa0cc078bc0 msgr2=0x7fa0cc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:58.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.291+0000 7fa0efe00640 1 --2- 172.21.15.90:0/3586054203 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa0cc078bc0 0x7fa0cc07b0d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8034000 tx=0x7fa0d8004730 comp rx=0 tx=0).stop 2024-09-21T03:14:58.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.291+0000 7fa0efe00640 1 -- 172.21.15.90:0/3586054203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0f006e380 msgr2=0x7fa0f00c5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:58.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.291+0000 7fa0efe00640 1 --2- 172.21.15.90:0/3586054203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0f006e380 0x7fa0f00c5100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000c3d0 tx=0x7fa0e000c890 comp rx=0 tx=0).stop 2024-09-21T03:14:58.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.292+0000 7fa0efe00640 1 -- 172.21.15.90:0/3586054203 shutdown_connections 2024-09-21T03:14:58.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.292+0000 7fa0efe00640 1 --2- 172.21.15.90:0/3586054203 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa0cc078bc0 0x7fa0cc07b0d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:58.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.292+0000 7fa0efe00640 1 --2- 172.21.15.90:0/3586054203 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa0f01545f0 0x7fa0f0150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:58.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.292+0000 7fa0efe00640 1 --2- 172.21.15.90:0/3586054203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f00c7900 0x7fa0f01edce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:58.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.292+0000 7fa0efe00640 1 --2- 172.21.15.90:0/3586054203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0f006e380 0x7fa0f00c5100 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:58.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.292+0000 7fa0efe00640 1 -- 172.21.15.90:0/3586054203 >> 172.21.15.90:0/3586054203 conn(0x7fa0f00c8d90 msgr2=0x7fa0f01539a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:58.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.292+0000 7fa0efe00640 1 -- 172.21.15.90:0/3586054203 shutdown_connections 2024-09-21T03:14:58.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.292+0000 7fa0efe00640 1 -- 172.21.15.90:0/3586054203 wait complete. 2024-09-21T03:14:58.318 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-21T03:14:58.318 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:14:58.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.539+0000 7f929d200640 1 -- 172.21.15.90:0/232597555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92980c4730 msgr2=0x7f9298074290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:58.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.539+0000 7f929d200640 1 --2- 172.21.15.90:0/232597555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92980c4730 0x7f9298074290 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f929806d8d0 tx=0x7f928802a560 comp rx=0 tx=0).stop 2024-09-21T03:14:58.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.539+0000 7f929d200640 1 -- 172.21.15.90:0/232597555 shutdown_connections 2024-09-21T03:14:58.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.539+0000 7f929d200640 1 --2- 172.21.15.90:0/232597555 >> v2:172.21.15.149:3300/0 conn(0x7f929806d940 0x7f92980747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:58.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.539+0000 7f929d200640 1 --2- 172.21.15.90:0/232597555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92980c4730 0x7f9298074290 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:58.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.539+0000 7f929d200640 1 -- 172.21.15.90:0/232597555 >> 172.21.15.90:0/232597555 conn(0x7f92980c8ba0 msgr2=0x7f929806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:58.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.539+0000 7f929d200640 1 -- 172.21.15.90:0/232597555 shutdown_connections 2024-09-21T03:14:58.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.539+0000 7f929d200640 1 -- 172.21.15.90:0/232597555 wait complete. 2024-09-21T03:14:58.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.541+0000 7f929d200640 1 Processor -- start 2024-09-21T03:14:58.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.541+0000 7f929d200640 1 -- start start 2024-09-21T03:14:58.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.542+0000 7f929d200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f929806d940 0x7f92980c2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:58.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.542+0000 7f929d200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9298072a70 0x7f92981dfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:58.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.542+0000 7f929d200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92980c4730 0x7f92981eb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:58.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.542+0000 7f929d200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f92980ab6f0 con 0x7f92980c4730 2024-09-21T03:14:58.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.542+0000 7f929d200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f92980ab410 con 0x7f9298072a70 2024-09-21T03:14:58.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.542+0000 7f929d200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f92980acd10 con 0x7f929806d940 2024-09-21T03:14:58.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.543+0000 7f9296800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92980c4730 0x7f92981eb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:58.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.543+0000 7f928d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9298072a70 0x7f92981dfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:58.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.543+0000 7f9295e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f929806d940 0x7f92980c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:58.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.543+0000 7f9296800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92980c4730 0x7f92981eb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33566/0 (socket says 172.21.15.90:33566) 2024-09-21T03:14:58.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.543+0000 7f9296800640 1 -- 172.21.15.90:0/1952228971 learned_addr learned my addr 172.21.15.90:0/1952228971 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:58.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.543+0000 7f9296800640 1 -- 172.21.15.90:0/1952228971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f929806d940 msgr2=0x7f92980c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:58.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.543+0000 7f9296800640 1 --2- 172.21.15.90:0/1952228971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f929806d940 0x7f92980c2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:58.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.543+0000 7f9296800640 1 -- 172.21.15.90:0/1952228971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9298072a70 msgr2=0x7f92981dfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:58.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.543+0000 7f9296800640 1 --2- 172.21.15.90:0/1952228971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9298072a70 0x7f92981dfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:58.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.543+0000 7f9296800640 1 -- 172.21.15.90:0/1952228971 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92980bdc20 con 0x7f92980c4730 2024-09-21T03:14:58.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.544+0000 7f9296800640 1 --2- 172.21.15.90:0/1952228971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92980c4730 0x7f92981eb1f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f929000b9a0 tx=0x7f929000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:58.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.544+0000 7f928ea00640 1 -- 172.21.15.90:0/1952228971 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9290019070 con 0x7f92980c4730 2024-09-21T03:14:58.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.544+0000 7f928ea00640 1 -- 172.21.15.90:0/1952228971 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f929000cc90 con 0x7f92980c4730 2024-09-21T03:14:58.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.544+0000 7f929d200640 1 -- 172.21.15.90:0/1952228971 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92980bdf30 con 0x7f92980c4730 2024-09-21T03:14:58.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.544+0000 7f928ea00640 1 -- 172.21.15.90:0/1952228971 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92900146a0 con 0x7f92980c4730 2024-09-21T03:14:58.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.544+0000 7f929d200640 1 -- 172.21.15.90:0/1952228971 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9298157610 con 0x7f92980c4730 2024-09-21T03:14:58.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.545+0000 7f929d200640 1 -- 172.21.15.90:0/1952228971 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92980ad190 con 0x7f92980c4730 2024-09-21T03:14:58.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.546+0000 7f928ea00640 1 -- 172.21.15.90:0/1952228971 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f929001c070 con 0x7f92980c4730 2024-09-21T03:14:58.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.547+0000 7f928ea00640 1 --2- 172.21.15.90:0/1952228971 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9274078bf0 0x7f927407b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:58.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.547+0000 7f928ea00640 1 -- 172.21.15.90:0/1952228971 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f929009ab10 con 0x7f92980c4730 2024-09-21T03:14:58.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.547+0000 7f9295e00640 1 --2- 172.21.15.90:0/1952228971 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9274078bf0 0x7f927407b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:58.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.548+0000 7f9295e00640 1 --2- 172.21.15.90:0/1952228971 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9274078bf0 0x7f927407b100 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9288033000 tx=0x7f9288004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:58.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.551+0000 7f928ea00640 1 -- 172.21.15.90:0/1952228971 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f92900626f0 con 0x7f92980c4730 2024-09-21T03:14:58.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.779+0000 7f929d200640 1 -- 172.21.15.90:0/1952228971 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9298158d30 con 0x7f92980c4730 2024-09-21T03:14:58.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.780+0000 7f928ea00640 1 -- 172.21.15.90:0/1952228971 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6530 (secure 0 0 0) 0x7f9290067120 con 0x7f92980c4730 2024-09-21T03:14:58.782 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:58.782 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"btime":"2024-09-21T03:14:51:570098+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3707484056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3707484056},{"type":"v1","addr":"172.21.15.90:6835","nonce":3707484056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1650707992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1650707992},{"type":"v1","addr":"172.21.15.149:6837","nonce":1650707992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:37.954868+0000","modified":"2024-09-21T03:14:41.971257+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/2166962836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2166962836},{"type":"v1","addr":"172.21.15.149:6836","nonce":2166962836}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:47.021969+0000","modified":"2024-09-21T03:14:51.055397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4395},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4395":{"gid":4395,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6833/1105275899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1105275899},{"type":"v1","addr":"172.21.15.90:6833","nonce":1105275899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4395,"qdb_cluster":[4395]},"id":2}]} 2024-09-21T03:14:58.782 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2024-09-21T03:14:58.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.782+0000 7f929d200640 1 -- 172.21.15.90:0/1952228971 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9274078bf0 msgr2=0x7f927407b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:58.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.782+0000 7f929d200640 1 --2- 172.21.15.90:0/1952228971 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9274078bf0 0x7f927407b100 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9288033000 tx=0x7f9288004730 comp rx=0 tx=0).stop 2024-09-21T03:14:58.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.782+0000 7f929d200640 1 -- 172.21.15.90:0/1952228971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92980c4730 msgr2=0x7f92981eb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:58.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.782+0000 7f929d200640 1 --2- 172.21.15.90:0/1952228971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92980c4730 0x7f92981eb1f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f929000b9a0 tx=0x7f929000be60 comp rx=0 tx=0).stop 2024-09-21T03:14:58.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.783+0000 7f929d200640 1 -- 172.21.15.90:0/1952228971 shutdown_connections 2024-09-21T03:14:58.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.783+0000 7f929d200640 1 --2- 172.21.15.90:0/1952228971 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9274078bf0 0x7f927407b100 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:58.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.783+0000 7f929d200640 1 --2- 172.21.15.90:0/1952228971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92980c4730 0x7f92981eb1f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:58.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.783+0000 7f929d200640 1 --2- 172.21.15.90:0/1952228971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9298072a70 0x7f92981dfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:58.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.783+0000 7f929d200640 1 --2- 172.21.15.90:0/1952228971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f929806d940 0x7f92980c2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:58.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.783+0000 7f929d200640 1 -- 172.21.15.90:0/1952228971 >> 172.21.15.90:0/1952228971 conn(0x7f92980c8ba0 msgr2=0x7f92980c5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:58.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.783+0000 7f929d200640 1 -- 172.21.15.90:0/1952228971 shutdown_connections 2024-09-21T03:14:58.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:58.783+0000 7f929d200640 1 -- 172.21.15.90:0/1952228971 wait complete. 2024-09-21T03:14:58.810 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:14:59.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.026+0000 7ffb1e200640 1 -- 172.21.15.90:0/250278693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb18155030 msgr2=0x7ffb180c5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:59.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.026+0000 7ffb1e200640 1 --2- 172.21.15.90:0/250278693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb18155030 0x7ffb180c5080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffb18158f60 tx=0x7ffb1002a970 comp rx=0 tx=0).stop 2024-09-21T03:14:59.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.026+0000 7ffb1e200640 1 -- 172.21.15.90:0/250278693 shutdown_connections 2024-09-21T03:14:59.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.026+0000 7ffb1e200640 1 --2- 172.21.15.90:0/250278693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb18155030 0x7ffb180c5080 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.026+0000 7ffb1e200640 1 --2- 172.21.15.90:0/250278693 >> v2:172.21.15.149:3300/0 conn(0x7ffb18158900 0x7ffb18073e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.026+0000 7ffb1e200640 1 -- 172.21.15.90:0/250278693 >> 172.21.15.90:0/250278693 conn(0x7ffb180c84c0 msgr2=0x7ffb180c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:59.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.026+0000 7ffb1e200640 1 -- 172.21.15.90:0/250278693 shutdown_connections 2024-09-21T03:14:59.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.027+0000 7ffb1e200640 1 -- 172.21.15.90:0/250278693 wait complete. 2024-09-21T03:14:59.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.029+0000 7ffb1e200640 1 Processor -- start 2024-09-21T03:14:59.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.029+0000 7ffb1e200640 1 -- start start 2024-09-21T03:14:59.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.030+0000 7ffb1e200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb180ab1c0 0x7ffb1814a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:59.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.030+0000 7ffb1e200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb18155030 0x7ffb180c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:59.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.030+0000 7ffb1e200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb18158900 0x7ffb1806ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:59.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.030+0000 7ffb1e200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffb180c55c0 con 0x7ffb18155030 2024-09-21T03:14:59.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.030+0000 7ffb1e200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ffb18072c60 con 0x7ffb180ab1c0 2024-09-21T03:14:59.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.030+0000 7ffb1e200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ffb180c5740 con 0x7ffb18158900 2024-09-21T03:14:59.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.030+0000 7ffb0fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb18155030 0x7ffb180c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:59.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.030+0000 7ffb0fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb18155030 0x7ffb180c6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33580/0 (socket says 172.21.15.90:33580) 2024-09-21T03:14:59.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.030+0000 7ffb0fe00640 1 -- 172.21.15.90:0/1947259977 learned_addr learned my addr 172.21.15.90:0/1947259977 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:59.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.030+0000 7ffb1ce00640 1 --2- 172.21.15.90:0/1947259977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb180ab1c0 0x7ffb1814a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:59.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.031+0000 7ffb1d800640 1 --2- 172.21.15.90:0/1947259977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb18158900 0x7ffb1806ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:59.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.031+0000 7ffb0fe00640 1 -- 172.21.15.90:0/1947259977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb18158900 msgr2=0x7ffb1806ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:59.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.031+0000 7ffb0fe00640 1 --2- 172.21.15.90:0/1947259977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb18158900 0x7ffb1806ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.031+0000 7ffb0fe00640 1 -- 172.21.15.90:0/1947259977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb180ab1c0 msgr2=0x7ffb1814a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:59.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.031+0000 7ffb0fe00640 1 --2- 172.21.15.90:0/1947259977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb180ab1c0 0x7ffb1814a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.031+0000 7ffb0fe00640 1 -- 172.21.15.90:0/1947259977 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1814a9e0 con 0x7ffb18155030 2024-09-21T03:14:59.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.031+0000 7ffb0fe00640 1 --2- 172.21.15.90:0/1947259977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb18155030 0x7ffb180c6ef0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000b420 tx=0x7ffb0000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:59.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.031+0000 7ffb15600640 1 -- 172.21.15.90:0/1947259977 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00011830 con 0x7ffb18155030 2024-09-21T03:14:59.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.031+0000 7ffb15600640 1 -- 172.21.15.90:0/1947259977 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb00016070 con 0x7ffb18155030 2024-09-21T03:14:59.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.031+0000 7ffb1e200640 1 -- 172.21.15.90:0/1947259977 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb181ed5a0 con 0x7ffb18155030 2024-09-21T03:14:59.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.031+0000 7ffb15600640 1 -- 172.21.15.90:0/1947259977 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00011d60 con 0x7ffb18155030 2024-09-21T03:14:59.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.032+0000 7ffb1e200640 1 -- 172.21.15.90:0/1947259977 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb181ed880 con 0x7ffb18155030 2024-09-21T03:14:59.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.033+0000 7ffb1e200640 1 -- 172.21.15.90:0/1947259977 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb18155440 con 0x7ffb18155030 2024-09-21T03:14:59.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.034+0000 7ffb15600640 1 -- 172.21.15.90:0/1947259977 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffb0001b460 con 0x7ffb18155030 2024-09-21T03:14:59.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.035+0000 7ffb15600640 1 --2- 172.21.15.90:0/1947259977 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ffaf4078bc0 0x7ffaf407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:59.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.035+0000 7ffb15600640 1 -- 172.21.15.90:0/1947259977 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7ffb0009a9a0 con 0x7ffb18155030 2024-09-21T03:14:59.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.035+0000 7ffb1ce00640 1 --2- 172.21.15.90:0/1947259977 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ffaf4078bc0 0x7ffaf407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:59.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.036+0000 7ffb1ce00640 1 --2- 172.21.15.90:0/1947259977 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ffaf4078bc0 0x7ffaf407b0d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffb08004630 tx=0x7ffb0800b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:59.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.039+0000 7ffb15600640 1 -- 172.21.15.90:0/1947259977 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ffb00020020 con 0x7ffb18155030 2024-09-21T03:14:59.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.261+0000 7ffb1e200640 1 -- 172.21.15.90:0/1947259977 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb1814abb0 con 0x7ffb18155030 2024-09-21T03:14:59.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.262+0000 7ffb15600640 1 -- 172.21.15.90:0/1947259977 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6530 (secure 0 0 0) 0x7ffb00062580 con 0x7ffb18155030 2024-09-21T03:14:59.264 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:59.264 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"btime":"2024-09-21T03:14:51:570098+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3707484056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3707484056},{"type":"v1","addr":"172.21.15.90:6835","nonce":3707484056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1650707992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1650707992},{"type":"v1","addr":"172.21.15.149:6837","nonce":1650707992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:37.954868+0000","modified":"2024-09-21T03:14:41.971257+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/2166962836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2166962836},{"type":"v1","addr":"172.21.15.149:6836","nonce":2166962836}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:47.021969+0000","modified":"2024-09-21T03:14:51.055397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4395},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4395":{"gid":4395,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6833/1105275899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1105275899},{"type":"v1","addr":"172.21.15.90:6833","nonce":1105275899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4395,"qdb_cluster":[4395]},"id":2}]} 2024-09-21T03:14:59.264 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2024-09-21T03:14:59.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.264+0000 7ffb1e200640 1 -- 172.21.15.90:0/1947259977 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ffaf4078bc0 msgr2=0x7ffaf407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:59.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.264+0000 7ffb1e200640 1 --2- 172.21.15.90:0/1947259977 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ffaf4078bc0 0x7ffaf407b0d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffb08004630 tx=0x7ffb0800b2e0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.264+0000 7ffb1e200640 1 -- 172.21.15.90:0/1947259977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb18155030 msgr2=0x7ffb180c6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:59.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.264+0000 7ffb1e200640 1 --2- 172.21.15.90:0/1947259977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb18155030 0x7ffb180c6ef0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000b420 tx=0x7ffb0000b8e0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.265+0000 7ffb1e200640 1 -- 172.21.15.90:0/1947259977 shutdown_connections 2024-09-21T03:14:59.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.265+0000 7ffb1e200640 1 --2- 172.21.15.90:0/1947259977 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ffaf4078bc0 0x7ffaf407b0d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.265+0000 7ffb1e200640 1 --2- 172.21.15.90:0/1947259977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb18158900 0x7ffb1806ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.265+0000 7ffb1e200640 1 --2- 172.21.15.90:0/1947259977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb18155030 0x7ffb180c6ef0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.265+0000 7ffb1e200640 1 --2- 172.21.15.90:0/1947259977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb180ab1c0 0x7ffb1814a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.265+0000 7ffb1e200640 1 -- 172.21.15.90:0/1947259977 >> 172.21.15.90:0/1947259977 conn(0x7ffb180c84c0 msgr2=0x7ffb180c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:59.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.265+0000 7ffb1e200640 1 -- 172.21.15.90:0/1947259977 shutdown_connections 2024-09-21T03:14:59.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.265+0000 7ffb1e200640 1 -- 172.21.15.90:0/1947259977 wait complete. 2024-09-21T03:14:59.288 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:14:59.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.507+0000 7f8a3e400640 1 -- 172.21.15.90:0/3706826473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a380c5460 msgr2=0x7f8a380c5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:59.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.507+0000 7f8a3e400640 1 --2- 172.21.15.90:0/3706826473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a380c5460 0x7f8a380c5870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009900 tx=0x7f8a2402a580 comp rx=0 tx=0).stop 2024-09-21T03:14:59.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.507+0000 7f8a3e400640 1 -- 172.21.15.90:0/3706826473 shutdown_connections 2024-09-21T03:14:59.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.507+0000 7f8a3e400640 1 --2- 172.21.15.90:0/3706826473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a380c5460 0x7f8a380c5870 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.507+0000 7f8a3e400640 1 --2- 172.21.15.90:0/3706826473 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a38071530 0x7f8a380af880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.507+0000 7f8a3e400640 1 -- 172.21.15.90:0/3706826473 >> 172.21.15.90:0/3706826473 conn(0x7f8a380ca0d0 msgr2=0x7f8a380ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:59.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.507+0000 7f8a3e400640 1 -- 172.21.15.90:0/3706826473 shutdown_connections 2024-09-21T03:14:59.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.507+0000 7f8a3e400640 1 -- 172.21.15.90:0/3706826473 wait complete. 2024-09-21T03:14:59.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.509+0000 7f8a3e400640 1 Processor -- start 2024-09-21T03:14:59.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.509+0000 7f8a3e400640 1 -- start start 2024-09-21T03:14:59.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.510+0000 7f8a3e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a38071530 0x7f8a380ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:59.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.510+0000 7f8a3e400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a380c5460 0x7f8a380acf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:59.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.510+0000 7f8a3e400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a38157f60 0x7f8a3814d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:59.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.510+0000 7f8a3e400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8a38158a80 con 0x7f8a38157f60 2024-09-21T03:14:59.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.510+0000 7f8a3e400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8a380730b0 con 0x7f8a380c5460 2024-09-21T03:14:59.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.510+0000 7f8a3e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8a38073540 con 0x7f8a38071530 2024-09-21T03:14:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.510+0000 7f8a3da00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a38157f60 0x7f8a3814d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.511+0000 7f8a3da00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a38157f60 0x7f8a3814d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33586/0 (socket says 172.21.15.90:33586) 2024-09-21T03:14:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.511+0000 7f8a3da00640 1 -- 172.21.15.90:0/3022370764 learned_addr learned my addr 172.21.15.90:0/3022370764 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.511+0000 7f8a3d000640 1 --2- 172.21.15.90:0/3022370764 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a38071530 0x7f8a380ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.511+0000 7f8a37e00640 1 --2- 172.21.15.90:0/3022370764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a380c5460 0x7f8a380acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.511+0000 7f8a3da00640 1 -- 172.21.15.90:0/3022370764 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a38071530 msgr2=0x7f8a380ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.511+0000 7f8a3da00640 1 --2- 172.21.15.90:0/3022370764 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a38071530 0x7f8a380ae260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.511+0000 7f8a3da00640 1 -- 172.21.15.90:0/3022370764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a380c5460 msgr2=0x7f8a380acf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.511+0000 7f8a3da00640 1 --2- 172.21.15.90:0/3022370764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a380c5460 0x7f8a380acf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.511+0000 7f8a3da00640 1 -- 172.21.15.90:0/3022370764 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a380ad4a0 con 0x7f8a38157f60 2024-09-21T03:14:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.511+0000 7f8a3da00640 1 --2- 172.21.15.90:0/3022370764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a38157f60 0x7f8a3814d5e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000c6e0 tx=0x7f8a3000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.511+0000 7f8a34c00640 1 -- 172.21.15.90:0/3022370764 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a30003b70 con 0x7f8a38157f60 2024-09-21T03:14:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.511+0000 7f8a34c00640 1 -- 172.21.15.90:0/3022370764 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a30003d10 con 0x7f8a38157f60 2024-09-21T03:14:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.511+0000 7f8a3e400640 1 -- 172.21.15.90:0/3022370764 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a3814d170 con 0x7f8a38157f60 2024-09-21T03:14:59.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.511+0000 7f8a34c00640 1 -- 172.21.15.90:0/3022370764 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a30005330 con 0x7f8a38157f60 2024-09-21T03:14:59.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.512+0000 7f8a3e400640 1 -- 172.21.15.90:0/3022370764 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a381f1220 con 0x7f8a38157f60 2024-09-21T03:14:59.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.513+0000 7f8a3e400640 1 -- 172.21.15.90:0/3022370764 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a380c66b0 con 0x7f8a38157f60 2024-09-21T03:14:59.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.514+0000 7f8a34c00640 1 -- 172.21.15.90:0/3022370764 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8a300054d0 con 0x7f8a38157f60 2024-09-21T03:14:59.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.515+0000 7f8a34c00640 1 --2- 172.21.15.90:0/3022370764 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8a18078b90 0x7f8a1807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:59.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.516+0000 7f8a34c00640 1 -- 172.21.15.90:0/3022370764 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f8a3009ade0 con 0x7f8a38157f60 2024-09-21T03:14:59.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.516+0000 7f8a3d000640 1 --2- 172.21.15.90:0/3022370764 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8a18078b90 0x7f8a1807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:59.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.517+0000 7f8a3d000640 1 --2- 172.21.15.90:0/3022370764 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8a18078b90 0x7f8a1807b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00bb00 tx=0x7f8a2c005e30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:59.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.520+0000 7f8a34c00640 1 -- 172.21.15.90:0/3022370764 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8a380c5db0 con 0x7f8a38157f60 2024-09-21T03:14:59.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.709+0000 7f8a3e400640 1 -- 172.21.15.90:0/3022370764 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a380c3ff0 con 0x7f8a38157f60 2024-09-21T03:14:59.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.710+0000 7f8a34c00640 1 -- 172.21.15.90:0/3022370764 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20407 (secure 0 0 0) 0x7f8a30062f90 con 0x7f8a38157f60 2024-09-21T03:14:59.712 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:14:59.712 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":25,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","created":"2024-09-21T03:14:09.323302+0000","modified":"2024-09-21T03:14:48.547226+0000","last_up_change":"2024-09-21T03:14:25.329650+0000","last_in_change":"2024-09-21T03:14:15.386953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:14:24.511246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-21T03:14:35.815250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-21T03:14:36.914615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-21T03:14:45.298287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-21T03:14:45.977111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ceaacfab-e71c-45e2-ac50-4597dfd460bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6809","nonce":3187794863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6811","nonce":3187794863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6815","nonce":3187794863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6813","nonce":3187794863}]},"public_addr":"172.21.15.90:6809/3187794863","cluster_addr":"172.21.15.90:6811/3187794863","heartbeat_back_addr":"172.21.15.90:6815/3187794863","heartbeat_front_addr":"172.21.15.90:6813/3187794863","state":["exists","up"]},{"osd":1,"uuid":"86f91523-232b-4e80-ada7-d9e12770adb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6801","nonce":3769758484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6803","nonce":3769758484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6807","nonce":3769758484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6805","nonce":3769758484}]},"public_addr":"172.21.15.90:6801/3769758484","cluster_addr":"172.21.15.90:6803/3769758484","heartbeat_back_addr":"172.21.15.90:6807/3769758484","heartbeat_front_addr":"172.21.15.90:6805/3769758484","state":["exists","up"]},{"osd":2,"uuid":"6eb0f47b-e767-49c0-8d72-07f71b9c2e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6825","nonce":1025535744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6827","nonce":1025535744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6831","nonce":1025535744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6829","nonce":1025535744}]},"public_addr":"172.21.15.90:6825/1025535744","cluster_addr":"172.21.15.90:6827/1025535744","heartbeat_back_addr":"172.21.15.90:6831/1025535744","heartbeat_front_addr":"172.21.15.90:6829/1025535744","state":["exists","up"]},{"osd":3,"uuid":"64418862-beef-479c-be11-dfe0e515e09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6817","nonce":1515884437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6819","nonce":1515884437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6823","nonce":1515884437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6821","nonce":1515884437}]},"public_addr":"172.21.15.90:6817/1515884437","cluster_addr":"172.21.15.90:6819/1515884437","heartbeat_back_addr":"172.21.15.90:6823/1515884437","heartbeat_front_addr":"172.21.15.90:6821/1515884437","state":["exists","up"]},{"osd":4,"uuid":"a05b63f4-ec0a-426c-9d60-285e2680a897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6816","nonce":4278726553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6820","nonce":4278726553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6825","nonce":4278726553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6823","nonce":4278726553}]},"public_addr":"172.21.15.149:6816/4278726553","cluster_addr":"172.21.15.149:6820/4278726553","heartbeat_back_addr":"172.21.15.149:6825/4278726553","heartbeat_front_addr":"172.21.15.149:6823/4278726553","state":["exists","up"]},{"osd":5,"uuid":"3a1bab89-963c-4fe7-b14f-3080c5cf7830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6827","nonce":1341677333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6829","nonce":1341677333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6833","nonce":1341677333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6831","nonce":1341677333}]},"public_addr":"172.21.15.149:6827/1341677333","cluster_addr":"172.21.15.149:6829/1341677333","heartbeat_back_addr":"172.21.15.149:6833/1341677333","heartbeat_front_addr":"172.21.15.149:6831/1341677333","state":["exists","up"]},{"osd":6,"uuid":"bfcd1596-2688-4deb-be2e-55f305a5b4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6811","nonce":821196931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6813","nonce":821196931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6821","nonce":821196931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6817","nonce":821196931}]},"public_addr":"172.21.15.149:6811/821196931","cluster_addr":"172.21.15.149:6813/821196931","heartbeat_back_addr":"172.21.15.149:6821/821196931","heartbeat_front_addr":"172.21.15.149:6817/821196931","state":["exists","up"]},{"osd":7,"uuid":"58b19790-4006-4f07-966c-911b938cc1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6803","nonce":1657326880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6805","nonce":1657326880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6809","nonce":1657326880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6807","nonce":1657326880}]},"public_addr":"172.21.15.149:6803/1657326880","cluster_addr":"172.21.15.149:6805/1657326880","heartbeat_back_addr":"172.21.15.149:6809/1657326880","heartbeat_front_addr":"172.21.15.149:6807/1657326880","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.399701+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.051745+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.190159+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:23.240143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.446570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.259974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:21.990407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.459259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:14:59.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.713+0000 7f8a3e400640 1 -- 172.21.15.90:0/3022370764 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8a18078b90 msgr2=0x7f8a1807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:59.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.713+0000 7f8a3e400640 1 --2- 172.21.15.90:0/3022370764 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8a18078b90 0x7f8a1807b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00bb00 tx=0x7f8a2c005e30 comp rx=0 tx=0).stop 2024-09-21T03:14:59.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.713+0000 7f8a3e400640 1 -- 172.21.15.90:0/3022370764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a38157f60 msgr2=0x7f8a3814d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:59.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.713+0000 7f8a3e400640 1 --2- 172.21.15.90:0/3022370764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a38157f60 0x7f8a3814d5e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000c6e0 tx=0x7f8a3000cba0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.713+0000 7f8a3e400640 1 -- 172.21.15.90:0/3022370764 shutdown_connections 2024-09-21T03:14:59.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.713+0000 7f8a3e400640 1 --2- 172.21.15.90:0/3022370764 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8a18078b90 0x7f8a1807b0a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.713+0000 7f8a3e400640 1 --2- 172.21.15.90:0/3022370764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a38157f60 0x7f8a3814d5e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.713+0000 7f8a3e400640 1 --2- 172.21.15.90:0/3022370764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a380c5460 0x7f8a380acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.713+0000 7f8a3e400640 1 --2- 172.21.15.90:0/3022370764 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a38071530 0x7f8a380ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.713+0000 7f8a3e400640 1 -- 172.21.15.90:0/3022370764 >> 172.21.15.90:0/3022370764 conn(0x7f8a380ca0d0 msgr2=0x7f8a380af380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:59.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.713+0000 7f8a3e400640 1 -- 172.21.15.90:0/3022370764 shutdown_connections 2024-09-21T03:14:59.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.713+0000 7f8a3e400640 1 -- 172.21.15.90:0/3022370764 wait complete. 2024-09-21T03:14:59.740 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:14:59.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.960+0000 7f23cae00640 1 -- 172.21.15.90:0/4123601757 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23c40c55b0 msgr2=0x7f23c4156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:59.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.960+0000 7f23cae00640 1 --2- 172.21.15.90:0/4123601757 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23c40c55b0 0x7f23c4156ef0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f23bc005fd0 tx=0x7f23bc02a820 comp rx=0 tx=0).stop 2024-09-21T03:14:59.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.960+0000 7f23cae00640 1 -- 172.21.15.90:0/4123601757 shutdown_connections 2024-09-21T03:14:59.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.960+0000 7f23cae00640 1 --2- 172.21.15.90:0/4123601757 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23c40c55b0 0x7f23c4156ef0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.960+0000 7f23cae00640 1 --2- 172.21.15.90:0/4123601757 >> v2:172.21.15.149:3300/0 conn(0x7f23c406ea40 0x7f23c40c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.960+0000 7f23cae00640 1 -- 172.21.15.90:0/4123601757 >> 172.21.15.90:0/4123601757 conn(0x7f23c40c84c0 msgr2=0x7f23c40c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:14:59.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.960+0000 7f23cae00640 1 -- 172.21.15.90:0/4123601757 shutdown_connections 2024-09-21T03:14:59.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.960+0000 7f23cae00640 1 -- 172.21.15.90:0/4123601757 wait complete. 2024-09-21T03:14:59.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.962+0000 7f23cae00640 1 Processor -- start 2024-09-21T03:14:59.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.962+0000 7f23cae00640 1 -- start start 2024-09-21T03:14:59.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.964+0000 7f23cae00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23c406ea40 0x7f23c40c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:59.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.964+0000 7f23cae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23c40c51a0 0x7f23c414eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:59.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.964+0000 7f23cae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23c41561f0 0x7f23c4147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:59.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.964+0000 7f23cae00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f23c41545f0 con 0x7f23c406ea40 2024-09-21T03:14:59.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.964+0000 7f23cae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f23c406fcb0 con 0x7f23c41561f0 2024-09-21T03:14:59.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.964+0000 7f23cae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f23c4154770 con 0x7f23c40c51a0 2024-09-21T03:14:59.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.964+0000 7f23c9a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23c406ea40 0x7f23c40c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:59.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.964+0000 7f23c9a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23c406ea40 0x7f23c40c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33602/0 (socket says 172.21.15.90:33602) 2024-09-21T03:14:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.964+0000 7f23c9a00640 1 -- 172.21.15.90:0/1960121840 learned_addr learned my addr 172.21.15.90:0/1960121840 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:14:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.964+0000 7f23ca400640 1 --2- 172.21.15.90:0/1960121840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23c41561f0 0x7f23c4147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.964+0000 7f23c9000640 1 --2- 172.21.15.90:0/1960121840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23c40c51a0 0x7f23c414eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.964+0000 7f23c9a00640 1 -- 172.21.15.90:0/1960121840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23c40c51a0 msgr2=0x7f23c414eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.964+0000 7f23c9a00640 1 --2- 172.21.15.90:0/1960121840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23c40c51a0 0x7f23c414eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.964+0000 7f23c9a00640 1 -- 172.21.15.90:0/1960121840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23c41561f0 msgr2=0x7f23c4147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:14:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.964+0000 7f23c9a00640 1 --2- 172.21.15.90:0/1960121840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23c41561f0 0x7f23c4147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:14:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.964+0000 7f23c9a00640 1 -- 172.21.15.90:0/1960121840 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c4155cf0 con 0x7f23c406ea40 2024-09-21T03:14:59.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.965+0000 7f23c9a00640 1 --2- 172.21.15.90:0/1960121840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23c406ea40 0x7f23c40c72e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f23b400e9c0 tx=0x7f23b400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:59.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.965+0000 7f23c1600640 1 -- 172.21.15.90:0/1960121840 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b400cd80 con 0x7f23c406ea40 2024-09-21T03:14:59.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.965+0000 7f23c1600640 1 -- 172.21.15.90:0/1960121840 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23b4004020 con 0x7f23c406ea40 2024-09-21T03:14:59.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.965+0000 7f23c1600640 1 -- 172.21.15.90:0/1960121840 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4004450 con 0x7f23c406ea40 2024-09-21T03:14:59.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.965+0000 7f23cae00640 1 -- 172.21.15.90:0/1960121840 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c414bdd0 con 0x7f23c406ea40 2024-09-21T03:14:59.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.965+0000 7f23cae00640 1 -- 172.21.15.90:0/1960121840 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c40746e0 con 0x7f23c406ea40 2024-09-21T03:14:59.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.966+0000 7f23cae00640 1 -- 172.21.15.90:0/1960121840 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c4076f50 con 0x7f23c406ea40 2024-09-21T03:14:59.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.967+0000 7f23c1600640 1 -- 172.21.15.90:0/1960121840 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f23b40035f0 con 0x7f23c406ea40 2024-09-21T03:14:59.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.969+0000 7f23c1600640 1 --2- 172.21.15.90:0/1960121840 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f23a8078b90 0x7f23a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:14:59.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.969+0000 7f23c1600640 1 -- 172.21.15.90:0/1960121840 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f23b409b890 con 0x7f23c406ea40 2024-09-21T03:14:59.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.969+0000 7f23c9000640 1 --2- 172.21.15.90:0/1960121840 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f23a8078b90 0x7f23a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:14:59.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.970+0000 7f23c9000640 1 --2- 172.21.15.90:0/1960121840 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f23a8078b90 0x7f23a807b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f23b8000f60 tx=0x7f23b8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:14:59.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:14:59.973+0000 7f23c1600640 1 -- 172.21.15.90:0/1960121840 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f23c4076f50 con 0x7f23c406ea40 2024-09-21T03:15:00.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.193+0000 7f23cae00640 1 -- 172.21.15.90:0/1960121840 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23c40c55b0 con 0x7f23c406ea40 2024-09-21T03:15:00.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.194+0000 7f23c1600640 1 -- 172.21.15.90:0/1960121840 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6530 (secure 0 0 0) 0x7f23b4063340 con 0x7f23c406ea40 2024-09-21T03:15:00.196 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:15:00.196 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"btime":"2024-09-21T03:14:51:570098+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3707484056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3707484056},{"type":"v1","addr":"172.21.15.90:6835","nonce":3707484056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1650707992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1650707992},{"type":"v1","addr":"172.21.15.149:6837","nonce":1650707992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:37.954868+0000","modified":"2024-09-21T03:14:41.971257+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/2166962836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2166962836},{"type":"v1","addr":"172.21.15.149:6836","nonce":2166962836}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:47.021969+0000","modified":"2024-09-21T03:14:51.055397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4395},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4395":{"gid":4395,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6833/1105275899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1105275899},{"type":"v1","addr":"172.21.15.90:6833","nonce":1105275899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4395,"qdb_cluster":[4395]},"id":2}]} 2024-09-21T03:15:00.196 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2024-09-21T03:15:00.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.196+0000 7f23cae00640 1 -- 172.21.15.90:0/1960121840 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f23a8078b90 msgr2=0x7f23a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:00.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.196+0000 7f23cae00640 1 --2- 172.21.15.90:0/1960121840 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f23a8078b90 0x7f23a807b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f23b8000f60 tx=0x7f23b8009040 comp rx=0 tx=0).stop 2024-09-21T03:15:00.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.196+0000 7f23cae00640 1 -- 172.21.15.90:0/1960121840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23c406ea40 msgr2=0x7f23c40c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:00.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.196+0000 7f23cae00640 1 --2- 172.21.15.90:0/1960121840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23c406ea40 0x7f23c40c72e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f23b400e9c0 tx=0x7f23b400ee80 comp rx=0 tx=0).stop 2024-09-21T03:15:00.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.196+0000 7f23cae00640 1 -- 172.21.15.90:0/1960121840 shutdown_connections 2024-09-21T03:15:00.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.196+0000 7f23cae00640 1 --2- 172.21.15.90:0/1960121840 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f23a8078b90 0x7f23a807b0a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.196+0000 7f23cae00640 1 --2- 172.21.15.90:0/1960121840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23c41561f0 0x7f23c4147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.196+0000 7f23cae00640 1 --2- 172.21.15.90:0/1960121840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23c40c51a0 0x7f23c414eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.196+0000 7f23cae00640 1 --2- 172.21.15.90:0/1960121840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23c406ea40 0x7f23c40c72e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.196+0000 7f23cae00640 1 -- 172.21.15.90:0/1960121840 >> 172.21.15.90:0/1960121840 conn(0x7f23c40c84c0 msgr2=0x7f23c40ab8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:00.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.197+0000 7f23cae00640 1 -- 172.21.15.90:0/1960121840 shutdown_connections 2024-09-21T03:15:00.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.197+0000 7f23cae00640 1 -- 172.21.15.90:0/1960121840 wait complete. 2024-09-21T03:15:00.623 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T03:14:37.954868+0000', 'modified': '2024-09-21T03:14:41.971257+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4414}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4414': {'gid': 4414, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.149:6836/2166962836', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6834', 'nonce': 2166962836}, {'type': 'v1', 'addr': '172.21.15.149:6836', 'nonce': 2166962836}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'a', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4414, 'qdb_cluster': [4414]} 2024-09-21T03:15:00.624 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T03:15:00.624 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-21T03:15:00.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.845+0000 7f8144600640 1 -- 172.21.15.90:0/3063964331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8124003a00 msgr2=0x7f8124003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:00.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.845+0000 7f8144600640 1 --2- 172.21.15.90:0/3063964331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8124003a00 0x7f8124003e70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f813000c290 tx=0x7f8124005830 comp rx=0 tx=0).stop 2024-09-21T03:15:00.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.845+0000 7f8142600640 1 -- 172.21.15.90:0/3063964331 reap_dead start 2024-09-21T03:15:00.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.845+0000 7f8144600640 1 -- 172.21.15.90:0/3063964331 shutdown_connections 2024-09-21T03:15:00.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.845+0000 7f8144600640 1 -- 172.21.15.90:0/3063964331 >> 172.21.15.90:0/3063964331 conn(0x7f813c0c85a0 msgr2=0x7f813c0c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:00.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.845+0000 7f8144600640 1 -- 172.21.15.90:0/3063964331 shutdown_connections 2024-09-21T03:15:00.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.845+0000 7f8144600640 1 -- 172.21.15.90:0/3063964331 wait complete. 2024-09-21T03:15:00.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.847+0000 7f8144600640 1 Processor -- start 2024-09-21T03:15:00.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.847+0000 7f8144600640 1 -- start start 2024-09-21T03:15:00.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.849+0000 7f8144600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8124003a00 0x7f813c0c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:00.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.849+0000 7f8144600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c0c71e0 0x7f813c137920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:00.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.849+0000 7f8144600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813c153b80 0x7f813c153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:00.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.849+0000 7f8144600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f813c06e8e0 con 0x7f8124003a00 2024-09-21T03:15:00.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.849+0000 7f8144600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f813c06e760 con 0x7f813c0c71e0 2024-09-21T03:15:00.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.849+0000 7f8144600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f813c070870 con 0x7f813c153b80 2024-09-21T03:15:00.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.849+0000 7f8141c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8124003a00 0x7f813c0c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:00.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.849+0000 7f8141c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8124003a00 0x7f813c0c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33626/0 (socket says 172.21.15.90:33626) 2024-09-21T03:15:00.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.849+0000 7f8141c00640 1 -- 172.21.15.90:0/2689784404 learned_addr learned my addr 172.21.15.90:0/2689784404 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:00.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.849+0000 7f8141200640 1 --2- 172.21.15.90:0/2689784404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c0c71e0 0x7f813c137920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:00.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.849+0000 7f8142600640 1 --2- 172.21.15.90:0/2689784404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813c153b80 0x7f813c153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:00.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.849+0000 7f8141c00640 1 -- 172.21.15.90:0/2689784404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813c153b80 msgr2=0x7f813c153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:00.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.849+0000 7f8141c00640 1 --2- 172.21.15.90:0/2689784404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813c153b80 0x7f813c153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.849+0000 7f8141c00640 1 -- 172.21.15.90:0/2689784404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c0c71e0 msgr2=0x7f813c137920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:00.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.849+0000 7f8141c00640 1 --2- 172.21.15.90:0/2689784404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c0c71e0 0x7f813c137920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.849+0000 7f8141c00640 1 -- 172.21.15.90:0/2689784404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813c13d410 con 0x7f8124003a00 2024-09-21T03:15:00.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.849+0000 7f8142600640 1 --2- 172.21.15.90:0/2689784404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813c153b80 0x7f813c153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:15:00.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.849+0000 7f8141200640 1 --2- 172.21.15.90:0/2689784404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c0c71e0 0x7f813c137920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:15:00.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.850+0000 7f8141c00640 1 --2- 172.21.15.90:0/2689784404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8124003a00 0x7f813c0c78a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f813000c3b0 tx=0x7f8130006380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:00.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.850+0000 7f8139600640 1 -- 172.21.15.90:0/2689784404 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130031050 con 0x7f8124003a00 2024-09-21T03:15:00.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.850+0000 7f8139600640 1 -- 172.21.15.90:0/2689784404 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8130003af0 con 0x7f8124003a00 2024-09-21T03:15:00.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.850+0000 7f8144600640 1 -- 172.21.15.90:0/2689784404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813c1eda00 con 0x7f8124003a00 2024-09-21T03:15:00.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.850+0000 7f8139600640 1 -- 172.21.15.90:0/2689784404 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130006570 con 0x7f8124003a00 2024-09-21T03:15:00.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.850+0000 7f8144600640 1 -- 172.21.15.90:0/2689784404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f813c0c7de0 con 0x7f8124003a00 2024-09-21T03:15:00.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.853+0000 7f8139600640 1 -- 172.21.15.90:0/2689784404 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f813002d450 con 0x7f8124003a00 2024-09-21T03:15:00.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.853+0000 7f8139600640 1 --2- 172.21.15.90:0/2689784404 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f811c078bc0 0x7f811c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:00.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.854+0000 7f8139600640 1 -- 172.21.15.90:0/2689784404 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f81300bb750 con 0x7f8124003a00 2024-09-21T03:15:00.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.854+0000 7f814b7f2740 1 Processor -- start 2024-09-21T03:15:00.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.854+0000 7f8141200640 1 --2- 172.21.15.90:0/2689784404 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f811c078bc0 0x7f811c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:00.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.854+0000 7f814b7f2740 1 -- start start 2024-09-21T03:15:00.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.855+0000 7f8141200640 1 --2- 172.21.15.90:0/2689784404 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f811c078bc0 0x7f811c07b0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8128005eb0 tx=0x7f8128005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:00.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.855+0000 7f814b7f2740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499ea5270 0x56449a248f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:00.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.855+0000 7f814b7f2740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564499e7c3b0 0x56449a26c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:00.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.855+0000 7f814b7f2740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x564499e84590 0x56449a28fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:00.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.855+0000 7f814b7f2740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56449a1cf430 con 0x564499ea5270 2024-09-21T03:15:00.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.855+0000 7f814b7f2740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56449a1bf5d0 con 0x564499e7c3b0 2024-09-21T03:15:00.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.855+0000 7f814b7f2740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x56449a1aea00 con 0x564499e84590 2024-09-21T03:15:00.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.856+0000 7f8141c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499ea5270 0x56449a248f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:00.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.856+0000 7f8141c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499ea5270 0x56449a248f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33632/0 (socket says 172.21.15.90:33632) 2024-09-21T03:15:00.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.856+0000 7f8141c00640 1 -- 172.21.15.90:0/1150739922 learned_addr learned my addr 172.21.15.90:0/1150739922 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:00.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.856+0000 7f8141200640 1 --2- 172.21.15.90:0/1150739922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564499e7c3b0 0x56449a26c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:00.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.856+0000 7f8142600640 1 --2- 172.21.15.90:0/1150739922 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x564499e84590 0x56449a28fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:00.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.856+0000 7f8141c00640 1 -- 172.21.15.90:0/1150739922 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x564499e84590 msgr2=0x56449a28fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:15:00.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.856+0000 7f8141c00640 1 --2- 172.21.15.90:0/1150739922 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x564499e84590 0x56449a28fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.856+0000 7f8141c00640 1 -- 172.21.15.90:0/1150739922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564499e7c3b0 msgr2=0x56449a26c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:15:00.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.856+0000 7f8141c00640 1 --2- 172.21.15.90:0/1150739922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564499e7c3b0 0x56449a26c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.856+0000 7f8141c00640 1 -- 172.21.15.90:0/1150739922 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56449a177520 con 0x564499ea5270 2024-09-21T03:15:00.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.856+0000 7f8141c00640 1 --2- 172.21.15.90:0/1150739922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499ea5270 0x56449a248f30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8130030040 tx=0x7f813007f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6d3f8fdf1cd780 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:00.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.856+0000 7f812e000640 1 -- 172.21.15.90:0/1150739922 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81300a9020 con 0x564499ea5270 2024-09-21T03:15:00.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.857+0000 7f812e000640 1 -- 172.21.15.90:0/1150739922 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81300839a0 con 0x564499ea5270 2024-09-21T03:15:00.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.857+0000 7f812e000640 1 -- 172.21.15.90:0/1150739922 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813008a2d0 con 0x564499ea5270 2024-09-21T03:15:00.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.857+0000 7f814b7f2740 1 -- 172.21.15.90:0/1150739922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499ea5270 msgr2=0x56449a248f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:00.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.857+0000 7f814b7f2740 1 --2- 172.21.15.90:0/1150739922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499ea5270 0x56449a248f30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8130030040 tx=0x7f813007f270 comp rx=0 tx=0).stop 2024-09-21T03:15:00.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.857+0000 7f814b7f2740 1 -- 172.21.15.90:0/1150739922 shutdown_connections 2024-09-21T03:15:00.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.857+0000 7f814b7f2740 1 --2- 172.21.15.90:0/1150739922 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x564499e84590 0x56449a28fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.857+0000 7f814b7f2740 1 --2- 172.21.15.90:0/1150739922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564499e7c3b0 0x56449a26c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.857+0000 7f814b7f2740 1 --2- 172.21.15.90:0/1150739922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499ea5270 0x56449a248f30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.857+0000 7f814b7f2740 1 -- 172.21.15.90:0/1150739922 >> 172.21.15.90:0/1150739922 conn(0x564499e993c0 msgr2=0x56449a28a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:00.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.857+0000 7f814b7f2740 1 -- 172.21.15.90:0/1150739922 shutdown_connections 2024-09-21T03:15:00.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.857+0000 7f814b7f2740 1 -- 172.21.15.90:0/1150739922 wait complete. 2024-09-21T03:15:00.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.858+0000 7f814b7f2740 1 -- start start 2024-09-21T03:15:00.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.859+0000 7f814b7f2740 1 Processor -- start 2024-09-21T03:15:00.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.860+0000 7f814b7f2740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 0x56449a280640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:00.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.860+0000 7f814b7f2740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x564499e84590 0x56449a296500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:00.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.860+0000 7f814b7f2740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564499ea5270 0x56449a25f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:00.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.860+0000 7f814b7f2740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56449a155330 con 0x564499e7c3b0 2024-09-21T03:15:00.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.860+0000 7f814b7f2740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56449a1b2810 con 0x564499ea5270 2024-09-21T03:15:00.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.860+0000 7f814b7f2740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x564499f1f620 con 0x564499e84590 2024-09-21T03:15:00.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.860+0000 7f814b7f2740 10 client.0 _ll_register_callbacks cb 0x56449a15a420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:15:00.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.860+0000 7f8141c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 0x56449a280640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:00.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.860+0000 7f8141c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 0x56449a280640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33642/0 (socket says 172.21.15.90:33642) 2024-09-21T03:15:00.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.860+0000 7f8141200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x564499e84590 0x56449a296500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:00.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.860+0000 7f8141c00640 1 -- 172.21.15.90:0/2081865543 learned_addr learned my addr 172.21.15.90:0/2081865543 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:00.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.861+0000 7f8142600640 1 --2- 172.21.15.90:0/2081865543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564499ea5270 0x56449a25f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:00.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.861+0000 7f8141c00640 1 -- 172.21.15.90:0/2081865543 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x564499e84590 msgr2=0x56449a296500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:15:00.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.861+0000 7f8141c00640 1 --2- 172.21.15.90:0/2081865543 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x564499e84590 0x56449a296500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.861+0000 7f8141c00640 1 -- 172.21.15.90:0/2081865543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564499ea5270 msgr2=0x56449a25f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:15:00.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.861+0000 7f8141c00640 1 --2- 172.21.15.90:0/2081865543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564499ea5270 0x56449a25f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.861+0000 7f8141c00640 1 -- 172.21.15.90:0/2081865543 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564499f10850 con 0x564499e7c3b0 2024-09-21T03:15:00.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.861+0000 7f8141c00640 1 --2- 172.21.15.90:0/2081865543 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 0x56449a280640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8130083b50 tx=0x7f813008a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c29fb229fa7ecd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:00.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.861+0000 7f8122a00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T03:15:00.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.861+0000 7f8122a00640 1 -- 172.21.15.90:0/2081865543 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81300a9040 con 0x564499e7c3b0 2024-09-21T03:15:00.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.861+0000 7f8122a00640 1 -- 172.21.15.90:0/2081865543 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f813008c7a0 con 0x564499e7c3b0 2024-09-21T03:15:00.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.861+0000 7f814b7f2740 1 -- 172.21.15.90:0/2081865543 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81300839a0 con 0x564499e7c3b0 2024-09-21T03:15:00.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.862+0000 7f8122a00640 1 -- 172.21.15.90:0/2081865543 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f8130087d80 con 0x564499e7c3b0 2024-09-21T03:15:00.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.862+0000 7f814b7f2740 10 client.4743 fetch_fsmap learned FSMap version 14 2024-09-21T03:15:00.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.862+0000 7f814b7f2740 1 -- 172.21.15.90:0/2081865543 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x564499f876b0 con 0x564499e7c3b0 2024-09-21T03:15:00.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.862+0000 7f8122a00640 1 -- 172.21.15.90:0/2081865543 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81300839a0 con 0x564499e7c3b0 2024-09-21T03:15:00.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.862+0000 7f8122a00640 1 -- 172.21.15.90:0/2081865543 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) ==== 4136+0+0 (secure 0 0 0) 0x7f8130049070 con 0x564499e7c3b0 2024-09-21T03:15:00.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.862+0000 7f814b7f2740 10 client.4743 fetch_fsmap finished waiting for FSMap version 14 2024-09-21T03:15:00.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.862+0000 7f814b7f2740 10 client.4743 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:15:00.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.862+0000 7f814b7f2740 20 client.4743 populate_metadata read hostname 'smithi090' 2024-09-21T03:15:00.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.862+0000 7f814b7f2740 1 --2- 172.21.15.90:0/2081865543 >> [v2:172.21.15.149:6834/2166962836,v1:172.21.15.149:6836/2166962836] conn(0x564499e63e40 0x56449a249990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:00.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.862+0000 7f814b7f2740 4 client.4743 mds_command: new command op to 4414 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:15:00.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.862+0000 7f814b7f2740 1 -- 172.21.15.90:0/2081865543 --> [v2:172.21.15.149:6834/2166962836,v1:172.21.15.149:6836/2166962836] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56449a1c1520 con 0x564499e63e40 2024-09-21T03:15:00.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.862+0000 7f8141200640 1 --2- 172.21.15.90:0/2081865543 >> [v2:172.21.15.149:6834/2166962836,v1:172.21.15.149:6836/2166962836] conn(0x564499e63e40 0x56449a249990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:00.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.863+0000 7f8122a00640 10 client.4743 ms_handle_connect on v2:172.21.15.149:6834/2166962836 2024-09-21T03:15:00.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.863+0000 7f8141200640 1 --2- 172.21.15.90:0/2081865543 >> [v2:172.21.15.149:6834/2166962836,v1:172.21.15.149:6836/2166962836] conn(0x564499e63e40 0x56449a249990 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=921ce3f685036a2c server_cookie=f34bc12917c19c8c in_seq=0 out_seq=0 2024-09-21T03:15:00.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.864+0000 7f8122a00640 1 -- 172.21.15.90:0/2081865543 <== mds.0 v2:172.21.15.149:6834/2166962836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56449a1c1520 con 0x564499e63e40 2024-09-21T03:15:00.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.864+0000 7f8122a00640 10 client.4743 handle_command_reply: tid=0 2024-09-21T03:15:00.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.864+0000 7f814b7f2740 1 client.4743 shutdown 2024-09-21T03:15:00.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.865+0000 7f814b7f2740 1 -- 172.21.15.90:0/2081865543 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 msgr2=0x56449a280640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:00.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.865+0000 7f814b7f2740 1 --2- 172.21.15.90:0/2081865543 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 0x56449a280640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8130083b50 tx=0x7f813008a2f0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.865+0000 7f814b7f2740 1 -- 172.21.15.90:0/2081865543 shutdown_connections 2024-09-21T03:15:00.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.865+0000 7f814b7f2740 1 --2- 172.21.15.90:0/2081865543 >> [v2:172.21.15.149:6834/2166962836,v1:172.21.15.149:6836/2166962836] conn(0x564499e63e40 0x56449a249990 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.865+0000 7f814b7f2740 1 --2- 172.21.15.90:0/2081865543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564499ea5270 0x56449a25f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.865+0000 7f814b7f2740 1 --2- 172.21.15.90:0/2081865543 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x564499e84590 0x56449a296500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.865+0000 7f814b7f2740 1 --2- 172.21.15.90:0/2081865543 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 0x56449a280640 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.865+0000 7f814b7f2740 1 -- 172.21.15.90:0/2081865543 >> 172.21.15.90:0/2081865543 conn(0x564499e993c0 msgr2=0x56449a265680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:00.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.865+0000 7f8122a00640 0 client.4743 ms_handle_reset on v2:172.21.15.149:6834/2166962836 2024-09-21T03:15:00.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.865+0000 7f814b7f2740 1 -- 172.21.15.90:0/2081865543 shutdown_connections 2024-09-21T03:15:00.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.865+0000 7f814b7f2740 1 -- 172.21.15.90:0/2081865543 wait complete. 2024-09-21T03:15:00.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.865+0000 7f814b7f2740 20 client.4743 trim_cache size 0 max 16384 2024-09-21T03:15:00.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.884+0000 7f814b7f2740 1 Processor -- start 2024-09-21T03:15:00.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.884+0000 7f814b7f2740 1 -- start start 2024-09-21T03:15:00.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.885+0000 7f814b7f2740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 0x56449a241540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:00.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.885+0000 7f814b7f2740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x564499e84590 0x56449a269500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:00.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.885+0000 7f814b7f2740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564499ea5270 0x56449a2aa1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:00.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.885+0000 7f814b7f2740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f813c1fd680 con 0x564499e7c3b0 2024-09-21T03:15:00.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.885+0000 7f814b7f2740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f813c1fb060 con 0x564499ea5270 2024-09-21T03:15:00.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.885+0000 7f814b7f2740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f813c1fb6b0 con 0x564499e84590 2024-09-21T03:15:00.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.885+0000 7f8141c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 0x56449a241540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:00.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.885+0000 7f8141c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 0x56449a241540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33650/0 (socket says 172.21.15.90:33650) 2024-09-21T03:15:00.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.885+0000 7f8141c00640 1 -- 172.21.15.90:0/3326353961 learned_addr learned my addr 172.21.15.90:0/3326353961 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:00.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.885+0000 7f8141c00640 1 -- 172.21.15.90:0/3326353961 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x564499e84590 msgr2=0x56449a269500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:15:00.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.885+0000 7f8141c00640 1 --2- 172.21.15.90:0/3326353961 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x564499e84590 0x56449a269500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.885+0000 7f8141c00640 1 -- 172.21.15.90:0/3326353961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564499ea5270 msgr2=0x56449a2aa1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:15:00.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.885+0000 7f8141c00640 1 --2- 172.21.15.90:0/3326353961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564499ea5270 0x56449a2aa1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.885+0000 7f8141c00640 1 -- 172.21.15.90:0/3326353961 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564499f876b0 con 0x564499e7c3b0 2024-09-21T03:15:00.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.886+0000 7f8141c00640 1 --2- 172.21.15.90:0/3326353961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 0x56449a241540 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8130083460 tx=0x7f8130006950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adefaeb86db3aa70 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:00.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.886+0000 7f812d600640 1 -- 172.21.15.90:0/3326353961 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81300a9040 con 0x564499e7c3b0 2024-09-21T03:15:00.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.886+0000 7f812d600640 1 -- 172.21.15.90:0/3326353961 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81300a2070 con 0x564499e7c3b0 2024-09-21T03:15:00.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.886+0000 7f812d600640 1 -- 172.21.15.90:0/3326353961 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81300839a0 con 0x564499e7c3b0 2024-09-21T03:15:00.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.887+0000 7f814b7f2740 1 -- 172.21.15.90:0/3326353961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 msgr2=0x56449a241540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:00.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.887+0000 7f814b7f2740 1 --2- 172.21.15.90:0/3326353961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 0x56449a241540 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8130083460 tx=0x7f8130006950 comp rx=0 tx=0).stop 2024-09-21T03:15:00.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.887+0000 7f814b7f2740 1 -- 172.21.15.90:0/3326353961 shutdown_connections 2024-09-21T03:15:00.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.887+0000 7f814b7f2740 1 --2- 172.21.15.90:0/3326353961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564499ea5270 0x56449a2aa1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.887+0000 7f814b7f2740 1 --2- 172.21.15.90:0/3326353961 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x564499e84590 0x56449a269500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.887+0000 7f814b7f2740 1 --2- 172.21.15.90:0/3326353961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 0x56449a241540 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.887+0000 7f814b7f2740 1 -- 172.21.15.90:0/3326353961 >> 172.21.15.90:0/3326353961 conn(0x564499e993c0 msgr2=0x56449a247670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:00.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.887+0000 7f814b7f2740 1 -- 172.21.15.90:0/3326353961 shutdown_connections 2024-09-21T03:15:00.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.887+0000 7f814b7f2740 1 -- 172.21.15.90:0/3326353961 wait complete. 2024-09-21T03:15:00.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.888+0000 7f814b7f2740 1 -- start start 2024-09-21T03:15:00.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.888+0000 7f814b7f2740 1 Processor -- start 2024-09-21T03:15:00.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.889+0000 7f814b7f2740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 0x56449a29afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:00.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.889+0000 7f814b7f2740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564499e84590 0x56449a292c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:00.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.889+0000 7f814b7f2740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x564499ea5270 0x56449a2aa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:00.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.889+0000 7f814b7f2740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56449a155330 con 0x564499e7c3b0 2024-09-21T03:15:00.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.889+0000 7f814b7f2740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x564499f1f620 con 0x564499e84590 2024-09-21T03:15:00.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.889+0000 7f814b7f2740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x56449a296d10 con 0x564499ea5270 2024-09-21T03:15:00.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.889+0000 7f814b7f2740 10 client.0 _ll_register_callbacks cb 0x7f81300832a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:15:00.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.889+0000 7f8141c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 0x56449a29afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:00.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.889+0000 7f8141c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 0x56449a29afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33664/0 (socket says 172.21.15.90:33664) 2024-09-21T03:15:00.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.889+0000 7f8141c00640 1 -- 172.21.15.90:0/1938099829 learned_addr learned my addr 172.21.15.90:0/1938099829 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:00.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.890+0000 7f8142600640 1 --2- 172.21.15.90:0/1938099829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x564499ea5270 0x56449a2aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:00.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.890+0000 7f8141200640 1 --2- 172.21.15.90:0/1938099829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564499e84590 0x56449a292c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:00.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.890+0000 7f8141c00640 1 -- 172.21.15.90:0/1938099829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x564499ea5270 msgr2=0x56449a2aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:15:00.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.890+0000 7f8141c00640 1 --2- 172.21.15.90:0/1938099829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x564499ea5270 0x56449a2aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.890+0000 7f8141c00640 1 -- 172.21.15.90:0/1938099829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564499e84590 msgr2=0x56449a292c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:15:00.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.890+0000 7f8141c00640 1 --2- 172.21.15.90:0/1938099829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564499e84590 0x56449a292c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:00.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.890+0000 7f8141c00640 1 -- 172.21.15.90:0/1938099829 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56449a2852c0 con 0x564499e7c3b0 2024-09-21T03:15:00.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.890+0000 7f8141c00640 1 --2- 172.21.15.90:0/1938099829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 0x56449a29afe0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f81300b9940 tx=0x7f8130001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a6c54e772d95b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:00.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.890+0000 7f8122a00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T03:15:00.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.890+0000 7f8122a00640 1 -- 172.21.15.90:0/1938099829 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81300a9040 con 0x564499e7c3b0 2024-09-21T03:15:00.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.890+0000 7f8122a00640 1 -- 172.21.15.90:0/1938099829 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f8130082700 con 0x564499e7c3b0 2024-09-21T03:15:00.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.890+0000 7f814b7f2740 1 -- 172.21.15.90:0/1938099829 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81300a2070 con 0x564499e7c3b0 2024-09-21T03:15:00.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.891+0000 7f8122a00640 1 -- 172.21.15.90:0/1938099829 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f81300b5070 con 0x564499e7c3b0 2024-09-21T03:15:00.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.891+0000 7f814b7f2740 10 client.4749 fetch_fsmap learned FSMap version 14 2024-09-21T03:15:00.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.891+0000 7f814b7f2740 1 -- 172.21.15.90:0/1938099829 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x56449a287610 con 0x564499e7c3b0 2024-09-21T03:15:00.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.891+0000 7f8122a00640 1 -- 172.21.15.90:0/1938099829 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81300a2070 con 0x564499e7c3b0 2024-09-21T03:15:00.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.891+0000 7f8122a00640 1 -- 172.21.15.90:0/1938099829 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) ==== 4136+0+0 (secure 0 0 0) 0x7f8130049070 con 0x564499e7c3b0 2024-09-21T03:15:00.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.891+0000 7f814b7f2740 10 client.4749 fetch_fsmap finished waiting for FSMap version 14 2024-09-21T03:15:00.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.891+0000 7f814b7f2740 10 client.4749 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:15:00.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.891+0000 7f814b7f2740 20 client.4749 populate_metadata read hostname 'smithi090' 2024-09-21T03:15:00.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.891+0000 7f814b7f2740 1 --2- 172.21.15.90:0/1938099829 >> [v2:172.21.15.149:6834/2166962836,v1:172.21.15.149:6836/2166962836] conn(0x56449a29feb0 0x56449a30ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:00.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.891+0000 7f814b7f2740 4 client.4749 mds_command: new command op to 4414 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:15:00.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.891+0000 7f814b7f2740 1 -- 172.21.15.90:0/1938099829 --> [v2:172.21.15.149:6834/2166962836,v1:172.21.15.149:6836/2166962836] -- command(tid 0: {"prefix": "status"}) -- 0x56449a1bcfd0 con 0x56449a29feb0 2024-09-21T03:15:00.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.891+0000 7f8141200640 1 --2- 172.21.15.90:0/1938099829 >> [v2:172.21.15.149:6834/2166962836,v1:172.21.15.149:6836/2166962836] conn(0x56449a29feb0 0x56449a30ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:00.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.892+0000 7f8141200640 1 -- 172.21.15.90:0/1938099829 >> [v2:172.21.15.149:6834/2166962836,v1:172.21.15.149:6836/2166962836] conn(0x56449a29feb0 msgr2=0x56449a30ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-09-21T03:15:00.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.892+0000 7f8141200640 1 -- 172.21.15.90:0/1938099829 >> [v2:172.21.15.149:6834/2166962836,v1:172.21.15.149:6836/2166962836] conn(0x56449a29feb0 msgr2=0x56449a30ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-21T03:15:00.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.892+0000 7f8141200640 1 --2- 172.21.15.90:0/1938099829 >> [v2:172.21.15.149:6834/2166962836,v1:172.21.15.149:6836/2166962836] conn(0x56449a29feb0 0x56449a30ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T03:15:00.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:00.892+0000 7f8141200640 1 --2- 172.21.15.90:0/1938099829 >> [v2:172.21.15.149:6834/2166962836,v1:172.21.15.149:6836/2166962836] conn(0x56449a29feb0 0x56449a30ab20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:15:01.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.093+0000 7f8141200640 1 --2- 172.21.15.90:0/1938099829 >> [v2:172.21.15.149:6834/2166962836,v1:172.21.15.149:6836/2166962836] conn(0x56449a29feb0 0x56449a30ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:01.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.094+0000 7f8141200640 1 --2- 172.21.15.90:0/1938099829 >> [v2:172.21.15.149:6834/2166962836,v1:172.21.15.149:6836/2166962836] conn(0x56449a29feb0 0x56449a30ab20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d08f244088f0e290 server_cookie=915958babc3e7cb in_seq=0 out_seq=0 2024-09-21T03:15:01.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.094+0000 7f8122a00640 10 client.4749 ms_handle_connect on v2:172.21.15.149:6834/2166962836 2024-09-21T03:15:01.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.095+0000 7f8122a00640 1 -- 172.21.15.90:0/1938099829 <== mds.0 v2:172.21.15.149:6834/2166962836 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x56449a1bcfd0 con 0x56449a29feb0 2024-09-21T03:15:01.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.095+0000 7f8122a00640 10 client.4749 handle_command_reply: tid=0 2024-09-21T03:15:01.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.095+0000 7f814b7f2740 1 client.4749 shutdown 2024-09-21T03:15:01.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.095+0000 7f814b7f2740 1 -- 172.21.15.90:0/1938099829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 msgr2=0x56449a29afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:01.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.095+0000 7f814b7f2740 1 --2- 172.21.15.90:0/1938099829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 0x56449a29afe0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f81300b9940 tx=0x7f8130001e10 comp rx=0 tx=0).stop 2024-09-21T03:15:01.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.095+0000 7f814b7f2740 1 -- 172.21.15.90:0/1938099829 shutdown_connections 2024-09-21T03:15:01.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.095+0000 7f814b7f2740 1 --2- 172.21.15.90:0/1938099829 >> [v2:172.21.15.149:6834/2166962836,v1:172.21.15.149:6836/2166962836] conn(0x56449a29feb0 0x56449a30ab20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.095+0000 7f814b7f2740 1 --2- 172.21.15.90:0/1938099829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x564499ea5270 0x56449a2aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.095+0000 7f814b7f2740 1 --2- 172.21.15.90:0/1938099829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564499e84590 0x56449a292c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.095+0000 7f8122a00640 0 client.4749 ms_handle_reset on v2:172.21.15.149:6834/2166962836 2024-09-21T03:15:01.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.095+0000 7f814b7f2740 1 --2- 172.21.15.90:0/1938099829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564499e7c3b0 0x56449a29afe0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.095+0000 7f814b7f2740 1 -- 172.21.15.90:0/1938099829 >> 172.21.15.90:0/1938099829 conn(0x564499e993c0 msgr2=0x56449a296ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:01.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.095+0000 7f814b7f2740 1 -- 172.21.15.90:0/1938099829 shutdown_connections 2024-09-21T03:15:01.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.095+0000 7f814b7f2740 1 -- 172.21.15.90:0/1938099829 wait complete. 2024-09-21T03:15:01.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.095+0000 7f814b7f2740 20 client.4749 trim_cache size 0 max 16384 2024-09-21T03:15:01.099 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:15:01.099 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:15:01.099 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2024-09-21T03:15:01.099 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4414, 2024-09-21T03:15:01.099 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2024-09-21T03:15:01.099 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2024-09-21T03:15:01.099 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "a", 2024-09-21T03:15:01.099 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 22.647252251000001, 2024-09-21T03:15:01.099 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 8, 2024-09-21T03:15:01.100 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 25, 2024-09-21T03:15:01.100 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 21, 2024-09-21T03:15:01.100 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 28.938358600000001 2024-09-21T03:15:01.100 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:15:01.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.096+0000 7f8144600640 1 -- 172.21.15.90:0/2689784404 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f811c078bc0 msgr2=0x7f811c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:01.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.096+0000 7f8144600640 1 --2- 172.21.15.90:0/2689784404 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f811c078bc0 0x7f811c07b0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8128005eb0 tx=0x7f8128005f90 comp rx=0 tx=0).stop 2024-09-21T03:15:01.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.096+0000 7f8144600640 1 -- 172.21.15.90:0/2689784404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8124003a00 msgr2=0x7f813c0c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:01.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.096+0000 7f8144600640 1 --2- 172.21.15.90:0/2689784404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8124003a00 0x7f813c0c78a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f813000c3b0 tx=0x7f8130006380 comp rx=0 tx=0).stop 2024-09-21T03:15:01.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.096+0000 7f8144600640 1 -- 172.21.15.90:0/2689784404 shutdown_connections 2024-09-21T03:15:01.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.096+0000 7f8144600640 1 --2- 172.21.15.90:0/2689784404 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f811c078bc0 0x7f811c07b0d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.096+0000 7f8144600640 1 --2- 172.21.15.90:0/2689784404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f813c153b80 0x7f813c153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.096+0000 7f8144600640 1 --2- 172.21.15.90:0/2689784404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c0c71e0 0x7f813c137920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.096+0000 7f8144600640 1 --2- 172.21.15.90:0/2689784404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8124003a00 0x7f813c0c78a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.096+0000 7f8144600640 1 -- 172.21.15.90:0/2689784404 >> 172.21.15.90:0/2689784404 conn(0x7f813c0c85a0 msgr2=0x7f813c06fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:01.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.096+0000 7f8144600640 1 -- 172.21.15.90:0/2689784404 shutdown_connections 2024-09-21T03:15:01.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.096+0000 7f8144600640 1 -- 172.21.15.90:0/2689784404 wait complete. 2024-09-21T03:15:01.123 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:15:01.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.341+0000 7f110b200640 1 -- 172.21.15.90:0/1853999294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f110406e380 msgr2=0x7f11041615a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:01.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.341+0000 7f110b200640 1 --2- 172.21.15.90:0/1853999294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f110406e380 0x7f11041615a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f110408d9a0 tx=0x7f110002a8d0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.341+0000 7f110b200640 1 -- 172.21.15.90:0/1853999294 shutdown_connections 2024-09-21T03:15:01.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.341+0000 7f110b200640 1 --2- 172.21.15.90:0/1853999294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f110406e380 0x7f11041615a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.341+0000 7f110b200640 1 --2- 172.21.15.90:0/1853999294 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11040c7900 0x7f11040c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.341+0000 7f110b200640 1 -- 172.21.15.90:0/1853999294 >> 172.21.15.90:0/1853999294 conn(0x7f11040c8d90 msgr2=0x7f11040c91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:01.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.341+0000 7f110b200640 1 -- 172.21.15.90:0/1853999294 shutdown_connections 2024-09-21T03:15:01.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.341+0000 7f110b200640 1 -- 172.21.15.90:0/1853999294 wait complete. 2024-09-21T03:15:01.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.344+0000 7f110b200640 1 Processor -- start 2024-09-21T03:15:01.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.344+0000 7f110b200640 1 -- start start 2024-09-21T03:15:01.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.345+0000 7f110b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f110406e380 0x7f11040c17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:01.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.345+0000 7f110b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11040c7900 0x7f11040c3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:01.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.345+0000 7f110b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11041545f0 0x7f11041e2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:01.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.345+0000 7f110b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1104157b10 con 0x7f11040c7900 2024-09-21T03:15:01.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.345+0000 7f110b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f11041578b0 con 0x7f110406e380 2024-09-21T03:15:01.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.345+0000 7f110b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f11040c89e0 con 0x7f11041545f0 2024-09-21T03:15:01.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.345+0000 7f1109400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11040c7900 0x7f11040c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:01.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.345+0000 7f1109400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11040c7900 0x7f11040c3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33688/0 (socket says 172.21.15.90:33688) 2024-09-21T03:15:01.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.345+0000 7f1109400640 1 -- 172.21.15.90:0/2917576014 learned_addr learned my addr 172.21.15.90:0/2917576014 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:01.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.346+0000 7f1109e00640 1 --2- 172.21.15.90:0/2917576014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f110406e380 0x7f11040c17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:01.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.346+0000 7f110a800640 1 --2- 172.21.15.90:0/2917576014 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11041545f0 0x7f11041e2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:01.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.346+0000 7f1109400640 1 -- 172.21.15.90:0/2917576014 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11041545f0 msgr2=0x7f11041e2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:01.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.346+0000 7f1109400640 1 --2- 172.21.15.90:0/2917576014 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11041545f0 0x7f11041e2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.346+0000 7f1109400640 1 -- 172.21.15.90:0/2917576014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f110406e380 msgr2=0x7f11040c17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:01.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.346+0000 7f1109400640 1 --2- 172.21.15.90:0/2917576014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f110406e380 0x7f11040c17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.346+0000 7f1109400640 1 -- 172.21.15.90:0/2917576014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11040c0ad0 con 0x7f11040c7900 2024-09-21T03:15:01.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.346+0000 7f1109400640 1 --2- 172.21.15.90:0/2917576014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11040c7900 0x7f11040c3350 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f10f400c3c0 tx=0x7f10f400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:01.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.346+0000 7f10fe000640 1 -- 172.21.15.90:0/2917576014 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4017070 con 0x7f11040c7900 2024-09-21T03:15:01.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.346+0000 7f10fe000640 1 -- 172.21.15.90:0/2917576014 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10f40035f0 con 0x7f11040c7900 2024-09-21T03:15:01.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.346+0000 7f10fe000640 1 -- 172.21.15.90:0/2917576014 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4003a80 con 0x7f11040c7900 2024-09-21T03:15:01.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.346+0000 7f110b200640 1 -- 172.21.15.90:0/2917576014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11040bfd10 con 0x7f11040c7900 2024-09-21T03:15:01.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.346+0000 7f110b200640 1 -- 172.21.15.90:0/2917576014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11040c02d0 con 0x7f11040c7900 2024-09-21T03:15:01.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.347+0000 7f110b200640 1 -- 172.21.15.90:0/2917576014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11040c6e00 con 0x7f11040c7900 2024-09-21T03:15:01.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.349+0000 7f10fe000640 1 -- 172.21.15.90:0/2917576014 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f10f401a070 con 0x7f11040c7900 2024-09-21T03:15:01.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.350+0000 7f10fe000640 1 --2- 172.21.15.90:0/2917576014 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f10e8078bc0 0x7f10e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:01.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.350+0000 7f10fe000640 1 -- 172.21.15.90:0/2917576014 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f10f409a280 con 0x7f11040c7900 2024-09-21T03:15:01.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.350+0000 7f1109e00640 1 --2- 172.21.15.90:0/2917576014 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f10e8078bc0 0x7f10e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:01.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.351+0000 7f1109e00640 1 --2- 172.21.15.90:0/2917576014 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f10e8078bc0 0x7f10e807b0d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f10f800bb00 tx=0x7f10f8005e30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:01.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.354+0000 7f10fe000640 1 -- 172.21.15.90:0/2917576014 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f10f4062410 con 0x7f11040c7900 2024-09-21T03:15:01.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.577+0000 7f110b200640 1 -- 172.21.15.90:0/2917576014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11040cb900 con 0x7f11040c7900 2024-09-21T03:15:01.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.578+0000 7f10fe000640 1 -- 172.21.15.90:0/2917576014 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6530 (secure 0 0 0) 0x7f10f4061d10 con 0x7f11040c7900 2024-09-21T03:15:01.580 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:15:01.580 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"btime":"2024-09-21T03:14:51:570098+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3707484056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3707484056},{"type":"v1","addr":"172.21.15.90:6835","nonce":3707484056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1650707992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1650707992},{"type":"v1","addr":"172.21.15.149:6837","nonce":1650707992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:37.954868+0000","modified":"2024-09-21T03:14:41.971257+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/2166962836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2166962836},{"type":"v1","addr":"172.21.15.149:6836","nonce":2166962836}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:47.021969+0000","modified":"2024-09-21T03:14:51.055397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4395},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4395":{"gid":4395,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6833/1105275899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1105275899},{"type":"v1","addr":"172.21.15.90:6833","nonce":1105275899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4395,"qdb_cluster":[4395]},"id":2}]} 2024-09-21T03:15:01.580 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2024-09-21T03:15:01.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.580+0000 7f110b200640 1 -- 172.21.15.90:0/2917576014 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f10e8078bc0 msgr2=0x7f10e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:01.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.580+0000 7f110b200640 1 --2- 172.21.15.90:0/2917576014 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f10e8078bc0 0x7f10e807b0d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f10f800bb00 tx=0x7f10f8005e30 comp rx=0 tx=0).stop 2024-09-21T03:15:01.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.580+0000 7f110b200640 1 -- 172.21.15.90:0/2917576014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11040c7900 msgr2=0x7f11040c3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:01.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.580+0000 7f110b200640 1 --2- 172.21.15.90:0/2917576014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11040c7900 0x7f11040c3350 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f10f400c3c0 tx=0x7f10f400c880 comp rx=0 tx=0).stop 2024-09-21T03:15:01.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.580+0000 7f110b200640 1 -- 172.21.15.90:0/2917576014 shutdown_connections 2024-09-21T03:15:01.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.580+0000 7f110b200640 1 --2- 172.21.15.90:0/2917576014 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f10e8078bc0 0x7f10e807b0d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.580+0000 7f110b200640 1 --2- 172.21.15.90:0/2917576014 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11041545f0 0x7f11041e2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.580+0000 7f110b200640 1 --2- 172.21.15.90:0/2917576014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11040c7900 0x7f11040c3350 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.580+0000 7f110b200640 1 --2- 172.21.15.90:0/2917576014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f110406e380 0x7f11040c17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.580+0000 7f110b200640 1 -- 172.21.15.90:0/2917576014 >> 172.21.15.90:0/2917576014 conn(0x7f11040c8d90 msgr2=0x7f1104153830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:01.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.580+0000 7f110b200640 1 -- 172.21.15.90:0/2917576014 shutdown_connections 2024-09-21T03:15:01.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.580+0000 7f110b200640 1 -- 172.21.15.90:0/2917576014 wait complete. 2024-09-21T03:15:01.606 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:15:01.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.824+0000 7f970a400640 1 -- 172.21.15.90:0/1493224766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97040c47b0 msgr2=0x7f97040ad2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:01.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.824+0000 7f970a400640 1 --2- 172.21.15.90:0/1493224766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97040c47b0 0x7f97040ad2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f96f4009830 tx=0x7f96f402a4a0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.824+0000 7f970a400640 1 -- 172.21.15.90:0/1493224766 shutdown_connections 2024-09-21T03:15:01.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.824+0000 7f970a400640 1 --2- 172.21.15.90:0/1493224766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97040c47b0 0x7f97040ad2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.824+0000 7f970a400640 1 -- 172.21.15.90:0/1493224766 >> 172.21.15.90:0/1493224766 conn(0x7f97040c8ba0 msgr2=0x7f970406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:01.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.824+0000 7f970a400640 1 -- 172.21.15.90:0/1493224766 shutdown_connections 2024-09-21T03:15:01.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.824+0000 7f970a400640 1 -- 172.21.15.90:0/1493224766 wait complete. 2024-09-21T03:15:01.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.826+0000 7f970a400640 1 Processor -- start 2024-09-21T03:15:01.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.827+0000 7f970a400640 1 -- start start 2024-09-21T03:15:01.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.828+0000 7f970a400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97040c3d40 0x7f9704144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:01.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.828+0000 7f970a400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97040c47b0 0x7f970414ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:01.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.828+0000 7f970a400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9704157140 0x7f97041521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:01.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.828+0000 7f970a400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f970406fcb0 con 0x7f97040c47b0 2024-09-21T03:15:01.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.828+0000 7f970a400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f970406f9d0 con 0x7f97040c3d40 2024-09-21T03:15:01.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.828+0000 7f970a400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f97040c26e0 con 0x7f9704157140 2024-09-21T03:15:01.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.828+0000 7f96fbe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97040c47b0 0x7f970414ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:01.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.828+0000 7f96fbe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97040c47b0 0x7f970414ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33696/0 (socket says 172.21.15.90:33696) 2024-09-21T03:15:01.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.828+0000 7f96fbe00640 1 -- 172.21.15.90:0/192372578 learned_addr learned my addr 172.21.15.90:0/192372578 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:01.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.828+0000 7f9703400640 1 --2- 172.21.15.90:0/192372578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97040c3d40 0x7f9704144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:01.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.828+0000 7f9703e00640 1 --2- 172.21.15.90:0/192372578 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9704157140 0x7f97041521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:01.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.829+0000 7f96fbe00640 1 -- 172.21.15.90:0/192372578 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9704157140 msgr2=0x7f97041521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:01.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.829+0000 7f96fbe00640 1 --2- 172.21.15.90:0/192372578 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9704157140 0x7f97041521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.829+0000 7f96fbe00640 1 -- 172.21.15.90:0/192372578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97040c3d40 msgr2=0x7f9704144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:01.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.829+0000 7f96fbe00640 1 --2- 172.21.15.90:0/192372578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97040c3d40 0x7f9704144280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:01.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.829+0000 7f96fbe00640 1 -- 172.21.15.90:0/192372578 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97041edc50 con 0x7f97040c47b0 2024-09-21T03:15:01.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.829+0000 7f96fbe00640 1 --2- 172.21.15.90:0/192372578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97040c47b0 0x7f970414ec90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f96ec001eb0 tx=0x7f96ec00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:01.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.829+0000 7f96fb400640 1 -- 172.21.15.90:0/192372578 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ec017070 con 0x7f97040c47b0 2024-09-21T03:15:01.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.829+0000 7f96fb400640 1 -- 172.21.15.90:0/192372578 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96ec0053c0 con 0x7f97040c47b0 2024-09-21T03:15:01.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.829+0000 7f970a400640 1 -- 172.21.15.90:0/192372578 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9704153420 con 0x7f97040c47b0 2024-09-21T03:15:01.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.829+0000 7f96fb400640 1 -- 172.21.15.90:0/192372578 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ec003830 con 0x7f97040c47b0 2024-09-21T03:15:01.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.829+0000 7f970a400640 1 -- 172.21.15.90:0/192372578 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97041544c0 con 0x7f97040c47b0 2024-09-21T03:15:01.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.831+0000 7f970a400640 1 -- 172.21.15.90:0/192372578 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97040ad2f0 con 0x7f97040c47b0 2024-09-21T03:15:01.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.832+0000 7f96fb400640 1 -- 172.21.15.90:0/192372578 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f96ec01a070 con 0x7f97040c47b0 2024-09-21T03:15:01.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.833+0000 7f96fb400640 1 --2- 172.21.15.90:0/192372578 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f96e0078bc0 0x7f96e007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:01.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.833+0000 7f96fb400640 1 -- 172.21.15.90:0/192372578 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f96ec09a2c0 con 0x7f97040c47b0 2024-09-21T03:15:01.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.833+0000 7f9703400640 1 --2- 172.21.15.90:0/192372578 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f96e0078bc0 0x7f96e007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:01.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.834+0000 7f9703400640 1 --2- 172.21.15.90:0/192372578 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f96e0078bc0 0x7f96e007b0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f96f4034000 tx=0x7f96f4004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:01.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:01.837+0000 7f96fb400640 1 -- 172.21.15.90:0/192372578 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f96ec061e10 con 0x7f97040c47b0 2024-09-21T03:15:02.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.023+0000 7f970a400640 1 -- 172.21.15.90:0/192372578 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9704151e00 con 0x7f97040c47b0 2024-09-21T03:15:02.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.025+0000 7f96fb400640 1 -- 172.21.15.90:0/192372578 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20407 (secure 0 0 0) 0x7f96ec066840 con 0x7f97040c47b0 2024-09-21T03:15:02.027 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:15:02.027 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":25,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","created":"2024-09-21T03:14:09.323302+0000","modified":"2024-09-21T03:14:48.547226+0000","last_up_change":"2024-09-21T03:14:25.329650+0000","last_in_change":"2024-09-21T03:14:15.386953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:14:24.511246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-21T03:14:35.815250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-21T03:14:36.914615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-21T03:14:45.298287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-21T03:14:45.977111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ceaacfab-e71c-45e2-ac50-4597dfd460bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6809","nonce":3187794863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6811","nonce":3187794863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6815","nonce":3187794863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6813","nonce":3187794863}]},"public_addr":"172.21.15.90:6809/3187794863","cluster_addr":"172.21.15.90:6811/3187794863","heartbeat_back_addr":"172.21.15.90:6815/3187794863","heartbeat_front_addr":"172.21.15.90:6813/3187794863","state":["exists","up"]},{"osd":1,"uuid":"86f91523-232b-4e80-ada7-d9e12770adb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6801","nonce":3769758484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6803","nonce":3769758484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6807","nonce":3769758484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6805","nonce":3769758484}]},"public_addr":"172.21.15.90:6801/3769758484","cluster_addr":"172.21.15.90:6803/3769758484","heartbeat_back_addr":"172.21.15.90:6807/3769758484","heartbeat_front_addr":"172.21.15.90:6805/3769758484","state":["exists","up"]},{"osd":2,"uuid":"6eb0f47b-e767-49c0-8d72-07f71b9c2e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6825","nonce":1025535744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6827","nonce":1025535744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6831","nonce":1025535744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6829","nonce":1025535744}]},"public_addr":"172.21.15.90:6825/1025535744","cluster_addr":"172.21.15.90:6827/1025535744","heartbeat_back_addr":"172.21.15.90:6831/1025535744","heartbeat_front_addr":"172.21.15.90:6829/1025535744","state":["exists","up"]},{"osd":3,"uuid":"64418862-beef-479c-be11-dfe0e515e09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6817","nonce":1515884437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6819","nonce":1515884437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6823","nonce":1515884437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6821","nonce":1515884437}]},"public_addr":"172.21.15.90:6817/1515884437","cluster_addr":"172.21.15.90:6819/1515884437","heartbeat_back_addr":"172.21.15.90:6823/1515884437","heartbeat_front_addr":"172.21.15.90:6821/1515884437","state":["exists","up"]},{"osd":4,"uuid":"a05b63f4-ec0a-426c-9d60-285e2680a897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6816","nonce":4278726553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6820","nonce":4278726553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6825","nonce":4278726553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6823","nonce":4278726553}]},"public_addr":"172.21.15.149:6816/4278726553","cluster_addr":"172.21.15.149:6820/4278726553","heartbeat_back_addr":"172.21.15.149:6825/4278726553","heartbeat_front_addr":"172.21.15.149:6823/4278726553","state":["exists","up"]},{"osd":5,"uuid":"3a1bab89-963c-4fe7-b14f-3080c5cf7830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6827","nonce":1341677333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6829","nonce":1341677333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6833","nonce":1341677333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6831","nonce":1341677333}]},"public_addr":"172.21.15.149:6827/1341677333","cluster_addr":"172.21.15.149:6829/1341677333","heartbeat_back_addr":"172.21.15.149:6833/1341677333","heartbeat_front_addr":"172.21.15.149:6831/1341677333","state":["exists","up"]},{"osd":6,"uuid":"bfcd1596-2688-4deb-be2e-55f305a5b4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6811","nonce":821196931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6813","nonce":821196931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6821","nonce":821196931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6817","nonce":821196931}]},"public_addr":"172.21.15.149:6811/821196931","cluster_addr":"172.21.15.149:6813/821196931","heartbeat_back_addr":"172.21.15.149:6821/821196931","heartbeat_front_addr":"172.21.15.149:6817/821196931","state":["exists","up"]},{"osd":7,"uuid":"58b19790-4006-4f07-966c-911b938cc1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6803","nonce":1657326880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6805","nonce":1657326880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6809","nonce":1657326880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6807","nonce":1657326880}]},"public_addr":"172.21.15.149:6803/1657326880","cluster_addr":"172.21.15.149:6805/1657326880","heartbeat_back_addr":"172.21.15.149:6809/1657326880","heartbeat_front_addr":"172.21.15.149:6807/1657326880","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.399701+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.051745+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.190159+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:23.240143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.446570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.259974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:21.990407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.459259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:15:02.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.027+0000 7f970a400640 1 -- 172.21.15.90:0/192372578 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f96e0078bc0 msgr2=0x7f96e007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:02.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.027+0000 7f970a400640 1 --2- 172.21.15.90:0/192372578 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f96e0078bc0 0x7f96e007b0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f96f4034000 tx=0x7f96f4004730 comp rx=0 tx=0).stop 2024-09-21T03:15:02.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.027+0000 7f970a400640 1 -- 172.21.15.90:0/192372578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97040c47b0 msgr2=0x7f970414ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:02.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.027+0000 7f970a400640 1 --2- 172.21.15.90:0/192372578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97040c47b0 0x7f970414ec90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f96ec001eb0 tx=0x7f96ec00c890 comp rx=0 tx=0).stop 2024-09-21T03:15:02.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.027+0000 7f970a400640 1 -- 172.21.15.90:0/192372578 shutdown_connections 2024-09-21T03:15:02.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.027+0000 7f970a400640 1 --2- 172.21.15.90:0/192372578 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f96e0078bc0 0x7f96e007b0d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:02.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.027+0000 7f970a400640 1 --2- 172.21.15.90:0/192372578 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9704157140 0x7f97041521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:02.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.027+0000 7f970a400640 1 --2- 172.21.15.90:0/192372578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97040c47b0 0x7f970414ec90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:02.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.027+0000 7f970a400640 1 --2- 172.21.15.90:0/192372578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97040c3d40 0x7f9704144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:02.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.027+0000 7f970a400640 1 -- 172.21.15.90:0/192372578 >> 172.21.15.90:0/192372578 conn(0x7f97040c8ba0 msgr2=0x7f9704156370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:02.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.027+0000 7f970a400640 1 -- 172.21.15.90:0/192372578 shutdown_connections 2024-09-21T03:15:02.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.027+0000 7f970a400640 1 -- 172.21.15.90:0/192372578 wait complete. 2024-09-21T03:15:02.054 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:15:02.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.272+0000 7f9933200640 1 -- 172.21.15.90:0/428763034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f992c0ab1c0 msgr2=0x7f992c158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:02.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.272+0000 7f9933200640 1 --2- 172.21.15.90:0/428763034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f992c0ab1c0 0x7f992c158860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9920009860 tx=0x7f992002a530 comp rx=0 tx=0).stop 2024-09-21T03:15:02.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.272+0000 7f9933200640 1 -- 172.21.15.90:0/428763034 shutdown_connections 2024-09-21T03:15:02.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.272+0000 7f9933200640 1 --2- 172.21.15.90:0/428763034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f992c0ab1c0 0x7f992c158860 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:02.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.272+0000 7f9933200640 1 -- 172.21.15.90:0/428763034 >> 172.21.15.90:0/428763034 conn(0x7f992c0c84c0 msgr2=0x7f992c0c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:02.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.272+0000 7f9933200640 1 -- 172.21.15.90:0/428763034 shutdown_connections 2024-09-21T03:15:02.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.272+0000 7f9933200640 1 -- 172.21.15.90:0/428763034 wait complete. 2024-09-21T03:15:02.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.274+0000 7f9933200640 1 Processor -- start 2024-09-21T03:15:02.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.274+0000 7f9933200640 1 -- start start 2024-09-21T03:15:02.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.276+0000 7f9933200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f992c073ea0 0x7f992c0c16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:02.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.276+0000 7f9933200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f992c0ab1c0 0x7f992c14f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:02.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.276+0000 7f9933200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f992c1550e0 0x7f992c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:02.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.276+0000 7f9933200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f992c074da0 con 0x7f992c1550e0 2024-09-21T03:15:02.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.276+0000 7f9933200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f992c154890 con 0x7f992c0ab1c0 2024-09-21T03:15:02.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.276+0000 7f9933200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f992c074f20 con 0x7f992c073ea0 2024-09-21T03:15:02.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.276+0000 7f9932800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f992c1550e0 0x7f992c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:02.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.276+0000 7f9932800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f992c1550e0 0x7f992c06ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33702/0 (socket says 172.21.15.90:33702) 2024-09-21T03:15:02.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.276+0000 7f9932800640 1 -- 172.21.15.90:0/1720064853 learned_addr learned my addr 172.21.15.90:0/1720064853 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:02.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.276+0000 7f9931400640 1 --2- 172.21.15.90:0/1720064853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f992c0ab1c0 0x7f992c14f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:02.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.276+0000 7f9931e00640 1 --2- 172.21.15.90:0/1720064853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f992c073ea0 0x7f992c0c16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:02.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.277+0000 7f9932800640 1 -- 172.21.15.90:0/1720064853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f992c073ea0 msgr2=0x7f992c0c16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:02.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.277+0000 7f9932800640 1 --2- 172.21.15.90:0/1720064853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f992c073ea0 0x7f992c0c16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:02.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.277+0000 7f9932800640 1 -- 172.21.15.90:0/1720064853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f992c0ab1c0 msgr2=0x7f992c14f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:02.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.277+0000 7f9932800640 1 --2- 172.21.15.90:0/1720064853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f992c0ab1c0 0x7f992c14f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:02.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.277+0000 7f9932800640 1 -- 172.21.15.90:0/1720064853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992c1ed4f0 con 0x7f992c1550e0 2024-09-21T03:15:02.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.277+0000 7f9932800640 1 --2- 172.21.15.90:0/1720064853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f992c1550e0 0x7f992c06ea40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f992800c7a0 tx=0x7f992800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:02.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.277+0000 7f9926000640 1 -- 172.21.15.90:0/1720064853 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9928017070 con 0x7f992c1550e0 2024-09-21T03:15:02.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.277+0000 7f9926000640 1 -- 172.21.15.90:0/1720064853 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9928005070 con 0x7f992c1550e0 2024-09-21T03:15:02.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.277+0000 7f9933200640 1 -- 172.21.15.90:0/1720064853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f992c1ed7d0 con 0x7f992c1550e0 2024-09-21T03:15:02.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.277+0000 7f9926000640 1 -- 172.21.15.90:0/1720064853 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99280054c0 con 0x7f992c1550e0 2024-09-21T03:15:02.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.277+0000 7f9933200640 1 -- 172.21.15.90:0/1720064853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f992c1edd90 con 0x7f992c1550e0 2024-09-21T03:15:02.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.278+0000 7f9933200640 1 -- 172.21.15.90:0/1720064853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f992c073a10 con 0x7f992c1550e0 2024-09-21T03:15:02.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.280+0000 7f9926000640 1 -- 172.21.15.90:0/1720064853 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f992801a070 con 0x7f992c1550e0 2024-09-21T03:15:02.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.280+0000 7f9926000640 1 --2- 172.21.15.90:0/1720064853 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9910078bc0 0x7f991007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:02.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.281+0000 7f9926000640 1 -- 172.21.15.90:0/1720064853 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f992809a660 con 0x7f992c1550e0 2024-09-21T03:15:02.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.281+0000 7f9931e00640 1 --2- 172.21.15.90:0/1720064853 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9910078bc0 0x7f991007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:02.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.282+0000 7f9931e00640 1 --2- 172.21.15.90:0/1720064853 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9910078bc0 0x7f991007b0d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9920034000 tx=0x7f9920004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:02.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.285+0000 7f9926000640 1 -- 172.21.15.90:0/1720064853 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f992c073a10 con 0x7f992c1550e0 2024-09-21T03:15:02.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.511+0000 7f9933200640 1 -- 172.21.15.90:0/1720064853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f992c06d9b0 con 0x7f992c1550e0 2024-09-21T03:15:02.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.512+0000 7f9926000640 1 -- 172.21.15.90:0/1720064853 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6530 (secure 0 0 0) 0x7f99280627f0 con 0x7f992c1550e0 2024-09-21T03:15:02.513 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:15:02.514 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"btime":"2024-09-21T03:14:51:570098+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3707484056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3707484056},{"type":"v1","addr":"172.21.15.90:6835","nonce":3707484056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1650707992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1650707992},{"type":"v1","addr":"172.21.15.149:6837","nonce":1650707992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:37.954868+0000","modified":"2024-09-21T03:14:41.971257+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/2166962836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2166962836},{"type":"v1","addr":"172.21.15.149:6836","nonce":2166962836}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:47.021969+0000","modified":"2024-09-21T03:14:51.055397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4395},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4395":{"gid":4395,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6833/1105275899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1105275899},{"type":"v1","addr":"172.21.15.90:6833","nonce":1105275899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4395,"qdb_cluster":[4395]},"id":2}]} 2024-09-21T03:15:02.514 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2024-09-21T03:15:02.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.514+0000 7f9933200640 1 -- 172.21.15.90:0/1720064853 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9910078bc0 msgr2=0x7f991007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:02.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.514+0000 7f9933200640 1 --2- 172.21.15.90:0/1720064853 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9910078bc0 0x7f991007b0d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9920034000 tx=0x7f9920004730 comp rx=0 tx=0).stop 2024-09-21T03:15:02.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.514+0000 7f9933200640 1 -- 172.21.15.90:0/1720064853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f992c1550e0 msgr2=0x7f992c06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:02.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.514+0000 7f9933200640 1 --2- 172.21.15.90:0/1720064853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f992c1550e0 0x7f992c06ea40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f992800c7a0 tx=0x7f992800cc60 comp rx=0 tx=0).stop 2024-09-21T03:15:02.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.514+0000 7f9933200640 1 -- 172.21.15.90:0/1720064853 shutdown_connections 2024-09-21T03:15:02.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.514+0000 7f9933200640 1 --2- 172.21.15.90:0/1720064853 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9910078bc0 0x7f991007b0d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:02.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.514+0000 7f9933200640 1 --2- 172.21.15.90:0/1720064853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f992c1550e0 0x7f992c06ea40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:02.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.514+0000 7f9933200640 1 --2- 172.21.15.90:0/1720064853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f992c0ab1c0 0x7f992c14f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:02.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.514+0000 7f9933200640 1 --2- 172.21.15.90:0/1720064853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f992c073ea0 0x7f992c0c16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:02.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.514+0000 7f9933200640 1 -- 172.21.15.90:0/1720064853 >> 172.21.15.90:0/1720064853 conn(0x7f992c0c84c0 msgr2=0x7f992c0c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:02.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.514+0000 7f9933200640 1 -- 172.21.15.90:0/1720064853 shutdown_connections 2024-09-21T03:15:02.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:02.514+0000 7f9933200640 1 -- 172.21.15.90:0/1720064853 wait complete. 2024-09-21T03:15:02.942 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T03:14:47.021969+0000', 'modified': '2024-09-21T03:14:51.055397+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4395}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4395': {'gid': 4395, 'name': 'a', 'rank': 0, 'incarnation': 9, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.90:6833/1105275899', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6832', 'nonce': 1105275899}, {'type': 'v1', 'addr': '172.21.15.90:6833', 'nonce': 1105275899}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'b', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4395, 'qdb_cluster': [4395]} 2024-09-21T03:15:02.942 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T03:15:02.942 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T03:15:03.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.162+0000 7f9370a00640 1 -- 172.21.15.90:0/4128715601 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936c0ae0a0 msgr2=0x7f936c1521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:03.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.162+0000 7f9370a00640 1 --2- 172.21.15.90:0/4128715601 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936c0ae0a0 0x7f936c1521b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f936c0754f0 tx=0x7f935c02a4b0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.162+0000 7f9370a00640 1 -- 172.21.15.90:0/4128715601 shutdown_connections 2024-09-21T03:15:03.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.162+0000 7f9370a00640 1 --2- 172.21.15.90:0/4128715601 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f936c154aa0 0x7f936c154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.162+0000 7f9370a00640 1 --2- 172.21.15.90:0/4128715601 >> v2:172.21.15.149:3300/0 conn(0x7f936c073080 0x7f936c073490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.162+0000 7f9370a00640 1 --2- 172.21.15.90:0/4128715601 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936c0ae0a0 0x7f936c1521b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.162+0000 7f9370a00640 1 -- 172.21.15.90:0/4128715601 >> 172.21.15.90:0/4128715601 conn(0x7f936c0c85a0 msgr2=0x7f936c0c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:03.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.162+0000 7f9370a00640 1 -- 172.21.15.90:0/4128715601 shutdown_connections 2024-09-21T03:15:03.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.162+0000 7f9370a00640 1 -- 172.21.15.90:0/4128715601 wait complete. 2024-09-21T03:15:03.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.164+0000 7f9370a00640 1 Processor -- start 2024-09-21T03:15:03.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.164+0000 7f9370a00640 1 -- start start 2024-09-21T03:15:03.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.165+0000 7f9370a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936c073080 0x7f936c1f0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.165+0000 7f9370a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f936c0ae0a0 0x7f936c1deb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.165+0000 7f9370a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f936c154aa0 0x7f936c14ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.165+0000 7f9370a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f936c0abd90 con 0x7f936c073080 2024-09-21T03:15:03.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.165+0000 7f9370a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f936c0acf00 con 0x7f936c154aa0 2024-09-21T03:15:03.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.165+0000 7f9370a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f936c0abf10 con 0x7f936c0ae0a0 2024-09-21T03:15:03.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.166+0000 7f9369e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936c073080 0x7f936c1f0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.166+0000 7f9369e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936c073080 0x7f936c1f0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33726/0 (socket says 172.21.15.90:33726) 2024-09-21T03:15:03.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.166+0000 7f9369e00640 1 -- 172.21.15.90:0/4176542856 learned_addr learned my addr 172.21.15.90:0/4176542856 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:03.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.166+0000 7f9363e00640 1 --2- 172.21.15.90:0/4176542856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f936c0ae0a0 0x7f936c1deb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.166+0000 7f936a800640 1 --2- 172.21.15.90:0/4176542856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f936c154aa0 0x7f936c14ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.166+0000 7f9369e00640 1 -- 172.21.15.90:0/4176542856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f936c0ae0a0 msgr2=0x7f936c1deb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:03.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.166+0000 7f9369e00640 1 --2- 172.21.15.90:0/4176542856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f936c0ae0a0 0x7f936c1deb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.166+0000 7f9369e00640 1 -- 172.21.15.90:0/4176542856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f936c154aa0 msgr2=0x7f936c14ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:03.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.166+0000 7f9369e00640 1 --2- 172.21.15.90:0/4176542856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f936c154aa0 0x7f936c14ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.166+0000 7f9369e00640 1 -- 172.21.15.90:0/4176542856 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f936c1586e0 con 0x7f936c073080 2024-09-21T03:15:03.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.167+0000 7f9369e00640 1 --2- 172.21.15.90:0/4176542856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936c073080 0x7f936c1f0b60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f935c0099d0 tx=0x7f935c0052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:03.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.167+0000 7f9362000640 1 -- 172.21.15.90:0/4176542856 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935c031b50 con 0x7f936c073080 2024-09-21T03:15:03.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.167+0000 7f9362000640 1 -- 172.21.15.90:0/4176542856 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f935c031de0 con 0x7f936c073080 2024-09-21T03:15:03.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.167+0000 7f9370a00640 1 -- 172.21.15.90:0/4176542856 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f936c1589c0 con 0x7f936c073080 2024-09-21T03:15:03.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.167+0000 7f9362000640 1 -- 172.21.15.90:0/4176542856 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935c033330 con 0x7f936c073080 2024-09-21T03:15:03.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.167+0000 7f9370a00640 1 -- 172.21.15.90:0/4176542856 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f936c1f10a0 con 0x7f936c073080 2024-09-21T03:15:03.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.169+0000 7f9362000640 1 -- 172.21.15.90:0/4176542856 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f935c0334d0 con 0x7f936c073080 2024-09-21T03:15:03.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.170+0000 7f9362000640 1 --2- 172.21.15.90:0/4176542856 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9348078b90 0x7f934807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.170+0000 7f9362000640 1 -- 172.21.15.90:0/4176542856 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f935c0bc310 con 0x7f936c073080 2024-09-21T03:15:03.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.171+0000 7f93779f7740 1 Processor -- start 2024-09-21T03:15:03.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.171+0000 7f9363e00640 1 --2- 172.21.15.90:0/4176542856 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9348078b90 0x7f934807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.171+0000 7f93779f7740 1 -- start start 2024-09-21T03:15:03.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.171+0000 7f9363e00640 1 --2- 172.21.15.90:0/4176542856 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9348078b90 0x7f934807b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f936c1de2d0 tx=0x7f9354009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:03.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.172+0000 7f93779f7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205e1270 0x55cf20984f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.172+0000 7f93779f7740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205b83b0 0x55cf209a8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.172+0000 7f93779f7740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55cf205c0590 0x55cf209cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.172+0000 7f93779f7740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55cf2090b430 con 0x55cf205b83b0 2024-09-21T03:15:03.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.172+0000 7f93779f7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55cf208fb5d0 con 0x55cf205e1270 2024-09-21T03:15:03.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.172+0000 7f93779f7740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55cf208eaa00 con 0x55cf205c0590 2024-09-21T03:15:03.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.172+0000 7f9363e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205b83b0 0x55cf209a8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.172+0000 7f9363e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205b83b0 0x55cf209a8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33734/0 (socket says 172.21.15.90:33734) 2024-09-21T03:15:03.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.172+0000 7f9363e00640 1 -- 172.21.15.90:0/2115055348 learned_addr learned my addr 172.21.15.90:0/2115055348 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:03.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.172+0000 7f9369e00640 1 --2- 172.21.15.90:0/2115055348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205e1270 0x55cf20984f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.173+0000 7f936a800640 1 --2- 172.21.15.90:0/2115055348 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55cf205c0590 0x55cf209cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.173+0000 7f9363e00640 1 -- 172.21.15.90:0/2115055348 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55cf205c0590 msgr2=0x55cf209cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:15:03.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.173+0000 7f9363e00640 1 --2- 172.21.15.90:0/2115055348 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55cf205c0590 0x55cf209cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.173+0000 7f9363e00640 1 -- 172.21.15.90:0/2115055348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205e1270 msgr2=0x55cf20984f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:15:03.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.173+0000 7f9363e00640 1 --2- 172.21.15.90:0/2115055348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205e1270 0x55cf20984f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.173+0000 7f9363e00640 1 -- 172.21.15.90:0/2115055348 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf208b3520 con 0x55cf205b83b0 2024-09-21T03:15:03.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.173+0000 7f9363e00640 1 --2- 172.21.15.90:0/2115055348 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205b83b0 0x55cf209a8560 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f935400eb70 tx=0x7f9354011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a86c0b27f905e24 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:03.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.173+0000 7f935a600640 1 -- 172.21.15.90:0/2115055348 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935401b040 con 0x55cf205b83b0 2024-09-21T03:15:03.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.173+0000 7f935a600640 1 -- 172.21.15.90:0/2115055348 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9354024070 con 0x55cf205b83b0 2024-09-21T03:15:03.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.173+0000 7f935a600640 1 -- 172.21.15.90:0/2115055348 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9354015d50 con 0x55cf205b83b0 2024-09-21T03:15:03.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.174+0000 7f93779f7740 1 -- 172.21.15.90:0/2115055348 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205b83b0 msgr2=0x55cf209a8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:03.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.174+0000 7f93779f7740 1 --2- 172.21.15.90:0/2115055348 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205b83b0 0x55cf209a8560 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f935400eb70 tx=0x7f9354011000 comp rx=0 tx=0).stop 2024-09-21T03:15:03.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.174+0000 7f93779f7740 1 -- 172.21.15.90:0/2115055348 shutdown_connections 2024-09-21T03:15:03.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.174+0000 7f93779f7740 1 --2- 172.21.15.90:0/2115055348 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55cf205c0590 0x55cf209cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.174+0000 7f93779f7740 1 --2- 172.21.15.90:0/2115055348 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205b83b0 0x55cf209a8560 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.174+0000 7f93779f7740 1 --2- 172.21.15.90:0/2115055348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205e1270 0x55cf20984f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.174+0000 7f93779f7740 1 -- 172.21.15.90:0/2115055348 >> 172.21.15.90:0/2115055348 conn(0x55cf205d53c0 msgr2=0x55cf209c68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:03.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.174+0000 7f93779f7740 1 -- 172.21.15.90:0/2115055348 shutdown_connections 2024-09-21T03:15:03.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.174+0000 7f93779f7740 1 -- 172.21.15.90:0/2115055348 wait complete. 2024-09-21T03:15:03.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.175+0000 7f93779f7740 1 -- start start 2024-09-21T03:15:03.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.175+0000 7f93779f7740 1 Processor -- start 2024-09-21T03:15:03.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.177+0000 7f93779f7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205b83b0 0x55cf209bf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.177+0000 7f93779f7740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55cf205c0590 0x55cf209c0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.177+0000 7f93779f7740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205e1270 0x55cf209825c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.177+0000 7f93779f7740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55cf20891330 con 0x55cf205e1270 2024-09-21T03:15:03.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.177+0000 7f93779f7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55cf208ee810 con 0x55cf205b83b0 2024-09-21T03:15:03.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.177+0000 7f93779f7740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55cf2065b620 con 0x55cf205c0590 2024-09-21T03:15:03.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.177+0000 7f93779f7740 10 client.0 _ll_register_callbacks cb 0x55cf20896420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:15:03.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.177+0000 7f936a800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205e1270 0x55cf209825c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.177+0000 7f936a800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205e1270 0x55cf209825c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33746/0 (socket says 172.21.15.90:33746) 2024-09-21T03:15:03.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.177+0000 7f936a800640 1 -- 172.21.15.90:0/851758314 learned_addr learned my addr 172.21.15.90:0/851758314 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:03.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.177+0000 7f9369e00640 1 --2- 172.21.15.90:0/851758314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205b83b0 0x55cf209bf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.177+0000 7f9363e00640 1 --2- 172.21.15.90:0/851758314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55cf205c0590 0x55cf209c0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.177+0000 7f936a800640 1 -- 172.21.15.90:0/851758314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55cf205c0590 msgr2=0x55cf209c0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:15:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.177+0000 7f936a800640 1 --2- 172.21.15.90:0/851758314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55cf205c0590 0x55cf209c0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.177+0000 7f936a800640 1 -- 172.21.15.90:0/851758314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205b83b0 msgr2=0x55cf209bf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:15:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.177+0000 7f936a800640 1 --2- 172.21.15.90:0/851758314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205b83b0 0x55cf209bf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.177+0000 7f936a800640 1 -- 172.21.15.90:0/851758314 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf2064c850 con 0x55cf205e1270 2024-09-21T03:15:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.177+0000 7f9369e00640 1 --2- 172.21.15.90:0/851758314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205b83b0 0x55cf209bf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:15:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.178+0000 7f936a800640 1 --2- 172.21.15.90:0/851758314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205e1270 0x55cf209825c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f936400ab30 tx=0x7f9364009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3b39654380a61f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.178+0000 7f934ea00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T03:15:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.178+0000 7f934ea00640 1 -- 172.21.15.90:0/851758314 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936401a070 con 0x55cf205e1270 2024-09-21T03:15:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.178+0000 7f934ea00640 1 -- 172.21.15.90:0/851758314 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f9364011d80 con 0x55cf205e1270 2024-09-21T03:15:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.178+0000 7f93779f7740 1 -- 172.21.15.90:0/851758314 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9354024070 con 0x55cf205e1270 2024-09-21T03:15:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.178+0000 7f934ea00640 1 -- 172.21.15.90:0/851758314 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f9364025050 con 0x55cf205e1270 2024-09-21T03:15:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.178+0000 7f93779f7740 10 client.4782 fetch_fsmap learned FSMap version 14 2024-09-21T03:15:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.178+0000 7f93779f7740 1 -- 172.21.15.90:0/851758314 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55cf206c36b0 con 0x55cf205e1270 2024-09-21T03:15:03.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.178+0000 7f934ea00640 1 -- 172.21.15.90:0/851758314 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9354024070 con 0x55cf205e1270 2024-09-21T03:15:03.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.179+0000 7f934ea00640 1 -- 172.21.15.90:0/851758314 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) ==== 4136+0+0 (secure 0 0 0) 0x7f9364028020 con 0x55cf205e1270 2024-09-21T03:15:03.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.179+0000 7f93779f7740 10 client.4782 fetch_fsmap finished waiting for FSMap version 14 2024-09-21T03:15:03.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.179+0000 7f93779f7740 10 client.4782 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T03:15:03.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.179+0000 7f93779f7740 20 client.4782 populate_metadata read hostname 'smithi090' 2024-09-21T03:15:03.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.179+0000 7f93779f7740 1 --2- 172.21.15.90:0/851758314 >> [v2:172.21.15.90:6832/1105275899,v1:172.21.15.90:6833/1105275899] conn(0x55cf2059fe40 0x55cf209c2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.179+0000 7f93779f7740 4 client.4782 mds_command: new command op to 4395 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:15:03.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.179+0000 7f93779f7740 1 -- 172.21.15.90:0/851758314 --> [v2:172.21.15.90:6832/1105275899,v1:172.21.15.90:6833/1105275899] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf208fd520 con 0x55cf2059fe40 2024-09-21T03:15:03.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.179+0000 7f9369e00640 1 --2- 172.21.15.90:0/851758314 >> [v2:172.21.15.90:6832/1105275899,v1:172.21.15.90:6833/1105275899] conn(0x55cf2059fe40 0x55cf209c2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.179+0000 7f9369e00640 1 -- 172.21.15.90:0/851758314 >> [v2:172.21.15.90:6832/1105275899,v1:172.21.15.90:6833/1105275899] conn(0x55cf2059fe40 msgr2=0x55cf209c2400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-09-21T03:15:03.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.179+0000 7f9369e00640 1 -- 172.21.15.90:0/851758314 >> [v2:172.21.15.90:6832/1105275899,v1:172.21.15.90:6833/1105275899] conn(0x55cf2059fe40 msgr2=0x55cf209c2400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-21T03:15:03.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.179+0000 7f9369e00640 1 --2- 172.21.15.90:0/851758314 >> [v2:172.21.15.90:6832/1105275899,v1:172.21.15.90:6833/1105275899] conn(0x55cf2059fe40 0x55cf209c2400 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T03:15:03.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.179+0000 7f9369e00640 1 --2- 172.21.15.90:0/851758314 >> [v2:172.21.15.90:6832/1105275899,v1:172.21.15.90:6833/1105275899] conn(0x55cf2059fe40 0x55cf209c2400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:15:03.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.381+0000 7f9369e00640 1 --2- 172.21.15.90:0/851758314 >> [v2:172.21.15.90:6832/1105275899,v1:172.21.15.90:6833/1105275899] conn(0x55cf2059fe40 0x55cf209c2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.381+0000 7f9369e00640 1 --2- 172.21.15.90:0/851758314 >> [v2:172.21.15.90:6832/1105275899,v1:172.21.15.90:6833/1105275899] conn(0x55cf2059fe40 0x55cf209c2400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84e25c1c3e9347f1 server_cookie=76bed7b4fb8dbb5e in_seq=0 out_seq=0 2024-09-21T03:15:03.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.381+0000 7f934ea00640 10 client.4782 ms_handle_connect on v2:172.21.15.90:6832/1105275899 2024-09-21T03:15:03.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.382+0000 7f934ea00640 1 -- 172.21.15.90:0/851758314 <== mds.0 v2:172.21.15.90:6832/1105275899 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cf208fd520 con 0x55cf2059fe40 2024-09-21T03:15:03.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.382+0000 7f934ea00640 10 client.4782 handle_command_reply: tid=0 2024-09-21T03:15:03.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.382+0000 7f93779f7740 1 client.4782 shutdown 2024-09-21T03:15:03.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.383+0000 7f93779f7740 1 -- 172.21.15.90:0/851758314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205e1270 msgr2=0x55cf209825c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:03.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.383+0000 7f93779f7740 1 --2- 172.21.15.90:0/851758314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205e1270 0x55cf209825c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f936400ab30 tx=0x7f9364009f80 comp rx=0 tx=0).stop 2024-09-21T03:15:03.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.383+0000 7f93779f7740 1 -- 172.21.15.90:0/851758314 shutdown_connections 2024-09-21T03:15:03.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.383+0000 7f93779f7740 1 --2- 172.21.15.90:0/851758314 >> [v2:172.21.15.90:6832/1105275899,v1:172.21.15.90:6833/1105275899] conn(0x55cf2059fe40 0x55cf209c2400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.383+0000 7f93779f7740 1 --2- 172.21.15.90:0/851758314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205e1270 0x55cf209825c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.383+0000 7f93779f7740 1 --2- 172.21.15.90:0/851758314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55cf205c0590 0x55cf209c0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.383+0000 7f93779f7740 1 --2- 172.21.15.90:0/851758314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205b83b0 0x55cf209bf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.383+0000 7f934ea00640 0 client.4782 ms_handle_reset on v2:172.21.15.90:6832/1105275899 2024-09-21T03:15:03.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.383+0000 7f93779f7740 1 -- 172.21.15.90:0/851758314 >> 172.21.15.90:0/851758314 conn(0x55cf205d53c0 msgr2=0x55cf209c3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:03.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.383+0000 7f93779f7740 1 -- 172.21.15.90:0/851758314 shutdown_connections 2024-09-21T03:15:03.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.383+0000 7f93779f7740 1 -- 172.21.15.90:0/851758314 wait complete. 2024-09-21T03:15:03.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.383+0000 7f93779f7740 20 client.4782 trim_cache size 0 max 16384 2024-09-21T03:15:03.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.402+0000 7f93779f7740 1 Processor -- start 2024-09-21T03:15:03.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.402+0000 7f93779f7740 1 -- start start 2024-09-21T03:15:03.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.403+0000 7f93779f7740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55cf205b83b0 0x55cf209d6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.403+0000 7f93779f7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205c0590 0x55cf20981c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.403+0000 7f93779f7740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205e1270 0x55cf209821b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.403+0000 7f93779f7740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f936c1fd000 con 0x55cf205e1270 2024-09-21T03:15:03.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.403+0000 7f93779f7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f936c1faa90 con 0x55cf205c0590 2024-09-21T03:15:03.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.403+0000 7f93779f7740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f936c1fb0b0 con 0x55cf205b83b0 2024-09-21T03:15:03.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.404+0000 7f936a800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205e1270 0x55cf209821b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.404+0000 7f936a800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205e1270 0x55cf209821b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33760/0 (socket says 172.21.15.90:33760) 2024-09-21T03:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.404+0000 7f936a800640 1 -- 172.21.15.90:0/1082850741 learned_addr learned my addr 172.21.15.90:0/1082850741 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.404+0000 7f9363e00640 1 --2- 172.21.15.90:0/1082850741 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205c0590 0x55cf20981c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.404+0000 7f9369e00640 1 --2- 172.21.15.90:0/1082850741 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55cf205b83b0 0x55cf209d6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.404+0000 7f936a800640 1 -- 172.21.15.90:0/1082850741 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55cf205b83b0 msgr2=0x55cf209d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.404+0000 7f936a800640 1 --2- 172.21.15.90:0/1082850741 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55cf205b83b0 0x55cf209d6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.404+0000 7f936a800640 1 -- 172.21.15.90:0/1082850741 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205c0590 msgr2=0x55cf20981c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.404+0000 7f936a800640 1 --2- 172.21.15.90:0/1082850741 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205c0590 0x55cf20981c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.404+0000 7f936a800640 1 -- 172.21.15.90:0/1082850741 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf209d71a0 con 0x55cf205e1270 2024-09-21T03:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.404+0000 7f9363e00640 1 --2- 172.21.15.90:0/1082850741 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205c0590 0x55cf20981c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.404+0000 7f936a800640 1 --2- 172.21.15.90:0/1082850741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205e1270 0x55cf209821b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f936400a510 tx=0x7f936400a8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ece7cc9919f90a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.404+0000 7f9359c00640 1 -- 172.21.15.90:0/1082850741 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936401a040 con 0x55cf205e1270 2024-09-21T03:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.404+0000 7f9359c00640 1 -- 172.21.15.90:0/1082850741 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9364016a30 con 0x55cf205e1270 2024-09-21T03:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.404+0000 7f9359c00640 1 -- 172.21.15.90:0/1082850741 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936401f440 con 0x55cf205e1270 2024-09-21T03:15:03.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.405+0000 7f93779f7740 1 -- 172.21.15.90:0/1082850741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205e1270 msgr2=0x55cf209821b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:03.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.405+0000 7f93779f7740 1 --2- 172.21.15.90:0/1082850741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205e1270 0x55cf209821b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f936400a510 tx=0x7f936400a8b0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.405+0000 7f93779f7740 1 -- 172.21.15.90:0/1082850741 shutdown_connections 2024-09-21T03:15:03.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.405+0000 7f93779f7740 1 --2- 172.21.15.90:0/1082850741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205e1270 0x55cf209821b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.405+0000 7f93779f7740 1 --2- 172.21.15.90:0/1082850741 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205c0590 0x55cf20981c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.405+0000 7f93779f7740 1 --2- 172.21.15.90:0/1082850741 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55cf205b83b0 0x55cf209d6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.405+0000 7f93779f7740 1 -- 172.21.15.90:0/1082850741 >> 172.21.15.90:0/1082850741 conn(0x55cf205d53c0 msgr2=0x55cf209d3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:03.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.405+0000 7f93779f7740 1 -- 172.21.15.90:0/1082850741 shutdown_connections 2024-09-21T03:15:03.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.405+0000 7f93779f7740 1 -- 172.21.15.90:0/1082850741 wait complete. 2024-09-21T03:15:03.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.406+0000 7f93779f7740 1 -- start start 2024-09-21T03:15:03.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.406+0000 7f93779f7740 1 Processor -- start 2024-09-21T03:15:03.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.408+0000 7f93779f7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205b83b0 0x55cf20a43750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.408+0000 7f93779f7740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205c0590 0x55cf209bc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.408+0000 7f93779f7740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55cf205e1270 0x55cf20a40a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.408+0000 7f93779f7740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55cf20982b00 con 0x55cf205c0590 2024-09-21T03:15:03.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.408+0000 7f93779f7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55cf209c06c0 con 0x55cf205b83b0 2024-09-21T03:15:03.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.408+0000 7f93779f7740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55cf209c1e70 con 0x55cf205e1270 2024-09-21T03:15:03.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.408+0000 7f93779f7740 10 client.0 _ll_register_callbacks cb 0x7f9364009ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:15:03.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.408+0000 7f9363e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205c0590 0x55cf209bc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.408+0000 7f9363e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205c0590 0x55cf209bc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33772/0 (socket says 172.21.15.90:33772) 2024-09-21T03:15:03.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.408+0000 7f9363e00640 1 -- 172.21.15.90:0/615963080 learned_addr learned my addr 172.21.15.90:0/615963080 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:03.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.408+0000 7f9369e00640 1 --2- 172.21.15.90:0/615963080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205b83b0 0x55cf20a43750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.408+0000 7f936a800640 1 --2- 172.21.15.90:0/615963080 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55cf205e1270 0x55cf20a40a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.408+0000 7f9363e00640 1 -- 172.21.15.90:0/615963080 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55cf205e1270 msgr2=0x55cf20a40a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:15:03.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.408+0000 7f9363e00640 1 --2- 172.21.15.90:0/615963080 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55cf205e1270 0x55cf20a40a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.408+0000 7f9363e00640 1 -- 172.21.15.90:0/615963080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205b83b0 msgr2=0x55cf20a43750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:15:03.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.408+0000 7f9363e00640 1 --2- 172.21.15.90:0/615963080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205b83b0 0x55cf20a43750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.408+0000 7f9363e00640 1 -- 172.21.15.90:0/615963080 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf20984300 con 0x55cf205c0590 2024-09-21T03:15:03.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.409+0000 7f9363e00640 1 --2- 172.21.15.90:0/615963080 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205c0590 0x55cf209bc550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f935400eb40 tx=0x7f9354015ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbecb9d8158aa21a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:03.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.409+0000 7f934ea00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T03:15:03.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.409+0000 7f934ea00640 1 -- 172.21.15.90:0/615963080 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9354032670 con 0x55cf205c0590 2024-09-21T03:15:03.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.409+0000 7f934ea00640 1 -- 172.21.15.90:0/615963080 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f9354032810 con 0x55cf205c0590 2024-09-21T03:15:03.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.409+0000 7f93779f7740 1 -- 172.21.15.90:0/615963080 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9364016a30 con 0x55cf205c0590 2024-09-21T03:15:03.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.409+0000 7f934ea00640 1 -- 172.21.15.90:0/615963080 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f935403a050 con 0x55cf205c0590 2024-09-21T03:15:03.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.409+0000 7f93779f7740 10 client.4788 fetch_fsmap learned FSMap version 14 2024-09-21T03:15:03.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.409+0000 7f93779f7740 1 -- 172.21.15.90:0/615963080 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55cf209856a0 con 0x55cf205c0590 2024-09-21T03:15:03.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.409+0000 7f934ea00640 1 -- 172.21.15.90:0/615963080 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9364016a30 con 0x55cf205c0590 2024-09-21T03:15:03.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.410+0000 7f934ea00640 1 -- 172.21.15.90:0/615963080 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) ==== 4136+0+0 (secure 0 0 0) 0x7f935403d020 con 0x55cf205c0590 2024-09-21T03:15:03.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.410+0000 7f93779f7740 10 client.4788 fetch_fsmap finished waiting for FSMap version 14 2024-09-21T03:15:03.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.410+0000 7f93779f7740 10 client.4788 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T03:15:03.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.410+0000 7f93779f7740 20 client.4788 populate_metadata read hostname 'smithi090' 2024-09-21T03:15:03.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.410+0000 7f93779f7740 1 --2- 172.21.15.90:0/615963080 >> [v2:172.21.15.90:6832/1105275899,v1:172.21.15.90:6833/1105275899] conn(0x55cf20a41180 0x55cf209e58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.410+0000 7f93779f7740 4 client.4788 mds_command: new command op to 4395 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:15:03.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.410+0000 7f93779f7740 1 -- 172.21.15.90:0/615963080 --> [v2:172.21.15.90:6832/1105275899,v1:172.21.15.90:6833/1105275899] -- command(tid 0: {"prefix": "status"}) -- 0x55cf208f8fd0 con 0x55cf20a41180 2024-09-21T03:15:03.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.410+0000 7f9369e00640 1 --2- 172.21.15.90:0/615963080 >> [v2:172.21.15.90:6832/1105275899,v1:172.21.15.90:6833/1105275899] conn(0x55cf20a41180 0x55cf209e58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.410+0000 7f934ea00640 10 client.4788 ms_handle_connect on v2:172.21.15.90:6832/1105275899 2024-09-21T03:15:03.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.410+0000 7f9369e00640 1 --2- 172.21.15.90:0/615963080 >> [v2:172.21.15.90:6832/1105275899,v1:172.21.15.90:6833/1105275899] conn(0x55cf20a41180 0x55cf209e58e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b752f16a6f861185 server_cookie=be9a2b827cd72bec in_seq=0 out_seq=0 2024-09-21T03:15:03.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.411+0000 7f934ea00640 1 -- 172.21.15.90:0/615963080 <== mds.0 v2:172.21.15.90:6832/1105275899 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x55cf208f8fd0 con 0x55cf20a41180 2024-09-21T03:15:03.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.411+0000 7f934ea00640 10 client.4788 handle_command_reply: tid=0 2024-09-21T03:15:03.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.411+0000 7f93779f7740 1 client.4788 shutdown 2024-09-21T03:15:03.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.411+0000 7f93779f7740 1 -- 172.21.15.90:0/615963080 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205c0590 msgr2=0x55cf209bc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:03.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.411+0000 7f93779f7740 1 --2- 172.21.15.90:0/615963080 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205c0590 0x55cf209bc550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f935400eb40 tx=0x7f9354015ee0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.411+0000 7f93779f7740 1 -- 172.21.15.90:0/615963080 shutdown_connections 2024-09-21T03:15:03.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.411+0000 7f93779f7740 1 --2- 172.21.15.90:0/615963080 >> [v2:172.21.15.90:6832/1105275899,v1:172.21.15.90:6833/1105275899] conn(0x55cf20a41180 0x55cf209e58e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.411+0000 7f93779f7740 1 --2- 172.21.15.90:0/615963080 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55cf205e1270 0x55cf20a40a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.411+0000 7f93779f7740 1 --2- 172.21.15.90:0/615963080 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf205c0590 0x55cf209bc550 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.411+0000 7f934ea00640 0 client.4788 ms_handle_reset on v2:172.21.15.90:6832/1105275899 2024-09-21T03:15:03.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.411+0000 7f93779f7740 1 --2- 172.21.15.90:0/615963080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf205b83b0 0x55cf20a43750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.411+0000 7f93779f7740 1 -- 172.21.15.90:0/615963080 >> 172.21.15.90:0/615963080 conn(0x55cf205d53c0 msgr2=0x55cf209bff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:03.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.411+0000 7f93779f7740 1 -- 172.21.15.90:0/615963080 shutdown_connections 2024-09-21T03:15:03.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.411+0000 7f93779f7740 1 -- 172.21.15.90:0/615963080 wait complete. 2024-09-21T03:15:03.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.411+0000 7f93779f7740 20 client.4788 trim_cache size 0 max 16384 2024-09-21T03:15:03.418 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:15:03.418 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:15:03.418 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2024-09-21T03:15:03.418 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4395, 2024-09-21T03:15:03.418 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2024-09-21T03:15:03.418 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2024-09-21T03:15:03.418 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "b", 2024-09-21T03:15:03.419 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 15.863631682999999, 2024-09-21T03:15:03.419 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 14, 2024-09-21T03:15:03.419 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 25, 2024-09-21T03:15:03.419 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 25, 2024-09-21T03:15:03.419 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 31.274379514 2024-09-21T03:15:03.419 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:15:03.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.412+0000 7f9370a00640 1 -- 172.21.15.90:0/4176542856 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9348078b90 msgr2=0x7f934807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:03.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.412+0000 7f9370a00640 1 --2- 172.21.15.90:0/4176542856 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9348078b90 0x7f934807b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f936c1de2d0 tx=0x7f9354009060 comp rx=0 tx=0).stop 2024-09-21T03:15:03.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.412+0000 7f9370a00640 1 -- 172.21.15.90:0/4176542856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936c073080 msgr2=0x7f936c1f0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:03.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.412+0000 7f9370a00640 1 --2- 172.21.15.90:0/4176542856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936c073080 0x7f936c1f0b60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f935c0099d0 tx=0x7f935c0052f0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.412+0000 7f9370a00640 1 -- 172.21.15.90:0/4176542856 shutdown_connections 2024-09-21T03:15:03.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.412+0000 7f9370a00640 1 --2- 172.21.15.90:0/4176542856 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9348078b90 0x7f934807b0a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.412+0000 7f9370a00640 1 --2- 172.21.15.90:0/4176542856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f936c154aa0 0x7f936c14ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.412+0000 7f9370a00640 1 --2- 172.21.15.90:0/4176542856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f936c0ae0a0 0x7f936c1deb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.412+0000 7f9370a00640 1 --2- 172.21.15.90:0/4176542856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936c073080 0x7f936c1f0b60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.412+0000 7f9370a00640 1 -- 172.21.15.90:0/4176542856 >> 172.21.15.90:0/4176542856 conn(0x7f936c0c85a0 msgr2=0x7f936c152ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:03.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.412+0000 7f9370a00640 1 -- 172.21.15.90:0/4176542856 shutdown_connections 2024-09-21T03:15:03.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.412+0000 7f9370a00640 1 -- 172.21.15.90:0/4176542856 wait complete. 2024-09-21T03:15:03.434 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T03:15:03.463 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T03:15:03.463 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-09-21T03:15:03.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:15:03.463 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-21T03:15:03.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:15:03.499 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link delete ceph-brx 2024-09-21T03:15:03.601 INFO:teuthology.orchestra.run.smithi090.stderr:Cannot find device "ceph-brx" 2024-09-21T03:15:03.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:15:03.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:15:03.603 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T03:15:03.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:15:03.643 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-09-21T03:15:03.746 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2024-09-21T03:15:03.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:15:03.748 INFO:tasks.kclient:client.0 config is {'syntax': 'v1', 'cephfs_name': 'a'} 2024-09-21T03:15:03.749 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T03:15:03.749 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:15:03.749 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:15:03.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.968+0000 7f8aeb000640 1 -- 172.21.15.90:0/3021200614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ae4074220 msgr2=0x7f8ae4074630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:03.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.968+0000 7f8aeb000640 1 --2- 172.21.15.90:0/3021200614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ae4074220 0x7f8ae4074630 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8adc005fd0 tx=0x7f8adc02aa10 comp rx=0 tx=0).stop 2024-09-21T03:15:03.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.968+0000 7f8aeb000640 1 -- 172.21.15.90:0/3021200614 shutdown_connections 2024-09-21T03:15:03.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.968+0000 7f8aeb000640 1 --2- 172.21.15.90:0/3021200614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ae4074220 0x7f8ae4074630 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.968+0000 7f8aeb000640 1 --2- 172.21.15.90:0/3021200614 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ae406d960 0x7f8ae413dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.968+0000 7f8aeb000640 1 -- 172.21.15.90:0/3021200614 >> 172.21.15.90:0/3021200614 conn(0x7f8ae40c8ba0 msgr2=0x7f8ae406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:03.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.968+0000 7f8aeb000640 1 -- 172.21.15.90:0/3021200614 shutdown_connections 2024-09-21T03:15:03.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.968+0000 7f8aeb000640 1 -- 172.21.15.90:0/3021200614 wait complete. 2024-09-21T03:15:03.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.970+0000 7f8aeb000640 1 Processor -- start 2024-09-21T03:15:03.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.971+0000 7f8aeb000640 1 -- start start 2024-09-21T03:15:03.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.972+0000 7f8aeb000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ae406d960 0x7f8ae41509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.972+0000 7f8aeb000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ae4074220 0x7f8ae414c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.972+0000 7f8aeb000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ae40ac350 0x7f8ae41585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.972+0000 7f8aeb000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae40ab640 con 0x7f8ae406d960 2024-09-21T03:15:03.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.972+0000 7f8aeb000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae40ab360 con 0x7f8ae40ac350 2024-09-21T03:15:03.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.972+0000 7f8aeb000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae40ace70 con 0x7f8ae4074220 2024-09-21T03:15:03.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.972+0000 7f8ae3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ae406d960 0x7f8ae41509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.972+0000 7f8ae3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ae406d960 0x7f8ae41509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33792/0 (socket says 172.21.15.90:33792) 2024-09-21T03:15:03.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.972+0000 7f8ae3e00640 1 -- 172.21.15.90:0/1271580903 learned_addr learned my addr 172.21.15.90:0/1271580903 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:03.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.972+0000 7f8adbe00640 1 --2- 172.21.15.90:0/1271580903 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ae4074220 0x7f8ae414c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.972+0000 7f8ae9000640 1 --2- 172.21.15.90:0/1271580903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ae40ac350 0x7f8ae41585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.973+0000 7f8ae3e00640 1 -- 172.21.15.90:0/1271580903 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ae4074220 msgr2=0x7f8ae414c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:03.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.973+0000 7f8ae3e00640 1 --2- 172.21.15.90:0/1271580903 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ae4074220 0x7f8ae414c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.973+0000 7f8ae3e00640 1 -- 172.21.15.90:0/1271580903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ae40ac350 msgr2=0x7f8ae41585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:03.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.973+0000 7f8ae3e00640 1 --2- 172.21.15.90:0/1271580903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ae40ac350 0x7f8ae41585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:03.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.973+0000 7f8ae3e00640 1 -- 172.21.15.90:0/1271580903 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae414dc70 con 0x7f8ae406d960 2024-09-21T03:15:03.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.973+0000 7f8ae3e00640 1 --2- 172.21.15.90:0/1271580903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ae406d960 0x7f8ae41509a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400d750 tx=0x7f8ad400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:03.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.973+0000 7f8ae0c00640 1 -- 172.21.15.90:0/1271580903 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4017070 con 0x7f8ae406d960 2024-09-21T03:15:03.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.973+0000 7f8ae0c00640 1 -- 172.21.15.90:0/1271580903 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ad4009b20 con 0x7f8ae406d960 2024-09-21T03:15:03.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.973+0000 7f8ae0c00640 1 -- 172.21.15.90:0/1271580903 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4010460 con 0x7f8ae406d960 2024-09-21T03:15:03.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.973+0000 7f8aeb000640 1 -- 172.21.15.90:0/1271580903 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae41ede60 con 0x7f8ae406d960 2024-09-21T03:15:03.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.973+0000 7f8aeb000640 1 -- 172.21.15.90:0/1271580903 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ae414bf10 con 0x7f8ae406d960 2024-09-21T03:15:03.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.975+0000 7f8aeb000640 1 -- 172.21.15.90:0/1271580903 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ae413dd40 con 0x7f8ae406d960 2024-09-21T03:15:03.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.976+0000 7f8ae0c00640 1 -- 172.21.15.90:0/1271580903 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ad401a070 con 0x7f8ae406d960 2024-09-21T03:15:03.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.976+0000 7f8ae0c00640 1 --2- 172.21.15.90:0/1271580903 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8ac0078b90 0x7f8ac007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:03.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.977+0000 7f8ae0c00640 1 -- 172.21.15.90:0/1271580903 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f8ad409b250 con 0x7f8ae406d960 2024-09-21T03:15:03.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.977+0000 7f8adbe00640 1 --2- 172.21.15.90:0/1271580903 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8ac0078b90 0x7f8ac007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:03.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.978+0000 7f8adbe00640 1 --2- 172.21.15.90:0/1271580903 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8ac0078b90 0x7f8ac007b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40ac980 tx=0x7f8acc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:03.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:03.981+0000 7f8ae0c00640 1 -- 172.21.15.90:0/1271580903 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8ad4062d00 con 0x7f8ae406d960 2024-09-21T03:15:04.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:04.203+0000 7f8aeb000640 1 -- 172.21.15.90:0/1271580903 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8ae40c26d0 con 0x7f8ae406d960 2024-09-21T03:15:04.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:04.203+0000 7f8ae0c00640 1 -- 172.21.15.90:0/1271580903 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+116 (secure 0 0 0) 0x7f8ad4067730 con 0x7f8ae406d960 2024-09-21T03:15:04.205 INFO:teuthology.orchestra.run.smithi090.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-09-21T03:15:04.205 INFO:teuthology.orchestra.run.smithi090.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-09-21T03:15:04.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:04.205+0000 7f8aeb000640 1 -- 172.21.15.90:0/1271580903 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8ac0078b90 msgr2=0x7f8ac007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:04.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:04.205+0000 7f8aeb000640 1 --2- 172.21.15.90:0/1271580903 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8ac0078b90 0x7f8ac007b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40ac980 tx=0x7f8acc009040 comp rx=0 tx=0).stop 2024-09-21T03:15:04.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:04.206+0000 7f8aeb000640 1 -- 172.21.15.90:0/1271580903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ae406d960 msgr2=0x7f8ae41509a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:04.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:04.206+0000 7f8aeb000640 1 --2- 172.21.15.90:0/1271580903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ae406d960 0x7f8ae41509a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400d750 tx=0x7f8ad400dc10 comp rx=0 tx=0).stop 2024-09-21T03:15:04.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:04.206+0000 7f8aeb000640 1 -- 172.21.15.90:0/1271580903 shutdown_connections 2024-09-21T03:15:04.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:04.206+0000 7f8aeb000640 1 --2- 172.21.15.90:0/1271580903 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8ac0078b90 0x7f8ac007b0a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:04.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:04.206+0000 7f8aeb000640 1 --2- 172.21.15.90:0/1271580903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ae40ac350 0x7f8ae41585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:04.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:04.206+0000 7f8aeb000640 1 --2- 172.21.15.90:0/1271580903 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ae4074220 0x7f8ae414c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:04.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:04.206+0000 7f8aeb000640 1 --2- 172.21.15.90:0/1271580903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ae406d960 0x7f8ae41509a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:04.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:04.206+0000 7f8aeb000640 1 -- 172.21.15.90:0/1271580903 >> 172.21.15.90:0/1271580903 conn(0x7f8ae40c8ba0 msgr2=0x7f8ae40c3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:04.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:04.206+0000 7f8aeb000640 1 -- 172.21.15.90:0/1271580903 shutdown_connections 2024-09-21T03:15:04.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:04.206+0000 7f8aeb000640 1 -- 172.21.15.90:0/1271580903 wait complete. 2024-09-21T03:15:04.230 INFO:tasks.cephfs.mount:Mounting Ceph FS a; just confirmed its presence on cluster 2024-09-21T03:15:04.230 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:15:04.230 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2024-09-21T03:15:04.230 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T03:15:04.230 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:15:04.230 INFO:tasks.cephfs.mount:self.cephfs_name = a 2024-09-21T03:15:04.230 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T03:15:04.230 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:15:04.230 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:15:04.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:15:04.231 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2024-09-21T03:15:04.265 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:15:04.265 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:15:04.266 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:15:04.266 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:15:04.266 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-09-21T03:15:04.266 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:15:04.266 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:15:04.266 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:15:04.266 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2024-09-21T03:15:04.266 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:15:04.266 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:15:04.266 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2024-09-21T03:15:04.266 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:15:04.266 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:15:04.267 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:15:04.267 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:15:04.267 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:15:04.267 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42688sec preferred_lft 42688sec 2024-09-21T03:15:04.267 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link noprefixroute 2024-09-21T03:15:04.267 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:15:04.267 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T03:15:04.267 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:15:04.267 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-21T03:15:04.268 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link add name ceph-brx type bridge 2024-09-21T03:15:04.268 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip addr flush dev ceph-brx 2024-09-21T03:15:04.268 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set ceph-brx up 2024-09-21T03:15:04.268 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T03:15:04.268 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-21T03:15:04.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:15:04.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:15:04.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:15:04.756 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:15:04.812 INFO:teuthology.orchestra.run.smithi090.stdout:1 2024-09-21T03:15:04.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:15:04.815 DEBUG:teuthology.orchestra.run.smithi090:> route 2024-09-21T03:15:04.865 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2024-09-21T03:15:04.865 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:15:04.866 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:15:04.866 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:15:04.866 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:15:04.866 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:15:04.866 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-21T03:15:04.866 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:15:04.866 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:15:04.866 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:15:04.866 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-21T03:15:04.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:15:05.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:15:05.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:15:05.584 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-21T03:15:05.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:15:05.621 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list-id 2024-09-21T03:15:05.697 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:15:05.697 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-21T03:15:05.697 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:15:05.697 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T03:15:05.697 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-21T03:15:05.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:15:05.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:15:05.877 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T03:15:05.877 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:15:05.877 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-21T03:15:05.877 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T03:15:05.877 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T03:15:05.877 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T03:15:05.877 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T03:15:05.877 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T03:15:05.877 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-21T03:15:05.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:15:06.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:15:06.120 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:15:06.120 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-21T03:15:06.120 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.0 up 2024-09-21T03:15:06.120 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T03:15:06.120 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-21T03:15:06.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:15:06.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:15:06.290 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:15:06.290 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T03:15:06.325 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:15:06.325 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:15:06.326 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:15:06.403 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:15:06.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:15:06.403 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=a 2024-09-21T03:15:06.609 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=a 2024-09-21T03:15:06.609 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=a". 2024-09-21T03:15:06.609 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-21T03:15:07.274 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=a 2024-09-21T03:15:07.274 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=a". 2024-09-21T03:15:07.274 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-21T03:15:07.274 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T03:15:07.274 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:15:07.309 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=a 2024-09-21T03:15:07.309 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=a". 2024-09-21T03:15:07.309 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-21T03:15:07.310 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T03:15:07.310 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:15:07.310 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-21T03:15:07.310 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-21T03:15:07.310 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=a,key=0,fsid=03c7e55f-7aae-4606-9d16-02ae95467377" will pass to kernel 2024-09-21T03:15:07.311 INFO:teuthology.orchestra.run.smithi090.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T03:15:07.311 INFO:teuthology.orchestra.run.smithi090.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:15:07.311 INFO:teuthology.orchestra.run.smithi090.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:15:07.311 INFO:teuthology.orchestra.run.smithi090.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:15:07.312 INFO:teuthology.orchestra.run.smithi090.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:15:07.315 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:15:07.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:15:07.315 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:15:07.373 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:15:07.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:15:07.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:15:07.477 INFO:teuthology.orchestra.run.smithi090.stdout:client4577 2024-09-21T03:15:07.477 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:15:07.477 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:15:07.513 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:15:07.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:15:07.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:15:07.655 INFO:teuthology.orchestra.run.smithi090.stdout:client4577 2024-09-21T03:15:07.655 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:15:07.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:15:07.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:15:07.754 INFO:teuthology.orchestra.run.smithi090.stdout:client4577 2024-09-21T03:15:07.754 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/03c7e55f-7aae-4606-9d16-02ae95467377.client4577/status') 2024-09-21T03:15:07.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:15:07.861 INFO:teuthology.orchestra.run.smithi090.stdout:instance: client.4577 (3)172.21.15.90:0/2783281456 2024-09-21T03:15:07.861 INFO:teuthology.orchestra.run.smithi090.stdout:blocklisted: false 2024-09-21T03:15:07.861 INFO:teuthology.orchestra.run.smithi090.stderr:0+1 records in 2024-09-21T03:15:07.862 INFO:teuthology.orchestra.run.smithi090.stderr:0+1 records out 2024-09-21T03:15:07.862 INFO:teuthology.orchestra.run.smithi090.stderr:70 bytes copied, 6.8818e-05 s, 1.0 MB/s 2024-09-21T03:15:07.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:15:07.872 INFO:tasks.kclient:client.1 config is {'syntax': 'v1', 'cephfs_name': 'b'} 2024-09-21T03:15:07.872 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T03:15:07.872 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T03:15:07.872 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:15:08.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.091+0000 7fcc4ec00640 1 -- 172.21.15.90:0/350494667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc480c47b0 msgr2=0x7fcc480ad2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:08.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.091+0000 7fcc4ec00640 1 --2- 172.21.15.90:0/350494667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc480c47b0 0x7fcc480ad2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcc38005fd0 tx=0x7fcc3802a8e0 comp rx=0 tx=0).stop 2024-09-21T03:15:08.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.091+0000 7fcc4ec00640 1 -- 172.21.15.90:0/350494667 shutdown_connections 2024-09-21T03:15:08.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.091+0000 7fcc4ec00640 1 --2- 172.21.15.90:0/350494667 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc480c3d40 0x7fcc480c1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:08.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.091+0000 7fcc4ec00640 1 --2- 172.21.15.90:0/350494667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc480c47b0 0x7fcc480ad2f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:08.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.091+0000 7fcc4ec00640 1 -- 172.21.15.90:0/350494667 >> 172.21.15.90:0/350494667 conn(0x7fcc480c8ba0 msgr2=0x7fcc4806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:08.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.091+0000 7fcc4ec00640 1 -- 172.21.15.90:0/350494667 shutdown_connections 2024-09-21T03:15:08.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.091+0000 7fcc4ec00640 1 -- 172.21.15.90:0/350494667 wait complete. 2024-09-21T03:15:08.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.093+0000 7fcc4ec00640 1 Processor -- start 2024-09-21T03:15:08.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.094+0000 7fcc4ec00640 1 -- start start 2024-09-21T03:15:08.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.095+0000 7fcc4ec00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc480c1a80 0x7fcc48158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:08.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.095+0000 7fcc4ec00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc480c3d40 0x7fcc481f0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:08.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.095+0000 7fcc4ec00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc480c47b0 0x7fcc4814ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:08.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.095+0000 7fcc4ec00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcc480c26e0 con 0x7fcc480c47b0 2024-09-21T03:15:08.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.095+0000 7fcc4ec00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4806fcb0 con 0x7fcc480c1a80 2024-09-21T03:15:08.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.095+0000 7fcc4ec00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcc48157850 con 0x7fcc480c3d40 2024-09-21T03:15:08.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.095+0000 7fcc4cc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc480c47b0 0x7fcc4814ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:08.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.095+0000 7fcc4cc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc480c47b0 0x7fcc4814ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46982/0 (socket says 172.21.15.90:46982) 2024-09-21T03:15:08.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.095+0000 7fcc4cc00640 1 -- 172.21.15.90:0/576996155 learned_addr learned my addr 172.21.15.90:0/576996155 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:08.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.095+0000 7fcc3f400640 1 --2- 172.21.15.90:0/576996155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc480c3d40 0x7fcc481f0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:08.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.095+0000 7fcc47e00640 1 --2- 172.21.15.90:0/576996155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc480c1a80 0x7fcc48158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:08.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.096+0000 7fcc4cc00640 1 -- 172.21.15.90:0/576996155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc480c3d40 msgr2=0x7fcc481f0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:08.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.096+0000 7fcc4cc00640 1 --2- 172.21.15.90:0/576996155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc480c3d40 0x7fcc481f0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:08.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.096+0000 7fcc4cc00640 1 -- 172.21.15.90:0/576996155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc480c1a80 msgr2=0x7fcc48158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:08.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.096+0000 7fcc4cc00640 1 --2- 172.21.15.90:0/576996155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc480c1a80 0x7fcc48158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:08.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.096+0000 7fcc4cc00640 1 -- 172.21.15.90:0/576996155 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4815a0d0 con 0x7fcc480c47b0 2024-09-21T03:15:08.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.096+0000 7fcc4cc00640 1 --2- 172.21.15.90:0/576996155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc480c47b0 0x7fcc4814ca20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcc4000b3e0 tx=0x7fcc4000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:08.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.096+0000 7fcc44c00640 1 -- 172.21.15.90:0/576996155 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc40015030 con 0x7fcc480c47b0 2024-09-21T03:15:08.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.096+0000 7fcc44c00640 1 -- 172.21.15.90:0/576996155 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc40004110 con 0x7fcc480c47b0 2024-09-21T03:15:08.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.096+0000 7fcc44c00640 1 -- 172.21.15.90:0/576996155 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc40011630 con 0x7fcc480c47b0 2024-09-21T03:15:08.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.096+0000 7fcc4ec00640 1 -- 172.21.15.90:0/576996155 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc4815a600 con 0x7fcc480c47b0 2024-09-21T03:15:08.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.096+0000 7fcc4ec00640 1 -- 172.21.15.90:0/576996155 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc48158ad0 con 0x7fcc480c47b0 2024-09-21T03:15:08.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.097+0000 7fcc4ec00640 1 -- 172.21.15.90:0/576996155 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc480c1540 con 0x7fcc480c47b0 2024-09-21T03:15:08.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.099+0000 7fcc44c00640 1 -- 172.21.15.90:0/576996155 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc40018070 con 0x7fcc480c47b0 2024-09-21T03:15:08.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.099+0000 7fcc44c00640 1 --2- 172.21.15.90:0/576996155 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc24078b90 0x7fcc2407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:08.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.100+0000 7fcc44c00640 1 -- 172.21.15.90:0/576996155 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fcc4009aad0 con 0x7fcc480c47b0 2024-09-21T03:15:08.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.100+0000 7fcc47e00640 1 --2- 172.21.15.90:0/576996155 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc24078b90 0x7fcc2407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:08.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.101+0000 7fcc47e00640 1 --2- 172.21.15.90:0/576996155 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc24078b90 0x7fcc2407b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcc38035000 tx=0x7fcc38004ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:08.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.104+0000 7fcc44c00640 1 -- 172.21.15.90:0/576996155 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcc40062c60 con 0x7fcc480c47b0 2024-09-21T03:15:08.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.326+0000 7fcc4ec00640 1 -- 172.21.15.90:0/576996155 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcc480c3b20 con 0x7fcc480c47b0 2024-09-21T03:15:08.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.326+0000 7fcc44c00640 1 -- 172.21.15.90:0/576996155 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+116 (secure 0 0 0) 0x7fcc40062560 con 0x7fcc480c47b0 2024-09-21T03:15:08.328 INFO:teuthology.orchestra.run.smithi090.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-09-21T03:15:08.328 INFO:teuthology.orchestra.run.smithi090.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-09-21T03:15:08.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.328+0000 7fcc4ec00640 1 -- 172.21.15.90:0/576996155 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc24078b90 msgr2=0x7fcc2407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:08.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.328+0000 7fcc4ec00640 1 --2- 172.21.15.90:0/576996155 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc24078b90 0x7fcc2407b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcc38035000 tx=0x7fcc38004ab0 comp rx=0 tx=0).stop 2024-09-21T03:15:08.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.328+0000 7fcc4ec00640 1 -- 172.21.15.90:0/576996155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc480c47b0 msgr2=0x7fcc4814ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:08.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.328+0000 7fcc4ec00640 1 --2- 172.21.15.90:0/576996155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc480c47b0 0x7fcc4814ca20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcc4000b3e0 tx=0x7fcc4000b8a0 comp rx=0 tx=0).stop 2024-09-21T03:15:08.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.328+0000 7fcc4ec00640 1 -- 172.21.15.90:0/576996155 shutdown_connections 2024-09-21T03:15:08.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.328+0000 7fcc4ec00640 1 --2- 172.21.15.90:0/576996155 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc24078b90 0x7fcc2407b0a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:08.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.328+0000 7fcc4ec00640 1 --2- 172.21.15.90:0/576996155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc480c47b0 0x7fcc4814ca20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:08.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.328+0000 7fcc4ec00640 1 --2- 172.21.15.90:0/576996155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc480c3d40 0x7fcc481f0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:08.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.328+0000 7fcc4ec00640 1 --2- 172.21.15.90:0/576996155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc480c1a80 0x7fcc48158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:08.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.329+0000 7fcc4ec00640 1 -- 172.21.15.90:0/576996155 >> 172.21.15.90:0/576996155 conn(0x7fcc480c8ba0 msgr2=0x7fcc480abc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:08.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.329+0000 7fcc4ec00640 1 -- 172.21.15.90:0/576996155 shutdown_connections 2024-09-21T03:15:08.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:08.329+0000 7fcc4ec00640 1 -- 172.21.15.90:0/576996155 wait complete. 2024-09-21T03:15:08.352 INFO:tasks.cephfs.mount:Mounting Ceph FS b; just confirmed its presence on cluster 2024-09-21T03:15:08.352 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:15:08.352 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-21T03:15:08.352 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T03:15:08.352 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T03:15:08.352 INFO:tasks.cephfs.mount:self.cephfs_name = b 2024-09-21T03:15:08.352 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T03:15:08.352 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:15:08.352 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:15:08.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:15:08.353 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-21T03:15:08.393 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:15:08.393 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:15:08.393 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:15:08.393 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:15:08.393 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-21T03:15:08.393 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:15:08.393 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:15:08.394 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:15:08.394 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-21T03:15:08.394 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:15:08.394 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:15:08.394 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-21T03:15:08.394 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:15:08.394 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:15:08.394 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:15:08.394 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:15:08.394 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:15:08.394 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42664sec preferred_lft 42664sec 2024-09-21T03:15:08.394 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link noprefixroute 2024-09-21T03:15:08.394 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:15:08.395 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T03:15:08.395 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:15:08.395 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T03:15:08.395 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add name ceph-brx type bridge 2024-09-21T03:15:08.395 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr flush dev ceph-brx 2024-09-21T03:15:08.395 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set ceph-brx up 2024-09-21T03:15:08.395 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T03:15:08.395 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T03:15:08.517 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:15:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:15:08.805 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:15:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:15:08.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:15:08.814 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:15:08.872 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-21T03:15:08.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:15:08.875 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-21T03:15:08.920 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-21T03:15:08.920 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:15:08.920 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:15:08.920 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:15:08.920 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:15:08.921 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:15:08.921 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T03:15:08.921 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:15:08.921 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:15:08.921 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:15:08.921 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T03:15:09.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:15:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:15:09.525 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:15:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:15:09.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:15:09.533 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T03:15:09.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:15:09.570 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2024-09-21T03:15:09.646 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:15:09.646 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T03:15:09.646 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T03:15:09.646 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-21T03:15:09.646 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T03:15:09.767 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:15:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:15:09.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:15:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:15:09.829 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-21T03:15:09.829 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:15:09.829 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T03:15:09.829 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-21T03:15:09.829 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T03:15:09.829 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-21T03:15:09.829 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-21T03:15:09.829 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-21T03:15:09.829 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T03:15:09.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:15:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:15:10.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:15:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:15:10.071 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:15:10.071 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T03:15:10.071 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-21T03:15:10.071 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T03:15:10.071 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T03:15:10.150 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:15:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:15:10.232 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:15:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:15:10.240 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:15:10.240 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T03:15:10.275 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:15:10.275 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:15:10.275 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:15:10.351 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:15:10.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:15:10.351 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=b 2024-09-21T03:15:10.566 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=b 2024-09-21T03:15:10.566 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=b". 2024-09-21T03:15:10.566 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-21T03:15:11.208 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=b 2024-09-21T03:15:11.208 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=b". 2024-09-21T03:15:11.208 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-21T03:15:11.208 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T03:15:11.208 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:15:11.241 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=b 2024-09-21T03:15:11.241 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=b". 2024-09-21T03:15:11.241 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-21T03:15:11.241 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T03:15:11.241 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:15:11.242 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-21T03:15:11.242 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-21T03:15:11.242 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=b,key=1,fsid=03c7e55f-7aae-4606-9d16-02ae95467377" will pass to kernel 2024-09-21T03:15:11.243 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T03:15:11.243 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:15:11.243 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:15:11.243 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:15:11.243 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:15:11.246 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:15:11.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:15:11.246 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:15:11.304 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:15:12.870 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:15:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:15:12.875 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:15:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:15:12.883 INFO:teuthology.orchestra.run.smithi149.stdout:client4586 2024-09-21T03:15:12.883 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:15:12.883 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:15:12.920 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:15:13.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:15:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:15:13.041 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:15:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:15:13.049 INFO:teuthology.orchestra.run.smithi149.stdout:client4586 2024-09-21T03:15:13.049 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:15:13.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:15:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:15:13.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:15:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:15:13.140 INFO:teuthology.orchestra.run.smithi149.stdout:client4586 2024-09-21T03:15:13.141 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/03c7e55f-7aae-4606-9d16-02ae95467377.client4586/status') 2024-09-21T03:15:13.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:15:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:15:13.241 INFO:teuthology.orchestra.run.smithi149.stdout:instance: client.4586 (3)192.168.0.1:0/2537304896 2024-09-21T03:15:13.241 INFO:teuthology.orchestra.run.smithi149.stdout:blocklisted: false 2024-09-21T03:15:13.241 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records in 2024-09-21T03:15:13.241 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records out 2024-09-21T03:15:13.241 INFO:teuthology.orchestra.run.smithi149.stderr:69 bytes copied, 5.2403e-05 s, 1.3 MB/s 2024-09-21T03:15:13.243 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T03:15:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:15:13.252 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-09-21T03:15:13.283 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-09-21T03:15:13.284 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:15:13.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.513+0000 7f90bd400640 1 -- 172.21.15.90:0/3342565275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90b806d960 msgr2=0x7f90b813dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:13.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.513+0000 7f90bd400640 1 --2- 172.21.15.90:0/3342565275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90b806d960 0x7f90b813dd40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f90b8069d10 tx=0x7f90a802a4d0 comp rx=0 tx=0).stop 2024-09-21T03:15:13.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.513+0000 7f90bd400640 1 -- 172.21.15.90:0/3342565275 shutdown_connections 2024-09-21T03:15:13.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.513+0000 7f90bd400640 1 --2- 172.21.15.90:0/3342565275 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90b80acca0 0x7f90b8074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:13.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.513+0000 7f90bd400640 1 --2- 172.21.15.90:0/3342565275 >> v2:172.21.15.149:3300/0 conn(0x7f90b80ac350 0x7f90b80ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:13.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.513+0000 7f90bd400640 1 --2- 172.21.15.90:0/3342565275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90b806d960 0x7f90b813dd40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:13.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.513+0000 7f90bd400640 1 -- 172.21.15.90:0/3342565275 >> 172.21.15.90:0/3342565275 conn(0x7f90b80c8ba0 msgr2=0x7f90b806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:13.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.513+0000 7f90bd400640 1 -- 172.21.15.90:0/3342565275 shutdown_connections 2024-09-21T03:15:13.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.513+0000 7f90bd400640 1 -- 172.21.15.90:0/3342565275 wait complete. 2024-09-21T03:15:13.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.515+0000 7f90bd400640 1 Processor -- start 2024-09-21T03:15:13.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.515+0000 7f90bd400640 1 -- start start 2024-09-21T03:15:13.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.517+0000 7f90bd400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90b806d960 0x7f90b81e2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:13.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.517+0000 7f90bd400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90b80ac350 0x7f90b813a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:13.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.517+0000 7f90bd400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90b80acca0 0x7f90b8153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:13.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.517+0000 7f90bd400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f90b80ab640 con 0x7f90b80acca0 2024-09-21T03:15:13.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.517+0000 7f90bd400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f90b80ab360 con 0x7f90b806d960 2024-09-21T03:15:13.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.517+0000 7f90bd400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f90b8074760 con 0x7f90b80ac350 2024-09-21T03:15:13.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.517+0000 7f90b7200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90b80acca0 0x7f90b8153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:13.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.517+0000 7f90b6800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90b806d960 0x7f90b81e2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:13.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.517+0000 7f90afe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90b80ac350 0x7f90b813a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:13.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.517+0000 7f90b7200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90b80acca0 0x7f90b8153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46994/0 (socket says 172.21.15.90:46994) 2024-09-21T03:15:13.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.517+0000 7f90b6800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90b806d960 0x7f90b81e2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:57756/0 (socket says 172.21.15.90:57756) 2024-09-21T03:15:13.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.517+0000 7f90b7200640 1 -- 172.21.15.90:0/660327338 learned_addr learned my addr 172.21.15.90:0/660327338 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:13.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.518+0000 7f90b7200640 1 -- 172.21.15.90:0/660327338 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90b80ac350 msgr2=0x7f90b813a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:13.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.518+0000 7f90b7200640 1 --2- 172.21.15.90:0/660327338 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90b80ac350 0x7f90b813a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:13.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.518+0000 7f90b7200640 1 -- 172.21.15.90:0/660327338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90b806d960 msgr2=0x7f90b81e2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:13.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.518+0000 7f90b7200640 1 --2- 172.21.15.90:0/660327338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90b806d960 0x7f90b81e2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:13.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.518+0000 7f90b7200640 1 -- 172.21.15.90:0/660327338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b81e3250 con 0x7f90b80acca0 2024-09-21T03:15:13.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.518+0000 7f90b7200640 1 --2- 172.21.15.90:0/660327338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90b80acca0 0x7f90b8153940 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f90b000cac0 tx=0x7f90b000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:13.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.518+0000 7f90aea00640 1 -- 172.21.15.90:0/660327338 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b0007df0 con 0x7f90b80acca0 2024-09-21T03:15:13.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.518+0000 7f90aea00640 1 -- 172.21.15.90:0/660327338 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90b000f450 con 0x7f90b80acca0 2024-09-21T03:15:13.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.518+0000 7f90aea00640 1 -- 172.21.15.90:0/660327338 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b000f8c0 con 0x7f90b80acca0 2024-09-21T03:15:13.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.518+0000 7f90bd400640 1 -- 172.21.15.90:0/660327338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b81ed2c0 con 0x7f90b80acca0 2024-09-21T03:15:13.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.518+0000 7f90bd400640 1 -- 172.21.15.90:0/660327338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b81ed880 con 0x7f90b80acca0 2024-09-21T03:15:13.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.519+0000 7f90bd400640 1 -- 172.21.15.90:0/660327338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b8074cc0 con 0x7f90b80acca0 2024-09-21T03:15:13.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.521+0000 7f90aea00640 1 -- 172.21.15.90:0/660327338 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f90b000fa60 con 0x7f90b80acca0 2024-09-21T03:15:13.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.522+0000 7f90aea00640 1 --2- 172.21.15.90:0/660327338 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9094078bc0 0x7f909407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:13.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.522+0000 7f90aea00640 1 -- 172.21.15.90:0/660327338 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f90b009b900 con 0x7f90b80acca0 2024-09-21T03:15:13.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.522+0000 7f90b6800640 1 --2- 172.21.15.90:0/660327338 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9094078bc0 0x7f909407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:13.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.523+0000 7f90b6800640 1 --2- 172.21.15.90:0/660327338 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9094078bc0 0x7f909407b0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f90a8033000 tx=0x7f90a8004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:13.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.527+0000 7f90aea00640 1 -- 172.21.15.90:0/660327338 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f90b0014030 con 0x7f90b80acca0 2024-09-21T03:15:13.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.716+0000 7f90bd400640 1 -- 172.21.15.90:0/660327338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90b8074480 con 0x7f90b80acca0 2024-09-21T03:15:13.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.717+0000 7f90aea00640 1 -- 172.21.15.90:0/660327338 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20407 (secure 0 0 0) 0x7f90b0063440 con 0x7f90b80acca0 2024-09-21T03:15:13.832 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:15:13.832 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":25,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","created":"2024-09-21T03:14:09.323302+0000","modified":"2024-09-21T03:14:48.547226+0000","last_up_change":"2024-09-21T03:14:25.329650+0000","last_in_change":"2024-09-21T03:14:15.386953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:14:24.511246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-21T03:14:35.815250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-21T03:14:36.914615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-21T03:14:45.298287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-21T03:14:45.977111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ceaacfab-e71c-45e2-ac50-4597dfd460bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6809","nonce":3187794863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6811","nonce":3187794863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6815","nonce":3187794863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6813","nonce":3187794863}]},"public_addr":"172.21.15.90:6809/3187794863","cluster_addr":"172.21.15.90:6811/3187794863","heartbeat_back_addr":"172.21.15.90:6815/3187794863","heartbeat_front_addr":"172.21.15.90:6813/3187794863","state":["exists","up"]},{"osd":1,"uuid":"86f91523-232b-4e80-ada7-d9e12770adb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6801","nonce":3769758484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6803","nonce":3769758484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6807","nonce":3769758484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6805","nonce":3769758484}]},"public_addr":"172.21.15.90:6801/3769758484","cluster_addr":"172.21.15.90:6803/3769758484","heartbeat_back_addr":"172.21.15.90:6807/3769758484","heartbeat_front_addr":"172.21.15.90:6805/3769758484","state":["exists","up"]},{"osd":2,"uuid":"6eb0f47b-e767-49c0-8d72-07f71b9c2e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6825","nonce":1025535744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6827","nonce":1025535744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6831","nonce":1025535744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6829","nonce":1025535744}]},"public_addr":"172.21.15.90:6825/1025535744","cluster_addr":"172.21.15.90:6827/1025535744","heartbeat_back_addr":"172.21.15.90:6831/1025535744","heartbeat_front_addr":"172.21.15.90:6829/1025535744","state":["exists","up"]},{"osd":3,"uuid":"64418862-beef-479c-be11-dfe0e515e09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6817","nonce":1515884437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6819","nonce":1515884437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6823","nonce":1515884437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6821","nonce":1515884437}]},"public_addr":"172.21.15.90:6817/1515884437","cluster_addr":"172.21.15.90:6819/1515884437","heartbeat_back_addr":"172.21.15.90:6823/1515884437","heartbeat_front_addr":"172.21.15.90:6821/1515884437","state":["exists","up"]},{"osd":4,"uuid":"a05b63f4-ec0a-426c-9d60-285e2680a897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6816","nonce":4278726553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6820","nonce":4278726553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6825","nonce":4278726553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6823","nonce":4278726553}]},"public_addr":"172.21.15.149:6816/4278726553","cluster_addr":"172.21.15.149:6820/4278726553","heartbeat_back_addr":"172.21.15.149:6825/4278726553","heartbeat_front_addr":"172.21.15.149:6823/4278726553","state":["exists","up"]},{"osd":5,"uuid":"3a1bab89-963c-4fe7-b14f-3080c5cf7830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6827","nonce":1341677333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6829","nonce":1341677333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6833","nonce":1341677333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6831","nonce":1341677333}]},"public_addr":"172.21.15.149:6827/1341677333","cluster_addr":"172.21.15.149:6829/1341677333","heartbeat_back_addr":"172.21.15.149:6833/1341677333","heartbeat_front_addr":"172.21.15.149:6831/1341677333","state":["exists","up"]},{"osd":6,"uuid":"bfcd1596-2688-4deb-be2e-55f305a5b4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6811","nonce":821196931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6813","nonce":821196931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6821","nonce":821196931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6817","nonce":821196931}]},"public_addr":"172.21.15.149:6811/821196931","cluster_addr":"172.21.15.149:6813/821196931","heartbeat_back_addr":"172.21.15.149:6821/821196931","heartbeat_front_addr":"172.21.15.149:6817/821196931","state":["exists","up"]},{"osd":7,"uuid":"58b19790-4006-4f07-966c-911b938cc1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6803","nonce":1657326880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6805","nonce":1657326880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6809","nonce":1657326880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6807","nonce":1657326880}]},"public_addr":"172.21.15.149:6803/1657326880","cluster_addr":"172.21.15.149:6805/1657326880","heartbeat_back_addr":"172.21.15.149:6809/1657326880","heartbeat_front_addr":"172.21.15.149:6807/1657326880","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.399701+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.051745+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.190159+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:23.240143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.446570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.259974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:21.990407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.459259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:15:13.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.720+0000 7f90bd400640 1 -- 172.21.15.90:0/660327338 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9094078bc0 msgr2=0x7f909407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:13.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.720+0000 7f90bd400640 1 --2- 172.21.15.90:0/660327338 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9094078bc0 0x7f909407b0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f90a8033000 tx=0x7f90a8004730 comp rx=0 tx=0).stop 2024-09-21T03:15:13.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.720+0000 7f90bd400640 1 -- 172.21.15.90:0/660327338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90b80acca0 msgr2=0x7f90b8153940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:13.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.720+0000 7f90bd400640 1 --2- 172.21.15.90:0/660327338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90b80acca0 0x7f90b8153940 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f90b000cac0 tx=0x7f90b000cf80 comp rx=0 tx=0).stop 2024-09-21T03:15:13.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.720+0000 7f90bd400640 1 -- 172.21.15.90:0/660327338 shutdown_connections 2024-09-21T03:15:13.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.720+0000 7f90bd400640 1 --2- 172.21.15.90:0/660327338 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9094078bc0 0x7f909407b0d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:13.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.720+0000 7f90bd400640 1 --2- 172.21.15.90:0/660327338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90b80acca0 0x7f90b8153940 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:13.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.720+0000 7f90bd400640 1 --2- 172.21.15.90:0/660327338 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90b80ac350 0x7f90b813a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:13.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.720+0000 7f90bd400640 1 --2- 172.21.15.90:0/660327338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90b806d960 0x7f90b81e2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:13.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.720+0000 7f90bd400640 1 -- 172.21.15.90:0/660327338 >> 172.21.15.90:0/660327338 conn(0x7f90b80c8ba0 msgr2=0x7f90b80c3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:13.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.720+0000 7f90bd400640 1 -- 172.21.15.90:0/660327338 shutdown_connections 2024-09-21T03:15:13.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:13.720+0000 7f90bd400640 1 -- 172.21.15.90:0/660327338 wait complete. 2024-09-21T03:15:13.835 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:14:24.511246+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-09-21T03:14:35.815250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-09-21T03:14:36.914615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-09-21T03:14:45.298287+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-09-21T03:14:45.977111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T03:15:13.835 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T03:15:14.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.058+0000 7eff16600640 1 -- 172.21.15.90:0/2894718940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efef4003a50 msgr2=0x7efef4003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:14.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.058+0000 7eff16600640 1 --2- 172.21.15.90:0/2894718940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efef4003a50 0x7efef4003ee0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7eff00006fd0 tx=0x7efef4005830 comp rx=0 tx=0).stop 2024-09-21T03:15:14.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.058+0000 7eff16600640 1 -- 172.21.15.90:0/2894718940 shutdown_connections 2024-09-21T03:15:14.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.058+0000 7eff16600640 1 --2- 172.21.15.90:0/2894718940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efef4003a50 0x7efef4003ee0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:14.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.058+0000 7eff16600640 1 -- 172.21.15.90:0/2894718940 >> 172.21.15.90:0/2894718940 conn(0x7eff100c7ec0 msgr2=0x7eff100c82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:14.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.058+0000 7eff16600640 1 -- 172.21.15.90:0/2894718940 shutdown_connections 2024-09-21T03:15:14.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.058+0000 7eff16600640 1 -- 172.21.15.90:0/2894718940 wait complete. 2024-09-21T03:15:14.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.060+0000 7eff16600640 1 Processor -- start 2024-09-21T03:15:14.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.060+0000 7eff16600640 1 -- start start 2024-09-21T03:15:14.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.062+0000 7eff16600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efef4003a50 0x7eff10158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:14.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.062+0000 7eff16600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff10073c00 0x7eff101f0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:14.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.062+0000 7eff16600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff10074010 0x7eff10139710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:14.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.062+0000 7eff16600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7eff10155880 con 0x7eff10074010 2024-09-21T03:15:14.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.062+0000 7eff16600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7eff100adff0 con 0x7eff10073c00 2024-09-21T03:15:14.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.062+0000 7eff16600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7eff10070c40 con 0x7efef4003a50 2024-09-21T03:15:14.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.062+0000 7eff15c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff10074010 0x7eff10139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:14.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.062+0000 7eff15c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff10074010 0x7eff10139710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47014/0 (socket says 172.21.15.90:47014) 2024-09-21T03:15:14.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.062+0000 7eff15c00640 1 -- 172.21.15.90:0/2123185356 learned_addr learned my addr 172.21.15.90:0/2123185356 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:14.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.062+0000 7eff15200640 1 --2- 172.21.15.90:0/2123185356 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efef4003a50 0x7eff10158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:14.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.062+0000 7eff07e00640 1 --2- 172.21.15.90:0/2123185356 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff10073c00 0x7eff101f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:14.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.062+0000 7eff15c00640 1 -- 172.21.15.90:0/2123185356 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efef4003a50 msgr2=0x7eff10158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:14.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.062+0000 7eff15c00640 1 --2- 172.21.15.90:0/2123185356 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efef4003a50 0x7eff10158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:14.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.062+0000 7eff15c00640 1 -- 172.21.15.90:0/2123185356 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff10073c00 msgr2=0x7eff101f0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:14.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.062+0000 7eff15c00640 1 --2- 172.21.15.90:0/2123185356 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff10073c00 0x7eff101f0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:14.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.062+0000 7eff15c00640 1 -- 172.21.15.90:0/2123185356 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff10157800 con 0x7eff10074010 2024-09-21T03:15:14.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.062+0000 7eff15200640 1 --2- 172.21.15.90:0/2123185356 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efef4003a50 0x7eff10158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:15:14.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.063+0000 7eff15c00640 1 --2- 172.21.15.90:0/2123185356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff10074010 0x7eff10139710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7eff100c8e90 tx=0x7eff0800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:14.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.063+0000 7eff0d600640 1 -- 172.21.15.90:0/2123185356 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08003d80 con 0x7eff10074010 2024-09-21T03:15:14.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.063+0000 7eff0d600640 1 -- 172.21.15.90:0/2123185356 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff08004b20 con 0x7eff10074010 2024-09-21T03:15:14.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.063+0000 7eff16600640 1 -- 172.21.15.90:0/2123185356 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff101ed6b0 con 0x7eff10074010 2024-09-21T03:15:14.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.063+0000 7eff0d600640 1 -- 172.21.15.90:0/2123185356 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08004050 con 0x7eff10074010 2024-09-21T03:15:14.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.063+0000 7eff16600640 1 -- 172.21.15.90:0/2123185356 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff100c7020 con 0x7eff10074010 2024-09-21T03:15:14.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.064+0000 7eff16600640 1 -- 172.21.15.90:0/2123185356 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff1006fb00 con 0x7eff10074010 2024-09-21T03:15:14.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.065+0000 7eff0d600640 1 -- 172.21.15.90:0/2123185356 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7eff080041f0 con 0x7eff10074010 2024-09-21T03:15:14.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.066+0000 7eff0d600640 1 --2- 172.21.15.90:0/2123185356 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efeec078b90 0x7efeec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:14.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.066+0000 7eff0d600640 1 -- 172.21.15.90:0/2123185356 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7eff0809c170 con 0x7eff10074010 2024-09-21T03:15:14.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.067+0000 7eff15200640 1 --2- 172.21.15.90:0/2123185356 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efeec078b90 0x7efeec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:14.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.067+0000 7eff15200640 1 --2- 172.21.15.90:0/2123185356 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efeec078b90 0x7efeec07b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7eff00033000 tx=0x7eff100c2960 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:14.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.071+0000 7eff0d600640 1 -- 172.21.15.90:0/2123185356 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7eff08064300 con 0x7eff10074010 2024-09-21T03:15:14.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.253+0000 7eff16600640 1 -- 172.21.15.90:0/2123185356 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7eff100c3930 con 0x7eff10074010 2024-09-21T03:15:14.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.254+0000 7eff0d600640 1 -- 172.21.15.90:0/2123185356 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7eff08063c00 con 0x7eff10074010 2024-09-21T03:15:14.256 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-09-21T03:15:14.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.256+0000 7eff16600640 1 -- 172.21.15.90:0/2123185356 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efeec078b90 msgr2=0x7efeec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:14.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.256+0000 7eff16600640 1 --2- 172.21.15.90:0/2123185356 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efeec078b90 0x7efeec07b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7eff00033000 tx=0x7eff100c2960 comp rx=0 tx=0).stop 2024-09-21T03:15:14.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.256+0000 7eff16600640 1 -- 172.21.15.90:0/2123185356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff10074010 msgr2=0x7eff10139710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:14.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.256+0000 7eff16600640 1 --2- 172.21.15.90:0/2123185356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff10074010 0x7eff10139710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7eff100c8e90 tx=0x7eff0800f790 comp rx=0 tx=0).stop 2024-09-21T03:15:14.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.256+0000 7eff16600640 1 -- 172.21.15.90:0/2123185356 shutdown_connections 2024-09-21T03:15:14.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.256+0000 7eff16600640 1 --2- 172.21.15.90:0/2123185356 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efeec078b90 0x7efeec07b0a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:14.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.256+0000 7eff16600640 1 --2- 172.21.15.90:0/2123185356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff10074010 0x7eff10139710 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:14.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.256+0000 7eff16600640 1 --2- 172.21.15.90:0/2123185356 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff10073c00 0x7eff101f0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:14.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.256+0000 7eff16600640 1 --2- 172.21.15.90:0/2123185356 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efef4003a50 0x7eff10158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:14.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.256+0000 7eff16600640 1 -- 172.21.15.90:0/2123185356 >> 172.21.15.90:0/2123185356 conn(0x7eff100c7ec0 msgr2=0x7eff1013c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:14.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.256+0000 7eff16600640 1 -- 172.21.15.90:0/2123185356 shutdown_connections 2024-09-21T03:15:14.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.256+0000 7eff16600640 1 -- 172.21.15.90:0/2123185356 wait complete. 2024-09-21T03:15:14.283 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-09-21T03:15:14.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.505+0000 7f91a2200640 1 -- 172.21.15.90:0/3222336057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f919c1548d0 msgr2=0x7f919c1586c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:14.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.505+0000 7f91a2200640 1 --2- 172.21.15.90:0/3222336057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f919c1548d0 0x7f919c1586c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9184009830 tx=0x7f918402a3f0 comp rx=0 tx=0).stop 2024-09-21T03:15:14.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.505+0000 7f91a2200640 1 -- 172.21.15.90:0/3222336057 shutdown_connections 2024-09-21T03:15:14.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.505+0000 7f91a2200640 1 --2- 172.21.15.90:0/3222336057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f919c1548d0 0x7f919c1586c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:14.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.505+0000 7f91a2200640 1 --2- 172.21.15.90:0/3222336057 >> v2:172.21.15.149:3300/0 conn(0x7f919c06f320 0x7f919c1553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:14.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.505+0000 7f91a2200640 1 -- 172.21.15.90:0/3222336057 >> 172.21.15.90:0/3222336057 conn(0x7f919c0c8490 msgr2=0x7f919c0c88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:14.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.505+0000 7f91a2200640 1 -- 172.21.15.90:0/3222336057 shutdown_connections 2024-09-21T03:15:14.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.506+0000 7f91a2200640 1 -- 172.21.15.90:0/3222336057 wait complete. 2024-09-21T03:15:14.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.508+0000 7f91a2200640 1 Processor -- start 2024-09-21T03:15:14.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.508+0000 7f91a2200640 1 -- start start 2024-09-21T03:15:14.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.509+0000 7f91a2200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f919c06f320 0x7f919c1dedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:14.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.509+0000 7f91a2200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f919c0ad480 0x7f919c1ea8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:14.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.509+0000 7f91a2200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f919c1548d0 0x7f919c0c3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:14.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.509+0000 7f91a2200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f919c158c00 con 0x7f919c06f320 2024-09-21T03:15:14.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.509+0000 7f91a2200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f919c0adfa0 con 0x7f919c1548d0 2024-09-21T03:15:14.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.509+0000 7f91a2200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f919c1eb370 con 0x7f919c0ad480 2024-09-21T03:15:14.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.509+0000 7f91a0e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f919c06f320 0x7f919c1dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:14.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.509+0000 7f91a0e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f919c06f320 0x7f919c1dedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47020/0 (socket says 172.21.15.90:47020) 2024-09-21T03:15:14.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.509+0000 7f91a0e00640 1 -- 172.21.15.90:0/506973918 learned_addr learned my addr 172.21.15.90:0/506973918 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:14.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.509+0000 7f91a1800640 1 --2- 172.21.15.90:0/506973918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f919c1548d0 0x7f919c0c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:14.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.509+0000 7f9193e00640 1 --2- 172.21.15.90:0/506973918 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f919c0ad480 0x7f919c1ea8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:14.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.510+0000 7f91a0e00640 1 -- 172.21.15.90:0/506973918 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f919c0ad480 msgr2=0x7f919c1ea8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:14.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.510+0000 7f91a0e00640 1 --2- 172.21.15.90:0/506973918 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f919c0ad480 0x7f919c1ea8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:14.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.510+0000 7f91a0e00640 1 -- 172.21.15.90:0/506973918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f919c1548d0 msgr2=0x7f919c0c3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:14.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.510+0000 7f91a0e00640 1 --2- 172.21.15.90:0/506973918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f919c1548d0 0x7f919c0c3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:14.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.510+0000 7f91a0e00640 1 -- 172.21.15.90:0/506973918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919c1e0c80 con 0x7f919c06f320 2024-09-21T03:15:14.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.510+0000 7f91a0e00640 1 --2- 172.21.15.90:0/506973918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f919c06f320 0x7f919c1dedb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f918c00e940 tx=0x7f918c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:14.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.510+0000 7f9199600640 1 -- 172.21.15.90:0/506973918 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c00cd80 con 0x7f919c06f320 2024-09-21T03:15:14.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.510+0000 7f9199600640 1 -- 172.21.15.90:0/506973918 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f918c010430 con 0x7f919c06f320 2024-09-21T03:15:14.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.510+0000 7f9199600640 1 -- 172.21.15.90:0/506973918 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c010880 con 0x7f919c06f320 2024-09-21T03:15:14.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.510+0000 7f91a2200640 1 -- 172.21.15.90:0/506973918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f919c145290 con 0x7f919c06f320 2024-09-21T03:15:14.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.510+0000 7f91a2200640 1 -- 172.21.15.90:0/506973918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f919c1eae30 con 0x7f919c06f320 2024-09-21T03:15:14.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.511+0000 7f91a2200640 1 -- 172.21.15.90:0/506973918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f919c0ab1c0 con 0x7f919c06f320 2024-09-21T03:15:14.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.513+0000 7f9199600640 1 -- 172.21.15.90:0/506973918 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f918c01f020 con 0x7f919c06f320 2024-09-21T03:15:14.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.513+0000 7f9199600640 1 --2- 172.21.15.90:0/506973918 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9178078bc0 0x7f917807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:14.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.514+0000 7f9199600640 1 -- 172.21.15.90:0/506973918 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f918c09b5e0 con 0x7f919c06f320 2024-09-21T03:15:14.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.514+0000 7f9193e00640 1 --2- 172.21.15.90:0/506973918 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9178078bc0 0x7f917807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:14.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.515+0000 7f9193e00640 1 --2- 172.21.15.90:0/506973918 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9178078bc0 0x7f917807b0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9184034000 tx=0x7f9184004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:14.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.518+0000 7f9199600640 1 -- 172.21.15.90:0/506973918 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f918c0631c0 con 0x7f919c06f320 2024-09-21T03:15:14.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.713+0000 7f91a2200640 1 -- 172.21.15.90:0/506973918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f919c076d70 con 0x7f919c06f320 2024-09-21T03:15:14.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.713+0000 7f9199600640 1 -- 172.21.15.90:0/506973918 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v26) ==== 99+0+11 (secure 0 0 0) 0x7f918c067bf0 con 0x7f919c06f320 2024-09-21T03:15:14.715 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-09-21T03:15:14.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.716+0000 7f91a2200640 1 -- 172.21.15.90:0/506973918 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9178078bc0 msgr2=0x7f917807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:14.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.716+0000 7f91a2200640 1 --2- 172.21.15.90:0/506973918 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9178078bc0 0x7f917807b0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9184034000 tx=0x7f9184004730 comp rx=0 tx=0).stop 2024-09-21T03:15:14.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.716+0000 7f91a2200640 1 -- 172.21.15.90:0/506973918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f919c06f320 msgr2=0x7f919c1dedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:14.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.716+0000 7f91a2200640 1 --2- 172.21.15.90:0/506973918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f919c06f320 0x7f919c1dedb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f918c00e940 tx=0x7f918c00ee00 comp rx=0 tx=0).stop 2024-09-21T03:15:14.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.716+0000 7f91a2200640 1 -- 172.21.15.90:0/506973918 shutdown_connections 2024-09-21T03:15:14.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.716+0000 7f91a2200640 1 --2- 172.21.15.90:0/506973918 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9178078bc0 0x7f917807b0d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:14.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.716+0000 7f91a2200640 1 --2- 172.21.15.90:0/506973918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f919c1548d0 0x7f919c0c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:14.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.716+0000 7f91a2200640 1 --2- 172.21.15.90:0/506973918 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f919c0ad480 0x7f919c1ea8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:14.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.716+0000 7f91a2200640 1 --2- 172.21.15.90:0/506973918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f919c06f320 0x7f919c1dedb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:14.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.716+0000 7f91a2200640 1 -- 172.21.15.90:0/506973918 >> 172.21.15.90:0/506973918 conn(0x7f919c0c8490 msgr2=0x7f919c146d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:14.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.716+0000 7f91a2200640 1 -- 172.21.15.90:0/506973918 shutdown_connections 2024-09-21T03:15:14.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.716+0000 7f91a2200640 1 -- 172.21.15.90:0/506973918 wait complete. 2024-09-21T03:15:14.739 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-09-21T03:15:14.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.965+0000 7fdc1f200640 1 -- 172.21.15.90:0/3880846386 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbfc0051a0 msgr2=0x7fdbfc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:14.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.965+0000 7fdc1f200640 1 --2- 172.21.15.90:0/3880846386 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbfc0051a0 0x7fdbfc00b9c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdc1000c610 tx=0x7fdbfc005830 comp rx=0 tx=0).stop 2024-09-21T03:15:14.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.965+0000 7fdc1d200640 1 -- 172.21.15.90:0/3880846386 reap_dead start 2024-09-21T03:15:14.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.966+0000 7fdc1f200640 1 -- 172.21.15.90:0/3880846386 shutdown_connections 2024-09-21T03:15:14.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.966+0000 7fdc1f200640 1 -- 172.21.15.90:0/3880846386 >> 172.21.15.90:0/3880846386 conn(0x7fdc180c85a0 msgr2=0x7fdc180c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:14.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.966+0000 7fdc1f200640 1 -- 172.21.15.90:0/3880846386 shutdown_connections 2024-09-21T03:15:14.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.966+0000 7fdc1f200640 1 -- 172.21.15.90:0/3880846386 wait complete. 2024-09-21T03:15:14.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.968+0000 7fdc1f200640 1 Processor -- start 2024-09-21T03:15:14.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.968+0000 7fdc1f200640 1 -- start start 2024-09-21T03:15:14.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.970+0000 7fdc1f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbfc0051a0 0x7fdc18152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:14.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.970+0000 7fdc1f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc181f0ac0 0x7fdc1814f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:14.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.970+0000 7fdc1f200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc181e0a30 0x7fdc181dcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:14.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.970+0000 7fdc1f200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdc18157c30 con 0x7fdc181e0a30 2024-09-21T03:15:14.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.970+0000 7fdc1f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdc18157ab0 con 0x7fdc181f0ac0 2024-09-21T03:15:14.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.970+0000 7fdc1f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdc180ad250 con 0x7fdbfc0051a0 2024-09-21T03:15:14.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.970+0000 7fdc1d200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc181e0a30 0x7fdc181dcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:14.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.970+0000 7fdc1d200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc181e0a30 0x7fdc181dcfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47562/0 (socket says 172.21.15.90:47562) 2024-09-21T03:15:14.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.970+0000 7fdc1d200640 1 -- 172.21.15.90:0/1147782317 learned_addr learned my addr 172.21.15.90:0/1147782317 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:14.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.970+0000 7fdc17e00640 1 --2- 172.21.15.90:0/1147782317 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbfc0051a0 0x7fdc18152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:14.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.970+0000 7fdc1d200640 1 -- 172.21.15.90:0/1147782317 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbfc0051a0 msgr2=0x7fdc18152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:14.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.970+0000 7fdc17400640 1 --2- 172.21.15.90:0/1147782317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc181f0ac0 0x7fdc1814f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:14.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.971+0000 7fdc1d200640 1 --2- 172.21.15.90:0/1147782317 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbfc0051a0 0x7fdc18152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:14.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.971+0000 7fdc1d200640 1 -- 172.21.15.90:0/1147782317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc181f0ac0 msgr2=0x7fdc1814f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:14.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.971+0000 7fdc1d200640 1 --2- 172.21.15.90:0/1147782317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc181f0ac0 0x7fdc1814f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:14.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.971+0000 7fdc1d200640 1 -- 172.21.15.90:0/1147782317 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc18148bd0 con 0x7fdc181e0a30 2024-09-21T03:15:14.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.971+0000 7fdc17e00640 1 --2- 172.21.15.90:0/1147782317 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbfc0051a0 0x7fdc18152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:15:14.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.971+0000 7fdc17400640 1 --2- 172.21.15.90:0/1147782317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc181f0ac0 0x7fdc1814f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:15:14.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.971+0000 7fdc1d200640 1 --2- 172.21.15.90:0/1147782317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc181e0a30 0x7fdc181dcfe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdc1000c700 tx=0x7fdc10001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:14.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.971+0000 7fdc0fe00640 1 -- 172.21.15.90:0/1147782317 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc10039070 con 0x7fdc181e0a30 2024-09-21T03:15:14.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.971+0000 7fdc0fe00640 1 -- 172.21.15.90:0/1147782317 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc1002ba90 con 0x7fdc181e0a30 2024-09-21T03:15:14.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.971+0000 7fdc1f200640 1 -- 172.21.15.90:0/1147782317 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc18148f40 con 0x7fdc181e0a30 2024-09-21T03:15:14.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.971+0000 7fdc0fe00640 1 -- 172.21.15.90:0/1147782317 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc10002030 con 0x7fdc181e0a30 2024-09-21T03:15:14.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.972+0000 7fdc1f200640 1 -- 172.21.15.90:0/1147782317 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc181f02c0 con 0x7fdc181e0a30 2024-09-21T03:15:14.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.973+0000 7fdc1f200640 1 -- 172.21.15.90:0/1147782317 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc180c2760 con 0x7fdc181e0a30 2024-09-21T03:15:14.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.974+0000 7fdc0fe00640 1 -- 172.21.15.90:0/1147782317 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdc10034680 con 0x7fdc181e0a30 2024-09-21T03:15:14.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.975+0000 7fdc0fe00640 1 --2- 172.21.15.90:0/1147782317 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdbf8078b90 0x7fdbf807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:14.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.976+0000 7fdc0fe00640 1 -- 172.21.15.90:0/1147782317 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fdc100baee0 con 0x7fdc181e0a30 2024-09-21T03:15:14.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.976+0000 7fdc17e00640 1 --2- 172.21.15.90:0/1147782317 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdbf8078b90 0x7fdbf807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:14.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.976+0000 7fdc17e00640 1 --2- 172.21.15.90:0/1147782317 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdbf8078b90 0x7fdbf807b0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdc180725b0 tx=0x7fdc08005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:14.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:14.980+0000 7fdc0fe00640 1 -- 172.21.15.90:0/1147782317 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdc180c2760 con 0x7fdc181e0a30 2024-09-21T03:15:15.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.166+0000 7fdc1f200640 1 -- 172.21.15.90:0/1147782317 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7fdc18073d30 con 0x7fdc181e0a30 2024-09-21T03:15:15.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.167+0000 7fdc0fe00640 1 -- 172.21.15.90:0/1147782317 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v26) ==== 95+0+11 (secure 0 0 0) 0x7fdc10082f60 con 0x7fdc181e0a30 2024-09-21T03:15:15.169 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-09-21T03:15:15.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.169+0000 7fdc1f200640 1 -- 172.21.15.90:0/1147782317 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdbf8078b90 msgr2=0x7fdbf807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:15.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.169+0000 7fdc1f200640 1 --2- 172.21.15.90:0/1147782317 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdbf8078b90 0x7fdbf807b0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdc180725b0 tx=0x7fdc08005f90 comp rx=0 tx=0).stop 2024-09-21T03:15:15.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.169+0000 7fdc1f200640 1 -- 172.21.15.90:0/1147782317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc181e0a30 msgr2=0x7fdc181dcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:15.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.169+0000 7fdc1f200640 1 --2- 172.21.15.90:0/1147782317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc181e0a30 0x7fdc181dcfe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdc1000c700 tx=0x7fdc10001aa0 comp rx=0 tx=0).stop 2024-09-21T03:15:15.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.169+0000 7fdc1f200640 1 -- 172.21.15.90:0/1147782317 shutdown_connections 2024-09-21T03:15:15.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.169+0000 7fdc1f200640 1 --2- 172.21.15.90:0/1147782317 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdbf8078b90 0x7fdbf807b0a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:15.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.169+0000 7fdc1f200640 1 --2- 172.21.15.90:0/1147782317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc181e0a30 0x7fdc181dcfe0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:15.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.169+0000 7fdc1f200640 1 --2- 172.21.15.90:0/1147782317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc181f0ac0 0x7fdc1814f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:15.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.169+0000 7fdc1f200640 1 --2- 172.21.15.90:0/1147782317 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbfc0051a0 0x7fdc18152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:15.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.169+0000 7fdc1f200640 1 -- 172.21.15.90:0/1147782317 >> 172.21.15.90:0/1147782317 conn(0x7fdc180c85a0 msgr2=0x7fdc18149ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:15.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.169+0000 7fdc1f200640 1 -- 172.21.15.90:0/1147782317 shutdown_connections 2024-09-21T03:15:15.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.169+0000 7fdc1f200640 1 -- 172.21.15.90:0/1147782317 wait complete. 2024-09-21T03:15:15.192 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-09-21T03:15:15.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.413+0000 7fd9bc400640 1 -- 172.21.15.90:0/3464234489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9b4150d30 msgr2=0x7fd9b4151140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:15.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.413+0000 7fd9bc400640 1 --2- 172.21.15.90:0/3464234489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9b4150d30 0x7fd9b4151140 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009830 tx=0x7fd9a002a3f0 comp rx=0 tx=0).stop 2024-09-21T03:15:15.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.413+0000 7fd9bc400640 1 -- 172.21.15.90:0/3464234489 shutdown_connections 2024-09-21T03:15:15.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.413+0000 7fd9bc400640 1 --2- 172.21.15.90:0/3464234489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9b4150d30 0x7fd9b4151140 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:15.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.413+0000 7fd9bc400640 1 -- 172.21.15.90:0/3464234489 >> 172.21.15.90:0/3464234489 conn(0x7fd9b406e2e0 msgr2=0x7fd9b406e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:15.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.413+0000 7fd9bc400640 1 -- 172.21.15.90:0/3464234489 shutdown_connections 2024-09-21T03:15:15.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.414+0000 7fd9bc400640 1 -- 172.21.15.90:0/3464234489 wait complete. 2024-09-21T03:15:15.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.416+0000 7fd9bc400640 1 Processor -- start 2024-09-21T03:15:15.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.416+0000 7fd9bc400640 1 -- start start 2024-09-21T03:15:15.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.417+0000 7fd9bc400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9b40708e0 0x7fd9b414f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:15.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.417+0000 7fd9bc400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9b4074720 0x7fd9b41de8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:15.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.417+0000 7fd9bc400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9b4150d30 0x7fd9b41425d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:15.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.417+0000 7fd9bc400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b4071cf0 con 0x7fd9b4150d30 2024-09-21T03:15:15.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.417+0000 7fd9bc400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b4154230 con 0x7fd9b4074720 2024-09-21T03:15:15.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.417+0000 7fd9bc400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd9b4153920 con 0x7fd9b40708e0 2024-09-21T03:15:15.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.417+0000 7fd9ba400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9b4150d30 0x7fd9b41425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:15.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.417+0000 7fd9ba400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9b4150d30 0x7fd9b41425d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47580/0 (socket says 172.21.15.90:47580) 2024-09-21T03:15:15.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.417+0000 7fd9ba400640 1 -- 172.21.15.90:0/1902480369 learned_addr learned my addr 172.21.15.90:0/1902480369 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:15.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.418+0000 7fd9b9000640 1 --2- 172.21.15.90:0/1902480369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9b4074720 0x7fd9b41de8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:15.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.418+0000 7fd9b9a00640 1 --2- 172.21.15.90:0/1902480369 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9b40708e0 0x7fd9b414f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:15.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.418+0000 7fd9ba400640 1 -- 172.21.15.90:0/1902480369 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9b40708e0 msgr2=0x7fd9b414f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:15.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.418+0000 7fd9ba400640 1 --2- 172.21.15.90:0/1902480369 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9b40708e0 0x7fd9b414f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:15.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.418+0000 7fd9ba400640 1 -- 172.21.15.90:0/1902480369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9b4074720 msgr2=0x7fd9b41de8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:15.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.418+0000 7fd9ba400640 1 --2- 172.21.15.90:0/1902480369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9b4074720 0x7fd9b41de8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:15.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.418+0000 7fd9ba400640 1 -- 172.21.15.90:0/1902480369 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b41dfd80 con 0x7fd9b4150d30 2024-09-21T03:15:15.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.418+0000 7fd9b9a00640 1 --2- 172.21.15.90:0/1902480369 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9b40708e0 0x7fd9b414f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:15:15.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.418+0000 7fd9ba400640 1 --2- 172.21.15.90:0/1902480369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9b4150d30 0x7fd9b41425d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00cb40 tx=0x7fd9ac00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:15.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.418+0000 7fd9b1600640 1 -- 172.21.15.90:0/1902480369 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac016020 con 0x7fd9b4150d30 2024-09-21T03:15:15.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.418+0000 7fd9b1600640 1 -- 172.21.15.90:0/1902480369 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9ac00ad30 con 0x7fd9b4150d30 2024-09-21T03:15:15.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.418+0000 7fd9bc400640 1 -- 172.21.15.90:0/1902480369 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9b41432a0 con 0x7fd9b4150d30 2024-09-21T03:15:15.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.418+0000 7fd9b1600640 1 -- 172.21.15.90:0/1902480369 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac012680 con 0x7fd9b4150d30 2024-09-21T03:15:15.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.418+0000 7fd9bc400640 1 -- 172.21.15.90:0/1902480369 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9b4157d10 con 0x7fd9b4150d30 2024-09-21T03:15:15.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.419+0000 7fd9bc400640 1 -- 172.21.15.90:0/1902480369 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9b41dff50 con 0x7fd9b4150d30 2024-09-21T03:15:15.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.420+0000 7fd9b1600640 1 -- 172.21.15.90:0/1902480369 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd9ac019020 con 0x7fd9b4150d30 2024-09-21T03:15:15.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.421+0000 7fd9b1600640 1 --2- 172.21.15.90:0/1902480369 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd994078b90 0x7fd99407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:15.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.422+0000 7fd9b1600640 1 -- 172.21.15.90:0/1902480369 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fd9ac09b400 con 0x7fd9b4150d30 2024-09-21T03:15:15.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.422+0000 7fd9b9a00640 1 --2- 172.21.15.90:0/1902480369 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd994078b90 0x7fd99407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:15.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.423+0000 7fd9b9a00640 1 --2- 172.21.15.90:0/1902480369 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd994078b90 0x7fd99407b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd9a800a810 tx=0x7fd9a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:15.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.426+0000 7fd9b1600640 1 -- 172.21.15.90:0/1902480369 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd9ac020030 con 0x7fd9b4150d30 2024-09-21T03:15:15.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.611+0000 7fd9bc400640 1 -- 172.21.15.90:0/1902480369 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7fd9b41547a0 con 0x7fd9b4150d30 2024-09-21T03:15:15.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.612+0000 7fd9b1600640 1 -- 172.21.15.90:0/1902480369 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v26) ==== 99+0+11 (secure 0 0 0) 0x7fd9ac063500 con 0x7fd9b4150d30 2024-09-21T03:15:15.614 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-09-21T03:15:15.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.614+0000 7fd9bc400640 1 -- 172.21.15.90:0/1902480369 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd994078b90 msgr2=0x7fd99407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:15.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.614+0000 7fd9bc400640 1 --2- 172.21.15.90:0/1902480369 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd994078b90 0x7fd99407b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd9a800a810 tx=0x7fd9a8008040 comp rx=0 tx=0).stop 2024-09-21T03:15:15.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.614+0000 7fd9bc400640 1 -- 172.21.15.90:0/1902480369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9b4150d30 msgr2=0x7fd9b41425d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:15.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.614+0000 7fd9bc400640 1 --2- 172.21.15.90:0/1902480369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9b4150d30 0x7fd9b41425d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00cb40 tx=0x7fd9ac00a060 comp rx=0 tx=0).stop 2024-09-21T03:15:15.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.614+0000 7fd9bc400640 1 -- 172.21.15.90:0/1902480369 shutdown_connections 2024-09-21T03:15:15.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.614+0000 7fd9bc400640 1 --2- 172.21.15.90:0/1902480369 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd994078b90 0x7fd99407b0a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:15.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.614+0000 7fd9bc400640 1 --2- 172.21.15.90:0/1902480369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9b4150d30 0x7fd9b41425d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:15.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.614+0000 7fd9bc400640 1 --2- 172.21.15.90:0/1902480369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9b4074720 0x7fd9b41de8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:15.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.614+0000 7fd9bc400640 1 --2- 172.21.15.90:0/1902480369 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9b40708e0 0x7fd9b414f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:15.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.614+0000 7fd9bc400640 1 -- 172.21.15.90:0/1902480369 >> 172.21.15.90:0/1902480369 conn(0x7fd9b406e2e0 msgr2=0x7fd9b406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:15.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.614+0000 7fd9bc400640 1 -- 172.21.15.90:0/1902480369 shutdown_connections 2024-09-21T03:15:15.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.614+0000 7fd9bc400640 1 -- 172.21.15.90:0/1902480369 wait complete. 2024-09-21T03:15:15.638 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-09-21T03:15:15.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.867+0000 7fcc8a000640 1 -- 172.21.15.90:0/3412143556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc84074ae0 msgr2=0x7fcc84073040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:15.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.867+0000 7fcc8a000640 1 --2- 172.21.15.90:0/3412143556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc84074ae0 0x7fcc84073040 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcc840725b0 tx=0x7fcc6c02a4d0 comp rx=0 tx=0).stop 2024-09-21T03:15:15.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.867+0000 7fcc8a000640 1 -- 172.21.15.90:0/3412143556 shutdown_connections 2024-09-21T03:15:15.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.867+0000 7fcc8a000640 1 --2- 172.21.15.90:0/3412143556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc84074ae0 0x7fcc84073040 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:15.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.867+0000 7fcc8a000640 1 --2- 172.21.15.90:0/3412143556 >> v2:172.21.15.149:3300/0 conn(0x7fcc840740e0 0x7fcc84152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:15.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.867+0000 7fcc8a000640 1 -- 172.21.15.90:0/3412143556 >> 172.21.15.90:0/3412143556 conn(0x7fcc840c85a0 msgr2=0x7fcc840c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:15.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.867+0000 7fcc8a000640 1 -- 172.21.15.90:0/3412143556 shutdown_connections 2024-09-21T03:15:15.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.867+0000 7fcc8a000640 1 -- 172.21.15.90:0/3412143556 wait complete. 2024-09-21T03:15:15.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.869+0000 7fcc8a000640 1 Processor -- start 2024-09-21T03:15:15.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.869+0000 7fcc8a000640 1 -- start start 2024-09-21T03:15:15.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.870+0000 7fcc8a000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc84073580 0x7fcc841efb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:15.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.870+0000 7fcc8a000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc84074ae0 0x7fcc8414bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:15.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.870+0000 7fcc8a000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc84151730 0x7fcc84149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:15.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.871+0000 7fcc8a000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcc841554c0 con 0x7fcc84074ae0 2024-09-21T03:15:15.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.871+0000 7fcc8a000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcc84155340 con 0x7fcc84073580 2024-09-21T03:15:15.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.871+0000 7fcc8a000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcc84155640 con 0x7fcc84151730 2024-09-21T03:15:15.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.871+0000 7fcc7aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc84074ae0 0x7fcc8414bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:15.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.871+0000 7fcc7aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc84074ae0 0x7fcc8414bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47592/0 (socket says 172.21.15.90:47592) 2024-09-21T03:15:15.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.871+0000 7fcc7aa00640 1 -- 172.21.15.90:0/4117587836 learned_addr learned my addr 172.21.15.90:0/4117587836 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:15.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.871+0000 7fcc83400640 1 --2- 172.21.15.90:0/4117587836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc84073580 0x7fcc841efb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:15.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.871+0000 7fcc83e00640 1 --2- 172.21.15.90:0/4117587836 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc84151730 0x7fcc84149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:15.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.871+0000 7fcc7aa00640 1 -- 172.21.15.90:0/4117587836 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc84151730 msgr2=0x7fcc84149a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:15.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.871+0000 7fcc7aa00640 1 --2- 172.21.15.90:0/4117587836 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc84151730 0x7fcc84149a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:15.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.871+0000 7fcc7aa00640 1 -- 172.21.15.90:0/4117587836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc84073580 msgr2=0x7fcc841efb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:15.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.871+0000 7fcc7aa00640 1 --2- 172.21.15.90:0/4117587836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc84073580 0x7fcc841efb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:15.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.871+0000 7fcc7aa00640 1 -- 172.21.15.90:0/4117587836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc841f0040 con 0x7fcc84074ae0 2024-09-21T03:15:15.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.872+0000 7fcc7aa00640 1 --2- 172.21.15.90:0/4117587836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc84074ae0 0x7fcc8414bf70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c000c00 tx=0x7fcc6c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:15.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.872+0000 7fcc7be00640 1 -- 172.21.15.90:0/4117587836 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c03e030 con 0x7fcc84074ae0 2024-09-21T03:15:15.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.872+0000 7fcc7be00640 1 -- 172.21.15.90:0/4117587836 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc6c003e00 con 0x7fcc84074ae0 2024-09-21T03:15:15.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.872+0000 7fcc7be00640 1 -- 172.21.15.90:0/4117587836 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c035040 con 0x7fcc84074ae0 2024-09-21T03:15:15.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.872+0000 7fcc8a000640 1 -- 172.21.15.90:0/4117587836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc84070860 con 0x7fcc84074ae0 2024-09-21T03:15:15.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.872+0000 7fcc8a000640 1 -- 172.21.15.90:0/4117587836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc840702a0 con 0x7fcc84074ae0 2024-09-21T03:15:15.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.873+0000 7fcc8a000640 1 -- 172.21.15.90:0/4117587836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc840740e0 con 0x7fcc84074ae0 2024-09-21T03:15:15.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.874+0000 7fcc7be00640 1 -- 172.21.15.90:0/4117587836 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc6c041030 con 0x7fcc84074ae0 2024-09-21T03:15:15.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.876+0000 7fcc7be00640 1 --2- 172.21.15.90:0/4117587836 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc60078bc0 0x7fcc6007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:15.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.876+0000 7fcc7be00640 1 -- 172.21.15.90:0/4117587836 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fcc6c0bb780 con 0x7fcc84074ae0 2024-09-21T03:15:15.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.876+0000 7fcc83400640 1 --2- 172.21.15.90:0/4117587836 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc60078bc0 0x7fcc6007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:15.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.877+0000 7fcc83400640 1 --2- 172.21.15.90:0/4117587836 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc60078bc0 0x7fcc6007b0d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcc74004630 tx=0x7fcc7400b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:15.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:15.880+0000 7fcc7be00640 1 -- 172.21.15.90:0/4117587836 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcc6c0831a0 con 0x7fcc84074ae0 2024-09-21T03:15:16.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.074+0000 7fcc8a000640 1 -- 172.21.15.90:0/4117587836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7fcc8406a2e0 con 0x7fcc84074ae0 2024-09-21T03:15:16.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.074+0000 7fcc7be00640 1 -- 172.21.15.90:0/4117587836 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v27) ==== 95+0+11 (secure 0 0 0) 0x7fcc6c087bd0 con 0x7fcc84074ae0 2024-09-21T03:15:16.076 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-09-21T03:15:16.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.077+0000 7fcc8a000640 1 -- 172.21.15.90:0/4117587836 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc60078bc0 msgr2=0x7fcc6007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:16.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.077+0000 7fcc8a000640 1 --2- 172.21.15.90:0/4117587836 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc60078bc0 0x7fcc6007b0d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcc74004630 tx=0x7fcc7400b2e0 comp rx=0 tx=0).stop 2024-09-21T03:15:16.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.077+0000 7fcc8a000640 1 -- 172.21.15.90:0/4117587836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc84074ae0 msgr2=0x7fcc8414bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:16.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.077+0000 7fcc8a000640 1 --2- 172.21.15.90:0/4117587836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc84074ae0 0x7fcc8414bf70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c000c00 tx=0x7fcc6c003910 comp rx=0 tx=0).stop 2024-09-21T03:15:16.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.077+0000 7fcc8a000640 1 -- 172.21.15.90:0/4117587836 shutdown_connections 2024-09-21T03:15:16.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.077+0000 7fcc8a000640 1 --2- 172.21.15.90:0/4117587836 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc60078bc0 0x7fcc6007b0d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:16.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.077+0000 7fcc8a000640 1 --2- 172.21.15.90:0/4117587836 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc84151730 0x7fcc84149a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:16.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.077+0000 7fcc8a000640 1 --2- 172.21.15.90:0/4117587836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc84074ae0 0x7fcc8414bf70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:16.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.077+0000 7fcc8a000640 1 --2- 172.21.15.90:0/4117587836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc84073580 0x7fcc841efb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:16.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.077+0000 7fcc8a000640 1 -- 172.21.15.90:0/4117587836 >> 172.21.15.90:0/4117587836 conn(0x7fcc840c85a0 msgr2=0x7fcc840c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:16.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.077+0000 7fcc8a000640 1 -- 172.21.15.90:0/4117587836 shutdown_connections 2024-09-21T03:15:16.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.077+0000 7fcc8a000640 1 -- 172.21.15.90:0/4117587836 wait complete. 2024-09-21T03:15:16.100 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-09-21T03:15:16.100 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:15:16.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.317+0000 7fc356400640 1 -- 172.21.15.90:0/253004407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc35014b810 msgr2=0x7fc3500c69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:16.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.317+0000 7fc356400640 1 --2- 172.21.15.90:0/253004407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc35014b810 0x7fc3500c69f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc350155620 tx=0x7fc33802a410 comp rx=0 tx=0).stop 2024-09-21T03:15:16.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.317+0000 7fc356400640 1 -- 172.21.15.90:0/253004407 shutdown_connections 2024-09-21T03:15:16.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.317+0000 7fc356400640 1 --2- 172.21.15.90:0/253004407 >> v2:172.21.15.149:3300/0 conn(0x7fc3500c6f30 0x7fc3500c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:16.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.317+0000 7fc356400640 1 --2- 172.21.15.90:0/253004407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc35014b810 0x7fc3500c69f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:16.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.317+0000 7fc356400640 1 -- 172.21.15.90:0/253004407 >> 172.21.15.90:0/253004407 conn(0x7fc35006d410 msgr2=0x7fc3500ac020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:16.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.317+0000 7fc356400640 1 -- 172.21.15.90:0/253004407 shutdown_connections 2024-09-21T03:15:16.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.317+0000 7fc356400640 1 -- 172.21.15.90:0/253004407 wait complete. 2024-09-21T03:15:16.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.319+0000 7fc356400640 1 Processor -- start 2024-09-21T03:15:16.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.319+0000 7fc356400640 1 -- start start 2024-09-21T03:15:16.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.321+0000 7fc356400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc350072880 0x7fc350158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:16.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.321+0000 7fc356400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3500c6f30 0x7fc35014bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:16.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.321+0000 7fc356400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc35014b810 0x7fc35014d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:16.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.321+0000 7fc356400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc350072c90 con 0x7fc350072880 2024-09-21T03:15:16.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.321+0000 7fc356400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc350155930 con 0x7fc3500c6f30 2024-09-21T03:15:16.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.321+0000 7fc356400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc3501584d0 con 0x7fc35014b810 2024-09-21T03:15:16.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.321+0000 7fc34f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc350072880 0x7fc350158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:16.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.321+0000 7fc34f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc350072880 0x7fc350158990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47604/0 (socket says 172.21.15.90:47604) 2024-09-21T03:15:16.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.321+0000 7fc34f400640 1 -- 172.21.15.90:0/4154020191 learned_addr learned my addr 172.21.15.90:0/4154020191 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:16.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.321+0000 7fc34f400640 1 -- 172.21.15.90:0/4154020191 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc35014b810 msgr2=0x7fc35014d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:16.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.321+0000 7fc34f400640 1 --2- 172.21.15.90:0/4154020191 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc35014b810 0x7fc35014d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:16.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.321+0000 7fc34f400640 1 -- 172.21.15.90:0/4154020191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3500c6f30 msgr2=0x7fc35014bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:16.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.321+0000 7fc34f400640 1 --2- 172.21.15.90:0/4154020191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3500c6f30 0x7fc35014bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:16.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.321+0000 7fc34f400640 1 -- 172.21.15.90:0/4154020191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35014e370 con 0x7fc350072880 2024-09-21T03:15:16.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.322+0000 7fc34f400640 1 --2- 172.21.15.90:0/4154020191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc350072880 0x7fc350158990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc34000c390 tx=0x7fc34000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:16.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.322+0000 7fc347e00640 1 -- 172.21.15.90:0/4154020191 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc340017070 con 0x7fc350072880 2024-09-21T03:15:16.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.322+0000 7fc347e00640 1 -- 172.21.15.90:0/4154020191 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3400035f0 con 0x7fc350072880 2024-09-21T03:15:16.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.322+0000 7fc356400640 1 -- 172.21.15.90:0/4154020191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35014e5e0 con 0x7fc350072880 2024-09-21T03:15:16.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.322+0000 7fc347e00640 1 -- 172.21.15.90:0/4154020191 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc340003a20 con 0x7fc350072880 2024-09-21T03:15:16.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.322+0000 7fc356400640 1 -- 172.21.15.90:0/4154020191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc350157f50 con 0x7fc350072880 2024-09-21T03:15:16.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.323+0000 7fc356400640 1 -- 172.21.15.90:0/4154020191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3500c74d0 con 0x7fc350072880 2024-09-21T03:15:16.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.324+0000 7fc347e00640 1 -- 172.21.15.90:0/4154020191 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc34001a070 con 0x7fc350072880 2024-09-21T03:15:16.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.325+0000 7fc347e00640 1 --2- 172.21.15.90:0/4154020191 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc32c078b90 0x7fc32c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:16.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.325+0000 7fc347e00640 1 -- 172.21.15.90:0/4154020191 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fc34009a2b0 con 0x7fc350072880 2024-09-21T03:15:16.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.326+0000 7fc346a00640 1 --2- 172.21.15.90:0/4154020191 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc32c078b90 0x7fc32c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:16.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.326+0000 7fc346a00640 1 --2- 172.21.15.90:0/4154020191 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc32c078b90 0x7fc32c07b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc338034000 tx=0x7fc3380046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:16.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.330+0000 7fc347e00640 1 -- 172.21.15.90:0/4154020191 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc340062450 con 0x7fc350072880 2024-09-21T03:15:16.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.512+0000 7fc356400640 1 -- 172.21.15.90:0/4154020191 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc350072e10 con 0x7fc32c078b90 2024-09-21T03:15:16.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.522+0000 7fc347e00640 1 -- 172.21.15.90:0/4154020191 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490343 (secure 0 0 0) 0x7fc350072e10 con 0x7fc32c078b90 2024-09-21T03:15:16.529 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:15:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-21T03:15:16.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.527+0000 7fc356400640 1 -- 172.21.15.90:0/4154020191 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc32c078b90 msgr2=0x7fc32c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:16.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.527+0000 7fc356400640 1 --2- 172.21.15.90:0/4154020191 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc32c078b90 0x7fc32c07b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc338034000 tx=0x7fc3380046c0 comp rx=0 tx=0).stop 2024-09-21T03:15:16.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.527+0000 7fc356400640 1 -- 172.21.15.90:0/4154020191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc350072880 msgr2=0x7fc350158990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:16.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.527+0000 7fc356400640 1 --2- 172.21.15.90:0/4154020191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc350072880 0x7fc350158990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc34000c390 tx=0x7fc34000c850 comp rx=0 tx=0).stop 2024-09-21T03:15:16.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.527+0000 7fc356400640 1 -- 172.21.15.90:0/4154020191 shutdown_connections 2024-09-21T03:15:16.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.527+0000 7fc356400640 1 --2- 172.21.15.90:0/4154020191 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc32c078b90 0x7fc32c07b0a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:16.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.527+0000 7fc356400640 1 --2- 172.21.15.90:0/4154020191 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc35014b810 0x7fc35014d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:16.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.527+0000 7fc356400640 1 --2- 172.21.15.90:0/4154020191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3500c6f30 0x7fc35014bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:16.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.527+0000 7fc356400640 1 --2- 172.21.15.90:0/4154020191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc350072880 0x7fc350158990 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:16.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.527+0000 7fc356400640 1 -- 172.21.15.90:0/4154020191 >> 172.21.15.90:0/4154020191 conn(0x7fc35006d410 msgr2=0x7fc3500af120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:16.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.528+0000 7fc356400640 1 -- 172.21.15.90:0/4154020191 shutdown_connections 2024-09-21T03:15:16.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.528+0000 7fc356400640 1 -- 172.21.15.90:0/4154020191 wait complete. 2024-09-21T03:15:16.551 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-09-21T03:15:16.484995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597680,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":197,"num_write_kb":1662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219616,"kb_used_data":3388,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755104,"statfs":{"total":773094113280,"available":772869226496,"internally_reserved":0,"allocated":3469312,"data_stored":2048508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2492,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002429"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804323+0000","last_change":"2024-09-21T03:14:47.552762+0000","last_active":"2024-09-21T03:15:15.804323+0000","last_peered":"2024-09-21T03:15:15.804323+0000","last_clean":"2024-09-21T03:15:15.804323+0000","last_became_active":"2024-09-21T03:14:47.551883+0000","last_became_peered":"2024-09-21T03:14:47.551883+0000","last_unstale":"2024-09-21T03:15:15.804323+0000","last_undegraded":"2024-09-21T03:15:15.804323+0000","last_fullsized":"2024-09-21T03:15:15.804323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:51.935797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806503+0000","last_change":"2024-09-21T03:14:37.471004+0000","last_active":"2024-09-21T03:15:15.806503+0000","last_peered":"2024-09-21T03:15:15.806503+0000","last_clean":"2024-09-21T03:15:15.806503+0000","last_became_active":"2024-09-21T03:14:37.470563+0000","last_became_peered":"2024-09-21T03:14:37.470563+0000","last_unstale":"2024-09-21T03:15:15.806503+0000","last_undegraded":"2024-09-21T03:15:15.806503+0000","last_fullsized":"2024-09-21T03:15:15.806503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.422826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680312+0000","last_change":"2024-09-21T03:14:38.496252+0000","last_active":"2024-09-21T03:15:15.680312+0000","last_peered":"2024-09-21T03:15:15.680312+0000","last_clean":"2024-09-21T03:15:15.680312+0000","last_became_active":"2024-09-21T03:14:38.488292+0000","last_became_peered":"2024-09-21T03:14:38.488292+0000","last_unstale":"2024-09-21T03:15:15.680312+0000","last_undegraded":"2024-09-21T03:15:15.680312+0000","last_fullsized":"2024-09-21T03:15:15.680312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:57.409792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683500+0000","last_change":"2024-09-21T03:14:46.549877+0000","last_active":"2024-09-21T03:15:15.683500+0000","last_peered":"2024-09-21T03:15:15.683500+0000","last_clean":"2024-09-21T03:15:15.683500+0000","last_became_active":"2024-09-21T03:14:46.549536+0000","last_became_peered":"2024-09-21T03:14:46.549536+0000","last_unstale":"2024-09-21T03:15:15.683500+0000","last_undegraded":"2024-09-21T03:15:15.683500+0000","last_fullsized":"2024-09-21T03:15:15.683500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:57.491042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804846+0000","last_change":"2024-09-21T03:14:47.560303+0000","last_active":"2024-09-21T03:15:15.804846+0000","last_peered":"2024-09-21T03:15:15.804846+0000","last_clean":"2024-09-21T03:15:15.804846+0000","last_became_active":"2024-09-21T03:14:47.559659+0000","last_became_peered":"2024-09-21T03:14:47.559659+0000","last_unstale":"2024-09-21T03:15:15.804846+0000","last_undegraded":"2024-09-21T03:15:15.804846+0000","last_fullsized":"2024-09-21T03:15:15.804846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:49.328036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680553+0000","last_change":"2024-09-21T03:14:37.467448+0000","last_active":"2024-09-21T03:15:15.680553+0000","last_peered":"2024-09-21T03:15:15.680553+0000","last_clean":"2024-09-21T03:15:15.680553+0000","last_became_active":"2024-09-21T03:14:37.467146+0000","last_became_peered":"2024-09-21T03:14:37.467146+0000","last_unstale":"2024-09-21T03:15:15.680553+0000","last_undegraded":"2024-09-21T03:15:15.680553+0000","last_fullsized":"2024-09-21T03:15:15.680553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:53.475083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681362+0000","last_change":"2024-09-21T03:14:38.486401+0000","last_active":"2024-09-21T03:15:15.681362+0000","last_peered":"2024-09-21T03:15:15.681362+0000","last_clean":"2024-09-21T03:15:15.681362+0000","last_became_active":"2024-09-21T03:14:38.486090+0000","last_became_peered":"2024-09-21T03:14:38.486090+0000","last_unstale":"2024-09-21T03:15:15.681362+0000","last_undegraded":"2024-09-21T03:15:15.681362+0000","last_fullsized":"2024-09-21T03:15:15.681362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:44.085100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677377+0000","last_change":"2024-09-21T03:14:46.541705+0000","last_active":"2024-09-21T03:15:15.677377+0000","last_peered":"2024-09-21T03:15:15.677377+0000","last_clean":"2024-09-21T03:15:15.677377+0000","last_became_active":"2024-09-21T03:14:46.541357+0000","last_became_peered":"2024-09-21T03:14:46.541357+0000","last_unstale":"2024-09-21T03:15:15.677377+0000","last_undegraded":"2024-09-21T03:15:15.677377+0000","last_fullsized":"2024-09-21T03:15:15.677377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:31.082059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804443+0000","last_change":"2024-09-21T03:14:47.556183+0000","last_active":"2024-09-21T03:15:15.804443+0000","last_peered":"2024-09-21T03:15:15.804443+0000","last_clean":"2024-09-21T03:15:15.804443+0000","last_became_active":"2024-09-21T03:14:47.553312+0000","last_became_peered":"2024-09-21T03:14:47.553312+0000","last_unstale":"2024-09-21T03:15:15.804443+0000","last_undegraded":"2024-09-21T03:15:15.804443+0000","last_fullsized":"2024-09-21T03:15:15.804443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:07.314491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681355+0000","last_change":"2024-09-21T03:14:37.478711+0000","last_active":"2024-09-21T03:15:15.681355+0000","last_peered":"2024-09-21T03:15:15.681355+0000","last_clean":"2024-09-21T03:15:15.681355+0000","last_became_active":"2024-09-21T03:14:37.477910+0000","last_became_peered":"2024-09-21T03:14:37.477910+0000","last_unstale":"2024-09-21T03:15:15.681355+0000","last_undegraded":"2024-09-21T03:15:15.681355+0000","last_fullsized":"2024-09-21T03:15:15.681355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:40.166966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804969+0000","last_change":"2024-09-21T03:14:38.472992+0000","last_active":"2024-09-21T03:15:15.804969+0000","last_peered":"2024-09-21T03:15:15.804969+0000","last_clean":"2024-09-21T03:15:15.804969+0000","last_became_active":"2024-09-21T03:14:38.472426+0000","last_became_peered":"2024-09-21T03:14:38.472426+0000","last_unstale":"2024-09-21T03:15:15.804969+0000","last_undegraded":"2024-09-21T03:15:15.804969+0000","last_fullsized":"2024-09-21T03:15:15.804969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:36.825612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677572+0000","last_change":"2024-09-21T03:14:46.526996+0000","last_active":"2024-09-21T03:15:15.677572+0000","last_peered":"2024-09-21T03:15:15.677572+0000","last_clean":"2024-09-21T03:15:15.677572+0000","last_became_active":"2024-09-21T03:14:46.525587+0000","last_became_peered":"2024-09-21T03:14:46.525587+0000","last_unstale":"2024-09-21T03:15:15.677572+0000","last_undegraded":"2024-09-21T03:15:15.677572+0000","last_fullsized":"2024-09-21T03:15:15.677572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:56.977126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677435+0000","last_change":"2024-09-21T03:14:47.554143+0000","last_active":"2024-09-21T03:15:15.677435+0000","last_peered":"2024-09-21T03:15:15.677435+0000","last_clean":"2024-09-21T03:15:15.677435+0000","last_became_active":"2024-09-21T03:14:47.553802+0000","last_became_peered":"2024-09-21T03:14:47.553802+0000","last_unstale":"2024-09-21T03:15:15.677435+0000","last_undegraded":"2024-09-21T03:15:15.677435+0000","last_fullsized":"2024-09-21T03:15:15.677435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:37.963442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681887+0000","last_change":"2024-09-21T03:14:37.479842+0000","last_active":"2024-09-21T03:15:15.681887+0000","last_peered":"2024-09-21T03:15:15.681887+0000","last_clean":"2024-09-21T03:15:15.681887+0000","last_became_active":"2024-09-21T03:14:37.478893+0000","last_became_peered":"2024-09-21T03:14:37.478893+0000","last_unstale":"2024-09-21T03:15:15.681887+0000","last_undegraded":"2024-09-21T03:15:15.681887+0000","last_fullsized":"2024-09-21T03:15:15.681887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:27.916133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684739+0000","last_change":"2024-09-21T03:14:38.468756+0000","last_active":"2024-09-21T03:15:14.684739+0000","last_peered":"2024-09-21T03:15:14.684739+0000","last_clean":"2024-09-21T03:15:14.684739+0000","last_became_active":"2024-09-21T03:14:38.467570+0000","last_became_peered":"2024-09-21T03:14:38.467570+0000","last_unstale":"2024-09-21T03:15:14.684739+0000","last_undegraded":"2024-09-21T03:15:14.684739+0000","last_fullsized":"2024-09-21T03:15:14.684739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:24.784157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677514+0000","last_change":"2024-09-21T03:14:46.529932+0000","last_active":"2024-09-21T03:15:15.677514+0000","last_peered":"2024-09-21T03:15:15.677514+0000","last_clean":"2024-09-21T03:15:15.677514+0000","last_became_active":"2024-09-21T03:14:46.529629+0000","last_became_peered":"2024-09-21T03:14:46.529629+0000","last_unstale":"2024-09-21T03:15:15.677514+0000","last_undegraded":"2024-09-21T03:15:15.677514+0000","last_fullsized":"2024-09-21T03:15:15.677514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:39.808494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681239+0000","last_change":"2024-09-21T03:14:47.547724+0000","last_active":"2024-09-21T03:15:15.681239+0000","last_peered":"2024-09-21T03:15:15.681239+0000","last_clean":"2024-09-21T03:15:15.681239+0000","last_became_active":"2024-09-21T03:14:47.546770+0000","last_became_peered":"2024-09-21T03:14:47.546770+0000","last_unstale":"2024-09-21T03:15:15.681239+0000","last_undegraded":"2024-09-21T03:15:15.681239+0000","last_fullsized":"2024-09-21T03:15:15.681239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:31.476710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682495+0000","last_change":"2024-09-21T03:14:38.476747+0000","last_active":"2024-09-21T03:15:14.682495+0000","last_peered":"2024-09-21T03:15:14.682495+0000","last_clean":"2024-09-21T03:15:14.682495+0000","last_became_active":"2024-09-21T03:14:38.476386+0000","last_became_peered":"2024-09-21T03:14:38.476386+0000","last_unstale":"2024-09-21T03:15:14.682495+0000","last_undegraded":"2024-09-21T03:15:14.682495+0000","last_fullsized":"2024-09-21T03:15:14.682495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:28.751991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.683209+0000","last_change":"2024-09-21T03:14:37.463164+0000","last_active":"2024-09-21T03:15:14.683209+0000","last_peered":"2024-09-21T03:15:14.683209+0000","last_clean":"2024-09-21T03:15:14.683209+0000","last_became_active":"2024-09-21T03:14:37.461409+0000","last_became_peered":"2024-09-21T03:14:37.461409+0000","last_unstale":"2024-09-21T03:15:14.683209+0000","last_undegraded":"2024-09-21T03:15:14.683209+0000","last_fullsized":"2024-09-21T03:15:14.683209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:51.126291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684453+0000","last_change":"2024-09-21T03:14:46.538480+0000","last_active":"2024-09-21T03:15:14.684453+0000","last_peered":"2024-09-21T03:15:14.684453+0000","last_clean":"2024-09-21T03:15:14.684453+0000","last_became_active":"2024-09-21T03:14:46.537493+0000","last_became_peered":"2024-09-21T03:14:46.537493+0000","last_unstale":"2024-09-21T03:15:14.684453+0000","last_undegraded":"2024-09-21T03:15:14.684453+0000","last_fullsized":"2024-09-21T03:15:14.684453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:52.769190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684608+0000","last_change":"2024-09-21T03:14:47.580512+0000","last_active":"2024-09-21T03:15:15.684608+0000","last_peered":"2024-09-21T03:15:15.684608+0000","last_clean":"2024-09-21T03:15:15.684608+0000","last_became_active":"2024-09-21T03:14:47.580210+0000","last_became_peered":"2024-09-21T03:14:47.580210+0000","last_unstale":"2024-09-21T03:15:15.684608+0000","last_undegraded":"2024-09-21T03:15:15.684608+0000","last_fullsized":"2024-09-21T03:15:15.684608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:20.192190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684313+0000","last_change":"2024-09-21T03:14:38.494021+0000","last_active":"2024-09-21T03:15:15.684313+0000","last_peered":"2024-09-21T03:15:15.684313+0000","last_clean":"2024-09-21T03:15:15.684313+0000","last_became_active":"2024-09-21T03:14:38.486802+0000","last_became_peered":"2024-09-21T03:14:38.486802+0000","last_unstale":"2024-09-21T03:15:15.684313+0000","last_undegraded":"2024-09-21T03:15:15.684313+0000","last_fullsized":"2024-09-21T03:15:15.684313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:31.817505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558034+0000","last_change":"2024-09-21T03:14:37.465907+0000","last_active":"2024-09-21T03:14:48.558034+0000","last_peered":"2024-09-21T03:14:48.558034+0000","last_clean":"2024-09-21T03:14:48.558034+0000","last_became_active":"2024-09-21T03:14:37.465551+0000","last_became_peered":"2024-09-21T03:14:37.465551+0000","last_unstale":"2024-09-21T03:14:48.558034+0000","last_undegraded":"2024-09-21T03:14:48.558034+0000","last_fullsized":"2024-09-21T03:14:48.558034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:10.599687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681508+0000","last_change":"2024-09-21T03:14:46.546737+0000","last_active":"2024-09-21T03:15:15.681508+0000","last_peered":"2024-09-21T03:15:15.681508+0000","last_clean":"2024-09-21T03:15:15.681508+0000","last_became_active":"2024-09-21T03:14:46.546312+0000","last_became_peered":"2024-09-21T03:14:46.546312+0000","last_unstale":"2024-09-21T03:15:15.681508+0000","last_undegraded":"2024-09-21T03:15:15.681508+0000","last_fullsized":"2024-09-21T03:15:15.681508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:03.939168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.686382+0000","last_change":"2024-09-21T03:14:47.558742+0000","last_active":"2024-09-21T03:15:14.686382+0000","last_peered":"2024-09-21T03:15:14.686382+0000","last_clean":"2024-09-21T03:15:14.686382+0000","last_became_active":"2024-09-21T03:14:47.558431+0000","last_became_peered":"2024-09-21T03:14:47.558431+0000","last_unstale":"2024-09-21T03:15:14.686382+0000","last_undegraded":"2024-09-21T03:15:14.686382+0000","last_fullsized":"2024-09-21T03:15:14.686382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:32.053674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805176+0000","last_change":"2024-09-21T03:14:38.479370+0000","last_active":"2024-09-21T03:15:15.805176+0000","last_peered":"2024-09-21T03:15:15.805176+0000","last_clean":"2024-09-21T03:15:15.805176+0000","last_became_active":"2024-09-21T03:14:38.476976+0000","last_became_peered":"2024-09-21T03:14:38.476976+0000","last_unstale":"2024-09-21T03:15:15.805176+0000","last_undegraded":"2024-09-21T03:15:15.805176+0000","last_fullsized":"2024-09-21T03:15:15.805176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:14.695819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805302+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:15:15.805302+0000","last_peered":"2024-09-21T03:15:15.805302+0000","last_clean":"2024-09-21T03:15:15.805302+0000","last_became_active":"2024-09-21T03:14:37.478840+0000","last_became_peered":"2024-09-21T03:14:37.478840+0000","last_unstale":"2024-09-21T03:15:15.805302+0000","last_undegraded":"2024-09-21T03:15:15.805302+0000","last_fullsized":"2024-09-21T03:15:15.805302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:00.964354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684541+0000","last_change":"2024-09-21T03:14:46.543085+0000","last_active":"2024-09-21T03:15:15.684541+0000","last_peered":"2024-09-21T03:15:15.684541+0000","last_clean":"2024-09-21T03:15:15.684541+0000","last_became_active":"2024-09-21T03:14:46.542721+0000","last_became_peered":"2024-09-21T03:14:46.542721+0000","last_unstale":"2024-09-21T03:15:15.684541+0000","last_undegraded":"2024-09-21T03:15:15.684541+0000","last_fullsized":"2024-09-21T03:15:15.684541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:05.590871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805028+0000","last_change":"2024-09-21T03:14:47.566806+0000","last_active":"2024-09-21T03:15:15.805028+0000","last_peered":"2024-09-21T03:15:15.805028+0000","last_clean":"2024-09-21T03:15:15.805028+0000","last_became_active":"2024-09-21T03:14:47.566634+0000","last_became_peered":"2024-09-21T03:14:47.566634+0000","last_unstale":"2024-09-21T03:15:15.805028+0000","last_undegraded":"2024-09-21T03:15:15.805028+0000","last_fullsized":"2024-09-21T03:15:15.805028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:03.997294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682260+0000","last_change":"2024-09-21T03:14:38.482658+0000","last_active":"2024-09-21T03:15:14.682260+0000","last_peered":"2024-09-21T03:15:14.682260+0000","last_clean":"2024-09-21T03:15:14.682260+0000","last_became_active":"2024-09-21T03:14:38.482369+0000","last_became_peered":"2024-09-21T03:14:38.482369+0000","last_unstale":"2024-09-21T03:15:14.682260+0000","last_undegraded":"2024-09-21T03:15:14.682260+0000","last_fullsized":"2024-09-21T03:15:14.682260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:36.682534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680554+0000","last_change":"2024-09-21T03:14:37.472962+0000","last_active":"2024-09-21T03:15:15.680554+0000","last_peered":"2024-09-21T03:15:15.680554+0000","last_clean":"2024-09-21T03:15:15.680554+0000","last_became_active":"2024-09-21T03:14:37.472271+0000","last_became_peered":"2024-09-21T03:14:37.472271+0000","last_unstale":"2024-09-21T03:15:15.680554+0000","last_undegraded":"2024-09-21T03:15:15.680554+0000","last_fullsized":"2024-09-21T03:15:15.680554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:54.952223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678253+0000","last_change":"2024-09-21T03:14:46.537137+0000","last_active":"2024-09-21T03:15:15.678253+0000","last_peered":"2024-09-21T03:15:15.678253+0000","last_clean":"2024-09-21T03:15:15.678253+0000","last_became_active":"2024-09-21T03:14:46.536791+0000","last_became_peered":"2024-09-21T03:14:46.536791+0000","last_unstale":"2024-09-21T03:15:15.678253+0000","last_undegraded":"2024-09-21T03:15:15.678253+0000","last_fullsized":"2024-09-21T03:15:15.678253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:43.186807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805335+0000","last_change":"2024-09-21T03:14:47.555605+0000","last_active":"2024-09-21T03:15:15.805335+0000","last_peered":"2024-09-21T03:15:15.805335+0000","last_clean":"2024-09-21T03:15:15.805335+0000","last_became_active":"2024-09-21T03:14:47.555329+0000","last_became_peered":"2024-09-21T03:14:47.555329+0000","last_unstale":"2024-09-21T03:15:15.805335+0000","last_undegraded":"2024-09-21T03:15:15.805335+0000","last_fullsized":"2024-09-21T03:15:15.805335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:24.271656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806141+0000","last_change":"2024-09-21T03:14:38.479133+0000","last_active":"2024-09-21T03:15:15.806141+0000","last_peered":"2024-09-21T03:15:15.806141+0000","last_clean":"2024-09-21T03:15:15.806141+0000","last_became_active":"2024-09-21T03:14:38.478077+0000","last_became_peered":"2024-09-21T03:14:38.478077+0000","last_unstale":"2024-09-21T03:15:15.806141+0000","last_undegraded":"2024-09-21T03:15:15.806141+0000","last_fullsized":"2024-09-21T03:15:15.806141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:56.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.687362+0000","last_change":"2024-09-21T03:14:37.480508+0000","last_active":"2024-09-21T03:15:14.687362+0000","last_peered":"2024-09-21T03:15:14.687362+0000","last_clean":"2024-09-21T03:15:14.687362+0000","last_became_active":"2024-09-21T03:14:37.480218+0000","last_became_peered":"2024-09-21T03:14:37.480218+0000","last_unstale":"2024-09-21T03:15:14.687362+0000","last_undegraded":"2024-09-21T03:15:14.687362+0000","last_fullsized":"2024-09-21T03:15:14.687362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:01.851380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678755+0000","last_change":"2024-09-21T03:14:46.531615+0000","last_active":"2024-09-21T03:15:15.678755+0000","last_peered":"2024-09-21T03:15:15.678755+0000","last_clean":"2024-09-21T03:15:15.678755+0000","last_became_active":"2024-09-21T03:14:46.531289+0000","last_became_peered":"2024-09-21T03:14:46.531289+0000","last_unstale":"2024-09-21T03:15:15.678755+0000","last_undegraded":"2024-09-21T03:15:15.678755+0000","last_fullsized":"2024-09-21T03:15:15.678755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:10.145489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682075+0000","last_change":"2024-09-21T03:14:47.552705+0000","last_active":"2024-09-21T03:15:14.682075+0000","last_peered":"2024-09-21T03:15:14.682075+0000","last_clean":"2024-09-21T03:15:14.682075+0000","last_became_active":"2024-09-21T03:14:47.552367+0000","last_became_peered":"2024-09-21T03:14:47.552367+0000","last_unstale":"2024-09-21T03:15:14.682075+0000","last_undegraded":"2024-09-21T03:15:14.682075+0000","last_fullsized":"2024-09-21T03:15:14.682075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:45.379581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806286+0000","last_change":"2024-09-21T03:14:38.475318+0000","last_active":"2024-09-21T03:15:15.806286+0000","last_peered":"2024-09-21T03:15:15.806286+0000","last_clean":"2024-09-21T03:15:15.806286+0000","last_became_active":"2024-09-21T03:14:38.474978+0000","last_became_peered":"2024-09-21T03:14:38.474978+0000","last_unstale":"2024-09-21T03:15:15.806286+0000","last_undegraded":"2024-09-21T03:15:15.806286+0000","last_fullsized":"2024-09-21T03:15:15.806286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:38.209624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806345+0000","last_change":"2024-09-21T03:14:37.479651+0000","last_active":"2024-09-21T03:15:15.806345+0000","last_peered":"2024-09-21T03:15:15.806345+0000","last_clean":"2024-09-21T03:15:15.806345+0000","last_became_active":"2024-09-21T03:14:37.478833+0000","last_became_peered":"2024-09-21T03:14:37.478833+0000","last_unstale":"2024-09-21T03:15:15.806345+0000","last_undegraded":"2024-09-21T03:15:15.806345+0000","last_fullsized":"2024-09-21T03:15:15.806345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:48.578637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804935+0000","last_change":"2024-09-21T03:14:46.536054+0000","last_active":"2024-09-21T03:15:15.804935+0000","last_peered":"2024-09-21T03:15:15.804935+0000","last_clean":"2024-09-21T03:15:15.804935+0000","last_became_active":"2024-09-21T03:14:46.535569+0000","last_became_peered":"2024-09-21T03:14:46.535569+0000","last_unstale":"2024-09-21T03:15:15.804935+0000","last_undegraded":"2024-09-21T03:15:15.804935+0000","last_fullsized":"2024-09-21T03:15:15.804935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:04.556059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680654+0000","last_change":"2024-09-21T03:14:47.571889+0000","last_active":"2024-09-21T03:15:15.680654+0000","last_peered":"2024-09-21T03:15:15.680654+0000","last_clean":"2024-09-21T03:15:15.680654+0000","last_became_active":"2024-09-21T03:14:47.571620+0000","last_became_peered":"2024-09-21T03:14:47.571620+0000","last_unstale":"2024-09-21T03:15:15.680654+0000","last_undegraded":"2024-09-21T03:15:15.680654+0000","last_fullsized":"2024-09-21T03:15:15.680654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:23.103973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558656+0000","last_change":"2024-09-21T03:14:38.493350+0000","last_active":"2024-09-21T03:14:48.558656+0000","last_peered":"2024-09-21T03:14:48.558656+0000","last_clean":"2024-09-21T03:14:48.558656+0000","last_became_active":"2024-09-21T03:14:38.492830+0000","last_became_peered":"2024-09-21T03:14:38.492830+0000","last_unstale":"2024-09-21T03:14:48.558656+0000","last_undegraded":"2024-09-21T03:14:48.558656+0000","last_fullsized":"2024-09-21T03:14:48.558656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:19.946319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.685128+0000","last_change":"2024-09-21T03:14:37.473484+0000","last_active":"2024-09-21T03:15:14.685128+0000","last_peered":"2024-09-21T03:15:14.685128+0000","last_clean":"2024-09-21T03:15:14.685128+0000","last_became_active":"2024-09-21T03:14:37.473218+0000","last_became_peered":"2024-09-21T03:14:37.473218+0000","last_unstale":"2024-09-21T03:15:14.685128+0000","last_undegraded":"2024-09-21T03:15:14.685128+0000","last_fullsized":"2024-09-21T03:15:14.685128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:49.006579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558777+0000","last_change":"2024-09-21T03:14:46.548858+0000","last_active":"2024-09-21T03:14:48.558777+0000","last_peered":"2024-09-21T03:14:48.558777+0000","last_clean":"2024-09-21T03:14:48.558777+0000","last_became_active":"2024-09-21T03:14:46.548166+0000","last_became_peered":"2024-09-21T03:14:46.548166+0000","last_unstale":"2024-09-21T03:14:48.558777+0000","last_undegraded":"2024-09-21T03:14:48.558777+0000","last_fullsized":"2024-09-21T03:14:48.558777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:41.470072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805741+0000","last_change":"2024-09-21T03:14:47.555787+0000","last_active":"2024-09-21T03:15:15.805741+0000","last_peered":"2024-09-21T03:15:15.805741+0000","last_clean":"2024-09-21T03:15:15.805741+0000","last_became_active":"2024-09-21T03:14:47.555420+0000","last_became_peered":"2024-09-21T03:14:47.555420+0000","last_unstale":"2024-09-21T03:15:15.805741+0000","last_undegraded":"2024-09-21T03:15:15.805741+0000","last_fullsized":"2024-09-21T03:15:15.805741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:45.769786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677640+0000","last_change":"2024-09-21T03:14:38.479657+0000","last_active":"2024-09-21T03:15:15.677640+0000","last_peered":"2024-09-21T03:15:15.677640+0000","last_clean":"2024-09-21T03:15:15.677640+0000","last_became_active":"2024-09-21T03:14:38.479439+0000","last_became_peered":"2024-09-21T03:14:38.479439+0000","last_unstale":"2024-09-21T03:15:15.677640+0000","last_undegraded":"2024-09-21T03:15:15.677640+0000","last_fullsized":"2024-09-21T03:15:15.677640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.107215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681857+0000","last_change":"2024-09-21T03:14:37.469799+0000","last_active":"2024-09-21T03:15:15.681857+0000","last_peered":"2024-09-21T03:15:15.681857+0000","last_clean":"2024-09-21T03:15:15.681857+0000","last_became_active":"2024-09-21T03:14:37.469495+0000","last_became_peered":"2024-09-21T03:14:37.469495+0000","last_unstale":"2024-09-21T03:15:15.681857+0000","last_undegraded":"2024-09-21T03:15:15.681857+0000","last_fullsized":"2024-09-21T03:15:15.681857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:50.247050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557375+0000","last_change":"2024-09-21T03:14:46.544320+0000","last_active":"2024-09-21T03:14:48.557375+0000","last_peered":"2024-09-21T03:14:48.557375+0000","last_clean":"2024-09-21T03:14:48.557375+0000","last_became_active":"2024-09-21T03:14:46.544038+0000","last_became_peered":"2024-09-21T03:14:46.544038+0000","last_unstale":"2024-09-21T03:14:48.557375+0000","last_undegraded":"2024-09-21T03:14:48.557375+0000","last_fullsized":"2024-09-21T03:14:48.557375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:57.457687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684713+0000","last_change":"2024-09-21T03:14:47.579698+0000","last_active":"2024-09-21T03:15:15.684713+0000","last_peered":"2024-09-21T03:15:15.684713+0000","last_clean":"2024-09-21T03:15:15.684713+0000","last_became_active":"2024-09-21T03:14:47.579324+0000","last_became_peered":"2024-09-21T03:14:47.579324+0000","last_unstale":"2024-09-21T03:15:15.684713+0000","last_undegraded":"2024-09-21T03:15:15.684713+0000","last_fullsized":"2024-09-21T03:15:15.684713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:37.656859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681701+0000","last_change":"2024-09-21T03:14:38.476763+0000","last_active":"2024-09-21T03:15:15.681701+0000","last_peered":"2024-09-21T03:15:15.681701+0000","last_clean":"2024-09-21T03:15:15.681701+0000","last_became_active":"2024-09-21T03:14:38.474299+0000","last_became_peered":"2024-09-21T03:14:38.474299+0000","last_unstale":"2024-09-21T03:15:15.681701+0000","last_undegraded":"2024-09-21T03:15:15.681701+0000","last_fullsized":"2024-09-21T03:15:15.681701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:46.544930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682672+0000","last_change":"2024-09-21T03:14:37.466857+0000","last_active":"2024-09-21T03:15:14.682672+0000","last_peered":"2024-09-21T03:15:14.682672+0000","last_clean":"2024-09-21T03:15:14.682672+0000","last_became_active":"2024-09-21T03:14:37.466256+0000","last_became_peered":"2024-09-21T03:14:37.466256+0000","last_unstale":"2024-09-21T03:15:14.682672+0000","last_undegraded":"2024-09-21T03:15:14.682672+0000","last_fullsized":"2024-09-21T03:15:14.682672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:02.240461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558502+0000","last_change":"2024-09-21T03:14:46.537315+0000","last_active":"2024-09-21T03:14:48.558502+0000","last_peered":"2024-09-21T03:14:48.558502+0000","last_clean":"2024-09-21T03:14:48.558502+0000","last_became_active":"2024-09-21T03:14:46.536975+0000","last_became_peered":"2024-09-21T03:14:46.536975+0000","last_unstale":"2024-09-21T03:14:48.558502+0000","last_undegraded":"2024-09-21T03:14:48.558502+0000","last_fullsized":"2024-09-21T03:14:48.558502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:42.529591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.685045+0000","last_change":"2024-09-21T03:14:47.573009+0000","last_active":"2024-09-21T03:15:15.685045+0000","last_peered":"2024-09-21T03:15:15.685045+0000","last_clean":"2024-09-21T03:15:15.685045+0000","last_became_active":"2024-09-21T03:14:47.572395+0000","last_became_peered":"2024-09-21T03:14:47.572395+0000","last_unstale":"2024-09-21T03:15:15.685045+0000","last_undegraded":"2024-09-21T03:15:15.685045+0000","last_fullsized":"2024-09-21T03:15:15.685045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:41.733447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678985+0000","last_change":"2024-09-21T03:14:38.481801+0000","last_active":"2024-09-21T03:15:15.678985+0000","last_peered":"2024-09-21T03:15:15.678985+0000","last_clean":"2024-09-21T03:15:15.678985+0000","last_became_active":"2024-09-21T03:14:38.481186+0000","last_became_peered":"2024-09-21T03:14:38.481186+0000","last_unstale":"2024-09-21T03:15:15.678985+0000","last_undegraded":"2024-09-21T03:15:15.678985+0000","last_fullsized":"2024-09-21T03:15:15.678985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:54.271470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683612+0000","last_change":"2024-09-21T03:14:37.474798+0000","last_active":"2024-09-21T03:15:15.683612+0000","last_peered":"2024-09-21T03:15:15.683612+0000","last_clean":"2024-09-21T03:15:15.683612+0000","last_became_active":"2024-09-21T03:14:37.473829+0000","last_became_peered":"2024-09-21T03:14:37.473829+0000","last_unstale":"2024-09-21T03:15:15.683612+0000","last_undegraded":"2024-09-21T03:15:15.683612+0000","last_fullsized":"2024-09-21T03:15:15.683612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:11.571814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558227+0000","last_change":"2024-09-21T03:14:46.542495+0000","last_active":"2024-09-21T03:14:48.558227+0000","last_peered":"2024-09-21T03:14:48.558227+0000","last_clean":"2024-09-21T03:14:48.558227+0000","last_became_active":"2024-09-21T03:14:46.542181+0000","last_became_peered":"2024-09-21T03:14:46.542181+0000","last_unstale":"2024-09-21T03:14:48.558227+0000","last_undegraded":"2024-09-21T03:14:48.558227+0000","last_fullsized":"2024-09-21T03:14:48.558227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:22.481477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.686650+0000","last_change":"2024-09-21T03:14:47.569409+0000","last_active":"2024-09-21T03:15:14.686650+0000","last_peered":"2024-09-21T03:15:14.686650+0000","last_clean":"2024-09-21T03:15:14.686650+0000","last_became_active":"2024-09-21T03:14:47.569212+0000","last_became_peered":"2024-09-21T03:14:47.569212+0000","last_unstale":"2024-09-21T03:15:14.686650+0000","last_undegraded":"2024-09-21T03:15:14.686650+0000","last_fullsized":"2024-09-21T03:15:14.686650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.851943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557644+0000","last_change":"2024-09-21T03:14:38.480026+0000","last_active":"2024-09-21T03:14:48.557644+0000","last_peered":"2024-09-21T03:14:48.557644+0000","last_clean":"2024-09-21T03:14:48.557644+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:14:48.557644+0000","last_undegraded":"2024-09-21T03:14:48.557644+0000","last_fullsized":"2024-09-21T03:14:48.557644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:20.481816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682008+0000","last_change":"2024-09-21T03:14:37.464554+0000","last_active":"2024-09-21T03:15:14.682008+0000","last_peered":"2024-09-21T03:15:14.682008+0000","last_clean":"2024-09-21T03:15:14.682008+0000","last_became_active":"2024-09-21T03:14:37.464228+0000","last_became_peered":"2024-09-21T03:14:37.464228+0000","last_unstale":"2024-09-21T03:15:14.682008+0000","last_undegraded":"2024-09-21T03:15:14.682008+0000","last_fullsized":"2024-09-21T03:15:14.682008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:32.529512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680429+0000","last_change":"2024-09-21T03:14:46.538538+0000","last_active":"2024-09-21T03:15:15.680429+0000","last_peered":"2024-09-21T03:15:15.680429+0000","last_clean":"2024-09-21T03:15:15.680429+0000","last_became_active":"2024-09-21T03:14:46.537815+0000","last_became_peered":"2024-09-21T03:14:46.537815+0000","last_unstale":"2024-09-21T03:15:15.680429+0000","last_undegraded":"2024-09-21T03:15:15.680429+0000","last_fullsized":"2024-09-21T03:15:15.680429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:42.264439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680898+0000","last_change":"2024-09-21T03:14:47.558861+0000","last_active":"2024-09-21T03:15:15.680898+0000","last_peered":"2024-09-21T03:15:15.680898+0000","last_clean":"2024-09-21T03:15:15.680898+0000","last_became_active":"2024-09-21T03:14:47.557305+0000","last_became_peered":"2024-09-21T03:14:47.557305+0000","last_unstale":"2024-09-21T03:15:15.680898+0000","last_undegraded":"2024-09-21T03:15:15.680898+0000","last_fullsized":"2024-09-21T03:15:15.680898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:45.962367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805521+0000","last_change":"2024-09-21T03:14:38.479181+0000","last_active":"2024-09-21T03:15:15.805521+0000","last_peered":"2024-09-21T03:15:15.805521+0000","last_clean":"2024-09-21T03:15:15.805521+0000","last_became_active":"2024-09-21T03:14:38.478842+0000","last_became_peered":"2024-09-21T03:14:38.478842+0000","last_unstale":"2024-09-21T03:15:15.805521+0000","last_undegraded":"2024-09-21T03:15:15.805521+0000","last_fullsized":"2024-09-21T03:15:15.805521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:08.664381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.683994+0000","last_change":"2024-09-21T03:14:37.463990+0000","last_active":"2024-09-21T03:15:14.683994+0000","last_peered":"2024-09-21T03:15:14.683994+0000","last_clean":"2024-09-21T03:15:14.683994+0000","last_became_active":"2024-09-21T03:14:37.463674+0000","last_became_peered":"2024-09-21T03:14:37.463674+0000","last_unstale":"2024-09-21T03:15:14.683994+0000","last_undegraded":"2024-09-21T03:15:14.683994+0000","last_fullsized":"2024-09-21T03:15:14.683994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:35.391985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804527+0000","last_change":"2024-09-21T03:14:26.342355+0000","last_active":"2024-09-21T03:15:15.804527+0000","last_peered":"2024-09-21T03:15:15.804527+0000","last_clean":"2024-09-21T03:15:15.804527+0000","last_became_active":"2024-09-21T03:14:26.341929+0000","last_became_peered":"2024-09-21T03:14:26.341929+0000","last_unstale":"2024-09-21T03:15:15.804527+0000","last_undegraded":"2024-09-21T03:15:15.804527+0000","last_fullsized":"2024-09-21T03:15:15.804527+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_clean_scrub_stamp":"2024-09-21T03:14:25.329650+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:45.390822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684834+0000","last_change":"2024-09-21T03:14:46.538184+0000","last_active":"2024-09-21T03:15:14.684834+0000","last_peered":"2024-09-21T03:15:14.684834+0000","last_clean":"2024-09-21T03:15:14.684834+0000","last_became_active":"2024-09-21T03:14:46.536753+0000","last_became_peered":"2024-09-21T03:14:46.536753+0000","last_unstale":"2024-09-21T03:15:14.684834+0000","last_undegraded":"2024-09-21T03:15:14.684834+0000","last_fullsized":"2024-09-21T03:15:14.684834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:49.078638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680743+0000","last_change":"2024-09-21T03:14:47.552966+0000","last_active":"2024-09-21T03:15:15.680743+0000","last_peered":"2024-09-21T03:15:15.680743+0000","last_clean":"2024-09-21T03:15:15.680743+0000","last_became_active":"2024-09-21T03:14:47.552642+0000","last_became_peered":"2024-09-21T03:14:47.552642+0000","last_unstale":"2024-09-21T03:15:15.680743+0000","last_undegraded":"2024-09-21T03:15:15.680743+0000","last_fullsized":"2024-09-21T03:15:15.680743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:15.928026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684929+0000","last_change":"2024-09-21T03:14:38.478414+0000","last_active":"2024-09-21T03:15:14.684929+0000","last_peered":"2024-09-21T03:15:14.684929+0000","last_clean":"2024-09-21T03:15:14.684929+0000","last_became_active":"2024-09-21T03:14:38.478116+0000","last_became_peered":"2024-09-21T03:14:38.478116+0000","last_unstale":"2024-09-21T03:15:14.684929+0000","last_undegraded":"2024-09-21T03:15:14.684929+0000","last_fullsized":"2024-09-21T03:15:14.684929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:29.618008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558850+0000","last_change":"2024-09-21T03:14:37.479578+0000","last_active":"2024-09-21T03:14:48.558850+0000","last_peered":"2024-09-21T03:14:48.558850+0000","last_clean":"2024-09-21T03:14:48.558850+0000","last_became_active":"2024-09-21T03:14:37.479284+0000","last_became_peered":"2024-09-21T03:14:37.479284+0000","last_unstale":"2024-09-21T03:14:48.558850+0000","last_undegraded":"2024-09-21T03:14:48.558850+0000","last_fullsized":"2024-09-21T03:14:48.558850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:15.732230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677624+0000","last_change":"2024-09-21T03:14:46.531536+0000","last_active":"2024-09-21T03:15:15.677624+0000","last_peered":"2024-09-21T03:15:15.677624+0000","last_clean":"2024-09-21T03:15:15.677624+0000","last_became_active":"2024-09-21T03:14:46.531069+0000","last_became_peered":"2024-09-21T03:14:46.531069+0000","last_unstale":"2024-09-21T03:15:15.677624+0000","last_undegraded":"2024-09-21T03:15:15.677624+0000","last_fullsized":"2024-09-21T03:15:15.677624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:14.050618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557238+0000","last_change":"2024-09-21T03:14:47.553039+0000","last_active":"2024-09-21T03:14:48.557238+0000","last_peered":"2024-09-21T03:14:48.557238+0000","last_clean":"2024-09-21T03:14:48.557238+0000","last_became_active":"2024-09-21T03:14:47.552712+0000","last_became_peered":"2024-09-21T03:14:47.552712+0000","last_unstale":"2024-09-21T03:14:48.557238+0000","last_undegraded":"2024-09-21T03:14:48.557238+0000","last_fullsized":"2024-09-21T03:14:48.557238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:32.630319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681782+0000","last_change":"2024-09-21T03:14:38.488259+0000","last_active":"2024-09-21T03:15:15.681782+0000","last_peered":"2024-09-21T03:15:15.681782+0000","last_clean":"2024-09-21T03:15:15.681782+0000","last_became_active":"2024-09-21T03:14:38.487420+0000","last_became_peered":"2024-09-21T03:14:38.487420+0000","last_unstale":"2024-09-21T03:15:15.681782+0000","last_undegraded":"2024-09-21T03:15:15.681782+0000","last_fullsized":"2024-09-21T03:15:15.681782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:48.003893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681753+0000","last_change":"2024-09-21T03:14:37.460763+0000","last_active":"2024-09-21T03:15:15.681753+0000","last_peered":"2024-09-21T03:15:15.681753+0000","last_clean":"2024-09-21T03:15:15.681753+0000","last_became_active":"2024-09-21T03:14:37.460320+0000","last_became_peered":"2024-09-21T03:14:37.460320+0000","last_unstale":"2024-09-21T03:15:15.681753+0000","last_undegraded":"2024-09-21T03:15:15.681753+0000","last_fullsized":"2024-09-21T03:15:15.681753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.907794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681101+0000","last_change":"2024-09-21T03:14:46.540901+0000","last_active":"2024-09-21T03:15:15.681101+0000","last_peered":"2024-09-21T03:15:15.681101+0000","last_clean":"2024-09-21T03:15:15.681101+0000","last_became_active":"2024-09-21T03:14:46.540182+0000","last_became_peered":"2024-09-21T03:14:46.540182+0000","last_unstale":"2024-09-21T03:15:15.681101+0000","last_undegraded":"2024-09-21T03:15:15.681101+0000","last_fullsized":"2024-09-21T03:15:15.681101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:38.416663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804362+0000","last_change":"2024-09-21T03:14:47.553810+0000","last_active":"2024-09-21T03:15:15.804362+0000","last_peered":"2024-09-21T03:15:15.804362+0000","last_clean":"2024-09-21T03:15:15.804362+0000","last_became_active":"2024-09-21T03:14:47.552371+0000","last_became_peered":"2024-09-21T03:14:47.552371+0000","last_unstale":"2024-09-21T03:15:15.804362+0000","last_undegraded":"2024-09-21T03:15:15.804362+0000","last_fullsized":"2024-09-21T03:15:15.804362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:38.659512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681305+0000","last_change":"2024-09-21T03:14:38.480629+0000","last_active":"2024-09-21T03:15:15.681305+0000","last_peered":"2024-09-21T03:15:15.681305+0000","last_clean":"2024-09-21T03:15:15.681305+0000","last_became_active":"2024-09-21T03:14:38.474135+0000","last_became_peered":"2024-09-21T03:14:38.474135+0000","last_unstale":"2024-09-21T03:15:15.681305+0000","last_undegraded":"2024-09-21T03:15:15.681305+0000","last_fullsized":"2024-09-21T03:15:15.681305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:36.171044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806268+0000","last_change":"2024-09-21T03:14:37.472491+0000","last_active":"2024-09-21T03:15:15.806268+0000","last_peered":"2024-09-21T03:15:15.806268+0000","last_clean":"2024-09-21T03:15:15.806268+0000","last_became_active":"2024-09-21T03:14:37.472164+0000","last_became_peered":"2024-09-21T03:14:37.472164+0000","last_unstale":"2024-09-21T03:15:15.806268+0000","last_undegraded":"2024-09-21T03:15:15.806268+0000","last_fullsized":"2024-09-21T03:15:15.806268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.498178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681720+0000","last_change":"2024-09-21T03:14:46.544828+0000","last_active":"2024-09-21T03:15:14.681720+0000","last_peered":"2024-09-21T03:15:14.681720+0000","last_clean":"2024-09-21T03:15:14.681720+0000","last_became_active":"2024-09-21T03:14:46.535901+0000","last_became_peered":"2024-09-21T03:14:46.535901+0000","last_unstale":"2024-09-21T03:15:14.681720+0000","last_undegraded":"2024-09-21T03:15:14.681720+0000","last_fullsized":"2024-09-21T03:15:14.681720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:08.608530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557424+0000","last_change":"2024-09-21T03:14:47.556478+0000","last_active":"2024-09-21T03:14:48.557424+0000","last_peered":"2024-09-21T03:14:48.557424+0000","last_clean":"2024-09-21T03:14:48.557424+0000","last_became_active":"2024-09-21T03:14:47.556145+0000","last_became_peered":"2024-09-21T03:14:47.556145+0000","last_unstale":"2024-09-21T03:14:48.557424+0000","last_undegraded":"2024-09-21T03:14:48.557424+0000","last_fullsized":"2024-09-21T03:14:48.557424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:59.004648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678670+0000","last_change":"2024-09-21T03:14:38.469502+0000","last_active":"2024-09-21T03:15:15.678670+0000","last_peered":"2024-09-21T03:15:15.678670+0000","last_clean":"2024-09-21T03:15:15.678670+0000","last_became_active":"2024-09-21T03:14:38.468972+0000","last_became_peered":"2024-09-21T03:14:38.468972+0000","last_unstale":"2024-09-21T03:15:15.678670+0000","last_undegraded":"2024-09-21T03:15:15.678670+0000","last_fullsized":"2024-09-21T03:15:15.678670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681340+0000","last_change":"2024-09-21T03:14:37.480905+0000","last_active":"2024-09-21T03:15:15.681340+0000","last_peered":"2024-09-21T03:15:15.681340+0000","last_clean":"2024-09-21T03:15:15.681340+0000","last_became_active":"2024-09-21T03:14:37.478227+0000","last_became_peered":"2024-09-21T03:14:37.478227+0000","last_unstale":"2024-09-21T03:15:15.681340+0000","last_undegraded":"2024-09-21T03:15:15.681340+0000","last_fullsized":"2024-09-21T03:15:15.681340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:42.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804534+0000","last_change":"2024-09-21T03:14:46.536103+0000","last_active":"2024-09-21T03:15:15.804534+0000","last_peered":"2024-09-21T03:15:15.804534+0000","last_clean":"2024-09-21T03:15:15.804534+0000","last_became_active":"2024-09-21T03:14:46.535445+0000","last_became_peered":"2024-09-21T03:14:46.535445+0000","last_unstale":"2024-09-21T03:15:15.804534+0000","last_undegraded":"2024-09-21T03:15:15.804534+0000","last_fullsized":"2024-09-21T03:15:15.804534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:59.078000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806222+0000","last_change":"2024-09-21T03:14:47.557503+0000","last_active":"2024-09-21T03:15:15.806222+0000","last_peered":"2024-09-21T03:15:15.806222+0000","last_clean":"2024-09-21T03:15:15.806222+0000","last_became_active":"2024-09-21T03:14:47.554366+0000","last_became_peered":"2024-09-21T03:14:47.554366+0000","last_unstale":"2024-09-21T03:15:15.806222+0000","last_undegraded":"2024-09-21T03:15:15.806222+0000","last_fullsized":"2024-09-21T03:15:15.806222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.994560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682222+0000","last_change":"2024-09-21T03:14:38.479516+0000","last_active":"2024-09-21T03:15:14.682222+0000","last_peered":"2024-09-21T03:15:14.682222+0000","last_clean":"2024-09-21T03:15:14.682222+0000","last_became_active":"2024-09-21T03:14:38.474826+0000","last_became_peered":"2024-09-21T03:14:38.474826+0000","last_unstale":"2024-09-21T03:15:14.682222+0000","last_undegraded":"2024-09-21T03:15:14.682222+0000","last_fullsized":"2024-09-21T03:15:14.682222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:22.181411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805649+0000","last_change":"2024-09-21T03:14:37.471063+0000","last_active":"2024-09-21T03:15:15.805649+0000","last_peered":"2024-09-21T03:15:15.805649+0000","last_clean":"2024-09-21T03:15:15.805649+0000","last_became_active":"2024-09-21T03:14:37.470720+0000","last_became_peered":"2024-09-21T03:14:37.470720+0000","last_unstale":"2024-09-21T03:15:15.805649+0000","last_undegraded":"2024-09-21T03:15:15.805649+0000","last_fullsized":"2024-09-21T03:15:15.805649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:00.054692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679915+0000","last_change":"2024-09-21T03:14:46.538665+0000","last_active":"2024-09-21T03:15:15.679915+0000","last_peered":"2024-09-21T03:15:15.679915+0000","last_clean":"2024-09-21T03:15:15.679915+0000","last_became_active":"2024-09-21T03:14:46.537774+0000","last_became_peered":"2024-09-21T03:14:46.537774+0000","last_unstale":"2024-09-21T03:15:15.679915+0000","last_undegraded":"2024-09-21T03:15:15.679915+0000","last_fullsized":"2024-09-21T03:15:15.679915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:07.736404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.686200+0000","last_change":"2024-09-21T03:14:47.553011+0000","last_active":"2024-09-21T03:15:14.686200+0000","last_peered":"2024-09-21T03:15:14.686200+0000","last_clean":"2024-09-21T03:15:14.686200+0000","last_became_active":"2024-09-21T03:14:47.552700+0000","last_became_peered":"2024-09-21T03:14:47.552700+0000","last_unstale":"2024-09-21T03:15:14.686200+0000","last_undegraded":"2024-09-21T03:15:14.686200+0000","last_fullsized":"2024-09-21T03:15:14.686200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:58.780132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804436+0000","last_change":"2024-09-21T03:14:38.472906+0000","last_active":"2024-09-21T03:15:15.804436+0000","last_peered":"2024-09-21T03:15:15.804436+0000","last_clean":"2024-09-21T03:15:15.804436+0000","last_became_active":"2024-09-21T03:14:38.471933+0000","last_became_peered":"2024-09-21T03:14:38.471933+0000","last_unstale":"2024-09-21T03:15:15.804436+0000","last_undegraded":"2024-09-21T03:15:15.804436+0000","last_fullsized":"2024-09-21T03:15:15.804436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:05.395821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680585+0000","last_change":"2024-09-21T03:14:37.478714+0000","last_active":"2024-09-21T03:15:15.680585+0000","last_peered":"2024-09-21T03:15:15.680585+0000","last_clean":"2024-09-21T03:15:15.680585+0000","last_became_active":"2024-09-21T03:14:37.477951+0000","last_became_peered":"2024-09-21T03:14:37.477951+0000","last_unstale":"2024-09-21T03:15:15.680585+0000","last_undegraded":"2024-09-21T03:15:15.680585+0000","last_fullsized":"2024-09-21T03:15:15.680585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:42.529545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680921+0000","last_change":"2024-09-21T03:14:46.546142+0000","last_active":"2024-09-21T03:15:15.680921+0000","last_peered":"2024-09-21T03:15:15.680921+0000","last_clean":"2024-09-21T03:15:15.680921+0000","last_became_active":"2024-09-21T03:14:46.545865+0000","last_became_peered":"2024-09-21T03:14:46.545865+0000","last_unstale":"2024-09-21T03:15:15.680921+0000","last_undegraded":"2024-09-21T03:15:15.680921+0000","last_fullsized":"2024-09-21T03:15:15.680921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:11.705309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684250+0000","last_change":"2024-09-21T03:14:47.568961+0000","last_active":"2024-09-21T03:15:14.684250+0000","last_peered":"2024-09-21T03:15:14.684250+0000","last_clean":"2024-09-21T03:15:14.684250+0000","last_became_active":"2024-09-21T03:14:47.568656+0000","last_became_peered":"2024-09-21T03:14:47.568656+0000","last_unstale":"2024-09-21T03:15:14.684250+0000","last_undegraded":"2024-09-21T03:15:14.684250+0000","last_fullsized":"2024-09-21T03:15:14.684250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.041710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.683102+0000","last_change":"2024-09-21T03:14:38.485454+0000","last_active":"2024-09-21T03:15:14.683102+0000","last_peered":"2024-09-21T03:15:14.683102+0000","last_clean":"2024-09-21T03:15:14.683102+0000","last_became_active":"2024-09-21T03:14:38.485235+0000","last_became_peered":"2024-09-21T03:14:38.485235+0000","last_unstale":"2024-09-21T03:15:14.683102+0000","last_undegraded":"2024-09-21T03:15:14.683102+0000","last_fullsized":"2024-09-21T03:15:14.683102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:11.585637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682605+0000","last_change":"2024-09-21T03:14:37.466544+0000","last_active":"2024-09-21T03:15:14.682605+0000","last_peered":"2024-09-21T03:15:14.682605+0000","last_clean":"2024-09-21T03:15:14.682605+0000","last_became_active":"2024-09-21T03:14:37.465817+0000","last_became_peered":"2024-09-21T03:14:37.465817+0000","last_unstale":"2024-09-21T03:15:14.682605+0000","last_undegraded":"2024-09-21T03:15:14.682605+0000","last_fullsized":"2024-09-21T03:15:14.682605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:36.113483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:15:11.442899+0000","last_change":"2024-09-21T03:14:46.549921+0000","last_active":"2024-09-21T03:15:11.442899+0000","last_peered":"2024-09-21T03:15:11.442899+0000","last_clean":"2024-09-21T03:15:11.442899+0000","last_became_active":"2024-09-21T03:14:46.549119+0000","last_became_peered":"2024-09-21T03:14:46.549119+0000","last_unstale":"2024-09-21T03:15:11.442899+0000","last_undegraded":"2024-09-21T03:15:11.442899+0000","last_fullsized":"2024-09-21T03:15:11.442899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:09.622498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2858,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.691871+0000","last_change":"2024-09-21T03:15:15.687659+0000","last_active":"2024-09-21T03:15:15.691871+0000","last_peered":"2024-09-21T03:15:15.691871+0000","last_clean":"2024-09-21T03:15:15.691871+0000","last_became_active":"2024-09-21T03:15:15.687225+0000","last_became_peered":"2024-09-21T03:15:15.687225+0000","last_unstale":"2024-09-21T03:15:15.691871+0000","last_undegraded":"2024-09-21T03:15:15.691871+0000","last_fullsized":"2024-09-21T03:15:15.691871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:56.395767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557891+0000","last_change":"2024-09-21T03:14:38.482528+0000","last_active":"2024-09-21T03:14:48.557891+0000","last_peered":"2024-09-21T03:14:48.557891+0000","last_clean":"2024-09-21T03:14:48.557891+0000","last_became_active":"2024-09-21T03:14:38.482241+0000","last_became_peered":"2024-09-21T03:14:38.482241+0000","last_unstale":"2024-09-21T03:14:48.557891+0000","last_undegraded":"2024-09-21T03:14:48.557891+0000","last_fullsized":"2024-09-21T03:14:48.557891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:23.110703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684414+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:15:15.684414+0000","last_peered":"2024-09-21T03:15:15.684414+0000","last_clean":"2024-09-21T03:15:15.684414+0000","last_became_active":"2024-09-21T03:14:37.478882+0000","last_became_peered":"2024-09-21T03:14:37.478882+0000","last_unstale":"2024-09-21T03:15:15.684414+0000","last_undegraded":"2024-09-21T03:15:15.684414+0000","last_fullsized":"2024-09-21T03:15:15.684414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:11.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684629+0000","last_change":"2024-09-21T03:14:46.538817+0000","last_active":"2024-09-21T03:15:14.684629+0000","last_peered":"2024-09-21T03:15:14.684629+0000","last_clean":"2024-09-21T03:15:14.684629+0000","last_became_active":"2024-09-21T03:14:46.537835+0000","last_became_peered":"2024-09-21T03:14:46.537835+0000","last_unstale":"2024-09-21T03:15:14.684629+0000","last_undegraded":"2024-09-21T03:15:14.684629+0000","last_fullsized":"2024-09-21T03:15:14.684629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:08.236663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805566+0000","last_change":"2024-09-21T03:14:47.566534+0000","last_active":"2024-09-21T03:15:15.805566+0000","last_peered":"2024-09-21T03:15:15.805566+0000","last_clean":"2024-09-21T03:15:15.805566+0000","last_became_active":"2024-09-21T03:14:47.566157+0000","last_became_peered":"2024-09-21T03:14:47.566157+0000","last_unstale":"2024-09-21T03:15:15.805566+0000","last_undegraded":"2024-09-21T03:15:15.805566+0000","last_fullsized":"2024-09-21T03:15:15.805566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:35.557811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681246+0000","last_change":"2024-09-21T03:14:38.478509+0000","last_active":"2024-09-21T03:15:15.681246+0000","last_peered":"2024-09-21T03:15:15.681246+0000","last_clean":"2024-09-21T03:15:15.681246+0000","last_became_active":"2024-09-21T03:14:38.478197+0000","last_became_peered":"2024-09-21T03:14:38.478197+0000","last_unstale":"2024-09-21T03:15:15.681246+0000","last_undegraded":"2024-09-21T03:15:15.681246+0000","last_fullsized":"2024-09-21T03:15:15.681246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.411134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677857+0000","last_change":"2024-09-21T03:14:37.472695+0000","last_active":"2024-09-21T03:15:15.677857+0000","last_peered":"2024-09-21T03:15:15.677857+0000","last_clean":"2024-09-21T03:15:15.677857+0000","last_became_active":"2024-09-21T03:14:37.472374+0000","last_became_peered":"2024-09-21T03:14:37.472374+0000","last_unstale":"2024-09-21T03:15:15.677857+0000","last_undegraded":"2024-09-21T03:15:15.677857+0000","last_fullsized":"2024-09-21T03:15:15.677857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:11.245914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2858,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805279+0000","last_change":"2024-09-21T03:14:46.547433+0000","last_active":"2024-09-21T03:15:15.805279+0000","last_peered":"2024-09-21T03:15:15.805279+0000","last_clean":"2024-09-21T03:15:15.805279+0000","last_became_active":"2024-09-21T03:14:46.547192+0000","last_became_peered":"2024-09-21T03:14:46.547192+0000","last_unstale":"2024-09-21T03:15:15.805279+0000","last_undegraded":"2024-09-21T03:15:15.805279+0000","last_fullsized":"2024-09-21T03:15:15.805279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:03.238245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557599+0000","last_change":"2024-09-21T03:14:47.545827+0000","last_active":"2024-09-21T03:14:48.557599+0000","last_peered":"2024-09-21T03:14:48.557599+0000","last_clean":"2024-09-21T03:14:48.557599+0000","last_became_active":"2024-09-21T03:14:47.545440+0000","last_became_peered":"2024-09-21T03:14:47.545440+0000","last_unstale":"2024-09-21T03:14:48.557599+0000","last_undegraded":"2024-09-21T03:14:48.557599+0000","last_fullsized":"2024-09-21T03:14:48.557599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:20.532645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684125+0000","last_change":"2024-09-21T03:14:38.476564+0000","last_active":"2024-09-21T03:15:14.684125+0000","last_peered":"2024-09-21T03:15:14.684125+0000","last_clean":"2024-09-21T03:15:14.684125+0000","last_became_active":"2024-09-21T03:14:38.476158+0000","last_became_peered":"2024-09-21T03:14:38.476158+0000","last_unstale":"2024-09-21T03:15:14.684125+0000","last_undegraded":"2024-09-21T03:15:14.684125+0000","last_fullsized":"2024-09-21T03:15:14.684125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:26.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684904+0000","last_change":"2024-09-21T03:14:37.473709+0000","last_active":"2024-09-21T03:15:15.684904+0000","last_peered":"2024-09-21T03:15:15.684904+0000","last_clean":"2024-09-21T03:15:15.684904+0000","last_became_active":"2024-09-21T03:14:37.472544+0000","last_became_peered":"2024-09-21T03:14:37.472544+0000","last_unstale":"2024-09-21T03:15:15.684904+0000","last_undegraded":"2024-09-21T03:15:15.684904+0000","last_fullsized":"2024-09-21T03:15:15.684904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:47.892146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677701+0000","last_change":"2024-09-21T03:14:46.534201+0000","last_active":"2024-09-21T03:15:15.677701+0000","last_peered":"2024-09-21T03:15:15.677701+0000","last_clean":"2024-09-21T03:15:15.677701+0000","last_became_active":"2024-09-21T03:14:46.533891+0000","last_became_peered":"2024-09-21T03:14:46.533891+0000","last_unstale":"2024-09-21T03:15:15.677701+0000","last_undegraded":"2024-09-21T03:15:15.677701+0000","last_fullsized":"2024-09-21T03:15:15.677701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:06.645173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681643+0000","last_change":"2024-09-21T03:14:47.552016+0000","last_active":"2024-09-21T03:15:14.681643+0000","last_peered":"2024-09-21T03:15:14.681643+0000","last_clean":"2024-09-21T03:15:14.681643+0000","last_became_active":"2024-09-21T03:14:47.551622+0000","last_became_peered":"2024-09-21T03:14:47.551622+0000","last_unstale":"2024-09-21T03:15:14.681643+0000","last_undegraded":"2024-09-21T03:15:14.681643+0000","last_fullsized":"2024-09-21T03:15:14.681643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:56:04.849535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681489+0000","last_change":"2024-09-21T03:14:38.484757+0000","last_active":"2024-09-21T03:15:15.681489+0000","last_peered":"2024-09-21T03:15:15.681489+0000","last_clean":"2024-09-21T03:15:15.681489+0000","last_became_active":"2024-09-21T03:14:38.483348+0000","last_became_peered":"2024-09-21T03:14:38.483348+0000","last_unstale":"2024-09-21T03:15:15.681489+0000","last_undegraded":"2024-09-21T03:15:15.681489+0000","last_fullsized":"2024-09-21T03:15:15.681489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:57.697723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681239+0000","last_change":"2024-09-21T03:14:37.479047+0000","last_active":"2024-09-21T03:15:15.681239+0000","last_peered":"2024-09-21T03:15:15.681239+0000","last_clean":"2024-09-21T03:15:15.681239+0000","last_became_active":"2024-09-21T03:14:37.478700+0000","last_became_peered":"2024-09-21T03:14:37.478700+0000","last_unstale":"2024-09-21T03:15:15.681239+0000","last_undegraded":"2024-09-21T03:15:15.681239+0000","last_fullsized":"2024-09-21T03:15:15.681239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:31.702450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.682880+0000","last_change":"2024-09-21T03:14:46.547287+0000","last_active":"2024-09-21T03:15:15.682880+0000","last_peered":"2024-09-21T03:15:15.682880+0000","last_clean":"2024-09-21T03:15:15.682880+0000","last_became_active":"2024-09-21T03:14:46.546867+0000","last_became_peered":"2024-09-21T03:14:46.546867+0000","last_unstale":"2024-09-21T03:15:15.682880+0000","last_undegraded":"2024-09-21T03:15:15.682880+0000","last_fullsized":"2024-09-21T03:15:15.682880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:54.119841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677259+0000","last_change":"2024-09-21T03:14:47.558571+0000","last_active":"2024-09-21T03:15:15.677259+0000","last_peered":"2024-09-21T03:15:15.677259+0000","last_clean":"2024-09-21T03:15:15.677259+0000","last_became_active":"2024-09-21T03:14:47.558037+0000","last_became_peered":"2024-09-21T03:14:47.558037+0000","last_unstale":"2024-09-21T03:15:15.677259+0000","last_undegraded":"2024-09-21T03:15:15.677259+0000","last_fullsized":"2024-09-21T03:15:15.677259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:42.564181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678774+0000","last_change":"2024-09-21T03:14:38.488227+0000","last_active":"2024-09-21T03:15:15.678774+0000","last_peered":"2024-09-21T03:15:15.678774+0000","last_clean":"2024-09-21T03:15:15.678774+0000","last_became_active":"2024-09-21T03:14:38.482370+0000","last_became_peered":"2024-09-21T03:14:38.482370+0000","last_unstale":"2024-09-21T03:15:15.678774+0000","last_undegraded":"2024-09-21T03:15:15.678774+0000","last_fullsized":"2024-09-21T03:15:15.678774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:52.561391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805382+0000","last_change":"2024-09-21T03:14:37.471363+0000","last_active":"2024-09-21T03:15:15.805382+0000","last_peered":"2024-09-21T03:15:15.805382+0000","last_clean":"2024-09-21T03:15:15.805382+0000","last_became_active":"2024-09-21T03:14:37.471002+0000","last_became_peered":"2024-09-21T03:14:37.471002+0000","last_unstale":"2024-09-21T03:15:15.805382+0000","last_undegraded":"2024-09-21T03:15:15.805382+0000","last_fullsized":"2024-09-21T03:15:15.805382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:25.922368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805008+0000","last_change":"2024-09-21T03:14:46.545186+0000","last_active":"2024-09-21T03:15:15.805008+0000","last_peered":"2024-09-21T03:15:15.805008+0000","last_clean":"2024-09-21T03:15:15.805008+0000","last_became_active":"2024-09-21T03:14:46.543647+0000","last_became_peered":"2024-09-21T03:14:46.543647+0000","last_unstale":"2024-09-21T03:15:15.805008+0000","last_undegraded":"2024-09-21T03:15:15.805008+0000","last_fullsized":"2024-09-21T03:15:15.805008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:03.097368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678464+0000","last_change":"2024-09-21T03:14:47.554766+0000","last_active":"2024-09-21T03:15:15.678464+0000","last_peered":"2024-09-21T03:15:15.678464+0000","last_clean":"2024-09-21T03:15:15.678464+0000","last_became_active":"2024-09-21T03:14:47.551563+0000","last_became_peered":"2024-09-21T03:14:47.551563+0000","last_unstale":"2024-09-21T03:15:15.678464+0000","last_undegraded":"2024-09-21T03:15:15.678464+0000","last_fullsized":"2024-09-21T03:15:15.678464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:08.790725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805982+0000","last_change":"2024-09-21T03:14:46.542659+0000","last_active":"2024-09-21T03:15:15.805982+0000","last_peered":"2024-09-21T03:15:15.805982+0000","last_clean":"2024-09-21T03:15:15.805982+0000","last_became_active":"2024-09-21T03:14:46.541771+0000","last_became_peered":"2024-09-21T03:14:46.541771+0000","last_unstale":"2024-09-21T03:15:15.805982+0000","last_undegraded":"2024-09-21T03:15:15.805982+0000","last_fullsized":"2024-09-21T03:15:15.805982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:45.543904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805168+0000","last_change":"2024-09-21T03:14:38.481837+0000","last_active":"2024-09-21T03:15:15.805168+0000","last_peered":"2024-09-21T03:15:15.805168+0000","last_clean":"2024-09-21T03:15:15.805168+0000","last_became_active":"2024-09-21T03:14:38.478400+0000","last_became_peered":"2024-09-21T03:14:38.478400+0000","last_unstale":"2024-09-21T03:15:15.805168+0000","last_undegraded":"2024-09-21T03:15:15.805168+0000","last_fullsized":"2024-09-21T03:15:15.805168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.702185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681897+0000","last_change":"2024-09-21T03:14:37.459351+0000","last_active":"2024-09-21T03:15:14.681897+0000","last_peered":"2024-09-21T03:15:14.681897+0000","last_clean":"2024-09-21T03:15:14.681897+0000","last_became_active":"2024-09-21T03:14:37.458676+0000","last_became_peered":"2024-09-21T03:14:37.458676+0000","last_unstale":"2024-09-21T03:15:14.681897+0000","last_undegraded":"2024-09-21T03:15:14.681897+0000","last_fullsized":"2024-09-21T03:15:14.681897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:42.671520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558462+0000","last_change":"2024-09-21T03:14:47.561232+0000","last_active":"2024-09-21T03:14:48.558462+0000","last_peered":"2024-09-21T03:14:48.558462+0000","last_clean":"2024-09-21T03:14:48.558462+0000","last_became_active":"2024-09-21T03:14:47.557224+0000","last_became_peered":"2024-09-21T03:14:47.557224+0000","last_unstale":"2024-09-21T03:14:48.558462+0000","last_undegraded":"2024-09-21T03:14:48.558462+0000","last_fullsized":"2024-09-21T03:14:48.558462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:09.611235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.686753+0000","last_change":"2024-09-21T03:14:46.543157+0000","last_active":"2024-09-21T03:15:14.686753+0000","last_peered":"2024-09-21T03:15:14.686753+0000","last_clean":"2024-09-21T03:15:14.686753+0000","last_became_active":"2024-09-21T03:14:46.542746+0000","last_became_peered":"2024-09-21T03:14:46.542746+0000","last_unstale":"2024-09-21T03:15:14.686753+0000","last_undegraded":"2024-09-21T03:15:14.686753+0000","last_fullsized":"2024-09-21T03:15:14.686753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:30.644843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679102+0000","last_change":"2024-09-21T03:14:38.480723+0000","last_active":"2024-09-21T03:15:15.679102+0000","last_peered":"2024-09-21T03:15:15.679102+0000","last_clean":"2024-09-21T03:15:15.679102+0000","last_became_active":"2024-09-21T03:14:38.472823+0000","last_became_peered":"2024-09-21T03:14:38.472823+0000","last_unstale":"2024-09-21T03:15:15.679102+0000","last_undegraded":"2024-09-21T03:15:15.679102+0000","last_fullsized":"2024-09-21T03:15:15.679102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:59.862592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557827+0000","last_change":"2024-09-21T03:14:37.472209+0000","last_active":"2024-09-21T03:14:48.557827+0000","last_peered":"2024-09-21T03:14:48.557827+0000","last_clean":"2024-09-21T03:14:48.557827+0000","last_became_active":"2024-09-21T03:14:37.471771+0000","last_became_peered":"2024-09-21T03:14:37.471771+0000","last_unstale":"2024-09-21T03:14:48.557827+0000","last_undegraded":"2024-09-21T03:14:48.557827+0000","last_fullsized":"2024-09-21T03:14:48.557827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:30.648010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805722+0000","last_change":"2024-09-21T03:14:47.570651+0000","last_active":"2024-09-21T03:15:15.805722+0000","last_peered":"2024-09-21T03:15:15.805722+0000","last_clean":"2024-09-21T03:15:15.805722+0000","last_became_active":"2024-09-21T03:14:47.568081+0000","last_became_peered":"2024-09-21T03:14:47.568081+0000","last_unstale":"2024-09-21T03:15:15.805722+0000","last_undegraded":"2024-09-21T03:15:15.805722+0000","last_fullsized":"2024-09-21T03:15:15.805722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:45.036938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682502+0000","last_change":"2024-09-21T03:14:37.475076+0000","last_active":"2024-09-21T03:15:14.682502+0000","last_peered":"2024-09-21T03:15:14.682502+0000","last_clean":"2024-09-21T03:15:14.682502+0000","last_became_active":"2024-09-21T03:14:37.474595+0000","last_became_peered":"2024-09-21T03:14:37.474595+0000","last_unstale":"2024-09-21T03:15:14.682502+0000","last_undegraded":"2024-09-21T03:15:14.682502+0000","last_fullsized":"2024-09-21T03:15:14.682502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:16.880647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805997+0000","last_change":"2024-09-21T03:14:38.483226+0000","last_active":"2024-09-21T03:15:15.805997+0000","last_peered":"2024-09-21T03:15:15.805997+0000","last_clean":"2024-09-21T03:15:15.805997+0000","last_became_active":"2024-09-21T03:14:38.482354+0000","last_became_peered":"2024-09-21T03:14:38.482354+0000","last_unstale":"2024-09-21T03:15:15.805997+0000","last_undegraded":"2024-09-21T03:15:15.805997+0000","last_fullsized":"2024-09-21T03:15:15.805997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:51.488594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805767+0000","last_change":"2024-09-21T03:14:46.551282+0000","last_active":"2024-09-21T03:15:15.805767+0000","last_peered":"2024-09-21T03:15:15.805767+0000","last_clean":"2024-09-21T03:15:15.805767+0000","last_became_active":"2024-09-21T03:14:46.550191+0000","last_became_peered":"2024-09-21T03:14:46.550191+0000","last_unstale":"2024-09-21T03:15:15.805767+0000","last_undegraded":"2024-09-21T03:15:15.805767+0000","last_fullsized":"2024-09-21T03:15:15.805767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:32.136739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.686630+0000","last_change":"2024-09-21T03:15:15.686522+0000","last_active":"2024-09-21T03:15:15.686630+0000","last_peered":"2024-09-21T03:15:15.686630+0000","last_clean":"2024-09-21T03:15:15.686630+0000","last_became_active":"2024-09-21T03:15:15.686063+0000","last_became_peered":"2024-09-21T03:15:15.686063+0000","last_unstale":"2024-09-21T03:15:15.686630+0000","last_undegraded":"2024-09-21T03:15:15.686630+0000","last_fullsized":"2024-09-21T03:15:15.686630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:57.750372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681320+0000","last_change":"2024-09-21T03:14:37.465536+0000","last_active":"2024-09-21T03:15:15.681320+0000","last_peered":"2024-09-21T03:15:15.681320+0000","last_clean":"2024-09-21T03:15:15.681320+0000","last_became_active":"2024-09-21T03:14:37.465240+0000","last_became_peered":"2024-09-21T03:14:37.465240+0000","last_unstale":"2024-09-21T03:15:15.681320+0000","last_undegraded":"2024-09-21T03:15:15.681320+0000","last_fullsized":"2024-09-21T03:15:15.681320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:34.780298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804722+0000","last_change":"2024-09-21T03:14:38.474516+0000","last_active":"2024-09-21T03:15:15.804722+0000","last_peered":"2024-09-21T03:15:15.804722+0000","last_clean":"2024-09-21T03:15:15.804722+0000","last_became_active":"2024-09-21T03:14:38.472225+0000","last_became_peered":"2024-09-21T03:14:38.472225+0000","last_unstale":"2024-09-21T03:15:15.804722+0000","last_undegraded":"2024-09-21T03:15:15.804722+0000","last_fullsized":"2024-09-21T03:15:15.804722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:47.504910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684801+0000","last_change":"2024-09-21T03:14:46.544072+0000","last_active":"2024-09-21T03:15:15.684801+0000","last_peered":"2024-09-21T03:15:15.684801+0000","last_clean":"2024-09-21T03:15:15.684801+0000","last_became_active":"2024-09-21T03:14:46.543729+0000","last_became_peered":"2024-09-21T03:14:46.543729+0000","last_unstale":"2024-09-21T03:15:15.684801+0000","last_undegraded":"2024-09-21T03:15:15.684801+0000","last_fullsized":"2024-09-21T03:15:15.684801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:18.560012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805979+0000","last_change":"2024-09-21T03:14:47.563764+0000","last_active":"2024-09-21T03:15:15.805979+0000","last_peered":"2024-09-21T03:15:15.805979+0000","last_clean":"2024-09-21T03:15:15.805979+0000","last_became_active":"2024-09-21T03:14:47.562943+0000","last_became_peered":"2024-09-21T03:14:47.562943+0000","last_unstale":"2024-09-21T03:15:15.805979+0000","last_undegraded":"2024-09-21T03:15:15.805979+0000","last_fullsized":"2024-09-21T03:15:15.805979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:39.284350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678175+0000","last_change":"2024-09-21T03:14:38.484311+0000","last_active":"2024-09-21T03:15:15.678175+0000","last_peered":"2024-09-21T03:15:15.678175+0000","last_clean":"2024-09-21T03:15:15.678175+0000","last_became_active":"2024-09-21T03:14:38.483975+0000","last_became_peered":"2024-09-21T03:14:38.483975+0000","last_unstale":"2024-09-21T03:15:15.678175+0000","last_undegraded":"2024-09-21T03:15:15.678175+0000","last_fullsized":"2024-09-21T03:15:15.678175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:31.145431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806372+0000","last_change":"2024-09-21T03:14:47.566252+0000","last_active":"2024-09-21T03:15:15.806372+0000","last_peered":"2024-09-21T03:15:15.806372+0000","last_clean":"2024-09-21T03:15:15.806372+0000","last_became_active":"2024-09-21T03:14:47.560282+0000","last_became_peered":"2024-09-21T03:14:47.560282+0000","last_unstale":"2024-09-21T03:15:15.806372+0000","last_undegraded":"2024-09-21T03:15:15.806372+0000","last_fullsized":"2024-09-21T03:15:15.806372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:23.553847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683395+0000","last_change":"2024-09-21T03:14:38.477183+0000","last_active":"2024-09-21T03:15:15.683395+0000","last_peered":"2024-09-21T03:15:15.683395+0000","last_clean":"2024-09-21T03:15:15.683395+0000","last_became_active":"2024-09-21T03:14:38.476657+0000","last_became_peered":"2024-09-21T03:14:38.476657+0000","last_unstale":"2024-09-21T03:15:15.683395+0000","last_undegraded":"2024-09-21T03:15:15.683395+0000","last_fullsized":"2024-09-21T03:15:15.683395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:36.801764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677510+0000","last_change":"2024-09-21T03:14:47.574339+0000","last_active":"2024-09-21T03:15:15.677510+0000","last_peered":"2024-09-21T03:15:15.677510+0000","last_clean":"2024-09-21T03:15:15.677510+0000","last_became_active":"2024-09-21T03:14:47.565732+0000","last_became_peered":"2024-09-21T03:14:47.565732+0000","last_unstale":"2024-09-21T03:15:15.677510+0000","last_undegraded":"2024-09-21T03:15:15.677510+0000","last_fullsized":"2024-09-21T03:15:15.677510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:57.896810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682397+0000","last_change":"2024-09-21T03:14:38.472860+0000","last_active":"2024-09-21T03:15:14.682397+0000","last_peered":"2024-09-21T03:15:14.682397+0000","last_clean":"2024-09-21T03:15:14.682397+0000","last_became_active":"2024-09-21T03:14:38.472548+0000","last_became_peered":"2024-09-21T03:14:38.472548+0000","last_unstale":"2024-09-21T03:15:14.682397+0000","last_undegraded":"2024-09-21T03:15:14.682397+0000","last_fullsized":"2024-09-21T03:15:14.682397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:16.071692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681588+0000","last_change":"2024-09-21T03:14:47.557402+0000","last_active":"2024-09-21T03:15:15.681588+0000","last_peered":"2024-09-21T03:15:15.681588+0000","last_clean":"2024-09-21T03:15:15.681588+0000","last_became_active":"2024-09-21T03:14:47.557047+0000","last_became_peered":"2024-09-21T03:14:47.557047+0000","last_unstale":"2024-09-21T03:15:15.681588+0000","last_undegraded":"2024-09-21T03:15:15.681588+0000","last_fullsized":"2024-09-21T03:15:15.681588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:29.792514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681269+0000","last_change":"2024-09-21T03:14:38.481039+0000","last_active":"2024-09-21T03:15:15.681269+0000","last_peered":"2024-09-21T03:15:15.681269+0000","last_clean":"2024-09-21T03:15:15.681269+0000","last_became_active":"2024-09-21T03:14:38.480686+0000","last_became_peered":"2024-09-21T03:14:38.480686+0000","last_unstale":"2024-09-21T03:15:15.681269+0000","last_undegraded":"2024-09-21T03:15:15.681269+0000","last_fullsized":"2024-09-21T03:15:15.681269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:18.603386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680603+0000","last_change":"2024-09-21T03:14:47.565697+0000","last_active":"2024-09-21T03:15:15.680603+0000","last_peered":"2024-09-21T03:15:15.680603+0000","last_clean":"2024-09-21T03:15:15.680603+0000","last_became_active":"2024-09-21T03:14:47.565393+0000","last_became_peered":"2024-09-21T03:14:47.565393+0000","last_unstale":"2024-09-21T03:15:15.680603+0000","last_undegraded":"2024-09-21T03:15:15.680603+0000","last_fullsized":"2024-09-21T03:15:15.680603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:35.421803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558553+0000","last_change":"2024-09-21T03:14:38.473900+0000","last_active":"2024-09-21T03:14:48.558553+0000","last_peered":"2024-09-21T03:14:48.558553+0000","last_clean":"2024-09-21T03:14:48.558553+0000","last_became_active":"2024-09-21T03:14:38.471325+0000","last_became_peered":"2024-09-21T03:14:38.471325+0000","last_unstale":"2024-09-21T03:14:48.558553+0000","last_undegraded":"2024-09-21T03:14:48.558553+0000","last_fullsized":"2024-09-21T03:14:48.558553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:47.556293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.685190+0000","last_change":"2024-09-21T03:15:15.685059+0000","last_active":"2024-09-21T03:15:15.685190+0000","last_peered":"2024-09-21T03:15:15.685190+0000","last_clean":"2024-09-21T03:15:15.685190+0000","last_became_active":"2024-09-21T03:15:15.684633+0000","last_became_peered":"2024-09-21T03:15:15.684633+0000","last_unstale":"2024-09-21T03:15:15.685190+0000","last_undegraded":"2024-09-21T03:15:15.685190+0000","last_fullsized":"2024-09-21T03:15:15.685190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:22.251366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557408+0000","last_change":"2024-09-21T03:14:38.478099+0000","last_active":"2024-09-21T03:14:48.557408+0000","last_peered":"2024-09-21T03:14:48.557408+0000","last_clean":"2024-09-21T03:14:48.557408+0000","last_became_active":"2024-09-21T03:14:38.475894+0000","last_became_peered":"2024-09-21T03:14:38.475894+0000","last_unstale":"2024-09-21T03:14:48.557408+0000","last_undegraded":"2024-09-21T03:14:48.557408+0000","last_fullsized":"2024-09-21T03:14:48.557408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:49.876430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681689+0000","last_change":"2024-09-21T03:14:47.556933+0000","last_active":"2024-09-21T03:15:14.681689+0000","last_peered":"2024-09-21T03:15:14.681689+0000","last_clean":"2024-09-21T03:15:14.681689+0000","last_became_active":"2024-09-21T03:14:47.556615+0000","last_became_peered":"2024-09-21T03:14:47.556615+0000","last_unstale":"2024-09-21T03:15:14.681689+0000","last_undegraded":"2024-09-21T03:15:14.681689+0000","last_fullsized":"2024-09-21T03:15:14.681689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:27.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678569+0000","last_change":"2024-09-21T03:14:38.484198+0000","last_active":"2024-09-21T03:15:15.678569+0000","last_peered":"2024-09-21T03:15:15.678569+0000","last_clean":"2024-09-21T03:15:15.678569+0000","last_became_active":"2024-09-21T03:14:38.483893+0000","last_became_peered":"2024-09-21T03:14:38.483893+0000","last_unstale":"2024-09-21T03:15:15.678569+0000","last_undegraded":"2024-09-21T03:15:15.678569+0000","last_fullsized":"2024-09-21T03:15:15.678569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:56.665359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677336+0000","last_change":"2024-09-21T03:14:47.553479+0000","last_active":"2024-09-21T03:15:15.677336+0000","last_peered":"2024-09-21T03:15:15.677336+0000","last_clean":"2024-09-21T03:15:15.677336+0000","last_became_active":"2024-09-21T03:14:47.553144+0000","last_became_peered":"2024-09-21T03:14:47.553144+0000","last_unstale":"2024-09-21T03:15:15.677336+0000","last_undegraded":"2024-09-21T03:15:15.677336+0000","last_fullsized":"2024-09-21T03:15:15.677336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:26.321488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681234+0000","last_change":"2024-09-21T03:14:38.487093+0000","last_active":"2024-09-21T03:15:15.681234+0000","last_peered":"2024-09-21T03:15:15.681234+0000","last_clean":"2024-09-21T03:15:15.681234+0000","last_became_active":"2024-09-21T03:14:38.486204+0000","last_became_peered":"2024-09-21T03:14:38.486204+0000","last_unstale":"2024-09-21T03:15:15.681234+0000","last_undegraded":"2024-09-21T03:15:15.681234+0000","last_fullsized":"2024-09-21T03:15:15.681234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:55.531046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684987+0000","last_change":"2024-09-21T03:14:47.573375+0000","last_active":"2024-09-21T03:15:15.684987+0000","last_peered":"2024-09-21T03:15:15.684987+0000","last_clean":"2024-09-21T03:15:15.684987+0000","last_became_active":"2024-09-21T03:14:47.572717+0000","last_became_peered":"2024-09-21T03:14:47.572717+0000","last_unstale":"2024-09-21T03:15:15.684987+0000","last_undegraded":"2024-09-21T03:15:15.684987+0000","last_fullsized":"2024-09-21T03:15:15.684987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:44.673283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681844+0000","last_change":"2024-09-21T03:14:38.471959+0000","last_active":"2024-09-21T03:15:14.681844+0000","last_peered":"2024-09-21T03:15:14.681844+0000","last_clean":"2024-09-21T03:15:14.681844+0000","last_became_active":"2024-09-21T03:14:38.471625+0000","last_became_peered":"2024-09-21T03:14:38.471625+0000","last_unstale":"2024-09-21T03:15:14.681844+0000","last_undegraded":"2024-09-21T03:15:14.681844+0000","last_fullsized":"2024-09-21T03:15:14.681844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:17.761951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.687099+0000","last_change":"2024-09-21T03:14:47.564597+0000","last_active":"2024-09-21T03:15:14.687099+0000","last_peered":"2024-09-21T03:15:14.687099+0000","last_clean":"2024-09-21T03:15:14.687099+0000","last_became_active":"2024-09-21T03:14:47.563816+0000","last_became_peered":"2024-09-21T03:14:47.563816+0000","last_unstale":"2024-09-21T03:15:14.687099+0000","last_undegraded":"2024-09-21T03:15:14.687099+0000","last_fullsized":"2024-09-21T03:15:14.687099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:33.061271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678841+0000","last_change":"2024-09-21T03:14:38.491888+0000","last_active":"2024-09-21T03:15:15.678841+0000","last_peered":"2024-09-21T03:15:15.678841+0000","last_clean":"2024-09-21T03:15:15.678841+0000","last_became_active":"2024-09-21T03:14:38.491510+0000","last_became_peered":"2024-09-21T03:14:38.491510+0000","last_unstale":"2024-09-21T03:15:15.678841+0000","last_undegraded":"2024-09-21T03:15:15.678841+0000","last_fullsized":"2024-09-21T03:15:15.678841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:26.740304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558275+0000","last_change":"2024-09-21T03:14:47.564310+0000","last_active":"2024-09-21T03:14:48.558275+0000","last_peered":"2024-09-21T03:14:48.558275+0000","last_clean":"2024-09-21T03:14:48.558275+0000","last_became_active":"2024-09-21T03:14:47.564003+0000","last_became_peered":"2024-09-21T03:14:47.564003+0000","last_unstale":"2024-09-21T03:14:48.558275+0000","last_undegraded":"2024-09-21T03:14:48.558275+0000","last_fullsized":"2024-09-21T03:14:48.558275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:45.016321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804618+0000","last_change":"2024-09-21T03:14:38.470991+0000","last_active":"2024-09-21T03:15:15.804618+0000","last_peered":"2024-09-21T03:15:15.804618+0000","last_clean":"2024-09-21T03:15:15.804618+0000","last_became_active":"2024-09-21T03:14:38.470666+0000","last_became_peered":"2024-09-21T03:14:38.470666+0000","last_unstale":"2024-09-21T03:15:15.804618+0000","last_undegraded":"2024-09-21T03:15:15.804618+0000","last_fullsized":"2024-09-21T03:15:15.804618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:25.477992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684492+0000","last_change":"2024-09-21T03:14:47.575212+0000","last_active":"2024-09-21T03:15:15.684492+0000","last_peered":"2024-09-21T03:15:15.684492+0000","last_clean":"2024-09-21T03:15:15.684492+0000","last_became_active":"2024-09-21T03:14:47.574895+0000","last_became_peered":"2024-09-21T03:14:47.574895+0000","last_unstale":"2024-09-21T03:15:15.684492+0000","last_undegraded":"2024-09-21T03:15:15.684492+0000","last_fullsized":"2024-09-21T03:15:15.684492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:04.240949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806008+0000","last_change":"2024-09-21T03:14:38.482681+0000","last_active":"2024-09-21T03:15:15.806008+0000","last_peered":"2024-09-21T03:15:15.806008+0000","last_clean":"2024-09-21T03:15:15.806008+0000","last_became_active":"2024-09-21T03:14:38.477816+0000","last_became_peered":"2024-09-21T03:14:38.477816+0000","last_unstale":"2024-09-21T03:15:15.806008+0000","last_undegraded":"2024-09-21T03:15:15.806008+0000","last_fullsized":"2024-09-21T03:15:15.806008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:18.675641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677394+0000","last_change":"2024-09-21T03:14:47.555329+0000","last_active":"2024-09-21T03:15:15.677394+0000","last_peered":"2024-09-21T03:15:15.677394+0000","last_clean":"2024-09-21T03:15:15.677394+0000","last_became_active":"2024-09-21T03:14:47.555033+0000","last_became_peered":"2024-09-21T03:14:47.555033+0000","last_unstale":"2024-09-21T03:15:15.677394+0000","last_undegraded":"2024-09-21T03:15:15.677394+0000","last_fullsized":"2024-09-21T03:15:15.677394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:49.060834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681613+0000","last_change":"2024-09-21T03:14:38.480638+0000","last_active":"2024-09-21T03:15:15.681613+0000","last_peered":"2024-09-21T03:15:15.681613+0000","last_clean":"2024-09-21T03:15:15.681613+0000","last_became_active":"2024-09-21T03:14:38.477739+0000","last_became_peered":"2024-09-21T03:14:38.477739+0000","last_unstale":"2024-09-21T03:15:15.681613+0000","last_undegraded":"2024-09-21T03:15:15.681613+0000","last_fullsized":"2024-09-21T03:15:15.681613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:35.097761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680739+0000","last_change":"2024-09-21T03:14:47.573659+0000","last_active":"2024-09-21T03:15:15.680739+0000","last_peered":"2024-09-21T03:15:15.680739+0000","last_clean":"2024-09-21T03:15:15.680739+0000","last_became_active":"2024-09-21T03:14:47.572756+0000","last_became_peered":"2024-09-21T03:14:47.572756+0000","last_unstale":"2024-09-21T03:15:15.680739+0000","last_undegraded":"2024-09-21T03:15:15.680739+0000","last_fullsized":"2024-09-21T03:15:15.680739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:21.986681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.685032+0000","last_change":"2024-09-21T03:14:38.478039+0000","last_active":"2024-09-21T03:15:14.685032+0000","last_peered":"2024-09-21T03:15:14.685032+0000","last_clean":"2024-09-21T03:15:14.685032+0000","last_became_active":"2024-09-21T03:14:38.473843+0000","last_became_peered":"2024-09-21T03:14:38.473843+0000","last_unstale":"2024-09-21T03:15:14.685032+0000","last_undegraded":"2024-09-21T03:15:14.685032+0000","last_fullsized":"2024-09-21T03:15:14.685032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:27.072406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677250+0000","last_change":"2024-09-21T03:14:47.555386+0000","last_active":"2024-09-21T03:15:15.677250+0000","last_peered":"2024-09-21T03:15:15.677250+0000","last_clean":"2024-09-21T03:15:15.677250+0000","last_became_active":"2024-09-21T03:14:47.554758+0000","last_became_peered":"2024-09-21T03:14:47.554758+0000","last_unstale":"2024-09-21T03:15:15.677250+0000","last_undegraded":"2024-09-21T03:15:15.677250+0000","last_fullsized":"2024-09-21T03:15:15.677250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:47.574672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.685167+0000","last_change":"2024-09-21T03:14:38.494878+0000","last_active":"2024-09-21T03:15:15.685167+0000","last_peered":"2024-09-21T03:15:15.685167+0000","last_clean":"2024-09-21T03:15:15.685167+0000","last_became_active":"2024-09-21T03:14:38.492813+0000","last_became_peered":"2024-09-21T03:14:38.492813+0000","last_unstale":"2024-09-21T03:15:15.685167+0000","last_undegraded":"2024-09-21T03:15:15.685167+0000","last_fullsized":"2024-09-21T03:15:15.685167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:55.064844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557554+0000","last_change":"2024-09-21T03:14:47.544806+0000","last_active":"2024-09-21T03:14:48.557554+0000","last_peered":"2024-09-21T03:14:48.557554+0000","last_clean":"2024-09-21T03:14:48.557554+0000","last_became_active":"2024-09-21T03:14:47.544431+0000","last_became_peered":"2024-09-21T03:14:47.544431+0000","last_unstale":"2024-09-21T03:14:48.557554+0000","last_undegraded":"2024-09-21T03:14:48.557554+0000","last_fullsized":"2024-09-21T03:14:48.557554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:01.463573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.687263+0000","last_change":"2024-09-21T03:14:38.474462+0000","last_active":"2024-09-21T03:15:14.687263+0000","last_peered":"2024-09-21T03:15:14.687263+0000","last_clean":"2024-09-21T03:15:14.687263+0000","last_became_active":"2024-09-21T03:14:38.474156+0000","last_became_peered":"2024-09-21T03:14:38.474156+0000","last_unstale":"2024-09-21T03:15:14.687263+0000","last_undegraded":"2024-09-21T03:15:14.687263+0000","last_fullsized":"2024-09-21T03:15:14.687263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:55.329945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806137+0000","last_change":"2024-09-21T03:14:47.563297+0000","last_active":"2024-09-21T03:15:15.806137+0000","last_peered":"2024-09-21T03:15:15.806137+0000","last_clean":"2024-09-21T03:15:15.806137+0000","last_became_active":"2024-09-21T03:14:47.562519+0000","last_became_peered":"2024-09-21T03:14:47.562519+0000","last_unstale":"2024-09-21T03:15:15.806137+0000","last_undegraded":"2024-09-21T03:15:15.806137+0000","last_fullsized":"2024-09-21T03:15:15.806137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:47.959373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681798+0000","last_change":"2024-09-21T03:14:38.474262+0000","last_active":"2024-09-21T03:15:14.681798+0000","last_peered":"2024-09-21T03:15:14.681798+0000","last_clean":"2024-09-21T03:15:14.681798+0000","last_became_active":"2024-09-21T03:14:38.473856+0000","last_became_peered":"2024-09-21T03:14:38.473856+0000","last_unstale":"2024-09-21T03:15:14.681798+0000","last_undegraded":"2024-09-21T03:15:14.681798+0000","last_fullsized":"2024-09-21T03:15:14.681798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804869+0000","last_change":"2024-09-21T03:14:47.558732+0000","last_active":"2024-09-21T03:15:15.804869+0000","last_peered":"2024-09-21T03:15:15.804869+0000","last_clean":"2024-09-21T03:15:15.804869+0000","last_became_active":"2024-09-21T03:14:47.558403+0000","last_became_peered":"2024-09-21T03:14:47.558403+0000","last_unstale":"2024-09-21T03:15:15.804869+0000","last_undegraded":"2024-09-21T03:15:15.804869+0000","last_fullsized":"2024-09-21T03:15:15.804869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:46.054565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678631+0000","last_change":"2024-09-21T03:14:38.469736+0000","last_active":"2024-09-21T03:15:15.678631+0000","last_peered":"2024-09-21T03:15:15.678631+0000","last_clean":"2024-09-21T03:15:15.678631+0000","last_became_active":"2024-09-21T03:14:38.469240+0000","last_became_peered":"2024-09-21T03:14:38.469240+0000","last_unstale":"2024-09-21T03:15:15.678631+0000","last_undegraded":"2024-09-21T03:15:15.678631+0000","last_fullsized":"2024-09-21T03:15:15.678631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:04.258761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804652+0000","last_change":"2024-09-21T03:14:47.550684+0000","last_active":"2024-09-21T03:15:15.804652+0000","last_peered":"2024-09-21T03:15:15.804652+0000","last_clean":"2024-09-21T03:15:15.804652+0000","last_became_active":"2024-09-21T03:14:47.550375+0000","last_became_peered":"2024-09-21T03:14:47.550375+0000","last_unstale":"2024-09-21T03:15:15.804652+0000","last_undegraded":"2024-09-21T03:15:15.804652+0000","last_fullsized":"2024-09-21T03:15:15.804652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:05.268160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557691+0000","last_change":"2024-09-21T03:14:38.487983+0000","last_active":"2024-09-21T03:14:48.557691+0000","last_peered":"2024-09-21T03:14:48.557691+0000","last_clean":"2024-09-21T03:14:48.557691+0000","last_became_active":"2024-09-21T03:14:38.487676+0000","last_became_peered":"2024-09-21T03:14:38.487676+0000","last_unstale":"2024-09-21T03:14:48.557691+0000","last_undegraded":"2024-09-21T03:14:48.557691+0000","last_fullsized":"2024-09-21T03:14:48.557691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:35.320169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684351+0000","last_change":"2024-09-21T03:14:47.561566+0000","last_active":"2024-09-21T03:15:14.684351+0000","last_peered":"2024-09-21T03:15:14.684351+0000","last_clean":"2024-09-21T03:15:14.684351+0000","last_became_active":"2024-09-21T03:14:47.561229+0000","last_became_peered":"2024-09-21T03:14:47.561229+0000","last_unstale":"2024-09-21T03:15:14.684351+0000","last_undegraded":"2024-09-21T03:15:14.684351+0000","last_fullsized":"2024-09-21T03:15:14.684351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:07.280356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558891+0000","last_change":"2024-09-21T03:14:38.478853+0000","last_active":"2024-09-21T03:14:48.558891+0000","last_peered":"2024-09-21T03:14:48.558891+0000","last_clean":"2024-09-21T03:14:48.558891+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:14:48.558891+0000","last_undegraded":"2024-09-21T03:14:48.558891+0000","last_fullsized":"2024-09-21T03:14:48.558891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:31.427596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":2,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-21T03:14:51.026823+0000","last_change":"2024-09-21T03:15:15.025321+0000","last_active":"2024-09-21T03:15:15.025321+0000","last_peered":"2024-09-21T03:14:51.026823+0000","last_clean":"2024-09-21T03:14:51.026823+0000","last_became_active":"2024-09-21T03:14:47.552659+0000","last_became_peered":"2024-09-21T03:14:47.552659+0000","last_unstale":"2024-09-21T03:14:51.026823+0000","last_undegraded":"2024-09-21T03:14:51.026823+0000","last_fullsized":"2024-09-21T03:14:51.026823+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681084+0000","last_change":"2024-09-21T03:14:38.481308+0000","last_active":"2024-09-21T03:15:15.681084+0000","last_peered":"2024-09-21T03:15:15.681084+0000","last_clean":"2024-09-21T03:15:15.681084+0000","last_became_active":"2024-09-21T03:14:38.480923+0000","last_became_peered":"2024-09-21T03:14:38.480923+0000","last_unstale":"2024-09-21T03:15:15.681084+0000","last_undegraded":"2024-09-21T03:15:15.681084+0000","last_fullsized":"2024-09-21T03:15:15.681084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:40.689231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557324+0000","last_change":"2024-09-21T03:14:47.561972+0000","last_active":"2024-09-21T03:14:48.557324+0000","last_peered":"2024-09-21T03:14:48.557324+0000","last_clean":"2024-09-21T03:14:48.557324+0000","last_became_active":"2024-09-21T03:14:47.561645+0000","last_became_peered":"2024-09-21T03:14:47.561645+0000","last_unstale":"2024-09-21T03:14:48.557324+0000","last_undegraded":"2024-09-21T03:14:48.557324+0000","last_fullsized":"2024-09-21T03:14:48.557324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:57.526787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681129+0000","last_change":"2024-09-21T03:14:38.473907+0000","last_active":"2024-09-21T03:15:15.681129+0000","last_peered":"2024-09-21T03:15:15.681129+0000","last_clean":"2024-09-21T03:15:15.681129+0000","last_became_active":"2024-09-21T03:14:38.473579+0000","last_became_peered":"2024-09-21T03:14:38.473579+0000","last_unstale":"2024-09-21T03:15:15.681129+0000","last_undegraded":"2024-09-21T03:15:15.681129+0000","last_fullsized":"2024-09-21T03:15:15.681129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:32.273503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680383+0000","last_change":"2024-09-21T03:14:47.566089+0000","last_active":"2024-09-21T03:15:15.680383+0000","last_peered":"2024-09-21T03:15:15.680383+0000","last_clean":"2024-09-21T03:15:15.680383+0000","last_became_active":"2024-09-21T03:14:47.565681+0000","last_became_peered":"2024-09-21T03:14:47.565681+0000","last_unstale":"2024-09-21T03:15:15.680383+0000","last_undegraded":"2024-09-21T03:15:15.680383+0000","last_fullsized":"2024-09-21T03:15:15.680383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.208933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681048+0000","last_change":"2024-09-21T03:14:38.474326+0000","last_active":"2024-09-21T03:15:15.681048+0000","last_peered":"2024-09-21T03:15:15.681048+0000","last_clean":"2024-09-21T03:15:15.681048+0000","last_became_active":"2024-09-21T03:14:38.470430+0000","last_became_peered":"2024-09-21T03:14:38.470430+0000","last_unstale":"2024-09-21T03:15:15.681048+0000","last_undegraded":"2024-09-21T03:15:15.681048+0000","last_fullsized":"2024-09-21T03:15:15.681048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:09.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680250+0000","last_change":"2024-09-21T03:14:47.571487+0000","last_active":"2024-09-21T03:15:15.680250+0000","last_peered":"2024-09-21T03:15:15.680250+0000","last_clean":"2024-09-21T03:15:15.680250+0000","last_became_active":"2024-09-21T03:14:47.571126+0000","last_became_peered":"2024-09-21T03:14:47.571126+0000","last_unstale":"2024-09-21T03:15:15.680250+0000","last_undegraded":"2024-09-21T03:15:15.680250+0000","last_fullsized":"2024-09-21T03:15:15.680250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:57.128853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805276+0000","last_change":"2024-09-21T03:14:38.483370+0000","last_active":"2024-09-21T03:15:15.805276+0000","last_peered":"2024-09-21T03:15:15.805276+0000","last_clean":"2024-09-21T03:15:15.805276+0000","last_became_active":"2024-09-21T03:14:38.483019+0000","last_became_peered":"2024-09-21T03:14:38.483019+0000","last_unstale":"2024-09-21T03:15:15.805276+0000","last_undegraded":"2024-09-21T03:15:15.805276+0000","last_fullsized":"2024-09-21T03:15:15.805276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:55.085422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679803+0000","last_change":"2024-09-21T03:14:47.555777+0000","last_active":"2024-09-21T03:15:15.679803+0000","last_peered":"2024-09-21T03:15:15.679803+0000","last_clean":"2024-09-21T03:15:15.679803+0000","last_became_active":"2024-09-21T03:14:47.555465+0000","last_became_peered":"2024-09-21T03:14:47.555465+0000","last_unstale":"2024-09-21T03:15:15.679803+0000","last_undegraded":"2024-09-21T03:15:15.679803+0000","last_fullsized":"2024-09-21T03:15:15.679803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:27.123740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678858+0000","last_change":"2024-09-21T03:14:38.465771+0000","last_active":"2024-09-21T03:15:15.678858+0000","last_peered":"2024-09-21T03:15:15.678858+0000","last_clean":"2024-09-21T03:15:15.678858+0000","last_became_active":"2024-09-21T03:14:38.465479+0000","last_became_peered":"2024-09-21T03:14:38.465479+0000","last_unstale":"2024-09-21T03:15:15.678858+0000","last_undegraded":"2024-09-21T03:15:15.678858+0000","last_fullsized":"2024-09-21T03:15:15.678858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.754315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678369+0000","last_change":"2024-09-21T03:14:47.567695+0000","last_active":"2024-09-21T03:15:15.678369+0000","last_peered":"2024-09-21T03:15:15.678369+0000","last_clean":"2024-09-21T03:15:15.678369+0000","last_became_active":"2024-09-21T03:14:47.566936+0000","last_became_peered":"2024-09-21T03:14:47.566936+0000","last_unstale":"2024-09-21T03:15:15.678369+0000","last_undegraded":"2024-09-21T03:15:15.678369+0000","last_fullsized":"2024-09-21T03:15:15.678369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:48.182523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.808619+0000","last_change":"2024-09-21T03:15:15.807206+0000","last_active":"2024-09-21T03:15:15.808619+0000","last_peered":"2024-09-21T03:15:15.808619+0000","last_clean":"2024-09-21T03:15:15.808619+0000","last_became_active":"2024-09-21T03:15:15.806775+0000","last_became_peered":"2024-09-21T03:15:15.806775+0000","last_unstale":"2024-09-21T03:15:15.808619+0000","last_undegraded":"2024-09-21T03:15:15.808619+0000","last_fullsized":"2024-09-21T03:15:15.808619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:51.779236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805513+0000","last_change":"2024-09-21T03:14:47.580314+0000","last_active":"2024-09-21T03:15:15.805513+0000","last_peered":"2024-09-21T03:15:15.805513+0000","last_clean":"2024-09-21T03:15:15.805513+0000","last_became_active":"2024-09-21T03:14:47.576499+0000","last_became_peered":"2024-09-21T03:14:47.576499+0000","last_unstale":"2024-09-21T03:15:15.805513+0000","last_undegraded":"2024-09-21T03:15:15.805513+0000","last_fullsized":"2024-09-21T03:15:15.805513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:46.154586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678336+0000","last_change":"2024-09-21T03:14:38.471270+0000","last_active":"2024-09-21T03:15:15.678336+0000","last_peered":"2024-09-21T03:15:15.678336+0000","last_clean":"2024-09-21T03:15:15.678336+0000","last_became_active":"2024-09-21T03:14:38.470708+0000","last_became_peered":"2024-09-21T03:14:38.470708+0000","last_unstale":"2024-09-21T03:15:15.678336+0000","last_undegraded":"2024-09-21T03:15:15.678336+0000","last_fullsized":"2024-09-21T03:15:15.678336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.122804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804703+0000","last_change":"2024-09-21T03:14:47.554180+0000","last_active":"2024-09-21T03:15:15.804703+0000","last_peered":"2024-09-21T03:15:15.804703+0000","last_clean":"2024-09-21T03:15:15.804703+0000","last_became_active":"2024-09-21T03:14:47.552808+0000","last_became_peered":"2024-09-21T03:14:47.552808+0000","last_unstale":"2024-09-21T03:15:15.804703+0000","last_undegraded":"2024-09-21T03:15:15.804703+0000","last_fullsized":"2024-09-21T03:15:15.804703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:07.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681593+0000","last_change":"2024-09-21T03:14:38.466077+0000","last_active":"2024-09-21T03:15:15.681593+0000","last_peered":"2024-09-21T03:15:15.681593+0000","last_clean":"2024-09-21T03:15:15.681593+0000","last_became_active":"2024-09-21T03:14:38.465818+0000","last_became_peered":"2024-09-21T03:14:38.465818+0000","last_unstale":"2024-09-21T03:15:15.681593+0000","last_undegraded":"2024-09-21T03:15:15.681593+0000","last_fullsized":"2024-09-21T03:15:15.681593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:34.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684015+0000","last_change":"2024-09-21T03:14:47.577228+0000","last_active":"2024-09-21T03:15:15.684015+0000","last_peered":"2024-09-21T03:15:15.684015+0000","last_clean":"2024-09-21T03:15:15.684015+0000","last_became_active":"2024-09-21T03:14:47.576843+0000","last_became_peered":"2024-09-21T03:14:47.576843+0000","last_unstale":"2024-09-21T03:15:15.684015+0000","last_undegraded":"2024-09-21T03:15:15.684015+0000","last_fullsized":"2024-09-21T03:15:15.684015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:56.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677741+0000","last_change":"2024-09-21T03:14:38.481389+0000","last_active":"2024-09-21T03:15:15.677741+0000","last_peered":"2024-09-21T03:15:15.677741+0000","last_clean":"2024-09-21T03:15:15.677741+0000","last_became_active":"2024-09-21T03:14:38.470907+0000","last_became_peered":"2024-09-21T03:14:38.470907+0000","last_unstale":"2024-09-21T03:15:15.677741+0000","last_undegraded":"2024-09-21T03:15:15.677741+0000","last_fullsized":"2024-09-21T03:15:15.677741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:30.068915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680895+0000","last_change":"2024-09-21T03:14:47.551766+0000","last_active":"2024-09-21T03:15:15.680895+0000","last_peered":"2024-09-21T03:15:15.680895+0000","last_clean":"2024-09-21T03:15:15.680895+0000","last_became_active":"2024-09-21T03:14:47.551420+0000","last_became_peered":"2024-09-21T03:14:47.551420+0000","last_unstale":"2024-09-21T03:15:15.680895+0000","last_undegraded":"2024-09-21T03:15:15.680895+0000","last_fullsized":"2024-09-21T03:15:15.680895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:56.255472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681739+0000","last_change":"2024-09-21T03:14:38.482605+0000","last_active":"2024-09-21T03:15:15.681739+0000","last_peered":"2024-09-21T03:15:15.681739+0000","last_clean":"2024-09-21T03:15:15.681739+0000","last_became_active":"2024-09-21T03:14:38.482306+0000","last_became_peered":"2024-09-21T03:14:38.482306+0000","last_unstale":"2024-09-21T03:15:15.681739+0000","last_undegraded":"2024-09-21T03:15:15.681739+0000","last_fullsized":"2024-09-21T03:15:15.681739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:40.482635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678145+0000","last_change":"2024-09-21T03:14:47.555070+0000","last_active":"2024-09-21T03:15:15.678145+0000","last_peered":"2024-09-21T03:15:15.678145+0000","last_clean":"2024-09-21T03:15:15.678145+0000","last_became_active":"2024-09-21T03:14:47.554363+0000","last_became_peered":"2024-09-21T03:14:47.554363+0000","last_unstale":"2024-09-21T03:15:15.678145+0000","last_undegraded":"2024-09-21T03:15:15.678145+0000","last_fullsized":"2024-09-21T03:15:15.678145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:40.027266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680191+0000","last_change":"2024-09-21T03:14:38.496218+0000","last_active":"2024-09-21T03:15:15.680191+0000","last_peered":"2024-09-21T03:15:15.680191+0000","last_clean":"2024-09-21T03:15:15.680191+0000","last_became_active":"2024-09-21T03:14:38.488537+0000","last_became_peered":"2024-09-21T03:14:38.488537+0000","last_unstale":"2024-09-21T03:15:15.680191+0000","last_undegraded":"2024-09-21T03:15:15.680191+0000","last_fullsized":"2024-09-21T03:15:15.680191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:59.667392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677329+0000","last_change":"2024-09-21T03:14:47.564250+0000","last_active":"2024-09-21T03:15:15.677329+0000","last_peered":"2024-09-21T03:15:15.677329+0000","last_clean":"2024-09-21T03:15:15.677329+0000","last_became_active":"2024-09-21T03:14:47.563745+0000","last_became_peered":"2024-09-21T03:14:47.563745+0000","last_unstale":"2024-09-21T03:15:15.677329+0000","last_undegraded":"2024-09-21T03:15:15.677329+0000","last_fullsized":"2024-09-21T03:15:15.677329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:31.282910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681230+0000","last_change":"2024-09-21T03:14:38.490309+0000","last_active":"2024-09-21T03:15:15.681230+0000","last_peered":"2024-09-21T03:15:15.681230+0000","last_clean":"2024-09-21T03:15:15.681230+0000","last_became_active":"2024-09-21T03:14:38.489167+0000","last_became_peered":"2024-09-21T03:14:38.489167+0000","last_unstale":"2024-09-21T03:15:15.681230+0000","last_undegraded":"2024-09-21T03:15:15.681230+0000","last_fullsized":"2024-09-21T03:15:15.681230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:07.725691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3656,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3656,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":698575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":319488,"data_stored":120849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":110425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":698041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":103380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":101880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:15:16.559 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:15:16.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.812+0000 7f8f54600640 1 -- 172.21.15.90:0/78183022 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f4c0708e0 msgr2=0x7f8f4c06ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:16.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.812+0000 7f8f54600640 1 --2- 172.21.15.90:0/78183022 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f4c0708e0 0x7f8f4c06ec10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8f38009830 tx=0x7f8f3802a510 comp rx=0 tx=0).stop 2024-09-21T03:15:16.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.812+0000 7f8f54600640 1 -- 172.21.15.90:0/78183022 shutdown_connections 2024-09-21T03:15:16.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.812+0000 7f8f54600640 1 --2- 172.21.15.90:0/78183022 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f4c0708e0 0x7f8f4c06ec10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:16.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.812+0000 7f8f54600640 1 --2- 172.21.15.90:0/78183022 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f4c074c50 0x7f8f4c06e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:16.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.812+0000 7f8f54600640 1 -- 172.21.15.90:0/78183022 >> 172.21.15.90:0/78183022 conn(0x7f8f4c0c8ba0 msgr2=0x7f8f4c06cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:16.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.812+0000 7f8f54600640 1 -- 172.21.15.90:0/78183022 shutdown_connections 2024-09-21T03:15:16.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.812+0000 7f8f54600640 1 -- 172.21.15.90:0/78183022 wait complete. 2024-09-21T03:15:16.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.814+0000 7f8f54600640 1 Processor -- start 2024-09-21T03:15:16.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.815+0000 7f8f54600640 1 -- start start 2024-09-21T03:15:16.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.816+0000 7f8f54600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f4c0708e0 0x7f8f4c150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:16.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.816+0000 7f8f54600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f4c074c50 0x7f8f4c0c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:16.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.816+0000 7f8f54600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f4c0c2e00 0x7f8f4c147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:16.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.816+0000 7f8f54600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c0ac9d0 con 0x7f8f4c074c50 2024-09-21T03:15:16.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.816+0000 7f8f54600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c0ac850 con 0x7f8f4c0c2e00 2024-09-21T03:15:16.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.816+0000 7f8f54600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8f4c1576e0 con 0x7f8f4c0708e0 2024-09-21T03:15:16.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.816+0000 7f8f51200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f4c074c50 0x7f8f4c0c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:16.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.816+0000 7f8f51200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f4c074c50 0x7f8f4c0c7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47626/0 (socket says 172.21.15.90:47626) 2024-09-21T03:15:16.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.816+0000 7f8f51200640 1 -- 172.21.15.90:0/2040145674 learned_addr learned my addr 172.21.15.90:0/2040145674 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:16.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.817+0000 7f8f52600640 1 --2- 172.21.15.90:0/2040145674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f4c0c2e00 0x7f8f4c147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:16.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.817+0000 7f8f51200640 1 -- 172.21.15.90:0/2040145674 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f4c0708e0 msgr2=0x7f8f4c150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:16.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.817+0000 7f8f51200640 1 --2- 172.21.15.90:0/2040145674 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f4c0708e0 0x7f8f4c150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:16.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.817+0000 7f8f51200640 1 -- 172.21.15.90:0/2040145674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f4c0c2e00 msgr2=0x7f8f4c147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:16.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.817+0000 7f8f51200640 1 --2- 172.21.15.90:0/2040145674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f4c0c2e00 0x7f8f4c147360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:16.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.817+0000 7f8f51200640 1 -- 172.21.15.90:0/2040145674 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4c1de780 con 0x7f8f4c074c50 2024-09-21T03:15:16.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.817+0000 7f8f52600640 1 --2- 172.21.15.90:0/2040145674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f4c0c2e00 0x7f8f4c147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:15:16.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.817+0000 7f8f51200640 1 --2- 172.21.15.90:0/2040145674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f4c074c50 0x7f8f4c0c7410 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8f38000c00 tx=0x7f8f38033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:16.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.817+0000 7f8f49600640 1 -- 172.21.15.90:0/2040145674 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f38005c90 con 0x7f8f4c074c50 2024-09-21T03:15:16.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.817+0000 7f8f49600640 1 -- 172.21.15.90:0/2040145674 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f38031e50 con 0x7f8f4c074c50 2024-09-21T03:15:16.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.817+0000 7f8f49600640 1 -- 172.21.15.90:0/2040145674 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f380332f0 con 0x7f8f4c074c50 2024-09-21T03:15:16.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.817+0000 7f8f54600640 1 -- 172.21.15.90:0/2040145674 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f4c147ea0 con 0x7f8f4c074c50 2024-09-21T03:15:16.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.817+0000 7f8f54600640 1 -- 172.21.15.90:0/2040145674 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f4c0c5d90 con 0x7f8f4c074c50 2024-09-21T03:15:16.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.818+0000 7f8f54600640 1 -- 172.21.15.90:0/2040145674 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f4c156fd0 con 0x7f8f4c074c50 2024-09-21T03:15:16.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.820+0000 7f8f49600640 1 -- 172.21.15.90:0/2040145674 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8f38033490 con 0x7f8f4c074c50 2024-09-21T03:15:16.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.820+0000 7f8f49600640 1 --2- 172.21.15.90:0/2040145674 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8f2c078b90 0x7f8f2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:16.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.821+0000 7f8f49600640 1 -- 172.21.15.90:0/2040145674 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f8f380bc4d0 con 0x7f8f4c074c50 2024-09-21T03:15:16.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.821+0000 7f8f51c00640 1 --2- 172.21.15.90:0/2040145674 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8f2c078b90 0x7f8f2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:16.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.822+0000 7f8f51c00640 1 --2- 172.21.15.90:0/2040145674 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8f2c078b90 0x7f8f2c07b0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000b980 tx=0x7f8f40005ce0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:16.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:16.825+0000 7f8f49600640 1 -- 172.21.15.90:0/2040145674 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8f3803f030 con 0x7f8f4c074c50 2024-09-21T03:15:17.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.008+0000 7f8f54600640 1 -- 172.21.15.90:0/2040145674 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8f4c0c2bc0 con 0x7f8f2c078b90 2024-09-21T03:15:17.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.017+0000 7f8f49600640 1 -- 172.21.15.90:0/2040145674 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490343 (secure 0 0 0) 0x7f8f4c0c2bc0 con 0x7f8f2c078b90 2024-09-21T03:15:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:15:17.028 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-21T03:15:17.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.023+0000 7f8f54600640 1 -- 172.21.15.90:0/2040145674 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8f2c078b90 msgr2=0x7f8f2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:17.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.023+0000 7f8f54600640 1 --2- 172.21.15.90:0/2040145674 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8f2c078b90 0x7f8f2c07b0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000b980 tx=0x7f8f40005ce0 comp rx=0 tx=0).stop 2024-09-21T03:15:17.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.023+0000 7f8f54600640 1 -- 172.21.15.90:0/2040145674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f4c074c50 msgr2=0x7f8f4c0c7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:17.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.023+0000 7f8f54600640 1 --2- 172.21.15.90:0/2040145674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f4c074c50 0x7f8f4c0c7410 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8f38000c00 tx=0x7f8f38033c90 comp rx=0 tx=0).stop 2024-09-21T03:15:17.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.023+0000 7f8f54600640 1 -- 172.21.15.90:0/2040145674 shutdown_connections 2024-09-21T03:15:17.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.023+0000 7f8f54600640 1 --2- 172.21.15.90:0/2040145674 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8f2c078b90 0x7f8f2c07b0a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:17.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.023+0000 7f8f54600640 1 --2- 172.21.15.90:0/2040145674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f4c0c2e00 0x7f8f4c147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:17.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.023+0000 7f8f54600640 1 --2- 172.21.15.90:0/2040145674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f4c074c50 0x7f8f4c0c7410 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:17.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.023+0000 7f8f54600640 1 --2- 172.21.15.90:0/2040145674 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f4c0708e0 0x7f8f4c150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:17.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.023+0000 7f8f54600640 1 -- 172.21.15.90:0/2040145674 >> 172.21.15.90:0/2040145674 conn(0x7f8f4c0c8ba0 msgr2=0x7f8f4c1dd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:17.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.024+0000 7f8f54600640 1 -- 172.21.15.90:0/2040145674 shutdown_connections 2024-09-21T03:15:17.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.024+0000 7f8f54600640 1 -- 172.21.15.90:0/2040145674 wait complete. 2024-09-21T03:15:17.047 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-09-21T03:15:16.484995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597680,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":197,"num_write_kb":1662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219616,"kb_used_data":3388,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755104,"statfs":{"total":773094113280,"available":772869226496,"internally_reserved":0,"allocated":3469312,"data_stored":2048508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2492,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002429"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804323+0000","last_change":"2024-09-21T03:14:47.552762+0000","last_active":"2024-09-21T03:15:15.804323+0000","last_peered":"2024-09-21T03:15:15.804323+0000","last_clean":"2024-09-21T03:15:15.804323+0000","last_became_active":"2024-09-21T03:14:47.551883+0000","last_became_peered":"2024-09-21T03:14:47.551883+0000","last_unstale":"2024-09-21T03:15:15.804323+0000","last_undegraded":"2024-09-21T03:15:15.804323+0000","last_fullsized":"2024-09-21T03:15:15.804323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:51.935797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806503+0000","last_change":"2024-09-21T03:14:37.471004+0000","last_active":"2024-09-21T03:15:15.806503+0000","last_peered":"2024-09-21T03:15:15.806503+0000","last_clean":"2024-09-21T03:15:15.806503+0000","last_became_active":"2024-09-21T03:14:37.470563+0000","last_became_peered":"2024-09-21T03:14:37.470563+0000","last_unstale":"2024-09-21T03:15:15.806503+0000","last_undegraded":"2024-09-21T03:15:15.806503+0000","last_fullsized":"2024-09-21T03:15:15.806503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.422826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680312+0000","last_change":"2024-09-21T03:14:38.496252+0000","last_active":"2024-09-21T03:15:15.680312+0000","last_peered":"2024-09-21T03:15:15.680312+0000","last_clean":"2024-09-21T03:15:15.680312+0000","last_became_active":"2024-09-21T03:14:38.488292+0000","last_became_peered":"2024-09-21T03:14:38.488292+0000","last_unstale":"2024-09-21T03:15:15.680312+0000","last_undegraded":"2024-09-21T03:15:15.680312+0000","last_fullsized":"2024-09-21T03:15:15.680312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:57.409792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683500+0000","last_change":"2024-09-21T03:14:46.549877+0000","last_active":"2024-09-21T03:15:15.683500+0000","last_peered":"2024-09-21T03:15:15.683500+0000","last_clean":"2024-09-21T03:15:15.683500+0000","last_became_active":"2024-09-21T03:14:46.549536+0000","last_became_peered":"2024-09-21T03:14:46.549536+0000","last_unstale":"2024-09-21T03:15:15.683500+0000","last_undegraded":"2024-09-21T03:15:15.683500+0000","last_fullsized":"2024-09-21T03:15:15.683500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:57.491042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804846+0000","last_change":"2024-09-21T03:14:47.560303+0000","last_active":"2024-09-21T03:15:15.804846+0000","last_peered":"2024-09-21T03:15:15.804846+0000","last_clean":"2024-09-21T03:15:15.804846+0000","last_became_active":"2024-09-21T03:14:47.559659+0000","last_became_peered":"2024-09-21T03:14:47.559659+0000","last_unstale":"2024-09-21T03:15:15.804846+0000","last_undegraded":"2024-09-21T03:15:15.804846+0000","last_fullsized":"2024-09-21T03:15:15.804846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:49.328036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680553+0000","last_change":"2024-09-21T03:14:37.467448+0000","last_active":"2024-09-21T03:15:15.680553+0000","last_peered":"2024-09-21T03:15:15.680553+0000","last_clean":"2024-09-21T03:15:15.680553+0000","last_became_active":"2024-09-21T03:14:37.467146+0000","last_became_peered":"2024-09-21T03:14:37.467146+0000","last_unstale":"2024-09-21T03:15:15.680553+0000","last_undegraded":"2024-09-21T03:15:15.680553+0000","last_fullsized":"2024-09-21T03:15:15.680553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:53.475083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681362+0000","last_change":"2024-09-21T03:14:38.486401+0000","last_active":"2024-09-21T03:15:15.681362+0000","last_peered":"2024-09-21T03:15:15.681362+0000","last_clean":"2024-09-21T03:15:15.681362+0000","last_became_active":"2024-09-21T03:14:38.486090+0000","last_became_peered":"2024-09-21T03:14:38.486090+0000","last_unstale":"2024-09-21T03:15:15.681362+0000","last_undegraded":"2024-09-21T03:15:15.681362+0000","last_fullsized":"2024-09-21T03:15:15.681362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:44.085100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677377+0000","last_change":"2024-09-21T03:14:46.541705+0000","last_active":"2024-09-21T03:15:15.677377+0000","last_peered":"2024-09-21T03:15:15.677377+0000","last_clean":"2024-09-21T03:15:15.677377+0000","last_became_active":"2024-09-21T03:14:46.541357+0000","last_became_peered":"2024-09-21T03:14:46.541357+0000","last_unstale":"2024-09-21T03:15:15.677377+0000","last_undegraded":"2024-09-21T03:15:15.677377+0000","last_fullsized":"2024-09-21T03:15:15.677377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:31.082059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804443+0000","last_change":"2024-09-21T03:14:47.556183+0000","last_active":"2024-09-21T03:15:15.804443+0000","last_peered":"2024-09-21T03:15:15.804443+0000","last_clean":"2024-09-21T03:15:15.804443+0000","last_became_active":"2024-09-21T03:14:47.553312+0000","last_became_peered":"2024-09-21T03:14:47.553312+0000","last_unstale":"2024-09-21T03:15:15.804443+0000","last_undegraded":"2024-09-21T03:15:15.804443+0000","last_fullsized":"2024-09-21T03:15:15.804443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:07.314491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681355+0000","last_change":"2024-09-21T03:14:37.478711+0000","last_active":"2024-09-21T03:15:15.681355+0000","last_peered":"2024-09-21T03:15:15.681355+0000","last_clean":"2024-09-21T03:15:15.681355+0000","last_became_active":"2024-09-21T03:14:37.477910+0000","last_became_peered":"2024-09-21T03:14:37.477910+0000","last_unstale":"2024-09-21T03:15:15.681355+0000","last_undegraded":"2024-09-21T03:15:15.681355+0000","last_fullsized":"2024-09-21T03:15:15.681355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:40.166966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804969+0000","last_change":"2024-09-21T03:14:38.472992+0000","last_active":"2024-09-21T03:15:15.804969+0000","last_peered":"2024-09-21T03:15:15.804969+0000","last_clean":"2024-09-21T03:15:15.804969+0000","last_became_active":"2024-09-21T03:14:38.472426+0000","last_became_peered":"2024-09-21T03:14:38.472426+0000","last_unstale":"2024-09-21T03:15:15.804969+0000","last_undegraded":"2024-09-21T03:15:15.804969+0000","last_fullsized":"2024-09-21T03:15:15.804969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:36.825612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677572+0000","last_change":"2024-09-21T03:14:46.526996+0000","last_active":"2024-09-21T03:15:15.677572+0000","last_peered":"2024-09-21T03:15:15.677572+0000","last_clean":"2024-09-21T03:15:15.677572+0000","last_became_active":"2024-09-21T03:14:46.525587+0000","last_became_peered":"2024-09-21T03:14:46.525587+0000","last_unstale":"2024-09-21T03:15:15.677572+0000","last_undegraded":"2024-09-21T03:15:15.677572+0000","last_fullsized":"2024-09-21T03:15:15.677572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:56.977126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677435+0000","last_change":"2024-09-21T03:14:47.554143+0000","last_active":"2024-09-21T03:15:15.677435+0000","last_peered":"2024-09-21T03:15:15.677435+0000","last_clean":"2024-09-21T03:15:15.677435+0000","last_became_active":"2024-09-21T03:14:47.553802+0000","last_became_peered":"2024-09-21T03:14:47.553802+0000","last_unstale":"2024-09-21T03:15:15.677435+0000","last_undegraded":"2024-09-21T03:15:15.677435+0000","last_fullsized":"2024-09-21T03:15:15.677435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:37.963442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681887+0000","last_change":"2024-09-21T03:14:37.479842+0000","last_active":"2024-09-21T03:15:15.681887+0000","last_peered":"2024-09-21T03:15:15.681887+0000","last_clean":"2024-09-21T03:15:15.681887+0000","last_became_active":"2024-09-21T03:14:37.478893+0000","last_became_peered":"2024-09-21T03:14:37.478893+0000","last_unstale":"2024-09-21T03:15:15.681887+0000","last_undegraded":"2024-09-21T03:15:15.681887+0000","last_fullsized":"2024-09-21T03:15:15.681887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:27.916133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684739+0000","last_change":"2024-09-21T03:14:38.468756+0000","last_active":"2024-09-21T03:15:14.684739+0000","last_peered":"2024-09-21T03:15:14.684739+0000","last_clean":"2024-09-21T03:15:14.684739+0000","last_became_active":"2024-09-21T03:14:38.467570+0000","last_became_peered":"2024-09-21T03:14:38.467570+0000","last_unstale":"2024-09-21T03:15:14.684739+0000","last_undegraded":"2024-09-21T03:15:14.684739+0000","last_fullsized":"2024-09-21T03:15:14.684739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:24.784157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677514+0000","last_change":"2024-09-21T03:14:46.529932+0000","last_active":"2024-09-21T03:15:15.677514+0000","last_peered":"2024-09-21T03:15:15.677514+0000","last_clean":"2024-09-21T03:15:15.677514+0000","last_became_active":"2024-09-21T03:14:46.529629+0000","last_became_peered":"2024-09-21T03:14:46.529629+0000","last_unstale":"2024-09-21T03:15:15.677514+0000","last_undegraded":"2024-09-21T03:15:15.677514+0000","last_fullsized":"2024-09-21T03:15:15.677514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:39.808494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681239+0000","last_change":"2024-09-21T03:14:47.547724+0000","last_active":"2024-09-21T03:15:15.681239+0000","last_peered":"2024-09-21T03:15:15.681239+0000","last_clean":"2024-09-21T03:15:15.681239+0000","last_became_active":"2024-09-21T03:14:47.546770+0000","last_became_peered":"2024-09-21T03:14:47.546770+0000","last_unstale":"2024-09-21T03:15:15.681239+0000","last_undegraded":"2024-09-21T03:15:15.681239+0000","last_fullsized":"2024-09-21T03:15:15.681239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:31.476710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682495+0000","last_change":"2024-09-21T03:14:38.476747+0000","last_active":"2024-09-21T03:15:14.682495+0000","last_peered":"2024-09-21T03:15:14.682495+0000","last_clean":"2024-09-21T03:15:14.682495+0000","last_became_active":"2024-09-21T03:14:38.476386+0000","last_became_peered":"2024-09-21T03:14:38.476386+0000","last_unstale":"2024-09-21T03:15:14.682495+0000","last_undegraded":"2024-09-21T03:15:14.682495+0000","last_fullsized":"2024-09-21T03:15:14.682495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:28.751991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.683209+0000","last_change":"2024-09-21T03:14:37.463164+0000","last_active":"2024-09-21T03:15:14.683209+0000","last_peered":"2024-09-21T03:15:14.683209+0000","last_clean":"2024-09-21T03:15:14.683209+0000","last_became_active":"2024-09-21T03:14:37.461409+0000","last_became_peered":"2024-09-21T03:14:37.461409+0000","last_unstale":"2024-09-21T03:15:14.683209+0000","last_undegraded":"2024-09-21T03:15:14.683209+0000","last_fullsized":"2024-09-21T03:15:14.683209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:51.126291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684453+0000","last_change":"2024-09-21T03:14:46.538480+0000","last_active":"2024-09-21T03:15:14.684453+0000","last_peered":"2024-09-21T03:15:14.684453+0000","last_clean":"2024-09-21T03:15:14.684453+0000","last_became_active":"2024-09-21T03:14:46.537493+0000","last_became_peered":"2024-09-21T03:14:46.537493+0000","last_unstale":"2024-09-21T03:15:14.684453+0000","last_undegraded":"2024-09-21T03:15:14.684453+0000","last_fullsized":"2024-09-21T03:15:14.684453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:52.769190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684608+0000","last_change":"2024-09-21T03:14:47.580512+0000","last_active":"2024-09-21T03:15:15.684608+0000","last_peered":"2024-09-21T03:15:15.684608+0000","last_clean":"2024-09-21T03:15:15.684608+0000","last_became_active":"2024-09-21T03:14:47.580210+0000","last_became_peered":"2024-09-21T03:14:47.580210+0000","last_unstale":"2024-09-21T03:15:15.684608+0000","last_undegraded":"2024-09-21T03:15:15.684608+0000","last_fullsized":"2024-09-21T03:15:15.684608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:20.192190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684313+0000","last_change":"2024-09-21T03:14:38.494021+0000","last_active":"2024-09-21T03:15:15.684313+0000","last_peered":"2024-09-21T03:15:15.684313+0000","last_clean":"2024-09-21T03:15:15.684313+0000","last_became_active":"2024-09-21T03:14:38.486802+0000","last_became_peered":"2024-09-21T03:14:38.486802+0000","last_unstale":"2024-09-21T03:15:15.684313+0000","last_undegraded":"2024-09-21T03:15:15.684313+0000","last_fullsized":"2024-09-21T03:15:15.684313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:31.817505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558034+0000","last_change":"2024-09-21T03:14:37.465907+0000","last_active":"2024-09-21T03:14:48.558034+0000","last_peered":"2024-09-21T03:14:48.558034+0000","last_clean":"2024-09-21T03:14:48.558034+0000","last_became_active":"2024-09-21T03:14:37.465551+0000","last_became_peered":"2024-09-21T03:14:37.465551+0000","last_unstale":"2024-09-21T03:14:48.558034+0000","last_undegraded":"2024-09-21T03:14:48.558034+0000","last_fullsized":"2024-09-21T03:14:48.558034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:10.599687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681508+0000","last_change":"2024-09-21T03:14:46.546737+0000","last_active":"2024-09-21T03:15:15.681508+0000","last_peered":"2024-09-21T03:15:15.681508+0000","last_clean":"2024-09-21T03:15:15.681508+0000","last_became_active":"2024-09-21T03:14:46.546312+0000","last_became_peered":"2024-09-21T03:14:46.546312+0000","last_unstale":"2024-09-21T03:15:15.681508+0000","last_undegraded":"2024-09-21T03:15:15.681508+0000","last_fullsized":"2024-09-21T03:15:15.681508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:03.939168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.686382+0000","last_change":"2024-09-21T03:14:47.558742+0000","last_active":"2024-09-21T03:15:14.686382+0000","last_peered":"2024-09-21T03:15:14.686382+0000","last_clean":"2024-09-21T03:15:14.686382+0000","last_became_active":"2024-09-21T03:14:47.558431+0000","last_became_peered":"2024-09-21T03:14:47.558431+0000","last_unstale":"2024-09-21T03:15:14.686382+0000","last_undegraded":"2024-09-21T03:15:14.686382+0000","last_fullsized":"2024-09-21T03:15:14.686382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:32.053674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805176+0000","last_change":"2024-09-21T03:14:38.479370+0000","last_active":"2024-09-21T03:15:15.805176+0000","last_peered":"2024-09-21T03:15:15.805176+0000","last_clean":"2024-09-21T03:15:15.805176+0000","last_became_active":"2024-09-21T03:14:38.476976+0000","last_became_peered":"2024-09-21T03:14:38.476976+0000","last_unstale":"2024-09-21T03:15:15.805176+0000","last_undegraded":"2024-09-21T03:15:15.805176+0000","last_fullsized":"2024-09-21T03:15:15.805176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:14.695819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805302+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:15:15.805302+0000","last_peered":"2024-09-21T03:15:15.805302+0000","last_clean":"2024-09-21T03:15:15.805302+0000","last_became_active":"2024-09-21T03:14:37.478840+0000","last_became_peered":"2024-09-21T03:14:37.478840+0000","last_unstale":"2024-09-21T03:15:15.805302+0000","last_undegraded":"2024-09-21T03:15:15.805302+0000","last_fullsized":"2024-09-21T03:15:15.805302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:00.964354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684541+0000","last_change":"2024-09-21T03:14:46.543085+0000","last_active":"2024-09-21T03:15:15.684541+0000","last_peered":"2024-09-21T03:15:15.684541+0000","last_clean":"2024-09-21T03:15:15.684541+0000","last_became_active":"2024-09-21T03:14:46.542721+0000","last_became_peered":"2024-09-21T03:14:46.542721+0000","last_unstale":"2024-09-21T03:15:15.684541+0000","last_undegraded":"2024-09-21T03:15:15.684541+0000","last_fullsized":"2024-09-21T03:15:15.684541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:05.590871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805028+0000","last_change":"2024-09-21T03:14:47.566806+0000","last_active":"2024-09-21T03:15:15.805028+0000","last_peered":"2024-09-21T03:15:15.805028+0000","last_clean":"2024-09-21T03:15:15.805028+0000","last_became_active":"2024-09-21T03:14:47.566634+0000","last_became_peered":"2024-09-21T03:14:47.566634+0000","last_unstale":"2024-09-21T03:15:15.805028+0000","last_undegraded":"2024-09-21T03:15:15.805028+0000","last_fullsized":"2024-09-21T03:15:15.805028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:03.997294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682260+0000","last_change":"2024-09-21T03:14:38.482658+0000","last_active":"2024-09-21T03:15:14.682260+0000","last_peered":"2024-09-21T03:15:14.682260+0000","last_clean":"2024-09-21T03:15:14.682260+0000","last_became_active":"2024-09-21T03:14:38.482369+0000","last_became_peered":"2024-09-21T03:14:38.482369+0000","last_unstale":"2024-09-21T03:15:14.682260+0000","last_undegraded":"2024-09-21T03:15:14.682260+0000","last_fullsized":"2024-09-21T03:15:14.682260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:36.682534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680554+0000","last_change":"2024-09-21T03:14:37.472962+0000","last_active":"2024-09-21T03:15:15.680554+0000","last_peered":"2024-09-21T03:15:15.680554+0000","last_clean":"2024-09-21T03:15:15.680554+0000","last_became_active":"2024-09-21T03:14:37.472271+0000","last_became_peered":"2024-09-21T03:14:37.472271+0000","last_unstale":"2024-09-21T03:15:15.680554+0000","last_undegraded":"2024-09-21T03:15:15.680554+0000","last_fullsized":"2024-09-21T03:15:15.680554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:54.952223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678253+0000","last_change":"2024-09-21T03:14:46.537137+0000","last_active":"2024-09-21T03:15:15.678253+0000","last_peered":"2024-09-21T03:15:15.678253+0000","last_clean":"2024-09-21T03:15:15.678253+0000","last_became_active":"2024-09-21T03:14:46.536791+0000","last_became_peered":"2024-09-21T03:14:46.536791+0000","last_unstale":"2024-09-21T03:15:15.678253+0000","last_undegraded":"2024-09-21T03:15:15.678253+0000","last_fullsized":"2024-09-21T03:15:15.678253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:43.186807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805335+0000","last_change":"2024-09-21T03:14:47.555605+0000","last_active":"2024-09-21T03:15:15.805335+0000","last_peered":"2024-09-21T03:15:15.805335+0000","last_clean":"2024-09-21T03:15:15.805335+0000","last_became_active":"2024-09-21T03:14:47.555329+0000","last_became_peered":"2024-09-21T03:14:47.555329+0000","last_unstale":"2024-09-21T03:15:15.805335+0000","last_undegraded":"2024-09-21T03:15:15.805335+0000","last_fullsized":"2024-09-21T03:15:15.805335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:24.271656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806141+0000","last_change":"2024-09-21T03:14:38.479133+0000","last_active":"2024-09-21T03:15:15.806141+0000","last_peered":"2024-09-21T03:15:15.806141+0000","last_clean":"2024-09-21T03:15:15.806141+0000","last_became_active":"2024-09-21T03:14:38.478077+0000","last_became_peered":"2024-09-21T03:14:38.478077+0000","last_unstale":"2024-09-21T03:15:15.806141+0000","last_undegraded":"2024-09-21T03:15:15.806141+0000","last_fullsized":"2024-09-21T03:15:15.806141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:56.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.687362+0000","last_change":"2024-09-21T03:14:37.480508+0000","last_active":"2024-09-21T03:15:14.687362+0000","last_peered":"2024-09-21T03:15:14.687362+0000","last_clean":"2024-09-21T03:15:14.687362+0000","last_became_active":"2024-09-21T03:14:37.480218+0000","last_became_peered":"2024-09-21T03:14:37.480218+0000","last_unstale":"2024-09-21T03:15:14.687362+0000","last_undegraded":"2024-09-21T03:15:14.687362+0000","last_fullsized":"2024-09-21T03:15:14.687362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:01.851380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678755+0000","last_change":"2024-09-21T03:14:46.531615+0000","last_active":"2024-09-21T03:15:15.678755+0000","last_peered":"2024-09-21T03:15:15.678755+0000","last_clean":"2024-09-21T03:15:15.678755+0000","last_became_active":"2024-09-21T03:14:46.531289+0000","last_became_peered":"2024-09-21T03:14:46.531289+0000","last_unstale":"2024-09-21T03:15:15.678755+0000","last_undegraded":"2024-09-21T03:15:15.678755+0000","last_fullsized":"2024-09-21T03:15:15.678755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:10.145489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682075+0000","last_change":"2024-09-21T03:14:47.552705+0000","last_active":"2024-09-21T03:15:14.682075+0000","last_peered":"2024-09-21T03:15:14.682075+0000","last_clean":"2024-09-21T03:15:14.682075+0000","last_became_active":"2024-09-21T03:14:47.552367+0000","last_became_peered":"2024-09-21T03:14:47.552367+0000","last_unstale":"2024-09-21T03:15:14.682075+0000","last_undegraded":"2024-09-21T03:15:14.682075+0000","last_fullsized":"2024-09-21T03:15:14.682075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:45.379581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806286+0000","last_change":"2024-09-21T03:14:38.475318+0000","last_active":"2024-09-21T03:15:15.806286+0000","last_peered":"2024-09-21T03:15:15.806286+0000","last_clean":"2024-09-21T03:15:15.806286+0000","last_became_active":"2024-09-21T03:14:38.474978+0000","last_became_peered":"2024-09-21T03:14:38.474978+0000","last_unstale":"2024-09-21T03:15:15.806286+0000","last_undegraded":"2024-09-21T03:15:15.806286+0000","last_fullsized":"2024-09-21T03:15:15.806286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:38.209624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806345+0000","last_change":"2024-09-21T03:14:37.479651+0000","last_active":"2024-09-21T03:15:15.806345+0000","last_peered":"2024-09-21T03:15:15.806345+0000","last_clean":"2024-09-21T03:15:15.806345+0000","last_became_active":"2024-09-21T03:14:37.478833+0000","last_became_peered":"2024-09-21T03:14:37.478833+0000","last_unstale":"2024-09-21T03:15:15.806345+0000","last_undegraded":"2024-09-21T03:15:15.806345+0000","last_fullsized":"2024-09-21T03:15:15.806345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:48.578637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804935+0000","last_change":"2024-09-21T03:14:46.536054+0000","last_active":"2024-09-21T03:15:15.804935+0000","last_peered":"2024-09-21T03:15:15.804935+0000","last_clean":"2024-09-21T03:15:15.804935+0000","last_became_active":"2024-09-21T03:14:46.535569+0000","last_became_peered":"2024-09-21T03:14:46.535569+0000","last_unstale":"2024-09-21T03:15:15.804935+0000","last_undegraded":"2024-09-21T03:15:15.804935+0000","last_fullsized":"2024-09-21T03:15:15.804935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:04.556059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680654+0000","last_change":"2024-09-21T03:14:47.571889+0000","last_active":"2024-09-21T03:15:15.680654+0000","last_peered":"2024-09-21T03:15:15.680654+0000","last_clean":"2024-09-21T03:15:15.680654+0000","last_became_active":"2024-09-21T03:14:47.571620+0000","last_became_peered":"2024-09-21T03:14:47.571620+0000","last_unstale":"2024-09-21T03:15:15.680654+0000","last_undegraded":"2024-09-21T03:15:15.680654+0000","last_fullsized":"2024-09-21T03:15:15.680654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:23.103973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558656+0000","last_change":"2024-09-21T03:14:38.493350+0000","last_active":"2024-09-21T03:14:48.558656+0000","last_peered":"2024-09-21T03:14:48.558656+0000","last_clean":"2024-09-21T03:14:48.558656+0000","last_became_active":"2024-09-21T03:14:38.492830+0000","last_became_peered":"2024-09-21T03:14:38.492830+0000","last_unstale":"2024-09-21T03:14:48.558656+0000","last_undegraded":"2024-09-21T03:14:48.558656+0000","last_fullsized":"2024-09-21T03:14:48.558656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:19.946319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.685128+0000","last_change":"2024-09-21T03:14:37.473484+0000","last_active":"2024-09-21T03:15:14.685128+0000","last_peered":"2024-09-21T03:15:14.685128+0000","last_clean":"2024-09-21T03:15:14.685128+0000","last_became_active":"2024-09-21T03:14:37.473218+0000","last_became_peered":"2024-09-21T03:14:37.473218+0000","last_unstale":"2024-09-21T03:15:14.685128+0000","last_undegraded":"2024-09-21T03:15:14.685128+0000","last_fullsized":"2024-09-21T03:15:14.685128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:49.006579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558777+0000","last_change":"2024-09-21T03:14:46.548858+0000","last_active":"2024-09-21T03:14:48.558777+0000","last_peered":"2024-09-21T03:14:48.558777+0000","last_clean":"2024-09-21T03:14:48.558777+0000","last_became_active":"2024-09-21T03:14:46.548166+0000","last_became_peered":"2024-09-21T03:14:46.548166+0000","last_unstale":"2024-09-21T03:14:48.558777+0000","last_undegraded":"2024-09-21T03:14:48.558777+0000","last_fullsized":"2024-09-21T03:14:48.558777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:41.470072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805741+0000","last_change":"2024-09-21T03:14:47.555787+0000","last_active":"2024-09-21T03:15:15.805741+0000","last_peered":"2024-09-21T03:15:15.805741+0000","last_clean":"2024-09-21T03:15:15.805741+0000","last_became_active":"2024-09-21T03:14:47.555420+0000","last_became_peered":"2024-09-21T03:14:47.555420+0000","last_unstale":"2024-09-21T03:15:15.805741+0000","last_undegraded":"2024-09-21T03:15:15.805741+0000","last_fullsized":"2024-09-21T03:15:15.805741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:45.769786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677640+0000","last_change":"2024-09-21T03:14:38.479657+0000","last_active":"2024-09-21T03:15:15.677640+0000","last_peered":"2024-09-21T03:15:15.677640+0000","last_clean":"2024-09-21T03:15:15.677640+0000","last_became_active":"2024-09-21T03:14:38.479439+0000","last_became_peered":"2024-09-21T03:14:38.479439+0000","last_unstale":"2024-09-21T03:15:15.677640+0000","last_undegraded":"2024-09-21T03:15:15.677640+0000","last_fullsized":"2024-09-21T03:15:15.677640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.107215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681857+0000","last_change":"2024-09-21T03:14:37.469799+0000","last_active":"2024-09-21T03:15:15.681857+0000","last_peered":"2024-09-21T03:15:15.681857+0000","last_clean":"2024-09-21T03:15:15.681857+0000","last_became_active":"2024-09-21T03:14:37.469495+0000","last_became_peered":"2024-09-21T03:14:37.469495+0000","last_unstale":"2024-09-21T03:15:15.681857+0000","last_undegraded":"2024-09-21T03:15:15.681857+0000","last_fullsized":"2024-09-21T03:15:15.681857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:50.247050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557375+0000","last_change":"2024-09-21T03:14:46.544320+0000","last_active":"2024-09-21T03:14:48.557375+0000","last_peered":"2024-09-21T03:14:48.557375+0000","last_clean":"2024-09-21T03:14:48.557375+0000","last_became_active":"2024-09-21T03:14:46.544038+0000","last_became_peered":"2024-09-21T03:14:46.544038+0000","last_unstale":"2024-09-21T03:14:48.557375+0000","last_undegraded":"2024-09-21T03:14:48.557375+0000","last_fullsized":"2024-09-21T03:14:48.557375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:57.457687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684713+0000","last_change":"2024-09-21T03:14:47.579698+0000","last_active":"2024-09-21T03:15:15.684713+0000","last_peered":"2024-09-21T03:15:15.684713+0000","last_clean":"2024-09-21T03:15:15.684713+0000","last_became_active":"2024-09-21T03:14:47.579324+0000","last_became_peered":"2024-09-21T03:14:47.579324+0000","last_unstale":"2024-09-21T03:15:15.684713+0000","last_undegraded":"2024-09-21T03:15:15.684713+0000","last_fullsized":"2024-09-21T03:15:15.684713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:37.656859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681701+0000","last_change":"2024-09-21T03:14:38.476763+0000","last_active":"2024-09-21T03:15:15.681701+0000","last_peered":"2024-09-21T03:15:15.681701+0000","last_clean":"2024-09-21T03:15:15.681701+0000","last_became_active":"2024-09-21T03:14:38.474299+0000","last_became_peered":"2024-09-21T03:14:38.474299+0000","last_unstale":"2024-09-21T03:15:15.681701+0000","last_undegraded":"2024-09-21T03:15:15.681701+0000","last_fullsized":"2024-09-21T03:15:15.681701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:46.544930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682672+0000","last_change":"2024-09-21T03:14:37.466857+0000","last_active":"2024-09-21T03:15:14.682672+0000","last_peered":"2024-09-21T03:15:14.682672+0000","last_clean":"2024-09-21T03:15:14.682672+0000","last_became_active":"2024-09-21T03:14:37.466256+0000","last_became_peered":"2024-09-21T03:14:37.466256+0000","last_unstale":"2024-09-21T03:15:14.682672+0000","last_undegraded":"2024-09-21T03:15:14.682672+0000","last_fullsized":"2024-09-21T03:15:14.682672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:02.240461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558502+0000","last_change":"2024-09-21T03:14:46.537315+0000","last_active":"2024-09-21T03:14:48.558502+0000","last_peered":"2024-09-21T03:14:48.558502+0000","last_clean":"2024-09-21T03:14:48.558502+0000","last_became_active":"2024-09-21T03:14:46.536975+0000","last_became_peered":"2024-09-21T03:14:46.536975+0000","last_unstale":"2024-09-21T03:14:48.558502+0000","last_undegraded":"2024-09-21T03:14:48.558502+0000","last_fullsized":"2024-09-21T03:14:48.558502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:42.529591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.685045+0000","last_change":"2024-09-21T03:14:47.573009+0000","last_active":"2024-09-21T03:15:15.685045+0000","last_peered":"2024-09-21T03:15:15.685045+0000","last_clean":"2024-09-21T03:15:15.685045+0000","last_became_active":"2024-09-21T03:14:47.572395+0000","last_became_peered":"2024-09-21T03:14:47.572395+0000","last_unstale":"2024-09-21T03:15:15.685045+0000","last_undegraded":"2024-09-21T03:15:15.685045+0000","last_fullsized":"2024-09-21T03:15:15.685045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:41.733447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678985+0000","last_change":"2024-09-21T03:14:38.481801+0000","last_active":"2024-09-21T03:15:15.678985+0000","last_peered":"2024-09-21T03:15:15.678985+0000","last_clean":"2024-09-21T03:15:15.678985+0000","last_became_active":"2024-09-21T03:14:38.481186+0000","last_became_peered":"2024-09-21T03:14:38.481186+0000","last_unstale":"2024-09-21T03:15:15.678985+0000","last_undegraded":"2024-09-21T03:15:15.678985+0000","last_fullsized":"2024-09-21T03:15:15.678985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:54.271470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683612+0000","last_change":"2024-09-21T03:14:37.474798+0000","last_active":"2024-09-21T03:15:15.683612+0000","last_peered":"2024-09-21T03:15:15.683612+0000","last_clean":"2024-09-21T03:15:15.683612+0000","last_became_active":"2024-09-21T03:14:37.473829+0000","last_became_peered":"2024-09-21T03:14:37.473829+0000","last_unstale":"2024-09-21T03:15:15.683612+0000","last_undegraded":"2024-09-21T03:15:15.683612+0000","last_fullsized":"2024-09-21T03:15:15.683612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:11.571814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558227+0000","last_change":"2024-09-21T03:14:46.542495+0000","last_active":"2024-09-21T03:14:48.558227+0000","last_peered":"2024-09-21T03:14:48.558227+0000","last_clean":"2024-09-21T03:14:48.558227+0000","last_became_active":"2024-09-21T03:14:46.542181+0000","last_became_peered":"2024-09-21T03:14:46.542181+0000","last_unstale":"2024-09-21T03:14:48.558227+0000","last_undegraded":"2024-09-21T03:14:48.558227+0000","last_fullsized":"2024-09-21T03:14:48.558227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:22.481477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.686650+0000","last_change":"2024-09-21T03:14:47.569409+0000","last_active":"2024-09-21T03:15:14.686650+0000","last_peered":"2024-09-21T03:15:14.686650+0000","last_clean":"2024-09-21T03:15:14.686650+0000","last_became_active":"2024-09-21T03:14:47.569212+0000","last_became_peered":"2024-09-21T03:14:47.569212+0000","last_unstale":"2024-09-21T03:15:14.686650+0000","last_undegraded":"2024-09-21T03:15:14.686650+0000","last_fullsized":"2024-09-21T03:15:14.686650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.851943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557644+0000","last_change":"2024-09-21T03:14:38.480026+0000","last_active":"2024-09-21T03:14:48.557644+0000","last_peered":"2024-09-21T03:14:48.557644+0000","last_clean":"2024-09-21T03:14:48.557644+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:14:48.557644+0000","last_undegraded":"2024-09-21T03:14:48.557644+0000","last_fullsized":"2024-09-21T03:14:48.557644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:20.481816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682008+0000","last_change":"2024-09-21T03:14:37.464554+0000","last_active":"2024-09-21T03:15:14.682008+0000","last_peered":"2024-09-21T03:15:14.682008+0000","last_clean":"2024-09-21T03:15:14.682008+0000","last_became_active":"2024-09-21T03:14:37.464228+0000","last_became_peered":"2024-09-21T03:14:37.464228+0000","last_unstale":"2024-09-21T03:15:14.682008+0000","last_undegraded":"2024-09-21T03:15:14.682008+0000","last_fullsized":"2024-09-21T03:15:14.682008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:32.529512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680429+0000","last_change":"2024-09-21T03:14:46.538538+0000","last_active":"2024-09-21T03:15:15.680429+0000","last_peered":"2024-09-21T03:15:15.680429+0000","last_clean":"2024-09-21T03:15:15.680429+0000","last_became_active":"2024-09-21T03:14:46.537815+0000","last_became_peered":"2024-09-21T03:14:46.537815+0000","last_unstale":"2024-09-21T03:15:15.680429+0000","last_undegraded":"2024-09-21T03:15:15.680429+0000","last_fullsized":"2024-09-21T03:15:15.680429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:42.264439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680898+0000","last_change":"2024-09-21T03:14:47.558861+0000","last_active":"2024-09-21T03:15:15.680898+0000","last_peered":"2024-09-21T03:15:15.680898+0000","last_clean":"2024-09-21T03:15:15.680898+0000","last_became_active":"2024-09-21T03:14:47.557305+0000","last_became_peered":"2024-09-21T03:14:47.557305+0000","last_unstale":"2024-09-21T03:15:15.680898+0000","last_undegraded":"2024-09-21T03:15:15.680898+0000","last_fullsized":"2024-09-21T03:15:15.680898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:45.962367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805521+0000","last_change":"2024-09-21T03:14:38.479181+0000","last_active":"2024-09-21T03:15:15.805521+0000","last_peered":"2024-09-21T03:15:15.805521+0000","last_clean":"2024-09-21T03:15:15.805521+0000","last_became_active":"2024-09-21T03:14:38.478842+0000","last_became_peered":"2024-09-21T03:14:38.478842+0000","last_unstale":"2024-09-21T03:15:15.805521+0000","last_undegraded":"2024-09-21T03:15:15.805521+0000","last_fullsized":"2024-09-21T03:15:15.805521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:08.664381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.683994+0000","last_change":"2024-09-21T03:14:37.463990+0000","last_active":"2024-09-21T03:15:14.683994+0000","last_peered":"2024-09-21T03:15:14.683994+0000","last_clean":"2024-09-21T03:15:14.683994+0000","last_became_active":"2024-09-21T03:14:37.463674+0000","last_became_peered":"2024-09-21T03:14:37.463674+0000","last_unstale":"2024-09-21T03:15:14.683994+0000","last_undegraded":"2024-09-21T03:15:14.683994+0000","last_fullsized":"2024-09-21T03:15:14.683994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:35.391985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804527+0000","last_change":"2024-09-21T03:14:26.342355+0000","last_active":"2024-09-21T03:15:15.804527+0000","last_peered":"2024-09-21T03:15:15.804527+0000","last_clean":"2024-09-21T03:15:15.804527+0000","last_became_active":"2024-09-21T03:14:26.341929+0000","last_became_peered":"2024-09-21T03:14:26.341929+0000","last_unstale":"2024-09-21T03:15:15.804527+0000","last_undegraded":"2024-09-21T03:15:15.804527+0000","last_fullsized":"2024-09-21T03:15:15.804527+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_clean_scrub_stamp":"2024-09-21T03:14:25.329650+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:45.390822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684834+0000","last_change":"2024-09-21T03:14:46.538184+0000","last_active":"2024-09-21T03:15:14.684834+0000","last_peered":"2024-09-21T03:15:14.684834+0000","last_clean":"2024-09-21T03:15:14.684834+0000","last_became_active":"2024-09-21T03:14:46.536753+0000","last_became_peered":"2024-09-21T03:14:46.536753+0000","last_unstale":"2024-09-21T03:15:14.684834+0000","last_undegraded":"2024-09-21T03:15:14.684834+0000","last_fullsized":"2024-09-21T03:15:14.684834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:49.078638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680743+0000","last_change":"2024-09-21T03:14:47.552966+0000","last_active":"2024-09-21T03:15:15.680743+0000","last_peered":"2024-09-21T03:15:15.680743+0000","last_clean":"2024-09-21T03:15:15.680743+0000","last_became_active":"2024-09-21T03:14:47.552642+0000","last_became_peered":"2024-09-21T03:14:47.552642+0000","last_unstale":"2024-09-21T03:15:15.680743+0000","last_undegraded":"2024-09-21T03:15:15.680743+0000","last_fullsized":"2024-09-21T03:15:15.680743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:15.928026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684929+0000","last_change":"2024-09-21T03:14:38.478414+0000","last_active":"2024-09-21T03:15:14.684929+0000","last_peered":"2024-09-21T03:15:14.684929+0000","last_clean":"2024-09-21T03:15:14.684929+0000","last_became_active":"2024-09-21T03:14:38.478116+0000","last_became_peered":"2024-09-21T03:14:38.478116+0000","last_unstale":"2024-09-21T03:15:14.684929+0000","last_undegraded":"2024-09-21T03:15:14.684929+0000","last_fullsized":"2024-09-21T03:15:14.684929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:29.618008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558850+0000","last_change":"2024-09-21T03:14:37.479578+0000","last_active":"2024-09-21T03:14:48.558850+0000","last_peered":"2024-09-21T03:14:48.558850+0000","last_clean":"2024-09-21T03:14:48.558850+0000","last_became_active":"2024-09-21T03:14:37.479284+0000","last_became_peered":"2024-09-21T03:14:37.479284+0000","last_unstale":"2024-09-21T03:14:48.558850+0000","last_undegraded":"2024-09-21T03:14:48.558850+0000","last_fullsized":"2024-09-21T03:14:48.558850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:15.732230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677624+0000","last_change":"2024-09-21T03:14:46.531536+0000","last_active":"2024-09-21T03:15:15.677624+0000","last_peered":"2024-09-21T03:15:15.677624+0000","last_clean":"2024-09-21T03:15:15.677624+0000","last_became_active":"2024-09-21T03:14:46.531069+0000","last_became_peered":"2024-09-21T03:14:46.531069+0000","last_unstale":"2024-09-21T03:15:15.677624+0000","last_undegraded":"2024-09-21T03:15:15.677624+0000","last_fullsized":"2024-09-21T03:15:15.677624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:14.050618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557238+0000","last_change":"2024-09-21T03:14:47.553039+0000","last_active":"2024-09-21T03:14:48.557238+0000","last_peered":"2024-09-21T03:14:48.557238+0000","last_clean":"2024-09-21T03:14:48.557238+0000","last_became_active":"2024-09-21T03:14:47.552712+0000","last_became_peered":"2024-09-21T03:14:47.552712+0000","last_unstale":"2024-09-21T03:14:48.557238+0000","last_undegraded":"2024-09-21T03:14:48.557238+0000","last_fullsized":"2024-09-21T03:14:48.557238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:32.630319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681782+0000","last_change":"2024-09-21T03:14:38.488259+0000","last_active":"2024-09-21T03:15:15.681782+0000","last_peered":"2024-09-21T03:15:15.681782+0000","last_clean":"2024-09-21T03:15:15.681782+0000","last_became_active":"2024-09-21T03:14:38.487420+0000","last_became_peered":"2024-09-21T03:14:38.487420+0000","last_unstale":"2024-09-21T03:15:15.681782+0000","last_undegraded":"2024-09-21T03:15:15.681782+0000","last_fullsized":"2024-09-21T03:15:15.681782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:48.003893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681753+0000","last_change":"2024-09-21T03:14:37.460763+0000","last_active":"2024-09-21T03:15:15.681753+0000","last_peered":"2024-09-21T03:15:15.681753+0000","last_clean":"2024-09-21T03:15:15.681753+0000","last_became_active":"2024-09-21T03:14:37.460320+0000","last_became_peered":"2024-09-21T03:14:37.460320+0000","last_unstale":"2024-09-21T03:15:15.681753+0000","last_undegraded":"2024-09-21T03:15:15.681753+0000","last_fullsized":"2024-09-21T03:15:15.681753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.907794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681101+0000","last_change":"2024-09-21T03:14:46.540901+0000","last_active":"2024-09-21T03:15:15.681101+0000","last_peered":"2024-09-21T03:15:15.681101+0000","last_clean":"2024-09-21T03:15:15.681101+0000","last_became_active":"2024-09-21T03:14:46.540182+0000","last_became_peered":"2024-09-21T03:14:46.540182+0000","last_unstale":"2024-09-21T03:15:15.681101+0000","last_undegraded":"2024-09-21T03:15:15.681101+0000","last_fullsized":"2024-09-21T03:15:15.681101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:38.416663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804362+0000","last_change":"2024-09-21T03:14:47.553810+0000","last_active":"2024-09-21T03:15:15.804362+0000","last_peered":"2024-09-21T03:15:15.804362+0000","last_clean":"2024-09-21T03:15:15.804362+0000","last_became_active":"2024-09-21T03:14:47.552371+0000","last_became_peered":"2024-09-21T03:14:47.552371+0000","last_unstale":"2024-09-21T03:15:15.804362+0000","last_undegraded":"2024-09-21T03:15:15.804362+0000","last_fullsized":"2024-09-21T03:15:15.804362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:38.659512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681305+0000","last_change":"2024-09-21T03:14:38.480629+0000","last_active":"2024-09-21T03:15:15.681305+0000","last_peered":"2024-09-21T03:15:15.681305+0000","last_clean":"2024-09-21T03:15:15.681305+0000","last_became_active":"2024-09-21T03:14:38.474135+0000","last_became_peered":"2024-09-21T03:14:38.474135+0000","last_unstale":"2024-09-21T03:15:15.681305+0000","last_undegraded":"2024-09-21T03:15:15.681305+0000","last_fullsized":"2024-09-21T03:15:15.681305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:36.171044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806268+0000","last_change":"2024-09-21T03:14:37.472491+0000","last_active":"2024-09-21T03:15:15.806268+0000","last_peered":"2024-09-21T03:15:15.806268+0000","last_clean":"2024-09-21T03:15:15.806268+0000","last_became_active":"2024-09-21T03:14:37.472164+0000","last_became_peered":"2024-09-21T03:14:37.472164+0000","last_unstale":"2024-09-21T03:15:15.806268+0000","last_undegraded":"2024-09-21T03:15:15.806268+0000","last_fullsized":"2024-09-21T03:15:15.806268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.498178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681720+0000","last_change":"2024-09-21T03:14:46.544828+0000","last_active":"2024-09-21T03:15:14.681720+0000","last_peered":"2024-09-21T03:15:14.681720+0000","last_clean":"2024-09-21T03:15:14.681720+0000","last_became_active":"2024-09-21T03:14:46.535901+0000","last_became_peered":"2024-09-21T03:14:46.535901+0000","last_unstale":"2024-09-21T03:15:14.681720+0000","last_undegraded":"2024-09-21T03:15:14.681720+0000","last_fullsized":"2024-09-21T03:15:14.681720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:08.608530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557424+0000","last_change":"2024-09-21T03:14:47.556478+0000","last_active":"2024-09-21T03:14:48.557424+0000","last_peered":"2024-09-21T03:14:48.557424+0000","last_clean":"2024-09-21T03:14:48.557424+0000","last_became_active":"2024-09-21T03:14:47.556145+0000","last_became_peered":"2024-09-21T03:14:47.556145+0000","last_unstale":"2024-09-21T03:14:48.557424+0000","last_undegraded":"2024-09-21T03:14:48.557424+0000","last_fullsized":"2024-09-21T03:14:48.557424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:59.004648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678670+0000","last_change":"2024-09-21T03:14:38.469502+0000","last_active":"2024-09-21T03:15:15.678670+0000","last_peered":"2024-09-21T03:15:15.678670+0000","last_clean":"2024-09-21T03:15:15.678670+0000","last_became_active":"2024-09-21T03:14:38.468972+0000","last_became_peered":"2024-09-21T03:14:38.468972+0000","last_unstale":"2024-09-21T03:15:15.678670+0000","last_undegraded":"2024-09-21T03:15:15.678670+0000","last_fullsized":"2024-09-21T03:15:15.678670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681340+0000","last_change":"2024-09-21T03:14:37.480905+0000","last_active":"2024-09-21T03:15:15.681340+0000","last_peered":"2024-09-21T03:15:15.681340+0000","last_clean":"2024-09-21T03:15:15.681340+0000","last_became_active":"2024-09-21T03:14:37.478227+0000","last_became_peered":"2024-09-21T03:14:37.478227+0000","last_unstale":"2024-09-21T03:15:15.681340+0000","last_undegraded":"2024-09-21T03:15:15.681340+0000","last_fullsized":"2024-09-21T03:15:15.681340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:42.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804534+0000","last_change":"2024-09-21T03:14:46.536103+0000","last_active":"2024-09-21T03:15:15.804534+0000","last_peered":"2024-09-21T03:15:15.804534+0000","last_clean":"2024-09-21T03:15:15.804534+0000","last_became_active":"2024-09-21T03:14:46.535445+0000","last_became_peered":"2024-09-21T03:14:46.535445+0000","last_unstale":"2024-09-21T03:15:15.804534+0000","last_undegraded":"2024-09-21T03:15:15.804534+0000","last_fullsized":"2024-09-21T03:15:15.804534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:59.078000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806222+0000","last_change":"2024-09-21T03:14:47.557503+0000","last_active":"2024-09-21T03:15:15.806222+0000","last_peered":"2024-09-21T03:15:15.806222+0000","last_clean":"2024-09-21T03:15:15.806222+0000","last_became_active":"2024-09-21T03:14:47.554366+0000","last_became_peered":"2024-09-21T03:14:47.554366+0000","last_unstale":"2024-09-21T03:15:15.806222+0000","last_undegraded":"2024-09-21T03:15:15.806222+0000","last_fullsized":"2024-09-21T03:15:15.806222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.994560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682222+0000","last_change":"2024-09-21T03:14:38.479516+0000","last_active":"2024-09-21T03:15:14.682222+0000","last_peered":"2024-09-21T03:15:14.682222+0000","last_clean":"2024-09-21T03:15:14.682222+0000","last_became_active":"2024-09-21T03:14:38.474826+0000","last_became_peered":"2024-09-21T03:14:38.474826+0000","last_unstale":"2024-09-21T03:15:14.682222+0000","last_undegraded":"2024-09-21T03:15:14.682222+0000","last_fullsized":"2024-09-21T03:15:14.682222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:22.181411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805649+0000","last_change":"2024-09-21T03:14:37.471063+0000","last_active":"2024-09-21T03:15:15.805649+0000","last_peered":"2024-09-21T03:15:15.805649+0000","last_clean":"2024-09-21T03:15:15.805649+0000","last_became_active":"2024-09-21T03:14:37.470720+0000","last_became_peered":"2024-09-21T03:14:37.470720+0000","last_unstale":"2024-09-21T03:15:15.805649+0000","last_undegraded":"2024-09-21T03:15:15.805649+0000","last_fullsized":"2024-09-21T03:15:15.805649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:00.054692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679915+0000","last_change":"2024-09-21T03:14:46.538665+0000","last_active":"2024-09-21T03:15:15.679915+0000","last_peered":"2024-09-21T03:15:15.679915+0000","last_clean":"2024-09-21T03:15:15.679915+0000","last_became_active":"2024-09-21T03:14:46.537774+0000","last_became_peered":"2024-09-21T03:14:46.537774+0000","last_unstale":"2024-09-21T03:15:15.679915+0000","last_undegraded":"2024-09-21T03:15:15.679915+0000","last_fullsized":"2024-09-21T03:15:15.679915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:07.736404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.686200+0000","last_change":"2024-09-21T03:14:47.553011+0000","last_active":"2024-09-21T03:15:14.686200+0000","last_peered":"2024-09-21T03:15:14.686200+0000","last_clean":"2024-09-21T03:15:14.686200+0000","last_became_active":"2024-09-21T03:14:47.552700+0000","last_became_peered":"2024-09-21T03:14:47.552700+0000","last_unstale":"2024-09-21T03:15:14.686200+0000","last_undegraded":"2024-09-21T03:15:14.686200+0000","last_fullsized":"2024-09-21T03:15:14.686200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:58.780132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804436+0000","last_change":"2024-09-21T03:14:38.472906+0000","last_active":"2024-09-21T03:15:15.804436+0000","last_peered":"2024-09-21T03:15:15.804436+0000","last_clean":"2024-09-21T03:15:15.804436+0000","last_became_active":"2024-09-21T03:14:38.471933+0000","last_became_peered":"2024-09-21T03:14:38.471933+0000","last_unstale":"2024-09-21T03:15:15.804436+0000","last_undegraded":"2024-09-21T03:15:15.804436+0000","last_fullsized":"2024-09-21T03:15:15.804436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:05.395821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680585+0000","last_change":"2024-09-21T03:14:37.478714+0000","last_active":"2024-09-21T03:15:15.680585+0000","last_peered":"2024-09-21T03:15:15.680585+0000","last_clean":"2024-09-21T03:15:15.680585+0000","last_became_active":"2024-09-21T03:14:37.477951+0000","last_became_peered":"2024-09-21T03:14:37.477951+0000","last_unstale":"2024-09-21T03:15:15.680585+0000","last_undegraded":"2024-09-21T03:15:15.680585+0000","last_fullsized":"2024-09-21T03:15:15.680585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:42.529545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680921+0000","last_change":"2024-09-21T03:14:46.546142+0000","last_active":"2024-09-21T03:15:15.680921+0000","last_peered":"2024-09-21T03:15:15.680921+0000","last_clean":"2024-09-21T03:15:15.680921+0000","last_became_active":"2024-09-21T03:14:46.545865+0000","last_became_peered":"2024-09-21T03:14:46.545865+0000","last_unstale":"2024-09-21T03:15:15.680921+0000","last_undegraded":"2024-09-21T03:15:15.680921+0000","last_fullsized":"2024-09-21T03:15:15.680921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:11.705309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684250+0000","last_change":"2024-09-21T03:14:47.568961+0000","last_active":"2024-09-21T03:15:14.684250+0000","last_peered":"2024-09-21T03:15:14.684250+0000","last_clean":"2024-09-21T03:15:14.684250+0000","last_became_active":"2024-09-21T03:14:47.568656+0000","last_became_peered":"2024-09-21T03:14:47.568656+0000","last_unstale":"2024-09-21T03:15:14.684250+0000","last_undegraded":"2024-09-21T03:15:14.684250+0000","last_fullsized":"2024-09-21T03:15:14.684250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.041710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.683102+0000","last_change":"2024-09-21T03:14:38.485454+0000","last_active":"2024-09-21T03:15:14.683102+0000","last_peered":"2024-09-21T03:15:14.683102+0000","last_clean":"2024-09-21T03:15:14.683102+0000","last_became_active":"2024-09-21T03:14:38.485235+0000","last_became_peered":"2024-09-21T03:14:38.485235+0000","last_unstale":"2024-09-21T03:15:14.683102+0000","last_undegraded":"2024-09-21T03:15:14.683102+0000","last_fullsized":"2024-09-21T03:15:14.683102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:11.585637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682605+0000","last_change":"2024-09-21T03:14:37.466544+0000","last_active":"2024-09-21T03:15:14.682605+0000","last_peered":"2024-09-21T03:15:14.682605+0000","last_clean":"2024-09-21T03:15:14.682605+0000","last_became_active":"2024-09-21T03:14:37.465817+0000","last_became_peered":"2024-09-21T03:14:37.465817+0000","last_unstale":"2024-09-21T03:15:14.682605+0000","last_undegraded":"2024-09-21T03:15:14.682605+0000","last_fullsized":"2024-09-21T03:15:14.682605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:36.113483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:15:11.442899+0000","last_change":"2024-09-21T03:14:46.549921+0000","last_active":"2024-09-21T03:15:11.442899+0000","last_peered":"2024-09-21T03:15:11.442899+0000","last_clean":"2024-09-21T03:15:11.442899+0000","last_became_active":"2024-09-21T03:14:46.549119+0000","last_became_peered":"2024-09-21T03:14:46.549119+0000","last_unstale":"2024-09-21T03:15:11.442899+0000","last_undegraded":"2024-09-21T03:15:11.442899+0000","last_fullsized":"2024-09-21T03:15:11.442899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:09.622498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2858,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.691871+0000","last_change":"2024-09-21T03:15:15.687659+0000","last_active":"2024-09-21T03:15:15.691871+0000","last_peered":"2024-09-21T03:15:15.691871+0000","last_clean":"2024-09-21T03:15:15.691871+0000","last_became_active":"2024-09-21T03:15:15.687225+0000","last_became_peered":"2024-09-21T03:15:15.687225+0000","last_unstale":"2024-09-21T03:15:15.691871+0000","last_undegraded":"2024-09-21T03:15:15.691871+0000","last_fullsized":"2024-09-21T03:15:15.691871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:56.395767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557891+0000","last_change":"2024-09-21T03:14:38.482528+0000","last_active":"2024-09-21T03:14:48.557891+0000","last_peered":"2024-09-21T03:14:48.557891+0000","last_clean":"2024-09-21T03:14:48.557891+0000","last_became_active":"2024-09-21T03:14:38.482241+0000","last_became_peered":"2024-09-21T03:14:38.482241+0000","last_unstale":"2024-09-21T03:14:48.557891+0000","last_undegraded":"2024-09-21T03:14:48.557891+0000","last_fullsized":"2024-09-21T03:14:48.557891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:23.110703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684414+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:15:15.684414+0000","last_peered":"2024-09-21T03:15:15.684414+0000","last_clean":"2024-09-21T03:15:15.684414+0000","last_became_active":"2024-09-21T03:14:37.478882+0000","last_became_peered":"2024-09-21T03:14:37.478882+0000","last_unstale":"2024-09-21T03:15:15.684414+0000","last_undegraded":"2024-09-21T03:15:15.684414+0000","last_fullsized":"2024-09-21T03:15:15.684414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:11.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684629+0000","last_change":"2024-09-21T03:14:46.538817+0000","last_active":"2024-09-21T03:15:14.684629+0000","last_peered":"2024-09-21T03:15:14.684629+0000","last_clean":"2024-09-21T03:15:14.684629+0000","last_became_active":"2024-09-21T03:14:46.537835+0000","last_became_peered":"2024-09-21T03:14:46.537835+0000","last_unstale":"2024-09-21T03:15:14.684629+0000","last_undegraded":"2024-09-21T03:15:14.684629+0000","last_fullsized":"2024-09-21T03:15:14.684629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:08.236663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805566+0000","last_change":"2024-09-21T03:14:47.566534+0000","last_active":"2024-09-21T03:15:15.805566+0000","last_peered":"2024-09-21T03:15:15.805566+0000","last_clean":"2024-09-21T03:15:15.805566+0000","last_became_active":"2024-09-21T03:14:47.566157+0000","last_became_peered":"2024-09-21T03:14:47.566157+0000","last_unstale":"2024-09-21T03:15:15.805566+0000","last_undegraded":"2024-09-21T03:15:15.805566+0000","last_fullsized":"2024-09-21T03:15:15.805566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:35.557811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681246+0000","last_change":"2024-09-21T03:14:38.478509+0000","last_active":"2024-09-21T03:15:15.681246+0000","last_peered":"2024-09-21T03:15:15.681246+0000","last_clean":"2024-09-21T03:15:15.681246+0000","last_became_active":"2024-09-21T03:14:38.478197+0000","last_became_peered":"2024-09-21T03:14:38.478197+0000","last_unstale":"2024-09-21T03:15:15.681246+0000","last_undegraded":"2024-09-21T03:15:15.681246+0000","last_fullsized":"2024-09-21T03:15:15.681246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.411134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677857+0000","last_change":"2024-09-21T03:14:37.472695+0000","last_active":"2024-09-21T03:15:15.677857+0000","last_peered":"2024-09-21T03:15:15.677857+0000","last_clean":"2024-09-21T03:15:15.677857+0000","last_became_active":"2024-09-21T03:14:37.472374+0000","last_became_peered":"2024-09-21T03:14:37.472374+0000","last_unstale":"2024-09-21T03:15:15.677857+0000","last_undegraded":"2024-09-21T03:15:15.677857+0000","last_fullsized":"2024-09-21T03:15:15.677857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:11.245914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2858,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805279+0000","last_change":"2024-09-21T03:14:46.547433+0000","last_active":"2024-09-21T03:15:15.805279+0000","last_peered":"2024-09-21T03:15:15.805279+0000","last_clean":"2024-09-21T03:15:15.805279+0000","last_became_active":"2024-09-21T03:14:46.547192+0000","last_became_peered":"2024-09-21T03:14:46.547192+0000","last_unstale":"2024-09-21T03:15:15.805279+0000","last_undegraded":"2024-09-21T03:15:15.805279+0000","last_fullsized":"2024-09-21T03:15:15.805279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:03.238245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557599+0000","last_change":"2024-09-21T03:14:47.545827+0000","last_active":"2024-09-21T03:14:48.557599+0000","last_peered":"2024-09-21T03:14:48.557599+0000","last_clean":"2024-09-21T03:14:48.557599+0000","last_became_active":"2024-09-21T03:14:47.545440+0000","last_became_peered":"2024-09-21T03:14:47.545440+0000","last_unstale":"2024-09-21T03:14:48.557599+0000","last_undegraded":"2024-09-21T03:14:48.557599+0000","last_fullsized":"2024-09-21T03:14:48.557599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:20.532645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684125+0000","last_change":"2024-09-21T03:14:38.476564+0000","last_active":"2024-09-21T03:15:14.684125+0000","last_peered":"2024-09-21T03:15:14.684125+0000","last_clean":"2024-09-21T03:15:14.684125+0000","last_became_active":"2024-09-21T03:14:38.476158+0000","last_became_peered":"2024-09-21T03:14:38.476158+0000","last_unstale":"2024-09-21T03:15:14.684125+0000","last_undegraded":"2024-09-21T03:15:14.684125+0000","last_fullsized":"2024-09-21T03:15:14.684125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:26.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684904+0000","last_change":"2024-09-21T03:14:37.473709+0000","last_active":"2024-09-21T03:15:15.684904+0000","last_peered":"2024-09-21T03:15:15.684904+0000","last_clean":"2024-09-21T03:15:15.684904+0000","last_became_active":"2024-09-21T03:14:37.472544+0000","last_became_peered":"2024-09-21T03:14:37.472544+0000","last_unstale":"2024-09-21T03:15:15.684904+0000","last_undegraded":"2024-09-21T03:15:15.684904+0000","last_fullsized":"2024-09-21T03:15:15.684904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:47.892146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677701+0000","last_change":"2024-09-21T03:14:46.534201+0000","last_active":"2024-09-21T03:15:15.677701+0000","last_peered":"2024-09-21T03:15:15.677701+0000","last_clean":"2024-09-21T03:15:15.677701+0000","last_became_active":"2024-09-21T03:14:46.533891+0000","last_became_peered":"2024-09-21T03:14:46.533891+0000","last_unstale":"2024-09-21T03:15:15.677701+0000","last_undegraded":"2024-09-21T03:15:15.677701+0000","last_fullsized":"2024-09-21T03:15:15.677701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:06.645173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681643+0000","last_change":"2024-09-21T03:14:47.552016+0000","last_active":"2024-09-21T03:15:14.681643+0000","last_peered":"2024-09-21T03:15:14.681643+0000","last_clean":"2024-09-21T03:15:14.681643+0000","last_became_active":"2024-09-21T03:14:47.551622+0000","last_became_peered":"2024-09-21T03:14:47.551622+0000","last_unstale":"2024-09-21T03:15:14.681643+0000","last_undegraded":"2024-09-21T03:15:14.681643+0000","last_fullsized":"2024-09-21T03:15:14.681643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:56:04.849535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681489+0000","last_change":"2024-09-21T03:14:38.484757+0000","last_active":"2024-09-21T03:15:15.681489+0000","last_peered":"2024-09-21T03:15:15.681489+0000","last_clean":"2024-09-21T03:15:15.681489+0000","last_became_active":"2024-09-21T03:14:38.483348+0000","last_became_peered":"2024-09-21T03:14:38.483348+0000","last_unstale":"2024-09-21T03:15:15.681489+0000","last_undegraded":"2024-09-21T03:15:15.681489+0000","last_fullsized":"2024-09-21T03:15:15.681489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:57.697723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681239+0000","last_change":"2024-09-21T03:14:37.479047+0000","last_active":"2024-09-21T03:15:15.681239+0000","last_peered":"2024-09-21T03:15:15.681239+0000","last_clean":"2024-09-21T03:15:15.681239+0000","last_became_active":"2024-09-21T03:14:37.478700+0000","last_became_peered":"2024-09-21T03:14:37.478700+0000","last_unstale":"2024-09-21T03:15:15.681239+0000","last_undegraded":"2024-09-21T03:15:15.681239+0000","last_fullsized":"2024-09-21T03:15:15.681239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:31.702450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.682880+0000","last_change":"2024-09-21T03:14:46.547287+0000","last_active":"2024-09-21T03:15:15.682880+0000","last_peered":"2024-09-21T03:15:15.682880+0000","last_clean":"2024-09-21T03:15:15.682880+0000","last_became_active":"2024-09-21T03:14:46.546867+0000","last_became_peered":"2024-09-21T03:14:46.546867+0000","last_unstale":"2024-09-21T03:15:15.682880+0000","last_undegraded":"2024-09-21T03:15:15.682880+0000","last_fullsized":"2024-09-21T03:15:15.682880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:54.119841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677259+0000","last_change":"2024-09-21T03:14:47.558571+0000","last_active":"2024-09-21T03:15:15.677259+0000","last_peered":"2024-09-21T03:15:15.677259+0000","last_clean":"2024-09-21T03:15:15.677259+0000","last_became_active":"2024-09-21T03:14:47.558037+0000","last_became_peered":"2024-09-21T03:14:47.558037+0000","last_unstale":"2024-09-21T03:15:15.677259+0000","last_undegraded":"2024-09-21T03:15:15.677259+0000","last_fullsized":"2024-09-21T03:15:15.677259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:42.564181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678774+0000","last_change":"2024-09-21T03:14:38.488227+0000","last_active":"2024-09-21T03:15:15.678774+0000","last_peered":"2024-09-21T03:15:15.678774+0000","last_clean":"2024-09-21T03:15:15.678774+0000","last_became_active":"2024-09-21T03:14:38.482370+0000","last_became_peered":"2024-09-21T03:14:38.482370+0000","last_unstale":"2024-09-21T03:15:15.678774+0000","last_undegraded":"2024-09-21T03:15:15.678774+0000","last_fullsized":"2024-09-21T03:15:15.678774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:52.561391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805382+0000","last_change":"2024-09-21T03:14:37.471363+0000","last_active":"2024-09-21T03:15:15.805382+0000","last_peered":"2024-09-21T03:15:15.805382+0000","last_clean":"2024-09-21T03:15:15.805382+0000","last_became_active":"2024-09-21T03:14:37.471002+0000","last_became_peered":"2024-09-21T03:14:37.471002+0000","last_unstale":"2024-09-21T03:15:15.805382+0000","last_undegraded":"2024-09-21T03:15:15.805382+0000","last_fullsized":"2024-09-21T03:15:15.805382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:25.922368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805008+0000","last_change":"2024-09-21T03:14:46.545186+0000","last_active":"2024-09-21T03:15:15.805008+0000","last_peered":"2024-09-21T03:15:15.805008+0000","last_clean":"2024-09-21T03:15:15.805008+0000","last_became_active":"2024-09-21T03:14:46.543647+0000","last_became_peered":"2024-09-21T03:14:46.543647+0000","last_unstale":"2024-09-21T03:15:15.805008+0000","last_undegraded":"2024-09-21T03:15:15.805008+0000","last_fullsized":"2024-09-21T03:15:15.805008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:03.097368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678464+0000","last_change":"2024-09-21T03:14:47.554766+0000","last_active":"2024-09-21T03:15:15.678464+0000","last_peered":"2024-09-21T03:15:15.678464+0000","last_clean":"2024-09-21T03:15:15.678464+0000","last_became_active":"2024-09-21T03:14:47.551563+0000","last_became_peered":"2024-09-21T03:14:47.551563+0000","last_unstale":"2024-09-21T03:15:15.678464+0000","last_undegraded":"2024-09-21T03:15:15.678464+0000","last_fullsized":"2024-09-21T03:15:15.678464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:08.790725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805982+0000","last_change":"2024-09-21T03:14:46.542659+0000","last_active":"2024-09-21T03:15:15.805982+0000","last_peered":"2024-09-21T03:15:15.805982+0000","last_clean":"2024-09-21T03:15:15.805982+0000","last_became_active":"2024-09-21T03:14:46.541771+0000","last_became_peered":"2024-09-21T03:14:46.541771+0000","last_unstale":"2024-09-21T03:15:15.805982+0000","last_undegraded":"2024-09-21T03:15:15.805982+0000","last_fullsized":"2024-09-21T03:15:15.805982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:45.543904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805168+0000","last_change":"2024-09-21T03:14:38.481837+0000","last_active":"2024-09-21T03:15:15.805168+0000","last_peered":"2024-09-21T03:15:15.805168+0000","last_clean":"2024-09-21T03:15:15.805168+0000","last_became_active":"2024-09-21T03:14:38.478400+0000","last_became_peered":"2024-09-21T03:14:38.478400+0000","last_unstale":"2024-09-21T03:15:15.805168+0000","last_undegraded":"2024-09-21T03:15:15.805168+0000","last_fullsized":"2024-09-21T03:15:15.805168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.702185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681897+0000","last_change":"2024-09-21T03:14:37.459351+0000","last_active":"2024-09-21T03:15:14.681897+0000","last_peered":"2024-09-21T03:15:14.681897+0000","last_clean":"2024-09-21T03:15:14.681897+0000","last_became_active":"2024-09-21T03:14:37.458676+0000","last_became_peered":"2024-09-21T03:14:37.458676+0000","last_unstale":"2024-09-21T03:15:14.681897+0000","last_undegraded":"2024-09-21T03:15:14.681897+0000","last_fullsized":"2024-09-21T03:15:14.681897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:42.671520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558462+0000","last_change":"2024-09-21T03:14:47.561232+0000","last_active":"2024-09-21T03:14:48.558462+0000","last_peered":"2024-09-21T03:14:48.558462+0000","last_clean":"2024-09-21T03:14:48.558462+0000","last_became_active":"2024-09-21T03:14:47.557224+0000","last_became_peered":"2024-09-21T03:14:47.557224+0000","last_unstale":"2024-09-21T03:14:48.558462+0000","last_undegraded":"2024-09-21T03:14:48.558462+0000","last_fullsized":"2024-09-21T03:14:48.558462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:09.611235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.686753+0000","last_change":"2024-09-21T03:14:46.543157+0000","last_active":"2024-09-21T03:15:14.686753+0000","last_peered":"2024-09-21T03:15:14.686753+0000","last_clean":"2024-09-21T03:15:14.686753+0000","last_became_active":"2024-09-21T03:14:46.542746+0000","last_became_peered":"2024-09-21T03:14:46.542746+0000","last_unstale":"2024-09-21T03:15:14.686753+0000","last_undegraded":"2024-09-21T03:15:14.686753+0000","last_fullsized":"2024-09-21T03:15:14.686753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:30.644843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679102+0000","last_change":"2024-09-21T03:14:38.480723+0000","last_active":"2024-09-21T03:15:15.679102+0000","last_peered":"2024-09-21T03:15:15.679102+0000","last_clean":"2024-09-21T03:15:15.679102+0000","last_became_active":"2024-09-21T03:14:38.472823+0000","last_became_peered":"2024-09-21T03:14:38.472823+0000","last_unstale":"2024-09-21T03:15:15.679102+0000","last_undegraded":"2024-09-21T03:15:15.679102+0000","last_fullsized":"2024-09-21T03:15:15.679102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:59.862592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557827+0000","last_change":"2024-09-21T03:14:37.472209+0000","last_active":"2024-09-21T03:14:48.557827+0000","last_peered":"2024-09-21T03:14:48.557827+0000","last_clean":"2024-09-21T03:14:48.557827+0000","last_became_active":"2024-09-21T03:14:37.471771+0000","last_became_peered":"2024-09-21T03:14:37.471771+0000","last_unstale":"2024-09-21T03:14:48.557827+0000","last_undegraded":"2024-09-21T03:14:48.557827+0000","last_fullsized":"2024-09-21T03:14:48.557827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:30.648010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805722+0000","last_change":"2024-09-21T03:14:47.570651+0000","last_active":"2024-09-21T03:15:15.805722+0000","last_peered":"2024-09-21T03:15:15.805722+0000","last_clean":"2024-09-21T03:15:15.805722+0000","last_became_active":"2024-09-21T03:14:47.568081+0000","last_became_peered":"2024-09-21T03:14:47.568081+0000","last_unstale":"2024-09-21T03:15:15.805722+0000","last_undegraded":"2024-09-21T03:15:15.805722+0000","last_fullsized":"2024-09-21T03:15:15.805722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:45.036938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682502+0000","last_change":"2024-09-21T03:14:37.475076+0000","last_active":"2024-09-21T03:15:14.682502+0000","last_peered":"2024-09-21T03:15:14.682502+0000","last_clean":"2024-09-21T03:15:14.682502+0000","last_became_active":"2024-09-21T03:14:37.474595+0000","last_became_peered":"2024-09-21T03:14:37.474595+0000","last_unstale":"2024-09-21T03:15:14.682502+0000","last_undegraded":"2024-09-21T03:15:14.682502+0000","last_fullsized":"2024-09-21T03:15:14.682502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:16.880647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805997+0000","last_change":"2024-09-21T03:14:38.483226+0000","last_active":"2024-09-21T03:15:15.805997+0000","last_peered":"2024-09-21T03:15:15.805997+0000","last_clean":"2024-09-21T03:15:15.805997+0000","last_became_active":"2024-09-21T03:14:38.482354+0000","last_became_peered":"2024-09-21T03:14:38.482354+0000","last_unstale":"2024-09-21T03:15:15.805997+0000","last_undegraded":"2024-09-21T03:15:15.805997+0000","last_fullsized":"2024-09-21T03:15:15.805997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:51.488594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805767+0000","last_change":"2024-09-21T03:14:46.551282+0000","last_active":"2024-09-21T03:15:15.805767+0000","last_peered":"2024-09-21T03:15:15.805767+0000","last_clean":"2024-09-21T03:15:15.805767+0000","last_became_active":"2024-09-21T03:14:46.550191+0000","last_became_peered":"2024-09-21T03:14:46.550191+0000","last_unstale":"2024-09-21T03:15:15.805767+0000","last_undegraded":"2024-09-21T03:15:15.805767+0000","last_fullsized":"2024-09-21T03:15:15.805767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:32.136739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.686630+0000","last_change":"2024-09-21T03:15:15.686522+0000","last_active":"2024-09-21T03:15:15.686630+0000","last_peered":"2024-09-21T03:15:15.686630+0000","last_clean":"2024-09-21T03:15:15.686630+0000","last_became_active":"2024-09-21T03:15:15.686063+0000","last_became_peered":"2024-09-21T03:15:15.686063+0000","last_unstale":"2024-09-21T03:15:15.686630+0000","last_undegraded":"2024-09-21T03:15:15.686630+0000","last_fullsized":"2024-09-21T03:15:15.686630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:57.750372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681320+0000","last_change":"2024-09-21T03:14:37.465536+0000","last_active":"2024-09-21T03:15:15.681320+0000","last_peered":"2024-09-21T03:15:15.681320+0000","last_clean":"2024-09-21T03:15:15.681320+0000","last_became_active":"2024-09-21T03:14:37.465240+0000","last_became_peered":"2024-09-21T03:14:37.465240+0000","last_unstale":"2024-09-21T03:15:15.681320+0000","last_undegraded":"2024-09-21T03:15:15.681320+0000","last_fullsized":"2024-09-21T03:15:15.681320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:34.780298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804722+0000","last_change":"2024-09-21T03:14:38.474516+0000","last_active":"2024-09-21T03:15:15.804722+0000","last_peered":"2024-09-21T03:15:15.804722+0000","last_clean":"2024-09-21T03:15:15.804722+0000","last_became_active":"2024-09-21T03:14:38.472225+0000","last_became_peered":"2024-09-21T03:14:38.472225+0000","last_unstale":"2024-09-21T03:15:15.804722+0000","last_undegraded":"2024-09-21T03:15:15.804722+0000","last_fullsized":"2024-09-21T03:15:15.804722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:47.504910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684801+0000","last_change":"2024-09-21T03:14:46.544072+0000","last_active":"2024-09-21T03:15:15.684801+0000","last_peered":"2024-09-21T03:15:15.684801+0000","last_clean":"2024-09-21T03:15:15.684801+0000","last_became_active":"2024-09-21T03:14:46.543729+0000","last_became_peered":"2024-09-21T03:14:46.543729+0000","last_unstale":"2024-09-21T03:15:15.684801+0000","last_undegraded":"2024-09-21T03:15:15.684801+0000","last_fullsized":"2024-09-21T03:15:15.684801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:18.560012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805979+0000","last_change":"2024-09-21T03:14:47.563764+0000","last_active":"2024-09-21T03:15:15.805979+0000","last_peered":"2024-09-21T03:15:15.805979+0000","last_clean":"2024-09-21T03:15:15.805979+0000","last_became_active":"2024-09-21T03:14:47.562943+0000","last_became_peered":"2024-09-21T03:14:47.562943+0000","last_unstale":"2024-09-21T03:15:15.805979+0000","last_undegraded":"2024-09-21T03:15:15.805979+0000","last_fullsized":"2024-09-21T03:15:15.805979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:39.284350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678175+0000","last_change":"2024-09-21T03:14:38.484311+0000","last_active":"2024-09-21T03:15:15.678175+0000","last_peered":"2024-09-21T03:15:15.678175+0000","last_clean":"2024-09-21T03:15:15.678175+0000","last_became_active":"2024-09-21T03:14:38.483975+0000","last_became_peered":"2024-09-21T03:14:38.483975+0000","last_unstale":"2024-09-21T03:15:15.678175+0000","last_undegraded":"2024-09-21T03:15:15.678175+0000","last_fullsized":"2024-09-21T03:15:15.678175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:31.145431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806372+0000","last_change":"2024-09-21T03:14:47.566252+0000","last_active":"2024-09-21T03:15:15.806372+0000","last_peered":"2024-09-21T03:15:15.806372+0000","last_clean":"2024-09-21T03:15:15.806372+0000","last_became_active":"2024-09-21T03:14:47.560282+0000","last_became_peered":"2024-09-21T03:14:47.560282+0000","last_unstale":"2024-09-21T03:15:15.806372+0000","last_undegraded":"2024-09-21T03:15:15.806372+0000","last_fullsized":"2024-09-21T03:15:15.806372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:23.553847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683395+0000","last_change":"2024-09-21T03:14:38.477183+0000","last_active":"2024-09-21T03:15:15.683395+0000","last_peered":"2024-09-21T03:15:15.683395+0000","last_clean":"2024-09-21T03:15:15.683395+0000","last_became_active":"2024-09-21T03:14:38.476657+0000","last_became_peered":"2024-09-21T03:14:38.476657+0000","last_unstale":"2024-09-21T03:15:15.683395+0000","last_undegraded":"2024-09-21T03:15:15.683395+0000","last_fullsized":"2024-09-21T03:15:15.683395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:36.801764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677510+0000","last_change":"2024-09-21T03:14:47.574339+0000","last_active":"2024-09-21T03:15:15.677510+0000","last_peered":"2024-09-21T03:15:15.677510+0000","last_clean":"2024-09-21T03:15:15.677510+0000","last_became_active":"2024-09-21T03:14:47.565732+0000","last_became_peered":"2024-09-21T03:14:47.565732+0000","last_unstale":"2024-09-21T03:15:15.677510+0000","last_undegraded":"2024-09-21T03:15:15.677510+0000","last_fullsized":"2024-09-21T03:15:15.677510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:57.896810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682397+0000","last_change":"2024-09-21T03:14:38.472860+0000","last_active":"2024-09-21T03:15:14.682397+0000","last_peered":"2024-09-21T03:15:14.682397+0000","last_clean":"2024-09-21T03:15:14.682397+0000","last_became_active":"2024-09-21T03:14:38.472548+0000","last_became_peered":"2024-09-21T03:14:38.472548+0000","last_unstale":"2024-09-21T03:15:14.682397+0000","last_undegraded":"2024-09-21T03:15:14.682397+0000","last_fullsized":"2024-09-21T03:15:14.682397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:16.071692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681588+0000","last_change":"2024-09-21T03:14:47.557402+0000","last_active":"2024-09-21T03:15:15.681588+0000","last_peered":"2024-09-21T03:15:15.681588+0000","last_clean":"2024-09-21T03:15:15.681588+0000","last_became_active":"2024-09-21T03:14:47.557047+0000","last_became_peered":"2024-09-21T03:14:47.557047+0000","last_unstale":"2024-09-21T03:15:15.681588+0000","last_undegraded":"2024-09-21T03:15:15.681588+0000","last_fullsized":"2024-09-21T03:15:15.681588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:29.792514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681269+0000","last_change":"2024-09-21T03:14:38.481039+0000","last_active":"2024-09-21T03:15:15.681269+0000","last_peered":"2024-09-21T03:15:15.681269+0000","last_clean":"2024-09-21T03:15:15.681269+0000","last_became_active":"2024-09-21T03:14:38.480686+0000","last_became_peered":"2024-09-21T03:14:38.480686+0000","last_unstale":"2024-09-21T03:15:15.681269+0000","last_undegraded":"2024-09-21T03:15:15.681269+0000","last_fullsized":"2024-09-21T03:15:15.681269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:18.603386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680603+0000","last_change":"2024-09-21T03:14:47.565697+0000","last_active":"2024-09-21T03:15:15.680603+0000","last_peered":"2024-09-21T03:15:15.680603+0000","last_clean":"2024-09-21T03:15:15.680603+0000","last_became_active":"2024-09-21T03:14:47.565393+0000","last_became_peered":"2024-09-21T03:14:47.565393+0000","last_unstale":"2024-09-21T03:15:15.680603+0000","last_undegraded":"2024-09-21T03:15:15.680603+0000","last_fullsized":"2024-09-21T03:15:15.680603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:35.421803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558553+0000","last_change":"2024-09-21T03:14:38.473900+0000","last_active":"2024-09-21T03:14:48.558553+0000","last_peered":"2024-09-21T03:14:48.558553+0000","last_clean":"2024-09-21T03:14:48.558553+0000","last_became_active":"2024-09-21T03:14:38.471325+0000","last_became_peered":"2024-09-21T03:14:38.471325+0000","last_unstale":"2024-09-21T03:14:48.558553+0000","last_undegraded":"2024-09-21T03:14:48.558553+0000","last_fullsized":"2024-09-21T03:14:48.558553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:47.556293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.685190+0000","last_change":"2024-09-21T03:15:15.685059+0000","last_active":"2024-09-21T03:15:15.685190+0000","last_peered":"2024-09-21T03:15:15.685190+0000","last_clean":"2024-09-21T03:15:15.685190+0000","last_became_active":"2024-09-21T03:15:15.684633+0000","last_became_peered":"2024-09-21T03:15:15.684633+0000","last_unstale":"2024-09-21T03:15:15.685190+0000","last_undegraded":"2024-09-21T03:15:15.685190+0000","last_fullsized":"2024-09-21T03:15:15.685190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:22.251366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557408+0000","last_change":"2024-09-21T03:14:38.478099+0000","last_active":"2024-09-21T03:14:48.557408+0000","last_peered":"2024-09-21T03:14:48.557408+0000","last_clean":"2024-09-21T03:14:48.557408+0000","last_became_active":"2024-09-21T03:14:38.475894+0000","last_became_peered":"2024-09-21T03:14:38.475894+0000","last_unstale":"2024-09-21T03:14:48.557408+0000","last_undegraded":"2024-09-21T03:14:48.557408+0000","last_fullsized":"2024-09-21T03:14:48.557408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:49.876430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681689+0000","last_change":"2024-09-21T03:14:47.556933+0000","last_active":"2024-09-21T03:15:14.681689+0000","last_peered":"2024-09-21T03:15:14.681689+0000","last_clean":"2024-09-21T03:15:14.681689+0000","last_became_active":"2024-09-21T03:14:47.556615+0000","last_became_peered":"2024-09-21T03:14:47.556615+0000","last_unstale":"2024-09-21T03:15:14.681689+0000","last_undegraded":"2024-09-21T03:15:14.681689+0000","last_fullsized":"2024-09-21T03:15:14.681689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:27.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678569+0000","last_change":"2024-09-21T03:14:38.484198+0000","last_active":"2024-09-21T03:15:15.678569+0000","last_peered":"2024-09-21T03:15:15.678569+0000","last_clean":"2024-09-21T03:15:15.678569+0000","last_became_active":"2024-09-21T03:14:38.483893+0000","last_became_peered":"2024-09-21T03:14:38.483893+0000","last_unstale":"2024-09-21T03:15:15.678569+0000","last_undegraded":"2024-09-21T03:15:15.678569+0000","last_fullsized":"2024-09-21T03:15:15.678569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:56.665359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677336+0000","last_change":"2024-09-21T03:14:47.553479+0000","last_active":"2024-09-21T03:15:15.677336+0000","last_peered":"2024-09-21T03:15:15.677336+0000","last_clean":"2024-09-21T03:15:15.677336+0000","last_became_active":"2024-09-21T03:14:47.553144+0000","last_became_peered":"2024-09-21T03:14:47.553144+0000","last_unstale":"2024-09-21T03:15:15.677336+0000","last_undegraded":"2024-09-21T03:15:15.677336+0000","last_fullsized":"2024-09-21T03:15:15.677336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:26.321488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681234+0000","last_change":"2024-09-21T03:14:38.487093+0000","last_active":"2024-09-21T03:15:15.681234+0000","last_peered":"2024-09-21T03:15:15.681234+0000","last_clean":"2024-09-21T03:15:15.681234+0000","last_became_active":"2024-09-21T03:14:38.486204+0000","last_became_peered":"2024-09-21T03:14:38.486204+0000","last_unstale":"2024-09-21T03:15:15.681234+0000","last_undegraded":"2024-09-21T03:15:15.681234+0000","last_fullsized":"2024-09-21T03:15:15.681234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:55.531046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684987+0000","last_change":"2024-09-21T03:14:47.573375+0000","last_active":"2024-09-21T03:15:15.684987+0000","last_peered":"2024-09-21T03:15:15.684987+0000","last_clean":"2024-09-21T03:15:15.684987+0000","last_became_active":"2024-09-21T03:14:47.572717+0000","last_became_peered":"2024-09-21T03:14:47.572717+0000","last_unstale":"2024-09-21T03:15:15.684987+0000","last_undegraded":"2024-09-21T03:15:15.684987+0000","last_fullsized":"2024-09-21T03:15:15.684987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:44.673283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681844+0000","last_change":"2024-09-21T03:14:38.471959+0000","last_active":"2024-09-21T03:15:14.681844+0000","last_peered":"2024-09-21T03:15:14.681844+0000","last_clean":"2024-09-21T03:15:14.681844+0000","last_became_active":"2024-09-21T03:14:38.471625+0000","last_became_peered":"2024-09-21T03:14:38.471625+0000","last_unstale":"2024-09-21T03:15:14.681844+0000","last_undegraded":"2024-09-21T03:15:14.681844+0000","last_fullsized":"2024-09-21T03:15:14.681844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:17.761951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.687099+0000","last_change":"2024-09-21T03:14:47.564597+0000","last_active":"2024-09-21T03:15:14.687099+0000","last_peered":"2024-09-21T03:15:14.687099+0000","last_clean":"2024-09-21T03:15:14.687099+0000","last_became_active":"2024-09-21T03:14:47.563816+0000","last_became_peered":"2024-09-21T03:14:47.563816+0000","last_unstale":"2024-09-21T03:15:14.687099+0000","last_undegraded":"2024-09-21T03:15:14.687099+0000","last_fullsized":"2024-09-21T03:15:14.687099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:33.061271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678841+0000","last_change":"2024-09-21T03:14:38.491888+0000","last_active":"2024-09-21T03:15:15.678841+0000","last_peered":"2024-09-21T03:15:15.678841+0000","last_clean":"2024-09-21T03:15:15.678841+0000","last_became_active":"2024-09-21T03:14:38.491510+0000","last_became_peered":"2024-09-21T03:14:38.491510+0000","last_unstale":"2024-09-21T03:15:15.678841+0000","last_undegraded":"2024-09-21T03:15:15.678841+0000","last_fullsized":"2024-09-21T03:15:15.678841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:26.740304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558275+0000","last_change":"2024-09-21T03:14:47.564310+0000","last_active":"2024-09-21T03:14:48.558275+0000","last_peered":"2024-09-21T03:14:48.558275+0000","last_clean":"2024-09-21T03:14:48.558275+0000","last_became_active":"2024-09-21T03:14:47.564003+0000","last_became_peered":"2024-09-21T03:14:47.564003+0000","last_unstale":"2024-09-21T03:14:48.558275+0000","last_undegraded":"2024-09-21T03:14:48.558275+0000","last_fullsized":"2024-09-21T03:14:48.558275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:45.016321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804618+0000","last_change":"2024-09-21T03:14:38.470991+0000","last_active":"2024-09-21T03:15:15.804618+0000","last_peered":"2024-09-21T03:15:15.804618+0000","last_clean":"2024-09-21T03:15:15.804618+0000","last_became_active":"2024-09-21T03:14:38.470666+0000","last_became_peered":"2024-09-21T03:14:38.470666+0000","last_unstale":"2024-09-21T03:15:15.804618+0000","last_undegraded":"2024-09-21T03:15:15.804618+0000","last_fullsized":"2024-09-21T03:15:15.804618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:25.477992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684492+0000","last_change":"2024-09-21T03:14:47.575212+0000","last_active":"2024-09-21T03:15:15.684492+0000","last_peered":"2024-09-21T03:15:15.684492+0000","last_clean":"2024-09-21T03:15:15.684492+0000","last_became_active":"2024-09-21T03:14:47.574895+0000","last_became_peered":"2024-09-21T03:14:47.574895+0000","last_unstale":"2024-09-21T03:15:15.684492+0000","last_undegraded":"2024-09-21T03:15:15.684492+0000","last_fullsized":"2024-09-21T03:15:15.684492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:04.240949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806008+0000","last_change":"2024-09-21T03:14:38.482681+0000","last_active":"2024-09-21T03:15:15.806008+0000","last_peered":"2024-09-21T03:15:15.806008+0000","last_clean":"2024-09-21T03:15:15.806008+0000","last_became_active":"2024-09-21T03:14:38.477816+0000","last_became_peered":"2024-09-21T03:14:38.477816+0000","last_unstale":"2024-09-21T03:15:15.806008+0000","last_undegraded":"2024-09-21T03:15:15.806008+0000","last_fullsized":"2024-09-21T03:15:15.806008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:18.675641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677394+0000","last_change":"2024-09-21T03:14:47.555329+0000","last_active":"2024-09-21T03:15:15.677394+0000","last_peered":"2024-09-21T03:15:15.677394+0000","last_clean":"2024-09-21T03:15:15.677394+0000","last_became_active":"2024-09-21T03:14:47.555033+0000","last_became_peered":"2024-09-21T03:14:47.555033+0000","last_unstale":"2024-09-21T03:15:15.677394+0000","last_undegraded":"2024-09-21T03:15:15.677394+0000","last_fullsized":"2024-09-21T03:15:15.677394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:49.060834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681613+0000","last_change":"2024-09-21T03:14:38.480638+0000","last_active":"2024-09-21T03:15:15.681613+0000","last_peered":"2024-09-21T03:15:15.681613+0000","last_clean":"2024-09-21T03:15:15.681613+0000","last_became_active":"2024-09-21T03:14:38.477739+0000","last_became_peered":"2024-09-21T03:14:38.477739+0000","last_unstale":"2024-09-21T03:15:15.681613+0000","last_undegraded":"2024-09-21T03:15:15.681613+0000","last_fullsized":"2024-09-21T03:15:15.681613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:35.097761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680739+0000","last_change":"2024-09-21T03:14:47.573659+0000","last_active":"2024-09-21T03:15:15.680739+0000","last_peered":"2024-09-21T03:15:15.680739+0000","last_clean":"2024-09-21T03:15:15.680739+0000","last_became_active":"2024-09-21T03:14:47.572756+0000","last_became_peered":"2024-09-21T03:14:47.572756+0000","last_unstale":"2024-09-21T03:15:15.680739+0000","last_undegraded":"2024-09-21T03:15:15.680739+0000","last_fullsized":"2024-09-21T03:15:15.680739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:21.986681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.685032+0000","last_change":"2024-09-21T03:14:38.478039+0000","last_active":"2024-09-21T03:15:14.685032+0000","last_peered":"2024-09-21T03:15:14.685032+0000","last_clean":"2024-09-21T03:15:14.685032+0000","last_became_active":"2024-09-21T03:14:38.473843+0000","last_became_peered":"2024-09-21T03:14:38.473843+0000","last_unstale":"2024-09-21T03:15:14.685032+0000","last_undegraded":"2024-09-21T03:15:14.685032+0000","last_fullsized":"2024-09-21T03:15:14.685032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:27.072406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677250+0000","last_change":"2024-09-21T03:14:47.555386+0000","last_active":"2024-09-21T03:15:15.677250+0000","last_peered":"2024-09-21T03:15:15.677250+0000","last_clean":"2024-09-21T03:15:15.677250+0000","last_became_active":"2024-09-21T03:14:47.554758+0000","last_became_peered":"2024-09-21T03:14:47.554758+0000","last_unstale":"2024-09-21T03:15:15.677250+0000","last_undegraded":"2024-09-21T03:15:15.677250+0000","last_fullsized":"2024-09-21T03:15:15.677250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:47.574672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.685167+0000","last_change":"2024-09-21T03:14:38.494878+0000","last_active":"2024-09-21T03:15:15.685167+0000","last_peered":"2024-09-21T03:15:15.685167+0000","last_clean":"2024-09-21T03:15:15.685167+0000","last_became_active":"2024-09-21T03:14:38.492813+0000","last_became_peered":"2024-09-21T03:14:38.492813+0000","last_unstale":"2024-09-21T03:15:15.685167+0000","last_undegraded":"2024-09-21T03:15:15.685167+0000","last_fullsized":"2024-09-21T03:15:15.685167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:55.064844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557554+0000","last_change":"2024-09-21T03:14:47.544806+0000","last_active":"2024-09-21T03:14:48.557554+0000","last_peered":"2024-09-21T03:14:48.557554+0000","last_clean":"2024-09-21T03:14:48.557554+0000","last_became_active":"2024-09-21T03:14:47.544431+0000","last_became_peered":"2024-09-21T03:14:47.544431+0000","last_unstale":"2024-09-21T03:14:48.557554+0000","last_undegraded":"2024-09-21T03:14:48.557554+0000","last_fullsized":"2024-09-21T03:14:48.557554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:01.463573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.687263+0000","last_change":"2024-09-21T03:14:38.474462+0000","last_active":"2024-09-21T03:15:14.687263+0000","last_peered":"2024-09-21T03:15:14.687263+0000","last_clean":"2024-09-21T03:15:14.687263+0000","last_became_active":"2024-09-21T03:14:38.474156+0000","last_became_peered":"2024-09-21T03:14:38.474156+0000","last_unstale":"2024-09-21T03:15:14.687263+0000","last_undegraded":"2024-09-21T03:15:14.687263+0000","last_fullsized":"2024-09-21T03:15:14.687263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:55.329945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806137+0000","last_change":"2024-09-21T03:14:47.563297+0000","last_active":"2024-09-21T03:15:15.806137+0000","last_peered":"2024-09-21T03:15:15.806137+0000","last_clean":"2024-09-21T03:15:15.806137+0000","last_became_active":"2024-09-21T03:14:47.562519+0000","last_became_peered":"2024-09-21T03:14:47.562519+0000","last_unstale":"2024-09-21T03:15:15.806137+0000","last_undegraded":"2024-09-21T03:15:15.806137+0000","last_fullsized":"2024-09-21T03:15:15.806137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:47.959373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681798+0000","last_change":"2024-09-21T03:14:38.474262+0000","last_active":"2024-09-21T03:15:14.681798+0000","last_peered":"2024-09-21T03:15:14.681798+0000","last_clean":"2024-09-21T03:15:14.681798+0000","last_became_active":"2024-09-21T03:14:38.473856+0000","last_became_peered":"2024-09-21T03:14:38.473856+0000","last_unstale":"2024-09-21T03:15:14.681798+0000","last_undegraded":"2024-09-21T03:15:14.681798+0000","last_fullsized":"2024-09-21T03:15:14.681798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804869+0000","last_change":"2024-09-21T03:14:47.558732+0000","last_active":"2024-09-21T03:15:15.804869+0000","last_peered":"2024-09-21T03:15:15.804869+0000","last_clean":"2024-09-21T03:15:15.804869+0000","last_became_active":"2024-09-21T03:14:47.558403+0000","last_became_peered":"2024-09-21T03:14:47.558403+0000","last_unstale":"2024-09-21T03:15:15.804869+0000","last_undegraded":"2024-09-21T03:15:15.804869+0000","last_fullsized":"2024-09-21T03:15:15.804869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:46.054565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678631+0000","last_change":"2024-09-21T03:14:38.469736+0000","last_active":"2024-09-21T03:15:15.678631+0000","last_peered":"2024-09-21T03:15:15.678631+0000","last_clean":"2024-09-21T03:15:15.678631+0000","last_became_active":"2024-09-21T03:14:38.469240+0000","last_became_peered":"2024-09-21T03:14:38.469240+0000","last_unstale":"2024-09-21T03:15:15.678631+0000","last_undegraded":"2024-09-21T03:15:15.678631+0000","last_fullsized":"2024-09-21T03:15:15.678631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:04.258761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804652+0000","last_change":"2024-09-21T03:14:47.550684+0000","last_active":"2024-09-21T03:15:15.804652+0000","last_peered":"2024-09-21T03:15:15.804652+0000","last_clean":"2024-09-21T03:15:15.804652+0000","last_became_active":"2024-09-21T03:14:47.550375+0000","last_became_peered":"2024-09-21T03:14:47.550375+0000","last_unstale":"2024-09-21T03:15:15.804652+0000","last_undegraded":"2024-09-21T03:15:15.804652+0000","last_fullsized":"2024-09-21T03:15:15.804652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:05.268160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557691+0000","last_change":"2024-09-21T03:14:38.487983+0000","last_active":"2024-09-21T03:14:48.557691+0000","last_peered":"2024-09-21T03:14:48.557691+0000","last_clean":"2024-09-21T03:14:48.557691+0000","last_became_active":"2024-09-21T03:14:38.487676+0000","last_became_peered":"2024-09-21T03:14:38.487676+0000","last_unstale":"2024-09-21T03:14:48.557691+0000","last_undegraded":"2024-09-21T03:14:48.557691+0000","last_fullsized":"2024-09-21T03:14:48.557691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:35.320169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684351+0000","last_change":"2024-09-21T03:14:47.561566+0000","last_active":"2024-09-21T03:15:14.684351+0000","last_peered":"2024-09-21T03:15:14.684351+0000","last_clean":"2024-09-21T03:15:14.684351+0000","last_became_active":"2024-09-21T03:14:47.561229+0000","last_became_peered":"2024-09-21T03:14:47.561229+0000","last_unstale":"2024-09-21T03:15:14.684351+0000","last_undegraded":"2024-09-21T03:15:14.684351+0000","last_fullsized":"2024-09-21T03:15:14.684351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:07.280356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558891+0000","last_change":"2024-09-21T03:14:38.478853+0000","last_active":"2024-09-21T03:14:48.558891+0000","last_peered":"2024-09-21T03:14:48.558891+0000","last_clean":"2024-09-21T03:14:48.558891+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:14:48.558891+0000","last_undegraded":"2024-09-21T03:14:48.558891+0000","last_fullsized":"2024-09-21T03:14:48.558891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:31.427596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":2,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-21T03:14:51.026823+0000","last_change":"2024-09-21T03:15:15.025321+0000","last_active":"2024-09-21T03:15:15.025321+0000","last_peered":"2024-09-21T03:14:51.026823+0000","last_clean":"2024-09-21T03:14:51.026823+0000","last_became_active":"2024-09-21T03:14:47.552659+0000","last_became_peered":"2024-09-21T03:14:47.552659+0000","last_unstale":"2024-09-21T03:14:51.026823+0000","last_undegraded":"2024-09-21T03:14:51.026823+0000","last_fullsized":"2024-09-21T03:14:51.026823+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681084+0000","last_change":"2024-09-21T03:14:38.481308+0000","last_active":"2024-09-21T03:15:15.681084+0000","last_peered":"2024-09-21T03:15:15.681084+0000","last_clean":"2024-09-21T03:15:15.681084+0000","last_became_active":"2024-09-21T03:14:38.480923+0000","last_became_peered":"2024-09-21T03:14:38.480923+0000","last_unstale":"2024-09-21T03:15:15.681084+0000","last_undegraded":"2024-09-21T03:15:15.681084+0000","last_fullsized":"2024-09-21T03:15:15.681084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:40.689231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557324+0000","last_change":"2024-09-21T03:14:47.561972+0000","last_active":"2024-09-21T03:14:48.557324+0000","last_peered":"2024-09-21T03:14:48.557324+0000","last_clean":"2024-09-21T03:14:48.557324+0000","last_became_active":"2024-09-21T03:14:47.561645+0000","last_became_peered":"2024-09-21T03:14:47.561645+0000","last_unstale":"2024-09-21T03:14:48.557324+0000","last_undegraded":"2024-09-21T03:14:48.557324+0000","last_fullsized":"2024-09-21T03:14:48.557324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:57.526787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681129+0000","last_change":"2024-09-21T03:14:38.473907+0000","last_active":"2024-09-21T03:15:15.681129+0000","last_peered":"2024-09-21T03:15:15.681129+0000","last_clean":"2024-09-21T03:15:15.681129+0000","last_became_active":"2024-09-21T03:14:38.473579+0000","last_became_peered":"2024-09-21T03:14:38.473579+0000","last_unstale":"2024-09-21T03:15:15.681129+0000","last_undegraded":"2024-09-21T03:15:15.681129+0000","last_fullsized":"2024-09-21T03:15:15.681129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:32.273503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680383+0000","last_change":"2024-09-21T03:14:47.566089+0000","last_active":"2024-09-21T03:15:15.680383+0000","last_peered":"2024-09-21T03:15:15.680383+0000","last_clean":"2024-09-21T03:15:15.680383+0000","last_became_active":"2024-09-21T03:14:47.565681+0000","last_became_peered":"2024-09-21T03:14:47.565681+0000","last_unstale":"2024-09-21T03:15:15.680383+0000","last_undegraded":"2024-09-21T03:15:15.680383+0000","last_fullsized":"2024-09-21T03:15:15.680383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.208933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681048+0000","last_change":"2024-09-21T03:14:38.474326+0000","last_active":"2024-09-21T03:15:15.681048+0000","last_peered":"2024-09-21T03:15:15.681048+0000","last_clean":"2024-09-21T03:15:15.681048+0000","last_became_active":"2024-09-21T03:14:38.470430+0000","last_became_peered":"2024-09-21T03:14:38.470430+0000","last_unstale":"2024-09-21T03:15:15.681048+0000","last_undegraded":"2024-09-21T03:15:15.681048+0000","last_fullsized":"2024-09-21T03:15:15.681048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:09.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680250+0000","last_change":"2024-09-21T03:14:47.571487+0000","last_active":"2024-09-21T03:15:15.680250+0000","last_peered":"2024-09-21T03:15:15.680250+0000","last_clean":"2024-09-21T03:15:15.680250+0000","last_became_active":"2024-09-21T03:14:47.571126+0000","last_became_peered":"2024-09-21T03:14:47.571126+0000","last_unstale":"2024-09-21T03:15:15.680250+0000","last_undegraded":"2024-09-21T03:15:15.680250+0000","last_fullsized":"2024-09-21T03:15:15.680250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:57.128853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805276+0000","last_change":"2024-09-21T03:14:38.483370+0000","last_active":"2024-09-21T03:15:15.805276+0000","last_peered":"2024-09-21T03:15:15.805276+0000","last_clean":"2024-09-21T03:15:15.805276+0000","last_became_active":"2024-09-21T03:14:38.483019+0000","last_became_peered":"2024-09-21T03:14:38.483019+0000","last_unstale":"2024-09-21T03:15:15.805276+0000","last_undegraded":"2024-09-21T03:15:15.805276+0000","last_fullsized":"2024-09-21T03:15:15.805276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:55.085422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679803+0000","last_change":"2024-09-21T03:14:47.555777+0000","last_active":"2024-09-21T03:15:15.679803+0000","last_peered":"2024-09-21T03:15:15.679803+0000","last_clean":"2024-09-21T03:15:15.679803+0000","last_became_active":"2024-09-21T03:14:47.555465+0000","last_became_peered":"2024-09-21T03:14:47.555465+0000","last_unstale":"2024-09-21T03:15:15.679803+0000","last_undegraded":"2024-09-21T03:15:15.679803+0000","last_fullsized":"2024-09-21T03:15:15.679803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:27.123740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678858+0000","last_change":"2024-09-21T03:14:38.465771+0000","last_active":"2024-09-21T03:15:15.678858+0000","last_peered":"2024-09-21T03:15:15.678858+0000","last_clean":"2024-09-21T03:15:15.678858+0000","last_became_active":"2024-09-21T03:14:38.465479+0000","last_became_peered":"2024-09-21T03:14:38.465479+0000","last_unstale":"2024-09-21T03:15:15.678858+0000","last_undegraded":"2024-09-21T03:15:15.678858+0000","last_fullsized":"2024-09-21T03:15:15.678858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.754315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678369+0000","last_change":"2024-09-21T03:14:47.567695+0000","last_active":"2024-09-21T03:15:15.678369+0000","last_peered":"2024-09-21T03:15:15.678369+0000","last_clean":"2024-09-21T03:15:15.678369+0000","last_became_active":"2024-09-21T03:14:47.566936+0000","last_became_peered":"2024-09-21T03:14:47.566936+0000","last_unstale":"2024-09-21T03:15:15.678369+0000","last_undegraded":"2024-09-21T03:15:15.678369+0000","last_fullsized":"2024-09-21T03:15:15.678369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:48.182523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.808619+0000","last_change":"2024-09-21T03:15:15.807206+0000","last_active":"2024-09-21T03:15:15.808619+0000","last_peered":"2024-09-21T03:15:15.808619+0000","last_clean":"2024-09-21T03:15:15.808619+0000","last_became_active":"2024-09-21T03:15:15.806775+0000","last_became_peered":"2024-09-21T03:15:15.806775+0000","last_unstale":"2024-09-21T03:15:15.808619+0000","last_undegraded":"2024-09-21T03:15:15.808619+0000","last_fullsized":"2024-09-21T03:15:15.808619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:51.779236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805513+0000","last_change":"2024-09-21T03:14:47.580314+0000","last_active":"2024-09-21T03:15:15.805513+0000","last_peered":"2024-09-21T03:15:15.805513+0000","last_clean":"2024-09-21T03:15:15.805513+0000","last_became_active":"2024-09-21T03:14:47.576499+0000","last_became_peered":"2024-09-21T03:14:47.576499+0000","last_unstale":"2024-09-21T03:15:15.805513+0000","last_undegraded":"2024-09-21T03:15:15.805513+0000","last_fullsized":"2024-09-21T03:15:15.805513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:46.154586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678336+0000","last_change":"2024-09-21T03:14:38.471270+0000","last_active":"2024-09-21T03:15:15.678336+0000","last_peered":"2024-09-21T03:15:15.678336+0000","last_clean":"2024-09-21T03:15:15.678336+0000","last_became_active":"2024-09-21T03:14:38.470708+0000","last_became_peered":"2024-09-21T03:14:38.470708+0000","last_unstale":"2024-09-21T03:15:15.678336+0000","last_undegraded":"2024-09-21T03:15:15.678336+0000","last_fullsized":"2024-09-21T03:15:15.678336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.122804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804703+0000","last_change":"2024-09-21T03:14:47.554180+0000","last_active":"2024-09-21T03:15:15.804703+0000","last_peered":"2024-09-21T03:15:15.804703+0000","last_clean":"2024-09-21T03:15:15.804703+0000","last_became_active":"2024-09-21T03:14:47.552808+0000","last_became_peered":"2024-09-21T03:14:47.552808+0000","last_unstale":"2024-09-21T03:15:15.804703+0000","last_undegraded":"2024-09-21T03:15:15.804703+0000","last_fullsized":"2024-09-21T03:15:15.804703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:07.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681593+0000","last_change":"2024-09-21T03:14:38.466077+0000","last_active":"2024-09-21T03:15:15.681593+0000","last_peered":"2024-09-21T03:15:15.681593+0000","last_clean":"2024-09-21T03:15:15.681593+0000","last_became_active":"2024-09-21T03:14:38.465818+0000","last_became_peered":"2024-09-21T03:14:38.465818+0000","last_unstale":"2024-09-21T03:15:15.681593+0000","last_undegraded":"2024-09-21T03:15:15.681593+0000","last_fullsized":"2024-09-21T03:15:15.681593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:34.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684015+0000","last_change":"2024-09-21T03:14:47.577228+0000","last_active":"2024-09-21T03:15:15.684015+0000","last_peered":"2024-09-21T03:15:15.684015+0000","last_clean":"2024-09-21T03:15:15.684015+0000","last_became_active":"2024-09-21T03:14:47.576843+0000","last_became_peered":"2024-09-21T03:14:47.576843+0000","last_unstale":"2024-09-21T03:15:15.684015+0000","last_undegraded":"2024-09-21T03:15:15.684015+0000","last_fullsized":"2024-09-21T03:15:15.684015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:56.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677741+0000","last_change":"2024-09-21T03:14:38.481389+0000","last_active":"2024-09-21T03:15:15.677741+0000","last_peered":"2024-09-21T03:15:15.677741+0000","last_clean":"2024-09-21T03:15:15.677741+0000","last_became_active":"2024-09-21T03:14:38.470907+0000","last_became_peered":"2024-09-21T03:14:38.470907+0000","last_unstale":"2024-09-21T03:15:15.677741+0000","last_undegraded":"2024-09-21T03:15:15.677741+0000","last_fullsized":"2024-09-21T03:15:15.677741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:30.068915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680895+0000","last_change":"2024-09-21T03:14:47.551766+0000","last_active":"2024-09-21T03:15:15.680895+0000","last_peered":"2024-09-21T03:15:15.680895+0000","last_clean":"2024-09-21T03:15:15.680895+0000","last_became_active":"2024-09-21T03:14:47.551420+0000","last_became_peered":"2024-09-21T03:14:47.551420+0000","last_unstale":"2024-09-21T03:15:15.680895+0000","last_undegraded":"2024-09-21T03:15:15.680895+0000","last_fullsized":"2024-09-21T03:15:15.680895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:56.255472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681739+0000","last_change":"2024-09-21T03:14:38.482605+0000","last_active":"2024-09-21T03:15:15.681739+0000","last_peered":"2024-09-21T03:15:15.681739+0000","last_clean":"2024-09-21T03:15:15.681739+0000","last_became_active":"2024-09-21T03:14:38.482306+0000","last_became_peered":"2024-09-21T03:14:38.482306+0000","last_unstale":"2024-09-21T03:15:15.681739+0000","last_undegraded":"2024-09-21T03:15:15.681739+0000","last_fullsized":"2024-09-21T03:15:15.681739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:40.482635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678145+0000","last_change":"2024-09-21T03:14:47.555070+0000","last_active":"2024-09-21T03:15:15.678145+0000","last_peered":"2024-09-21T03:15:15.678145+0000","last_clean":"2024-09-21T03:15:15.678145+0000","last_became_active":"2024-09-21T03:14:47.554363+0000","last_became_peered":"2024-09-21T03:14:47.554363+0000","last_unstale":"2024-09-21T03:15:15.678145+0000","last_undegraded":"2024-09-21T03:15:15.678145+0000","last_fullsized":"2024-09-21T03:15:15.678145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:40.027266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680191+0000","last_change":"2024-09-21T03:14:38.496218+0000","last_active":"2024-09-21T03:15:15.680191+0000","last_peered":"2024-09-21T03:15:15.680191+0000","last_clean":"2024-09-21T03:15:15.680191+0000","last_became_active":"2024-09-21T03:14:38.488537+0000","last_became_peered":"2024-09-21T03:14:38.488537+0000","last_unstale":"2024-09-21T03:15:15.680191+0000","last_undegraded":"2024-09-21T03:15:15.680191+0000","last_fullsized":"2024-09-21T03:15:15.680191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:59.667392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677329+0000","last_change":"2024-09-21T03:14:47.564250+0000","last_active":"2024-09-21T03:15:15.677329+0000","last_peered":"2024-09-21T03:15:15.677329+0000","last_clean":"2024-09-21T03:15:15.677329+0000","last_became_active":"2024-09-21T03:14:47.563745+0000","last_became_peered":"2024-09-21T03:14:47.563745+0000","last_unstale":"2024-09-21T03:15:15.677329+0000","last_undegraded":"2024-09-21T03:15:15.677329+0000","last_fullsized":"2024-09-21T03:15:15.677329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:31.282910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681230+0000","last_change":"2024-09-21T03:14:38.490309+0000","last_active":"2024-09-21T03:15:15.681230+0000","last_peered":"2024-09-21T03:15:15.681230+0000","last_clean":"2024-09-21T03:15:15.681230+0000","last_became_active":"2024-09-21T03:14:38.489167+0000","last_became_peered":"2024-09-21T03:14:38.489167+0000","last_unstale":"2024-09-21T03:15:15.681230+0000","last_undegraded":"2024-09-21T03:15:15.681230+0000","last_fullsized":"2024-09-21T03:15:15.681230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:07.725691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3656,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3656,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":698575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":319488,"data_stored":120849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":110425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":698041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":103380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":101880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:15:17.054 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:15:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.306+0000 7f61b9000640 1 -- 172.21.15.90:0/3647410447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61b413d110 msgr2=0x7f61b413d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.306+0000 7f61b9000640 1 --2- 172.21.15.90:0/3647410447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61b413d110 0x7f61b413d520 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f619c005fd0 tx=0x7f619c02a540 comp rx=0 tx=0).stop 2024-09-21T03:15:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.306+0000 7f61b9000640 1 -- 172.21.15.90:0/3647410447 shutdown_connections 2024-09-21T03:15:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.306+0000 7f61b9000640 1 --2- 172.21.15.90:0/3647410447 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61b4154ad0 0x7f61b4154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.306+0000 7f61b9000640 1 --2- 172.21.15.90:0/3647410447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61b413d110 0x7f61b413d520 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.306+0000 7f61b9000640 1 -- 172.21.15.90:0/3647410447 >> 172.21.15.90:0/3647410447 conn(0x7f61b40c84c0 msgr2=0x7f61b40c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.306+0000 7f61b9000640 1 -- 172.21.15.90:0/3647410447 shutdown_connections 2024-09-21T03:15:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.306+0000 7f61b9000640 1 -- 172.21.15.90:0/3647410447 wait complete. 2024-09-21T03:15:17.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.308+0000 7f61b9000640 1 Processor -- start 2024-09-21T03:15:17.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.308+0000 7f61b9000640 1 -- start start 2024-09-21T03:15:17.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.309+0000 7f61b9000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61b413d110 0x7f61b41e05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:17.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.309+0000 7f61b9000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61b413dde0 0x7f61b41574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:17.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.310+0000 7f61b9000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61b4154ad0 0x7f61b41ea9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:17.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.310+0000 7f61b9000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f61b40c56d0 con 0x7f61b4154ad0 2024-09-21T03:15:17.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.310+0000 7f61b9000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f61b413da60 con 0x7f61b413d110 2024-09-21T03:15:17.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.310+0000 7f61b9000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f61b40c5850 con 0x7f61b413dde0 2024-09-21T03:15:17.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.310+0000 7f61b3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61b4154ad0 0x7f61b41ea9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:17.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.310+0000 7f61b3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61b4154ad0 0x7f61b41ea9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47652/0 (socket says 172.21.15.90:47652) 2024-09-21T03:15:17.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.310+0000 7f61b3e00640 1 -- 172.21.15.90:0/3064270073 learned_addr learned my addr 172.21.15.90:0/3064270073 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:17.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.310+0000 7f61b3400640 1 --2- 172.21.15.90:0/3064270073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61b413d110 0x7f61b41e05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:17.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.310+0000 7f61aaa00640 1 --2- 172.21.15.90:0/3064270073 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61b413dde0 0x7f61b41574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:17.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.310+0000 7f61b3e00640 1 -- 172.21.15.90:0/3064270073 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61b413dde0 msgr2=0x7f61b41574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:17.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.310+0000 7f61b3e00640 1 --2- 172.21.15.90:0/3064270073 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61b413dde0 0x7f61b41574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:17.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.310+0000 7f61b3e00640 1 -- 172.21.15.90:0/3064270073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61b413d110 msgr2=0x7f61b41e05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:17.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.310+0000 7f61b3e00640 1 --2- 172.21.15.90:0/3064270073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61b413d110 0x7f61b41e05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:17.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.310+0000 7f61b3e00640 1 -- 172.21.15.90:0/3064270073 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b4138780 con 0x7f61b4154ad0 2024-09-21T03:15:17.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.311+0000 7f61b3e00640 1 --2- 172.21.15.90:0/3064270073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61b4154ad0 0x7f61b41ea9e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00d990 tx=0x7f61ac00de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:17.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.311+0000 7f61abe00640 1 -- 172.21.15.90:0/3064270073 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac016070 con 0x7f61b4154ad0 2024-09-21T03:15:17.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.311+0000 7f61abe00640 1 -- 172.21.15.90:0/3064270073 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61ac00be00 con 0x7f61b4154ad0 2024-09-21T03:15:17.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.311+0000 7f61b9000640 1 -- 172.21.15.90:0/3064270073 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b41df480 con 0x7f61b4154ad0 2024-09-21T03:15:17.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.311+0000 7f61abe00640 1 -- 172.21.15.90:0/3064270073 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac003bd0 con 0x7f61b4154ad0 2024-09-21T03:15:17.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.311+0000 7f61b9000640 1 -- 172.21.15.90:0/3064270073 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b41eb440 con 0x7f61b4154ad0 2024-09-21T03:15:17.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.312+0000 7f61b9000640 1 -- 172.21.15.90:0/3064270073 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b413d520 con 0x7f61b4154ad0 2024-09-21T03:15:17.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.314+0000 7f61abe00640 1 -- 172.21.15.90:0/3064270073 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f61ac010460 con 0x7f61b4154ad0 2024-09-21T03:15:17.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.315+0000 7f61abe00640 1 --2- 172.21.15.90:0/3064270073 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6190078bc0 0x7f619007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:17.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.315+0000 7f61abe00640 1 -- 172.21.15.90:0/3064270073 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f61ac09b620 con 0x7f61b4154ad0 2024-09-21T03:15:17.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.315+0000 7f61b3400640 1 --2- 172.21.15.90:0/3064270073 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6190078bc0 0x7f619007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:17.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.316+0000 7f61b3400640 1 --2- 172.21.15.90:0/3064270073 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6190078bc0 0x7f619007b0d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f61a4001720 tx=0x7f61a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:17.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.320+0000 7f61abe00640 1 -- 172.21.15.90:0/3064270073 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f61ac0630d0 con 0x7f61b4154ad0 2024-09-21T03:15:17.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.504+0000 7f61b9000640 1 -- 172.21.15.90:0/3064270073 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f61b4138f80 con 0x7f6190078bc0 2024-09-21T03:15:17.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.513+0000 7f61abe00640 1 -- 172.21.15.90:0/3064270073 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490343 (secure 0 0 0) 0x7f61a4001d00 con 0x7f6190078bc0 2024-09-21T03:15:17.521 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:15:17.524 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-21T03:15:17.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.519+0000 7f61b9000640 1 -- 172.21.15.90:0/3064270073 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6190078bc0 msgr2=0x7f619007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:17.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.519+0000 7f61b9000640 1 --2- 172.21.15.90:0/3064270073 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6190078bc0 0x7f619007b0d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f61a4001720 tx=0x7f61a4009040 comp rx=0 tx=0).stop 2024-09-21T03:15:17.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.519+0000 7f61b9000640 1 -- 172.21.15.90:0/3064270073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61b4154ad0 msgr2=0x7f61b41ea9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:17.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.519+0000 7f61b9000640 1 --2- 172.21.15.90:0/3064270073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61b4154ad0 0x7f61b41ea9e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00d990 tx=0x7f61ac00de50 comp rx=0 tx=0).stop 2024-09-21T03:15:17.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.519+0000 7f61b9000640 1 -- 172.21.15.90:0/3064270073 shutdown_connections 2024-09-21T03:15:17.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.519+0000 7f61b9000640 1 --2- 172.21.15.90:0/3064270073 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6190078bc0 0x7f619007b0d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:17.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.519+0000 7f61b9000640 1 --2- 172.21.15.90:0/3064270073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61b4154ad0 0x7f61b41ea9e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:17.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.519+0000 7f61b9000640 1 --2- 172.21.15.90:0/3064270073 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61b413dde0 0x7f61b41574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:17.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.519+0000 7f61b9000640 1 --2- 172.21.15.90:0/3064270073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61b413d110 0x7f61b41e05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:17.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.519+0000 7f61b9000640 1 -- 172.21.15.90:0/3064270073 >> 172.21.15.90:0/3064270073 conn(0x7f61b40c84c0 msgr2=0x7f61b413a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:17.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.519+0000 7f61b9000640 1 -- 172.21.15.90:0/3064270073 shutdown_connections 2024-09-21T03:15:17.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.519+0000 7f61b9000640 1 -- 172.21.15.90:0/3064270073 wait complete. 2024-09-21T03:15:17.542 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-09-21T03:15:16.484995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597680,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":197,"num_write_kb":1662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219616,"kb_used_data":3388,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755104,"statfs":{"total":773094113280,"available":772869226496,"internally_reserved":0,"allocated":3469312,"data_stored":2048508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2492,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002429"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804323+0000","last_change":"2024-09-21T03:14:47.552762+0000","last_active":"2024-09-21T03:15:15.804323+0000","last_peered":"2024-09-21T03:15:15.804323+0000","last_clean":"2024-09-21T03:15:15.804323+0000","last_became_active":"2024-09-21T03:14:47.551883+0000","last_became_peered":"2024-09-21T03:14:47.551883+0000","last_unstale":"2024-09-21T03:15:15.804323+0000","last_undegraded":"2024-09-21T03:15:15.804323+0000","last_fullsized":"2024-09-21T03:15:15.804323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:51.935797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806503+0000","last_change":"2024-09-21T03:14:37.471004+0000","last_active":"2024-09-21T03:15:15.806503+0000","last_peered":"2024-09-21T03:15:15.806503+0000","last_clean":"2024-09-21T03:15:15.806503+0000","last_became_active":"2024-09-21T03:14:37.470563+0000","last_became_peered":"2024-09-21T03:14:37.470563+0000","last_unstale":"2024-09-21T03:15:15.806503+0000","last_undegraded":"2024-09-21T03:15:15.806503+0000","last_fullsized":"2024-09-21T03:15:15.806503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.422826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680312+0000","last_change":"2024-09-21T03:14:38.496252+0000","last_active":"2024-09-21T03:15:15.680312+0000","last_peered":"2024-09-21T03:15:15.680312+0000","last_clean":"2024-09-21T03:15:15.680312+0000","last_became_active":"2024-09-21T03:14:38.488292+0000","last_became_peered":"2024-09-21T03:14:38.488292+0000","last_unstale":"2024-09-21T03:15:15.680312+0000","last_undegraded":"2024-09-21T03:15:15.680312+0000","last_fullsized":"2024-09-21T03:15:15.680312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:57.409792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683500+0000","last_change":"2024-09-21T03:14:46.549877+0000","last_active":"2024-09-21T03:15:15.683500+0000","last_peered":"2024-09-21T03:15:15.683500+0000","last_clean":"2024-09-21T03:15:15.683500+0000","last_became_active":"2024-09-21T03:14:46.549536+0000","last_became_peered":"2024-09-21T03:14:46.549536+0000","last_unstale":"2024-09-21T03:15:15.683500+0000","last_undegraded":"2024-09-21T03:15:15.683500+0000","last_fullsized":"2024-09-21T03:15:15.683500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:57.491042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804846+0000","last_change":"2024-09-21T03:14:47.560303+0000","last_active":"2024-09-21T03:15:15.804846+0000","last_peered":"2024-09-21T03:15:15.804846+0000","last_clean":"2024-09-21T03:15:15.804846+0000","last_became_active":"2024-09-21T03:14:47.559659+0000","last_became_peered":"2024-09-21T03:14:47.559659+0000","last_unstale":"2024-09-21T03:15:15.804846+0000","last_undegraded":"2024-09-21T03:15:15.804846+0000","last_fullsized":"2024-09-21T03:15:15.804846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:49.328036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680553+0000","last_change":"2024-09-21T03:14:37.467448+0000","last_active":"2024-09-21T03:15:15.680553+0000","last_peered":"2024-09-21T03:15:15.680553+0000","last_clean":"2024-09-21T03:15:15.680553+0000","last_became_active":"2024-09-21T03:14:37.467146+0000","last_became_peered":"2024-09-21T03:14:37.467146+0000","last_unstale":"2024-09-21T03:15:15.680553+0000","last_undegraded":"2024-09-21T03:15:15.680553+0000","last_fullsized":"2024-09-21T03:15:15.680553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:53.475083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681362+0000","last_change":"2024-09-21T03:14:38.486401+0000","last_active":"2024-09-21T03:15:15.681362+0000","last_peered":"2024-09-21T03:15:15.681362+0000","last_clean":"2024-09-21T03:15:15.681362+0000","last_became_active":"2024-09-21T03:14:38.486090+0000","last_became_peered":"2024-09-21T03:14:38.486090+0000","last_unstale":"2024-09-21T03:15:15.681362+0000","last_undegraded":"2024-09-21T03:15:15.681362+0000","last_fullsized":"2024-09-21T03:15:15.681362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:44.085100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677377+0000","last_change":"2024-09-21T03:14:46.541705+0000","last_active":"2024-09-21T03:15:15.677377+0000","last_peered":"2024-09-21T03:15:15.677377+0000","last_clean":"2024-09-21T03:15:15.677377+0000","last_became_active":"2024-09-21T03:14:46.541357+0000","last_became_peered":"2024-09-21T03:14:46.541357+0000","last_unstale":"2024-09-21T03:15:15.677377+0000","last_undegraded":"2024-09-21T03:15:15.677377+0000","last_fullsized":"2024-09-21T03:15:15.677377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:31.082059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804443+0000","last_change":"2024-09-21T03:14:47.556183+0000","last_active":"2024-09-21T03:15:15.804443+0000","last_peered":"2024-09-21T03:15:15.804443+0000","last_clean":"2024-09-21T03:15:15.804443+0000","last_became_active":"2024-09-21T03:14:47.553312+0000","last_became_peered":"2024-09-21T03:14:47.553312+0000","last_unstale":"2024-09-21T03:15:15.804443+0000","last_undegraded":"2024-09-21T03:15:15.804443+0000","last_fullsized":"2024-09-21T03:15:15.804443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:07.314491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681355+0000","last_change":"2024-09-21T03:14:37.478711+0000","last_active":"2024-09-21T03:15:15.681355+0000","last_peered":"2024-09-21T03:15:15.681355+0000","last_clean":"2024-09-21T03:15:15.681355+0000","last_became_active":"2024-09-21T03:14:37.477910+0000","last_became_peered":"2024-09-21T03:14:37.477910+0000","last_unstale":"2024-09-21T03:15:15.681355+0000","last_undegraded":"2024-09-21T03:15:15.681355+0000","last_fullsized":"2024-09-21T03:15:15.681355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:40.166966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804969+0000","last_change":"2024-09-21T03:14:38.472992+0000","last_active":"2024-09-21T03:15:15.804969+0000","last_peered":"2024-09-21T03:15:15.804969+0000","last_clean":"2024-09-21T03:15:15.804969+0000","last_became_active":"2024-09-21T03:14:38.472426+0000","last_became_peered":"2024-09-21T03:14:38.472426+0000","last_unstale":"2024-09-21T03:15:15.804969+0000","last_undegraded":"2024-09-21T03:15:15.804969+0000","last_fullsized":"2024-09-21T03:15:15.804969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:36.825612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677572+0000","last_change":"2024-09-21T03:14:46.526996+0000","last_active":"2024-09-21T03:15:15.677572+0000","last_peered":"2024-09-21T03:15:15.677572+0000","last_clean":"2024-09-21T03:15:15.677572+0000","last_became_active":"2024-09-21T03:14:46.525587+0000","last_became_peered":"2024-09-21T03:14:46.525587+0000","last_unstale":"2024-09-21T03:15:15.677572+0000","last_undegraded":"2024-09-21T03:15:15.677572+0000","last_fullsized":"2024-09-21T03:15:15.677572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:56.977126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677435+0000","last_change":"2024-09-21T03:14:47.554143+0000","last_active":"2024-09-21T03:15:15.677435+0000","last_peered":"2024-09-21T03:15:15.677435+0000","last_clean":"2024-09-21T03:15:15.677435+0000","last_became_active":"2024-09-21T03:14:47.553802+0000","last_became_peered":"2024-09-21T03:14:47.553802+0000","last_unstale":"2024-09-21T03:15:15.677435+0000","last_undegraded":"2024-09-21T03:15:15.677435+0000","last_fullsized":"2024-09-21T03:15:15.677435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:37.963442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681887+0000","last_change":"2024-09-21T03:14:37.479842+0000","last_active":"2024-09-21T03:15:15.681887+0000","last_peered":"2024-09-21T03:15:15.681887+0000","last_clean":"2024-09-21T03:15:15.681887+0000","last_became_active":"2024-09-21T03:14:37.478893+0000","last_became_peered":"2024-09-21T03:14:37.478893+0000","last_unstale":"2024-09-21T03:15:15.681887+0000","last_undegraded":"2024-09-21T03:15:15.681887+0000","last_fullsized":"2024-09-21T03:15:15.681887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:27.916133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684739+0000","last_change":"2024-09-21T03:14:38.468756+0000","last_active":"2024-09-21T03:15:14.684739+0000","last_peered":"2024-09-21T03:15:14.684739+0000","last_clean":"2024-09-21T03:15:14.684739+0000","last_became_active":"2024-09-21T03:14:38.467570+0000","last_became_peered":"2024-09-21T03:14:38.467570+0000","last_unstale":"2024-09-21T03:15:14.684739+0000","last_undegraded":"2024-09-21T03:15:14.684739+0000","last_fullsized":"2024-09-21T03:15:14.684739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:24.784157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677514+0000","last_change":"2024-09-21T03:14:46.529932+0000","last_active":"2024-09-21T03:15:15.677514+0000","last_peered":"2024-09-21T03:15:15.677514+0000","last_clean":"2024-09-21T03:15:15.677514+0000","last_became_active":"2024-09-21T03:14:46.529629+0000","last_became_peered":"2024-09-21T03:14:46.529629+0000","last_unstale":"2024-09-21T03:15:15.677514+0000","last_undegraded":"2024-09-21T03:15:15.677514+0000","last_fullsized":"2024-09-21T03:15:15.677514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:39.808494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681239+0000","last_change":"2024-09-21T03:14:47.547724+0000","last_active":"2024-09-21T03:15:15.681239+0000","last_peered":"2024-09-21T03:15:15.681239+0000","last_clean":"2024-09-21T03:15:15.681239+0000","last_became_active":"2024-09-21T03:14:47.546770+0000","last_became_peered":"2024-09-21T03:14:47.546770+0000","last_unstale":"2024-09-21T03:15:15.681239+0000","last_undegraded":"2024-09-21T03:15:15.681239+0000","last_fullsized":"2024-09-21T03:15:15.681239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:31.476710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682495+0000","last_change":"2024-09-21T03:14:38.476747+0000","last_active":"2024-09-21T03:15:14.682495+0000","last_peered":"2024-09-21T03:15:14.682495+0000","last_clean":"2024-09-21T03:15:14.682495+0000","last_became_active":"2024-09-21T03:14:38.476386+0000","last_became_peered":"2024-09-21T03:14:38.476386+0000","last_unstale":"2024-09-21T03:15:14.682495+0000","last_undegraded":"2024-09-21T03:15:14.682495+0000","last_fullsized":"2024-09-21T03:15:14.682495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:28.751991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.683209+0000","last_change":"2024-09-21T03:14:37.463164+0000","last_active":"2024-09-21T03:15:14.683209+0000","last_peered":"2024-09-21T03:15:14.683209+0000","last_clean":"2024-09-21T03:15:14.683209+0000","last_became_active":"2024-09-21T03:14:37.461409+0000","last_became_peered":"2024-09-21T03:14:37.461409+0000","last_unstale":"2024-09-21T03:15:14.683209+0000","last_undegraded":"2024-09-21T03:15:14.683209+0000","last_fullsized":"2024-09-21T03:15:14.683209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:51.126291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684453+0000","last_change":"2024-09-21T03:14:46.538480+0000","last_active":"2024-09-21T03:15:14.684453+0000","last_peered":"2024-09-21T03:15:14.684453+0000","last_clean":"2024-09-21T03:15:14.684453+0000","last_became_active":"2024-09-21T03:14:46.537493+0000","last_became_peered":"2024-09-21T03:14:46.537493+0000","last_unstale":"2024-09-21T03:15:14.684453+0000","last_undegraded":"2024-09-21T03:15:14.684453+0000","last_fullsized":"2024-09-21T03:15:14.684453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:52.769190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684608+0000","last_change":"2024-09-21T03:14:47.580512+0000","last_active":"2024-09-21T03:15:15.684608+0000","last_peered":"2024-09-21T03:15:15.684608+0000","last_clean":"2024-09-21T03:15:15.684608+0000","last_became_active":"2024-09-21T03:14:47.580210+0000","last_became_peered":"2024-09-21T03:14:47.580210+0000","last_unstale":"2024-09-21T03:15:15.684608+0000","last_undegraded":"2024-09-21T03:15:15.684608+0000","last_fullsized":"2024-09-21T03:15:15.684608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:20.192190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684313+0000","last_change":"2024-09-21T03:14:38.494021+0000","last_active":"2024-09-21T03:15:15.684313+0000","last_peered":"2024-09-21T03:15:15.684313+0000","last_clean":"2024-09-21T03:15:15.684313+0000","last_became_active":"2024-09-21T03:14:38.486802+0000","last_became_peered":"2024-09-21T03:14:38.486802+0000","last_unstale":"2024-09-21T03:15:15.684313+0000","last_undegraded":"2024-09-21T03:15:15.684313+0000","last_fullsized":"2024-09-21T03:15:15.684313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:31.817505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558034+0000","last_change":"2024-09-21T03:14:37.465907+0000","last_active":"2024-09-21T03:14:48.558034+0000","last_peered":"2024-09-21T03:14:48.558034+0000","last_clean":"2024-09-21T03:14:48.558034+0000","last_became_active":"2024-09-21T03:14:37.465551+0000","last_became_peered":"2024-09-21T03:14:37.465551+0000","last_unstale":"2024-09-21T03:14:48.558034+0000","last_undegraded":"2024-09-21T03:14:48.558034+0000","last_fullsized":"2024-09-21T03:14:48.558034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:10.599687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681508+0000","last_change":"2024-09-21T03:14:46.546737+0000","last_active":"2024-09-21T03:15:15.681508+0000","last_peered":"2024-09-21T03:15:15.681508+0000","last_clean":"2024-09-21T03:15:15.681508+0000","last_became_active":"2024-09-21T03:14:46.546312+0000","last_became_peered":"2024-09-21T03:14:46.546312+0000","last_unstale":"2024-09-21T03:15:15.681508+0000","last_undegraded":"2024-09-21T03:15:15.681508+0000","last_fullsized":"2024-09-21T03:15:15.681508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:03.939168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.686382+0000","last_change":"2024-09-21T03:14:47.558742+0000","last_active":"2024-09-21T03:15:14.686382+0000","last_peered":"2024-09-21T03:15:14.686382+0000","last_clean":"2024-09-21T03:15:14.686382+0000","last_became_active":"2024-09-21T03:14:47.558431+0000","last_became_peered":"2024-09-21T03:14:47.558431+0000","last_unstale":"2024-09-21T03:15:14.686382+0000","last_undegraded":"2024-09-21T03:15:14.686382+0000","last_fullsized":"2024-09-21T03:15:14.686382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:32.053674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805176+0000","last_change":"2024-09-21T03:14:38.479370+0000","last_active":"2024-09-21T03:15:15.805176+0000","last_peered":"2024-09-21T03:15:15.805176+0000","last_clean":"2024-09-21T03:15:15.805176+0000","last_became_active":"2024-09-21T03:14:38.476976+0000","last_became_peered":"2024-09-21T03:14:38.476976+0000","last_unstale":"2024-09-21T03:15:15.805176+0000","last_undegraded":"2024-09-21T03:15:15.805176+0000","last_fullsized":"2024-09-21T03:15:15.805176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:14.695819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805302+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:15:15.805302+0000","last_peered":"2024-09-21T03:15:15.805302+0000","last_clean":"2024-09-21T03:15:15.805302+0000","last_became_active":"2024-09-21T03:14:37.478840+0000","last_became_peered":"2024-09-21T03:14:37.478840+0000","last_unstale":"2024-09-21T03:15:15.805302+0000","last_undegraded":"2024-09-21T03:15:15.805302+0000","last_fullsized":"2024-09-21T03:15:15.805302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:00.964354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684541+0000","last_change":"2024-09-21T03:14:46.543085+0000","last_active":"2024-09-21T03:15:15.684541+0000","last_peered":"2024-09-21T03:15:15.684541+0000","last_clean":"2024-09-21T03:15:15.684541+0000","last_became_active":"2024-09-21T03:14:46.542721+0000","last_became_peered":"2024-09-21T03:14:46.542721+0000","last_unstale":"2024-09-21T03:15:15.684541+0000","last_undegraded":"2024-09-21T03:15:15.684541+0000","last_fullsized":"2024-09-21T03:15:15.684541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:05.590871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805028+0000","last_change":"2024-09-21T03:14:47.566806+0000","last_active":"2024-09-21T03:15:15.805028+0000","last_peered":"2024-09-21T03:15:15.805028+0000","last_clean":"2024-09-21T03:15:15.805028+0000","last_became_active":"2024-09-21T03:14:47.566634+0000","last_became_peered":"2024-09-21T03:14:47.566634+0000","last_unstale":"2024-09-21T03:15:15.805028+0000","last_undegraded":"2024-09-21T03:15:15.805028+0000","last_fullsized":"2024-09-21T03:15:15.805028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:03.997294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682260+0000","last_change":"2024-09-21T03:14:38.482658+0000","last_active":"2024-09-21T03:15:14.682260+0000","last_peered":"2024-09-21T03:15:14.682260+0000","last_clean":"2024-09-21T03:15:14.682260+0000","last_became_active":"2024-09-21T03:14:38.482369+0000","last_became_peered":"2024-09-21T03:14:38.482369+0000","last_unstale":"2024-09-21T03:15:14.682260+0000","last_undegraded":"2024-09-21T03:15:14.682260+0000","last_fullsized":"2024-09-21T03:15:14.682260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:36.682534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680554+0000","last_change":"2024-09-21T03:14:37.472962+0000","last_active":"2024-09-21T03:15:15.680554+0000","last_peered":"2024-09-21T03:15:15.680554+0000","last_clean":"2024-09-21T03:15:15.680554+0000","last_became_active":"2024-09-21T03:14:37.472271+0000","last_became_peered":"2024-09-21T03:14:37.472271+0000","last_unstale":"2024-09-21T03:15:15.680554+0000","last_undegraded":"2024-09-21T03:15:15.680554+0000","last_fullsized":"2024-09-21T03:15:15.680554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:54.952223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678253+0000","last_change":"2024-09-21T03:14:46.537137+0000","last_active":"2024-09-21T03:15:15.678253+0000","last_peered":"2024-09-21T03:15:15.678253+0000","last_clean":"2024-09-21T03:15:15.678253+0000","last_became_active":"2024-09-21T03:14:46.536791+0000","last_became_peered":"2024-09-21T03:14:46.536791+0000","last_unstale":"2024-09-21T03:15:15.678253+0000","last_undegraded":"2024-09-21T03:15:15.678253+0000","last_fullsized":"2024-09-21T03:15:15.678253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:43.186807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805335+0000","last_change":"2024-09-21T03:14:47.555605+0000","last_active":"2024-09-21T03:15:15.805335+0000","last_peered":"2024-09-21T03:15:15.805335+0000","last_clean":"2024-09-21T03:15:15.805335+0000","last_became_active":"2024-09-21T03:14:47.555329+0000","last_became_peered":"2024-09-21T03:14:47.555329+0000","last_unstale":"2024-09-21T03:15:15.805335+0000","last_undegraded":"2024-09-21T03:15:15.805335+0000","last_fullsized":"2024-09-21T03:15:15.805335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:24.271656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806141+0000","last_change":"2024-09-21T03:14:38.479133+0000","last_active":"2024-09-21T03:15:15.806141+0000","last_peered":"2024-09-21T03:15:15.806141+0000","last_clean":"2024-09-21T03:15:15.806141+0000","last_became_active":"2024-09-21T03:14:38.478077+0000","last_became_peered":"2024-09-21T03:14:38.478077+0000","last_unstale":"2024-09-21T03:15:15.806141+0000","last_undegraded":"2024-09-21T03:15:15.806141+0000","last_fullsized":"2024-09-21T03:15:15.806141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:56.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.687362+0000","last_change":"2024-09-21T03:14:37.480508+0000","last_active":"2024-09-21T03:15:14.687362+0000","last_peered":"2024-09-21T03:15:14.687362+0000","last_clean":"2024-09-21T03:15:14.687362+0000","last_became_active":"2024-09-21T03:14:37.480218+0000","last_became_peered":"2024-09-21T03:14:37.480218+0000","last_unstale":"2024-09-21T03:15:14.687362+0000","last_undegraded":"2024-09-21T03:15:14.687362+0000","last_fullsized":"2024-09-21T03:15:14.687362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:01.851380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678755+0000","last_change":"2024-09-21T03:14:46.531615+0000","last_active":"2024-09-21T03:15:15.678755+0000","last_peered":"2024-09-21T03:15:15.678755+0000","last_clean":"2024-09-21T03:15:15.678755+0000","last_became_active":"2024-09-21T03:14:46.531289+0000","last_became_peered":"2024-09-21T03:14:46.531289+0000","last_unstale":"2024-09-21T03:15:15.678755+0000","last_undegraded":"2024-09-21T03:15:15.678755+0000","last_fullsized":"2024-09-21T03:15:15.678755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:10.145489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682075+0000","last_change":"2024-09-21T03:14:47.552705+0000","last_active":"2024-09-21T03:15:14.682075+0000","last_peered":"2024-09-21T03:15:14.682075+0000","last_clean":"2024-09-21T03:15:14.682075+0000","last_became_active":"2024-09-21T03:14:47.552367+0000","last_became_peered":"2024-09-21T03:14:47.552367+0000","last_unstale":"2024-09-21T03:15:14.682075+0000","last_undegraded":"2024-09-21T03:15:14.682075+0000","last_fullsized":"2024-09-21T03:15:14.682075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:45.379581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806286+0000","last_change":"2024-09-21T03:14:38.475318+0000","last_active":"2024-09-21T03:15:15.806286+0000","last_peered":"2024-09-21T03:15:15.806286+0000","last_clean":"2024-09-21T03:15:15.806286+0000","last_became_active":"2024-09-21T03:14:38.474978+0000","last_became_peered":"2024-09-21T03:14:38.474978+0000","last_unstale":"2024-09-21T03:15:15.806286+0000","last_undegraded":"2024-09-21T03:15:15.806286+0000","last_fullsized":"2024-09-21T03:15:15.806286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:38.209624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806345+0000","last_change":"2024-09-21T03:14:37.479651+0000","last_active":"2024-09-21T03:15:15.806345+0000","last_peered":"2024-09-21T03:15:15.806345+0000","last_clean":"2024-09-21T03:15:15.806345+0000","last_became_active":"2024-09-21T03:14:37.478833+0000","last_became_peered":"2024-09-21T03:14:37.478833+0000","last_unstale":"2024-09-21T03:15:15.806345+0000","last_undegraded":"2024-09-21T03:15:15.806345+0000","last_fullsized":"2024-09-21T03:15:15.806345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:48.578637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804935+0000","last_change":"2024-09-21T03:14:46.536054+0000","last_active":"2024-09-21T03:15:15.804935+0000","last_peered":"2024-09-21T03:15:15.804935+0000","last_clean":"2024-09-21T03:15:15.804935+0000","last_became_active":"2024-09-21T03:14:46.535569+0000","last_became_peered":"2024-09-21T03:14:46.535569+0000","last_unstale":"2024-09-21T03:15:15.804935+0000","last_undegraded":"2024-09-21T03:15:15.804935+0000","last_fullsized":"2024-09-21T03:15:15.804935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:04.556059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680654+0000","last_change":"2024-09-21T03:14:47.571889+0000","last_active":"2024-09-21T03:15:15.680654+0000","last_peered":"2024-09-21T03:15:15.680654+0000","last_clean":"2024-09-21T03:15:15.680654+0000","last_became_active":"2024-09-21T03:14:47.571620+0000","last_became_peered":"2024-09-21T03:14:47.571620+0000","last_unstale":"2024-09-21T03:15:15.680654+0000","last_undegraded":"2024-09-21T03:15:15.680654+0000","last_fullsized":"2024-09-21T03:15:15.680654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:23.103973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558656+0000","last_change":"2024-09-21T03:14:38.493350+0000","last_active":"2024-09-21T03:14:48.558656+0000","last_peered":"2024-09-21T03:14:48.558656+0000","last_clean":"2024-09-21T03:14:48.558656+0000","last_became_active":"2024-09-21T03:14:38.492830+0000","last_became_peered":"2024-09-21T03:14:38.492830+0000","last_unstale":"2024-09-21T03:14:48.558656+0000","last_undegraded":"2024-09-21T03:14:48.558656+0000","last_fullsized":"2024-09-21T03:14:48.558656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:19.946319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.685128+0000","last_change":"2024-09-21T03:14:37.473484+0000","last_active":"2024-09-21T03:15:14.685128+0000","last_peered":"2024-09-21T03:15:14.685128+0000","last_clean":"2024-09-21T03:15:14.685128+0000","last_became_active":"2024-09-21T03:14:37.473218+0000","last_became_peered":"2024-09-21T03:14:37.473218+0000","last_unstale":"2024-09-21T03:15:14.685128+0000","last_undegraded":"2024-09-21T03:15:14.685128+0000","last_fullsized":"2024-09-21T03:15:14.685128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:49.006579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558777+0000","last_change":"2024-09-21T03:14:46.548858+0000","last_active":"2024-09-21T03:14:48.558777+0000","last_peered":"2024-09-21T03:14:48.558777+0000","last_clean":"2024-09-21T03:14:48.558777+0000","last_became_active":"2024-09-21T03:14:46.548166+0000","last_became_peered":"2024-09-21T03:14:46.548166+0000","last_unstale":"2024-09-21T03:14:48.558777+0000","last_undegraded":"2024-09-21T03:14:48.558777+0000","last_fullsized":"2024-09-21T03:14:48.558777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:41.470072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805741+0000","last_change":"2024-09-21T03:14:47.555787+0000","last_active":"2024-09-21T03:15:15.805741+0000","last_peered":"2024-09-21T03:15:15.805741+0000","last_clean":"2024-09-21T03:15:15.805741+0000","last_became_active":"2024-09-21T03:14:47.555420+0000","last_became_peered":"2024-09-21T03:14:47.555420+0000","last_unstale":"2024-09-21T03:15:15.805741+0000","last_undegraded":"2024-09-21T03:15:15.805741+0000","last_fullsized":"2024-09-21T03:15:15.805741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:45.769786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677640+0000","last_change":"2024-09-21T03:14:38.479657+0000","last_active":"2024-09-21T03:15:15.677640+0000","last_peered":"2024-09-21T03:15:15.677640+0000","last_clean":"2024-09-21T03:15:15.677640+0000","last_became_active":"2024-09-21T03:14:38.479439+0000","last_became_peered":"2024-09-21T03:14:38.479439+0000","last_unstale":"2024-09-21T03:15:15.677640+0000","last_undegraded":"2024-09-21T03:15:15.677640+0000","last_fullsized":"2024-09-21T03:15:15.677640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.107215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681857+0000","last_change":"2024-09-21T03:14:37.469799+0000","last_active":"2024-09-21T03:15:15.681857+0000","last_peered":"2024-09-21T03:15:15.681857+0000","last_clean":"2024-09-21T03:15:15.681857+0000","last_became_active":"2024-09-21T03:14:37.469495+0000","last_became_peered":"2024-09-21T03:14:37.469495+0000","last_unstale":"2024-09-21T03:15:15.681857+0000","last_undegraded":"2024-09-21T03:15:15.681857+0000","last_fullsized":"2024-09-21T03:15:15.681857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:50.247050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557375+0000","last_change":"2024-09-21T03:14:46.544320+0000","last_active":"2024-09-21T03:14:48.557375+0000","last_peered":"2024-09-21T03:14:48.557375+0000","last_clean":"2024-09-21T03:14:48.557375+0000","last_became_active":"2024-09-21T03:14:46.544038+0000","last_became_peered":"2024-09-21T03:14:46.544038+0000","last_unstale":"2024-09-21T03:14:48.557375+0000","last_undegraded":"2024-09-21T03:14:48.557375+0000","last_fullsized":"2024-09-21T03:14:48.557375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:57.457687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684713+0000","last_change":"2024-09-21T03:14:47.579698+0000","last_active":"2024-09-21T03:15:15.684713+0000","last_peered":"2024-09-21T03:15:15.684713+0000","last_clean":"2024-09-21T03:15:15.684713+0000","last_became_active":"2024-09-21T03:14:47.579324+0000","last_became_peered":"2024-09-21T03:14:47.579324+0000","last_unstale":"2024-09-21T03:15:15.684713+0000","last_undegraded":"2024-09-21T03:15:15.684713+0000","last_fullsized":"2024-09-21T03:15:15.684713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:37.656859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681701+0000","last_change":"2024-09-21T03:14:38.476763+0000","last_active":"2024-09-21T03:15:15.681701+0000","last_peered":"2024-09-21T03:15:15.681701+0000","last_clean":"2024-09-21T03:15:15.681701+0000","last_became_active":"2024-09-21T03:14:38.474299+0000","last_became_peered":"2024-09-21T03:14:38.474299+0000","last_unstale":"2024-09-21T03:15:15.681701+0000","last_undegraded":"2024-09-21T03:15:15.681701+0000","last_fullsized":"2024-09-21T03:15:15.681701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:46.544930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682672+0000","last_change":"2024-09-21T03:14:37.466857+0000","last_active":"2024-09-21T03:15:14.682672+0000","last_peered":"2024-09-21T03:15:14.682672+0000","last_clean":"2024-09-21T03:15:14.682672+0000","last_became_active":"2024-09-21T03:14:37.466256+0000","last_became_peered":"2024-09-21T03:14:37.466256+0000","last_unstale":"2024-09-21T03:15:14.682672+0000","last_undegraded":"2024-09-21T03:15:14.682672+0000","last_fullsized":"2024-09-21T03:15:14.682672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:02.240461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558502+0000","last_change":"2024-09-21T03:14:46.537315+0000","last_active":"2024-09-21T03:14:48.558502+0000","last_peered":"2024-09-21T03:14:48.558502+0000","last_clean":"2024-09-21T03:14:48.558502+0000","last_became_active":"2024-09-21T03:14:46.536975+0000","last_became_peered":"2024-09-21T03:14:46.536975+0000","last_unstale":"2024-09-21T03:14:48.558502+0000","last_undegraded":"2024-09-21T03:14:48.558502+0000","last_fullsized":"2024-09-21T03:14:48.558502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:42.529591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.685045+0000","last_change":"2024-09-21T03:14:47.573009+0000","last_active":"2024-09-21T03:15:15.685045+0000","last_peered":"2024-09-21T03:15:15.685045+0000","last_clean":"2024-09-21T03:15:15.685045+0000","last_became_active":"2024-09-21T03:14:47.572395+0000","last_became_peered":"2024-09-21T03:14:47.572395+0000","last_unstale":"2024-09-21T03:15:15.685045+0000","last_undegraded":"2024-09-21T03:15:15.685045+0000","last_fullsized":"2024-09-21T03:15:15.685045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:41.733447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678985+0000","last_change":"2024-09-21T03:14:38.481801+0000","last_active":"2024-09-21T03:15:15.678985+0000","last_peered":"2024-09-21T03:15:15.678985+0000","last_clean":"2024-09-21T03:15:15.678985+0000","last_became_active":"2024-09-21T03:14:38.481186+0000","last_became_peered":"2024-09-21T03:14:38.481186+0000","last_unstale":"2024-09-21T03:15:15.678985+0000","last_undegraded":"2024-09-21T03:15:15.678985+0000","last_fullsized":"2024-09-21T03:15:15.678985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:54.271470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683612+0000","last_change":"2024-09-21T03:14:37.474798+0000","last_active":"2024-09-21T03:15:15.683612+0000","last_peered":"2024-09-21T03:15:15.683612+0000","last_clean":"2024-09-21T03:15:15.683612+0000","last_became_active":"2024-09-21T03:14:37.473829+0000","last_became_peered":"2024-09-21T03:14:37.473829+0000","last_unstale":"2024-09-21T03:15:15.683612+0000","last_undegraded":"2024-09-21T03:15:15.683612+0000","last_fullsized":"2024-09-21T03:15:15.683612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:11.571814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558227+0000","last_change":"2024-09-21T03:14:46.542495+0000","last_active":"2024-09-21T03:14:48.558227+0000","last_peered":"2024-09-21T03:14:48.558227+0000","last_clean":"2024-09-21T03:14:48.558227+0000","last_became_active":"2024-09-21T03:14:46.542181+0000","last_became_peered":"2024-09-21T03:14:46.542181+0000","last_unstale":"2024-09-21T03:14:48.558227+0000","last_undegraded":"2024-09-21T03:14:48.558227+0000","last_fullsized":"2024-09-21T03:14:48.558227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:22.481477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.686650+0000","last_change":"2024-09-21T03:14:47.569409+0000","last_active":"2024-09-21T03:15:14.686650+0000","last_peered":"2024-09-21T03:15:14.686650+0000","last_clean":"2024-09-21T03:15:14.686650+0000","last_became_active":"2024-09-21T03:14:47.569212+0000","last_became_peered":"2024-09-21T03:14:47.569212+0000","last_unstale":"2024-09-21T03:15:14.686650+0000","last_undegraded":"2024-09-21T03:15:14.686650+0000","last_fullsized":"2024-09-21T03:15:14.686650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.851943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557644+0000","last_change":"2024-09-21T03:14:38.480026+0000","last_active":"2024-09-21T03:14:48.557644+0000","last_peered":"2024-09-21T03:14:48.557644+0000","last_clean":"2024-09-21T03:14:48.557644+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:14:48.557644+0000","last_undegraded":"2024-09-21T03:14:48.557644+0000","last_fullsized":"2024-09-21T03:14:48.557644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:20.481816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682008+0000","last_change":"2024-09-21T03:14:37.464554+0000","last_active":"2024-09-21T03:15:14.682008+0000","last_peered":"2024-09-21T03:15:14.682008+0000","last_clean":"2024-09-21T03:15:14.682008+0000","last_became_active":"2024-09-21T03:14:37.464228+0000","last_became_peered":"2024-09-21T03:14:37.464228+0000","last_unstale":"2024-09-21T03:15:14.682008+0000","last_undegraded":"2024-09-21T03:15:14.682008+0000","last_fullsized":"2024-09-21T03:15:14.682008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:32.529512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680429+0000","last_change":"2024-09-21T03:14:46.538538+0000","last_active":"2024-09-21T03:15:15.680429+0000","last_peered":"2024-09-21T03:15:15.680429+0000","last_clean":"2024-09-21T03:15:15.680429+0000","last_became_active":"2024-09-21T03:14:46.537815+0000","last_became_peered":"2024-09-21T03:14:46.537815+0000","last_unstale":"2024-09-21T03:15:15.680429+0000","last_undegraded":"2024-09-21T03:15:15.680429+0000","last_fullsized":"2024-09-21T03:15:15.680429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:42.264439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680898+0000","last_change":"2024-09-21T03:14:47.558861+0000","last_active":"2024-09-21T03:15:15.680898+0000","last_peered":"2024-09-21T03:15:15.680898+0000","last_clean":"2024-09-21T03:15:15.680898+0000","last_became_active":"2024-09-21T03:14:47.557305+0000","last_became_peered":"2024-09-21T03:14:47.557305+0000","last_unstale":"2024-09-21T03:15:15.680898+0000","last_undegraded":"2024-09-21T03:15:15.680898+0000","last_fullsized":"2024-09-21T03:15:15.680898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:45.962367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805521+0000","last_change":"2024-09-21T03:14:38.479181+0000","last_active":"2024-09-21T03:15:15.805521+0000","last_peered":"2024-09-21T03:15:15.805521+0000","last_clean":"2024-09-21T03:15:15.805521+0000","last_became_active":"2024-09-21T03:14:38.478842+0000","last_became_peered":"2024-09-21T03:14:38.478842+0000","last_unstale":"2024-09-21T03:15:15.805521+0000","last_undegraded":"2024-09-21T03:15:15.805521+0000","last_fullsized":"2024-09-21T03:15:15.805521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:08.664381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.683994+0000","last_change":"2024-09-21T03:14:37.463990+0000","last_active":"2024-09-21T03:15:14.683994+0000","last_peered":"2024-09-21T03:15:14.683994+0000","last_clean":"2024-09-21T03:15:14.683994+0000","last_became_active":"2024-09-21T03:14:37.463674+0000","last_became_peered":"2024-09-21T03:14:37.463674+0000","last_unstale":"2024-09-21T03:15:14.683994+0000","last_undegraded":"2024-09-21T03:15:14.683994+0000","last_fullsized":"2024-09-21T03:15:14.683994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:35.391985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804527+0000","last_change":"2024-09-21T03:14:26.342355+0000","last_active":"2024-09-21T03:15:15.804527+0000","last_peered":"2024-09-21T03:15:15.804527+0000","last_clean":"2024-09-21T03:15:15.804527+0000","last_became_active":"2024-09-21T03:14:26.341929+0000","last_became_peered":"2024-09-21T03:14:26.341929+0000","last_unstale":"2024-09-21T03:15:15.804527+0000","last_undegraded":"2024-09-21T03:15:15.804527+0000","last_fullsized":"2024-09-21T03:15:15.804527+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_clean_scrub_stamp":"2024-09-21T03:14:25.329650+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:45.390822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684834+0000","last_change":"2024-09-21T03:14:46.538184+0000","last_active":"2024-09-21T03:15:14.684834+0000","last_peered":"2024-09-21T03:15:14.684834+0000","last_clean":"2024-09-21T03:15:14.684834+0000","last_became_active":"2024-09-21T03:14:46.536753+0000","last_became_peered":"2024-09-21T03:14:46.536753+0000","last_unstale":"2024-09-21T03:15:14.684834+0000","last_undegraded":"2024-09-21T03:15:14.684834+0000","last_fullsized":"2024-09-21T03:15:14.684834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:49.078638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680743+0000","last_change":"2024-09-21T03:14:47.552966+0000","last_active":"2024-09-21T03:15:15.680743+0000","last_peered":"2024-09-21T03:15:15.680743+0000","last_clean":"2024-09-21T03:15:15.680743+0000","last_became_active":"2024-09-21T03:14:47.552642+0000","last_became_peered":"2024-09-21T03:14:47.552642+0000","last_unstale":"2024-09-21T03:15:15.680743+0000","last_undegraded":"2024-09-21T03:15:15.680743+0000","last_fullsized":"2024-09-21T03:15:15.680743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:15.928026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684929+0000","last_change":"2024-09-21T03:14:38.478414+0000","last_active":"2024-09-21T03:15:14.684929+0000","last_peered":"2024-09-21T03:15:14.684929+0000","last_clean":"2024-09-21T03:15:14.684929+0000","last_became_active":"2024-09-21T03:14:38.478116+0000","last_became_peered":"2024-09-21T03:14:38.478116+0000","last_unstale":"2024-09-21T03:15:14.684929+0000","last_undegraded":"2024-09-21T03:15:14.684929+0000","last_fullsized":"2024-09-21T03:15:14.684929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:29.618008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558850+0000","last_change":"2024-09-21T03:14:37.479578+0000","last_active":"2024-09-21T03:14:48.558850+0000","last_peered":"2024-09-21T03:14:48.558850+0000","last_clean":"2024-09-21T03:14:48.558850+0000","last_became_active":"2024-09-21T03:14:37.479284+0000","last_became_peered":"2024-09-21T03:14:37.479284+0000","last_unstale":"2024-09-21T03:14:48.558850+0000","last_undegraded":"2024-09-21T03:14:48.558850+0000","last_fullsized":"2024-09-21T03:14:48.558850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:15.732230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677624+0000","last_change":"2024-09-21T03:14:46.531536+0000","last_active":"2024-09-21T03:15:15.677624+0000","last_peered":"2024-09-21T03:15:15.677624+0000","last_clean":"2024-09-21T03:15:15.677624+0000","last_became_active":"2024-09-21T03:14:46.531069+0000","last_became_peered":"2024-09-21T03:14:46.531069+0000","last_unstale":"2024-09-21T03:15:15.677624+0000","last_undegraded":"2024-09-21T03:15:15.677624+0000","last_fullsized":"2024-09-21T03:15:15.677624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:14.050618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557238+0000","last_change":"2024-09-21T03:14:47.553039+0000","last_active":"2024-09-21T03:14:48.557238+0000","last_peered":"2024-09-21T03:14:48.557238+0000","last_clean":"2024-09-21T03:14:48.557238+0000","last_became_active":"2024-09-21T03:14:47.552712+0000","last_became_peered":"2024-09-21T03:14:47.552712+0000","last_unstale":"2024-09-21T03:14:48.557238+0000","last_undegraded":"2024-09-21T03:14:48.557238+0000","last_fullsized":"2024-09-21T03:14:48.557238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:32.630319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681782+0000","last_change":"2024-09-21T03:14:38.488259+0000","last_active":"2024-09-21T03:15:15.681782+0000","last_peered":"2024-09-21T03:15:15.681782+0000","last_clean":"2024-09-21T03:15:15.681782+0000","last_became_active":"2024-09-21T03:14:38.487420+0000","last_became_peered":"2024-09-21T03:14:38.487420+0000","last_unstale":"2024-09-21T03:15:15.681782+0000","last_undegraded":"2024-09-21T03:15:15.681782+0000","last_fullsized":"2024-09-21T03:15:15.681782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:48.003893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681753+0000","last_change":"2024-09-21T03:14:37.460763+0000","last_active":"2024-09-21T03:15:15.681753+0000","last_peered":"2024-09-21T03:15:15.681753+0000","last_clean":"2024-09-21T03:15:15.681753+0000","last_became_active":"2024-09-21T03:14:37.460320+0000","last_became_peered":"2024-09-21T03:14:37.460320+0000","last_unstale":"2024-09-21T03:15:15.681753+0000","last_undegraded":"2024-09-21T03:15:15.681753+0000","last_fullsized":"2024-09-21T03:15:15.681753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.907794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681101+0000","last_change":"2024-09-21T03:14:46.540901+0000","last_active":"2024-09-21T03:15:15.681101+0000","last_peered":"2024-09-21T03:15:15.681101+0000","last_clean":"2024-09-21T03:15:15.681101+0000","last_became_active":"2024-09-21T03:14:46.540182+0000","last_became_peered":"2024-09-21T03:14:46.540182+0000","last_unstale":"2024-09-21T03:15:15.681101+0000","last_undegraded":"2024-09-21T03:15:15.681101+0000","last_fullsized":"2024-09-21T03:15:15.681101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:38.416663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804362+0000","last_change":"2024-09-21T03:14:47.553810+0000","last_active":"2024-09-21T03:15:15.804362+0000","last_peered":"2024-09-21T03:15:15.804362+0000","last_clean":"2024-09-21T03:15:15.804362+0000","last_became_active":"2024-09-21T03:14:47.552371+0000","last_became_peered":"2024-09-21T03:14:47.552371+0000","last_unstale":"2024-09-21T03:15:15.804362+0000","last_undegraded":"2024-09-21T03:15:15.804362+0000","last_fullsized":"2024-09-21T03:15:15.804362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:38.659512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681305+0000","last_change":"2024-09-21T03:14:38.480629+0000","last_active":"2024-09-21T03:15:15.681305+0000","last_peered":"2024-09-21T03:15:15.681305+0000","last_clean":"2024-09-21T03:15:15.681305+0000","last_became_active":"2024-09-21T03:14:38.474135+0000","last_became_peered":"2024-09-21T03:14:38.474135+0000","last_unstale":"2024-09-21T03:15:15.681305+0000","last_undegraded":"2024-09-21T03:15:15.681305+0000","last_fullsized":"2024-09-21T03:15:15.681305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:36.171044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806268+0000","last_change":"2024-09-21T03:14:37.472491+0000","last_active":"2024-09-21T03:15:15.806268+0000","last_peered":"2024-09-21T03:15:15.806268+0000","last_clean":"2024-09-21T03:15:15.806268+0000","last_became_active":"2024-09-21T03:14:37.472164+0000","last_became_peered":"2024-09-21T03:14:37.472164+0000","last_unstale":"2024-09-21T03:15:15.806268+0000","last_undegraded":"2024-09-21T03:15:15.806268+0000","last_fullsized":"2024-09-21T03:15:15.806268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.498178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681720+0000","last_change":"2024-09-21T03:14:46.544828+0000","last_active":"2024-09-21T03:15:14.681720+0000","last_peered":"2024-09-21T03:15:14.681720+0000","last_clean":"2024-09-21T03:15:14.681720+0000","last_became_active":"2024-09-21T03:14:46.535901+0000","last_became_peered":"2024-09-21T03:14:46.535901+0000","last_unstale":"2024-09-21T03:15:14.681720+0000","last_undegraded":"2024-09-21T03:15:14.681720+0000","last_fullsized":"2024-09-21T03:15:14.681720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:08.608530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557424+0000","last_change":"2024-09-21T03:14:47.556478+0000","last_active":"2024-09-21T03:14:48.557424+0000","last_peered":"2024-09-21T03:14:48.557424+0000","last_clean":"2024-09-21T03:14:48.557424+0000","last_became_active":"2024-09-21T03:14:47.556145+0000","last_became_peered":"2024-09-21T03:14:47.556145+0000","last_unstale":"2024-09-21T03:14:48.557424+0000","last_undegraded":"2024-09-21T03:14:48.557424+0000","last_fullsized":"2024-09-21T03:14:48.557424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:59.004648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678670+0000","last_change":"2024-09-21T03:14:38.469502+0000","last_active":"2024-09-21T03:15:15.678670+0000","last_peered":"2024-09-21T03:15:15.678670+0000","last_clean":"2024-09-21T03:15:15.678670+0000","last_became_active":"2024-09-21T03:14:38.468972+0000","last_became_peered":"2024-09-21T03:14:38.468972+0000","last_unstale":"2024-09-21T03:15:15.678670+0000","last_undegraded":"2024-09-21T03:15:15.678670+0000","last_fullsized":"2024-09-21T03:15:15.678670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681340+0000","last_change":"2024-09-21T03:14:37.480905+0000","last_active":"2024-09-21T03:15:15.681340+0000","last_peered":"2024-09-21T03:15:15.681340+0000","last_clean":"2024-09-21T03:15:15.681340+0000","last_became_active":"2024-09-21T03:14:37.478227+0000","last_became_peered":"2024-09-21T03:14:37.478227+0000","last_unstale":"2024-09-21T03:15:15.681340+0000","last_undegraded":"2024-09-21T03:15:15.681340+0000","last_fullsized":"2024-09-21T03:15:15.681340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:42.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804534+0000","last_change":"2024-09-21T03:14:46.536103+0000","last_active":"2024-09-21T03:15:15.804534+0000","last_peered":"2024-09-21T03:15:15.804534+0000","last_clean":"2024-09-21T03:15:15.804534+0000","last_became_active":"2024-09-21T03:14:46.535445+0000","last_became_peered":"2024-09-21T03:14:46.535445+0000","last_unstale":"2024-09-21T03:15:15.804534+0000","last_undegraded":"2024-09-21T03:15:15.804534+0000","last_fullsized":"2024-09-21T03:15:15.804534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:59.078000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806222+0000","last_change":"2024-09-21T03:14:47.557503+0000","last_active":"2024-09-21T03:15:15.806222+0000","last_peered":"2024-09-21T03:15:15.806222+0000","last_clean":"2024-09-21T03:15:15.806222+0000","last_became_active":"2024-09-21T03:14:47.554366+0000","last_became_peered":"2024-09-21T03:14:47.554366+0000","last_unstale":"2024-09-21T03:15:15.806222+0000","last_undegraded":"2024-09-21T03:15:15.806222+0000","last_fullsized":"2024-09-21T03:15:15.806222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.994560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682222+0000","last_change":"2024-09-21T03:14:38.479516+0000","last_active":"2024-09-21T03:15:14.682222+0000","last_peered":"2024-09-21T03:15:14.682222+0000","last_clean":"2024-09-21T03:15:14.682222+0000","last_became_active":"2024-09-21T03:14:38.474826+0000","last_became_peered":"2024-09-21T03:14:38.474826+0000","last_unstale":"2024-09-21T03:15:14.682222+0000","last_undegraded":"2024-09-21T03:15:14.682222+0000","last_fullsized":"2024-09-21T03:15:14.682222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:22.181411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805649+0000","last_change":"2024-09-21T03:14:37.471063+0000","last_active":"2024-09-21T03:15:15.805649+0000","last_peered":"2024-09-21T03:15:15.805649+0000","last_clean":"2024-09-21T03:15:15.805649+0000","last_became_active":"2024-09-21T03:14:37.470720+0000","last_became_peered":"2024-09-21T03:14:37.470720+0000","last_unstale":"2024-09-21T03:15:15.805649+0000","last_undegraded":"2024-09-21T03:15:15.805649+0000","last_fullsized":"2024-09-21T03:15:15.805649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:00.054692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679915+0000","last_change":"2024-09-21T03:14:46.538665+0000","last_active":"2024-09-21T03:15:15.679915+0000","last_peered":"2024-09-21T03:15:15.679915+0000","last_clean":"2024-09-21T03:15:15.679915+0000","last_became_active":"2024-09-21T03:14:46.537774+0000","last_became_peered":"2024-09-21T03:14:46.537774+0000","last_unstale":"2024-09-21T03:15:15.679915+0000","last_undegraded":"2024-09-21T03:15:15.679915+0000","last_fullsized":"2024-09-21T03:15:15.679915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:07.736404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.686200+0000","last_change":"2024-09-21T03:14:47.553011+0000","last_active":"2024-09-21T03:15:14.686200+0000","last_peered":"2024-09-21T03:15:14.686200+0000","last_clean":"2024-09-21T03:15:14.686200+0000","last_became_active":"2024-09-21T03:14:47.552700+0000","last_became_peered":"2024-09-21T03:14:47.552700+0000","last_unstale":"2024-09-21T03:15:14.686200+0000","last_undegraded":"2024-09-21T03:15:14.686200+0000","last_fullsized":"2024-09-21T03:15:14.686200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:58.780132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804436+0000","last_change":"2024-09-21T03:14:38.472906+0000","last_active":"2024-09-21T03:15:15.804436+0000","last_peered":"2024-09-21T03:15:15.804436+0000","last_clean":"2024-09-21T03:15:15.804436+0000","last_became_active":"2024-09-21T03:14:38.471933+0000","last_became_peered":"2024-09-21T03:14:38.471933+0000","last_unstale":"2024-09-21T03:15:15.804436+0000","last_undegraded":"2024-09-21T03:15:15.804436+0000","last_fullsized":"2024-09-21T03:15:15.804436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:05.395821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680585+0000","last_change":"2024-09-21T03:14:37.478714+0000","last_active":"2024-09-21T03:15:15.680585+0000","last_peered":"2024-09-21T03:15:15.680585+0000","last_clean":"2024-09-21T03:15:15.680585+0000","last_became_active":"2024-09-21T03:14:37.477951+0000","last_became_peered":"2024-09-21T03:14:37.477951+0000","last_unstale":"2024-09-21T03:15:15.680585+0000","last_undegraded":"2024-09-21T03:15:15.680585+0000","last_fullsized":"2024-09-21T03:15:15.680585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:42.529545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680921+0000","last_change":"2024-09-21T03:14:46.546142+0000","last_active":"2024-09-21T03:15:15.680921+0000","last_peered":"2024-09-21T03:15:15.680921+0000","last_clean":"2024-09-21T03:15:15.680921+0000","last_became_active":"2024-09-21T03:14:46.545865+0000","last_became_peered":"2024-09-21T03:14:46.545865+0000","last_unstale":"2024-09-21T03:15:15.680921+0000","last_undegraded":"2024-09-21T03:15:15.680921+0000","last_fullsized":"2024-09-21T03:15:15.680921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:11.705309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684250+0000","last_change":"2024-09-21T03:14:47.568961+0000","last_active":"2024-09-21T03:15:14.684250+0000","last_peered":"2024-09-21T03:15:14.684250+0000","last_clean":"2024-09-21T03:15:14.684250+0000","last_became_active":"2024-09-21T03:14:47.568656+0000","last_became_peered":"2024-09-21T03:14:47.568656+0000","last_unstale":"2024-09-21T03:15:14.684250+0000","last_undegraded":"2024-09-21T03:15:14.684250+0000","last_fullsized":"2024-09-21T03:15:14.684250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.041710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.683102+0000","last_change":"2024-09-21T03:14:38.485454+0000","last_active":"2024-09-21T03:15:14.683102+0000","last_peered":"2024-09-21T03:15:14.683102+0000","last_clean":"2024-09-21T03:15:14.683102+0000","last_became_active":"2024-09-21T03:14:38.485235+0000","last_became_peered":"2024-09-21T03:14:38.485235+0000","last_unstale":"2024-09-21T03:15:14.683102+0000","last_undegraded":"2024-09-21T03:15:14.683102+0000","last_fullsized":"2024-09-21T03:15:14.683102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:11.585637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682605+0000","last_change":"2024-09-21T03:14:37.466544+0000","last_active":"2024-09-21T03:15:14.682605+0000","last_peered":"2024-09-21T03:15:14.682605+0000","last_clean":"2024-09-21T03:15:14.682605+0000","last_became_active":"2024-09-21T03:14:37.465817+0000","last_became_peered":"2024-09-21T03:14:37.465817+0000","last_unstale":"2024-09-21T03:15:14.682605+0000","last_undegraded":"2024-09-21T03:15:14.682605+0000","last_fullsized":"2024-09-21T03:15:14.682605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:36.113483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:15:11.442899+0000","last_change":"2024-09-21T03:14:46.549921+0000","last_active":"2024-09-21T03:15:11.442899+0000","last_peered":"2024-09-21T03:15:11.442899+0000","last_clean":"2024-09-21T03:15:11.442899+0000","last_became_active":"2024-09-21T03:14:46.549119+0000","last_became_peered":"2024-09-21T03:14:46.549119+0000","last_unstale":"2024-09-21T03:15:11.442899+0000","last_undegraded":"2024-09-21T03:15:11.442899+0000","last_fullsized":"2024-09-21T03:15:11.442899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:09.622498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2858,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.691871+0000","last_change":"2024-09-21T03:15:15.687659+0000","last_active":"2024-09-21T03:15:15.691871+0000","last_peered":"2024-09-21T03:15:15.691871+0000","last_clean":"2024-09-21T03:15:15.691871+0000","last_became_active":"2024-09-21T03:15:15.687225+0000","last_became_peered":"2024-09-21T03:15:15.687225+0000","last_unstale":"2024-09-21T03:15:15.691871+0000","last_undegraded":"2024-09-21T03:15:15.691871+0000","last_fullsized":"2024-09-21T03:15:15.691871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:56.395767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557891+0000","last_change":"2024-09-21T03:14:38.482528+0000","last_active":"2024-09-21T03:14:48.557891+0000","last_peered":"2024-09-21T03:14:48.557891+0000","last_clean":"2024-09-21T03:14:48.557891+0000","last_became_active":"2024-09-21T03:14:38.482241+0000","last_became_peered":"2024-09-21T03:14:38.482241+0000","last_unstale":"2024-09-21T03:14:48.557891+0000","last_undegraded":"2024-09-21T03:14:48.557891+0000","last_fullsized":"2024-09-21T03:14:48.557891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:23.110703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684414+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:15:15.684414+0000","last_peered":"2024-09-21T03:15:15.684414+0000","last_clean":"2024-09-21T03:15:15.684414+0000","last_became_active":"2024-09-21T03:14:37.478882+0000","last_became_peered":"2024-09-21T03:14:37.478882+0000","last_unstale":"2024-09-21T03:15:15.684414+0000","last_undegraded":"2024-09-21T03:15:15.684414+0000","last_fullsized":"2024-09-21T03:15:15.684414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:11.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684629+0000","last_change":"2024-09-21T03:14:46.538817+0000","last_active":"2024-09-21T03:15:14.684629+0000","last_peered":"2024-09-21T03:15:14.684629+0000","last_clean":"2024-09-21T03:15:14.684629+0000","last_became_active":"2024-09-21T03:14:46.537835+0000","last_became_peered":"2024-09-21T03:14:46.537835+0000","last_unstale":"2024-09-21T03:15:14.684629+0000","last_undegraded":"2024-09-21T03:15:14.684629+0000","last_fullsized":"2024-09-21T03:15:14.684629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:08.236663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805566+0000","last_change":"2024-09-21T03:14:47.566534+0000","last_active":"2024-09-21T03:15:15.805566+0000","last_peered":"2024-09-21T03:15:15.805566+0000","last_clean":"2024-09-21T03:15:15.805566+0000","last_became_active":"2024-09-21T03:14:47.566157+0000","last_became_peered":"2024-09-21T03:14:47.566157+0000","last_unstale":"2024-09-21T03:15:15.805566+0000","last_undegraded":"2024-09-21T03:15:15.805566+0000","last_fullsized":"2024-09-21T03:15:15.805566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:35.557811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681246+0000","last_change":"2024-09-21T03:14:38.478509+0000","last_active":"2024-09-21T03:15:15.681246+0000","last_peered":"2024-09-21T03:15:15.681246+0000","last_clean":"2024-09-21T03:15:15.681246+0000","last_became_active":"2024-09-21T03:14:38.478197+0000","last_became_peered":"2024-09-21T03:14:38.478197+0000","last_unstale":"2024-09-21T03:15:15.681246+0000","last_undegraded":"2024-09-21T03:15:15.681246+0000","last_fullsized":"2024-09-21T03:15:15.681246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.411134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677857+0000","last_change":"2024-09-21T03:14:37.472695+0000","last_active":"2024-09-21T03:15:15.677857+0000","last_peered":"2024-09-21T03:15:15.677857+0000","last_clean":"2024-09-21T03:15:15.677857+0000","last_became_active":"2024-09-21T03:14:37.472374+0000","last_became_peered":"2024-09-21T03:14:37.472374+0000","last_unstale":"2024-09-21T03:15:15.677857+0000","last_undegraded":"2024-09-21T03:15:15.677857+0000","last_fullsized":"2024-09-21T03:15:15.677857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:11.245914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2858,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805279+0000","last_change":"2024-09-21T03:14:46.547433+0000","last_active":"2024-09-21T03:15:15.805279+0000","last_peered":"2024-09-21T03:15:15.805279+0000","last_clean":"2024-09-21T03:15:15.805279+0000","last_became_active":"2024-09-21T03:14:46.547192+0000","last_became_peered":"2024-09-21T03:14:46.547192+0000","last_unstale":"2024-09-21T03:15:15.805279+0000","last_undegraded":"2024-09-21T03:15:15.805279+0000","last_fullsized":"2024-09-21T03:15:15.805279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:03.238245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557599+0000","last_change":"2024-09-21T03:14:47.545827+0000","last_active":"2024-09-21T03:14:48.557599+0000","last_peered":"2024-09-21T03:14:48.557599+0000","last_clean":"2024-09-21T03:14:48.557599+0000","last_became_active":"2024-09-21T03:14:47.545440+0000","last_became_peered":"2024-09-21T03:14:47.545440+0000","last_unstale":"2024-09-21T03:14:48.557599+0000","last_undegraded":"2024-09-21T03:14:48.557599+0000","last_fullsized":"2024-09-21T03:14:48.557599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:20.532645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684125+0000","last_change":"2024-09-21T03:14:38.476564+0000","last_active":"2024-09-21T03:15:14.684125+0000","last_peered":"2024-09-21T03:15:14.684125+0000","last_clean":"2024-09-21T03:15:14.684125+0000","last_became_active":"2024-09-21T03:14:38.476158+0000","last_became_peered":"2024-09-21T03:14:38.476158+0000","last_unstale":"2024-09-21T03:15:14.684125+0000","last_undegraded":"2024-09-21T03:15:14.684125+0000","last_fullsized":"2024-09-21T03:15:14.684125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:26.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684904+0000","last_change":"2024-09-21T03:14:37.473709+0000","last_active":"2024-09-21T03:15:15.684904+0000","last_peered":"2024-09-21T03:15:15.684904+0000","last_clean":"2024-09-21T03:15:15.684904+0000","last_became_active":"2024-09-21T03:14:37.472544+0000","last_became_peered":"2024-09-21T03:14:37.472544+0000","last_unstale":"2024-09-21T03:15:15.684904+0000","last_undegraded":"2024-09-21T03:15:15.684904+0000","last_fullsized":"2024-09-21T03:15:15.684904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:47.892146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677701+0000","last_change":"2024-09-21T03:14:46.534201+0000","last_active":"2024-09-21T03:15:15.677701+0000","last_peered":"2024-09-21T03:15:15.677701+0000","last_clean":"2024-09-21T03:15:15.677701+0000","last_became_active":"2024-09-21T03:14:46.533891+0000","last_became_peered":"2024-09-21T03:14:46.533891+0000","last_unstale":"2024-09-21T03:15:15.677701+0000","last_undegraded":"2024-09-21T03:15:15.677701+0000","last_fullsized":"2024-09-21T03:15:15.677701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:06.645173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681643+0000","last_change":"2024-09-21T03:14:47.552016+0000","last_active":"2024-09-21T03:15:14.681643+0000","last_peered":"2024-09-21T03:15:14.681643+0000","last_clean":"2024-09-21T03:15:14.681643+0000","last_became_active":"2024-09-21T03:14:47.551622+0000","last_became_peered":"2024-09-21T03:14:47.551622+0000","last_unstale":"2024-09-21T03:15:14.681643+0000","last_undegraded":"2024-09-21T03:15:14.681643+0000","last_fullsized":"2024-09-21T03:15:14.681643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:56:04.849535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681489+0000","last_change":"2024-09-21T03:14:38.484757+0000","last_active":"2024-09-21T03:15:15.681489+0000","last_peered":"2024-09-21T03:15:15.681489+0000","last_clean":"2024-09-21T03:15:15.681489+0000","last_became_active":"2024-09-21T03:14:38.483348+0000","last_became_peered":"2024-09-21T03:14:38.483348+0000","last_unstale":"2024-09-21T03:15:15.681489+0000","last_undegraded":"2024-09-21T03:15:15.681489+0000","last_fullsized":"2024-09-21T03:15:15.681489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:57.697723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681239+0000","last_change":"2024-09-21T03:14:37.479047+0000","last_active":"2024-09-21T03:15:15.681239+0000","last_peered":"2024-09-21T03:15:15.681239+0000","last_clean":"2024-09-21T03:15:15.681239+0000","last_became_active":"2024-09-21T03:14:37.478700+0000","last_became_peered":"2024-09-21T03:14:37.478700+0000","last_unstale":"2024-09-21T03:15:15.681239+0000","last_undegraded":"2024-09-21T03:15:15.681239+0000","last_fullsized":"2024-09-21T03:15:15.681239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:31.702450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.682880+0000","last_change":"2024-09-21T03:14:46.547287+0000","last_active":"2024-09-21T03:15:15.682880+0000","last_peered":"2024-09-21T03:15:15.682880+0000","last_clean":"2024-09-21T03:15:15.682880+0000","last_became_active":"2024-09-21T03:14:46.546867+0000","last_became_peered":"2024-09-21T03:14:46.546867+0000","last_unstale":"2024-09-21T03:15:15.682880+0000","last_undegraded":"2024-09-21T03:15:15.682880+0000","last_fullsized":"2024-09-21T03:15:15.682880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:54.119841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677259+0000","last_change":"2024-09-21T03:14:47.558571+0000","last_active":"2024-09-21T03:15:15.677259+0000","last_peered":"2024-09-21T03:15:15.677259+0000","last_clean":"2024-09-21T03:15:15.677259+0000","last_became_active":"2024-09-21T03:14:47.558037+0000","last_became_peered":"2024-09-21T03:14:47.558037+0000","last_unstale":"2024-09-21T03:15:15.677259+0000","last_undegraded":"2024-09-21T03:15:15.677259+0000","last_fullsized":"2024-09-21T03:15:15.677259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:42.564181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678774+0000","last_change":"2024-09-21T03:14:38.488227+0000","last_active":"2024-09-21T03:15:15.678774+0000","last_peered":"2024-09-21T03:15:15.678774+0000","last_clean":"2024-09-21T03:15:15.678774+0000","last_became_active":"2024-09-21T03:14:38.482370+0000","last_became_peered":"2024-09-21T03:14:38.482370+0000","last_unstale":"2024-09-21T03:15:15.678774+0000","last_undegraded":"2024-09-21T03:15:15.678774+0000","last_fullsized":"2024-09-21T03:15:15.678774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:52.561391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805382+0000","last_change":"2024-09-21T03:14:37.471363+0000","last_active":"2024-09-21T03:15:15.805382+0000","last_peered":"2024-09-21T03:15:15.805382+0000","last_clean":"2024-09-21T03:15:15.805382+0000","last_became_active":"2024-09-21T03:14:37.471002+0000","last_became_peered":"2024-09-21T03:14:37.471002+0000","last_unstale":"2024-09-21T03:15:15.805382+0000","last_undegraded":"2024-09-21T03:15:15.805382+0000","last_fullsized":"2024-09-21T03:15:15.805382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:25.922368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805008+0000","last_change":"2024-09-21T03:14:46.545186+0000","last_active":"2024-09-21T03:15:15.805008+0000","last_peered":"2024-09-21T03:15:15.805008+0000","last_clean":"2024-09-21T03:15:15.805008+0000","last_became_active":"2024-09-21T03:14:46.543647+0000","last_became_peered":"2024-09-21T03:14:46.543647+0000","last_unstale":"2024-09-21T03:15:15.805008+0000","last_undegraded":"2024-09-21T03:15:15.805008+0000","last_fullsized":"2024-09-21T03:15:15.805008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:03.097368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678464+0000","last_change":"2024-09-21T03:14:47.554766+0000","last_active":"2024-09-21T03:15:15.678464+0000","last_peered":"2024-09-21T03:15:15.678464+0000","last_clean":"2024-09-21T03:15:15.678464+0000","last_became_active":"2024-09-21T03:14:47.551563+0000","last_became_peered":"2024-09-21T03:14:47.551563+0000","last_unstale":"2024-09-21T03:15:15.678464+0000","last_undegraded":"2024-09-21T03:15:15.678464+0000","last_fullsized":"2024-09-21T03:15:15.678464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:08.790725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805982+0000","last_change":"2024-09-21T03:14:46.542659+0000","last_active":"2024-09-21T03:15:15.805982+0000","last_peered":"2024-09-21T03:15:15.805982+0000","last_clean":"2024-09-21T03:15:15.805982+0000","last_became_active":"2024-09-21T03:14:46.541771+0000","last_became_peered":"2024-09-21T03:14:46.541771+0000","last_unstale":"2024-09-21T03:15:15.805982+0000","last_undegraded":"2024-09-21T03:15:15.805982+0000","last_fullsized":"2024-09-21T03:15:15.805982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:45.543904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805168+0000","last_change":"2024-09-21T03:14:38.481837+0000","last_active":"2024-09-21T03:15:15.805168+0000","last_peered":"2024-09-21T03:15:15.805168+0000","last_clean":"2024-09-21T03:15:15.805168+0000","last_became_active":"2024-09-21T03:14:38.478400+0000","last_became_peered":"2024-09-21T03:14:38.478400+0000","last_unstale":"2024-09-21T03:15:15.805168+0000","last_undegraded":"2024-09-21T03:15:15.805168+0000","last_fullsized":"2024-09-21T03:15:15.805168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.702185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681897+0000","last_change":"2024-09-21T03:14:37.459351+0000","last_active":"2024-09-21T03:15:14.681897+0000","last_peered":"2024-09-21T03:15:14.681897+0000","last_clean":"2024-09-21T03:15:14.681897+0000","last_became_active":"2024-09-21T03:14:37.458676+0000","last_became_peered":"2024-09-21T03:14:37.458676+0000","last_unstale":"2024-09-21T03:15:14.681897+0000","last_undegraded":"2024-09-21T03:15:14.681897+0000","last_fullsized":"2024-09-21T03:15:14.681897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:42.671520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558462+0000","last_change":"2024-09-21T03:14:47.561232+0000","last_active":"2024-09-21T03:14:48.558462+0000","last_peered":"2024-09-21T03:14:48.558462+0000","last_clean":"2024-09-21T03:14:48.558462+0000","last_became_active":"2024-09-21T03:14:47.557224+0000","last_became_peered":"2024-09-21T03:14:47.557224+0000","last_unstale":"2024-09-21T03:14:48.558462+0000","last_undegraded":"2024-09-21T03:14:48.558462+0000","last_fullsized":"2024-09-21T03:14:48.558462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:09.611235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.686753+0000","last_change":"2024-09-21T03:14:46.543157+0000","last_active":"2024-09-21T03:15:14.686753+0000","last_peered":"2024-09-21T03:15:14.686753+0000","last_clean":"2024-09-21T03:15:14.686753+0000","last_became_active":"2024-09-21T03:14:46.542746+0000","last_became_peered":"2024-09-21T03:14:46.542746+0000","last_unstale":"2024-09-21T03:15:14.686753+0000","last_undegraded":"2024-09-21T03:15:14.686753+0000","last_fullsized":"2024-09-21T03:15:14.686753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:30.644843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679102+0000","last_change":"2024-09-21T03:14:38.480723+0000","last_active":"2024-09-21T03:15:15.679102+0000","last_peered":"2024-09-21T03:15:15.679102+0000","last_clean":"2024-09-21T03:15:15.679102+0000","last_became_active":"2024-09-21T03:14:38.472823+0000","last_became_peered":"2024-09-21T03:14:38.472823+0000","last_unstale":"2024-09-21T03:15:15.679102+0000","last_undegraded":"2024-09-21T03:15:15.679102+0000","last_fullsized":"2024-09-21T03:15:15.679102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:59.862592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557827+0000","last_change":"2024-09-21T03:14:37.472209+0000","last_active":"2024-09-21T03:14:48.557827+0000","last_peered":"2024-09-21T03:14:48.557827+0000","last_clean":"2024-09-21T03:14:48.557827+0000","last_became_active":"2024-09-21T03:14:37.471771+0000","last_became_peered":"2024-09-21T03:14:37.471771+0000","last_unstale":"2024-09-21T03:14:48.557827+0000","last_undegraded":"2024-09-21T03:14:48.557827+0000","last_fullsized":"2024-09-21T03:14:48.557827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:30.648010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805722+0000","last_change":"2024-09-21T03:14:47.570651+0000","last_active":"2024-09-21T03:15:15.805722+0000","last_peered":"2024-09-21T03:15:15.805722+0000","last_clean":"2024-09-21T03:15:15.805722+0000","last_became_active":"2024-09-21T03:14:47.568081+0000","last_became_peered":"2024-09-21T03:14:47.568081+0000","last_unstale":"2024-09-21T03:15:15.805722+0000","last_undegraded":"2024-09-21T03:15:15.805722+0000","last_fullsized":"2024-09-21T03:15:15.805722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:45.036938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682502+0000","last_change":"2024-09-21T03:14:37.475076+0000","last_active":"2024-09-21T03:15:14.682502+0000","last_peered":"2024-09-21T03:15:14.682502+0000","last_clean":"2024-09-21T03:15:14.682502+0000","last_became_active":"2024-09-21T03:14:37.474595+0000","last_became_peered":"2024-09-21T03:14:37.474595+0000","last_unstale":"2024-09-21T03:15:14.682502+0000","last_undegraded":"2024-09-21T03:15:14.682502+0000","last_fullsized":"2024-09-21T03:15:14.682502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:16.880647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805997+0000","last_change":"2024-09-21T03:14:38.483226+0000","last_active":"2024-09-21T03:15:15.805997+0000","last_peered":"2024-09-21T03:15:15.805997+0000","last_clean":"2024-09-21T03:15:15.805997+0000","last_became_active":"2024-09-21T03:14:38.482354+0000","last_became_peered":"2024-09-21T03:14:38.482354+0000","last_unstale":"2024-09-21T03:15:15.805997+0000","last_undegraded":"2024-09-21T03:15:15.805997+0000","last_fullsized":"2024-09-21T03:15:15.805997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:51.488594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805767+0000","last_change":"2024-09-21T03:14:46.551282+0000","last_active":"2024-09-21T03:15:15.805767+0000","last_peered":"2024-09-21T03:15:15.805767+0000","last_clean":"2024-09-21T03:15:15.805767+0000","last_became_active":"2024-09-21T03:14:46.550191+0000","last_became_peered":"2024-09-21T03:14:46.550191+0000","last_unstale":"2024-09-21T03:15:15.805767+0000","last_undegraded":"2024-09-21T03:15:15.805767+0000","last_fullsized":"2024-09-21T03:15:15.805767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:32.136739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.686630+0000","last_change":"2024-09-21T03:15:15.686522+0000","last_active":"2024-09-21T03:15:15.686630+0000","last_peered":"2024-09-21T03:15:15.686630+0000","last_clean":"2024-09-21T03:15:15.686630+0000","last_became_active":"2024-09-21T03:15:15.686063+0000","last_became_peered":"2024-09-21T03:15:15.686063+0000","last_unstale":"2024-09-21T03:15:15.686630+0000","last_undegraded":"2024-09-21T03:15:15.686630+0000","last_fullsized":"2024-09-21T03:15:15.686630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:57.750372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681320+0000","last_change":"2024-09-21T03:14:37.465536+0000","last_active":"2024-09-21T03:15:15.681320+0000","last_peered":"2024-09-21T03:15:15.681320+0000","last_clean":"2024-09-21T03:15:15.681320+0000","last_became_active":"2024-09-21T03:14:37.465240+0000","last_became_peered":"2024-09-21T03:14:37.465240+0000","last_unstale":"2024-09-21T03:15:15.681320+0000","last_undegraded":"2024-09-21T03:15:15.681320+0000","last_fullsized":"2024-09-21T03:15:15.681320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:34.780298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804722+0000","last_change":"2024-09-21T03:14:38.474516+0000","last_active":"2024-09-21T03:15:15.804722+0000","last_peered":"2024-09-21T03:15:15.804722+0000","last_clean":"2024-09-21T03:15:15.804722+0000","last_became_active":"2024-09-21T03:14:38.472225+0000","last_became_peered":"2024-09-21T03:14:38.472225+0000","last_unstale":"2024-09-21T03:15:15.804722+0000","last_undegraded":"2024-09-21T03:15:15.804722+0000","last_fullsized":"2024-09-21T03:15:15.804722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:47.504910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684801+0000","last_change":"2024-09-21T03:14:46.544072+0000","last_active":"2024-09-21T03:15:15.684801+0000","last_peered":"2024-09-21T03:15:15.684801+0000","last_clean":"2024-09-21T03:15:15.684801+0000","last_became_active":"2024-09-21T03:14:46.543729+0000","last_became_peered":"2024-09-21T03:14:46.543729+0000","last_unstale":"2024-09-21T03:15:15.684801+0000","last_undegraded":"2024-09-21T03:15:15.684801+0000","last_fullsized":"2024-09-21T03:15:15.684801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:18.560012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805979+0000","last_change":"2024-09-21T03:14:47.563764+0000","last_active":"2024-09-21T03:15:15.805979+0000","last_peered":"2024-09-21T03:15:15.805979+0000","last_clean":"2024-09-21T03:15:15.805979+0000","last_became_active":"2024-09-21T03:14:47.562943+0000","last_became_peered":"2024-09-21T03:14:47.562943+0000","last_unstale":"2024-09-21T03:15:15.805979+0000","last_undegraded":"2024-09-21T03:15:15.805979+0000","last_fullsized":"2024-09-21T03:15:15.805979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:39.284350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678175+0000","last_change":"2024-09-21T03:14:38.484311+0000","last_active":"2024-09-21T03:15:15.678175+0000","last_peered":"2024-09-21T03:15:15.678175+0000","last_clean":"2024-09-21T03:15:15.678175+0000","last_became_active":"2024-09-21T03:14:38.483975+0000","last_became_peered":"2024-09-21T03:14:38.483975+0000","last_unstale":"2024-09-21T03:15:15.678175+0000","last_undegraded":"2024-09-21T03:15:15.678175+0000","last_fullsized":"2024-09-21T03:15:15.678175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:31.145431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806372+0000","last_change":"2024-09-21T03:14:47.566252+0000","last_active":"2024-09-21T03:15:15.806372+0000","last_peered":"2024-09-21T03:15:15.806372+0000","last_clean":"2024-09-21T03:15:15.806372+0000","last_became_active":"2024-09-21T03:14:47.560282+0000","last_became_peered":"2024-09-21T03:14:47.560282+0000","last_unstale":"2024-09-21T03:15:15.806372+0000","last_undegraded":"2024-09-21T03:15:15.806372+0000","last_fullsized":"2024-09-21T03:15:15.806372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:23.553847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683395+0000","last_change":"2024-09-21T03:14:38.477183+0000","last_active":"2024-09-21T03:15:15.683395+0000","last_peered":"2024-09-21T03:15:15.683395+0000","last_clean":"2024-09-21T03:15:15.683395+0000","last_became_active":"2024-09-21T03:14:38.476657+0000","last_became_peered":"2024-09-21T03:14:38.476657+0000","last_unstale":"2024-09-21T03:15:15.683395+0000","last_undegraded":"2024-09-21T03:15:15.683395+0000","last_fullsized":"2024-09-21T03:15:15.683395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:36.801764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677510+0000","last_change":"2024-09-21T03:14:47.574339+0000","last_active":"2024-09-21T03:15:15.677510+0000","last_peered":"2024-09-21T03:15:15.677510+0000","last_clean":"2024-09-21T03:15:15.677510+0000","last_became_active":"2024-09-21T03:14:47.565732+0000","last_became_peered":"2024-09-21T03:14:47.565732+0000","last_unstale":"2024-09-21T03:15:15.677510+0000","last_undegraded":"2024-09-21T03:15:15.677510+0000","last_fullsized":"2024-09-21T03:15:15.677510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:57.896810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682397+0000","last_change":"2024-09-21T03:14:38.472860+0000","last_active":"2024-09-21T03:15:14.682397+0000","last_peered":"2024-09-21T03:15:14.682397+0000","last_clean":"2024-09-21T03:15:14.682397+0000","last_became_active":"2024-09-21T03:14:38.472548+0000","last_became_peered":"2024-09-21T03:14:38.472548+0000","last_unstale":"2024-09-21T03:15:14.682397+0000","last_undegraded":"2024-09-21T03:15:14.682397+0000","last_fullsized":"2024-09-21T03:15:14.682397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:16.071692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681588+0000","last_change":"2024-09-21T03:14:47.557402+0000","last_active":"2024-09-21T03:15:15.681588+0000","last_peered":"2024-09-21T03:15:15.681588+0000","last_clean":"2024-09-21T03:15:15.681588+0000","last_became_active":"2024-09-21T03:14:47.557047+0000","last_became_peered":"2024-09-21T03:14:47.557047+0000","last_unstale":"2024-09-21T03:15:15.681588+0000","last_undegraded":"2024-09-21T03:15:15.681588+0000","last_fullsized":"2024-09-21T03:15:15.681588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:29.792514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681269+0000","last_change":"2024-09-21T03:14:38.481039+0000","last_active":"2024-09-21T03:15:15.681269+0000","last_peered":"2024-09-21T03:15:15.681269+0000","last_clean":"2024-09-21T03:15:15.681269+0000","last_became_active":"2024-09-21T03:14:38.480686+0000","last_became_peered":"2024-09-21T03:14:38.480686+0000","last_unstale":"2024-09-21T03:15:15.681269+0000","last_undegraded":"2024-09-21T03:15:15.681269+0000","last_fullsized":"2024-09-21T03:15:15.681269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:18.603386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680603+0000","last_change":"2024-09-21T03:14:47.565697+0000","last_active":"2024-09-21T03:15:15.680603+0000","last_peered":"2024-09-21T03:15:15.680603+0000","last_clean":"2024-09-21T03:15:15.680603+0000","last_became_active":"2024-09-21T03:14:47.565393+0000","last_became_peered":"2024-09-21T03:14:47.565393+0000","last_unstale":"2024-09-21T03:15:15.680603+0000","last_undegraded":"2024-09-21T03:15:15.680603+0000","last_fullsized":"2024-09-21T03:15:15.680603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:35.421803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558553+0000","last_change":"2024-09-21T03:14:38.473900+0000","last_active":"2024-09-21T03:14:48.558553+0000","last_peered":"2024-09-21T03:14:48.558553+0000","last_clean":"2024-09-21T03:14:48.558553+0000","last_became_active":"2024-09-21T03:14:38.471325+0000","last_became_peered":"2024-09-21T03:14:38.471325+0000","last_unstale":"2024-09-21T03:14:48.558553+0000","last_undegraded":"2024-09-21T03:14:48.558553+0000","last_fullsized":"2024-09-21T03:14:48.558553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:47.556293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.685190+0000","last_change":"2024-09-21T03:15:15.685059+0000","last_active":"2024-09-21T03:15:15.685190+0000","last_peered":"2024-09-21T03:15:15.685190+0000","last_clean":"2024-09-21T03:15:15.685190+0000","last_became_active":"2024-09-21T03:15:15.684633+0000","last_became_peered":"2024-09-21T03:15:15.684633+0000","last_unstale":"2024-09-21T03:15:15.685190+0000","last_undegraded":"2024-09-21T03:15:15.685190+0000","last_fullsized":"2024-09-21T03:15:15.685190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:22.251366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557408+0000","last_change":"2024-09-21T03:14:38.478099+0000","last_active":"2024-09-21T03:14:48.557408+0000","last_peered":"2024-09-21T03:14:48.557408+0000","last_clean":"2024-09-21T03:14:48.557408+0000","last_became_active":"2024-09-21T03:14:38.475894+0000","last_became_peered":"2024-09-21T03:14:38.475894+0000","last_unstale":"2024-09-21T03:14:48.557408+0000","last_undegraded":"2024-09-21T03:14:48.557408+0000","last_fullsized":"2024-09-21T03:14:48.557408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:49.876430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681689+0000","last_change":"2024-09-21T03:14:47.556933+0000","last_active":"2024-09-21T03:15:14.681689+0000","last_peered":"2024-09-21T03:15:14.681689+0000","last_clean":"2024-09-21T03:15:14.681689+0000","last_became_active":"2024-09-21T03:14:47.556615+0000","last_became_peered":"2024-09-21T03:14:47.556615+0000","last_unstale":"2024-09-21T03:15:14.681689+0000","last_undegraded":"2024-09-21T03:15:14.681689+0000","last_fullsized":"2024-09-21T03:15:14.681689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:27.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678569+0000","last_change":"2024-09-21T03:14:38.484198+0000","last_active":"2024-09-21T03:15:15.678569+0000","last_peered":"2024-09-21T03:15:15.678569+0000","last_clean":"2024-09-21T03:15:15.678569+0000","last_became_active":"2024-09-21T03:14:38.483893+0000","last_became_peered":"2024-09-21T03:14:38.483893+0000","last_unstale":"2024-09-21T03:15:15.678569+0000","last_undegraded":"2024-09-21T03:15:15.678569+0000","last_fullsized":"2024-09-21T03:15:15.678569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:56.665359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677336+0000","last_change":"2024-09-21T03:14:47.553479+0000","last_active":"2024-09-21T03:15:15.677336+0000","last_peered":"2024-09-21T03:15:15.677336+0000","last_clean":"2024-09-21T03:15:15.677336+0000","last_became_active":"2024-09-21T03:14:47.553144+0000","last_became_peered":"2024-09-21T03:14:47.553144+0000","last_unstale":"2024-09-21T03:15:15.677336+0000","last_undegraded":"2024-09-21T03:15:15.677336+0000","last_fullsized":"2024-09-21T03:15:15.677336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:26.321488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681234+0000","last_change":"2024-09-21T03:14:38.487093+0000","last_active":"2024-09-21T03:15:15.681234+0000","last_peered":"2024-09-21T03:15:15.681234+0000","last_clean":"2024-09-21T03:15:15.681234+0000","last_became_active":"2024-09-21T03:14:38.486204+0000","last_became_peered":"2024-09-21T03:14:38.486204+0000","last_unstale":"2024-09-21T03:15:15.681234+0000","last_undegraded":"2024-09-21T03:15:15.681234+0000","last_fullsized":"2024-09-21T03:15:15.681234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:55.531046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684987+0000","last_change":"2024-09-21T03:14:47.573375+0000","last_active":"2024-09-21T03:15:15.684987+0000","last_peered":"2024-09-21T03:15:15.684987+0000","last_clean":"2024-09-21T03:15:15.684987+0000","last_became_active":"2024-09-21T03:14:47.572717+0000","last_became_peered":"2024-09-21T03:14:47.572717+0000","last_unstale":"2024-09-21T03:15:15.684987+0000","last_undegraded":"2024-09-21T03:15:15.684987+0000","last_fullsized":"2024-09-21T03:15:15.684987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:44.673283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681844+0000","last_change":"2024-09-21T03:14:38.471959+0000","last_active":"2024-09-21T03:15:14.681844+0000","last_peered":"2024-09-21T03:15:14.681844+0000","last_clean":"2024-09-21T03:15:14.681844+0000","last_became_active":"2024-09-21T03:14:38.471625+0000","last_became_peered":"2024-09-21T03:14:38.471625+0000","last_unstale":"2024-09-21T03:15:14.681844+0000","last_undegraded":"2024-09-21T03:15:14.681844+0000","last_fullsized":"2024-09-21T03:15:14.681844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:17.761951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.687099+0000","last_change":"2024-09-21T03:14:47.564597+0000","last_active":"2024-09-21T03:15:14.687099+0000","last_peered":"2024-09-21T03:15:14.687099+0000","last_clean":"2024-09-21T03:15:14.687099+0000","last_became_active":"2024-09-21T03:14:47.563816+0000","last_became_peered":"2024-09-21T03:14:47.563816+0000","last_unstale":"2024-09-21T03:15:14.687099+0000","last_undegraded":"2024-09-21T03:15:14.687099+0000","last_fullsized":"2024-09-21T03:15:14.687099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:33.061271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678841+0000","last_change":"2024-09-21T03:14:38.491888+0000","last_active":"2024-09-21T03:15:15.678841+0000","last_peered":"2024-09-21T03:15:15.678841+0000","last_clean":"2024-09-21T03:15:15.678841+0000","last_became_active":"2024-09-21T03:14:38.491510+0000","last_became_peered":"2024-09-21T03:14:38.491510+0000","last_unstale":"2024-09-21T03:15:15.678841+0000","last_undegraded":"2024-09-21T03:15:15.678841+0000","last_fullsized":"2024-09-21T03:15:15.678841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:26.740304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558275+0000","last_change":"2024-09-21T03:14:47.564310+0000","last_active":"2024-09-21T03:14:48.558275+0000","last_peered":"2024-09-21T03:14:48.558275+0000","last_clean":"2024-09-21T03:14:48.558275+0000","last_became_active":"2024-09-21T03:14:47.564003+0000","last_became_peered":"2024-09-21T03:14:47.564003+0000","last_unstale":"2024-09-21T03:14:48.558275+0000","last_undegraded":"2024-09-21T03:14:48.558275+0000","last_fullsized":"2024-09-21T03:14:48.558275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:45.016321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804618+0000","last_change":"2024-09-21T03:14:38.470991+0000","last_active":"2024-09-21T03:15:15.804618+0000","last_peered":"2024-09-21T03:15:15.804618+0000","last_clean":"2024-09-21T03:15:15.804618+0000","last_became_active":"2024-09-21T03:14:38.470666+0000","last_became_peered":"2024-09-21T03:14:38.470666+0000","last_unstale":"2024-09-21T03:15:15.804618+0000","last_undegraded":"2024-09-21T03:15:15.804618+0000","last_fullsized":"2024-09-21T03:15:15.804618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:25.477992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684492+0000","last_change":"2024-09-21T03:14:47.575212+0000","last_active":"2024-09-21T03:15:15.684492+0000","last_peered":"2024-09-21T03:15:15.684492+0000","last_clean":"2024-09-21T03:15:15.684492+0000","last_became_active":"2024-09-21T03:14:47.574895+0000","last_became_peered":"2024-09-21T03:14:47.574895+0000","last_unstale":"2024-09-21T03:15:15.684492+0000","last_undegraded":"2024-09-21T03:15:15.684492+0000","last_fullsized":"2024-09-21T03:15:15.684492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:04.240949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806008+0000","last_change":"2024-09-21T03:14:38.482681+0000","last_active":"2024-09-21T03:15:15.806008+0000","last_peered":"2024-09-21T03:15:15.806008+0000","last_clean":"2024-09-21T03:15:15.806008+0000","last_became_active":"2024-09-21T03:14:38.477816+0000","last_became_peered":"2024-09-21T03:14:38.477816+0000","last_unstale":"2024-09-21T03:15:15.806008+0000","last_undegraded":"2024-09-21T03:15:15.806008+0000","last_fullsized":"2024-09-21T03:15:15.806008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:18.675641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677394+0000","last_change":"2024-09-21T03:14:47.555329+0000","last_active":"2024-09-21T03:15:15.677394+0000","last_peered":"2024-09-21T03:15:15.677394+0000","last_clean":"2024-09-21T03:15:15.677394+0000","last_became_active":"2024-09-21T03:14:47.555033+0000","last_became_peered":"2024-09-21T03:14:47.555033+0000","last_unstale":"2024-09-21T03:15:15.677394+0000","last_undegraded":"2024-09-21T03:15:15.677394+0000","last_fullsized":"2024-09-21T03:15:15.677394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:49.060834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681613+0000","last_change":"2024-09-21T03:14:38.480638+0000","last_active":"2024-09-21T03:15:15.681613+0000","last_peered":"2024-09-21T03:15:15.681613+0000","last_clean":"2024-09-21T03:15:15.681613+0000","last_became_active":"2024-09-21T03:14:38.477739+0000","last_became_peered":"2024-09-21T03:14:38.477739+0000","last_unstale":"2024-09-21T03:15:15.681613+0000","last_undegraded":"2024-09-21T03:15:15.681613+0000","last_fullsized":"2024-09-21T03:15:15.681613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:35.097761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680739+0000","last_change":"2024-09-21T03:14:47.573659+0000","last_active":"2024-09-21T03:15:15.680739+0000","last_peered":"2024-09-21T03:15:15.680739+0000","last_clean":"2024-09-21T03:15:15.680739+0000","last_became_active":"2024-09-21T03:14:47.572756+0000","last_became_peered":"2024-09-21T03:14:47.572756+0000","last_unstale":"2024-09-21T03:15:15.680739+0000","last_undegraded":"2024-09-21T03:15:15.680739+0000","last_fullsized":"2024-09-21T03:15:15.680739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:21.986681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.685032+0000","last_change":"2024-09-21T03:14:38.478039+0000","last_active":"2024-09-21T03:15:14.685032+0000","last_peered":"2024-09-21T03:15:14.685032+0000","last_clean":"2024-09-21T03:15:14.685032+0000","last_became_active":"2024-09-21T03:14:38.473843+0000","last_became_peered":"2024-09-21T03:14:38.473843+0000","last_unstale":"2024-09-21T03:15:14.685032+0000","last_undegraded":"2024-09-21T03:15:14.685032+0000","last_fullsized":"2024-09-21T03:15:14.685032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:27.072406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677250+0000","last_change":"2024-09-21T03:14:47.555386+0000","last_active":"2024-09-21T03:15:15.677250+0000","last_peered":"2024-09-21T03:15:15.677250+0000","last_clean":"2024-09-21T03:15:15.677250+0000","last_became_active":"2024-09-21T03:14:47.554758+0000","last_became_peered":"2024-09-21T03:14:47.554758+0000","last_unstale":"2024-09-21T03:15:15.677250+0000","last_undegraded":"2024-09-21T03:15:15.677250+0000","last_fullsized":"2024-09-21T03:15:15.677250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:47.574672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.685167+0000","last_change":"2024-09-21T03:14:38.494878+0000","last_active":"2024-09-21T03:15:15.685167+0000","last_peered":"2024-09-21T03:15:15.685167+0000","last_clean":"2024-09-21T03:15:15.685167+0000","last_became_active":"2024-09-21T03:14:38.492813+0000","last_became_peered":"2024-09-21T03:14:38.492813+0000","last_unstale":"2024-09-21T03:15:15.685167+0000","last_undegraded":"2024-09-21T03:15:15.685167+0000","last_fullsized":"2024-09-21T03:15:15.685167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:55.064844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557554+0000","last_change":"2024-09-21T03:14:47.544806+0000","last_active":"2024-09-21T03:14:48.557554+0000","last_peered":"2024-09-21T03:14:48.557554+0000","last_clean":"2024-09-21T03:14:48.557554+0000","last_became_active":"2024-09-21T03:14:47.544431+0000","last_became_peered":"2024-09-21T03:14:47.544431+0000","last_unstale":"2024-09-21T03:14:48.557554+0000","last_undegraded":"2024-09-21T03:14:48.557554+0000","last_fullsized":"2024-09-21T03:14:48.557554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:01.463573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.687263+0000","last_change":"2024-09-21T03:14:38.474462+0000","last_active":"2024-09-21T03:15:14.687263+0000","last_peered":"2024-09-21T03:15:14.687263+0000","last_clean":"2024-09-21T03:15:14.687263+0000","last_became_active":"2024-09-21T03:14:38.474156+0000","last_became_peered":"2024-09-21T03:14:38.474156+0000","last_unstale":"2024-09-21T03:15:14.687263+0000","last_undegraded":"2024-09-21T03:15:14.687263+0000","last_fullsized":"2024-09-21T03:15:14.687263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:55.329945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806137+0000","last_change":"2024-09-21T03:14:47.563297+0000","last_active":"2024-09-21T03:15:15.806137+0000","last_peered":"2024-09-21T03:15:15.806137+0000","last_clean":"2024-09-21T03:15:15.806137+0000","last_became_active":"2024-09-21T03:14:47.562519+0000","last_became_peered":"2024-09-21T03:14:47.562519+0000","last_unstale":"2024-09-21T03:15:15.806137+0000","last_undegraded":"2024-09-21T03:15:15.806137+0000","last_fullsized":"2024-09-21T03:15:15.806137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:47.959373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681798+0000","last_change":"2024-09-21T03:14:38.474262+0000","last_active":"2024-09-21T03:15:14.681798+0000","last_peered":"2024-09-21T03:15:14.681798+0000","last_clean":"2024-09-21T03:15:14.681798+0000","last_became_active":"2024-09-21T03:14:38.473856+0000","last_became_peered":"2024-09-21T03:14:38.473856+0000","last_unstale":"2024-09-21T03:15:14.681798+0000","last_undegraded":"2024-09-21T03:15:14.681798+0000","last_fullsized":"2024-09-21T03:15:14.681798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804869+0000","last_change":"2024-09-21T03:14:47.558732+0000","last_active":"2024-09-21T03:15:15.804869+0000","last_peered":"2024-09-21T03:15:15.804869+0000","last_clean":"2024-09-21T03:15:15.804869+0000","last_became_active":"2024-09-21T03:14:47.558403+0000","last_became_peered":"2024-09-21T03:14:47.558403+0000","last_unstale":"2024-09-21T03:15:15.804869+0000","last_undegraded":"2024-09-21T03:15:15.804869+0000","last_fullsized":"2024-09-21T03:15:15.804869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:46.054565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678631+0000","last_change":"2024-09-21T03:14:38.469736+0000","last_active":"2024-09-21T03:15:15.678631+0000","last_peered":"2024-09-21T03:15:15.678631+0000","last_clean":"2024-09-21T03:15:15.678631+0000","last_became_active":"2024-09-21T03:14:38.469240+0000","last_became_peered":"2024-09-21T03:14:38.469240+0000","last_unstale":"2024-09-21T03:15:15.678631+0000","last_undegraded":"2024-09-21T03:15:15.678631+0000","last_fullsized":"2024-09-21T03:15:15.678631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:04.258761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804652+0000","last_change":"2024-09-21T03:14:47.550684+0000","last_active":"2024-09-21T03:15:15.804652+0000","last_peered":"2024-09-21T03:15:15.804652+0000","last_clean":"2024-09-21T03:15:15.804652+0000","last_became_active":"2024-09-21T03:14:47.550375+0000","last_became_peered":"2024-09-21T03:14:47.550375+0000","last_unstale":"2024-09-21T03:15:15.804652+0000","last_undegraded":"2024-09-21T03:15:15.804652+0000","last_fullsized":"2024-09-21T03:15:15.804652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:05.268160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557691+0000","last_change":"2024-09-21T03:14:38.487983+0000","last_active":"2024-09-21T03:14:48.557691+0000","last_peered":"2024-09-21T03:14:48.557691+0000","last_clean":"2024-09-21T03:14:48.557691+0000","last_became_active":"2024-09-21T03:14:38.487676+0000","last_became_peered":"2024-09-21T03:14:38.487676+0000","last_unstale":"2024-09-21T03:14:48.557691+0000","last_undegraded":"2024-09-21T03:14:48.557691+0000","last_fullsized":"2024-09-21T03:14:48.557691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:35.320169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684351+0000","last_change":"2024-09-21T03:14:47.561566+0000","last_active":"2024-09-21T03:15:14.684351+0000","last_peered":"2024-09-21T03:15:14.684351+0000","last_clean":"2024-09-21T03:15:14.684351+0000","last_became_active":"2024-09-21T03:14:47.561229+0000","last_became_peered":"2024-09-21T03:14:47.561229+0000","last_unstale":"2024-09-21T03:15:14.684351+0000","last_undegraded":"2024-09-21T03:15:14.684351+0000","last_fullsized":"2024-09-21T03:15:14.684351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:07.280356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558891+0000","last_change":"2024-09-21T03:14:38.478853+0000","last_active":"2024-09-21T03:14:48.558891+0000","last_peered":"2024-09-21T03:14:48.558891+0000","last_clean":"2024-09-21T03:14:48.558891+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:14:48.558891+0000","last_undegraded":"2024-09-21T03:14:48.558891+0000","last_fullsized":"2024-09-21T03:14:48.558891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:31.427596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":2,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-21T03:14:51.026823+0000","last_change":"2024-09-21T03:15:15.025321+0000","last_active":"2024-09-21T03:15:15.025321+0000","last_peered":"2024-09-21T03:14:51.026823+0000","last_clean":"2024-09-21T03:14:51.026823+0000","last_became_active":"2024-09-21T03:14:47.552659+0000","last_became_peered":"2024-09-21T03:14:47.552659+0000","last_unstale":"2024-09-21T03:14:51.026823+0000","last_undegraded":"2024-09-21T03:14:51.026823+0000","last_fullsized":"2024-09-21T03:14:51.026823+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681084+0000","last_change":"2024-09-21T03:14:38.481308+0000","last_active":"2024-09-21T03:15:15.681084+0000","last_peered":"2024-09-21T03:15:15.681084+0000","last_clean":"2024-09-21T03:15:15.681084+0000","last_became_active":"2024-09-21T03:14:38.480923+0000","last_became_peered":"2024-09-21T03:14:38.480923+0000","last_unstale":"2024-09-21T03:15:15.681084+0000","last_undegraded":"2024-09-21T03:15:15.681084+0000","last_fullsized":"2024-09-21T03:15:15.681084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:40.689231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557324+0000","last_change":"2024-09-21T03:14:47.561972+0000","last_active":"2024-09-21T03:14:48.557324+0000","last_peered":"2024-09-21T03:14:48.557324+0000","last_clean":"2024-09-21T03:14:48.557324+0000","last_became_active":"2024-09-21T03:14:47.561645+0000","last_became_peered":"2024-09-21T03:14:47.561645+0000","last_unstale":"2024-09-21T03:14:48.557324+0000","last_undegraded":"2024-09-21T03:14:48.557324+0000","last_fullsized":"2024-09-21T03:14:48.557324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:57.526787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681129+0000","last_change":"2024-09-21T03:14:38.473907+0000","last_active":"2024-09-21T03:15:15.681129+0000","last_peered":"2024-09-21T03:15:15.681129+0000","last_clean":"2024-09-21T03:15:15.681129+0000","last_became_active":"2024-09-21T03:14:38.473579+0000","last_became_peered":"2024-09-21T03:14:38.473579+0000","last_unstale":"2024-09-21T03:15:15.681129+0000","last_undegraded":"2024-09-21T03:15:15.681129+0000","last_fullsized":"2024-09-21T03:15:15.681129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:32.273503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680383+0000","last_change":"2024-09-21T03:14:47.566089+0000","last_active":"2024-09-21T03:15:15.680383+0000","last_peered":"2024-09-21T03:15:15.680383+0000","last_clean":"2024-09-21T03:15:15.680383+0000","last_became_active":"2024-09-21T03:14:47.565681+0000","last_became_peered":"2024-09-21T03:14:47.565681+0000","last_unstale":"2024-09-21T03:15:15.680383+0000","last_undegraded":"2024-09-21T03:15:15.680383+0000","last_fullsized":"2024-09-21T03:15:15.680383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.208933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681048+0000","last_change":"2024-09-21T03:14:38.474326+0000","last_active":"2024-09-21T03:15:15.681048+0000","last_peered":"2024-09-21T03:15:15.681048+0000","last_clean":"2024-09-21T03:15:15.681048+0000","last_became_active":"2024-09-21T03:14:38.470430+0000","last_became_peered":"2024-09-21T03:14:38.470430+0000","last_unstale":"2024-09-21T03:15:15.681048+0000","last_undegraded":"2024-09-21T03:15:15.681048+0000","last_fullsized":"2024-09-21T03:15:15.681048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:09.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680250+0000","last_change":"2024-09-21T03:14:47.571487+0000","last_active":"2024-09-21T03:15:15.680250+0000","last_peered":"2024-09-21T03:15:15.680250+0000","last_clean":"2024-09-21T03:15:15.680250+0000","last_became_active":"2024-09-21T03:14:47.571126+0000","last_became_peered":"2024-09-21T03:14:47.571126+0000","last_unstale":"2024-09-21T03:15:15.680250+0000","last_undegraded":"2024-09-21T03:15:15.680250+0000","last_fullsized":"2024-09-21T03:15:15.680250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:57.128853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805276+0000","last_change":"2024-09-21T03:14:38.483370+0000","last_active":"2024-09-21T03:15:15.805276+0000","last_peered":"2024-09-21T03:15:15.805276+0000","last_clean":"2024-09-21T03:15:15.805276+0000","last_became_active":"2024-09-21T03:14:38.483019+0000","last_became_peered":"2024-09-21T03:14:38.483019+0000","last_unstale":"2024-09-21T03:15:15.805276+0000","last_undegraded":"2024-09-21T03:15:15.805276+0000","last_fullsized":"2024-09-21T03:15:15.805276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:55.085422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679803+0000","last_change":"2024-09-21T03:14:47.555777+0000","last_active":"2024-09-21T03:15:15.679803+0000","last_peered":"2024-09-21T03:15:15.679803+0000","last_clean":"2024-09-21T03:15:15.679803+0000","last_became_active":"2024-09-21T03:14:47.555465+0000","last_became_peered":"2024-09-21T03:14:47.555465+0000","last_unstale":"2024-09-21T03:15:15.679803+0000","last_undegraded":"2024-09-21T03:15:15.679803+0000","last_fullsized":"2024-09-21T03:15:15.679803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:27.123740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678858+0000","last_change":"2024-09-21T03:14:38.465771+0000","last_active":"2024-09-21T03:15:15.678858+0000","last_peered":"2024-09-21T03:15:15.678858+0000","last_clean":"2024-09-21T03:15:15.678858+0000","last_became_active":"2024-09-21T03:14:38.465479+0000","last_became_peered":"2024-09-21T03:14:38.465479+0000","last_unstale":"2024-09-21T03:15:15.678858+0000","last_undegraded":"2024-09-21T03:15:15.678858+0000","last_fullsized":"2024-09-21T03:15:15.678858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.754315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678369+0000","last_change":"2024-09-21T03:14:47.567695+0000","last_active":"2024-09-21T03:15:15.678369+0000","last_peered":"2024-09-21T03:15:15.678369+0000","last_clean":"2024-09-21T03:15:15.678369+0000","last_became_active":"2024-09-21T03:14:47.566936+0000","last_became_peered":"2024-09-21T03:14:47.566936+0000","last_unstale":"2024-09-21T03:15:15.678369+0000","last_undegraded":"2024-09-21T03:15:15.678369+0000","last_fullsized":"2024-09-21T03:15:15.678369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:48.182523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.808619+0000","last_change":"2024-09-21T03:15:15.807206+0000","last_active":"2024-09-21T03:15:15.808619+0000","last_peered":"2024-09-21T03:15:15.808619+0000","last_clean":"2024-09-21T03:15:15.808619+0000","last_became_active":"2024-09-21T03:15:15.806775+0000","last_became_peered":"2024-09-21T03:15:15.806775+0000","last_unstale":"2024-09-21T03:15:15.808619+0000","last_undegraded":"2024-09-21T03:15:15.808619+0000","last_fullsized":"2024-09-21T03:15:15.808619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:51.779236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805513+0000","last_change":"2024-09-21T03:14:47.580314+0000","last_active":"2024-09-21T03:15:15.805513+0000","last_peered":"2024-09-21T03:15:15.805513+0000","last_clean":"2024-09-21T03:15:15.805513+0000","last_became_active":"2024-09-21T03:14:47.576499+0000","last_became_peered":"2024-09-21T03:14:47.576499+0000","last_unstale":"2024-09-21T03:15:15.805513+0000","last_undegraded":"2024-09-21T03:15:15.805513+0000","last_fullsized":"2024-09-21T03:15:15.805513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:46.154586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678336+0000","last_change":"2024-09-21T03:14:38.471270+0000","last_active":"2024-09-21T03:15:15.678336+0000","last_peered":"2024-09-21T03:15:15.678336+0000","last_clean":"2024-09-21T03:15:15.678336+0000","last_became_active":"2024-09-21T03:14:38.470708+0000","last_became_peered":"2024-09-21T03:14:38.470708+0000","last_unstale":"2024-09-21T03:15:15.678336+0000","last_undegraded":"2024-09-21T03:15:15.678336+0000","last_fullsized":"2024-09-21T03:15:15.678336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.122804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804703+0000","last_change":"2024-09-21T03:14:47.554180+0000","last_active":"2024-09-21T03:15:15.804703+0000","last_peered":"2024-09-21T03:15:15.804703+0000","last_clean":"2024-09-21T03:15:15.804703+0000","last_became_active":"2024-09-21T03:14:47.552808+0000","last_became_peered":"2024-09-21T03:14:47.552808+0000","last_unstale":"2024-09-21T03:15:15.804703+0000","last_undegraded":"2024-09-21T03:15:15.804703+0000","last_fullsized":"2024-09-21T03:15:15.804703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:07.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681593+0000","last_change":"2024-09-21T03:14:38.466077+0000","last_active":"2024-09-21T03:15:15.681593+0000","last_peered":"2024-09-21T03:15:15.681593+0000","last_clean":"2024-09-21T03:15:15.681593+0000","last_became_active":"2024-09-21T03:14:38.465818+0000","last_became_peered":"2024-09-21T03:14:38.465818+0000","last_unstale":"2024-09-21T03:15:15.681593+0000","last_undegraded":"2024-09-21T03:15:15.681593+0000","last_fullsized":"2024-09-21T03:15:15.681593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:34.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684015+0000","last_change":"2024-09-21T03:14:47.577228+0000","last_active":"2024-09-21T03:15:15.684015+0000","last_peered":"2024-09-21T03:15:15.684015+0000","last_clean":"2024-09-21T03:15:15.684015+0000","last_became_active":"2024-09-21T03:14:47.576843+0000","last_became_peered":"2024-09-21T03:14:47.576843+0000","last_unstale":"2024-09-21T03:15:15.684015+0000","last_undegraded":"2024-09-21T03:15:15.684015+0000","last_fullsized":"2024-09-21T03:15:15.684015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:56.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677741+0000","last_change":"2024-09-21T03:14:38.481389+0000","last_active":"2024-09-21T03:15:15.677741+0000","last_peered":"2024-09-21T03:15:15.677741+0000","last_clean":"2024-09-21T03:15:15.677741+0000","last_became_active":"2024-09-21T03:14:38.470907+0000","last_became_peered":"2024-09-21T03:14:38.470907+0000","last_unstale":"2024-09-21T03:15:15.677741+0000","last_undegraded":"2024-09-21T03:15:15.677741+0000","last_fullsized":"2024-09-21T03:15:15.677741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:30.068915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680895+0000","last_change":"2024-09-21T03:14:47.551766+0000","last_active":"2024-09-21T03:15:15.680895+0000","last_peered":"2024-09-21T03:15:15.680895+0000","last_clean":"2024-09-21T03:15:15.680895+0000","last_became_active":"2024-09-21T03:14:47.551420+0000","last_became_peered":"2024-09-21T03:14:47.551420+0000","last_unstale":"2024-09-21T03:15:15.680895+0000","last_undegraded":"2024-09-21T03:15:15.680895+0000","last_fullsized":"2024-09-21T03:15:15.680895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:56.255472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681739+0000","last_change":"2024-09-21T03:14:38.482605+0000","last_active":"2024-09-21T03:15:15.681739+0000","last_peered":"2024-09-21T03:15:15.681739+0000","last_clean":"2024-09-21T03:15:15.681739+0000","last_became_active":"2024-09-21T03:14:38.482306+0000","last_became_peered":"2024-09-21T03:14:38.482306+0000","last_unstale":"2024-09-21T03:15:15.681739+0000","last_undegraded":"2024-09-21T03:15:15.681739+0000","last_fullsized":"2024-09-21T03:15:15.681739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:40.482635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678145+0000","last_change":"2024-09-21T03:14:47.555070+0000","last_active":"2024-09-21T03:15:15.678145+0000","last_peered":"2024-09-21T03:15:15.678145+0000","last_clean":"2024-09-21T03:15:15.678145+0000","last_became_active":"2024-09-21T03:14:47.554363+0000","last_became_peered":"2024-09-21T03:14:47.554363+0000","last_unstale":"2024-09-21T03:15:15.678145+0000","last_undegraded":"2024-09-21T03:15:15.678145+0000","last_fullsized":"2024-09-21T03:15:15.678145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:40.027266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680191+0000","last_change":"2024-09-21T03:14:38.496218+0000","last_active":"2024-09-21T03:15:15.680191+0000","last_peered":"2024-09-21T03:15:15.680191+0000","last_clean":"2024-09-21T03:15:15.680191+0000","last_became_active":"2024-09-21T03:14:38.488537+0000","last_became_peered":"2024-09-21T03:14:38.488537+0000","last_unstale":"2024-09-21T03:15:15.680191+0000","last_undegraded":"2024-09-21T03:15:15.680191+0000","last_fullsized":"2024-09-21T03:15:15.680191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:59.667392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677329+0000","last_change":"2024-09-21T03:14:47.564250+0000","last_active":"2024-09-21T03:15:15.677329+0000","last_peered":"2024-09-21T03:15:15.677329+0000","last_clean":"2024-09-21T03:15:15.677329+0000","last_became_active":"2024-09-21T03:14:47.563745+0000","last_became_peered":"2024-09-21T03:14:47.563745+0000","last_unstale":"2024-09-21T03:15:15.677329+0000","last_undegraded":"2024-09-21T03:15:15.677329+0000","last_fullsized":"2024-09-21T03:15:15.677329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:31.282910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681230+0000","last_change":"2024-09-21T03:14:38.490309+0000","last_active":"2024-09-21T03:15:15.681230+0000","last_peered":"2024-09-21T03:15:15.681230+0000","last_clean":"2024-09-21T03:15:15.681230+0000","last_became_active":"2024-09-21T03:14:38.489167+0000","last_became_peered":"2024-09-21T03:14:38.489167+0000","last_unstale":"2024-09-21T03:15:15.681230+0000","last_undegraded":"2024-09-21T03:15:15.681230+0000","last_fullsized":"2024-09-21T03:15:15.681230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:07.725691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3656,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3656,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":698575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":319488,"data_stored":120849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":110425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":698041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":103380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":101880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:15:17.548 INFO:tasks.mon_thrash.ceph_manager:PG 5.32 is not active+clean 2024-09-21T03:15:17.548 INFO:tasks.mon_thrash.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 26, 'state': 'peering', 'last_fresh': '2024-09-21T03:14:51.026823+0000', 'last_change': '2024-09-21T03:15:15.025321+0000', 'last_active': '2024-09-21T03:15:15.025321+0000', 'last_peered': '2024-09-21T03:14:51.026823+0000', 'last_clean': '2024-09-21T03:14:51.026823+0000', 'last_became_active': '2024-09-21T03:14:47.552659+0000', 'last_became_peered': '2024-09-21T03:14:47.552659+0000', 'last_unstale': '2024-09-21T03:14:51.026823+0000', 'last_undegraded': '2024-09-21T03:14:51.026823+0000', 'last_fullsized': '2024-09-21T03:14:51.026823+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 24, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:14:46.510725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:14:46.510725+0000', 'last_clean_scrub_stamp': '2024-09-21T03:14:46.510725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:15:17.549 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T03:15:17.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.801+0000 7f2dd6400640 1 -- 172.21.15.90:0/758444487 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2db4003a00 msgr2=0x7f2db4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:17.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.801+0000 7f2dd6400640 1 --2- 172.21.15.90:0/758444487 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2db4003a00 0x7f2db4003e70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009b20 tx=0x7f2db4005830 comp rx=0 tx=0).stop 2024-09-21T03:15:17.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.801+0000 7f2dcfe00640 1 -- 172.21.15.90:0/758444487 reap_dead start 2024-09-21T03:15:17.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.801+0000 7f2dd6400640 1 -- 172.21.15.90:0/758444487 shutdown_connections 2024-09-21T03:15:17.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.801+0000 7f2dd6400640 1 -- 172.21.15.90:0/758444487 >> 172.21.15.90:0/758444487 conn(0x7f2dd00c8ba0 msgr2=0x7f2dd006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:17.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.801+0000 7f2dd6400640 1 -- 172.21.15.90:0/758444487 shutdown_connections 2024-09-21T03:15:17.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.801+0000 7f2dd6400640 1 -- 172.21.15.90:0/758444487 wait complete. 2024-09-21T03:15:17.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.804+0000 7f2dd6400640 1 Processor -- start 2024-09-21T03:15:17.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.804+0000 7f2dd6400640 1 -- start start 2024-09-21T03:15:17.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.805+0000 7f2dd6400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2db4003a00 0x7f2dd0151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:17.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.805+0000 7f2dd6400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd0139c20 0x7f2dd013a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:17.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.805+0000 7f2dd6400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd0150c40 0x7f2dd0151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:17.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.805+0000 7f2dd6400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd00ab640 con 0x7f2dd0139c20 2024-09-21T03:15:17.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.805+0000 7f2dd6400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd00ab360 con 0x7f2dd0150c40 2024-09-21T03:15:17.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.805+0000 7f2dd6400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd00ace70 con 0x7f2db4003a00 2024-09-21T03:15:17.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.805+0000 7f2dc6a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd0139c20 0x7f2dd013a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:17.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.805+0000 7f2dc6a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd0139c20 0x7f2dd013a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47680/0 (socket says 172.21.15.90:47680) 2024-09-21T03:15:17.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.805+0000 7f2dc6a00640 1 -- 172.21.15.90:0/881817926 learned_addr learned my addr 172.21.15.90:0/881817926 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:17.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.805+0000 7f2dcf400640 1 --2- 172.21.15.90:0/881817926 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2db4003a00 0x7f2dd0151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:17.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.806+0000 7f2dcfe00640 1 --2- 172.21.15.90:0/881817926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd0150c40 0x7f2dd0151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:17.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.806+0000 7f2dc6a00640 1 -- 172.21.15.90:0/881817926 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2db4003a00 msgr2=0x7f2dd0151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:17.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.806+0000 7f2dc6a00640 1 --2- 172.21.15.90:0/881817926 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2db4003a00 0x7f2dd0151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:17.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.806+0000 7f2dc6a00640 1 -- 172.21.15.90:0/881817926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd0150c40 msgr2=0x7f2dd0151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:17.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.806+0000 7f2dc6a00640 1 --2- 172.21.15.90:0/881817926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd0150c40 0x7f2dd0151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:17.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.806+0000 7f2dc6a00640 1 -- 172.21.15.90:0/881817926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd013aa30 con 0x7f2dd0139c20 2024-09-21T03:15:17.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.806+0000 7f2dc6a00640 1 --2- 172.21.15.90:0/881817926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd0139c20 0x7f2dd013a030 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2db8001a30 tx=0x7f2db80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:17.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.806+0000 7f2dc7e00640 1 -- 172.21.15.90:0/881817926 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db8015070 con 0x7f2dd0139c20 2024-09-21T03:15:17.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.806+0000 7f2dc7e00640 1 -- 172.21.15.90:0/881817926 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2db8011900 con 0x7f2dd0139c20 2024-09-21T03:15:17.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.806+0000 7f2dd6400640 1 -- 172.21.15.90:0/881817926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd014f090 con 0x7f2dd0139c20 2024-09-21T03:15:17.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.807+0000 7f2dc7e00640 1 -- 172.21.15.90:0/881817926 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db8011d50 con 0x7f2dd0139c20 2024-09-21T03:15:17.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.807+0000 7f2dd6400640 1 -- 172.21.15.90:0/881817926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd01548e0 con 0x7f2dd0139c20 2024-09-21T03:15:17.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.808+0000 7f2dd6400640 1 -- 172.21.15.90:0/881817926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dd013dd40 con 0x7f2dd0139c20 2024-09-21T03:15:17.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.809+0000 7f2dc7e00640 1 -- 172.21.15.90:0/881817926 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2db8018070 con 0x7f2dd0139c20 2024-09-21T03:15:17.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.810+0000 7f2dc7e00640 1 --2- 172.21.15.90:0/881817926 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2dac078b90 0x7f2dac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:17.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.810+0000 7f2dc7e00640 1 -- 172.21.15.90:0/881817926 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f2db809be40 con 0x7f2dd0139c20 2024-09-21T03:15:17.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.811+0000 7f2dcf400640 1 --2- 172.21.15.90:0/881817926 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2dac078b90 0x7f2dac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:17.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.811+0000 7f2dcf400640 1 --2- 172.21.15.90:0/881817926 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2dac078b90 0x7f2dac07b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0035000 tx=0x7f2dc00046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:17.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:17.815+0000 7f2dc7e00640 1 -- 172.21.15.90:0/881817926 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2dd013e280 con 0x7f2dd0139c20 2024-09-21T03:15:18.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.069+0000 7f2dd6400640 1 -- 172.21.15.90:0/881817926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f2dd0072e90 con 0x7f2dd0139c20 2024-09-21T03:15:18.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.070+0000 7f2dc7e00640 1 -- 172.21.15.90:0/881817926 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+3008 (secure 0 0 0) 0x7f2db80638f0 con 0x7f2dd0139c20 2024-09-21T03:15:18.071 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:15:18.072 INFO:teuthology.orchestra.run.smithi090.stdout:{"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":68,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":27,"num_osds":8,"num_up_osds":8,"osd_up_since":1726888465,"num_in_osds":8,"osd_in_since":1726888455,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":192},{"state_name":"peering","count":1}],"num_pgs":193,"num_pools":5,"num_objects":46,"data_bytes":597680,"bytes_used":224886784,"bytes_avail":772869226496,"bytes_total":773094113280,"inactive_pgs_ratio":0.005181347019970417,"write_bytes_sec":767,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":14,"btime":"2024-09-21T03:14:51:570098+0000","id":1,"up":1,"in":1,"max":1,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4395},{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4414}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-21T03:15:16.485411+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T03:15:18.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.072+0000 7f2dd6400640 1 -- 172.21.15.90:0/881817926 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2dac078b90 msgr2=0x7f2dac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:18.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.072+0000 7f2dd6400640 1 --2- 172.21.15.90:0/881817926 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2dac078b90 0x7f2dac07b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0035000 tx=0x7f2dc00046c0 comp rx=0 tx=0).stop 2024-09-21T03:15:18.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.072+0000 7f2dd6400640 1 -- 172.21.15.90:0/881817926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd0139c20 msgr2=0x7f2dd013a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:18.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.072+0000 7f2dd6400640 1 --2- 172.21.15.90:0/881817926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd0139c20 0x7f2dd013a030 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2db8001a30 tx=0x7f2db80039c0 comp rx=0 tx=0).stop 2024-09-21T03:15:18.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.072+0000 7f2dd6400640 1 -- 172.21.15.90:0/881817926 shutdown_connections 2024-09-21T03:15:18.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.072+0000 7f2dd6400640 1 --2- 172.21.15.90:0/881817926 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2dac078b90 0x7f2dac07b0a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:18.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.072+0000 7f2dd6400640 1 --2- 172.21.15.90:0/881817926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd0150c40 0x7f2dd0151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:18.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.072+0000 7f2dd6400640 1 --2- 172.21.15.90:0/881817926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd0139c20 0x7f2dd013a030 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:18.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.072+0000 7f2dd6400640 1 --2- 172.21.15.90:0/881817926 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2db4003a00 0x7f2dd0151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:18.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.072+0000 7f2dd6400640 1 -- 172.21.15.90:0/881817926 >> 172.21.15.90:0/881817926 conn(0x7f2dd00c8ba0 msgr2=0x7f2dd00c7370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:18.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.072+0000 7f2dd6400640 1 -- 172.21.15.90:0/881817926 shutdown_connections 2024-09-21T03:15:18.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.073+0000 7f2dd6400640 1 -- 172.21.15.90:0/881817926 wait complete. 2024-09-21T03:15:18.102 INFO:tasks.mon_thrash.ceph_manager:no progress seen, keeping timeout for now 2024-09-21T03:15:18.103 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:15:18.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.320+0000 7f199f200640 1 -- 172.21.15.90:0/4008715266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19980ac350 msgr2=0x7f19980ac760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:18.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.320+0000 7f199f200640 1 --2- 172.21.15.90:0/4008715266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19980ac350 0x7f19980ac760 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f19980719a0 tx=0x7f198402a4d0 comp rx=0 tx=0).stop 2024-09-21T03:15:18.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.320+0000 7f199f200640 1 -- 172.21.15.90:0/4008715266 shutdown_connections 2024-09-21T03:15:18.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.320+0000 7f199f200640 1 --2- 172.21.15.90:0/4008715266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19980ac350 0x7f19980ac760 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:18.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.320+0000 7f199f200640 1 --2- 172.21.15.90:0/4008715266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19980acca0 0x7f1998074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:18.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.320+0000 7f199f200640 1 --2- 172.21.15.90:0/4008715266 >> v2:172.21.15.149:3300/0 conn(0x7f199806d960 0x7f199813dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:18.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.320+0000 7f199f200640 1 -- 172.21.15.90:0/4008715266 >> 172.21.15.90:0/4008715266 conn(0x7f19980c8ba0 msgr2=0x7f199806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:18.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.320+0000 7f199f200640 1 -- 172.21.15.90:0/4008715266 shutdown_connections 2024-09-21T03:15:18.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.320+0000 7f199f200640 1 -- 172.21.15.90:0/4008715266 wait complete. 2024-09-21T03:15:18.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.322+0000 7f199f200640 1 Processor -- start 2024-09-21T03:15:18.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.322+0000 7f199f200640 1 -- start start 2024-09-21T03:15:18.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.324+0000 7f199f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f199806d960 0x7f199814be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:18.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.324+0000 7f199f200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19980ac350 0x7f19981500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:18.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.324+0000 7f199f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19980acca0 0x7f199813a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:18.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.324+0000 7f199f200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f19980ab640 con 0x7f19980ac350 2024-09-21T03:15:18.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.324+0000 7f199f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f19980ab360 con 0x7f19980acca0 2024-09-21T03:15:18.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.324+0000 7f199f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1998074760 con 0x7f199806d960 2024-09-21T03:15:18.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.324+0000 7f1997400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19980ac350 0x7f19981500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:18.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.324+0000 7f1997400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19980ac350 0x7f19981500c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47704/0 (socket says 172.21.15.90:47704) 2024-09-21T03:15:18.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.324+0000 7f1997400640 1 -- 172.21.15.90:0/3908417015 learned_addr learned my addr 172.21.15.90:0/3908417015 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:18.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.324+0000 7f1997400640 1 -- 172.21.15.90:0/3908417015 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f199806d960 msgr2=0x7f199814be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:18.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.324+0000 7f1997400640 1 --2- 172.21.15.90:0/3908417015 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f199806d960 0x7f199814be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:18.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.324+0000 7f1997400640 1 -- 172.21.15.90:0/3908417015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19980acca0 msgr2=0x7f199813a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:18.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.324+0000 7f1997400640 1 --2- 172.21.15.90:0/3908417015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19980acca0 0x7f199813a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:18.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.324+0000 7f1997400640 1 -- 172.21.15.90:0/3908417015 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f199814f1c0 con 0x7f19980ac350 2024-09-21T03:15:18.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.325+0000 7f1997400640 1 --2- 172.21.15.90:0/3908417015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19980ac350 0x7f19981500c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1984034040 tx=0x7f19840038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:18.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.325+0000 7f198fe00640 1 -- 172.21.15.90:0/3908417015 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198403e030 con 0x7f19980ac350 2024-09-21T03:15:18.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.325+0000 7f198fe00640 1 -- 172.21.15.90:0/3908417015 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1984003ca0 con 0x7f19980ac350 2024-09-21T03:15:18.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.325+0000 7f198fe00640 1 -- 172.21.15.90:0/3908417015 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1984035040 con 0x7f19980ac350 2024-09-21T03:15:18.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.325+0000 7f199f200640 1 -- 172.21.15.90:0/3908417015 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f199814e9b0 con 0x7f19980ac350 2024-09-21T03:15:18.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.325+0000 7f199f200640 1 -- 172.21.15.90:0/3908417015 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f199813a770 con 0x7f19980ac350 2024-09-21T03:15:18.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.326+0000 7f199f200640 1 -- 172.21.15.90:0/3908417015 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1998074cc0 con 0x7f19980ac350 2024-09-21T03:15:18.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.327+0000 7f198fe00640 1 -- 172.21.15.90:0/3908417015 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1984041030 con 0x7f19980ac350 2024-09-21T03:15:18.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.328+0000 7f198fe00640 1 --2- 172.21.15.90:0/3908417015 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1978078b90 0x7f197807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:18.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.328+0000 7f198fe00640 1 -- 172.21.15.90:0/3908417015 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f19840bb550 con 0x7f19980ac350 2024-09-21T03:15:18.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.329+0000 7f1997e00640 1 --2- 172.21.15.90:0/3908417015 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1978078b90 0x7f197807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:18.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.329+0000 7f1997e00640 1 --2- 172.21.15.90:0/3908417015 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1978078b90 0x7f197807b0a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f19980c5ca0 tx=0x7f1988009590 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:18.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.333+0000 7f198fe00640 1 -- 172.21.15.90:0/3908417015 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f19840836f0 con 0x7f19980ac350 2024-09-21T03:15:18.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.520+0000 7f199f200640 1 -- 172.21.15.90:0/3908417015 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1998076c40 con 0x7f1978078b90 2024-09-21T03:15:18.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.529+0000 7f198fe00640 1 -- 172.21.15.90:0/3908417015 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490343 (secure 0 0 0) 0x7f1998076c40 con 0x7f1978078b90 2024-09-21T03:15:18.536 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:15:18.539 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-21T03:15:18.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.535+0000 7f199f200640 1 -- 172.21.15.90:0/3908417015 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1978078b90 msgr2=0x7f197807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:18.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.535+0000 7f199f200640 1 --2- 172.21.15.90:0/3908417015 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1978078b90 0x7f197807b0a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f19980c5ca0 tx=0x7f1988009590 comp rx=0 tx=0).stop 2024-09-21T03:15:18.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.535+0000 7f199f200640 1 -- 172.21.15.90:0/3908417015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19980ac350 msgr2=0x7f19981500c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:18.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.535+0000 7f199f200640 1 --2- 172.21.15.90:0/3908417015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19980ac350 0x7f19981500c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1984034040 tx=0x7f19840038a0 comp rx=0 tx=0).stop 2024-09-21T03:15:18.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.535+0000 7f199f200640 1 -- 172.21.15.90:0/3908417015 shutdown_connections 2024-09-21T03:15:18.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.535+0000 7f199f200640 1 --2- 172.21.15.90:0/3908417015 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1978078b90 0x7f197807b0a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:18.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.535+0000 7f199f200640 1 --2- 172.21.15.90:0/3908417015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19980acca0 0x7f199813a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:18.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.535+0000 7f199f200640 1 --2- 172.21.15.90:0/3908417015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19980ac350 0x7f19981500c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:18.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.535+0000 7f199f200640 1 --2- 172.21.15.90:0/3908417015 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f199806d960 0x7f199814be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:18.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.535+0000 7f199f200640 1 -- 172.21.15.90:0/3908417015 >> 172.21.15.90:0/3908417015 conn(0x7f19980c8ba0 msgr2=0x7f1998152f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:18.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.535+0000 7f199f200640 1 -- 172.21.15.90:0/3908417015 shutdown_connections 2024-09-21T03:15:18.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:18.535+0000 7f199f200640 1 -- 172.21.15.90:0/3908417015 wait complete. 2024-09-21T03:15:18.563 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-09-21T03:15:18.485819+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597680,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":197,"num_write_kb":1662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219616,"kb_used_data":3388,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755104,"statfs":{"total":773094113280,"available":772869226496,"internally_reserved":0,"allocated":3469312,"data_stored":2048508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2492,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002863"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804323+0000","last_change":"2024-09-21T03:14:47.552762+0000","last_active":"2024-09-21T03:15:15.804323+0000","last_peered":"2024-09-21T03:15:15.804323+0000","last_clean":"2024-09-21T03:15:15.804323+0000","last_became_active":"2024-09-21T03:14:47.551883+0000","last_became_peered":"2024-09-21T03:14:47.551883+0000","last_unstale":"2024-09-21T03:15:15.804323+0000","last_undegraded":"2024-09-21T03:15:15.804323+0000","last_fullsized":"2024-09-21T03:15:15.804323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:51.935797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806503+0000","last_change":"2024-09-21T03:14:37.471004+0000","last_active":"2024-09-21T03:15:15.806503+0000","last_peered":"2024-09-21T03:15:15.806503+0000","last_clean":"2024-09-21T03:15:15.806503+0000","last_became_active":"2024-09-21T03:14:37.470563+0000","last_became_peered":"2024-09-21T03:14:37.470563+0000","last_unstale":"2024-09-21T03:15:15.806503+0000","last_undegraded":"2024-09-21T03:15:15.806503+0000","last_fullsized":"2024-09-21T03:15:15.806503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.422826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680312+0000","last_change":"2024-09-21T03:14:38.496252+0000","last_active":"2024-09-21T03:15:15.680312+0000","last_peered":"2024-09-21T03:15:15.680312+0000","last_clean":"2024-09-21T03:15:15.680312+0000","last_became_active":"2024-09-21T03:14:38.488292+0000","last_became_peered":"2024-09-21T03:14:38.488292+0000","last_unstale":"2024-09-21T03:15:15.680312+0000","last_undegraded":"2024-09-21T03:15:15.680312+0000","last_fullsized":"2024-09-21T03:15:15.680312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:57.409792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683500+0000","last_change":"2024-09-21T03:14:46.549877+0000","last_active":"2024-09-21T03:15:15.683500+0000","last_peered":"2024-09-21T03:15:15.683500+0000","last_clean":"2024-09-21T03:15:15.683500+0000","last_became_active":"2024-09-21T03:14:46.549536+0000","last_became_peered":"2024-09-21T03:14:46.549536+0000","last_unstale":"2024-09-21T03:15:15.683500+0000","last_undegraded":"2024-09-21T03:15:15.683500+0000","last_fullsized":"2024-09-21T03:15:15.683500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:57.491042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804846+0000","last_change":"2024-09-21T03:14:47.560303+0000","last_active":"2024-09-21T03:15:15.804846+0000","last_peered":"2024-09-21T03:15:15.804846+0000","last_clean":"2024-09-21T03:15:15.804846+0000","last_became_active":"2024-09-21T03:14:47.559659+0000","last_became_peered":"2024-09-21T03:14:47.559659+0000","last_unstale":"2024-09-21T03:15:15.804846+0000","last_undegraded":"2024-09-21T03:15:15.804846+0000","last_fullsized":"2024-09-21T03:15:15.804846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:49.328036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680553+0000","last_change":"2024-09-21T03:14:37.467448+0000","last_active":"2024-09-21T03:15:15.680553+0000","last_peered":"2024-09-21T03:15:15.680553+0000","last_clean":"2024-09-21T03:15:15.680553+0000","last_became_active":"2024-09-21T03:14:37.467146+0000","last_became_peered":"2024-09-21T03:14:37.467146+0000","last_unstale":"2024-09-21T03:15:15.680553+0000","last_undegraded":"2024-09-21T03:15:15.680553+0000","last_fullsized":"2024-09-21T03:15:15.680553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:53.475083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681362+0000","last_change":"2024-09-21T03:14:38.486401+0000","last_active":"2024-09-21T03:15:15.681362+0000","last_peered":"2024-09-21T03:15:15.681362+0000","last_clean":"2024-09-21T03:15:15.681362+0000","last_became_active":"2024-09-21T03:14:38.486090+0000","last_became_peered":"2024-09-21T03:14:38.486090+0000","last_unstale":"2024-09-21T03:15:15.681362+0000","last_undegraded":"2024-09-21T03:15:15.681362+0000","last_fullsized":"2024-09-21T03:15:15.681362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:44.085100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677377+0000","last_change":"2024-09-21T03:14:46.541705+0000","last_active":"2024-09-21T03:15:15.677377+0000","last_peered":"2024-09-21T03:15:15.677377+0000","last_clean":"2024-09-21T03:15:15.677377+0000","last_became_active":"2024-09-21T03:14:46.541357+0000","last_became_peered":"2024-09-21T03:14:46.541357+0000","last_unstale":"2024-09-21T03:15:15.677377+0000","last_undegraded":"2024-09-21T03:15:15.677377+0000","last_fullsized":"2024-09-21T03:15:15.677377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:31.082059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804443+0000","last_change":"2024-09-21T03:14:47.556183+0000","last_active":"2024-09-21T03:15:15.804443+0000","last_peered":"2024-09-21T03:15:15.804443+0000","last_clean":"2024-09-21T03:15:15.804443+0000","last_became_active":"2024-09-21T03:14:47.553312+0000","last_became_peered":"2024-09-21T03:14:47.553312+0000","last_unstale":"2024-09-21T03:15:15.804443+0000","last_undegraded":"2024-09-21T03:15:15.804443+0000","last_fullsized":"2024-09-21T03:15:15.804443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:07.314491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681355+0000","last_change":"2024-09-21T03:14:37.478711+0000","last_active":"2024-09-21T03:15:15.681355+0000","last_peered":"2024-09-21T03:15:15.681355+0000","last_clean":"2024-09-21T03:15:15.681355+0000","last_became_active":"2024-09-21T03:14:37.477910+0000","last_became_peered":"2024-09-21T03:14:37.477910+0000","last_unstale":"2024-09-21T03:15:15.681355+0000","last_undegraded":"2024-09-21T03:15:15.681355+0000","last_fullsized":"2024-09-21T03:15:15.681355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:40.166966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804969+0000","last_change":"2024-09-21T03:14:38.472992+0000","last_active":"2024-09-21T03:15:15.804969+0000","last_peered":"2024-09-21T03:15:15.804969+0000","last_clean":"2024-09-21T03:15:15.804969+0000","last_became_active":"2024-09-21T03:14:38.472426+0000","last_became_peered":"2024-09-21T03:14:38.472426+0000","last_unstale":"2024-09-21T03:15:15.804969+0000","last_undegraded":"2024-09-21T03:15:15.804969+0000","last_fullsized":"2024-09-21T03:15:15.804969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:36.825612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677572+0000","last_change":"2024-09-21T03:14:46.526996+0000","last_active":"2024-09-21T03:15:15.677572+0000","last_peered":"2024-09-21T03:15:15.677572+0000","last_clean":"2024-09-21T03:15:15.677572+0000","last_became_active":"2024-09-21T03:14:46.525587+0000","last_became_peered":"2024-09-21T03:14:46.525587+0000","last_unstale":"2024-09-21T03:15:15.677572+0000","last_undegraded":"2024-09-21T03:15:15.677572+0000","last_fullsized":"2024-09-21T03:15:15.677572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:56.977126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677435+0000","last_change":"2024-09-21T03:14:47.554143+0000","last_active":"2024-09-21T03:15:15.677435+0000","last_peered":"2024-09-21T03:15:15.677435+0000","last_clean":"2024-09-21T03:15:15.677435+0000","last_became_active":"2024-09-21T03:14:47.553802+0000","last_became_peered":"2024-09-21T03:14:47.553802+0000","last_unstale":"2024-09-21T03:15:15.677435+0000","last_undegraded":"2024-09-21T03:15:15.677435+0000","last_fullsized":"2024-09-21T03:15:15.677435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:37.963442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681887+0000","last_change":"2024-09-21T03:14:37.479842+0000","last_active":"2024-09-21T03:15:15.681887+0000","last_peered":"2024-09-21T03:15:15.681887+0000","last_clean":"2024-09-21T03:15:15.681887+0000","last_became_active":"2024-09-21T03:14:37.478893+0000","last_became_peered":"2024-09-21T03:14:37.478893+0000","last_unstale":"2024-09-21T03:15:15.681887+0000","last_undegraded":"2024-09-21T03:15:15.681887+0000","last_fullsized":"2024-09-21T03:15:15.681887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:27.916133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684739+0000","last_change":"2024-09-21T03:14:38.468756+0000","last_active":"2024-09-21T03:15:14.684739+0000","last_peered":"2024-09-21T03:15:14.684739+0000","last_clean":"2024-09-21T03:15:14.684739+0000","last_became_active":"2024-09-21T03:14:38.467570+0000","last_became_peered":"2024-09-21T03:14:38.467570+0000","last_unstale":"2024-09-21T03:15:14.684739+0000","last_undegraded":"2024-09-21T03:15:14.684739+0000","last_fullsized":"2024-09-21T03:15:14.684739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:24.784157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677514+0000","last_change":"2024-09-21T03:14:46.529932+0000","last_active":"2024-09-21T03:15:15.677514+0000","last_peered":"2024-09-21T03:15:15.677514+0000","last_clean":"2024-09-21T03:15:15.677514+0000","last_became_active":"2024-09-21T03:14:46.529629+0000","last_became_peered":"2024-09-21T03:14:46.529629+0000","last_unstale":"2024-09-21T03:15:15.677514+0000","last_undegraded":"2024-09-21T03:15:15.677514+0000","last_fullsized":"2024-09-21T03:15:15.677514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:39.808494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681239+0000","last_change":"2024-09-21T03:14:47.547724+0000","last_active":"2024-09-21T03:15:15.681239+0000","last_peered":"2024-09-21T03:15:15.681239+0000","last_clean":"2024-09-21T03:15:15.681239+0000","last_became_active":"2024-09-21T03:14:47.546770+0000","last_became_peered":"2024-09-21T03:14:47.546770+0000","last_unstale":"2024-09-21T03:15:15.681239+0000","last_undegraded":"2024-09-21T03:15:15.681239+0000","last_fullsized":"2024-09-21T03:15:15.681239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:31.476710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682495+0000","last_change":"2024-09-21T03:14:38.476747+0000","last_active":"2024-09-21T03:15:14.682495+0000","last_peered":"2024-09-21T03:15:14.682495+0000","last_clean":"2024-09-21T03:15:14.682495+0000","last_became_active":"2024-09-21T03:14:38.476386+0000","last_became_peered":"2024-09-21T03:14:38.476386+0000","last_unstale":"2024-09-21T03:15:14.682495+0000","last_undegraded":"2024-09-21T03:15:14.682495+0000","last_fullsized":"2024-09-21T03:15:14.682495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:28.751991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.683209+0000","last_change":"2024-09-21T03:14:37.463164+0000","last_active":"2024-09-21T03:15:14.683209+0000","last_peered":"2024-09-21T03:15:14.683209+0000","last_clean":"2024-09-21T03:15:14.683209+0000","last_became_active":"2024-09-21T03:14:37.461409+0000","last_became_peered":"2024-09-21T03:14:37.461409+0000","last_unstale":"2024-09-21T03:15:14.683209+0000","last_undegraded":"2024-09-21T03:15:14.683209+0000","last_fullsized":"2024-09-21T03:15:14.683209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:51.126291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684453+0000","last_change":"2024-09-21T03:14:46.538480+0000","last_active":"2024-09-21T03:15:14.684453+0000","last_peered":"2024-09-21T03:15:14.684453+0000","last_clean":"2024-09-21T03:15:14.684453+0000","last_became_active":"2024-09-21T03:14:46.537493+0000","last_became_peered":"2024-09-21T03:14:46.537493+0000","last_unstale":"2024-09-21T03:15:14.684453+0000","last_undegraded":"2024-09-21T03:15:14.684453+0000","last_fullsized":"2024-09-21T03:15:14.684453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:52.769190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684608+0000","last_change":"2024-09-21T03:14:47.580512+0000","last_active":"2024-09-21T03:15:15.684608+0000","last_peered":"2024-09-21T03:15:15.684608+0000","last_clean":"2024-09-21T03:15:15.684608+0000","last_became_active":"2024-09-21T03:14:47.580210+0000","last_became_peered":"2024-09-21T03:14:47.580210+0000","last_unstale":"2024-09-21T03:15:15.684608+0000","last_undegraded":"2024-09-21T03:15:15.684608+0000","last_fullsized":"2024-09-21T03:15:15.684608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:20.192190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684313+0000","last_change":"2024-09-21T03:14:38.494021+0000","last_active":"2024-09-21T03:15:15.684313+0000","last_peered":"2024-09-21T03:15:15.684313+0000","last_clean":"2024-09-21T03:15:15.684313+0000","last_became_active":"2024-09-21T03:14:38.486802+0000","last_became_peered":"2024-09-21T03:14:38.486802+0000","last_unstale":"2024-09-21T03:15:15.684313+0000","last_undegraded":"2024-09-21T03:15:15.684313+0000","last_fullsized":"2024-09-21T03:15:15.684313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:31.817505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558034+0000","last_change":"2024-09-21T03:14:37.465907+0000","last_active":"2024-09-21T03:14:48.558034+0000","last_peered":"2024-09-21T03:14:48.558034+0000","last_clean":"2024-09-21T03:14:48.558034+0000","last_became_active":"2024-09-21T03:14:37.465551+0000","last_became_peered":"2024-09-21T03:14:37.465551+0000","last_unstale":"2024-09-21T03:14:48.558034+0000","last_undegraded":"2024-09-21T03:14:48.558034+0000","last_fullsized":"2024-09-21T03:14:48.558034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:10.599687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681508+0000","last_change":"2024-09-21T03:14:46.546737+0000","last_active":"2024-09-21T03:15:15.681508+0000","last_peered":"2024-09-21T03:15:15.681508+0000","last_clean":"2024-09-21T03:15:15.681508+0000","last_became_active":"2024-09-21T03:14:46.546312+0000","last_became_peered":"2024-09-21T03:14:46.546312+0000","last_unstale":"2024-09-21T03:15:15.681508+0000","last_undegraded":"2024-09-21T03:15:15.681508+0000","last_fullsized":"2024-09-21T03:15:15.681508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:03.939168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.686382+0000","last_change":"2024-09-21T03:14:47.558742+0000","last_active":"2024-09-21T03:15:14.686382+0000","last_peered":"2024-09-21T03:15:14.686382+0000","last_clean":"2024-09-21T03:15:14.686382+0000","last_became_active":"2024-09-21T03:14:47.558431+0000","last_became_peered":"2024-09-21T03:14:47.558431+0000","last_unstale":"2024-09-21T03:15:14.686382+0000","last_undegraded":"2024-09-21T03:15:14.686382+0000","last_fullsized":"2024-09-21T03:15:14.686382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:32.053674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805176+0000","last_change":"2024-09-21T03:14:38.479370+0000","last_active":"2024-09-21T03:15:15.805176+0000","last_peered":"2024-09-21T03:15:15.805176+0000","last_clean":"2024-09-21T03:15:15.805176+0000","last_became_active":"2024-09-21T03:14:38.476976+0000","last_became_peered":"2024-09-21T03:14:38.476976+0000","last_unstale":"2024-09-21T03:15:15.805176+0000","last_undegraded":"2024-09-21T03:15:15.805176+0000","last_fullsized":"2024-09-21T03:15:15.805176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:14.695819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805302+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:15:15.805302+0000","last_peered":"2024-09-21T03:15:15.805302+0000","last_clean":"2024-09-21T03:15:15.805302+0000","last_became_active":"2024-09-21T03:14:37.478840+0000","last_became_peered":"2024-09-21T03:14:37.478840+0000","last_unstale":"2024-09-21T03:15:15.805302+0000","last_undegraded":"2024-09-21T03:15:15.805302+0000","last_fullsized":"2024-09-21T03:15:15.805302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:00.964354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684541+0000","last_change":"2024-09-21T03:14:46.543085+0000","last_active":"2024-09-21T03:15:15.684541+0000","last_peered":"2024-09-21T03:15:15.684541+0000","last_clean":"2024-09-21T03:15:15.684541+0000","last_became_active":"2024-09-21T03:14:46.542721+0000","last_became_peered":"2024-09-21T03:14:46.542721+0000","last_unstale":"2024-09-21T03:15:15.684541+0000","last_undegraded":"2024-09-21T03:15:15.684541+0000","last_fullsized":"2024-09-21T03:15:15.684541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:05.590871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805028+0000","last_change":"2024-09-21T03:14:47.566806+0000","last_active":"2024-09-21T03:15:15.805028+0000","last_peered":"2024-09-21T03:15:15.805028+0000","last_clean":"2024-09-21T03:15:15.805028+0000","last_became_active":"2024-09-21T03:14:47.566634+0000","last_became_peered":"2024-09-21T03:14:47.566634+0000","last_unstale":"2024-09-21T03:15:15.805028+0000","last_undegraded":"2024-09-21T03:15:15.805028+0000","last_fullsized":"2024-09-21T03:15:15.805028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:03.997294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682260+0000","last_change":"2024-09-21T03:14:38.482658+0000","last_active":"2024-09-21T03:15:14.682260+0000","last_peered":"2024-09-21T03:15:14.682260+0000","last_clean":"2024-09-21T03:15:14.682260+0000","last_became_active":"2024-09-21T03:14:38.482369+0000","last_became_peered":"2024-09-21T03:14:38.482369+0000","last_unstale":"2024-09-21T03:15:14.682260+0000","last_undegraded":"2024-09-21T03:15:14.682260+0000","last_fullsized":"2024-09-21T03:15:14.682260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:36.682534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680554+0000","last_change":"2024-09-21T03:14:37.472962+0000","last_active":"2024-09-21T03:15:15.680554+0000","last_peered":"2024-09-21T03:15:15.680554+0000","last_clean":"2024-09-21T03:15:15.680554+0000","last_became_active":"2024-09-21T03:14:37.472271+0000","last_became_peered":"2024-09-21T03:14:37.472271+0000","last_unstale":"2024-09-21T03:15:15.680554+0000","last_undegraded":"2024-09-21T03:15:15.680554+0000","last_fullsized":"2024-09-21T03:15:15.680554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:54.952223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678253+0000","last_change":"2024-09-21T03:14:46.537137+0000","last_active":"2024-09-21T03:15:15.678253+0000","last_peered":"2024-09-21T03:15:15.678253+0000","last_clean":"2024-09-21T03:15:15.678253+0000","last_became_active":"2024-09-21T03:14:46.536791+0000","last_became_peered":"2024-09-21T03:14:46.536791+0000","last_unstale":"2024-09-21T03:15:15.678253+0000","last_undegraded":"2024-09-21T03:15:15.678253+0000","last_fullsized":"2024-09-21T03:15:15.678253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:43.186807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805335+0000","last_change":"2024-09-21T03:14:47.555605+0000","last_active":"2024-09-21T03:15:15.805335+0000","last_peered":"2024-09-21T03:15:15.805335+0000","last_clean":"2024-09-21T03:15:15.805335+0000","last_became_active":"2024-09-21T03:14:47.555329+0000","last_became_peered":"2024-09-21T03:14:47.555329+0000","last_unstale":"2024-09-21T03:15:15.805335+0000","last_undegraded":"2024-09-21T03:15:15.805335+0000","last_fullsized":"2024-09-21T03:15:15.805335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:24.271656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806141+0000","last_change":"2024-09-21T03:14:38.479133+0000","last_active":"2024-09-21T03:15:15.806141+0000","last_peered":"2024-09-21T03:15:15.806141+0000","last_clean":"2024-09-21T03:15:15.806141+0000","last_became_active":"2024-09-21T03:14:38.478077+0000","last_became_peered":"2024-09-21T03:14:38.478077+0000","last_unstale":"2024-09-21T03:15:15.806141+0000","last_undegraded":"2024-09-21T03:15:15.806141+0000","last_fullsized":"2024-09-21T03:15:15.806141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:56.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.687362+0000","last_change":"2024-09-21T03:14:37.480508+0000","last_active":"2024-09-21T03:15:14.687362+0000","last_peered":"2024-09-21T03:15:14.687362+0000","last_clean":"2024-09-21T03:15:14.687362+0000","last_became_active":"2024-09-21T03:14:37.480218+0000","last_became_peered":"2024-09-21T03:14:37.480218+0000","last_unstale":"2024-09-21T03:15:14.687362+0000","last_undegraded":"2024-09-21T03:15:14.687362+0000","last_fullsized":"2024-09-21T03:15:14.687362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:01.851380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678755+0000","last_change":"2024-09-21T03:14:46.531615+0000","last_active":"2024-09-21T03:15:15.678755+0000","last_peered":"2024-09-21T03:15:15.678755+0000","last_clean":"2024-09-21T03:15:15.678755+0000","last_became_active":"2024-09-21T03:14:46.531289+0000","last_became_peered":"2024-09-21T03:14:46.531289+0000","last_unstale":"2024-09-21T03:15:15.678755+0000","last_undegraded":"2024-09-21T03:15:15.678755+0000","last_fullsized":"2024-09-21T03:15:15.678755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:10.145489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682075+0000","last_change":"2024-09-21T03:14:47.552705+0000","last_active":"2024-09-21T03:15:14.682075+0000","last_peered":"2024-09-21T03:15:14.682075+0000","last_clean":"2024-09-21T03:15:14.682075+0000","last_became_active":"2024-09-21T03:14:47.552367+0000","last_became_peered":"2024-09-21T03:14:47.552367+0000","last_unstale":"2024-09-21T03:15:14.682075+0000","last_undegraded":"2024-09-21T03:15:14.682075+0000","last_fullsized":"2024-09-21T03:15:14.682075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:45.379581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806286+0000","last_change":"2024-09-21T03:14:38.475318+0000","last_active":"2024-09-21T03:15:15.806286+0000","last_peered":"2024-09-21T03:15:15.806286+0000","last_clean":"2024-09-21T03:15:15.806286+0000","last_became_active":"2024-09-21T03:14:38.474978+0000","last_became_peered":"2024-09-21T03:14:38.474978+0000","last_unstale":"2024-09-21T03:15:15.806286+0000","last_undegraded":"2024-09-21T03:15:15.806286+0000","last_fullsized":"2024-09-21T03:15:15.806286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:38.209624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806345+0000","last_change":"2024-09-21T03:14:37.479651+0000","last_active":"2024-09-21T03:15:15.806345+0000","last_peered":"2024-09-21T03:15:15.806345+0000","last_clean":"2024-09-21T03:15:15.806345+0000","last_became_active":"2024-09-21T03:14:37.478833+0000","last_became_peered":"2024-09-21T03:14:37.478833+0000","last_unstale":"2024-09-21T03:15:15.806345+0000","last_undegraded":"2024-09-21T03:15:15.806345+0000","last_fullsized":"2024-09-21T03:15:15.806345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:48.578637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804935+0000","last_change":"2024-09-21T03:14:46.536054+0000","last_active":"2024-09-21T03:15:15.804935+0000","last_peered":"2024-09-21T03:15:15.804935+0000","last_clean":"2024-09-21T03:15:15.804935+0000","last_became_active":"2024-09-21T03:14:46.535569+0000","last_became_peered":"2024-09-21T03:14:46.535569+0000","last_unstale":"2024-09-21T03:15:15.804935+0000","last_undegraded":"2024-09-21T03:15:15.804935+0000","last_fullsized":"2024-09-21T03:15:15.804935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:04.556059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680654+0000","last_change":"2024-09-21T03:14:47.571889+0000","last_active":"2024-09-21T03:15:15.680654+0000","last_peered":"2024-09-21T03:15:15.680654+0000","last_clean":"2024-09-21T03:15:15.680654+0000","last_became_active":"2024-09-21T03:14:47.571620+0000","last_became_peered":"2024-09-21T03:14:47.571620+0000","last_unstale":"2024-09-21T03:15:15.680654+0000","last_undegraded":"2024-09-21T03:15:15.680654+0000","last_fullsized":"2024-09-21T03:15:15.680654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:23.103973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558656+0000","last_change":"2024-09-21T03:14:38.493350+0000","last_active":"2024-09-21T03:14:48.558656+0000","last_peered":"2024-09-21T03:14:48.558656+0000","last_clean":"2024-09-21T03:14:48.558656+0000","last_became_active":"2024-09-21T03:14:38.492830+0000","last_became_peered":"2024-09-21T03:14:38.492830+0000","last_unstale":"2024-09-21T03:14:48.558656+0000","last_undegraded":"2024-09-21T03:14:48.558656+0000","last_fullsized":"2024-09-21T03:14:48.558656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:19.946319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.685128+0000","last_change":"2024-09-21T03:14:37.473484+0000","last_active":"2024-09-21T03:15:14.685128+0000","last_peered":"2024-09-21T03:15:14.685128+0000","last_clean":"2024-09-21T03:15:14.685128+0000","last_became_active":"2024-09-21T03:14:37.473218+0000","last_became_peered":"2024-09-21T03:14:37.473218+0000","last_unstale":"2024-09-21T03:15:14.685128+0000","last_undegraded":"2024-09-21T03:15:14.685128+0000","last_fullsized":"2024-09-21T03:15:14.685128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:49.006579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558777+0000","last_change":"2024-09-21T03:14:46.548858+0000","last_active":"2024-09-21T03:14:48.558777+0000","last_peered":"2024-09-21T03:14:48.558777+0000","last_clean":"2024-09-21T03:14:48.558777+0000","last_became_active":"2024-09-21T03:14:46.548166+0000","last_became_peered":"2024-09-21T03:14:46.548166+0000","last_unstale":"2024-09-21T03:14:48.558777+0000","last_undegraded":"2024-09-21T03:14:48.558777+0000","last_fullsized":"2024-09-21T03:14:48.558777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:41.470072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805741+0000","last_change":"2024-09-21T03:14:47.555787+0000","last_active":"2024-09-21T03:15:15.805741+0000","last_peered":"2024-09-21T03:15:15.805741+0000","last_clean":"2024-09-21T03:15:15.805741+0000","last_became_active":"2024-09-21T03:14:47.555420+0000","last_became_peered":"2024-09-21T03:14:47.555420+0000","last_unstale":"2024-09-21T03:15:15.805741+0000","last_undegraded":"2024-09-21T03:15:15.805741+0000","last_fullsized":"2024-09-21T03:15:15.805741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:45.769786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677640+0000","last_change":"2024-09-21T03:14:38.479657+0000","last_active":"2024-09-21T03:15:15.677640+0000","last_peered":"2024-09-21T03:15:15.677640+0000","last_clean":"2024-09-21T03:15:15.677640+0000","last_became_active":"2024-09-21T03:14:38.479439+0000","last_became_peered":"2024-09-21T03:14:38.479439+0000","last_unstale":"2024-09-21T03:15:15.677640+0000","last_undegraded":"2024-09-21T03:15:15.677640+0000","last_fullsized":"2024-09-21T03:15:15.677640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.107215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681857+0000","last_change":"2024-09-21T03:14:37.469799+0000","last_active":"2024-09-21T03:15:15.681857+0000","last_peered":"2024-09-21T03:15:15.681857+0000","last_clean":"2024-09-21T03:15:15.681857+0000","last_became_active":"2024-09-21T03:14:37.469495+0000","last_became_peered":"2024-09-21T03:14:37.469495+0000","last_unstale":"2024-09-21T03:15:15.681857+0000","last_undegraded":"2024-09-21T03:15:15.681857+0000","last_fullsized":"2024-09-21T03:15:15.681857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:50.247050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557375+0000","last_change":"2024-09-21T03:14:46.544320+0000","last_active":"2024-09-21T03:14:48.557375+0000","last_peered":"2024-09-21T03:14:48.557375+0000","last_clean":"2024-09-21T03:14:48.557375+0000","last_became_active":"2024-09-21T03:14:46.544038+0000","last_became_peered":"2024-09-21T03:14:46.544038+0000","last_unstale":"2024-09-21T03:14:48.557375+0000","last_undegraded":"2024-09-21T03:14:48.557375+0000","last_fullsized":"2024-09-21T03:14:48.557375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:57.457687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684713+0000","last_change":"2024-09-21T03:14:47.579698+0000","last_active":"2024-09-21T03:15:15.684713+0000","last_peered":"2024-09-21T03:15:15.684713+0000","last_clean":"2024-09-21T03:15:15.684713+0000","last_became_active":"2024-09-21T03:14:47.579324+0000","last_became_peered":"2024-09-21T03:14:47.579324+0000","last_unstale":"2024-09-21T03:15:15.684713+0000","last_undegraded":"2024-09-21T03:15:15.684713+0000","last_fullsized":"2024-09-21T03:15:15.684713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:37.656859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681701+0000","last_change":"2024-09-21T03:14:38.476763+0000","last_active":"2024-09-21T03:15:15.681701+0000","last_peered":"2024-09-21T03:15:15.681701+0000","last_clean":"2024-09-21T03:15:15.681701+0000","last_became_active":"2024-09-21T03:14:38.474299+0000","last_became_peered":"2024-09-21T03:14:38.474299+0000","last_unstale":"2024-09-21T03:15:15.681701+0000","last_undegraded":"2024-09-21T03:15:15.681701+0000","last_fullsized":"2024-09-21T03:15:15.681701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:46.544930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682672+0000","last_change":"2024-09-21T03:14:37.466857+0000","last_active":"2024-09-21T03:15:14.682672+0000","last_peered":"2024-09-21T03:15:14.682672+0000","last_clean":"2024-09-21T03:15:14.682672+0000","last_became_active":"2024-09-21T03:14:37.466256+0000","last_became_peered":"2024-09-21T03:14:37.466256+0000","last_unstale":"2024-09-21T03:15:14.682672+0000","last_undegraded":"2024-09-21T03:15:14.682672+0000","last_fullsized":"2024-09-21T03:15:14.682672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:02.240461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558502+0000","last_change":"2024-09-21T03:14:46.537315+0000","last_active":"2024-09-21T03:14:48.558502+0000","last_peered":"2024-09-21T03:14:48.558502+0000","last_clean":"2024-09-21T03:14:48.558502+0000","last_became_active":"2024-09-21T03:14:46.536975+0000","last_became_peered":"2024-09-21T03:14:46.536975+0000","last_unstale":"2024-09-21T03:14:48.558502+0000","last_undegraded":"2024-09-21T03:14:48.558502+0000","last_fullsized":"2024-09-21T03:14:48.558502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:42.529591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.685045+0000","last_change":"2024-09-21T03:14:47.573009+0000","last_active":"2024-09-21T03:15:15.685045+0000","last_peered":"2024-09-21T03:15:15.685045+0000","last_clean":"2024-09-21T03:15:15.685045+0000","last_became_active":"2024-09-21T03:14:47.572395+0000","last_became_peered":"2024-09-21T03:14:47.572395+0000","last_unstale":"2024-09-21T03:15:15.685045+0000","last_undegraded":"2024-09-21T03:15:15.685045+0000","last_fullsized":"2024-09-21T03:15:15.685045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:41.733447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678985+0000","last_change":"2024-09-21T03:14:38.481801+0000","last_active":"2024-09-21T03:15:15.678985+0000","last_peered":"2024-09-21T03:15:15.678985+0000","last_clean":"2024-09-21T03:15:15.678985+0000","last_became_active":"2024-09-21T03:14:38.481186+0000","last_became_peered":"2024-09-21T03:14:38.481186+0000","last_unstale":"2024-09-21T03:15:15.678985+0000","last_undegraded":"2024-09-21T03:15:15.678985+0000","last_fullsized":"2024-09-21T03:15:15.678985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:54.271470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683612+0000","last_change":"2024-09-21T03:14:37.474798+0000","last_active":"2024-09-21T03:15:15.683612+0000","last_peered":"2024-09-21T03:15:15.683612+0000","last_clean":"2024-09-21T03:15:15.683612+0000","last_became_active":"2024-09-21T03:14:37.473829+0000","last_became_peered":"2024-09-21T03:14:37.473829+0000","last_unstale":"2024-09-21T03:15:15.683612+0000","last_undegraded":"2024-09-21T03:15:15.683612+0000","last_fullsized":"2024-09-21T03:15:15.683612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:11.571814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558227+0000","last_change":"2024-09-21T03:14:46.542495+0000","last_active":"2024-09-21T03:14:48.558227+0000","last_peered":"2024-09-21T03:14:48.558227+0000","last_clean":"2024-09-21T03:14:48.558227+0000","last_became_active":"2024-09-21T03:14:46.542181+0000","last_became_peered":"2024-09-21T03:14:46.542181+0000","last_unstale":"2024-09-21T03:14:48.558227+0000","last_undegraded":"2024-09-21T03:14:48.558227+0000","last_fullsized":"2024-09-21T03:14:48.558227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:22.481477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.686650+0000","last_change":"2024-09-21T03:14:47.569409+0000","last_active":"2024-09-21T03:15:14.686650+0000","last_peered":"2024-09-21T03:15:14.686650+0000","last_clean":"2024-09-21T03:15:14.686650+0000","last_became_active":"2024-09-21T03:14:47.569212+0000","last_became_peered":"2024-09-21T03:14:47.569212+0000","last_unstale":"2024-09-21T03:15:14.686650+0000","last_undegraded":"2024-09-21T03:15:14.686650+0000","last_fullsized":"2024-09-21T03:15:14.686650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.851943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557644+0000","last_change":"2024-09-21T03:14:38.480026+0000","last_active":"2024-09-21T03:14:48.557644+0000","last_peered":"2024-09-21T03:14:48.557644+0000","last_clean":"2024-09-21T03:14:48.557644+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:14:48.557644+0000","last_undegraded":"2024-09-21T03:14:48.557644+0000","last_fullsized":"2024-09-21T03:14:48.557644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:20.481816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682008+0000","last_change":"2024-09-21T03:14:37.464554+0000","last_active":"2024-09-21T03:15:14.682008+0000","last_peered":"2024-09-21T03:15:14.682008+0000","last_clean":"2024-09-21T03:15:14.682008+0000","last_became_active":"2024-09-21T03:14:37.464228+0000","last_became_peered":"2024-09-21T03:14:37.464228+0000","last_unstale":"2024-09-21T03:15:14.682008+0000","last_undegraded":"2024-09-21T03:15:14.682008+0000","last_fullsized":"2024-09-21T03:15:14.682008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:32.529512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680429+0000","last_change":"2024-09-21T03:14:46.538538+0000","last_active":"2024-09-21T03:15:15.680429+0000","last_peered":"2024-09-21T03:15:15.680429+0000","last_clean":"2024-09-21T03:15:15.680429+0000","last_became_active":"2024-09-21T03:14:46.537815+0000","last_became_peered":"2024-09-21T03:14:46.537815+0000","last_unstale":"2024-09-21T03:15:15.680429+0000","last_undegraded":"2024-09-21T03:15:15.680429+0000","last_fullsized":"2024-09-21T03:15:15.680429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:42.264439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680898+0000","last_change":"2024-09-21T03:14:47.558861+0000","last_active":"2024-09-21T03:15:15.680898+0000","last_peered":"2024-09-21T03:15:15.680898+0000","last_clean":"2024-09-21T03:15:15.680898+0000","last_became_active":"2024-09-21T03:14:47.557305+0000","last_became_peered":"2024-09-21T03:14:47.557305+0000","last_unstale":"2024-09-21T03:15:15.680898+0000","last_undegraded":"2024-09-21T03:15:15.680898+0000","last_fullsized":"2024-09-21T03:15:15.680898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:45.962367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805521+0000","last_change":"2024-09-21T03:14:38.479181+0000","last_active":"2024-09-21T03:15:15.805521+0000","last_peered":"2024-09-21T03:15:15.805521+0000","last_clean":"2024-09-21T03:15:15.805521+0000","last_became_active":"2024-09-21T03:14:38.478842+0000","last_became_peered":"2024-09-21T03:14:38.478842+0000","last_unstale":"2024-09-21T03:15:15.805521+0000","last_undegraded":"2024-09-21T03:15:15.805521+0000","last_fullsized":"2024-09-21T03:15:15.805521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:08.664381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.683994+0000","last_change":"2024-09-21T03:14:37.463990+0000","last_active":"2024-09-21T03:15:14.683994+0000","last_peered":"2024-09-21T03:15:14.683994+0000","last_clean":"2024-09-21T03:15:14.683994+0000","last_became_active":"2024-09-21T03:14:37.463674+0000","last_became_peered":"2024-09-21T03:14:37.463674+0000","last_unstale":"2024-09-21T03:15:14.683994+0000","last_undegraded":"2024-09-21T03:15:14.683994+0000","last_fullsized":"2024-09-21T03:15:14.683994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:35.391985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804527+0000","last_change":"2024-09-21T03:14:26.342355+0000","last_active":"2024-09-21T03:15:15.804527+0000","last_peered":"2024-09-21T03:15:15.804527+0000","last_clean":"2024-09-21T03:15:15.804527+0000","last_became_active":"2024-09-21T03:14:26.341929+0000","last_became_peered":"2024-09-21T03:14:26.341929+0000","last_unstale":"2024-09-21T03:15:15.804527+0000","last_undegraded":"2024-09-21T03:15:15.804527+0000","last_fullsized":"2024-09-21T03:15:15.804527+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_clean_scrub_stamp":"2024-09-21T03:14:25.329650+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:45.390822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684834+0000","last_change":"2024-09-21T03:14:46.538184+0000","last_active":"2024-09-21T03:15:14.684834+0000","last_peered":"2024-09-21T03:15:14.684834+0000","last_clean":"2024-09-21T03:15:14.684834+0000","last_became_active":"2024-09-21T03:14:46.536753+0000","last_became_peered":"2024-09-21T03:14:46.536753+0000","last_unstale":"2024-09-21T03:15:14.684834+0000","last_undegraded":"2024-09-21T03:15:14.684834+0000","last_fullsized":"2024-09-21T03:15:14.684834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:49.078638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680743+0000","last_change":"2024-09-21T03:14:47.552966+0000","last_active":"2024-09-21T03:15:15.680743+0000","last_peered":"2024-09-21T03:15:15.680743+0000","last_clean":"2024-09-21T03:15:15.680743+0000","last_became_active":"2024-09-21T03:14:47.552642+0000","last_became_peered":"2024-09-21T03:14:47.552642+0000","last_unstale":"2024-09-21T03:15:15.680743+0000","last_undegraded":"2024-09-21T03:15:15.680743+0000","last_fullsized":"2024-09-21T03:15:15.680743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:15.928026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684929+0000","last_change":"2024-09-21T03:14:38.478414+0000","last_active":"2024-09-21T03:15:14.684929+0000","last_peered":"2024-09-21T03:15:14.684929+0000","last_clean":"2024-09-21T03:15:14.684929+0000","last_became_active":"2024-09-21T03:14:38.478116+0000","last_became_peered":"2024-09-21T03:14:38.478116+0000","last_unstale":"2024-09-21T03:15:14.684929+0000","last_undegraded":"2024-09-21T03:15:14.684929+0000","last_fullsized":"2024-09-21T03:15:14.684929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:29.618008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558850+0000","last_change":"2024-09-21T03:14:37.479578+0000","last_active":"2024-09-21T03:14:48.558850+0000","last_peered":"2024-09-21T03:14:48.558850+0000","last_clean":"2024-09-21T03:14:48.558850+0000","last_became_active":"2024-09-21T03:14:37.479284+0000","last_became_peered":"2024-09-21T03:14:37.479284+0000","last_unstale":"2024-09-21T03:14:48.558850+0000","last_undegraded":"2024-09-21T03:14:48.558850+0000","last_fullsized":"2024-09-21T03:14:48.558850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:15.732230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677624+0000","last_change":"2024-09-21T03:14:46.531536+0000","last_active":"2024-09-21T03:15:15.677624+0000","last_peered":"2024-09-21T03:15:15.677624+0000","last_clean":"2024-09-21T03:15:15.677624+0000","last_became_active":"2024-09-21T03:14:46.531069+0000","last_became_peered":"2024-09-21T03:14:46.531069+0000","last_unstale":"2024-09-21T03:15:15.677624+0000","last_undegraded":"2024-09-21T03:15:15.677624+0000","last_fullsized":"2024-09-21T03:15:15.677624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:14.050618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557238+0000","last_change":"2024-09-21T03:14:47.553039+0000","last_active":"2024-09-21T03:14:48.557238+0000","last_peered":"2024-09-21T03:14:48.557238+0000","last_clean":"2024-09-21T03:14:48.557238+0000","last_became_active":"2024-09-21T03:14:47.552712+0000","last_became_peered":"2024-09-21T03:14:47.552712+0000","last_unstale":"2024-09-21T03:14:48.557238+0000","last_undegraded":"2024-09-21T03:14:48.557238+0000","last_fullsized":"2024-09-21T03:14:48.557238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:32.630319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681782+0000","last_change":"2024-09-21T03:14:38.488259+0000","last_active":"2024-09-21T03:15:15.681782+0000","last_peered":"2024-09-21T03:15:15.681782+0000","last_clean":"2024-09-21T03:15:15.681782+0000","last_became_active":"2024-09-21T03:14:38.487420+0000","last_became_peered":"2024-09-21T03:14:38.487420+0000","last_unstale":"2024-09-21T03:15:15.681782+0000","last_undegraded":"2024-09-21T03:15:15.681782+0000","last_fullsized":"2024-09-21T03:15:15.681782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:48.003893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681753+0000","last_change":"2024-09-21T03:14:37.460763+0000","last_active":"2024-09-21T03:15:15.681753+0000","last_peered":"2024-09-21T03:15:15.681753+0000","last_clean":"2024-09-21T03:15:15.681753+0000","last_became_active":"2024-09-21T03:14:37.460320+0000","last_became_peered":"2024-09-21T03:14:37.460320+0000","last_unstale":"2024-09-21T03:15:15.681753+0000","last_undegraded":"2024-09-21T03:15:15.681753+0000","last_fullsized":"2024-09-21T03:15:15.681753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.907794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681101+0000","last_change":"2024-09-21T03:14:46.540901+0000","last_active":"2024-09-21T03:15:15.681101+0000","last_peered":"2024-09-21T03:15:15.681101+0000","last_clean":"2024-09-21T03:15:15.681101+0000","last_became_active":"2024-09-21T03:14:46.540182+0000","last_became_peered":"2024-09-21T03:14:46.540182+0000","last_unstale":"2024-09-21T03:15:15.681101+0000","last_undegraded":"2024-09-21T03:15:15.681101+0000","last_fullsized":"2024-09-21T03:15:15.681101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:38.416663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804362+0000","last_change":"2024-09-21T03:14:47.553810+0000","last_active":"2024-09-21T03:15:15.804362+0000","last_peered":"2024-09-21T03:15:15.804362+0000","last_clean":"2024-09-21T03:15:15.804362+0000","last_became_active":"2024-09-21T03:14:47.552371+0000","last_became_peered":"2024-09-21T03:14:47.552371+0000","last_unstale":"2024-09-21T03:15:15.804362+0000","last_undegraded":"2024-09-21T03:15:15.804362+0000","last_fullsized":"2024-09-21T03:15:15.804362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:38.659512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681305+0000","last_change":"2024-09-21T03:14:38.480629+0000","last_active":"2024-09-21T03:15:15.681305+0000","last_peered":"2024-09-21T03:15:15.681305+0000","last_clean":"2024-09-21T03:15:15.681305+0000","last_became_active":"2024-09-21T03:14:38.474135+0000","last_became_peered":"2024-09-21T03:14:38.474135+0000","last_unstale":"2024-09-21T03:15:15.681305+0000","last_undegraded":"2024-09-21T03:15:15.681305+0000","last_fullsized":"2024-09-21T03:15:15.681305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:36.171044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806268+0000","last_change":"2024-09-21T03:14:37.472491+0000","last_active":"2024-09-21T03:15:15.806268+0000","last_peered":"2024-09-21T03:15:15.806268+0000","last_clean":"2024-09-21T03:15:15.806268+0000","last_became_active":"2024-09-21T03:14:37.472164+0000","last_became_peered":"2024-09-21T03:14:37.472164+0000","last_unstale":"2024-09-21T03:15:15.806268+0000","last_undegraded":"2024-09-21T03:15:15.806268+0000","last_fullsized":"2024-09-21T03:15:15.806268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.498178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681720+0000","last_change":"2024-09-21T03:14:46.544828+0000","last_active":"2024-09-21T03:15:14.681720+0000","last_peered":"2024-09-21T03:15:14.681720+0000","last_clean":"2024-09-21T03:15:14.681720+0000","last_became_active":"2024-09-21T03:14:46.535901+0000","last_became_peered":"2024-09-21T03:14:46.535901+0000","last_unstale":"2024-09-21T03:15:14.681720+0000","last_undegraded":"2024-09-21T03:15:14.681720+0000","last_fullsized":"2024-09-21T03:15:14.681720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:08.608530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557424+0000","last_change":"2024-09-21T03:14:47.556478+0000","last_active":"2024-09-21T03:14:48.557424+0000","last_peered":"2024-09-21T03:14:48.557424+0000","last_clean":"2024-09-21T03:14:48.557424+0000","last_became_active":"2024-09-21T03:14:47.556145+0000","last_became_peered":"2024-09-21T03:14:47.556145+0000","last_unstale":"2024-09-21T03:14:48.557424+0000","last_undegraded":"2024-09-21T03:14:48.557424+0000","last_fullsized":"2024-09-21T03:14:48.557424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:59.004648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678670+0000","last_change":"2024-09-21T03:14:38.469502+0000","last_active":"2024-09-21T03:15:15.678670+0000","last_peered":"2024-09-21T03:15:15.678670+0000","last_clean":"2024-09-21T03:15:15.678670+0000","last_became_active":"2024-09-21T03:14:38.468972+0000","last_became_peered":"2024-09-21T03:14:38.468972+0000","last_unstale":"2024-09-21T03:15:15.678670+0000","last_undegraded":"2024-09-21T03:15:15.678670+0000","last_fullsized":"2024-09-21T03:15:15.678670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681340+0000","last_change":"2024-09-21T03:14:37.480905+0000","last_active":"2024-09-21T03:15:15.681340+0000","last_peered":"2024-09-21T03:15:15.681340+0000","last_clean":"2024-09-21T03:15:15.681340+0000","last_became_active":"2024-09-21T03:14:37.478227+0000","last_became_peered":"2024-09-21T03:14:37.478227+0000","last_unstale":"2024-09-21T03:15:15.681340+0000","last_undegraded":"2024-09-21T03:15:15.681340+0000","last_fullsized":"2024-09-21T03:15:15.681340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:42.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804534+0000","last_change":"2024-09-21T03:14:46.536103+0000","last_active":"2024-09-21T03:15:15.804534+0000","last_peered":"2024-09-21T03:15:15.804534+0000","last_clean":"2024-09-21T03:15:15.804534+0000","last_became_active":"2024-09-21T03:14:46.535445+0000","last_became_peered":"2024-09-21T03:14:46.535445+0000","last_unstale":"2024-09-21T03:15:15.804534+0000","last_undegraded":"2024-09-21T03:15:15.804534+0000","last_fullsized":"2024-09-21T03:15:15.804534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:59.078000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806222+0000","last_change":"2024-09-21T03:14:47.557503+0000","last_active":"2024-09-21T03:15:15.806222+0000","last_peered":"2024-09-21T03:15:15.806222+0000","last_clean":"2024-09-21T03:15:15.806222+0000","last_became_active":"2024-09-21T03:14:47.554366+0000","last_became_peered":"2024-09-21T03:14:47.554366+0000","last_unstale":"2024-09-21T03:15:15.806222+0000","last_undegraded":"2024-09-21T03:15:15.806222+0000","last_fullsized":"2024-09-21T03:15:15.806222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.994560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682222+0000","last_change":"2024-09-21T03:14:38.479516+0000","last_active":"2024-09-21T03:15:14.682222+0000","last_peered":"2024-09-21T03:15:14.682222+0000","last_clean":"2024-09-21T03:15:14.682222+0000","last_became_active":"2024-09-21T03:14:38.474826+0000","last_became_peered":"2024-09-21T03:14:38.474826+0000","last_unstale":"2024-09-21T03:15:14.682222+0000","last_undegraded":"2024-09-21T03:15:14.682222+0000","last_fullsized":"2024-09-21T03:15:14.682222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:22.181411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805649+0000","last_change":"2024-09-21T03:14:37.471063+0000","last_active":"2024-09-21T03:15:15.805649+0000","last_peered":"2024-09-21T03:15:15.805649+0000","last_clean":"2024-09-21T03:15:15.805649+0000","last_became_active":"2024-09-21T03:14:37.470720+0000","last_became_peered":"2024-09-21T03:14:37.470720+0000","last_unstale":"2024-09-21T03:15:15.805649+0000","last_undegraded":"2024-09-21T03:15:15.805649+0000","last_fullsized":"2024-09-21T03:15:15.805649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:00.054692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679915+0000","last_change":"2024-09-21T03:14:46.538665+0000","last_active":"2024-09-21T03:15:15.679915+0000","last_peered":"2024-09-21T03:15:15.679915+0000","last_clean":"2024-09-21T03:15:15.679915+0000","last_became_active":"2024-09-21T03:14:46.537774+0000","last_became_peered":"2024-09-21T03:14:46.537774+0000","last_unstale":"2024-09-21T03:15:15.679915+0000","last_undegraded":"2024-09-21T03:15:15.679915+0000","last_fullsized":"2024-09-21T03:15:15.679915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:07.736404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.686200+0000","last_change":"2024-09-21T03:14:47.553011+0000","last_active":"2024-09-21T03:15:14.686200+0000","last_peered":"2024-09-21T03:15:14.686200+0000","last_clean":"2024-09-21T03:15:14.686200+0000","last_became_active":"2024-09-21T03:14:47.552700+0000","last_became_peered":"2024-09-21T03:14:47.552700+0000","last_unstale":"2024-09-21T03:15:14.686200+0000","last_undegraded":"2024-09-21T03:15:14.686200+0000","last_fullsized":"2024-09-21T03:15:14.686200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:58.780132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804436+0000","last_change":"2024-09-21T03:14:38.472906+0000","last_active":"2024-09-21T03:15:15.804436+0000","last_peered":"2024-09-21T03:15:15.804436+0000","last_clean":"2024-09-21T03:15:15.804436+0000","last_became_active":"2024-09-21T03:14:38.471933+0000","last_became_peered":"2024-09-21T03:14:38.471933+0000","last_unstale":"2024-09-21T03:15:15.804436+0000","last_undegraded":"2024-09-21T03:15:15.804436+0000","last_fullsized":"2024-09-21T03:15:15.804436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:05.395821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680585+0000","last_change":"2024-09-21T03:14:37.478714+0000","last_active":"2024-09-21T03:15:15.680585+0000","last_peered":"2024-09-21T03:15:15.680585+0000","last_clean":"2024-09-21T03:15:15.680585+0000","last_became_active":"2024-09-21T03:14:37.477951+0000","last_became_peered":"2024-09-21T03:14:37.477951+0000","last_unstale":"2024-09-21T03:15:15.680585+0000","last_undegraded":"2024-09-21T03:15:15.680585+0000","last_fullsized":"2024-09-21T03:15:15.680585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:42.529545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680921+0000","last_change":"2024-09-21T03:14:46.546142+0000","last_active":"2024-09-21T03:15:15.680921+0000","last_peered":"2024-09-21T03:15:15.680921+0000","last_clean":"2024-09-21T03:15:15.680921+0000","last_became_active":"2024-09-21T03:14:46.545865+0000","last_became_peered":"2024-09-21T03:14:46.545865+0000","last_unstale":"2024-09-21T03:15:15.680921+0000","last_undegraded":"2024-09-21T03:15:15.680921+0000","last_fullsized":"2024-09-21T03:15:15.680921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:11.705309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684250+0000","last_change":"2024-09-21T03:14:47.568961+0000","last_active":"2024-09-21T03:15:14.684250+0000","last_peered":"2024-09-21T03:15:14.684250+0000","last_clean":"2024-09-21T03:15:14.684250+0000","last_became_active":"2024-09-21T03:14:47.568656+0000","last_became_peered":"2024-09-21T03:14:47.568656+0000","last_unstale":"2024-09-21T03:15:14.684250+0000","last_undegraded":"2024-09-21T03:15:14.684250+0000","last_fullsized":"2024-09-21T03:15:14.684250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.041710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.683102+0000","last_change":"2024-09-21T03:14:38.485454+0000","last_active":"2024-09-21T03:15:14.683102+0000","last_peered":"2024-09-21T03:15:14.683102+0000","last_clean":"2024-09-21T03:15:14.683102+0000","last_became_active":"2024-09-21T03:14:38.485235+0000","last_became_peered":"2024-09-21T03:14:38.485235+0000","last_unstale":"2024-09-21T03:15:14.683102+0000","last_undegraded":"2024-09-21T03:15:14.683102+0000","last_fullsized":"2024-09-21T03:15:14.683102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:11.585637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682605+0000","last_change":"2024-09-21T03:14:37.466544+0000","last_active":"2024-09-21T03:15:14.682605+0000","last_peered":"2024-09-21T03:15:14.682605+0000","last_clean":"2024-09-21T03:15:14.682605+0000","last_became_active":"2024-09-21T03:14:37.465817+0000","last_became_peered":"2024-09-21T03:14:37.465817+0000","last_unstale":"2024-09-21T03:15:14.682605+0000","last_undegraded":"2024-09-21T03:15:14.682605+0000","last_fullsized":"2024-09-21T03:15:14.682605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:36.113483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:15:11.442899+0000","last_change":"2024-09-21T03:14:46.549921+0000","last_active":"2024-09-21T03:15:11.442899+0000","last_peered":"2024-09-21T03:15:11.442899+0000","last_clean":"2024-09-21T03:15:11.442899+0000","last_became_active":"2024-09-21T03:14:46.549119+0000","last_became_peered":"2024-09-21T03:14:46.549119+0000","last_unstale":"2024-09-21T03:15:11.442899+0000","last_undegraded":"2024-09-21T03:15:11.442899+0000","last_fullsized":"2024-09-21T03:15:11.442899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:09.622498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2858,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.691871+0000","last_change":"2024-09-21T03:15:15.687659+0000","last_active":"2024-09-21T03:15:15.691871+0000","last_peered":"2024-09-21T03:15:15.691871+0000","last_clean":"2024-09-21T03:15:15.691871+0000","last_became_active":"2024-09-21T03:15:15.687225+0000","last_became_peered":"2024-09-21T03:15:15.687225+0000","last_unstale":"2024-09-21T03:15:15.691871+0000","last_undegraded":"2024-09-21T03:15:15.691871+0000","last_fullsized":"2024-09-21T03:15:15.691871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:56.395767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557891+0000","last_change":"2024-09-21T03:14:38.482528+0000","last_active":"2024-09-21T03:14:48.557891+0000","last_peered":"2024-09-21T03:14:48.557891+0000","last_clean":"2024-09-21T03:14:48.557891+0000","last_became_active":"2024-09-21T03:14:38.482241+0000","last_became_peered":"2024-09-21T03:14:38.482241+0000","last_unstale":"2024-09-21T03:14:48.557891+0000","last_undegraded":"2024-09-21T03:14:48.557891+0000","last_fullsized":"2024-09-21T03:14:48.557891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:23.110703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684414+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:15:15.684414+0000","last_peered":"2024-09-21T03:15:15.684414+0000","last_clean":"2024-09-21T03:15:15.684414+0000","last_became_active":"2024-09-21T03:14:37.478882+0000","last_became_peered":"2024-09-21T03:14:37.478882+0000","last_unstale":"2024-09-21T03:15:15.684414+0000","last_undegraded":"2024-09-21T03:15:15.684414+0000","last_fullsized":"2024-09-21T03:15:15.684414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:11.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684629+0000","last_change":"2024-09-21T03:14:46.538817+0000","last_active":"2024-09-21T03:15:14.684629+0000","last_peered":"2024-09-21T03:15:14.684629+0000","last_clean":"2024-09-21T03:15:14.684629+0000","last_became_active":"2024-09-21T03:14:46.537835+0000","last_became_peered":"2024-09-21T03:14:46.537835+0000","last_unstale":"2024-09-21T03:15:14.684629+0000","last_undegraded":"2024-09-21T03:15:14.684629+0000","last_fullsized":"2024-09-21T03:15:14.684629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:08.236663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805566+0000","last_change":"2024-09-21T03:14:47.566534+0000","last_active":"2024-09-21T03:15:15.805566+0000","last_peered":"2024-09-21T03:15:15.805566+0000","last_clean":"2024-09-21T03:15:15.805566+0000","last_became_active":"2024-09-21T03:14:47.566157+0000","last_became_peered":"2024-09-21T03:14:47.566157+0000","last_unstale":"2024-09-21T03:15:15.805566+0000","last_undegraded":"2024-09-21T03:15:15.805566+0000","last_fullsized":"2024-09-21T03:15:15.805566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:35.557811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681246+0000","last_change":"2024-09-21T03:14:38.478509+0000","last_active":"2024-09-21T03:15:15.681246+0000","last_peered":"2024-09-21T03:15:15.681246+0000","last_clean":"2024-09-21T03:15:15.681246+0000","last_became_active":"2024-09-21T03:14:38.478197+0000","last_became_peered":"2024-09-21T03:14:38.478197+0000","last_unstale":"2024-09-21T03:15:15.681246+0000","last_undegraded":"2024-09-21T03:15:15.681246+0000","last_fullsized":"2024-09-21T03:15:15.681246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.411134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677857+0000","last_change":"2024-09-21T03:14:37.472695+0000","last_active":"2024-09-21T03:15:15.677857+0000","last_peered":"2024-09-21T03:15:15.677857+0000","last_clean":"2024-09-21T03:15:15.677857+0000","last_became_active":"2024-09-21T03:14:37.472374+0000","last_became_peered":"2024-09-21T03:14:37.472374+0000","last_unstale":"2024-09-21T03:15:15.677857+0000","last_undegraded":"2024-09-21T03:15:15.677857+0000","last_fullsized":"2024-09-21T03:15:15.677857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:11.245914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2858,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805279+0000","last_change":"2024-09-21T03:14:46.547433+0000","last_active":"2024-09-21T03:15:15.805279+0000","last_peered":"2024-09-21T03:15:15.805279+0000","last_clean":"2024-09-21T03:15:15.805279+0000","last_became_active":"2024-09-21T03:14:46.547192+0000","last_became_peered":"2024-09-21T03:14:46.547192+0000","last_unstale":"2024-09-21T03:15:15.805279+0000","last_undegraded":"2024-09-21T03:15:15.805279+0000","last_fullsized":"2024-09-21T03:15:15.805279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:03.238245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557599+0000","last_change":"2024-09-21T03:14:47.545827+0000","last_active":"2024-09-21T03:14:48.557599+0000","last_peered":"2024-09-21T03:14:48.557599+0000","last_clean":"2024-09-21T03:14:48.557599+0000","last_became_active":"2024-09-21T03:14:47.545440+0000","last_became_peered":"2024-09-21T03:14:47.545440+0000","last_unstale":"2024-09-21T03:14:48.557599+0000","last_undegraded":"2024-09-21T03:14:48.557599+0000","last_fullsized":"2024-09-21T03:14:48.557599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:20.532645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684125+0000","last_change":"2024-09-21T03:14:38.476564+0000","last_active":"2024-09-21T03:15:14.684125+0000","last_peered":"2024-09-21T03:15:14.684125+0000","last_clean":"2024-09-21T03:15:14.684125+0000","last_became_active":"2024-09-21T03:14:38.476158+0000","last_became_peered":"2024-09-21T03:14:38.476158+0000","last_unstale":"2024-09-21T03:15:14.684125+0000","last_undegraded":"2024-09-21T03:15:14.684125+0000","last_fullsized":"2024-09-21T03:15:14.684125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:26.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684904+0000","last_change":"2024-09-21T03:14:37.473709+0000","last_active":"2024-09-21T03:15:15.684904+0000","last_peered":"2024-09-21T03:15:15.684904+0000","last_clean":"2024-09-21T03:15:15.684904+0000","last_became_active":"2024-09-21T03:14:37.472544+0000","last_became_peered":"2024-09-21T03:14:37.472544+0000","last_unstale":"2024-09-21T03:15:15.684904+0000","last_undegraded":"2024-09-21T03:15:15.684904+0000","last_fullsized":"2024-09-21T03:15:15.684904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:47.892146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677701+0000","last_change":"2024-09-21T03:14:46.534201+0000","last_active":"2024-09-21T03:15:15.677701+0000","last_peered":"2024-09-21T03:15:15.677701+0000","last_clean":"2024-09-21T03:15:15.677701+0000","last_became_active":"2024-09-21T03:14:46.533891+0000","last_became_peered":"2024-09-21T03:14:46.533891+0000","last_unstale":"2024-09-21T03:15:15.677701+0000","last_undegraded":"2024-09-21T03:15:15.677701+0000","last_fullsized":"2024-09-21T03:15:15.677701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:06.645173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681643+0000","last_change":"2024-09-21T03:14:47.552016+0000","last_active":"2024-09-21T03:15:14.681643+0000","last_peered":"2024-09-21T03:15:14.681643+0000","last_clean":"2024-09-21T03:15:14.681643+0000","last_became_active":"2024-09-21T03:14:47.551622+0000","last_became_peered":"2024-09-21T03:14:47.551622+0000","last_unstale":"2024-09-21T03:15:14.681643+0000","last_undegraded":"2024-09-21T03:15:14.681643+0000","last_fullsized":"2024-09-21T03:15:14.681643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:56:04.849535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681489+0000","last_change":"2024-09-21T03:14:38.484757+0000","last_active":"2024-09-21T03:15:15.681489+0000","last_peered":"2024-09-21T03:15:15.681489+0000","last_clean":"2024-09-21T03:15:15.681489+0000","last_became_active":"2024-09-21T03:14:38.483348+0000","last_became_peered":"2024-09-21T03:14:38.483348+0000","last_unstale":"2024-09-21T03:15:15.681489+0000","last_undegraded":"2024-09-21T03:15:15.681489+0000","last_fullsized":"2024-09-21T03:15:15.681489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:57.697723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681239+0000","last_change":"2024-09-21T03:14:37.479047+0000","last_active":"2024-09-21T03:15:15.681239+0000","last_peered":"2024-09-21T03:15:15.681239+0000","last_clean":"2024-09-21T03:15:15.681239+0000","last_became_active":"2024-09-21T03:14:37.478700+0000","last_became_peered":"2024-09-21T03:14:37.478700+0000","last_unstale":"2024-09-21T03:15:15.681239+0000","last_undegraded":"2024-09-21T03:15:15.681239+0000","last_fullsized":"2024-09-21T03:15:15.681239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:31.702450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.682880+0000","last_change":"2024-09-21T03:14:46.547287+0000","last_active":"2024-09-21T03:15:15.682880+0000","last_peered":"2024-09-21T03:15:15.682880+0000","last_clean":"2024-09-21T03:15:15.682880+0000","last_became_active":"2024-09-21T03:14:46.546867+0000","last_became_peered":"2024-09-21T03:14:46.546867+0000","last_unstale":"2024-09-21T03:15:15.682880+0000","last_undegraded":"2024-09-21T03:15:15.682880+0000","last_fullsized":"2024-09-21T03:15:15.682880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:54.119841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677259+0000","last_change":"2024-09-21T03:14:47.558571+0000","last_active":"2024-09-21T03:15:15.677259+0000","last_peered":"2024-09-21T03:15:15.677259+0000","last_clean":"2024-09-21T03:15:15.677259+0000","last_became_active":"2024-09-21T03:14:47.558037+0000","last_became_peered":"2024-09-21T03:14:47.558037+0000","last_unstale":"2024-09-21T03:15:15.677259+0000","last_undegraded":"2024-09-21T03:15:15.677259+0000","last_fullsized":"2024-09-21T03:15:15.677259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:42.564181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678774+0000","last_change":"2024-09-21T03:14:38.488227+0000","last_active":"2024-09-21T03:15:15.678774+0000","last_peered":"2024-09-21T03:15:15.678774+0000","last_clean":"2024-09-21T03:15:15.678774+0000","last_became_active":"2024-09-21T03:14:38.482370+0000","last_became_peered":"2024-09-21T03:14:38.482370+0000","last_unstale":"2024-09-21T03:15:15.678774+0000","last_undegraded":"2024-09-21T03:15:15.678774+0000","last_fullsized":"2024-09-21T03:15:15.678774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:52.561391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805382+0000","last_change":"2024-09-21T03:14:37.471363+0000","last_active":"2024-09-21T03:15:15.805382+0000","last_peered":"2024-09-21T03:15:15.805382+0000","last_clean":"2024-09-21T03:15:15.805382+0000","last_became_active":"2024-09-21T03:14:37.471002+0000","last_became_peered":"2024-09-21T03:14:37.471002+0000","last_unstale":"2024-09-21T03:15:15.805382+0000","last_undegraded":"2024-09-21T03:15:15.805382+0000","last_fullsized":"2024-09-21T03:15:15.805382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:25.922368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805008+0000","last_change":"2024-09-21T03:14:46.545186+0000","last_active":"2024-09-21T03:15:15.805008+0000","last_peered":"2024-09-21T03:15:15.805008+0000","last_clean":"2024-09-21T03:15:15.805008+0000","last_became_active":"2024-09-21T03:14:46.543647+0000","last_became_peered":"2024-09-21T03:14:46.543647+0000","last_unstale":"2024-09-21T03:15:15.805008+0000","last_undegraded":"2024-09-21T03:15:15.805008+0000","last_fullsized":"2024-09-21T03:15:15.805008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:03.097368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678464+0000","last_change":"2024-09-21T03:14:47.554766+0000","last_active":"2024-09-21T03:15:15.678464+0000","last_peered":"2024-09-21T03:15:15.678464+0000","last_clean":"2024-09-21T03:15:15.678464+0000","last_became_active":"2024-09-21T03:14:47.551563+0000","last_became_peered":"2024-09-21T03:14:47.551563+0000","last_unstale":"2024-09-21T03:15:15.678464+0000","last_undegraded":"2024-09-21T03:15:15.678464+0000","last_fullsized":"2024-09-21T03:15:15.678464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:08.790725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805982+0000","last_change":"2024-09-21T03:14:46.542659+0000","last_active":"2024-09-21T03:15:15.805982+0000","last_peered":"2024-09-21T03:15:15.805982+0000","last_clean":"2024-09-21T03:15:15.805982+0000","last_became_active":"2024-09-21T03:14:46.541771+0000","last_became_peered":"2024-09-21T03:14:46.541771+0000","last_unstale":"2024-09-21T03:15:15.805982+0000","last_undegraded":"2024-09-21T03:15:15.805982+0000","last_fullsized":"2024-09-21T03:15:15.805982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:45.543904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805168+0000","last_change":"2024-09-21T03:14:38.481837+0000","last_active":"2024-09-21T03:15:15.805168+0000","last_peered":"2024-09-21T03:15:15.805168+0000","last_clean":"2024-09-21T03:15:15.805168+0000","last_became_active":"2024-09-21T03:14:38.478400+0000","last_became_peered":"2024-09-21T03:14:38.478400+0000","last_unstale":"2024-09-21T03:15:15.805168+0000","last_undegraded":"2024-09-21T03:15:15.805168+0000","last_fullsized":"2024-09-21T03:15:15.805168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.702185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681897+0000","last_change":"2024-09-21T03:14:37.459351+0000","last_active":"2024-09-21T03:15:14.681897+0000","last_peered":"2024-09-21T03:15:14.681897+0000","last_clean":"2024-09-21T03:15:14.681897+0000","last_became_active":"2024-09-21T03:14:37.458676+0000","last_became_peered":"2024-09-21T03:14:37.458676+0000","last_unstale":"2024-09-21T03:15:14.681897+0000","last_undegraded":"2024-09-21T03:15:14.681897+0000","last_fullsized":"2024-09-21T03:15:14.681897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:42.671520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558462+0000","last_change":"2024-09-21T03:14:47.561232+0000","last_active":"2024-09-21T03:14:48.558462+0000","last_peered":"2024-09-21T03:14:48.558462+0000","last_clean":"2024-09-21T03:14:48.558462+0000","last_became_active":"2024-09-21T03:14:47.557224+0000","last_became_peered":"2024-09-21T03:14:47.557224+0000","last_unstale":"2024-09-21T03:14:48.558462+0000","last_undegraded":"2024-09-21T03:14:48.558462+0000","last_fullsized":"2024-09-21T03:14:48.558462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:09.611235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.686753+0000","last_change":"2024-09-21T03:14:46.543157+0000","last_active":"2024-09-21T03:15:14.686753+0000","last_peered":"2024-09-21T03:15:14.686753+0000","last_clean":"2024-09-21T03:15:14.686753+0000","last_became_active":"2024-09-21T03:14:46.542746+0000","last_became_peered":"2024-09-21T03:14:46.542746+0000","last_unstale":"2024-09-21T03:15:14.686753+0000","last_undegraded":"2024-09-21T03:15:14.686753+0000","last_fullsized":"2024-09-21T03:15:14.686753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:30.644843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679102+0000","last_change":"2024-09-21T03:14:38.480723+0000","last_active":"2024-09-21T03:15:15.679102+0000","last_peered":"2024-09-21T03:15:15.679102+0000","last_clean":"2024-09-21T03:15:15.679102+0000","last_became_active":"2024-09-21T03:14:38.472823+0000","last_became_peered":"2024-09-21T03:14:38.472823+0000","last_unstale":"2024-09-21T03:15:15.679102+0000","last_undegraded":"2024-09-21T03:15:15.679102+0000","last_fullsized":"2024-09-21T03:15:15.679102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:59.862592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557827+0000","last_change":"2024-09-21T03:14:37.472209+0000","last_active":"2024-09-21T03:14:48.557827+0000","last_peered":"2024-09-21T03:14:48.557827+0000","last_clean":"2024-09-21T03:14:48.557827+0000","last_became_active":"2024-09-21T03:14:37.471771+0000","last_became_peered":"2024-09-21T03:14:37.471771+0000","last_unstale":"2024-09-21T03:14:48.557827+0000","last_undegraded":"2024-09-21T03:14:48.557827+0000","last_fullsized":"2024-09-21T03:14:48.557827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:30.648010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805722+0000","last_change":"2024-09-21T03:14:47.570651+0000","last_active":"2024-09-21T03:15:15.805722+0000","last_peered":"2024-09-21T03:15:15.805722+0000","last_clean":"2024-09-21T03:15:15.805722+0000","last_became_active":"2024-09-21T03:14:47.568081+0000","last_became_peered":"2024-09-21T03:14:47.568081+0000","last_unstale":"2024-09-21T03:15:15.805722+0000","last_undegraded":"2024-09-21T03:15:15.805722+0000","last_fullsized":"2024-09-21T03:15:15.805722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:45.036938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682502+0000","last_change":"2024-09-21T03:14:37.475076+0000","last_active":"2024-09-21T03:15:14.682502+0000","last_peered":"2024-09-21T03:15:14.682502+0000","last_clean":"2024-09-21T03:15:14.682502+0000","last_became_active":"2024-09-21T03:14:37.474595+0000","last_became_peered":"2024-09-21T03:14:37.474595+0000","last_unstale":"2024-09-21T03:15:14.682502+0000","last_undegraded":"2024-09-21T03:15:14.682502+0000","last_fullsized":"2024-09-21T03:15:14.682502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:16.880647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805997+0000","last_change":"2024-09-21T03:14:38.483226+0000","last_active":"2024-09-21T03:15:15.805997+0000","last_peered":"2024-09-21T03:15:15.805997+0000","last_clean":"2024-09-21T03:15:15.805997+0000","last_became_active":"2024-09-21T03:14:38.482354+0000","last_became_peered":"2024-09-21T03:14:38.482354+0000","last_unstale":"2024-09-21T03:15:15.805997+0000","last_undegraded":"2024-09-21T03:15:15.805997+0000","last_fullsized":"2024-09-21T03:15:15.805997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:51.488594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805767+0000","last_change":"2024-09-21T03:14:46.551282+0000","last_active":"2024-09-21T03:15:15.805767+0000","last_peered":"2024-09-21T03:15:15.805767+0000","last_clean":"2024-09-21T03:15:15.805767+0000","last_became_active":"2024-09-21T03:14:46.550191+0000","last_became_peered":"2024-09-21T03:14:46.550191+0000","last_unstale":"2024-09-21T03:15:15.805767+0000","last_undegraded":"2024-09-21T03:15:15.805767+0000","last_fullsized":"2024-09-21T03:15:15.805767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:32.136739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.686630+0000","last_change":"2024-09-21T03:15:15.686522+0000","last_active":"2024-09-21T03:15:15.686630+0000","last_peered":"2024-09-21T03:15:15.686630+0000","last_clean":"2024-09-21T03:15:15.686630+0000","last_became_active":"2024-09-21T03:15:15.686063+0000","last_became_peered":"2024-09-21T03:15:15.686063+0000","last_unstale":"2024-09-21T03:15:15.686630+0000","last_undegraded":"2024-09-21T03:15:15.686630+0000","last_fullsized":"2024-09-21T03:15:15.686630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:57.750372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681320+0000","last_change":"2024-09-21T03:14:37.465536+0000","last_active":"2024-09-21T03:15:15.681320+0000","last_peered":"2024-09-21T03:15:15.681320+0000","last_clean":"2024-09-21T03:15:15.681320+0000","last_became_active":"2024-09-21T03:14:37.465240+0000","last_became_peered":"2024-09-21T03:14:37.465240+0000","last_unstale":"2024-09-21T03:15:15.681320+0000","last_undegraded":"2024-09-21T03:15:15.681320+0000","last_fullsized":"2024-09-21T03:15:15.681320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:34.780298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804722+0000","last_change":"2024-09-21T03:14:38.474516+0000","last_active":"2024-09-21T03:15:15.804722+0000","last_peered":"2024-09-21T03:15:15.804722+0000","last_clean":"2024-09-21T03:15:15.804722+0000","last_became_active":"2024-09-21T03:14:38.472225+0000","last_became_peered":"2024-09-21T03:14:38.472225+0000","last_unstale":"2024-09-21T03:15:15.804722+0000","last_undegraded":"2024-09-21T03:15:15.804722+0000","last_fullsized":"2024-09-21T03:15:15.804722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:47.504910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684801+0000","last_change":"2024-09-21T03:14:46.544072+0000","last_active":"2024-09-21T03:15:15.684801+0000","last_peered":"2024-09-21T03:15:15.684801+0000","last_clean":"2024-09-21T03:15:15.684801+0000","last_became_active":"2024-09-21T03:14:46.543729+0000","last_became_peered":"2024-09-21T03:14:46.543729+0000","last_unstale":"2024-09-21T03:15:15.684801+0000","last_undegraded":"2024-09-21T03:15:15.684801+0000","last_fullsized":"2024-09-21T03:15:15.684801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:18.560012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805979+0000","last_change":"2024-09-21T03:14:47.563764+0000","last_active":"2024-09-21T03:15:15.805979+0000","last_peered":"2024-09-21T03:15:15.805979+0000","last_clean":"2024-09-21T03:15:15.805979+0000","last_became_active":"2024-09-21T03:14:47.562943+0000","last_became_peered":"2024-09-21T03:14:47.562943+0000","last_unstale":"2024-09-21T03:15:15.805979+0000","last_undegraded":"2024-09-21T03:15:15.805979+0000","last_fullsized":"2024-09-21T03:15:15.805979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:39.284350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678175+0000","last_change":"2024-09-21T03:14:38.484311+0000","last_active":"2024-09-21T03:15:15.678175+0000","last_peered":"2024-09-21T03:15:15.678175+0000","last_clean":"2024-09-21T03:15:15.678175+0000","last_became_active":"2024-09-21T03:14:38.483975+0000","last_became_peered":"2024-09-21T03:14:38.483975+0000","last_unstale":"2024-09-21T03:15:15.678175+0000","last_undegraded":"2024-09-21T03:15:15.678175+0000","last_fullsized":"2024-09-21T03:15:15.678175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:31.145431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806372+0000","last_change":"2024-09-21T03:14:47.566252+0000","last_active":"2024-09-21T03:15:15.806372+0000","last_peered":"2024-09-21T03:15:15.806372+0000","last_clean":"2024-09-21T03:15:15.806372+0000","last_became_active":"2024-09-21T03:14:47.560282+0000","last_became_peered":"2024-09-21T03:14:47.560282+0000","last_unstale":"2024-09-21T03:15:15.806372+0000","last_undegraded":"2024-09-21T03:15:15.806372+0000","last_fullsized":"2024-09-21T03:15:15.806372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:23.553847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683395+0000","last_change":"2024-09-21T03:14:38.477183+0000","last_active":"2024-09-21T03:15:15.683395+0000","last_peered":"2024-09-21T03:15:15.683395+0000","last_clean":"2024-09-21T03:15:15.683395+0000","last_became_active":"2024-09-21T03:14:38.476657+0000","last_became_peered":"2024-09-21T03:14:38.476657+0000","last_unstale":"2024-09-21T03:15:15.683395+0000","last_undegraded":"2024-09-21T03:15:15.683395+0000","last_fullsized":"2024-09-21T03:15:15.683395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:36.801764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677510+0000","last_change":"2024-09-21T03:14:47.574339+0000","last_active":"2024-09-21T03:15:15.677510+0000","last_peered":"2024-09-21T03:15:15.677510+0000","last_clean":"2024-09-21T03:15:15.677510+0000","last_became_active":"2024-09-21T03:14:47.565732+0000","last_became_peered":"2024-09-21T03:14:47.565732+0000","last_unstale":"2024-09-21T03:15:15.677510+0000","last_undegraded":"2024-09-21T03:15:15.677510+0000","last_fullsized":"2024-09-21T03:15:15.677510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:57.896810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.682397+0000","last_change":"2024-09-21T03:14:38.472860+0000","last_active":"2024-09-21T03:15:14.682397+0000","last_peered":"2024-09-21T03:15:14.682397+0000","last_clean":"2024-09-21T03:15:14.682397+0000","last_became_active":"2024-09-21T03:14:38.472548+0000","last_became_peered":"2024-09-21T03:14:38.472548+0000","last_unstale":"2024-09-21T03:15:14.682397+0000","last_undegraded":"2024-09-21T03:15:14.682397+0000","last_fullsized":"2024-09-21T03:15:14.682397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:16.071692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681588+0000","last_change":"2024-09-21T03:14:47.557402+0000","last_active":"2024-09-21T03:15:15.681588+0000","last_peered":"2024-09-21T03:15:15.681588+0000","last_clean":"2024-09-21T03:15:15.681588+0000","last_became_active":"2024-09-21T03:14:47.557047+0000","last_became_peered":"2024-09-21T03:14:47.557047+0000","last_unstale":"2024-09-21T03:15:15.681588+0000","last_undegraded":"2024-09-21T03:15:15.681588+0000","last_fullsized":"2024-09-21T03:15:15.681588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:29.792514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681269+0000","last_change":"2024-09-21T03:14:38.481039+0000","last_active":"2024-09-21T03:15:15.681269+0000","last_peered":"2024-09-21T03:15:15.681269+0000","last_clean":"2024-09-21T03:15:15.681269+0000","last_became_active":"2024-09-21T03:14:38.480686+0000","last_became_peered":"2024-09-21T03:14:38.480686+0000","last_unstale":"2024-09-21T03:15:15.681269+0000","last_undegraded":"2024-09-21T03:15:15.681269+0000","last_fullsized":"2024-09-21T03:15:15.681269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:18.603386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680603+0000","last_change":"2024-09-21T03:14:47.565697+0000","last_active":"2024-09-21T03:15:15.680603+0000","last_peered":"2024-09-21T03:15:15.680603+0000","last_clean":"2024-09-21T03:15:15.680603+0000","last_became_active":"2024-09-21T03:14:47.565393+0000","last_became_peered":"2024-09-21T03:14:47.565393+0000","last_unstale":"2024-09-21T03:15:15.680603+0000","last_undegraded":"2024-09-21T03:15:15.680603+0000","last_fullsized":"2024-09-21T03:15:15.680603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:35.421803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558553+0000","last_change":"2024-09-21T03:14:38.473900+0000","last_active":"2024-09-21T03:14:48.558553+0000","last_peered":"2024-09-21T03:14:48.558553+0000","last_clean":"2024-09-21T03:14:48.558553+0000","last_became_active":"2024-09-21T03:14:38.471325+0000","last_became_peered":"2024-09-21T03:14:38.471325+0000","last_unstale":"2024-09-21T03:14:48.558553+0000","last_undegraded":"2024-09-21T03:14:48.558553+0000","last_fullsized":"2024-09-21T03:14:48.558553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:47.556293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.685190+0000","last_change":"2024-09-21T03:15:15.685059+0000","last_active":"2024-09-21T03:15:15.685190+0000","last_peered":"2024-09-21T03:15:15.685190+0000","last_clean":"2024-09-21T03:15:15.685190+0000","last_became_active":"2024-09-21T03:15:15.684633+0000","last_became_peered":"2024-09-21T03:15:15.684633+0000","last_unstale":"2024-09-21T03:15:15.685190+0000","last_undegraded":"2024-09-21T03:15:15.685190+0000","last_fullsized":"2024-09-21T03:15:15.685190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:22.251366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557408+0000","last_change":"2024-09-21T03:14:38.478099+0000","last_active":"2024-09-21T03:14:48.557408+0000","last_peered":"2024-09-21T03:14:48.557408+0000","last_clean":"2024-09-21T03:14:48.557408+0000","last_became_active":"2024-09-21T03:14:38.475894+0000","last_became_peered":"2024-09-21T03:14:38.475894+0000","last_unstale":"2024-09-21T03:14:48.557408+0000","last_undegraded":"2024-09-21T03:14:48.557408+0000","last_fullsized":"2024-09-21T03:14:48.557408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:49.876430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681689+0000","last_change":"2024-09-21T03:14:47.556933+0000","last_active":"2024-09-21T03:15:14.681689+0000","last_peered":"2024-09-21T03:15:14.681689+0000","last_clean":"2024-09-21T03:15:14.681689+0000","last_became_active":"2024-09-21T03:14:47.556615+0000","last_became_peered":"2024-09-21T03:14:47.556615+0000","last_unstale":"2024-09-21T03:15:14.681689+0000","last_undegraded":"2024-09-21T03:15:14.681689+0000","last_fullsized":"2024-09-21T03:15:14.681689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:27.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678569+0000","last_change":"2024-09-21T03:14:38.484198+0000","last_active":"2024-09-21T03:15:15.678569+0000","last_peered":"2024-09-21T03:15:15.678569+0000","last_clean":"2024-09-21T03:15:15.678569+0000","last_became_active":"2024-09-21T03:14:38.483893+0000","last_became_peered":"2024-09-21T03:14:38.483893+0000","last_unstale":"2024-09-21T03:15:15.678569+0000","last_undegraded":"2024-09-21T03:15:15.678569+0000","last_fullsized":"2024-09-21T03:15:15.678569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:56.665359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677336+0000","last_change":"2024-09-21T03:14:47.553479+0000","last_active":"2024-09-21T03:15:15.677336+0000","last_peered":"2024-09-21T03:15:15.677336+0000","last_clean":"2024-09-21T03:15:15.677336+0000","last_became_active":"2024-09-21T03:14:47.553144+0000","last_became_peered":"2024-09-21T03:14:47.553144+0000","last_unstale":"2024-09-21T03:15:15.677336+0000","last_undegraded":"2024-09-21T03:15:15.677336+0000","last_fullsized":"2024-09-21T03:15:15.677336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:26.321488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681234+0000","last_change":"2024-09-21T03:14:38.487093+0000","last_active":"2024-09-21T03:15:15.681234+0000","last_peered":"2024-09-21T03:15:15.681234+0000","last_clean":"2024-09-21T03:15:15.681234+0000","last_became_active":"2024-09-21T03:14:38.486204+0000","last_became_peered":"2024-09-21T03:14:38.486204+0000","last_unstale":"2024-09-21T03:15:15.681234+0000","last_undegraded":"2024-09-21T03:15:15.681234+0000","last_fullsized":"2024-09-21T03:15:15.681234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:55.531046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684987+0000","last_change":"2024-09-21T03:14:47.573375+0000","last_active":"2024-09-21T03:15:15.684987+0000","last_peered":"2024-09-21T03:15:15.684987+0000","last_clean":"2024-09-21T03:15:15.684987+0000","last_became_active":"2024-09-21T03:14:47.572717+0000","last_became_peered":"2024-09-21T03:14:47.572717+0000","last_unstale":"2024-09-21T03:15:15.684987+0000","last_undegraded":"2024-09-21T03:15:15.684987+0000","last_fullsized":"2024-09-21T03:15:15.684987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:44.673283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681844+0000","last_change":"2024-09-21T03:14:38.471959+0000","last_active":"2024-09-21T03:15:14.681844+0000","last_peered":"2024-09-21T03:15:14.681844+0000","last_clean":"2024-09-21T03:15:14.681844+0000","last_became_active":"2024-09-21T03:14:38.471625+0000","last_became_peered":"2024-09-21T03:14:38.471625+0000","last_unstale":"2024-09-21T03:15:14.681844+0000","last_undegraded":"2024-09-21T03:15:14.681844+0000","last_fullsized":"2024-09-21T03:15:14.681844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:17.761951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.687099+0000","last_change":"2024-09-21T03:14:47.564597+0000","last_active":"2024-09-21T03:15:14.687099+0000","last_peered":"2024-09-21T03:15:14.687099+0000","last_clean":"2024-09-21T03:15:14.687099+0000","last_became_active":"2024-09-21T03:14:47.563816+0000","last_became_peered":"2024-09-21T03:14:47.563816+0000","last_unstale":"2024-09-21T03:15:14.687099+0000","last_undegraded":"2024-09-21T03:15:14.687099+0000","last_fullsized":"2024-09-21T03:15:14.687099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:33.061271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678841+0000","last_change":"2024-09-21T03:14:38.491888+0000","last_active":"2024-09-21T03:15:15.678841+0000","last_peered":"2024-09-21T03:15:15.678841+0000","last_clean":"2024-09-21T03:15:15.678841+0000","last_became_active":"2024-09-21T03:14:38.491510+0000","last_became_peered":"2024-09-21T03:14:38.491510+0000","last_unstale":"2024-09-21T03:15:15.678841+0000","last_undegraded":"2024-09-21T03:15:15.678841+0000","last_fullsized":"2024-09-21T03:15:15.678841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:26.740304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558275+0000","last_change":"2024-09-21T03:14:47.564310+0000","last_active":"2024-09-21T03:14:48.558275+0000","last_peered":"2024-09-21T03:14:48.558275+0000","last_clean":"2024-09-21T03:14:48.558275+0000","last_became_active":"2024-09-21T03:14:47.564003+0000","last_became_peered":"2024-09-21T03:14:47.564003+0000","last_unstale":"2024-09-21T03:14:48.558275+0000","last_undegraded":"2024-09-21T03:14:48.558275+0000","last_fullsized":"2024-09-21T03:14:48.558275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:45.016321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804618+0000","last_change":"2024-09-21T03:14:38.470991+0000","last_active":"2024-09-21T03:15:15.804618+0000","last_peered":"2024-09-21T03:15:15.804618+0000","last_clean":"2024-09-21T03:15:15.804618+0000","last_became_active":"2024-09-21T03:14:38.470666+0000","last_became_peered":"2024-09-21T03:14:38.470666+0000","last_unstale":"2024-09-21T03:15:15.804618+0000","last_undegraded":"2024-09-21T03:15:15.804618+0000","last_fullsized":"2024-09-21T03:15:15.804618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:25.477992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684492+0000","last_change":"2024-09-21T03:14:47.575212+0000","last_active":"2024-09-21T03:15:15.684492+0000","last_peered":"2024-09-21T03:15:15.684492+0000","last_clean":"2024-09-21T03:15:15.684492+0000","last_became_active":"2024-09-21T03:14:47.574895+0000","last_became_peered":"2024-09-21T03:14:47.574895+0000","last_unstale":"2024-09-21T03:15:15.684492+0000","last_undegraded":"2024-09-21T03:15:15.684492+0000","last_fullsized":"2024-09-21T03:15:15.684492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:04.240949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806008+0000","last_change":"2024-09-21T03:14:38.482681+0000","last_active":"2024-09-21T03:15:15.806008+0000","last_peered":"2024-09-21T03:15:15.806008+0000","last_clean":"2024-09-21T03:15:15.806008+0000","last_became_active":"2024-09-21T03:14:38.477816+0000","last_became_peered":"2024-09-21T03:14:38.477816+0000","last_unstale":"2024-09-21T03:15:15.806008+0000","last_undegraded":"2024-09-21T03:15:15.806008+0000","last_fullsized":"2024-09-21T03:15:15.806008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:18.675641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677394+0000","last_change":"2024-09-21T03:14:47.555329+0000","last_active":"2024-09-21T03:15:15.677394+0000","last_peered":"2024-09-21T03:15:15.677394+0000","last_clean":"2024-09-21T03:15:15.677394+0000","last_became_active":"2024-09-21T03:14:47.555033+0000","last_became_peered":"2024-09-21T03:14:47.555033+0000","last_unstale":"2024-09-21T03:15:15.677394+0000","last_undegraded":"2024-09-21T03:15:15.677394+0000","last_fullsized":"2024-09-21T03:15:15.677394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:49.060834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681613+0000","last_change":"2024-09-21T03:14:38.480638+0000","last_active":"2024-09-21T03:15:15.681613+0000","last_peered":"2024-09-21T03:15:15.681613+0000","last_clean":"2024-09-21T03:15:15.681613+0000","last_became_active":"2024-09-21T03:14:38.477739+0000","last_became_peered":"2024-09-21T03:14:38.477739+0000","last_unstale":"2024-09-21T03:15:15.681613+0000","last_undegraded":"2024-09-21T03:15:15.681613+0000","last_fullsized":"2024-09-21T03:15:15.681613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:35.097761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680739+0000","last_change":"2024-09-21T03:14:47.573659+0000","last_active":"2024-09-21T03:15:15.680739+0000","last_peered":"2024-09-21T03:15:15.680739+0000","last_clean":"2024-09-21T03:15:15.680739+0000","last_became_active":"2024-09-21T03:14:47.572756+0000","last_became_peered":"2024-09-21T03:14:47.572756+0000","last_unstale":"2024-09-21T03:15:15.680739+0000","last_undegraded":"2024-09-21T03:15:15.680739+0000","last_fullsized":"2024-09-21T03:15:15.680739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:21.986681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.685032+0000","last_change":"2024-09-21T03:14:38.478039+0000","last_active":"2024-09-21T03:15:14.685032+0000","last_peered":"2024-09-21T03:15:14.685032+0000","last_clean":"2024-09-21T03:15:14.685032+0000","last_became_active":"2024-09-21T03:14:38.473843+0000","last_became_peered":"2024-09-21T03:14:38.473843+0000","last_unstale":"2024-09-21T03:15:14.685032+0000","last_undegraded":"2024-09-21T03:15:14.685032+0000","last_fullsized":"2024-09-21T03:15:14.685032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:27.072406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677250+0000","last_change":"2024-09-21T03:14:47.555386+0000","last_active":"2024-09-21T03:15:15.677250+0000","last_peered":"2024-09-21T03:15:15.677250+0000","last_clean":"2024-09-21T03:15:15.677250+0000","last_became_active":"2024-09-21T03:14:47.554758+0000","last_became_peered":"2024-09-21T03:14:47.554758+0000","last_unstale":"2024-09-21T03:15:15.677250+0000","last_undegraded":"2024-09-21T03:15:15.677250+0000","last_fullsized":"2024-09-21T03:15:15.677250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:47.574672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.685167+0000","last_change":"2024-09-21T03:14:38.494878+0000","last_active":"2024-09-21T03:15:15.685167+0000","last_peered":"2024-09-21T03:15:15.685167+0000","last_clean":"2024-09-21T03:15:15.685167+0000","last_became_active":"2024-09-21T03:14:38.492813+0000","last_became_peered":"2024-09-21T03:14:38.492813+0000","last_unstale":"2024-09-21T03:15:15.685167+0000","last_undegraded":"2024-09-21T03:15:15.685167+0000","last_fullsized":"2024-09-21T03:15:15.685167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:55.064844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557554+0000","last_change":"2024-09-21T03:14:47.544806+0000","last_active":"2024-09-21T03:14:48.557554+0000","last_peered":"2024-09-21T03:14:48.557554+0000","last_clean":"2024-09-21T03:14:48.557554+0000","last_became_active":"2024-09-21T03:14:47.544431+0000","last_became_peered":"2024-09-21T03:14:47.544431+0000","last_unstale":"2024-09-21T03:14:48.557554+0000","last_undegraded":"2024-09-21T03:14:48.557554+0000","last_fullsized":"2024-09-21T03:14:48.557554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:01.463573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.687263+0000","last_change":"2024-09-21T03:14:38.474462+0000","last_active":"2024-09-21T03:15:14.687263+0000","last_peered":"2024-09-21T03:15:14.687263+0000","last_clean":"2024-09-21T03:15:14.687263+0000","last_became_active":"2024-09-21T03:14:38.474156+0000","last_became_peered":"2024-09-21T03:14:38.474156+0000","last_unstale":"2024-09-21T03:15:14.687263+0000","last_undegraded":"2024-09-21T03:15:14.687263+0000","last_fullsized":"2024-09-21T03:15:14.687263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:55.329945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806137+0000","last_change":"2024-09-21T03:14:47.563297+0000","last_active":"2024-09-21T03:15:15.806137+0000","last_peered":"2024-09-21T03:15:15.806137+0000","last_clean":"2024-09-21T03:15:15.806137+0000","last_became_active":"2024-09-21T03:14:47.562519+0000","last_became_peered":"2024-09-21T03:14:47.562519+0000","last_unstale":"2024-09-21T03:15:15.806137+0000","last_undegraded":"2024-09-21T03:15:15.806137+0000","last_fullsized":"2024-09-21T03:15:15.806137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:47.959373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.681798+0000","last_change":"2024-09-21T03:14:38.474262+0000","last_active":"2024-09-21T03:15:14.681798+0000","last_peered":"2024-09-21T03:15:14.681798+0000","last_clean":"2024-09-21T03:15:14.681798+0000","last_became_active":"2024-09-21T03:14:38.473856+0000","last_became_peered":"2024-09-21T03:14:38.473856+0000","last_unstale":"2024-09-21T03:15:14.681798+0000","last_undegraded":"2024-09-21T03:15:14.681798+0000","last_fullsized":"2024-09-21T03:15:14.681798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804869+0000","last_change":"2024-09-21T03:14:47.558732+0000","last_active":"2024-09-21T03:15:15.804869+0000","last_peered":"2024-09-21T03:15:15.804869+0000","last_clean":"2024-09-21T03:15:15.804869+0000","last_became_active":"2024-09-21T03:14:47.558403+0000","last_became_peered":"2024-09-21T03:14:47.558403+0000","last_unstale":"2024-09-21T03:15:15.804869+0000","last_undegraded":"2024-09-21T03:15:15.804869+0000","last_fullsized":"2024-09-21T03:15:15.804869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:46.054565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678631+0000","last_change":"2024-09-21T03:14:38.469736+0000","last_active":"2024-09-21T03:15:15.678631+0000","last_peered":"2024-09-21T03:15:15.678631+0000","last_clean":"2024-09-21T03:15:15.678631+0000","last_became_active":"2024-09-21T03:14:38.469240+0000","last_became_peered":"2024-09-21T03:14:38.469240+0000","last_unstale":"2024-09-21T03:15:15.678631+0000","last_undegraded":"2024-09-21T03:15:15.678631+0000","last_fullsized":"2024-09-21T03:15:15.678631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:04.258761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804652+0000","last_change":"2024-09-21T03:14:47.550684+0000","last_active":"2024-09-21T03:15:15.804652+0000","last_peered":"2024-09-21T03:15:15.804652+0000","last_clean":"2024-09-21T03:15:15.804652+0000","last_became_active":"2024-09-21T03:14:47.550375+0000","last_became_peered":"2024-09-21T03:14:47.550375+0000","last_unstale":"2024-09-21T03:15:15.804652+0000","last_undegraded":"2024-09-21T03:15:15.804652+0000","last_fullsized":"2024-09-21T03:15:15.804652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:05.268160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557691+0000","last_change":"2024-09-21T03:14:38.487983+0000","last_active":"2024-09-21T03:14:48.557691+0000","last_peered":"2024-09-21T03:14:48.557691+0000","last_clean":"2024-09-21T03:14:48.557691+0000","last_became_active":"2024-09-21T03:14:38.487676+0000","last_became_peered":"2024-09-21T03:14:38.487676+0000","last_unstale":"2024-09-21T03:14:48.557691+0000","last_undegraded":"2024-09-21T03:14:48.557691+0000","last_fullsized":"2024-09-21T03:14:48.557691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:35.320169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T03:15:14.684351+0000","last_change":"2024-09-21T03:14:47.561566+0000","last_active":"2024-09-21T03:15:14.684351+0000","last_peered":"2024-09-21T03:15:14.684351+0000","last_clean":"2024-09-21T03:15:14.684351+0000","last_became_active":"2024-09-21T03:14:47.561229+0000","last_became_peered":"2024-09-21T03:14:47.561229+0000","last_unstale":"2024-09-21T03:15:14.684351+0000","last_undegraded":"2024-09-21T03:15:14.684351+0000","last_fullsized":"2024-09-21T03:15:14.684351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:07.280356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.558891+0000","last_change":"2024-09-21T03:14:38.478853+0000","last_active":"2024-09-21T03:14:48.558891+0000","last_peered":"2024-09-21T03:14:48.558891+0000","last_clean":"2024-09-21T03:14:48.558891+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:14:48.558891+0000","last_undegraded":"2024-09-21T03:14:48.558891+0000","last_fullsized":"2024-09-21T03:14:48.558891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:31.427596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":2,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-21T03:14:51.026823+0000","last_change":"2024-09-21T03:15:15.025321+0000","last_active":"2024-09-21T03:15:15.025321+0000","last_peered":"2024-09-21T03:14:51.026823+0000","last_clean":"2024-09-21T03:14:51.026823+0000","last_became_active":"2024-09-21T03:14:47.552659+0000","last_became_peered":"2024-09-21T03:14:47.552659+0000","last_unstale":"2024-09-21T03:14:51.026823+0000","last_undegraded":"2024-09-21T03:14:51.026823+0000","last_fullsized":"2024-09-21T03:14:51.026823+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681084+0000","last_change":"2024-09-21T03:14:38.481308+0000","last_active":"2024-09-21T03:15:15.681084+0000","last_peered":"2024-09-21T03:15:15.681084+0000","last_clean":"2024-09-21T03:15:15.681084+0000","last_became_active":"2024-09-21T03:14:38.480923+0000","last_became_peered":"2024-09-21T03:14:38.480923+0000","last_unstale":"2024-09-21T03:15:15.681084+0000","last_undegraded":"2024-09-21T03:15:15.681084+0000","last_fullsized":"2024-09-21T03:15:15.681084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:40.689231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-21T03:14:48.557324+0000","last_change":"2024-09-21T03:14:47.561972+0000","last_active":"2024-09-21T03:14:48.557324+0000","last_peered":"2024-09-21T03:14:48.557324+0000","last_clean":"2024-09-21T03:14:48.557324+0000","last_became_active":"2024-09-21T03:14:47.561645+0000","last_became_peered":"2024-09-21T03:14:47.561645+0000","last_unstale":"2024-09-21T03:14:48.557324+0000","last_undegraded":"2024-09-21T03:14:48.557324+0000","last_fullsized":"2024-09-21T03:14:48.557324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:57.526787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681129+0000","last_change":"2024-09-21T03:14:38.473907+0000","last_active":"2024-09-21T03:15:15.681129+0000","last_peered":"2024-09-21T03:15:15.681129+0000","last_clean":"2024-09-21T03:15:15.681129+0000","last_became_active":"2024-09-21T03:14:38.473579+0000","last_became_peered":"2024-09-21T03:14:38.473579+0000","last_unstale":"2024-09-21T03:15:15.681129+0000","last_undegraded":"2024-09-21T03:15:15.681129+0000","last_fullsized":"2024-09-21T03:15:15.681129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:32.273503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680383+0000","last_change":"2024-09-21T03:14:47.566089+0000","last_active":"2024-09-21T03:15:15.680383+0000","last_peered":"2024-09-21T03:15:15.680383+0000","last_clean":"2024-09-21T03:15:15.680383+0000","last_became_active":"2024-09-21T03:14:47.565681+0000","last_became_peered":"2024-09-21T03:14:47.565681+0000","last_unstale":"2024-09-21T03:15:15.680383+0000","last_undegraded":"2024-09-21T03:15:15.680383+0000","last_fullsized":"2024-09-21T03:15:15.680383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.208933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681048+0000","last_change":"2024-09-21T03:14:38.474326+0000","last_active":"2024-09-21T03:15:15.681048+0000","last_peered":"2024-09-21T03:15:15.681048+0000","last_clean":"2024-09-21T03:15:15.681048+0000","last_became_active":"2024-09-21T03:14:38.470430+0000","last_became_peered":"2024-09-21T03:14:38.470430+0000","last_unstale":"2024-09-21T03:15:15.681048+0000","last_undegraded":"2024-09-21T03:15:15.681048+0000","last_fullsized":"2024-09-21T03:15:15.681048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:09.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680250+0000","last_change":"2024-09-21T03:14:47.571487+0000","last_active":"2024-09-21T03:15:15.680250+0000","last_peered":"2024-09-21T03:15:15.680250+0000","last_clean":"2024-09-21T03:15:15.680250+0000","last_became_active":"2024-09-21T03:14:47.571126+0000","last_became_peered":"2024-09-21T03:14:47.571126+0000","last_unstale":"2024-09-21T03:15:15.680250+0000","last_undegraded":"2024-09-21T03:15:15.680250+0000","last_fullsized":"2024-09-21T03:15:15.680250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:57.128853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805276+0000","last_change":"2024-09-21T03:14:38.483370+0000","last_active":"2024-09-21T03:15:15.805276+0000","last_peered":"2024-09-21T03:15:15.805276+0000","last_clean":"2024-09-21T03:15:15.805276+0000","last_became_active":"2024-09-21T03:14:38.483019+0000","last_became_peered":"2024-09-21T03:14:38.483019+0000","last_unstale":"2024-09-21T03:15:15.805276+0000","last_undegraded":"2024-09-21T03:15:15.805276+0000","last_fullsized":"2024-09-21T03:15:15.805276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:55.085422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679803+0000","last_change":"2024-09-21T03:14:47.555777+0000","last_active":"2024-09-21T03:15:15.679803+0000","last_peered":"2024-09-21T03:15:15.679803+0000","last_clean":"2024-09-21T03:15:15.679803+0000","last_became_active":"2024-09-21T03:14:47.555465+0000","last_became_peered":"2024-09-21T03:14:47.555465+0000","last_unstale":"2024-09-21T03:15:15.679803+0000","last_undegraded":"2024-09-21T03:15:15.679803+0000","last_fullsized":"2024-09-21T03:15:15.679803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:27.123740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678858+0000","last_change":"2024-09-21T03:14:38.465771+0000","last_active":"2024-09-21T03:15:15.678858+0000","last_peered":"2024-09-21T03:15:15.678858+0000","last_clean":"2024-09-21T03:15:15.678858+0000","last_became_active":"2024-09-21T03:14:38.465479+0000","last_became_peered":"2024-09-21T03:14:38.465479+0000","last_unstale":"2024-09-21T03:15:15.678858+0000","last_undegraded":"2024-09-21T03:15:15.678858+0000","last_fullsized":"2024-09-21T03:15:15.678858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.754315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678369+0000","last_change":"2024-09-21T03:14:47.567695+0000","last_active":"2024-09-21T03:15:15.678369+0000","last_peered":"2024-09-21T03:15:15.678369+0000","last_clean":"2024-09-21T03:15:15.678369+0000","last_became_active":"2024-09-21T03:14:47.566936+0000","last_became_peered":"2024-09-21T03:14:47.566936+0000","last_unstale":"2024-09-21T03:15:15.678369+0000","last_undegraded":"2024-09-21T03:15:15.678369+0000","last_fullsized":"2024-09-21T03:15:15.678369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:48.182523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.808619+0000","last_change":"2024-09-21T03:15:15.807206+0000","last_active":"2024-09-21T03:15:15.808619+0000","last_peered":"2024-09-21T03:15:15.808619+0000","last_clean":"2024-09-21T03:15:15.808619+0000","last_became_active":"2024-09-21T03:15:15.806775+0000","last_became_peered":"2024-09-21T03:15:15.806775+0000","last_unstale":"2024-09-21T03:15:15.808619+0000","last_undegraded":"2024-09-21T03:15:15.808619+0000","last_fullsized":"2024-09-21T03:15:15.808619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:51.779236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805513+0000","last_change":"2024-09-21T03:14:47.580314+0000","last_active":"2024-09-21T03:15:15.805513+0000","last_peered":"2024-09-21T03:15:15.805513+0000","last_clean":"2024-09-21T03:15:15.805513+0000","last_became_active":"2024-09-21T03:14:47.576499+0000","last_became_peered":"2024-09-21T03:14:47.576499+0000","last_unstale":"2024-09-21T03:15:15.805513+0000","last_undegraded":"2024-09-21T03:15:15.805513+0000","last_fullsized":"2024-09-21T03:15:15.805513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:46.154586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678336+0000","last_change":"2024-09-21T03:14:38.471270+0000","last_active":"2024-09-21T03:15:15.678336+0000","last_peered":"2024-09-21T03:15:15.678336+0000","last_clean":"2024-09-21T03:15:15.678336+0000","last_became_active":"2024-09-21T03:14:38.470708+0000","last_became_peered":"2024-09-21T03:14:38.470708+0000","last_unstale":"2024-09-21T03:15:15.678336+0000","last_undegraded":"2024-09-21T03:15:15.678336+0000","last_fullsized":"2024-09-21T03:15:15.678336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.122804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804703+0000","last_change":"2024-09-21T03:14:47.554180+0000","last_active":"2024-09-21T03:15:15.804703+0000","last_peered":"2024-09-21T03:15:15.804703+0000","last_clean":"2024-09-21T03:15:15.804703+0000","last_became_active":"2024-09-21T03:14:47.552808+0000","last_became_peered":"2024-09-21T03:14:47.552808+0000","last_unstale":"2024-09-21T03:15:15.804703+0000","last_undegraded":"2024-09-21T03:15:15.804703+0000","last_fullsized":"2024-09-21T03:15:15.804703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:07.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681593+0000","last_change":"2024-09-21T03:14:38.466077+0000","last_active":"2024-09-21T03:15:15.681593+0000","last_peered":"2024-09-21T03:15:15.681593+0000","last_clean":"2024-09-21T03:15:15.681593+0000","last_became_active":"2024-09-21T03:14:38.465818+0000","last_became_peered":"2024-09-21T03:14:38.465818+0000","last_unstale":"2024-09-21T03:15:15.681593+0000","last_undegraded":"2024-09-21T03:15:15.681593+0000","last_fullsized":"2024-09-21T03:15:15.681593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:34.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684015+0000","last_change":"2024-09-21T03:14:47.577228+0000","last_active":"2024-09-21T03:15:15.684015+0000","last_peered":"2024-09-21T03:15:15.684015+0000","last_clean":"2024-09-21T03:15:15.684015+0000","last_became_active":"2024-09-21T03:14:47.576843+0000","last_became_peered":"2024-09-21T03:14:47.576843+0000","last_unstale":"2024-09-21T03:15:15.684015+0000","last_undegraded":"2024-09-21T03:15:15.684015+0000","last_fullsized":"2024-09-21T03:15:15.684015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:56.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677741+0000","last_change":"2024-09-21T03:14:38.481389+0000","last_active":"2024-09-21T03:15:15.677741+0000","last_peered":"2024-09-21T03:15:15.677741+0000","last_clean":"2024-09-21T03:15:15.677741+0000","last_became_active":"2024-09-21T03:14:38.470907+0000","last_became_peered":"2024-09-21T03:14:38.470907+0000","last_unstale":"2024-09-21T03:15:15.677741+0000","last_undegraded":"2024-09-21T03:15:15.677741+0000","last_fullsized":"2024-09-21T03:15:15.677741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:30.068915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680895+0000","last_change":"2024-09-21T03:14:47.551766+0000","last_active":"2024-09-21T03:15:15.680895+0000","last_peered":"2024-09-21T03:15:15.680895+0000","last_clean":"2024-09-21T03:15:15.680895+0000","last_became_active":"2024-09-21T03:14:47.551420+0000","last_became_peered":"2024-09-21T03:14:47.551420+0000","last_unstale":"2024-09-21T03:15:15.680895+0000","last_undegraded":"2024-09-21T03:15:15.680895+0000","last_fullsized":"2024-09-21T03:15:15.680895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:56.255472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681739+0000","last_change":"2024-09-21T03:14:38.482605+0000","last_active":"2024-09-21T03:15:15.681739+0000","last_peered":"2024-09-21T03:15:15.681739+0000","last_clean":"2024-09-21T03:15:15.681739+0000","last_became_active":"2024-09-21T03:14:38.482306+0000","last_became_peered":"2024-09-21T03:14:38.482306+0000","last_unstale":"2024-09-21T03:15:15.681739+0000","last_undegraded":"2024-09-21T03:15:15.681739+0000","last_fullsized":"2024-09-21T03:15:15.681739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:40.482635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678145+0000","last_change":"2024-09-21T03:14:47.555070+0000","last_active":"2024-09-21T03:15:15.678145+0000","last_peered":"2024-09-21T03:15:15.678145+0000","last_clean":"2024-09-21T03:15:15.678145+0000","last_became_active":"2024-09-21T03:14:47.554363+0000","last_became_peered":"2024-09-21T03:14:47.554363+0000","last_unstale":"2024-09-21T03:15:15.678145+0000","last_undegraded":"2024-09-21T03:15:15.678145+0000","last_fullsized":"2024-09-21T03:15:15.678145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:40.027266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680191+0000","last_change":"2024-09-21T03:14:38.496218+0000","last_active":"2024-09-21T03:15:15.680191+0000","last_peered":"2024-09-21T03:15:15.680191+0000","last_clean":"2024-09-21T03:15:15.680191+0000","last_became_active":"2024-09-21T03:14:38.488537+0000","last_became_peered":"2024-09-21T03:14:38.488537+0000","last_unstale":"2024-09-21T03:15:15.680191+0000","last_undegraded":"2024-09-21T03:15:15.680191+0000","last_fullsized":"2024-09-21T03:15:15.680191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:59.667392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677329+0000","last_change":"2024-09-21T03:14:47.564250+0000","last_active":"2024-09-21T03:15:15.677329+0000","last_peered":"2024-09-21T03:15:15.677329+0000","last_clean":"2024-09-21T03:15:15.677329+0000","last_became_active":"2024-09-21T03:14:47.563745+0000","last_became_peered":"2024-09-21T03:14:47.563745+0000","last_unstale":"2024-09-21T03:15:15.677329+0000","last_undegraded":"2024-09-21T03:15:15.677329+0000","last_fullsized":"2024-09-21T03:15:15.677329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:31.282910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681230+0000","last_change":"2024-09-21T03:14:38.490309+0000","last_active":"2024-09-21T03:15:15.681230+0000","last_peered":"2024-09-21T03:15:15.681230+0000","last_clean":"2024-09-21T03:15:15.681230+0000","last_became_active":"2024-09-21T03:14:38.489167+0000","last_became_peered":"2024-09-21T03:14:38.489167+0000","last_unstale":"2024-09-21T03:15:15.681230+0000","last_undegraded":"2024-09-21T03:15:15.681230+0000","last_fullsized":"2024-09-21T03:15:15.681230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:07.725691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3656,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3656,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":698575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":319488,"data_stored":120849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":110425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":698041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":103380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":101880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:15:21.571 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:15:21.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.801+0000 7f4671200640 1 -- 172.21.15.90:0/3366471320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4650004800 msgr2=0x7f4650004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:21.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.801+0000 7f4671200640 1 --2- 172.21.15.90:0/3366471320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4650004800 0x7f4650004c10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4654009b50 tx=0x7f4650005830 comp rx=0 tx=0).stop 2024-09-21T03:15:21.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.801+0000 7f466a800640 1 -- 172.21.15.90:0/3366471320 reap_dead start 2024-09-21T03:15:21.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.801+0000 7f4671200640 1 -- 172.21.15.90:0/3366471320 shutdown_connections 2024-09-21T03:15:21.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.801+0000 7f4671200640 1 -- 172.21.15.90:0/3366471320 >> 172.21.15.90:0/3366471320 conn(0x7f466c0c8ba0 msgr2=0x7f466c06cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:21.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.801+0000 7f4671200640 1 -- 172.21.15.90:0/3366471320 shutdown_connections 2024-09-21T03:15:21.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.801+0000 7f4671200640 1 -- 172.21.15.90:0/3366471320 wait complete. 2024-09-21T03:15:21.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.803+0000 7f4671200640 1 Processor -- start 2024-09-21T03:15:21.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.804+0000 7f4671200640 1 -- start start 2024-09-21T03:15:21.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.805+0000 7f4671200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4650004800 0x7f466c156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:21.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.805+0000 7f4671200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f466c1ec2c0 0x7f466c14dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:21.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.805+0000 7f4671200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f466c138750 0x7f466c138b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:21.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.805+0000 7f4671200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f466c0ab640 con 0x7f466c1ec2c0 2024-09-21T03:15:21.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.805+0000 7f4671200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f466c0ab360 con 0x7f4650004800 2024-09-21T03:15:21.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.805+0000 7f4671200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f466c0ac760 con 0x7f466c138750 2024-09-21T03:15:21.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.805+0000 7f4661400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f466c1ec2c0 0x7f466c14dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:21.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.805+0000 7f4661400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f466c1ec2c0 0x7f466c14dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47730/0 (socket says 172.21.15.90:47730) 2024-09-21T03:15:21.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.805+0000 7f4661400640 1 -- 172.21.15.90:0/2881225008 learned_addr learned my addr 172.21.15.90:0/2881225008 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:21.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.805+0000 7f4669e00640 1 --2- 172.21.15.90:0/2881225008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4650004800 0x7f466c156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:21.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.805+0000 7f466a800640 1 --2- 172.21.15.90:0/2881225008 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f466c138750 0x7f466c138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:21.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.805+0000 7f4661400640 1 -- 172.21.15.90:0/2881225008 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f466c138750 msgr2=0x7f466c138b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:21.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.805+0000 7f4661400640 1 --2- 172.21.15.90:0/2881225008 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f466c138750 0x7f466c138b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:21.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.805+0000 7f4661400640 1 -- 172.21.15.90:0/2881225008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4650004800 msgr2=0x7f466c156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:21.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.805+0000 7f4661400640 1 --2- 172.21.15.90:0/2881225008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4650004800 0x7f466c156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:21.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.806+0000 7f4661400640 1 -- 172.21.15.90:0/2881225008 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466c14eb20 con 0x7f466c1ec2c0 2024-09-21T03:15:21.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.806+0000 7f4669e00640 1 --2- 172.21.15.90:0/2881225008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4650004800 0x7f466c156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:15:21.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.806+0000 7f4661400640 1 --2- 172.21.15.90:0/2881225008 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f466c1ec2c0 0x7f466c14dd30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4654009a70 tx=0x7f4654033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:21.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.806+0000 7f4662a00640 1 -- 172.21.15.90:0/2881225008 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654043070 con 0x7f466c1ec2c0 2024-09-21T03:15:21.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.806+0000 7f4662a00640 1 -- 172.21.15.90:0/2881225008 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4654004320 con 0x7f466c1ec2c0 2024-09-21T03:15:21.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.806+0000 7f4662a00640 1 -- 172.21.15.90:0/2881225008 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654038040 con 0x7f466c1ec2c0 2024-09-21T03:15:21.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.806+0000 7f4671200640 1 -- 172.21.15.90:0/2881225008 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466c14cc90 con 0x7f466c1ec2c0 2024-09-21T03:15:21.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.806+0000 7f4671200640 1 -- 172.21.15.90:0/2881225008 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f466c14d250 con 0x7f466c1ec2c0 2024-09-21T03:15:21.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.807+0000 7f4671200640 1 -- 172.21.15.90:0/2881225008 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f466c13dd40 con 0x7f466c1ec2c0 2024-09-21T03:15:21.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.808+0000 7f4662a00640 1 -- 172.21.15.90:0/2881225008 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4654046070 con 0x7f466c1ec2c0 2024-09-21T03:15:21.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.809+0000 7f4662a00640 1 --2- 172.21.15.90:0/2881225008 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4648078b90 0x7f464807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:21.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.809+0000 7f4662a00640 1 -- 172.21.15.90:0/2881225008 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f46540bb590 con 0x7f466c1ec2c0 2024-09-21T03:15:21.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.810+0000 7f4669e00640 1 --2- 172.21.15.90:0/2881225008 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4648078b90 0x7f464807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:21.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.810+0000 7f4669e00640 1 --2- 172.21.15.90:0/2881225008 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4648078b90 0x7f464807b0a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f466c0c5ca0 tx=0x7f465c005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:21.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.814+0000 7f4662a00640 1 -- 172.21.15.90:0/2881225008 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4654082fb0 con 0x7f466c1ec2c0 2024-09-21T03:15:22.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:21.999+0000 7f4671200640 1 -- 172.21.15.90:0/2881225008 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f466c0c27f0 con 0x7f4648078b90 2024-09-21T03:15:22.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.008+0000 7f4662a00640 1 -- 172.21.15.90:0/2881225008 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490398 (secure 0 0 0) 0x7f466c0c27f0 con 0x7f4648078b90 2024-09-21T03:15:22.015 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:15:22.018 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-21T03:15:22.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.013+0000 7f4671200640 1 -- 172.21.15.90:0/2881225008 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4648078b90 msgr2=0x7f464807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:22.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.013+0000 7f4671200640 1 --2- 172.21.15.90:0/2881225008 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4648078b90 0x7f464807b0a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f466c0c5ca0 tx=0x7f465c005f90 comp rx=0 tx=0).stop 2024-09-21T03:15:22.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.013+0000 7f4671200640 1 -- 172.21.15.90:0/2881225008 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f466c1ec2c0 msgr2=0x7f466c14dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:22.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.013+0000 7f4671200640 1 --2- 172.21.15.90:0/2881225008 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f466c1ec2c0 0x7f466c14dd30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4654009a70 tx=0x7f4654033670 comp rx=0 tx=0).stop 2024-09-21T03:15:22.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.013+0000 7f4671200640 1 -- 172.21.15.90:0/2881225008 shutdown_connections 2024-09-21T03:15:22.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.013+0000 7f4671200640 1 --2- 172.21.15.90:0/2881225008 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4648078b90 0x7f464807b0a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:22.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.013+0000 7f4671200640 1 --2- 172.21.15.90:0/2881225008 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f466c138750 0x7f466c138b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:22.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.013+0000 7f4671200640 1 --2- 172.21.15.90:0/2881225008 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f466c1ec2c0 0x7f466c14dd30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:22.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.013+0000 7f4671200640 1 --2- 172.21.15.90:0/2881225008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4650004800 0x7f466c156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:22.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.013+0000 7f4671200640 1 -- 172.21.15.90:0/2881225008 >> 172.21.15.90:0/2881225008 conn(0x7f466c0c8ba0 msgr2=0x7f466c154900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:22.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.013+0000 7f4671200640 1 -- 172.21.15.90:0/2881225008 shutdown_connections 2024-09-21T03:15:22.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.013+0000 7f4671200640 1 -- 172.21.15.90:0/2881225008 wait complete. 2024-09-21T03:15:22.039 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-09-21T03:15:20.486401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597680,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":197,"num_write_kb":1662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":387,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219672,"kb_used_data":3436,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755048,"statfs":{"total":773094113280,"available":772869169152,"internally_reserved":0,"allocated":3518464,"data_stored":2076342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2233,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002701"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804323+0000","last_change":"2024-09-21T03:14:47.552762+0000","last_active":"2024-09-21T03:15:15.804323+0000","last_peered":"2024-09-21T03:15:15.804323+0000","last_clean":"2024-09-21T03:15:15.804323+0000","last_became_active":"2024-09-21T03:14:47.551883+0000","last_became_peered":"2024-09-21T03:14:47.551883+0000","last_unstale":"2024-09-21T03:15:15.804323+0000","last_undegraded":"2024-09-21T03:15:15.804323+0000","last_fullsized":"2024-09-21T03:15:15.804323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:51.935797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806503+0000","last_change":"2024-09-21T03:14:37.471004+0000","last_active":"2024-09-21T03:15:15.806503+0000","last_peered":"2024-09-21T03:15:15.806503+0000","last_clean":"2024-09-21T03:15:15.806503+0000","last_became_active":"2024-09-21T03:14:37.470563+0000","last_became_peered":"2024-09-21T03:14:37.470563+0000","last_unstale":"2024-09-21T03:15:15.806503+0000","last_undegraded":"2024-09-21T03:15:15.806503+0000","last_fullsized":"2024-09-21T03:15:15.806503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.422826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680312+0000","last_change":"2024-09-21T03:14:38.496252+0000","last_active":"2024-09-21T03:15:15.680312+0000","last_peered":"2024-09-21T03:15:15.680312+0000","last_clean":"2024-09-21T03:15:15.680312+0000","last_became_active":"2024-09-21T03:14:38.488292+0000","last_became_peered":"2024-09-21T03:14:38.488292+0000","last_unstale":"2024-09-21T03:15:15.680312+0000","last_undegraded":"2024-09-21T03:15:15.680312+0000","last_fullsized":"2024-09-21T03:15:15.680312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:57.409792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683500+0000","last_change":"2024-09-21T03:14:46.549877+0000","last_active":"2024-09-21T03:15:15.683500+0000","last_peered":"2024-09-21T03:15:15.683500+0000","last_clean":"2024-09-21T03:15:15.683500+0000","last_became_active":"2024-09-21T03:14:46.549536+0000","last_became_peered":"2024-09-21T03:14:46.549536+0000","last_unstale":"2024-09-21T03:15:15.683500+0000","last_undegraded":"2024-09-21T03:15:15.683500+0000","last_fullsized":"2024-09-21T03:15:15.683500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:57.491042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804846+0000","last_change":"2024-09-21T03:14:47.560303+0000","last_active":"2024-09-21T03:15:15.804846+0000","last_peered":"2024-09-21T03:15:15.804846+0000","last_clean":"2024-09-21T03:15:15.804846+0000","last_became_active":"2024-09-21T03:14:47.559659+0000","last_became_peered":"2024-09-21T03:14:47.559659+0000","last_unstale":"2024-09-21T03:15:15.804846+0000","last_undegraded":"2024-09-21T03:15:15.804846+0000","last_fullsized":"2024-09-21T03:15:15.804846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:49.328036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680553+0000","last_change":"2024-09-21T03:14:37.467448+0000","last_active":"2024-09-21T03:15:15.680553+0000","last_peered":"2024-09-21T03:15:15.680553+0000","last_clean":"2024-09-21T03:15:15.680553+0000","last_became_active":"2024-09-21T03:14:37.467146+0000","last_became_peered":"2024-09-21T03:14:37.467146+0000","last_unstale":"2024-09-21T03:15:15.680553+0000","last_undegraded":"2024-09-21T03:15:15.680553+0000","last_fullsized":"2024-09-21T03:15:15.680553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:53.475083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681362+0000","last_change":"2024-09-21T03:14:38.486401+0000","last_active":"2024-09-21T03:15:15.681362+0000","last_peered":"2024-09-21T03:15:15.681362+0000","last_clean":"2024-09-21T03:15:15.681362+0000","last_became_active":"2024-09-21T03:14:38.486090+0000","last_became_peered":"2024-09-21T03:14:38.486090+0000","last_unstale":"2024-09-21T03:15:15.681362+0000","last_undegraded":"2024-09-21T03:15:15.681362+0000","last_fullsized":"2024-09-21T03:15:15.681362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:44.085100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677377+0000","last_change":"2024-09-21T03:14:46.541705+0000","last_active":"2024-09-21T03:15:15.677377+0000","last_peered":"2024-09-21T03:15:15.677377+0000","last_clean":"2024-09-21T03:15:15.677377+0000","last_became_active":"2024-09-21T03:14:46.541357+0000","last_became_peered":"2024-09-21T03:14:46.541357+0000","last_unstale":"2024-09-21T03:15:15.677377+0000","last_undegraded":"2024-09-21T03:15:15.677377+0000","last_fullsized":"2024-09-21T03:15:15.677377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:31.082059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804443+0000","last_change":"2024-09-21T03:14:47.556183+0000","last_active":"2024-09-21T03:15:15.804443+0000","last_peered":"2024-09-21T03:15:15.804443+0000","last_clean":"2024-09-21T03:15:15.804443+0000","last_became_active":"2024-09-21T03:14:47.553312+0000","last_became_peered":"2024-09-21T03:14:47.553312+0000","last_unstale":"2024-09-21T03:15:15.804443+0000","last_undegraded":"2024-09-21T03:15:15.804443+0000","last_fullsized":"2024-09-21T03:15:15.804443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:07.314491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681355+0000","last_change":"2024-09-21T03:14:37.478711+0000","last_active":"2024-09-21T03:15:15.681355+0000","last_peered":"2024-09-21T03:15:15.681355+0000","last_clean":"2024-09-21T03:15:15.681355+0000","last_became_active":"2024-09-21T03:14:37.477910+0000","last_became_peered":"2024-09-21T03:14:37.477910+0000","last_unstale":"2024-09-21T03:15:15.681355+0000","last_undegraded":"2024-09-21T03:15:15.681355+0000","last_fullsized":"2024-09-21T03:15:15.681355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:40.166966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804969+0000","last_change":"2024-09-21T03:14:38.472992+0000","last_active":"2024-09-21T03:15:15.804969+0000","last_peered":"2024-09-21T03:15:15.804969+0000","last_clean":"2024-09-21T03:15:15.804969+0000","last_became_active":"2024-09-21T03:14:38.472426+0000","last_became_peered":"2024-09-21T03:14:38.472426+0000","last_unstale":"2024-09-21T03:15:15.804969+0000","last_undegraded":"2024-09-21T03:15:15.804969+0000","last_fullsized":"2024-09-21T03:15:15.804969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:36.825612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677572+0000","last_change":"2024-09-21T03:14:46.526996+0000","last_active":"2024-09-21T03:15:15.677572+0000","last_peered":"2024-09-21T03:15:15.677572+0000","last_clean":"2024-09-21T03:15:15.677572+0000","last_became_active":"2024-09-21T03:14:46.525587+0000","last_became_peered":"2024-09-21T03:14:46.525587+0000","last_unstale":"2024-09-21T03:15:15.677572+0000","last_undegraded":"2024-09-21T03:15:15.677572+0000","last_fullsized":"2024-09-21T03:15:15.677572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:56.977126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677435+0000","last_change":"2024-09-21T03:14:47.554143+0000","last_active":"2024-09-21T03:15:15.677435+0000","last_peered":"2024-09-21T03:15:15.677435+0000","last_clean":"2024-09-21T03:15:15.677435+0000","last_became_active":"2024-09-21T03:14:47.553802+0000","last_became_peered":"2024-09-21T03:14:47.553802+0000","last_unstale":"2024-09-21T03:15:15.677435+0000","last_undegraded":"2024-09-21T03:15:15.677435+0000","last_fullsized":"2024-09-21T03:15:15.677435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:37.963442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681887+0000","last_change":"2024-09-21T03:14:37.479842+0000","last_active":"2024-09-21T03:15:15.681887+0000","last_peered":"2024-09-21T03:15:15.681887+0000","last_clean":"2024-09-21T03:15:15.681887+0000","last_became_active":"2024-09-21T03:14:37.478893+0000","last_became_peered":"2024-09-21T03:14:37.478893+0000","last_unstale":"2024-09-21T03:15:15.681887+0000","last_undegraded":"2024-09-21T03:15:15.681887+0000","last_fullsized":"2024-09-21T03:15:15.681887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:27.916133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684752+0000","last_change":"2024-09-21T03:14:38.468756+0000","last_active":"2024-09-21T03:15:15.684752+0000","last_peered":"2024-09-21T03:15:15.684752+0000","last_clean":"2024-09-21T03:15:15.684752+0000","last_became_active":"2024-09-21T03:14:38.467570+0000","last_became_peered":"2024-09-21T03:14:38.467570+0000","last_unstale":"2024-09-21T03:15:15.684752+0000","last_undegraded":"2024-09-21T03:15:15.684752+0000","last_fullsized":"2024-09-21T03:15:15.684752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:24.784157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677514+0000","last_change":"2024-09-21T03:14:46.529932+0000","last_active":"2024-09-21T03:15:15.677514+0000","last_peered":"2024-09-21T03:15:15.677514+0000","last_clean":"2024-09-21T03:15:15.677514+0000","last_became_active":"2024-09-21T03:14:46.529629+0000","last_became_peered":"2024-09-21T03:14:46.529629+0000","last_unstale":"2024-09-21T03:15:15.677514+0000","last_undegraded":"2024-09-21T03:15:15.677514+0000","last_fullsized":"2024-09-21T03:15:15.677514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:39.808494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681239+0000","last_change":"2024-09-21T03:14:47.547724+0000","last_active":"2024-09-21T03:15:15.681239+0000","last_peered":"2024-09-21T03:15:15.681239+0000","last_clean":"2024-09-21T03:15:15.681239+0000","last_became_active":"2024-09-21T03:14:47.546770+0000","last_became_peered":"2024-09-21T03:14:47.546770+0000","last_unstale":"2024-09-21T03:15:15.681239+0000","last_undegraded":"2024-09-21T03:15:15.681239+0000","last_fullsized":"2024-09-21T03:15:15.681239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:31.476710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683559+0000","last_change":"2024-09-21T03:14:38.476747+0000","last_active":"2024-09-21T03:15:15.683559+0000","last_peered":"2024-09-21T03:15:15.683559+0000","last_clean":"2024-09-21T03:15:15.683559+0000","last_became_active":"2024-09-21T03:14:38.476386+0000","last_became_peered":"2024-09-21T03:14:38.476386+0000","last_unstale":"2024-09-21T03:15:15.683559+0000","last_undegraded":"2024-09-21T03:15:15.683559+0000","last_fullsized":"2024-09-21T03:15:15.683559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:28.751991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683640+0000","last_change":"2024-09-21T03:14:37.463164+0000","last_active":"2024-09-21T03:15:15.683640+0000","last_peered":"2024-09-21T03:15:15.683640+0000","last_clean":"2024-09-21T03:15:15.683640+0000","last_became_active":"2024-09-21T03:14:37.461409+0000","last_became_peered":"2024-09-21T03:14:37.461409+0000","last_unstale":"2024-09-21T03:15:15.683640+0000","last_undegraded":"2024-09-21T03:15:15.683640+0000","last_fullsized":"2024-09-21T03:15:15.683640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:51.126291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684434+0000","last_change":"2024-09-21T03:14:46.538480+0000","last_active":"2024-09-21T03:15:15.684434+0000","last_peered":"2024-09-21T03:15:15.684434+0000","last_clean":"2024-09-21T03:15:15.684434+0000","last_became_active":"2024-09-21T03:14:46.537493+0000","last_became_peered":"2024-09-21T03:14:46.537493+0000","last_unstale":"2024-09-21T03:15:15.684434+0000","last_undegraded":"2024-09-21T03:15:15.684434+0000","last_fullsized":"2024-09-21T03:15:15.684434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:52.769190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684608+0000","last_change":"2024-09-21T03:14:47.580512+0000","last_active":"2024-09-21T03:15:15.684608+0000","last_peered":"2024-09-21T03:15:15.684608+0000","last_clean":"2024-09-21T03:15:15.684608+0000","last_became_active":"2024-09-21T03:14:47.580210+0000","last_became_peered":"2024-09-21T03:14:47.580210+0000","last_unstale":"2024-09-21T03:15:15.684608+0000","last_undegraded":"2024-09-21T03:15:15.684608+0000","last_fullsized":"2024-09-21T03:15:15.684608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:20.192190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684313+0000","last_change":"2024-09-21T03:14:38.494021+0000","last_active":"2024-09-21T03:15:15.684313+0000","last_peered":"2024-09-21T03:15:15.684313+0000","last_clean":"2024-09-21T03:15:15.684313+0000","last_became_active":"2024-09-21T03:14:38.486802+0000","last_became_peered":"2024-09-21T03:14:38.486802+0000","last_unstale":"2024-09-21T03:15:15.684313+0000","last_undegraded":"2024-09-21T03:15:15.684313+0000","last_fullsized":"2024-09-21T03:15:15.684313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:31.817505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679776+0000","last_change":"2024-09-21T03:14:37.465907+0000","last_active":"2024-09-21T03:15:15.679776+0000","last_peered":"2024-09-21T03:15:15.679776+0000","last_clean":"2024-09-21T03:15:15.679776+0000","last_became_active":"2024-09-21T03:14:37.465551+0000","last_became_peered":"2024-09-21T03:14:37.465551+0000","last_unstale":"2024-09-21T03:15:15.679776+0000","last_undegraded":"2024-09-21T03:15:15.679776+0000","last_fullsized":"2024-09-21T03:15:15.679776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:10.599687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681508+0000","last_change":"2024-09-21T03:14:46.546737+0000","last_active":"2024-09-21T03:15:15.681508+0000","last_peered":"2024-09-21T03:15:15.681508+0000","last_clean":"2024-09-21T03:15:15.681508+0000","last_became_active":"2024-09-21T03:14:46.546312+0000","last_became_peered":"2024-09-21T03:14:46.546312+0000","last_unstale":"2024-09-21T03:15:15.681508+0000","last_undegraded":"2024-09-21T03:15:15.681508+0000","last_fullsized":"2024-09-21T03:15:15.681508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:03.939168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683954+0000","last_change":"2024-09-21T03:14:47.558742+0000","last_active":"2024-09-21T03:15:15.683954+0000","last_peered":"2024-09-21T03:15:15.683954+0000","last_clean":"2024-09-21T03:15:15.683954+0000","last_became_active":"2024-09-21T03:14:47.558431+0000","last_became_peered":"2024-09-21T03:14:47.558431+0000","last_unstale":"2024-09-21T03:15:15.683954+0000","last_undegraded":"2024-09-21T03:15:15.683954+0000","last_fullsized":"2024-09-21T03:15:15.683954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:32.053674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805176+0000","last_change":"2024-09-21T03:14:38.479370+0000","last_active":"2024-09-21T03:15:15.805176+0000","last_peered":"2024-09-21T03:15:15.805176+0000","last_clean":"2024-09-21T03:15:15.805176+0000","last_became_active":"2024-09-21T03:14:38.476976+0000","last_became_peered":"2024-09-21T03:14:38.476976+0000","last_unstale":"2024-09-21T03:15:15.805176+0000","last_undegraded":"2024-09-21T03:15:15.805176+0000","last_fullsized":"2024-09-21T03:15:15.805176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:14.695819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805302+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:15:15.805302+0000","last_peered":"2024-09-21T03:15:15.805302+0000","last_clean":"2024-09-21T03:15:15.805302+0000","last_became_active":"2024-09-21T03:14:37.478840+0000","last_became_peered":"2024-09-21T03:14:37.478840+0000","last_unstale":"2024-09-21T03:15:15.805302+0000","last_undegraded":"2024-09-21T03:15:15.805302+0000","last_fullsized":"2024-09-21T03:15:15.805302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:00.964354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684541+0000","last_change":"2024-09-21T03:14:46.543085+0000","last_active":"2024-09-21T03:15:15.684541+0000","last_peered":"2024-09-21T03:15:15.684541+0000","last_clean":"2024-09-21T03:15:15.684541+0000","last_became_active":"2024-09-21T03:14:46.542721+0000","last_became_peered":"2024-09-21T03:14:46.542721+0000","last_unstale":"2024-09-21T03:15:15.684541+0000","last_undegraded":"2024-09-21T03:15:15.684541+0000","last_fullsized":"2024-09-21T03:15:15.684541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:05.590871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805028+0000","last_change":"2024-09-21T03:14:47.566806+0000","last_active":"2024-09-21T03:15:15.805028+0000","last_peered":"2024-09-21T03:15:15.805028+0000","last_clean":"2024-09-21T03:15:15.805028+0000","last_became_active":"2024-09-21T03:14:47.566634+0000","last_became_peered":"2024-09-21T03:14:47.566634+0000","last_unstale":"2024-09-21T03:15:15.805028+0000","last_undegraded":"2024-09-21T03:15:15.805028+0000","last_fullsized":"2024-09-21T03:15:15.805028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:03.997294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683330+0000","last_change":"2024-09-21T03:14:38.482658+0000","last_active":"2024-09-21T03:15:15.683330+0000","last_peered":"2024-09-21T03:15:15.683330+0000","last_clean":"2024-09-21T03:15:15.683330+0000","last_became_active":"2024-09-21T03:14:38.482369+0000","last_became_peered":"2024-09-21T03:14:38.482369+0000","last_unstale":"2024-09-21T03:15:15.683330+0000","last_undegraded":"2024-09-21T03:15:15.683330+0000","last_fullsized":"2024-09-21T03:15:15.683330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:36.682534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680554+0000","last_change":"2024-09-21T03:14:37.472962+0000","last_active":"2024-09-21T03:15:15.680554+0000","last_peered":"2024-09-21T03:15:15.680554+0000","last_clean":"2024-09-21T03:15:15.680554+0000","last_became_active":"2024-09-21T03:14:37.472271+0000","last_became_peered":"2024-09-21T03:14:37.472271+0000","last_unstale":"2024-09-21T03:15:15.680554+0000","last_undegraded":"2024-09-21T03:15:15.680554+0000","last_fullsized":"2024-09-21T03:15:15.680554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:54.952223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678253+0000","last_change":"2024-09-21T03:14:46.537137+0000","last_active":"2024-09-21T03:15:15.678253+0000","last_peered":"2024-09-21T03:15:15.678253+0000","last_clean":"2024-09-21T03:15:15.678253+0000","last_became_active":"2024-09-21T03:14:46.536791+0000","last_became_peered":"2024-09-21T03:14:46.536791+0000","last_unstale":"2024-09-21T03:15:15.678253+0000","last_undegraded":"2024-09-21T03:15:15.678253+0000","last_fullsized":"2024-09-21T03:15:15.678253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:43.186807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805335+0000","last_change":"2024-09-21T03:14:47.555605+0000","last_active":"2024-09-21T03:15:15.805335+0000","last_peered":"2024-09-21T03:15:15.805335+0000","last_clean":"2024-09-21T03:15:15.805335+0000","last_became_active":"2024-09-21T03:14:47.555329+0000","last_became_peered":"2024-09-21T03:14:47.555329+0000","last_unstale":"2024-09-21T03:15:15.805335+0000","last_undegraded":"2024-09-21T03:15:15.805335+0000","last_fullsized":"2024-09-21T03:15:15.805335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:24.271656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806141+0000","last_change":"2024-09-21T03:14:38.479133+0000","last_active":"2024-09-21T03:15:15.806141+0000","last_peered":"2024-09-21T03:15:15.806141+0000","last_clean":"2024-09-21T03:15:15.806141+0000","last_became_active":"2024-09-21T03:14:38.478077+0000","last_became_peered":"2024-09-21T03:14:38.478077+0000","last_unstale":"2024-09-21T03:15:15.806141+0000","last_undegraded":"2024-09-21T03:15:15.806141+0000","last_fullsized":"2024-09-21T03:15:15.806141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:56.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684235+0000","last_change":"2024-09-21T03:14:37.480508+0000","last_active":"2024-09-21T03:15:15.684235+0000","last_peered":"2024-09-21T03:15:15.684235+0000","last_clean":"2024-09-21T03:15:15.684235+0000","last_became_active":"2024-09-21T03:14:37.480218+0000","last_became_peered":"2024-09-21T03:14:37.480218+0000","last_unstale":"2024-09-21T03:15:15.684235+0000","last_undegraded":"2024-09-21T03:15:15.684235+0000","last_fullsized":"2024-09-21T03:15:15.684235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:01.851380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678755+0000","last_change":"2024-09-21T03:14:46.531615+0000","last_active":"2024-09-21T03:15:15.678755+0000","last_peered":"2024-09-21T03:15:15.678755+0000","last_clean":"2024-09-21T03:15:15.678755+0000","last_became_active":"2024-09-21T03:14:46.531289+0000","last_became_peered":"2024-09-21T03:14:46.531289+0000","last_unstale":"2024-09-21T03:15:15.678755+0000","last_undegraded":"2024-09-21T03:15:15.678755+0000","last_fullsized":"2024-09-21T03:15:15.678755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:10.145489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683072+0000","last_change":"2024-09-21T03:14:47.552705+0000","last_active":"2024-09-21T03:15:15.683072+0000","last_peered":"2024-09-21T03:15:15.683072+0000","last_clean":"2024-09-21T03:15:15.683072+0000","last_became_active":"2024-09-21T03:14:47.552367+0000","last_became_peered":"2024-09-21T03:14:47.552367+0000","last_unstale":"2024-09-21T03:15:15.683072+0000","last_undegraded":"2024-09-21T03:15:15.683072+0000","last_fullsized":"2024-09-21T03:15:15.683072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:45.379581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806286+0000","last_change":"2024-09-21T03:14:38.475318+0000","last_active":"2024-09-21T03:15:15.806286+0000","last_peered":"2024-09-21T03:15:15.806286+0000","last_clean":"2024-09-21T03:15:15.806286+0000","last_became_active":"2024-09-21T03:14:38.474978+0000","last_became_peered":"2024-09-21T03:14:38.474978+0000","last_unstale":"2024-09-21T03:15:15.806286+0000","last_undegraded":"2024-09-21T03:15:15.806286+0000","last_fullsized":"2024-09-21T03:15:15.806286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:38.209624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806345+0000","last_change":"2024-09-21T03:14:37.479651+0000","last_active":"2024-09-21T03:15:15.806345+0000","last_peered":"2024-09-21T03:15:15.806345+0000","last_clean":"2024-09-21T03:15:15.806345+0000","last_became_active":"2024-09-21T03:14:37.478833+0000","last_became_peered":"2024-09-21T03:14:37.478833+0000","last_unstale":"2024-09-21T03:15:15.806345+0000","last_undegraded":"2024-09-21T03:15:15.806345+0000","last_fullsized":"2024-09-21T03:15:15.806345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:48.578637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804935+0000","last_change":"2024-09-21T03:14:46.536054+0000","last_active":"2024-09-21T03:15:15.804935+0000","last_peered":"2024-09-21T03:15:15.804935+0000","last_clean":"2024-09-21T03:15:15.804935+0000","last_became_active":"2024-09-21T03:14:46.535569+0000","last_became_peered":"2024-09-21T03:14:46.535569+0000","last_unstale":"2024-09-21T03:15:15.804935+0000","last_undegraded":"2024-09-21T03:15:15.804935+0000","last_fullsized":"2024-09-21T03:15:15.804935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:04.556059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680654+0000","last_change":"2024-09-21T03:14:47.571889+0000","last_active":"2024-09-21T03:15:15.680654+0000","last_peered":"2024-09-21T03:15:15.680654+0000","last_clean":"2024-09-21T03:15:15.680654+0000","last_became_active":"2024-09-21T03:14:47.571620+0000","last_became_peered":"2024-09-21T03:14:47.571620+0000","last_unstale":"2024-09-21T03:15:15.680654+0000","last_undegraded":"2024-09-21T03:15:15.680654+0000","last_fullsized":"2024-09-21T03:15:15.680654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:23.103973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680192+0000","last_change":"2024-09-21T03:14:38.493350+0000","last_active":"2024-09-21T03:15:15.680192+0000","last_peered":"2024-09-21T03:15:15.680192+0000","last_clean":"2024-09-21T03:15:15.680192+0000","last_became_active":"2024-09-21T03:14:38.492830+0000","last_became_peered":"2024-09-21T03:14:38.492830+0000","last_unstale":"2024-09-21T03:15:15.680192+0000","last_undegraded":"2024-09-21T03:15:15.680192+0000","last_fullsized":"2024-09-21T03:15:15.680192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:19.946319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.685146+0000","last_change":"2024-09-21T03:14:37.473484+0000","last_active":"2024-09-21T03:15:15.685146+0000","last_peered":"2024-09-21T03:15:15.685146+0000","last_clean":"2024-09-21T03:15:15.685146+0000","last_became_active":"2024-09-21T03:14:37.473218+0000","last_became_peered":"2024-09-21T03:14:37.473218+0000","last_unstale":"2024-09-21T03:15:15.685146+0000","last_undegraded":"2024-09-21T03:15:15.685146+0000","last_fullsized":"2024-09-21T03:15:15.685146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:49.006579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678920+0000","last_change":"2024-09-21T03:14:46.548858+0000","last_active":"2024-09-21T03:15:15.678920+0000","last_peered":"2024-09-21T03:15:15.678920+0000","last_clean":"2024-09-21T03:15:15.678920+0000","last_became_active":"2024-09-21T03:14:46.548166+0000","last_became_peered":"2024-09-21T03:14:46.548166+0000","last_unstale":"2024-09-21T03:15:15.678920+0000","last_undegraded":"2024-09-21T03:15:15.678920+0000","last_fullsized":"2024-09-21T03:15:15.678920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:41.470072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805741+0000","last_change":"2024-09-21T03:14:47.555787+0000","last_active":"2024-09-21T03:15:15.805741+0000","last_peered":"2024-09-21T03:15:15.805741+0000","last_clean":"2024-09-21T03:15:15.805741+0000","last_became_active":"2024-09-21T03:14:47.555420+0000","last_became_peered":"2024-09-21T03:14:47.555420+0000","last_unstale":"2024-09-21T03:15:15.805741+0000","last_undegraded":"2024-09-21T03:15:15.805741+0000","last_fullsized":"2024-09-21T03:15:15.805741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:45.769786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677640+0000","last_change":"2024-09-21T03:14:38.479657+0000","last_active":"2024-09-21T03:15:15.677640+0000","last_peered":"2024-09-21T03:15:15.677640+0000","last_clean":"2024-09-21T03:15:15.677640+0000","last_became_active":"2024-09-21T03:14:38.479439+0000","last_became_peered":"2024-09-21T03:14:38.479439+0000","last_unstale":"2024-09-21T03:15:15.677640+0000","last_undegraded":"2024-09-21T03:15:15.677640+0000","last_fullsized":"2024-09-21T03:15:15.677640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.107215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681857+0000","last_change":"2024-09-21T03:14:37.469799+0000","last_active":"2024-09-21T03:15:15.681857+0000","last_peered":"2024-09-21T03:15:15.681857+0000","last_clean":"2024-09-21T03:15:15.681857+0000","last_became_active":"2024-09-21T03:14:37.469495+0000","last_became_peered":"2024-09-21T03:14:37.469495+0000","last_unstale":"2024-09-21T03:15:15.681857+0000","last_undegraded":"2024-09-21T03:15:15.681857+0000","last_fullsized":"2024-09-21T03:15:15.681857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:50.247050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678991+0000","last_change":"2024-09-21T03:14:46.544320+0000","last_active":"2024-09-21T03:15:15.678991+0000","last_peered":"2024-09-21T03:15:15.678991+0000","last_clean":"2024-09-21T03:15:15.678991+0000","last_became_active":"2024-09-21T03:14:46.544038+0000","last_became_peered":"2024-09-21T03:14:46.544038+0000","last_unstale":"2024-09-21T03:15:15.678991+0000","last_undegraded":"2024-09-21T03:15:15.678991+0000","last_fullsized":"2024-09-21T03:15:15.678991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:57.457687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684713+0000","last_change":"2024-09-21T03:14:47.579698+0000","last_active":"2024-09-21T03:15:15.684713+0000","last_peered":"2024-09-21T03:15:15.684713+0000","last_clean":"2024-09-21T03:15:15.684713+0000","last_became_active":"2024-09-21T03:14:47.579324+0000","last_became_peered":"2024-09-21T03:14:47.579324+0000","last_unstale":"2024-09-21T03:15:15.684713+0000","last_undegraded":"2024-09-21T03:15:15.684713+0000","last_fullsized":"2024-09-21T03:15:15.684713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:37.656859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681701+0000","last_change":"2024-09-21T03:14:38.476763+0000","last_active":"2024-09-21T03:15:15.681701+0000","last_peered":"2024-09-21T03:15:15.681701+0000","last_clean":"2024-09-21T03:15:15.681701+0000","last_became_active":"2024-09-21T03:14:38.474299+0000","last_became_peered":"2024-09-21T03:14:38.474299+0000","last_unstale":"2024-09-21T03:15:15.681701+0000","last_undegraded":"2024-09-21T03:15:15.681701+0000","last_fullsized":"2024-09-21T03:15:15.681701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:46.544930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683744+0000","last_change":"2024-09-21T03:14:37.466857+0000","last_active":"2024-09-21T03:15:15.683744+0000","last_peered":"2024-09-21T03:15:15.683744+0000","last_clean":"2024-09-21T03:15:15.683744+0000","last_became_active":"2024-09-21T03:14:37.466256+0000","last_became_peered":"2024-09-21T03:14:37.466256+0000","last_unstale":"2024-09-21T03:15:15.683744+0000","last_undegraded":"2024-09-21T03:15:15.683744+0000","last_fullsized":"2024-09-21T03:15:15.683744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:02.240461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679929+0000","last_change":"2024-09-21T03:14:46.537315+0000","last_active":"2024-09-21T03:15:15.679929+0000","last_peered":"2024-09-21T03:15:15.679929+0000","last_clean":"2024-09-21T03:15:15.679929+0000","last_became_active":"2024-09-21T03:14:46.536975+0000","last_became_peered":"2024-09-21T03:14:46.536975+0000","last_unstale":"2024-09-21T03:15:15.679929+0000","last_undegraded":"2024-09-21T03:15:15.679929+0000","last_fullsized":"2024-09-21T03:15:15.679929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:42.529591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.685045+0000","last_change":"2024-09-21T03:14:47.573009+0000","last_active":"2024-09-21T03:15:15.685045+0000","last_peered":"2024-09-21T03:15:15.685045+0000","last_clean":"2024-09-21T03:15:15.685045+0000","last_became_active":"2024-09-21T03:14:47.572395+0000","last_became_peered":"2024-09-21T03:14:47.572395+0000","last_unstale":"2024-09-21T03:15:15.685045+0000","last_undegraded":"2024-09-21T03:15:15.685045+0000","last_fullsized":"2024-09-21T03:15:15.685045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:41.733447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678985+0000","last_change":"2024-09-21T03:14:38.481801+0000","last_active":"2024-09-21T03:15:15.678985+0000","last_peered":"2024-09-21T03:15:15.678985+0000","last_clean":"2024-09-21T03:15:15.678985+0000","last_became_active":"2024-09-21T03:14:38.481186+0000","last_became_peered":"2024-09-21T03:14:38.481186+0000","last_unstale":"2024-09-21T03:15:15.678985+0000","last_undegraded":"2024-09-21T03:15:15.678985+0000","last_fullsized":"2024-09-21T03:15:15.678985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:54.271470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683612+0000","last_change":"2024-09-21T03:14:37.474798+0000","last_active":"2024-09-21T03:15:15.683612+0000","last_peered":"2024-09-21T03:15:15.683612+0000","last_clean":"2024-09-21T03:15:15.683612+0000","last_became_active":"2024-09-21T03:14:37.473829+0000","last_became_peered":"2024-09-21T03:14:37.473829+0000","last_unstale":"2024-09-21T03:15:15.683612+0000","last_undegraded":"2024-09-21T03:15:15.683612+0000","last_fullsized":"2024-09-21T03:15:15.683612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:11.571814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680441+0000","last_change":"2024-09-21T03:14:46.542495+0000","last_active":"2024-09-21T03:15:15.680441+0000","last_peered":"2024-09-21T03:15:15.680441+0000","last_clean":"2024-09-21T03:15:15.680441+0000","last_became_active":"2024-09-21T03:14:46.542181+0000","last_became_peered":"2024-09-21T03:14:46.542181+0000","last_unstale":"2024-09-21T03:15:15.680441+0000","last_undegraded":"2024-09-21T03:15:15.680441+0000","last_fullsized":"2024-09-21T03:15:15.680441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:22.481477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683913+0000","last_change":"2024-09-21T03:14:47.569409+0000","last_active":"2024-09-21T03:15:15.683913+0000","last_peered":"2024-09-21T03:15:15.683913+0000","last_clean":"2024-09-21T03:15:15.683913+0000","last_became_active":"2024-09-21T03:14:47.569212+0000","last_became_peered":"2024-09-21T03:14:47.569212+0000","last_unstale":"2024-09-21T03:15:15.683913+0000","last_undegraded":"2024-09-21T03:15:15.683913+0000","last_fullsized":"2024-09-21T03:15:15.683913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.851943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678578+0000","last_change":"2024-09-21T03:14:38.480026+0000","last_active":"2024-09-21T03:15:15.678578+0000","last_peered":"2024-09-21T03:15:15.678578+0000","last_clean":"2024-09-21T03:15:15.678578+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:15:15.678578+0000","last_undegraded":"2024-09-21T03:15:15.678578+0000","last_fullsized":"2024-09-21T03:15:15.678578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:20.481816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683069+0000","last_change":"2024-09-21T03:14:37.464554+0000","last_active":"2024-09-21T03:15:15.683069+0000","last_peered":"2024-09-21T03:15:15.683069+0000","last_clean":"2024-09-21T03:15:15.683069+0000","last_became_active":"2024-09-21T03:14:37.464228+0000","last_became_peered":"2024-09-21T03:14:37.464228+0000","last_unstale":"2024-09-21T03:15:15.683069+0000","last_undegraded":"2024-09-21T03:15:15.683069+0000","last_fullsized":"2024-09-21T03:15:15.683069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:32.529512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680429+0000","last_change":"2024-09-21T03:14:46.538538+0000","last_active":"2024-09-21T03:15:15.680429+0000","last_peered":"2024-09-21T03:15:15.680429+0000","last_clean":"2024-09-21T03:15:15.680429+0000","last_became_active":"2024-09-21T03:14:46.537815+0000","last_became_peered":"2024-09-21T03:14:46.537815+0000","last_unstale":"2024-09-21T03:15:15.680429+0000","last_undegraded":"2024-09-21T03:15:15.680429+0000","last_fullsized":"2024-09-21T03:15:15.680429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:42.264439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680898+0000","last_change":"2024-09-21T03:14:47.558861+0000","last_active":"2024-09-21T03:15:15.680898+0000","last_peered":"2024-09-21T03:15:15.680898+0000","last_clean":"2024-09-21T03:15:15.680898+0000","last_became_active":"2024-09-21T03:14:47.557305+0000","last_became_peered":"2024-09-21T03:14:47.557305+0000","last_unstale":"2024-09-21T03:15:15.680898+0000","last_undegraded":"2024-09-21T03:15:15.680898+0000","last_fullsized":"2024-09-21T03:15:15.680898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:45.962367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805521+0000","last_change":"2024-09-21T03:14:38.479181+0000","last_active":"2024-09-21T03:15:15.805521+0000","last_peered":"2024-09-21T03:15:15.805521+0000","last_clean":"2024-09-21T03:15:15.805521+0000","last_became_active":"2024-09-21T03:14:38.478842+0000","last_became_peered":"2024-09-21T03:14:38.478842+0000","last_unstale":"2024-09-21T03:15:15.805521+0000","last_undegraded":"2024-09-21T03:15:15.805521+0000","last_fullsized":"2024-09-21T03:15:15.805521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:08.664381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683767+0000","last_change":"2024-09-21T03:14:37.463990+0000","last_active":"2024-09-21T03:15:15.683767+0000","last_peered":"2024-09-21T03:15:15.683767+0000","last_clean":"2024-09-21T03:15:15.683767+0000","last_became_active":"2024-09-21T03:14:37.463674+0000","last_became_peered":"2024-09-21T03:14:37.463674+0000","last_unstale":"2024-09-21T03:15:15.683767+0000","last_undegraded":"2024-09-21T03:15:15.683767+0000","last_fullsized":"2024-09-21T03:15:15.683767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:35.391985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804527+0000","last_change":"2024-09-21T03:14:26.342355+0000","last_active":"2024-09-21T03:15:15.804527+0000","last_peered":"2024-09-21T03:15:15.804527+0000","last_clean":"2024-09-21T03:15:15.804527+0000","last_became_active":"2024-09-21T03:14:26.341929+0000","last_became_peered":"2024-09-21T03:14:26.341929+0000","last_unstale":"2024-09-21T03:15:15.804527+0000","last_undegraded":"2024-09-21T03:15:15.804527+0000","last_fullsized":"2024-09-21T03:15:15.804527+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_clean_scrub_stamp":"2024-09-21T03:14:25.329650+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:45.390822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684877+0000","last_change":"2024-09-21T03:14:46.538184+0000","last_active":"2024-09-21T03:15:15.684877+0000","last_peered":"2024-09-21T03:15:15.684877+0000","last_clean":"2024-09-21T03:15:15.684877+0000","last_became_active":"2024-09-21T03:14:46.536753+0000","last_became_peered":"2024-09-21T03:14:46.536753+0000","last_unstale":"2024-09-21T03:15:15.684877+0000","last_undegraded":"2024-09-21T03:15:15.684877+0000","last_fullsized":"2024-09-21T03:15:15.684877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:49.078638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680743+0000","last_change":"2024-09-21T03:14:47.552966+0000","last_active":"2024-09-21T03:15:15.680743+0000","last_peered":"2024-09-21T03:15:15.680743+0000","last_clean":"2024-09-21T03:15:15.680743+0000","last_became_active":"2024-09-21T03:14:47.552642+0000","last_became_peered":"2024-09-21T03:14:47.552642+0000","last_unstale":"2024-09-21T03:15:15.680743+0000","last_undegraded":"2024-09-21T03:15:15.680743+0000","last_fullsized":"2024-09-21T03:15:15.680743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:15.928026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684961+0000","last_change":"2024-09-21T03:14:38.478414+0000","last_active":"2024-09-21T03:15:15.684961+0000","last_peered":"2024-09-21T03:15:15.684961+0000","last_clean":"2024-09-21T03:15:15.684961+0000","last_became_active":"2024-09-21T03:14:38.478116+0000","last_became_peered":"2024-09-21T03:14:38.478116+0000","last_unstale":"2024-09-21T03:15:15.684961+0000","last_undegraded":"2024-09-21T03:15:15.684961+0000","last_fullsized":"2024-09-21T03:15:15.684961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:29.618008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680297+0000","last_change":"2024-09-21T03:14:37.479578+0000","last_active":"2024-09-21T03:15:15.680297+0000","last_peered":"2024-09-21T03:15:15.680297+0000","last_clean":"2024-09-21T03:15:15.680297+0000","last_became_active":"2024-09-21T03:14:37.479284+0000","last_became_peered":"2024-09-21T03:14:37.479284+0000","last_unstale":"2024-09-21T03:15:15.680297+0000","last_undegraded":"2024-09-21T03:15:15.680297+0000","last_fullsized":"2024-09-21T03:15:15.680297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:15.732230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677624+0000","last_change":"2024-09-21T03:14:46.531536+0000","last_active":"2024-09-21T03:15:15.677624+0000","last_peered":"2024-09-21T03:15:15.677624+0000","last_clean":"2024-09-21T03:15:15.677624+0000","last_became_active":"2024-09-21T03:14:46.531069+0000","last_became_peered":"2024-09-21T03:14:46.531069+0000","last_unstale":"2024-09-21T03:15:15.677624+0000","last_undegraded":"2024-09-21T03:15:15.677624+0000","last_fullsized":"2024-09-21T03:15:15.677624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:14.050618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678862+0000","last_change":"2024-09-21T03:14:47.553039+0000","last_active":"2024-09-21T03:15:15.678862+0000","last_peered":"2024-09-21T03:15:15.678862+0000","last_clean":"2024-09-21T03:15:15.678862+0000","last_became_active":"2024-09-21T03:14:47.552712+0000","last_became_peered":"2024-09-21T03:14:47.552712+0000","last_unstale":"2024-09-21T03:15:15.678862+0000","last_undegraded":"2024-09-21T03:15:15.678862+0000","last_fullsized":"2024-09-21T03:15:15.678862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:32.630319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681782+0000","last_change":"2024-09-21T03:14:38.488259+0000","last_active":"2024-09-21T03:15:15.681782+0000","last_peered":"2024-09-21T03:15:15.681782+0000","last_clean":"2024-09-21T03:15:15.681782+0000","last_became_active":"2024-09-21T03:14:38.487420+0000","last_became_peered":"2024-09-21T03:14:38.487420+0000","last_unstale":"2024-09-21T03:15:15.681782+0000","last_undegraded":"2024-09-21T03:15:15.681782+0000","last_fullsized":"2024-09-21T03:15:15.681782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:48.003893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681753+0000","last_change":"2024-09-21T03:14:37.460763+0000","last_active":"2024-09-21T03:15:15.681753+0000","last_peered":"2024-09-21T03:15:15.681753+0000","last_clean":"2024-09-21T03:15:15.681753+0000","last_became_active":"2024-09-21T03:14:37.460320+0000","last_became_peered":"2024-09-21T03:14:37.460320+0000","last_unstale":"2024-09-21T03:15:15.681753+0000","last_undegraded":"2024-09-21T03:15:15.681753+0000","last_fullsized":"2024-09-21T03:15:15.681753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.907794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681101+0000","last_change":"2024-09-21T03:14:46.540901+0000","last_active":"2024-09-21T03:15:15.681101+0000","last_peered":"2024-09-21T03:15:15.681101+0000","last_clean":"2024-09-21T03:15:15.681101+0000","last_became_active":"2024-09-21T03:14:46.540182+0000","last_became_peered":"2024-09-21T03:14:46.540182+0000","last_unstale":"2024-09-21T03:15:15.681101+0000","last_undegraded":"2024-09-21T03:15:15.681101+0000","last_fullsized":"2024-09-21T03:15:15.681101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:38.416663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804362+0000","last_change":"2024-09-21T03:14:47.553810+0000","last_active":"2024-09-21T03:15:15.804362+0000","last_peered":"2024-09-21T03:15:15.804362+0000","last_clean":"2024-09-21T03:15:15.804362+0000","last_became_active":"2024-09-21T03:14:47.552371+0000","last_became_peered":"2024-09-21T03:14:47.552371+0000","last_unstale":"2024-09-21T03:15:15.804362+0000","last_undegraded":"2024-09-21T03:15:15.804362+0000","last_fullsized":"2024-09-21T03:15:15.804362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:38.659512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681305+0000","last_change":"2024-09-21T03:14:38.480629+0000","last_active":"2024-09-21T03:15:15.681305+0000","last_peered":"2024-09-21T03:15:15.681305+0000","last_clean":"2024-09-21T03:15:15.681305+0000","last_became_active":"2024-09-21T03:14:38.474135+0000","last_became_peered":"2024-09-21T03:14:38.474135+0000","last_unstale":"2024-09-21T03:15:15.681305+0000","last_undegraded":"2024-09-21T03:15:15.681305+0000","last_fullsized":"2024-09-21T03:15:15.681305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:36.171044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806268+0000","last_change":"2024-09-21T03:14:37.472491+0000","last_active":"2024-09-21T03:15:15.806268+0000","last_peered":"2024-09-21T03:15:15.806268+0000","last_clean":"2024-09-21T03:15:15.806268+0000","last_became_active":"2024-09-21T03:14:37.472164+0000","last_became_peered":"2024-09-21T03:14:37.472164+0000","last_unstale":"2024-09-21T03:15:15.806268+0000","last_undegraded":"2024-09-21T03:15:15.806268+0000","last_fullsized":"2024-09-21T03:15:15.806268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.498178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.682823+0000","last_change":"2024-09-21T03:14:46.544828+0000","last_active":"2024-09-21T03:15:15.682823+0000","last_peered":"2024-09-21T03:15:15.682823+0000","last_clean":"2024-09-21T03:15:15.682823+0000","last_became_active":"2024-09-21T03:14:46.535901+0000","last_became_peered":"2024-09-21T03:14:46.535901+0000","last_unstale":"2024-09-21T03:15:15.682823+0000","last_undegraded":"2024-09-21T03:15:15.682823+0000","last_fullsized":"2024-09-21T03:15:15.682823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:08.608530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678214+0000","last_change":"2024-09-21T03:14:47.556478+0000","last_active":"2024-09-21T03:15:15.678214+0000","last_peered":"2024-09-21T03:15:15.678214+0000","last_clean":"2024-09-21T03:15:15.678214+0000","last_became_active":"2024-09-21T03:14:47.556145+0000","last_became_peered":"2024-09-21T03:14:47.556145+0000","last_unstale":"2024-09-21T03:15:15.678214+0000","last_undegraded":"2024-09-21T03:15:15.678214+0000","last_fullsized":"2024-09-21T03:15:15.678214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:59.004648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678670+0000","last_change":"2024-09-21T03:14:38.469502+0000","last_active":"2024-09-21T03:15:15.678670+0000","last_peered":"2024-09-21T03:15:15.678670+0000","last_clean":"2024-09-21T03:15:15.678670+0000","last_became_active":"2024-09-21T03:14:38.468972+0000","last_became_peered":"2024-09-21T03:14:38.468972+0000","last_unstale":"2024-09-21T03:15:15.678670+0000","last_undegraded":"2024-09-21T03:15:15.678670+0000","last_fullsized":"2024-09-21T03:15:15.678670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681340+0000","last_change":"2024-09-21T03:14:37.480905+0000","last_active":"2024-09-21T03:15:15.681340+0000","last_peered":"2024-09-21T03:15:15.681340+0000","last_clean":"2024-09-21T03:15:15.681340+0000","last_became_active":"2024-09-21T03:14:37.478227+0000","last_became_peered":"2024-09-21T03:14:37.478227+0000","last_unstale":"2024-09-21T03:15:15.681340+0000","last_undegraded":"2024-09-21T03:15:15.681340+0000","last_fullsized":"2024-09-21T03:15:15.681340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:42.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804534+0000","last_change":"2024-09-21T03:14:46.536103+0000","last_active":"2024-09-21T03:15:15.804534+0000","last_peered":"2024-09-21T03:15:15.804534+0000","last_clean":"2024-09-21T03:15:15.804534+0000","last_became_active":"2024-09-21T03:14:46.535445+0000","last_became_peered":"2024-09-21T03:14:46.535445+0000","last_unstale":"2024-09-21T03:15:15.804534+0000","last_undegraded":"2024-09-21T03:15:15.804534+0000","last_fullsized":"2024-09-21T03:15:15.804534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:59.078000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806222+0000","last_change":"2024-09-21T03:14:47.557503+0000","last_active":"2024-09-21T03:15:15.806222+0000","last_peered":"2024-09-21T03:15:15.806222+0000","last_clean":"2024-09-21T03:15:15.806222+0000","last_became_active":"2024-09-21T03:14:47.554366+0000","last_became_peered":"2024-09-21T03:14:47.554366+0000","last_unstale":"2024-09-21T03:15:15.806222+0000","last_undegraded":"2024-09-21T03:15:15.806222+0000","last_fullsized":"2024-09-21T03:15:15.806222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.994560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683225+0000","last_change":"2024-09-21T03:14:38.479516+0000","last_active":"2024-09-21T03:15:15.683225+0000","last_peered":"2024-09-21T03:15:15.683225+0000","last_clean":"2024-09-21T03:15:15.683225+0000","last_became_active":"2024-09-21T03:14:38.474826+0000","last_became_peered":"2024-09-21T03:14:38.474826+0000","last_unstale":"2024-09-21T03:15:15.683225+0000","last_undegraded":"2024-09-21T03:15:15.683225+0000","last_fullsized":"2024-09-21T03:15:15.683225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:22.181411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805649+0000","last_change":"2024-09-21T03:14:37.471063+0000","last_active":"2024-09-21T03:15:15.805649+0000","last_peered":"2024-09-21T03:15:15.805649+0000","last_clean":"2024-09-21T03:15:15.805649+0000","last_became_active":"2024-09-21T03:14:37.470720+0000","last_became_peered":"2024-09-21T03:14:37.470720+0000","last_unstale":"2024-09-21T03:15:15.805649+0000","last_undegraded":"2024-09-21T03:15:15.805649+0000","last_fullsized":"2024-09-21T03:15:15.805649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:00.054692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679915+0000","last_change":"2024-09-21T03:14:46.538665+0000","last_active":"2024-09-21T03:15:15.679915+0000","last_peered":"2024-09-21T03:15:15.679915+0000","last_clean":"2024-09-21T03:15:15.679915+0000","last_became_active":"2024-09-21T03:14:46.537774+0000","last_became_peered":"2024-09-21T03:14:46.537774+0000","last_unstale":"2024-09-21T03:15:15.679915+0000","last_undegraded":"2024-09-21T03:15:15.679915+0000","last_fullsized":"2024-09-21T03:15:15.679915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:07.736404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683850+0000","last_change":"2024-09-21T03:14:47.553011+0000","last_active":"2024-09-21T03:15:15.683850+0000","last_peered":"2024-09-21T03:15:15.683850+0000","last_clean":"2024-09-21T03:15:15.683850+0000","last_became_active":"2024-09-21T03:14:47.552700+0000","last_became_peered":"2024-09-21T03:14:47.552700+0000","last_unstale":"2024-09-21T03:15:15.683850+0000","last_undegraded":"2024-09-21T03:15:15.683850+0000","last_fullsized":"2024-09-21T03:15:15.683850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:58.780132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804436+0000","last_change":"2024-09-21T03:14:38.472906+0000","last_active":"2024-09-21T03:15:15.804436+0000","last_peered":"2024-09-21T03:15:15.804436+0000","last_clean":"2024-09-21T03:15:15.804436+0000","last_became_active":"2024-09-21T03:14:38.471933+0000","last_became_peered":"2024-09-21T03:14:38.471933+0000","last_unstale":"2024-09-21T03:15:15.804436+0000","last_undegraded":"2024-09-21T03:15:15.804436+0000","last_fullsized":"2024-09-21T03:15:15.804436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:05.395821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680585+0000","last_change":"2024-09-21T03:14:37.478714+0000","last_active":"2024-09-21T03:15:15.680585+0000","last_peered":"2024-09-21T03:15:15.680585+0000","last_clean":"2024-09-21T03:15:15.680585+0000","last_became_active":"2024-09-21T03:14:37.477951+0000","last_became_peered":"2024-09-21T03:14:37.477951+0000","last_unstale":"2024-09-21T03:15:15.680585+0000","last_undegraded":"2024-09-21T03:15:15.680585+0000","last_fullsized":"2024-09-21T03:15:15.680585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:42.529545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680921+0000","last_change":"2024-09-21T03:14:46.546142+0000","last_active":"2024-09-21T03:15:15.680921+0000","last_peered":"2024-09-21T03:15:15.680921+0000","last_clean":"2024-09-21T03:15:15.680921+0000","last_became_active":"2024-09-21T03:14:46.545865+0000","last_became_peered":"2024-09-21T03:14:46.545865+0000","last_unstale":"2024-09-21T03:15:15.680921+0000","last_undegraded":"2024-09-21T03:15:15.680921+0000","last_fullsized":"2024-09-21T03:15:15.680921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:11.705309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684139+0000","last_change":"2024-09-21T03:14:47.568961+0000","last_active":"2024-09-21T03:15:15.684139+0000","last_peered":"2024-09-21T03:15:15.684139+0000","last_clean":"2024-09-21T03:15:15.684139+0000","last_became_active":"2024-09-21T03:14:47.568656+0000","last_became_peered":"2024-09-21T03:14:47.568656+0000","last_unstale":"2024-09-21T03:15:15.684139+0000","last_undegraded":"2024-09-21T03:15:15.684139+0000","last_fullsized":"2024-09-21T03:15:15.684139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.041710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683494+0000","last_change":"2024-09-21T03:14:38.485454+0000","last_active":"2024-09-21T03:15:15.683494+0000","last_peered":"2024-09-21T03:15:15.683494+0000","last_clean":"2024-09-21T03:15:15.683494+0000","last_became_active":"2024-09-21T03:14:38.485235+0000","last_became_peered":"2024-09-21T03:14:38.485235+0000","last_unstale":"2024-09-21T03:15:15.683494+0000","last_undegraded":"2024-09-21T03:15:15.683494+0000","last_fullsized":"2024-09-21T03:15:15.683494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:11.585637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683663+0000","last_change":"2024-09-21T03:14:37.466544+0000","last_active":"2024-09-21T03:15:15.683663+0000","last_peered":"2024-09-21T03:15:15.683663+0000","last_clean":"2024-09-21T03:15:15.683663+0000","last_became_active":"2024-09-21T03:14:37.465817+0000","last_became_peered":"2024-09-21T03:14:37.465817+0000","last_unstale":"2024-09-21T03:15:15.683663+0000","last_undegraded":"2024-09-21T03:15:15.683663+0000","last_fullsized":"2024-09-21T03:15:15.683663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:36.113483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"25'9","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679930+0000","last_change":"2024-09-21T03:14:46.549921+0000","last_active":"2024-09-21T03:15:15.679930+0000","last_peered":"2024-09-21T03:15:15.679930+0000","last_clean":"2024-09-21T03:15:15.679930+0000","last_became_active":"2024-09-21T03:14:46.549119+0000","last_became_peered":"2024-09-21T03:14:46.549119+0000","last_unstale":"2024-09-21T03:15:15.679930+0000","last_undegraded":"2024-09-21T03:15:15.679930+0000","last_fullsized":"2024-09-21T03:15:15.679930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:09.622498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2858,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.691871+0000","last_change":"2024-09-21T03:15:15.687659+0000","last_active":"2024-09-21T03:15:15.691871+0000","last_peered":"2024-09-21T03:15:15.691871+0000","last_clean":"2024-09-21T03:15:15.691871+0000","last_became_active":"2024-09-21T03:15:15.687225+0000","last_became_peered":"2024-09-21T03:15:15.687225+0000","last_unstale":"2024-09-21T03:15:15.691871+0000","last_undegraded":"2024-09-21T03:15:15.691871+0000","last_fullsized":"2024-09-21T03:15:15.691871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:56.395767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679571+0000","last_change":"2024-09-21T03:14:38.482528+0000","last_active":"2024-09-21T03:15:15.679571+0000","last_peered":"2024-09-21T03:15:15.679571+0000","last_clean":"2024-09-21T03:15:15.679571+0000","last_became_active":"2024-09-21T03:14:38.482241+0000","last_became_peered":"2024-09-21T03:14:38.482241+0000","last_unstale":"2024-09-21T03:15:15.679571+0000","last_undegraded":"2024-09-21T03:15:15.679571+0000","last_fullsized":"2024-09-21T03:15:15.679571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:23.110703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684414+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:15:15.684414+0000","last_peered":"2024-09-21T03:15:15.684414+0000","last_clean":"2024-09-21T03:15:15.684414+0000","last_became_active":"2024-09-21T03:14:37.478882+0000","last_became_peered":"2024-09-21T03:14:37.478882+0000","last_unstale":"2024-09-21T03:15:15.684414+0000","last_undegraded":"2024-09-21T03:15:15.684414+0000","last_fullsized":"2024-09-21T03:15:15.684414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:11.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684615+0000","last_change":"2024-09-21T03:14:46.538817+0000","last_active":"2024-09-21T03:15:15.684615+0000","last_peered":"2024-09-21T03:15:15.684615+0000","last_clean":"2024-09-21T03:15:15.684615+0000","last_became_active":"2024-09-21T03:14:46.537835+0000","last_became_peered":"2024-09-21T03:14:46.537835+0000","last_unstale":"2024-09-21T03:15:15.684615+0000","last_undegraded":"2024-09-21T03:15:15.684615+0000","last_fullsized":"2024-09-21T03:15:15.684615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:08.236663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805566+0000","last_change":"2024-09-21T03:14:47.566534+0000","last_active":"2024-09-21T03:15:15.805566+0000","last_peered":"2024-09-21T03:15:15.805566+0000","last_clean":"2024-09-21T03:15:15.805566+0000","last_became_active":"2024-09-21T03:14:47.566157+0000","last_became_peered":"2024-09-21T03:14:47.566157+0000","last_unstale":"2024-09-21T03:15:15.805566+0000","last_undegraded":"2024-09-21T03:15:15.805566+0000","last_fullsized":"2024-09-21T03:15:15.805566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:35.557811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681246+0000","last_change":"2024-09-21T03:14:38.478509+0000","last_active":"2024-09-21T03:15:15.681246+0000","last_peered":"2024-09-21T03:15:15.681246+0000","last_clean":"2024-09-21T03:15:15.681246+0000","last_became_active":"2024-09-21T03:14:38.478197+0000","last_became_peered":"2024-09-21T03:14:38.478197+0000","last_unstale":"2024-09-21T03:15:15.681246+0000","last_undegraded":"2024-09-21T03:15:15.681246+0000","last_fullsized":"2024-09-21T03:15:15.681246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.411134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677857+0000","last_change":"2024-09-21T03:14:37.472695+0000","last_active":"2024-09-21T03:15:15.677857+0000","last_peered":"2024-09-21T03:15:15.677857+0000","last_clean":"2024-09-21T03:15:15.677857+0000","last_became_active":"2024-09-21T03:14:37.472374+0000","last_became_peered":"2024-09-21T03:14:37.472374+0000","last_unstale":"2024-09-21T03:15:15.677857+0000","last_undegraded":"2024-09-21T03:15:15.677857+0000","last_fullsized":"2024-09-21T03:15:15.677857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:11.245914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2858,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805279+0000","last_change":"2024-09-21T03:14:46.547433+0000","last_active":"2024-09-21T03:15:15.805279+0000","last_peered":"2024-09-21T03:15:15.805279+0000","last_clean":"2024-09-21T03:15:15.805279+0000","last_became_active":"2024-09-21T03:14:46.547192+0000","last_became_peered":"2024-09-21T03:14:46.547192+0000","last_unstale":"2024-09-21T03:15:15.805279+0000","last_undegraded":"2024-09-21T03:15:15.805279+0000","last_fullsized":"2024-09-21T03:15:15.805279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:03.238245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679116+0000","last_change":"2024-09-21T03:14:47.545827+0000","last_active":"2024-09-21T03:15:15.679116+0000","last_peered":"2024-09-21T03:15:15.679116+0000","last_clean":"2024-09-21T03:15:15.679116+0000","last_became_active":"2024-09-21T03:14:47.545440+0000","last_became_peered":"2024-09-21T03:14:47.545440+0000","last_unstale":"2024-09-21T03:15:15.679116+0000","last_undegraded":"2024-09-21T03:15:15.679116+0000","last_fullsized":"2024-09-21T03:15:15.679116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:20.532645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683766+0000","last_change":"2024-09-21T03:14:38.476564+0000","last_active":"2024-09-21T03:15:15.683766+0000","last_peered":"2024-09-21T03:15:15.683766+0000","last_clean":"2024-09-21T03:15:15.683766+0000","last_became_active":"2024-09-21T03:14:38.476158+0000","last_became_peered":"2024-09-21T03:14:38.476158+0000","last_unstale":"2024-09-21T03:15:15.683766+0000","last_undegraded":"2024-09-21T03:15:15.683766+0000","last_fullsized":"2024-09-21T03:15:15.683766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:26.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684904+0000","last_change":"2024-09-21T03:14:37.473709+0000","last_active":"2024-09-21T03:15:15.684904+0000","last_peered":"2024-09-21T03:15:15.684904+0000","last_clean":"2024-09-21T03:15:15.684904+0000","last_became_active":"2024-09-21T03:14:37.472544+0000","last_became_peered":"2024-09-21T03:14:37.472544+0000","last_unstale":"2024-09-21T03:15:15.684904+0000","last_undegraded":"2024-09-21T03:15:15.684904+0000","last_fullsized":"2024-09-21T03:15:15.684904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:47.892146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677701+0000","last_change":"2024-09-21T03:14:46.534201+0000","last_active":"2024-09-21T03:15:15.677701+0000","last_peered":"2024-09-21T03:15:15.677701+0000","last_clean":"2024-09-21T03:15:15.677701+0000","last_became_active":"2024-09-21T03:14:46.533891+0000","last_became_peered":"2024-09-21T03:14:46.533891+0000","last_unstale":"2024-09-21T03:15:15.677701+0000","last_undegraded":"2024-09-21T03:15:15.677701+0000","last_fullsized":"2024-09-21T03:15:15.677701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:06.645173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.682937+0000","last_change":"2024-09-21T03:14:47.552016+0000","last_active":"2024-09-21T03:15:15.682937+0000","last_peered":"2024-09-21T03:15:15.682937+0000","last_clean":"2024-09-21T03:15:15.682937+0000","last_became_active":"2024-09-21T03:14:47.551622+0000","last_became_peered":"2024-09-21T03:14:47.551622+0000","last_unstale":"2024-09-21T03:15:15.682937+0000","last_undegraded":"2024-09-21T03:15:15.682937+0000","last_fullsized":"2024-09-21T03:15:15.682937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:56:04.849535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681489+0000","last_change":"2024-09-21T03:14:38.484757+0000","last_active":"2024-09-21T03:15:15.681489+0000","last_peered":"2024-09-21T03:15:15.681489+0000","last_clean":"2024-09-21T03:15:15.681489+0000","last_became_active":"2024-09-21T03:14:38.483348+0000","last_became_peered":"2024-09-21T03:14:38.483348+0000","last_unstale":"2024-09-21T03:15:15.681489+0000","last_undegraded":"2024-09-21T03:15:15.681489+0000","last_fullsized":"2024-09-21T03:15:15.681489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:57.697723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681239+0000","last_change":"2024-09-21T03:14:37.479047+0000","last_active":"2024-09-21T03:15:15.681239+0000","last_peered":"2024-09-21T03:15:15.681239+0000","last_clean":"2024-09-21T03:15:15.681239+0000","last_became_active":"2024-09-21T03:14:37.478700+0000","last_became_peered":"2024-09-21T03:14:37.478700+0000","last_unstale":"2024-09-21T03:15:15.681239+0000","last_undegraded":"2024-09-21T03:15:15.681239+0000","last_fullsized":"2024-09-21T03:15:15.681239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:31.702450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.682880+0000","last_change":"2024-09-21T03:14:46.547287+0000","last_active":"2024-09-21T03:15:15.682880+0000","last_peered":"2024-09-21T03:15:15.682880+0000","last_clean":"2024-09-21T03:15:15.682880+0000","last_became_active":"2024-09-21T03:14:46.546867+0000","last_became_peered":"2024-09-21T03:14:46.546867+0000","last_unstale":"2024-09-21T03:15:15.682880+0000","last_undegraded":"2024-09-21T03:15:15.682880+0000","last_fullsized":"2024-09-21T03:15:15.682880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:54.119841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677259+0000","last_change":"2024-09-21T03:14:47.558571+0000","last_active":"2024-09-21T03:15:15.677259+0000","last_peered":"2024-09-21T03:15:15.677259+0000","last_clean":"2024-09-21T03:15:15.677259+0000","last_became_active":"2024-09-21T03:14:47.558037+0000","last_became_peered":"2024-09-21T03:14:47.558037+0000","last_unstale":"2024-09-21T03:15:15.677259+0000","last_undegraded":"2024-09-21T03:15:15.677259+0000","last_fullsized":"2024-09-21T03:15:15.677259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:42.564181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678774+0000","last_change":"2024-09-21T03:14:38.488227+0000","last_active":"2024-09-21T03:15:15.678774+0000","last_peered":"2024-09-21T03:15:15.678774+0000","last_clean":"2024-09-21T03:15:15.678774+0000","last_became_active":"2024-09-21T03:14:38.482370+0000","last_became_peered":"2024-09-21T03:14:38.482370+0000","last_unstale":"2024-09-21T03:15:15.678774+0000","last_undegraded":"2024-09-21T03:15:15.678774+0000","last_fullsized":"2024-09-21T03:15:15.678774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:52.561391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805382+0000","last_change":"2024-09-21T03:14:37.471363+0000","last_active":"2024-09-21T03:15:15.805382+0000","last_peered":"2024-09-21T03:15:15.805382+0000","last_clean":"2024-09-21T03:15:15.805382+0000","last_became_active":"2024-09-21T03:14:37.471002+0000","last_became_peered":"2024-09-21T03:14:37.471002+0000","last_unstale":"2024-09-21T03:15:15.805382+0000","last_undegraded":"2024-09-21T03:15:15.805382+0000","last_fullsized":"2024-09-21T03:15:15.805382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:25.922368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805008+0000","last_change":"2024-09-21T03:14:46.545186+0000","last_active":"2024-09-21T03:15:15.805008+0000","last_peered":"2024-09-21T03:15:15.805008+0000","last_clean":"2024-09-21T03:15:15.805008+0000","last_became_active":"2024-09-21T03:14:46.543647+0000","last_became_peered":"2024-09-21T03:14:46.543647+0000","last_unstale":"2024-09-21T03:15:15.805008+0000","last_undegraded":"2024-09-21T03:15:15.805008+0000","last_fullsized":"2024-09-21T03:15:15.805008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:03.097368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678464+0000","last_change":"2024-09-21T03:14:47.554766+0000","last_active":"2024-09-21T03:15:15.678464+0000","last_peered":"2024-09-21T03:15:15.678464+0000","last_clean":"2024-09-21T03:15:15.678464+0000","last_became_active":"2024-09-21T03:14:47.551563+0000","last_became_peered":"2024-09-21T03:14:47.551563+0000","last_unstale":"2024-09-21T03:15:15.678464+0000","last_undegraded":"2024-09-21T03:15:15.678464+0000","last_fullsized":"2024-09-21T03:15:15.678464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:08.790725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805982+0000","last_change":"2024-09-21T03:14:46.542659+0000","last_active":"2024-09-21T03:15:15.805982+0000","last_peered":"2024-09-21T03:15:15.805982+0000","last_clean":"2024-09-21T03:15:15.805982+0000","last_became_active":"2024-09-21T03:14:46.541771+0000","last_became_peered":"2024-09-21T03:14:46.541771+0000","last_unstale":"2024-09-21T03:15:15.805982+0000","last_undegraded":"2024-09-21T03:15:15.805982+0000","last_fullsized":"2024-09-21T03:15:15.805982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:45.543904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805168+0000","last_change":"2024-09-21T03:14:38.481837+0000","last_active":"2024-09-21T03:15:15.805168+0000","last_peered":"2024-09-21T03:15:15.805168+0000","last_clean":"2024-09-21T03:15:15.805168+0000","last_became_active":"2024-09-21T03:14:38.478400+0000","last_became_peered":"2024-09-21T03:14:38.478400+0000","last_unstale":"2024-09-21T03:15:15.805168+0000","last_undegraded":"2024-09-21T03:15:15.805168+0000","last_fullsized":"2024-09-21T03:15:15.805168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.702185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.682943+0000","last_change":"2024-09-21T03:14:37.459351+0000","last_active":"2024-09-21T03:15:15.682943+0000","last_peered":"2024-09-21T03:15:15.682943+0000","last_clean":"2024-09-21T03:15:15.682943+0000","last_became_active":"2024-09-21T03:14:37.458676+0000","last_became_peered":"2024-09-21T03:14:37.458676+0000","last_unstale":"2024-09-21T03:15:15.682943+0000","last_undegraded":"2024-09-21T03:15:15.682943+0000","last_fullsized":"2024-09-21T03:15:15.682943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:42.671520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680467+0000","last_change":"2024-09-21T03:14:47.561232+0000","last_active":"2024-09-21T03:15:15.680467+0000","last_peered":"2024-09-21T03:15:15.680467+0000","last_clean":"2024-09-21T03:15:15.680467+0000","last_became_active":"2024-09-21T03:14:47.557224+0000","last_became_peered":"2024-09-21T03:14:47.557224+0000","last_unstale":"2024-09-21T03:15:15.680467+0000","last_undegraded":"2024-09-21T03:15:15.680467+0000","last_fullsized":"2024-09-21T03:15:15.680467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:09.611235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683940+0000","last_change":"2024-09-21T03:14:46.543157+0000","last_active":"2024-09-21T03:15:15.683940+0000","last_peered":"2024-09-21T03:15:15.683940+0000","last_clean":"2024-09-21T03:15:15.683940+0000","last_became_active":"2024-09-21T03:14:46.542746+0000","last_became_peered":"2024-09-21T03:14:46.542746+0000","last_unstale":"2024-09-21T03:15:15.683940+0000","last_undegraded":"2024-09-21T03:15:15.683940+0000","last_fullsized":"2024-09-21T03:15:15.683940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:30.644843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679102+0000","last_change":"2024-09-21T03:14:38.480723+0000","last_active":"2024-09-21T03:15:15.679102+0000","last_peered":"2024-09-21T03:15:15.679102+0000","last_clean":"2024-09-21T03:15:15.679102+0000","last_became_active":"2024-09-21T03:14:38.472823+0000","last_became_peered":"2024-09-21T03:14:38.472823+0000","last_unstale":"2024-09-21T03:15:15.679102+0000","last_undegraded":"2024-09-21T03:15:15.679102+0000","last_fullsized":"2024-09-21T03:15:15.679102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:59.862592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678729+0000","last_change":"2024-09-21T03:14:37.472209+0000","last_active":"2024-09-21T03:15:15.678729+0000","last_peered":"2024-09-21T03:15:15.678729+0000","last_clean":"2024-09-21T03:15:15.678729+0000","last_became_active":"2024-09-21T03:14:37.471771+0000","last_became_peered":"2024-09-21T03:14:37.471771+0000","last_unstale":"2024-09-21T03:15:15.678729+0000","last_undegraded":"2024-09-21T03:15:15.678729+0000","last_fullsized":"2024-09-21T03:15:15.678729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:30.648010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805722+0000","last_change":"2024-09-21T03:14:47.570651+0000","last_active":"2024-09-21T03:15:15.805722+0000","last_peered":"2024-09-21T03:15:15.805722+0000","last_clean":"2024-09-21T03:15:15.805722+0000","last_became_active":"2024-09-21T03:14:47.568081+0000","last_became_peered":"2024-09-21T03:14:47.568081+0000","last_unstale":"2024-09-21T03:15:15.805722+0000","last_undegraded":"2024-09-21T03:15:15.805722+0000","last_fullsized":"2024-09-21T03:15:15.805722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:45.036938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683567+0000","last_change":"2024-09-21T03:14:37.475076+0000","last_active":"2024-09-21T03:15:15.683567+0000","last_peered":"2024-09-21T03:15:15.683567+0000","last_clean":"2024-09-21T03:15:15.683567+0000","last_became_active":"2024-09-21T03:14:37.474595+0000","last_became_peered":"2024-09-21T03:14:37.474595+0000","last_unstale":"2024-09-21T03:15:15.683567+0000","last_undegraded":"2024-09-21T03:15:15.683567+0000","last_fullsized":"2024-09-21T03:15:15.683567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:16.880647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805997+0000","last_change":"2024-09-21T03:14:38.483226+0000","last_active":"2024-09-21T03:15:15.805997+0000","last_peered":"2024-09-21T03:15:15.805997+0000","last_clean":"2024-09-21T03:15:15.805997+0000","last_became_active":"2024-09-21T03:14:38.482354+0000","last_became_peered":"2024-09-21T03:14:38.482354+0000","last_unstale":"2024-09-21T03:15:15.805997+0000","last_undegraded":"2024-09-21T03:15:15.805997+0000","last_fullsized":"2024-09-21T03:15:15.805997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:51.488594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805767+0000","last_change":"2024-09-21T03:14:46.551282+0000","last_active":"2024-09-21T03:15:15.805767+0000","last_peered":"2024-09-21T03:15:15.805767+0000","last_clean":"2024-09-21T03:15:15.805767+0000","last_became_active":"2024-09-21T03:14:46.550191+0000","last_became_peered":"2024-09-21T03:14:46.550191+0000","last_unstale":"2024-09-21T03:15:15.805767+0000","last_undegraded":"2024-09-21T03:15:15.805767+0000","last_fullsized":"2024-09-21T03:15:15.805767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:32.136739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.686630+0000","last_change":"2024-09-21T03:15:15.686522+0000","last_active":"2024-09-21T03:15:15.686630+0000","last_peered":"2024-09-21T03:15:15.686630+0000","last_clean":"2024-09-21T03:15:15.686630+0000","last_became_active":"2024-09-21T03:15:15.686063+0000","last_became_peered":"2024-09-21T03:15:15.686063+0000","last_unstale":"2024-09-21T03:15:15.686630+0000","last_undegraded":"2024-09-21T03:15:15.686630+0000","last_fullsized":"2024-09-21T03:15:15.686630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:57.750372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681320+0000","last_change":"2024-09-21T03:14:37.465536+0000","last_active":"2024-09-21T03:15:15.681320+0000","last_peered":"2024-09-21T03:15:15.681320+0000","last_clean":"2024-09-21T03:15:15.681320+0000","last_became_active":"2024-09-21T03:14:37.465240+0000","last_became_peered":"2024-09-21T03:14:37.465240+0000","last_unstale":"2024-09-21T03:15:15.681320+0000","last_undegraded":"2024-09-21T03:15:15.681320+0000","last_fullsized":"2024-09-21T03:15:15.681320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:34.780298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804722+0000","last_change":"2024-09-21T03:14:38.474516+0000","last_active":"2024-09-21T03:15:15.804722+0000","last_peered":"2024-09-21T03:15:15.804722+0000","last_clean":"2024-09-21T03:15:15.804722+0000","last_became_active":"2024-09-21T03:14:38.472225+0000","last_became_peered":"2024-09-21T03:14:38.472225+0000","last_unstale":"2024-09-21T03:15:15.804722+0000","last_undegraded":"2024-09-21T03:15:15.804722+0000","last_fullsized":"2024-09-21T03:15:15.804722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:47.504910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684801+0000","last_change":"2024-09-21T03:14:46.544072+0000","last_active":"2024-09-21T03:15:15.684801+0000","last_peered":"2024-09-21T03:15:15.684801+0000","last_clean":"2024-09-21T03:15:15.684801+0000","last_became_active":"2024-09-21T03:14:46.543729+0000","last_became_peered":"2024-09-21T03:14:46.543729+0000","last_unstale":"2024-09-21T03:15:15.684801+0000","last_undegraded":"2024-09-21T03:15:15.684801+0000","last_fullsized":"2024-09-21T03:15:15.684801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:18.560012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805979+0000","last_change":"2024-09-21T03:14:47.563764+0000","last_active":"2024-09-21T03:15:15.805979+0000","last_peered":"2024-09-21T03:15:15.805979+0000","last_clean":"2024-09-21T03:15:15.805979+0000","last_became_active":"2024-09-21T03:14:47.562943+0000","last_became_peered":"2024-09-21T03:14:47.562943+0000","last_unstale":"2024-09-21T03:15:15.805979+0000","last_undegraded":"2024-09-21T03:15:15.805979+0000","last_fullsized":"2024-09-21T03:15:15.805979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:39.284350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678175+0000","last_change":"2024-09-21T03:14:38.484311+0000","last_active":"2024-09-21T03:15:15.678175+0000","last_peered":"2024-09-21T03:15:15.678175+0000","last_clean":"2024-09-21T03:15:15.678175+0000","last_became_active":"2024-09-21T03:14:38.483975+0000","last_became_peered":"2024-09-21T03:14:38.483975+0000","last_unstale":"2024-09-21T03:15:15.678175+0000","last_undegraded":"2024-09-21T03:15:15.678175+0000","last_fullsized":"2024-09-21T03:15:15.678175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:31.145431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806372+0000","last_change":"2024-09-21T03:14:47.566252+0000","last_active":"2024-09-21T03:15:15.806372+0000","last_peered":"2024-09-21T03:15:15.806372+0000","last_clean":"2024-09-21T03:15:15.806372+0000","last_became_active":"2024-09-21T03:14:47.560282+0000","last_became_peered":"2024-09-21T03:14:47.560282+0000","last_unstale":"2024-09-21T03:15:15.806372+0000","last_undegraded":"2024-09-21T03:15:15.806372+0000","last_fullsized":"2024-09-21T03:15:15.806372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:23.553847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683395+0000","last_change":"2024-09-21T03:14:38.477183+0000","last_active":"2024-09-21T03:15:15.683395+0000","last_peered":"2024-09-21T03:15:15.683395+0000","last_clean":"2024-09-21T03:15:15.683395+0000","last_became_active":"2024-09-21T03:14:38.476657+0000","last_became_peered":"2024-09-21T03:14:38.476657+0000","last_unstale":"2024-09-21T03:15:15.683395+0000","last_undegraded":"2024-09-21T03:15:15.683395+0000","last_fullsized":"2024-09-21T03:15:15.683395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:36.801764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677510+0000","last_change":"2024-09-21T03:14:47.574339+0000","last_active":"2024-09-21T03:15:15.677510+0000","last_peered":"2024-09-21T03:15:15.677510+0000","last_clean":"2024-09-21T03:15:15.677510+0000","last_became_active":"2024-09-21T03:14:47.565732+0000","last_became_peered":"2024-09-21T03:14:47.565732+0000","last_unstale":"2024-09-21T03:15:15.677510+0000","last_undegraded":"2024-09-21T03:15:15.677510+0000","last_fullsized":"2024-09-21T03:15:15.677510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:57.896810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.683448+0000","last_change":"2024-09-21T03:14:38.472860+0000","last_active":"2024-09-21T03:15:15.683448+0000","last_peered":"2024-09-21T03:15:15.683448+0000","last_clean":"2024-09-21T03:15:15.683448+0000","last_became_active":"2024-09-21T03:14:38.472548+0000","last_became_peered":"2024-09-21T03:14:38.472548+0000","last_unstale":"2024-09-21T03:15:15.683448+0000","last_undegraded":"2024-09-21T03:15:15.683448+0000","last_fullsized":"2024-09-21T03:15:15.683448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:16.071692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681588+0000","last_change":"2024-09-21T03:14:47.557402+0000","last_active":"2024-09-21T03:15:15.681588+0000","last_peered":"2024-09-21T03:15:15.681588+0000","last_clean":"2024-09-21T03:15:15.681588+0000","last_became_active":"2024-09-21T03:14:47.557047+0000","last_became_peered":"2024-09-21T03:14:47.557047+0000","last_unstale":"2024-09-21T03:15:15.681588+0000","last_undegraded":"2024-09-21T03:15:15.681588+0000","last_fullsized":"2024-09-21T03:15:15.681588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:29.792514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681269+0000","last_change":"2024-09-21T03:14:38.481039+0000","last_active":"2024-09-21T03:15:15.681269+0000","last_peered":"2024-09-21T03:15:15.681269+0000","last_clean":"2024-09-21T03:15:15.681269+0000","last_became_active":"2024-09-21T03:14:38.480686+0000","last_became_peered":"2024-09-21T03:14:38.480686+0000","last_unstale":"2024-09-21T03:15:15.681269+0000","last_undegraded":"2024-09-21T03:15:15.681269+0000","last_fullsized":"2024-09-21T03:15:15.681269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:18.603386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680603+0000","last_change":"2024-09-21T03:14:47.565697+0000","last_active":"2024-09-21T03:15:15.680603+0000","last_peered":"2024-09-21T03:15:15.680603+0000","last_clean":"2024-09-21T03:15:15.680603+0000","last_became_active":"2024-09-21T03:14:47.565393+0000","last_became_peered":"2024-09-21T03:14:47.565393+0000","last_unstale":"2024-09-21T03:15:15.680603+0000","last_undegraded":"2024-09-21T03:15:15.680603+0000","last_fullsized":"2024-09-21T03:15:15.680603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:35.421803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680067+0000","last_change":"2024-09-21T03:14:38.473900+0000","last_active":"2024-09-21T03:15:15.680067+0000","last_peered":"2024-09-21T03:15:15.680067+0000","last_clean":"2024-09-21T03:15:15.680067+0000","last_became_active":"2024-09-21T03:14:38.471325+0000","last_became_peered":"2024-09-21T03:14:38.471325+0000","last_unstale":"2024-09-21T03:15:15.680067+0000","last_undegraded":"2024-09-21T03:15:15.680067+0000","last_fullsized":"2024-09-21T03:15:15.680067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:47.556293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.685190+0000","last_change":"2024-09-21T03:15:15.685059+0000","last_active":"2024-09-21T03:15:15.685190+0000","last_peered":"2024-09-21T03:15:15.685190+0000","last_clean":"2024-09-21T03:15:15.685190+0000","last_became_active":"2024-09-21T03:15:15.684633+0000","last_became_peered":"2024-09-21T03:15:15.684633+0000","last_unstale":"2024-09-21T03:15:15.685190+0000","last_undegraded":"2024-09-21T03:15:15.685190+0000","last_fullsized":"2024-09-21T03:15:15.685190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:22.251366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680430+0000","last_change":"2024-09-21T03:14:38.478099+0000","last_active":"2024-09-21T03:15:15.680430+0000","last_peered":"2024-09-21T03:15:15.680430+0000","last_clean":"2024-09-21T03:15:15.680430+0000","last_became_active":"2024-09-21T03:14:38.475894+0000","last_became_peered":"2024-09-21T03:14:38.475894+0000","last_unstale":"2024-09-21T03:15:15.680430+0000","last_undegraded":"2024-09-21T03:15:15.680430+0000","last_fullsized":"2024-09-21T03:15:15.680430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:49.876430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.682690+0000","last_change":"2024-09-21T03:14:47.556933+0000","last_active":"2024-09-21T03:15:15.682690+0000","last_peered":"2024-09-21T03:15:15.682690+0000","last_clean":"2024-09-21T03:15:15.682690+0000","last_became_active":"2024-09-21T03:14:47.556615+0000","last_became_peered":"2024-09-21T03:14:47.556615+0000","last_unstale":"2024-09-21T03:15:15.682690+0000","last_undegraded":"2024-09-21T03:15:15.682690+0000","last_fullsized":"2024-09-21T03:15:15.682690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:27.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678569+0000","last_change":"2024-09-21T03:14:38.484198+0000","last_active":"2024-09-21T03:15:15.678569+0000","last_peered":"2024-09-21T03:15:15.678569+0000","last_clean":"2024-09-21T03:15:15.678569+0000","last_became_active":"2024-09-21T03:14:38.483893+0000","last_became_peered":"2024-09-21T03:14:38.483893+0000","last_unstale":"2024-09-21T03:15:15.678569+0000","last_undegraded":"2024-09-21T03:15:15.678569+0000","last_fullsized":"2024-09-21T03:15:15.678569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:56.665359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677336+0000","last_change":"2024-09-21T03:14:47.553479+0000","last_active":"2024-09-21T03:15:15.677336+0000","last_peered":"2024-09-21T03:15:15.677336+0000","last_clean":"2024-09-21T03:15:15.677336+0000","last_became_active":"2024-09-21T03:14:47.553144+0000","last_became_peered":"2024-09-21T03:14:47.553144+0000","last_unstale":"2024-09-21T03:15:15.677336+0000","last_undegraded":"2024-09-21T03:15:15.677336+0000","last_fullsized":"2024-09-21T03:15:15.677336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:26.321488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681234+0000","last_change":"2024-09-21T03:14:38.487093+0000","last_active":"2024-09-21T03:15:15.681234+0000","last_peered":"2024-09-21T03:15:15.681234+0000","last_clean":"2024-09-21T03:15:15.681234+0000","last_became_active":"2024-09-21T03:14:38.486204+0000","last_became_peered":"2024-09-21T03:14:38.486204+0000","last_unstale":"2024-09-21T03:15:15.681234+0000","last_undegraded":"2024-09-21T03:15:15.681234+0000","last_fullsized":"2024-09-21T03:15:15.681234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:55.531046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684987+0000","last_change":"2024-09-21T03:14:47.573375+0000","last_active":"2024-09-21T03:15:15.684987+0000","last_peered":"2024-09-21T03:15:15.684987+0000","last_clean":"2024-09-21T03:15:15.684987+0000","last_became_active":"2024-09-21T03:14:47.572717+0000","last_became_peered":"2024-09-21T03:14:47.572717+0000","last_unstale":"2024-09-21T03:15:15.684987+0000","last_undegraded":"2024-09-21T03:15:15.684987+0000","last_fullsized":"2024-09-21T03:15:15.684987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:44.673283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.682952+0000","last_change":"2024-09-21T03:14:38.471959+0000","last_active":"2024-09-21T03:15:15.682952+0000","last_peered":"2024-09-21T03:15:15.682952+0000","last_clean":"2024-09-21T03:15:15.682952+0000","last_became_active":"2024-09-21T03:14:38.471625+0000","last_became_peered":"2024-09-21T03:14:38.471625+0000","last_unstale":"2024-09-21T03:15:15.682952+0000","last_undegraded":"2024-09-21T03:15:15.682952+0000","last_fullsized":"2024-09-21T03:15:15.682952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:17.761951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684134+0000","last_change":"2024-09-21T03:14:47.564597+0000","last_active":"2024-09-21T03:15:15.684134+0000","last_peered":"2024-09-21T03:15:15.684134+0000","last_clean":"2024-09-21T03:15:15.684134+0000","last_became_active":"2024-09-21T03:14:47.563816+0000","last_became_peered":"2024-09-21T03:14:47.563816+0000","last_unstale":"2024-09-21T03:15:15.684134+0000","last_undegraded":"2024-09-21T03:15:15.684134+0000","last_fullsized":"2024-09-21T03:15:15.684134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:33.061271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678841+0000","last_change":"2024-09-21T03:14:38.491888+0000","last_active":"2024-09-21T03:15:15.678841+0000","last_peered":"2024-09-21T03:15:15.678841+0000","last_clean":"2024-09-21T03:15:15.678841+0000","last_became_active":"2024-09-21T03:14:38.491510+0000","last_became_peered":"2024-09-21T03:14:38.491510+0000","last_unstale":"2024-09-21T03:15:15.678841+0000","last_undegraded":"2024-09-21T03:15:15.678841+0000","last_fullsized":"2024-09-21T03:15:15.678841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:26.740304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679812+0000","last_change":"2024-09-21T03:14:47.564310+0000","last_active":"2024-09-21T03:15:15.679812+0000","last_peered":"2024-09-21T03:15:15.679812+0000","last_clean":"2024-09-21T03:15:15.679812+0000","last_became_active":"2024-09-21T03:14:47.564003+0000","last_became_peered":"2024-09-21T03:14:47.564003+0000","last_unstale":"2024-09-21T03:15:15.679812+0000","last_undegraded":"2024-09-21T03:15:15.679812+0000","last_fullsized":"2024-09-21T03:15:15.679812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:45.016321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804618+0000","last_change":"2024-09-21T03:14:38.470991+0000","last_active":"2024-09-21T03:15:15.804618+0000","last_peered":"2024-09-21T03:15:15.804618+0000","last_clean":"2024-09-21T03:15:15.804618+0000","last_became_active":"2024-09-21T03:14:38.470666+0000","last_became_peered":"2024-09-21T03:14:38.470666+0000","last_unstale":"2024-09-21T03:15:15.804618+0000","last_undegraded":"2024-09-21T03:15:15.804618+0000","last_fullsized":"2024-09-21T03:15:15.804618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:25.477992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684492+0000","last_change":"2024-09-21T03:14:47.575212+0000","last_active":"2024-09-21T03:15:15.684492+0000","last_peered":"2024-09-21T03:15:15.684492+0000","last_clean":"2024-09-21T03:15:15.684492+0000","last_became_active":"2024-09-21T03:14:47.574895+0000","last_became_peered":"2024-09-21T03:14:47.574895+0000","last_unstale":"2024-09-21T03:15:15.684492+0000","last_undegraded":"2024-09-21T03:15:15.684492+0000","last_fullsized":"2024-09-21T03:15:15.684492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:04.240949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806008+0000","last_change":"2024-09-21T03:14:38.482681+0000","last_active":"2024-09-21T03:15:15.806008+0000","last_peered":"2024-09-21T03:15:15.806008+0000","last_clean":"2024-09-21T03:15:15.806008+0000","last_became_active":"2024-09-21T03:14:38.477816+0000","last_became_peered":"2024-09-21T03:14:38.477816+0000","last_unstale":"2024-09-21T03:15:15.806008+0000","last_undegraded":"2024-09-21T03:15:15.806008+0000","last_fullsized":"2024-09-21T03:15:15.806008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:18.675641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677394+0000","last_change":"2024-09-21T03:14:47.555329+0000","last_active":"2024-09-21T03:15:15.677394+0000","last_peered":"2024-09-21T03:15:15.677394+0000","last_clean":"2024-09-21T03:15:15.677394+0000","last_became_active":"2024-09-21T03:14:47.555033+0000","last_became_peered":"2024-09-21T03:14:47.555033+0000","last_unstale":"2024-09-21T03:15:15.677394+0000","last_undegraded":"2024-09-21T03:15:15.677394+0000","last_fullsized":"2024-09-21T03:15:15.677394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:49.060834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681613+0000","last_change":"2024-09-21T03:14:38.480638+0000","last_active":"2024-09-21T03:15:15.681613+0000","last_peered":"2024-09-21T03:15:15.681613+0000","last_clean":"2024-09-21T03:15:15.681613+0000","last_became_active":"2024-09-21T03:14:38.477739+0000","last_became_peered":"2024-09-21T03:14:38.477739+0000","last_unstale":"2024-09-21T03:15:15.681613+0000","last_undegraded":"2024-09-21T03:15:15.681613+0000","last_fullsized":"2024-09-21T03:15:15.681613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:35.097761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680739+0000","last_change":"2024-09-21T03:14:47.573659+0000","last_active":"2024-09-21T03:15:15.680739+0000","last_peered":"2024-09-21T03:15:15.680739+0000","last_clean":"2024-09-21T03:15:15.680739+0000","last_became_active":"2024-09-21T03:14:47.572756+0000","last_became_peered":"2024-09-21T03:14:47.572756+0000","last_unstale":"2024-09-21T03:15:15.680739+0000","last_undegraded":"2024-09-21T03:15:15.680739+0000","last_fullsized":"2024-09-21T03:15:15.680739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:21.986681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.685042+0000","last_change":"2024-09-21T03:14:38.478039+0000","last_active":"2024-09-21T03:15:15.685042+0000","last_peered":"2024-09-21T03:15:15.685042+0000","last_clean":"2024-09-21T03:15:15.685042+0000","last_became_active":"2024-09-21T03:14:38.473843+0000","last_became_peered":"2024-09-21T03:14:38.473843+0000","last_unstale":"2024-09-21T03:15:15.685042+0000","last_undegraded":"2024-09-21T03:15:15.685042+0000","last_fullsized":"2024-09-21T03:15:15.685042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:27.072406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677250+0000","last_change":"2024-09-21T03:14:47.555386+0000","last_active":"2024-09-21T03:15:15.677250+0000","last_peered":"2024-09-21T03:15:15.677250+0000","last_clean":"2024-09-21T03:15:15.677250+0000","last_became_active":"2024-09-21T03:14:47.554758+0000","last_became_peered":"2024-09-21T03:14:47.554758+0000","last_unstale":"2024-09-21T03:15:15.677250+0000","last_undegraded":"2024-09-21T03:15:15.677250+0000","last_fullsized":"2024-09-21T03:15:15.677250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:47.574672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.685167+0000","last_change":"2024-09-21T03:14:38.494878+0000","last_active":"2024-09-21T03:15:15.685167+0000","last_peered":"2024-09-21T03:15:15.685167+0000","last_clean":"2024-09-21T03:15:15.685167+0000","last_became_active":"2024-09-21T03:14:38.492813+0000","last_became_peered":"2024-09-21T03:14:38.492813+0000","last_unstale":"2024-09-21T03:15:15.685167+0000","last_undegraded":"2024-09-21T03:15:15.685167+0000","last_fullsized":"2024-09-21T03:15:15.685167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:55.064844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678405+0000","last_change":"2024-09-21T03:14:47.544806+0000","last_active":"2024-09-21T03:15:15.678405+0000","last_peered":"2024-09-21T03:15:15.678405+0000","last_clean":"2024-09-21T03:15:15.678405+0000","last_became_active":"2024-09-21T03:14:47.544431+0000","last_became_peered":"2024-09-21T03:14:47.544431+0000","last_unstale":"2024-09-21T03:15:15.678405+0000","last_undegraded":"2024-09-21T03:15:15.678405+0000","last_fullsized":"2024-09-21T03:15:15.678405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:01.463573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684175+0000","last_change":"2024-09-21T03:14:38.474462+0000","last_active":"2024-09-21T03:15:15.684175+0000","last_peered":"2024-09-21T03:15:15.684175+0000","last_clean":"2024-09-21T03:15:15.684175+0000","last_became_active":"2024-09-21T03:14:38.474156+0000","last_became_peered":"2024-09-21T03:14:38.474156+0000","last_unstale":"2024-09-21T03:15:15.684175+0000","last_undegraded":"2024-09-21T03:15:15.684175+0000","last_fullsized":"2024-09-21T03:15:15.684175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:55.329945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.806137+0000","last_change":"2024-09-21T03:14:47.563297+0000","last_active":"2024-09-21T03:15:15.806137+0000","last_peered":"2024-09-21T03:15:15.806137+0000","last_clean":"2024-09-21T03:15:15.806137+0000","last_became_active":"2024-09-21T03:14:47.562519+0000","last_became_peered":"2024-09-21T03:14:47.562519+0000","last_unstale":"2024-09-21T03:15:15.806137+0000","last_undegraded":"2024-09-21T03:15:15.806137+0000","last_fullsized":"2024-09-21T03:15:15.806137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:47.959373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.682826+0000","last_change":"2024-09-21T03:14:38.474262+0000","last_active":"2024-09-21T03:15:15.682826+0000","last_peered":"2024-09-21T03:15:15.682826+0000","last_clean":"2024-09-21T03:15:15.682826+0000","last_became_active":"2024-09-21T03:14:38.473856+0000","last_became_peered":"2024-09-21T03:14:38.473856+0000","last_unstale":"2024-09-21T03:15:15.682826+0000","last_undegraded":"2024-09-21T03:15:15.682826+0000","last_fullsized":"2024-09-21T03:15:15.682826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804869+0000","last_change":"2024-09-21T03:14:47.558732+0000","last_active":"2024-09-21T03:15:15.804869+0000","last_peered":"2024-09-21T03:15:15.804869+0000","last_clean":"2024-09-21T03:15:15.804869+0000","last_became_active":"2024-09-21T03:14:47.558403+0000","last_became_peered":"2024-09-21T03:14:47.558403+0000","last_unstale":"2024-09-21T03:15:15.804869+0000","last_undegraded":"2024-09-21T03:15:15.804869+0000","last_fullsized":"2024-09-21T03:15:15.804869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:46.054565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678631+0000","last_change":"2024-09-21T03:14:38.469736+0000","last_active":"2024-09-21T03:15:15.678631+0000","last_peered":"2024-09-21T03:15:15.678631+0000","last_clean":"2024-09-21T03:15:15.678631+0000","last_became_active":"2024-09-21T03:14:38.469240+0000","last_became_peered":"2024-09-21T03:14:38.469240+0000","last_unstale":"2024-09-21T03:15:15.678631+0000","last_undegraded":"2024-09-21T03:15:15.678631+0000","last_fullsized":"2024-09-21T03:15:15.678631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:04.258761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804652+0000","last_change":"2024-09-21T03:14:47.550684+0000","last_active":"2024-09-21T03:15:15.804652+0000","last_peered":"2024-09-21T03:15:15.804652+0000","last_clean":"2024-09-21T03:15:15.804652+0000","last_became_active":"2024-09-21T03:14:47.550375+0000","last_became_peered":"2024-09-21T03:14:47.550375+0000","last_unstale":"2024-09-21T03:15:15.804652+0000","last_undegraded":"2024-09-21T03:15:15.804652+0000","last_fullsized":"2024-09-21T03:15:15.804652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:05.268160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679305+0000","last_change":"2024-09-21T03:14:38.487983+0000","last_active":"2024-09-21T03:15:15.679305+0000","last_peered":"2024-09-21T03:15:15.679305+0000","last_clean":"2024-09-21T03:15:15.679305+0000","last_became_active":"2024-09-21T03:14:38.487676+0000","last_became_peered":"2024-09-21T03:14:38.487676+0000","last_unstale":"2024-09-21T03:15:15.679305+0000","last_undegraded":"2024-09-21T03:15:15.679305+0000","last_fullsized":"2024-09-21T03:15:15.679305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:35.320169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684289+0000","last_change":"2024-09-21T03:14:47.561566+0000","last_active":"2024-09-21T03:15:15.684289+0000","last_peered":"2024-09-21T03:15:15.684289+0000","last_clean":"2024-09-21T03:15:15.684289+0000","last_became_active":"2024-09-21T03:14:47.561229+0000","last_became_peered":"2024-09-21T03:14:47.561229+0000","last_unstale":"2024-09-21T03:15:15.684289+0000","last_undegraded":"2024-09-21T03:15:15.684289+0000","last_fullsized":"2024-09-21T03:15:15.684289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:07.280356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679195+0000","last_change":"2024-09-21T03:14:38.478853+0000","last_active":"2024-09-21T03:15:15.679195+0000","last_peered":"2024-09-21T03:15:15.679195+0000","last_clean":"2024-09-21T03:15:15.679195+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:15:15.679195+0000","last_undegraded":"2024-09-21T03:15:15.679195+0000","last_fullsized":"2024-09-21T03:15:15.679195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:31.427596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.687043+0000","last_change":"2024-09-21T03:15:15.686915+0000","last_active":"2024-09-21T03:15:15.687043+0000","last_peered":"2024-09-21T03:15:15.687043+0000","last_clean":"2024-09-21T03:15:15.687043+0000","last_became_active":"2024-09-21T03:15:15.686514+0000","last_became_peered":"2024-09-21T03:15:15.686514+0000","last_unstale":"2024-09-21T03:15:15.687043+0000","last_undegraded":"2024-09-21T03:15:15.687043+0000","last_fullsized":"2024-09-21T03:15:15.687043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:46.388388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681084+0000","last_change":"2024-09-21T03:14:38.481308+0000","last_active":"2024-09-21T03:15:15.681084+0000","last_peered":"2024-09-21T03:15:15.681084+0000","last_clean":"2024-09-21T03:15:15.681084+0000","last_became_active":"2024-09-21T03:14:38.480923+0000","last_became_peered":"2024-09-21T03:14:38.480923+0000","last_unstale":"2024-09-21T03:15:15.681084+0000","last_undegraded":"2024-09-21T03:15:15.681084+0000","last_fullsized":"2024-09-21T03:15:15.681084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:40.689231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678566+0000","last_change":"2024-09-21T03:14:47.561972+0000","last_active":"2024-09-21T03:15:15.678566+0000","last_peered":"2024-09-21T03:15:15.678566+0000","last_clean":"2024-09-21T03:15:15.678566+0000","last_became_active":"2024-09-21T03:14:47.561645+0000","last_became_peered":"2024-09-21T03:14:47.561645+0000","last_unstale":"2024-09-21T03:15:15.678566+0000","last_undegraded":"2024-09-21T03:15:15.678566+0000","last_fullsized":"2024-09-21T03:15:15.678566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:57.526787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681129+0000","last_change":"2024-09-21T03:14:38.473907+0000","last_active":"2024-09-21T03:15:15.681129+0000","last_peered":"2024-09-21T03:15:15.681129+0000","last_clean":"2024-09-21T03:15:15.681129+0000","last_became_active":"2024-09-21T03:14:38.473579+0000","last_became_peered":"2024-09-21T03:14:38.473579+0000","last_unstale":"2024-09-21T03:15:15.681129+0000","last_undegraded":"2024-09-21T03:15:15.681129+0000","last_fullsized":"2024-09-21T03:15:15.681129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:32.273503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680383+0000","last_change":"2024-09-21T03:14:47.566089+0000","last_active":"2024-09-21T03:15:15.680383+0000","last_peered":"2024-09-21T03:15:15.680383+0000","last_clean":"2024-09-21T03:15:15.680383+0000","last_became_active":"2024-09-21T03:14:47.565681+0000","last_became_peered":"2024-09-21T03:14:47.565681+0000","last_unstale":"2024-09-21T03:15:15.680383+0000","last_undegraded":"2024-09-21T03:15:15.680383+0000","last_fullsized":"2024-09-21T03:15:15.680383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.208933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681048+0000","last_change":"2024-09-21T03:14:38.474326+0000","last_active":"2024-09-21T03:15:15.681048+0000","last_peered":"2024-09-21T03:15:15.681048+0000","last_clean":"2024-09-21T03:15:15.681048+0000","last_became_active":"2024-09-21T03:14:38.470430+0000","last_became_peered":"2024-09-21T03:14:38.470430+0000","last_unstale":"2024-09-21T03:15:15.681048+0000","last_undegraded":"2024-09-21T03:15:15.681048+0000","last_fullsized":"2024-09-21T03:15:15.681048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:09.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680250+0000","last_change":"2024-09-21T03:14:47.571487+0000","last_active":"2024-09-21T03:15:15.680250+0000","last_peered":"2024-09-21T03:15:15.680250+0000","last_clean":"2024-09-21T03:15:15.680250+0000","last_became_active":"2024-09-21T03:14:47.571126+0000","last_became_peered":"2024-09-21T03:14:47.571126+0000","last_unstale":"2024-09-21T03:15:15.680250+0000","last_undegraded":"2024-09-21T03:15:15.680250+0000","last_fullsized":"2024-09-21T03:15:15.680250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:57.128853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805276+0000","last_change":"2024-09-21T03:14:38.483370+0000","last_active":"2024-09-21T03:15:15.805276+0000","last_peered":"2024-09-21T03:15:15.805276+0000","last_clean":"2024-09-21T03:15:15.805276+0000","last_became_active":"2024-09-21T03:14:38.483019+0000","last_became_peered":"2024-09-21T03:14:38.483019+0000","last_unstale":"2024-09-21T03:15:15.805276+0000","last_undegraded":"2024-09-21T03:15:15.805276+0000","last_fullsized":"2024-09-21T03:15:15.805276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:55.085422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.679803+0000","last_change":"2024-09-21T03:14:47.555777+0000","last_active":"2024-09-21T03:15:15.679803+0000","last_peered":"2024-09-21T03:15:15.679803+0000","last_clean":"2024-09-21T03:15:15.679803+0000","last_became_active":"2024-09-21T03:14:47.555465+0000","last_became_peered":"2024-09-21T03:14:47.555465+0000","last_unstale":"2024-09-21T03:15:15.679803+0000","last_undegraded":"2024-09-21T03:15:15.679803+0000","last_fullsized":"2024-09-21T03:15:15.679803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:27.123740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678858+0000","last_change":"2024-09-21T03:14:38.465771+0000","last_active":"2024-09-21T03:15:15.678858+0000","last_peered":"2024-09-21T03:15:15.678858+0000","last_clean":"2024-09-21T03:15:15.678858+0000","last_became_active":"2024-09-21T03:14:38.465479+0000","last_became_peered":"2024-09-21T03:14:38.465479+0000","last_unstale":"2024-09-21T03:15:15.678858+0000","last_undegraded":"2024-09-21T03:15:15.678858+0000","last_fullsized":"2024-09-21T03:15:15.678858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.754315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678369+0000","last_change":"2024-09-21T03:14:47.567695+0000","last_active":"2024-09-21T03:15:15.678369+0000","last_peered":"2024-09-21T03:15:15.678369+0000","last_clean":"2024-09-21T03:15:15.678369+0000","last_became_active":"2024-09-21T03:14:47.566936+0000","last_became_peered":"2024-09-21T03:14:47.566936+0000","last_unstale":"2024-09-21T03:15:15.678369+0000","last_undegraded":"2024-09-21T03:15:15.678369+0000","last_fullsized":"2024-09-21T03:15:15.678369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:48.182523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.808619+0000","last_change":"2024-09-21T03:15:15.807206+0000","last_active":"2024-09-21T03:15:15.808619+0000","last_peered":"2024-09-21T03:15:15.808619+0000","last_clean":"2024-09-21T03:15:15.808619+0000","last_became_active":"2024-09-21T03:15:15.806775+0000","last_became_peered":"2024-09-21T03:15:15.806775+0000","last_unstale":"2024-09-21T03:15:15.808619+0000","last_undegraded":"2024-09-21T03:15:15.808619+0000","last_fullsized":"2024-09-21T03:15:15.808619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:51.779236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.805513+0000","last_change":"2024-09-21T03:14:47.580314+0000","last_active":"2024-09-21T03:15:15.805513+0000","last_peered":"2024-09-21T03:15:15.805513+0000","last_clean":"2024-09-21T03:15:15.805513+0000","last_became_active":"2024-09-21T03:14:47.576499+0000","last_became_peered":"2024-09-21T03:14:47.576499+0000","last_unstale":"2024-09-21T03:15:15.805513+0000","last_undegraded":"2024-09-21T03:15:15.805513+0000","last_fullsized":"2024-09-21T03:15:15.805513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:46.154586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678336+0000","last_change":"2024-09-21T03:14:38.471270+0000","last_active":"2024-09-21T03:15:15.678336+0000","last_peered":"2024-09-21T03:15:15.678336+0000","last_clean":"2024-09-21T03:15:15.678336+0000","last_became_active":"2024-09-21T03:14:38.470708+0000","last_became_peered":"2024-09-21T03:14:38.470708+0000","last_unstale":"2024-09-21T03:15:15.678336+0000","last_undegraded":"2024-09-21T03:15:15.678336+0000","last_fullsized":"2024-09-21T03:15:15.678336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.122804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.804703+0000","last_change":"2024-09-21T03:14:47.554180+0000","last_active":"2024-09-21T03:15:15.804703+0000","last_peered":"2024-09-21T03:15:15.804703+0000","last_clean":"2024-09-21T03:15:15.804703+0000","last_became_active":"2024-09-21T03:14:47.552808+0000","last_became_peered":"2024-09-21T03:14:47.552808+0000","last_unstale":"2024-09-21T03:15:15.804703+0000","last_undegraded":"2024-09-21T03:15:15.804703+0000","last_fullsized":"2024-09-21T03:15:15.804703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:07.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681593+0000","last_change":"2024-09-21T03:14:38.466077+0000","last_active":"2024-09-21T03:15:15.681593+0000","last_peered":"2024-09-21T03:15:15.681593+0000","last_clean":"2024-09-21T03:15:15.681593+0000","last_became_active":"2024-09-21T03:14:38.465818+0000","last_became_peered":"2024-09-21T03:14:38.465818+0000","last_unstale":"2024-09-21T03:15:15.681593+0000","last_undegraded":"2024-09-21T03:15:15.681593+0000","last_fullsized":"2024-09-21T03:15:15.681593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:34.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.684015+0000","last_change":"2024-09-21T03:14:47.577228+0000","last_active":"2024-09-21T03:15:15.684015+0000","last_peered":"2024-09-21T03:15:15.684015+0000","last_clean":"2024-09-21T03:15:15.684015+0000","last_became_active":"2024-09-21T03:14:47.576843+0000","last_became_peered":"2024-09-21T03:14:47.576843+0000","last_unstale":"2024-09-21T03:15:15.684015+0000","last_undegraded":"2024-09-21T03:15:15.684015+0000","last_fullsized":"2024-09-21T03:15:15.684015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:56.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677741+0000","last_change":"2024-09-21T03:14:38.481389+0000","last_active":"2024-09-21T03:15:15.677741+0000","last_peered":"2024-09-21T03:15:15.677741+0000","last_clean":"2024-09-21T03:15:15.677741+0000","last_became_active":"2024-09-21T03:14:38.470907+0000","last_became_peered":"2024-09-21T03:14:38.470907+0000","last_unstale":"2024-09-21T03:15:15.677741+0000","last_undegraded":"2024-09-21T03:15:15.677741+0000","last_fullsized":"2024-09-21T03:15:15.677741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:30.068915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680895+0000","last_change":"2024-09-21T03:14:47.551766+0000","last_active":"2024-09-21T03:15:15.680895+0000","last_peered":"2024-09-21T03:15:15.680895+0000","last_clean":"2024-09-21T03:15:15.680895+0000","last_became_active":"2024-09-21T03:14:47.551420+0000","last_became_peered":"2024-09-21T03:14:47.551420+0000","last_unstale":"2024-09-21T03:15:15.680895+0000","last_undegraded":"2024-09-21T03:15:15.680895+0000","last_fullsized":"2024-09-21T03:15:15.680895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:56.255472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681739+0000","last_change":"2024-09-21T03:14:38.482605+0000","last_active":"2024-09-21T03:15:15.681739+0000","last_peered":"2024-09-21T03:15:15.681739+0000","last_clean":"2024-09-21T03:15:15.681739+0000","last_became_active":"2024-09-21T03:14:38.482306+0000","last_became_peered":"2024-09-21T03:14:38.482306+0000","last_unstale":"2024-09-21T03:15:15.681739+0000","last_undegraded":"2024-09-21T03:15:15.681739+0000","last_fullsized":"2024-09-21T03:15:15.681739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:40.482635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.678145+0000","last_change":"2024-09-21T03:14:47.555070+0000","last_active":"2024-09-21T03:15:15.678145+0000","last_peered":"2024-09-21T03:15:15.678145+0000","last_clean":"2024-09-21T03:15:15.678145+0000","last_became_active":"2024-09-21T03:14:47.554363+0000","last_became_peered":"2024-09-21T03:14:47.554363+0000","last_unstale":"2024-09-21T03:15:15.678145+0000","last_undegraded":"2024-09-21T03:15:15.678145+0000","last_fullsized":"2024-09-21T03:15:15.678145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:40.027266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.680191+0000","last_change":"2024-09-21T03:14:38.496218+0000","last_active":"2024-09-21T03:15:15.680191+0000","last_peered":"2024-09-21T03:15:15.680191+0000","last_clean":"2024-09-21T03:15:15.680191+0000","last_became_active":"2024-09-21T03:14:38.488537+0000","last_became_peered":"2024-09-21T03:14:38.488537+0000","last_unstale":"2024-09-21T03:15:15.680191+0000","last_undegraded":"2024-09-21T03:15:15.680191+0000","last_fullsized":"2024-09-21T03:15:15.680191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:59.667392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.677329+0000","last_change":"2024-09-21T03:14:47.564250+0000","last_active":"2024-09-21T03:15:15.677329+0000","last_peered":"2024-09-21T03:15:15.677329+0000","last_clean":"2024-09-21T03:15:15.677329+0000","last_became_active":"2024-09-21T03:14:47.563745+0000","last_became_peered":"2024-09-21T03:14:47.563745+0000","last_unstale":"2024-09-21T03:15:15.677329+0000","last_undegraded":"2024-09-21T03:15:15.677329+0000","last_fullsized":"2024-09-21T03:15:15.677329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:31.282910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:15:15.681230+0000","last_change":"2024-09-21T03:14:38.490309+0000","last_active":"2024-09-21T03:15:15.681230+0000","last_peered":"2024-09-21T03:15:15.681230+0000","last_clean":"2024-09-21T03:15:15.681230+0000","last_became_active":"2024-09-21T03:14:38.489167+0000","last_became_peered":"2024-09-21T03:14:38.489167+0000","last_unstale":"2024-09-21T03:15:15.681230+0000","last_undegraded":"2024-09-21T03:15:15.681230+0000","last_fullsized":"2024-09-21T03:15:15.681230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:07.725691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3656,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3656,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":698575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":319488,"data_stored":120849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":110425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":698041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542159,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":117297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542158,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":303104,"data_stored":115797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:15:22.046 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-09-21T03:15:22.046 DEBUG:tasks.mon_thrash:Yielding 2024-09-21T03:15:22.046 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T03:15:22.060 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:15:22.061 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T03:15:22.061 INFO:tasks.workunit:timeout=3h 2024-09-21T03:15:22.061 INFO:tasks.workunit:cleanup=True 2024-09-21T03:15:22.061 DEBUG:teuthology.orchestra.run.smithi090:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T03:15:22.061 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:15:22.116 INFO:teuthology.orchestra.run.smithi090.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T03:15:22.116 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T03:15:22.116 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-09-21T03:15:22.116 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:15:22.116 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T03:15:22.116 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-21T03:15:22.116 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-21 03:14:38.450103042 +0000 2024-09-21T03:15:22.117 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-21 03:15:07.367525707 +0000 2024-09-21T03:15:22.117 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-21 03:14:38.450103042 +0000 2024-09-21T03:15:22.117 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T03:15:22.117 DEBUG:teuthology.orchestra.run.smithi090:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T03:15:22.221 DEBUG:teuthology.orchestra.run.smithi149:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-21T03:15:22.261 INFO:teuthology.orchestra.run.smithi149.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-21T03:15:22.261 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T03:15:22.261 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-09-21T03:15:22.262 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:15:22.262 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T03:15:22.262 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-21T03:15:22.262 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-21 03:14:47.550772320 +0000 2024-09-21T03:15:22.262 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-21 03:15:11.298189345 +0000 2024-09-21T03:15:22.262 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-21 03:14:47.550772320 +0000 2024-09-21T03:15:22.262 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-21T03:15:22.262 DEBUG:teuthology.orchestra.run.smithi149:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-21T03:15:22.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.304+0000 7f301b400640 1 -- 172.21.15.90:0/1071468133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f301406d960 msgr2=0x7f301413dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:22.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.304+0000 7f301b400640 1 --2- 172.21.15.90:0/1071468133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f301406d960 0x7f301413dd40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3014069d10 tx=0x7f300402a4b0 comp rx=0 tx=0).stop 2024-09-21T03:15:22.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.304+0000 7f301b400640 1 -- 172.21.15.90:0/1071468133 shutdown_connections 2024-09-21T03:15:22.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.304+0000 7f301b400640 1 --2- 172.21.15.90:0/1071468133 >> v2:172.21.15.149:3300/0 conn(0x7f30140ac350 0x7f30140ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:22.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.304+0000 7f301b400640 1 --2- 172.21.15.90:0/1071468133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f301406d960 0x7f301413dd40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:22.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.304+0000 7f301b400640 1 -- 172.21.15.90:0/1071468133 >> 172.21.15.90:0/1071468133 conn(0x7f30140c8ba0 msgr2=0x7f301406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:22.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.304+0000 7f301b400640 1 -- 172.21.15.90:0/1071468133 shutdown_connections 2024-09-21T03:15:22.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.304+0000 7f301b400640 1 -- 172.21.15.90:0/1071468133 wait complete. 2024-09-21T03:15:22.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.306+0000 7f301b400640 1 Processor -- start 2024-09-21T03:15:22.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.307+0000 7f301b400640 1 -- start start 2024-09-21T03:15:22.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.308+0000 7f301b400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f301406d960 0x7f30141ee720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:22.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.308+0000 7f301b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30140ac350 0x7f3014157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:22.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.308+0000 7f301b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30140acca0 0x7f301413a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:22.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.308+0000 7f301b400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f30140ab640 con 0x7f30140ac350 2024-09-21T03:15:22.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.308+0000 7f301b400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f30140ab360 con 0x7f30140acca0 2024-09-21T03:15:22.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.308+0000 7f301b400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3014074930 con 0x7f301406d960 2024-09-21T03:15:22.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.308+0000 7f300be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30140ac350 0x7f3014157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:22.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.308+0000 7f300be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30140ac350 0x7f3014157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47742/0 (socket says 172.21.15.90:47742) 2024-09-21T03:15:22.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.308+0000 7f300be00640 1 -- 172.21.15.90:0/598506283 learned_addr learned my addr 172.21.15.90:0/598506283 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:22.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.308+0000 7f3019400640 1 --2- 172.21.15.90:0/598506283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30140acca0 0x7f301413a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:22.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.308+0000 7f3018a00640 1 --2- 172.21.15.90:0/598506283 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f301406d960 0x7f30141ee720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:22.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.309+0000 7f300be00640 1 -- 172.21.15.90:0/598506283 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f301406d960 msgr2=0x7f30141ee720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:22.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.309+0000 7f300be00640 1 --2- 172.21.15.90:0/598506283 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f301406d960 0x7f30141ee720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:22.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.309+0000 7f300be00640 1 -- 172.21.15.90:0/598506283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30140acca0 msgr2=0x7f301413a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:22.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.309+0000 7f300be00640 1 --2- 172.21.15.90:0/598506283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30140acca0 0x7f301413a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:22.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.309+0000 7f300be00640 1 -- 172.21.15.90:0/598506283 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30140c45f0 con 0x7f30140ac350 2024-09-21T03:15:22.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.309+0000 7f300be00640 1 --2- 172.21.15.90:0/598506283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30140ac350 0x7f3014157e90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009fd0 tx=0x7f2ffc00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:22.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.309+0000 7f3011600640 1 -- 172.21.15.90:0/598506283 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc00ccc0 con 0x7f30140ac350 2024-09-21T03:15:22.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.309+0000 7f3011600640 1 -- 172.21.15.90:0/598506283 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ffc00ee70 con 0x7f30140ac350 2024-09-21T03:15:22.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.309+0000 7f301b400640 1 -- 172.21.15.90:0/598506283 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30141ef410 con 0x7f30140ac350 2024-09-21T03:15:22.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.309+0000 7f3011600640 1 -- 172.21.15.90:0/598506283 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc00ce60 con 0x7f30140ac350 2024-09-21T03:15:22.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.309+0000 7f301b400640 1 -- 172.21.15.90:0/598506283 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30141ef130 con 0x7f30140ac350 2024-09-21T03:15:22.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.311+0000 7f301b400640 1 -- 172.21.15.90:0/598506283 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3014074e90 con 0x7f30140ac350 2024-09-21T03:15:22.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.312+0000 7f3011600640 1 -- 172.21.15.90:0/598506283 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2ffc005260 con 0x7f30140ac350 2024-09-21T03:15:22.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.313+0000 7f3011600640 1 --2- 172.21.15.90:0/598506283 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2ff0078bc0 0x7f2ff007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:22.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.313+0000 7f3011600640 1 -- 172.21.15.90:0/598506283 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f2ffc09b8c0 con 0x7f30140ac350 2024-09-21T03:15:22.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.313+0000 7f3018a00640 1 --2- 172.21.15.90:0/598506283 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2ff0078bc0 0x7f2ff007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:22.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.314+0000 7f3018a00640 1 --2- 172.21.15.90:0/598506283 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2ff0078bc0 0x7f2ff007b0d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3004034000 tx=0x7f3004004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:22.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.317+0000 7f3011600640 1 -- 172.21.15.90:0/598506283 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2ffc063380 con 0x7f30140ac350 2024-09-21T03:15:22.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.541+0000 7f301b400640 1 -- 172.21.15.90:0/598506283 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30140ac980 con 0x7f30140ac350 2024-09-21T03:15:22.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.541+0000 7f3011600640 1 -- 172.21.15.90:0/598506283 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6530 (secure 0 0 0) 0x7f2ffc067db0 con 0x7f30140ac350 2024-09-21T03:15:22.543 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:15:22.543 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"btime":"2024-09-21T03:14:51:570098+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3707484056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3707484056},{"type":"v1","addr":"172.21.15.90:6835","nonce":3707484056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1650707992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1650707992},{"type":"v1","addr":"172.21.15.149:6837","nonce":1650707992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:37.954868+0000","modified":"2024-09-21T03:14:41.971257+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/2166962836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2166962836},{"type":"v1","addr":"172.21.15.149:6836","nonce":2166962836}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:47.021969+0000","modified":"2024-09-21T03:14:51.055397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4395},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4395":{"gid":4395,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6833/1105275899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1105275899},{"type":"v1","addr":"172.21.15.90:6833","nonce":1105275899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4395,"qdb_cluster":[4395]},"id":2}]} 2024-09-21T03:15:22.544 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2024-09-21T03:15:22.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.544+0000 7f301b400640 1 -- 172.21.15.90:0/598506283 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2ff0078bc0 msgr2=0x7f2ff007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:22.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.544+0000 7f301b400640 1 --2- 172.21.15.90:0/598506283 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2ff0078bc0 0x7f2ff007b0d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3004034000 tx=0x7f3004004730 comp rx=0 tx=0).stop 2024-09-21T03:15:22.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.544+0000 7f301b400640 1 -- 172.21.15.90:0/598506283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30140ac350 msgr2=0x7f3014157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:22.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.544+0000 7f301b400640 1 --2- 172.21.15.90:0/598506283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30140ac350 0x7f3014157e90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009fd0 tx=0x7f2ffc00ec20 comp rx=0 tx=0).stop 2024-09-21T03:15:22.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.544+0000 7f301b400640 1 -- 172.21.15.90:0/598506283 shutdown_connections 2024-09-21T03:15:22.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.544+0000 7f301b400640 1 --2- 172.21.15.90:0/598506283 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2ff0078bc0 0x7f2ff007b0d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:22.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.544+0000 7f301b400640 1 --2- 172.21.15.90:0/598506283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30140acca0 0x7f301413a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:22.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.544+0000 7f301b400640 1 --2- 172.21.15.90:0/598506283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30140ac350 0x7f3014157e90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:22.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.544+0000 7f301b400640 1 --2- 172.21.15.90:0/598506283 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f301406d960 0x7f30141ee720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:22.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.544+0000 7f301b400640 1 -- 172.21.15.90:0/598506283 >> 172.21.15.90:0/598506283 conn(0x7f30140c8ba0 msgr2=0x7f3014153de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:22.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.544+0000 7f301b400640 1 -- 172.21.15.90:0/598506283 shutdown_connections 2024-09-21T03:15:22.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.544+0000 7f301b400640 1 -- 172.21.15.90:0/598506283 wait complete. 2024-09-21T03:15:22.570 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-09-21T03:15:22.571 INFO:tasks.mon_thrash.mon_thrasher:seed: 1726888522, revive delay: 20.0, thrash delay: 10.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-09-21T03:15:22.571 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-21T03:15:22.571 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:15:22.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.789+0000 7f7682200640 1 -- 172.21.15.90:0/539941822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767c0c2b50 msgr2=0x7f767c0c5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:22.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.789+0000 7f7682200640 1 --2- 172.21.15.90:0/539941822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767c0c2b50 0x7f767c0c5cc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f767c06f9f0 tx=0x7f766c02a980 comp rx=0 tx=0).stop 2024-09-21T03:15:22.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.789+0000 7f7682200640 1 -- 172.21.15.90:0/539941822 shutdown_connections 2024-09-21T03:15:22.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.789+0000 7f7682200640 1 --2- 172.21.15.90:0/539941822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f767c158190 0x7f767c1585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:22.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.789+0000 7f7682200640 1 --2- 172.21.15.90:0/539941822 >> v2:172.21.15.149:3300/0 conn(0x7f767c0c7ca0 0x7f767c0c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:22.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.789+0000 7f7682200640 1 --2- 172.21.15.90:0/539941822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767c0c2b50 0x7f767c0c5cc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:22.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.789+0000 7f7682200640 1 -- 172.21.15.90:0/539941822 >> 172.21.15.90:0/539941822 conn(0x7f767c0c91d0 msgr2=0x7f767c0c53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:22.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.789+0000 7f7682200640 1 -- 172.21.15.90:0/539941822 shutdown_connections 2024-09-21T03:15:22.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.789+0000 7f7682200640 1 -- 172.21.15.90:0/539941822 wait complete. 2024-09-21T03:15:22.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.791+0000 7f7682200640 1 Processor -- start 2024-09-21T03:15:22.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.791+0000 7f7682200640 1 -- start start 2024-09-21T03:15:22.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.792+0000 7f7682200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f767c0c2b50 0x7f767c074cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:22.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.792+0000 7f7682200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767c0c7ca0 0x7f767c1ed300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:22.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.793+0000 7f7682200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f767c158190 0x7f767c146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:22.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.793+0000 7f7682200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f767c0c6200 con 0x7f767c0c7ca0 2024-09-21T03:15:22.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.793+0000 7f7682200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f767c152750 con 0x7f767c158190 2024-09-21T03:15:22.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.793+0000 7f7682200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f767c0c6380 con 0x7f767c0c2b50 2024-09-21T03:15:22.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.793+0000 7f7672a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767c0c7ca0 0x7f767c1ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:22.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.793+0000 7f7672a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767c0c7ca0 0x7f767c1ed300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47760/0 (socket says 172.21.15.90:47760) 2024-09-21T03:15:22.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.793+0000 7f7672a00640 1 -- 172.21.15.90:0/583968455 learned_addr learned my addr 172.21.15.90:0/583968455 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:22.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.793+0000 7f767b400640 1 --2- 172.21.15.90:0/583968455 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f767c0c2b50 0x7f767c074cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:22.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.793+0000 7f767be00640 1 --2- 172.21.15.90:0/583968455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f767c158190 0x7f767c146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:22.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.793+0000 7f7672a00640 1 -- 172.21.15.90:0/583968455 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f767c0c2b50 msgr2=0x7f767c074cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:22.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.793+0000 7f7672a00640 1 --2- 172.21.15.90:0/583968455 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f767c0c2b50 0x7f767c074cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:22.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.793+0000 7f7672a00640 1 -- 172.21.15.90:0/583968455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f767c158190 msgr2=0x7f767c146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:22.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.793+0000 7f7672a00640 1 --2- 172.21.15.90:0/583968455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f767c158190 0x7f767c146cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:22.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.793+0000 7f7672a00640 1 -- 172.21.15.90:0/583968455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767c073310 con 0x7f767c0c7ca0 2024-09-21T03:15:22.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.793+0000 7f7672a00640 1 --2- 172.21.15.90:0/583968455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767c0c7ca0 0x7f767c1ed300 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f766400d720 tx=0x7f766400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:22.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.794+0000 7f7673e00640 1 -- 172.21.15.90:0/583968455 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7664017070 con 0x7f767c0c7ca0 2024-09-21T03:15:22.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.794+0000 7f7673e00640 1 -- 172.21.15.90:0/583968455 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7664009ab0 con 0x7f767c0c7ca0 2024-09-21T03:15:22.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.794+0000 7f7673e00640 1 -- 172.21.15.90:0/583968455 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7664010460 con 0x7f767c0c7ca0 2024-09-21T03:15:22.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.794+0000 7f7682200640 1 -- 172.21.15.90:0/583968455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767c157ee0 con 0x7f767c0c7ca0 2024-09-21T03:15:22.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.794+0000 7f7682200640 1 -- 172.21.15.90:0/583968455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f767c157920 con 0x7f767c0c7ca0 2024-09-21T03:15:22.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.795+0000 7f7682200640 1 -- 172.21.15.90:0/583968455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f767c1573a0 con 0x7f767c0c7ca0 2024-09-21T03:15:22.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.796+0000 7f7673e00640 1 -- 172.21.15.90:0/583968455 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f766401a070 con 0x7f767c0c7ca0 2024-09-21T03:15:22.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.797+0000 7f7673e00640 1 --2- 172.21.15.90:0/583968455 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7658078b90 0x7f765807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:22.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.797+0000 7f7673e00640 1 -- 172.21.15.90:0/583968455 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f766409b0e0 con 0x7f767c0c7ca0 2024-09-21T03:15:22.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.798+0000 7f767b400640 1 --2- 172.21.15.90:0/583968455 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7658078b90 0x7f765807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:22.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.799+0000 7f767b400640 1 --2- 172.21.15.90:0/583968455 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7658078b90 0x7f765807b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f766c035000 tx=0x7f766c004ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:22.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:22.802+0000 7f7673e00640 1 -- 172.21.15.90:0/583968455 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f767c1573a0 con 0x7f767c0c7ca0 2024-09-21T03:15:22.808 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:15:22.808 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:15:22.847 INFO:tasks.workunit.client.0.smithi090.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T03:15:22.849 INFO:tasks.workunit.client.1.smithi149.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-21T03:15:23.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.070+0000 7f7682200640 1 -- 172.21.15.90:0/583968455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f767c0c5070 con 0x7f767c0c7ca0 2024-09-21T03:15:23.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.071+0000 7f7673e00640 1 -- 172.21.15.90:0/583968455 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f7664063280 con 0x7f767c0c7ca0 2024-09-21T03:15:23.073 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":73,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:15:23.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.073+0000 7f7682200640 1 -- 172.21.15.90:0/583968455 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7658078b90 msgr2=0x7f765807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.073+0000 7f7682200640 1 --2- 172.21.15.90:0/583968455 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7658078b90 0x7f765807b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f766c035000 tx=0x7f766c004ab0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.073+0000 7f7682200640 1 -- 172.21.15.90:0/583968455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767c0c7ca0 msgr2=0x7f767c1ed300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.073+0000 7f7682200640 1 --2- 172.21.15.90:0/583968455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767c0c7ca0 0x7f767c1ed300 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f766400d720 tx=0x7f766400dbe0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.073+0000 7f7682200640 1 -- 172.21.15.90:0/583968455 shutdown_connections 2024-09-21T03:15:23.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.073+0000 7f7682200640 1 --2- 172.21.15.90:0/583968455 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7658078b90 0x7f765807b0a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.073+0000 7f7682200640 1 --2- 172.21.15.90:0/583968455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f767c158190 0x7f767c146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.073+0000 7f7682200640 1 --2- 172.21.15.90:0/583968455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767c0c7ca0 0x7f767c1ed300 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.073+0000 7f7682200640 1 --2- 172.21.15.90:0/583968455 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f767c0c2b50 0x7f767c074cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.073+0000 7f7682200640 1 -- 172.21.15.90:0/583968455 >> 172.21.15.90:0/583968455 conn(0x7f767c0c91d0 msgr2=0x7f767c14a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:23.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.073+0000 7f7682200640 1 -- 172.21.15.90:0/583968455 shutdown_connections 2024-09-21T03:15:23.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.073+0000 7f7682200640 1 -- 172.21.15.90:0/583968455 wait complete. 2024-09-21T03:15:23.097 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-21T03:15:23.098 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-21T03:15:23.098 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-21T03:15:23.098 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:15:23.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.359+0000 7f9744000640 1 -- 172.21.15.90:0/4213333548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c073490 msgr2=0x7f973c1551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.359+0000 7f9744000640 1 --2- 172.21.15.90:0/4213333548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c073490 0x7f973c1551b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9734005fd0 tx=0x7f973402a8b0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.359+0000 7f9744000640 1 -- 172.21.15.90:0/4213333548 shutdown_connections 2024-09-21T03:15:23.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.359+0000 7f9744000640 1 --2- 172.21.15.90:0/4213333548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c073490 0x7f973c1551b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.359+0000 7f9744000640 1 -- 172.21.15.90:0/4213333548 >> 172.21.15.90:0/4213333548 conn(0x7f973c0c85a0 msgr2=0x7f973c0c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:23.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.359+0000 7f9744000640 1 -- 172.21.15.90:0/4213333548 shutdown_connections 2024-09-21T03:15:23.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.359+0000 7f9744000640 1 -- 172.21.15.90:0/4213333548 wait complete. 2024-09-21T03:15:23.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.361+0000 7f9744000640 1 Processor -- start 2024-09-21T03:15:23.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.361+0000 7f9744000640 1 -- start start 2024-09-21T03:15:23.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.363+0000 7f9744000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973c073080 0x7f973c155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:23.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.363+0000 7f9744000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f973c073490 0x7f973c153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:23.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.363+0000 7f9744000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c0ae0a0 0x7f973c1ed300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:23.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.363+0000 7f9744000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f973c0acf00 con 0x7f973c0ae0a0 2024-09-21T03:15:23.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.363+0000 7f9744000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f973c0ac150 con 0x7f973c073080 2024-09-21T03:15:23.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.363+0000 7f9744000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f973c0abd90 con 0x7f973c073490 2024-09-21T03:15:23.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.363+0000 7f9742000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c0ae0a0 0x7f973c1ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:23.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.363+0000 7f9742000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c0ae0a0 0x7f973c1ed300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47782/0 (socket says 172.21.15.90:47782) 2024-09-21T03:15:23.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.363+0000 7f9742000640 1 -- 172.21.15.90:0/4261506569 learned_addr learned my addr 172.21.15.90:0/4261506569 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:23.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.363+0000 7f9741600640 1 --2- 172.21.15.90:0/4261506569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973c073080 0x7f973c155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:23.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.363+0000 7f9740c00640 1 --2- 172.21.15.90:0/4261506569 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f973c073490 0x7f973c153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:23.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.363+0000 7f9742000640 1 -- 172.21.15.90:0/4261506569 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f973c073490 msgr2=0x7f973c153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.363+0000 7f9742000640 1 --2- 172.21.15.90:0/4261506569 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f973c073490 0x7f973c153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.363+0000 7f9742000640 1 -- 172.21.15.90:0/4261506569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973c073080 msgr2=0x7f973c155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.363+0000 7f9742000640 1 --2- 172.21.15.90:0/4261506569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973c073080 0x7f973c155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.363+0000 7f9742000640 1 -- 172.21.15.90:0/4261506569 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973c158b30 con 0x7f973c0ae0a0 2024-09-21T03:15:23.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.364+0000 7f9742000640 1 --2- 172.21.15.90:0/4261506569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c0ae0a0 0x7f973c1ed300 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9734009cd0 tx=0x7f9734031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:23.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.364+0000 7f9739600640 1 -- 172.21.15.90:0/4261506569 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9734031990 con 0x7f973c0ae0a0 2024-09-21T03:15:23.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.364+0000 7f9739600640 1 -- 172.21.15.90:0/4261506569 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9734031c20 con 0x7f973c0ae0a0 2024-09-21T03:15:23.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.364+0000 7f9739600640 1 -- 172.21.15.90:0/4261506569 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97340330d0 con 0x7f973c0ae0a0 2024-09-21T03:15:23.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.364+0000 7f9744000640 1 -- 172.21.15.90:0/4261506569 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f973c158e10 con 0x7f973c0ae0a0 2024-09-21T03:15:23.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.364+0000 7f9744000640 1 -- 172.21.15.90:0/4261506569 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f973c06fd70 con 0x7f973c0ae0a0 2024-09-21T03:15:23.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.365+0000 7f9744000640 1 --2- 172.21.15.90:0/4261506569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c1ecd90 0x7f973c1ed840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:23.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.365+0000 7f9744000640 1 -- 172.21.15.90:0/4261506569 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f973c1588e0 con 0x7f973c1ecd90 2024-09-21T03:15:23.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.365+0000 7f9741600640 1 --2- 172.21.15.90:0/4261506569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c1ecd90 0x7f973c1ed840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:23.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.366+0000 7f9741600640 1 -- 172.21.15.90:0/4261506569 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f973c1f1260 con 0x7f973c1ecd90 2024-09-21T03:15:23.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.366+0000 7f9741600640 1 --2- 172.21.15.90:0/4261506569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c1ecd90 0x7f973c1ed840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f973000f570 tx=0x7f973000fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:23.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.366+0000 7f9739600640 1 -- 172.21.15.90:0/4261506569 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97300052e0 con 0x7f973c1ecd90 2024-09-21T03:15:23.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.367+0000 7f9739600640 1 -- 172.21.15.90:0/4261506569 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9734033270 con 0x7f973c0ae0a0 2024-09-21T03:15:23.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.368+0000 7f9739600640 1 --2- 172.21.15.90:0/4261506569 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f971c078a90 0x7f971c07afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:23.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.368+0000 7f9739600640 1 -- 172.21.15.90:0/4261506569 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f97340bc240 con 0x7f973c0ae0a0 2024-09-21T03:15:23.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.368+0000 7f9739600640 1 -- 172.21.15.90:0/4261506569 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9730018070 con 0x7f973c1ecd90 2024-09-21T03:15:23.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.368+0000 7f9739600640 1 -- 172.21.15.90:0/4261506569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c1ecd90 msgr2=0x7f973c1ed840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.368+0000 7f9739600640 1 --2- 172.21.15.90:0/4261506569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c1ecd90 0x7f973c1ed840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f973000f570 tx=0x7f973000fa30 comp rx=0 tx=0).stop 2024-09-21T03:15:23.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.368+0000 7f9739600640 1 -- 172.21.15.90:0/4261506569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c1ecd90 msgr2=0x7f973c1ed840 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:15:23.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.368+0000 7f9739600640 1 --2- 172.21.15.90:0/4261506569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c1ecd90 0x7f973c1ed840 secure :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f973000f570 tx=0x7f973000fa30 comp rx=0 tx=0).stop 2024-09-21T03:15:23.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.368+0000 7f9740c00640 1 --2- 172.21.15.90:0/4261506569 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f971c078a90 0x7f971c07afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:23.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.369+0000 7f9740c00640 1 --2- 172.21.15.90:0/4261506569 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f971c078a90 0x7f971c07afa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f973c06e9a0 tx=0x7f9728009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:23.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.374+0000 7f9744000640 1 --2- 172.21.15.90:0/4261506569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c0c7bd0 0x7f973c1485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:23.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.374+0000 7f9744000640 1 -- 172.21.15.90:0/4261506569 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f973c0c39a0 con 0x7f973c0c7bd0 2024-09-21T03:15:23.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.375+0000 7f9741600640 1 --2- 172.21.15.90:0/4261506569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c0c7bd0 0x7f973c1485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:23.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.375+0000 7f9741600640 1 -- 172.21.15.90:0/4261506569 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f973c073a70 con 0x7f973c0c7bd0 2024-09-21T03:15:23.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.375+0000 7f9741600640 1 --2- 172.21.15.90:0/4261506569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c0c7bd0 0x7f973c1485a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9730017000 tx=0x7f9730007ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:23.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.376+0000 7f9739600640 1 -- 172.21.15.90:0/4261506569 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9730003d50 con 0x7f973c0c7bd0 2024-09-21T03:15:23.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.376+0000 7f9739600640 1 -- 172.21.15.90:0/4261506569 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4884 (secure 0 0 0) 0x7f9730003d50 con 0x7f973c0c7bd0 2024-09-21T03:15:23.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.376+0000 7f9739600640 1 -- 172.21.15.90:0/4261506569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c0c7bd0 msgr2=0x7f973c1485a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.376+0000 7f9739600640 1 --2- 172.21.15.90:0/4261506569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c0c7bd0 0x7f973c1485a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9730017000 tx=0x7f9730007ba0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.376+0000 7f9739600640 1 -- 172.21.15.90:0/4261506569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c0c7bd0 msgr2=0x7f973c1485a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:15:23.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.376+0000 7f9739600640 1 --2- 172.21.15.90:0/4261506569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c0c7bd0 0x7f973c1485a0 secure :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9730017000 tx=0x7f9730007ba0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.378 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:15:23.378 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:15:23.378 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:15:23.379 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:15:23.379 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 4, 2024-09-21T03:15:23.379 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 74091, 2024-09-21T03:15:23.379 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:15:23.379 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:15:23.379 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:15:23.379 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:15:23.379 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:23.379 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 74, 2024-09-21T03:15:23.379 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:15:23.379 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:15:23.379 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:15:23.379 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:15:23.380 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:15:23.380 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:15:23.380 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:15:23.380 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:15:23.380 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:15:23.380 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:15:23.380 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:15:23.380 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:15:23.380 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:15:23.380 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:15:23.380 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:23.380 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:15:23.380 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:15:23.380 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:15:23.380 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:15:23.381 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:15:23.381 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:15:23.381 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:15:23.381 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:15:23.381 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:15:23.381 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:15:23.381 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:15:23.381 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:15:23.381 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:15:23.381 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:23.381 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.381 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:15:23.381 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:15:23.381 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:15:23.382 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:15:23.382 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:15:23.382 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:15:23.382 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:15:23.382 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:15:23.382 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:15:23.382 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:15:23.382 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:15:23.382 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:15:23.382 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:15:23.382 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:15:23.382 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:15:23.382 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:15:23.383 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:15:23.383 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:15:23.383 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:15:23.383 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:15:23.383 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:15:23.383 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:15:23.383 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:15:23.383 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:15:23.383 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:15:23.383 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:15:23.383 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:15:23.383 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:15:23.383 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:23.383 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:15:23.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.384 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:15:23.384 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.384 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:15:23.384 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:15:23.384 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:15:23.384 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:15:23.384 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.384 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:15:23.384 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:15:23.384 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:23.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.384 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.384 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:15:23.385 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:15:23.385 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:23.385 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.385 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:23.385 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.385 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:15:23.385 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:15:23.385 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:15:23.385 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:15:23.385 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:15:23.385 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.385 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.385 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:15:23.385 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:15:23.386 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:15:23.386 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:15:23.386 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.386 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:15:23.386 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:15:23.386 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:23.386 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.386 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.386 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:15:23.386 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:15:23.386 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:23.386 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.386 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:23.387 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.387 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:15:23.387 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:15:23.387 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:15:23.387 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:15:23.387 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:15:23.387 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.387 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.387 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:15:23.387 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:15:23.387 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:15:23.387 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:15:23.387 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.387 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:15:23.388 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:15:23.388 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:23.388 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.388 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.388 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:15:23.388 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:15:23.388 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:23.388 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.388 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:23.388 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.388 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:15:23.388 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:15:23.388 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:15:23.388 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:15:23.389 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:15:23.389 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.389 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:23.389 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.389 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:15:23.389 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:15:23.389 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.389 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:23.389 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:23.389 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:15:23.389 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.389 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:23.389 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:15:23.389 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.389 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:23.390 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:23.390 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:15:23.390 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.390 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:23.390 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:15:23.390 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.390 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:23.390 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:23.390 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 3 2024-09-21T03:15:23.390 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.390 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:23.390 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:15:23.390 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.390 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:23.391 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:23.391 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:15:23.391 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.391 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:23.391 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.391 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:15:23.391 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:15:23.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.376+0000 7f9744000640 1 -- 172.21.15.90:0/4261506569 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f971c078a90 msgr2=0x7f971c07afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.376+0000 7f9744000640 1 --2- 172.21.15.90:0/4261506569 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f971c078a90 0x7f971c07afa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f973c06e9a0 tx=0x7f9728009040 comp rx=0 tx=0).stop 2024-09-21T03:15:23.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.376+0000 7f9744000640 1 -- 172.21.15.90:0/4261506569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c0ae0a0 msgr2=0x7f973c1ed300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.376+0000 7f9744000640 1 --2- 172.21.15.90:0/4261506569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f973c0ae0a0 0x7f973c1ed300 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9734009cd0 tx=0x7f9734031700 comp rx=0 tx=0).stop 2024-09-21T03:15:23.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.376+0000 7f9742000640 1 -- 172.21.15.90:0/4261506569 reap_dead start 2024-09-21T03:15:23.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.376+0000 7f9742000640 1 -- 172.21.15.90:0/4261506569 reap_dead start 2024-09-21T03:15:23.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.376+0000 7f9744000640 1 -- 172.21.15.90:0/4261506569 shutdown_connections 2024-09-21T03:15:23.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.376+0000 7f9744000640 1 -- 172.21.15.90:0/4261506569 >> 172.21.15.90:0/4261506569 conn(0x7f973c0c85a0 msgr2=0x7f973c151560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:23.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.377+0000 7f9744000640 1 -- 172.21.15.90:0/4261506569 shutdown_connections 2024-09-21T03:15:23.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.377+0000 7f9744000640 1 -- 172.21.15.90:0/4261506569 wait complete. 2024-09-21T03:15:23.398 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:15:23.398 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-21T03:15:23.399 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:15:23.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.620+0000 7fa3f4c00640 1 -- 172.21.15.90:0/1172700942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f00ad310 msgr2=0x7fa3f00aa9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.620+0000 7fa3f4c00640 1 --2- 172.21.15.90:0/1172700942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f00ad310 0x7fa3f00aa9e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009830 tx=0x7fa3e002a4a0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.620+0000 7fa3f4c00640 1 -- 172.21.15.90:0/1172700942 shutdown_connections 2024-09-21T03:15:23.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.620+0000 7fa3f4c00640 1 --2- 172.21.15.90:0/1172700942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f00ad310 0x7fa3f00aa9e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.620+0000 7fa3f4c00640 1 -- 172.21.15.90:0/1172700942 >> 172.21.15.90:0/1172700942 conn(0x7fa3f006d200 msgr2=0x7fa3f006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:23.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.620+0000 7fa3f4c00640 1 -- 172.21.15.90:0/1172700942 shutdown_connections 2024-09-21T03:15:23.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.620+0000 7fa3f4c00640 1 -- 172.21.15.90:0/1172700942 wait complete. 2024-09-21T03:15:23.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.622+0000 7fa3f4c00640 1 Processor -- start 2024-09-21T03:15:23.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.622+0000 7fa3f4c00640 1 -- start start 2024-09-21T03:15:23.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.624+0000 7fa3f4c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f00aaf20 0x7fa3f0148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:23.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.624+0000 7fa3f4c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f00ad310 0x7fa3f01ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:23.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.624+0000 7fa3f4c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3f014b5a0 0x7fa3f0144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:23.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.624+0000 7fa3f4c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f00c57b0 con 0x7fa3f00aaf20 2024-09-21T03:15:23.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.624+0000 7fa3f4c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f00c5630 con 0x7fa3f00ad310 2024-09-21T03:15:23.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.624+0000 7fa3f4c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa3f0070030 con 0x7fa3f014b5a0 2024-09-21T03:15:23.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.624+0000 7fa3ef400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f00aaf20 0x7fa3f0148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:23.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.624+0000 7fa3ef400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f00aaf20 0x7fa3f0148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47804/0 (socket says 172.21.15.90:47804) 2024-09-21T03:15:23.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.624+0000 7fa3ef400640 1 -- 172.21.15.90:0/730793760 learned_addr learned my addr 172.21.15.90:0/730793760 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:23.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.624+0000 7fa3ef400640 1 -- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3f014b5a0 msgr2=0x7fa3f0144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.624+0000 7fa3ef400640 1 --2- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3f014b5a0 0x7fa3f0144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.624+0000 7fa3ef400640 1 -- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f00ad310 msgr2=0x7fa3f01ed0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.624+0000 7fa3ef400640 1 --2- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f00ad310 0x7fa3f01ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.624+0000 7fa3ef400640 1 -- 172.21.15.90:0/730793760 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f01547c0 con 0x7fa3f00aaf20 2024-09-21T03:15:23.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.625+0000 7fa3ef400640 1 --2- 172.21.15.90:0/730793760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f00aaf20 0x7fa3f0148d60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009950 tx=0x7fa3e0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:23.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.625+0000 7fa3e7400640 1 -- 172.21.15.90:0/730793760 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0031d60 con 0x7fa3f00aaf20 2024-09-21T03:15:23.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.625+0000 7fa3e7400640 1 -- 172.21.15.90:0/730793760 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3e0033e10 con 0x7fa3f00aaf20 2024-09-21T03:15:23.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.625+0000 7fa3f4c00640 1 -- 172.21.15.90:0/730793760 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f00743e0 con 0x7fa3f00aaf20 2024-09-21T03:15:23.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.625+0000 7fa3e7400640 1 -- 172.21.15.90:0/730793760 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0005260 con 0x7fa3f00aaf20 2024-09-21T03:15:23.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.625+0000 7fa3f4c00640 1 -- 172.21.15.90:0/730793760 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f01466a0 con 0x7fa3f00aaf20 2024-09-21T03:15:23.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.626+0000 7fa3f4c00640 1 --2- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f0146bc0 0x7fa3f0144c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:23.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.626+0000 7fa3f4c00640 1 -- 172.21.15.90:0/730793760 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f01ed9c0 con 0x7fa3f0146bc0 2024-09-21T03:15:23.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.626+0000 7fa3eea00640 1 --2- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f0146bc0 0x7fa3f0144c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:23.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.627+0000 7fa3eea00640 1 -- 172.21.15.90:0/730793760 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa3f01451b0 con 0x7fa3f0146bc0 2024-09-21T03:15:23.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.627+0000 7fa3eea00640 1 --2- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f0146bc0 0x7fa3f0144c70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0158a20 tx=0x7fa3dc00c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:23.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.627+0000 7fa3e7400640 1 -- 172.21.15.90:0/730793760 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc017070 con 0x7fa3f0146bc0 2024-09-21T03:15:23.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.628+0000 7fa3e7400640 1 -- 172.21.15.90:0/730793760 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa3dc0035f0 con 0x7fa3f0146bc0 2024-09-21T03:15:23.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.628+0000 7fa3e7400640 1 -- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f0146bc0 msgr2=0x7fa3f0144c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.628+0000 7fa3e7400640 1 --2- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f0146bc0 0x7fa3f0144c70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0158a20 tx=0x7fa3dc00c7a0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.628+0000 7fa3e7400640 1 -- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f0146bc0 msgr2=0x7fa3f0144c70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:15:23.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.628+0000 7fa3e7400640 1 --2- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f0146bc0 0x7fa3f0144c70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.628+0000 7fa3e7400640 1 -- 172.21.15.90:0/730793760 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa3e0005400 con 0x7fa3f00aaf20 2024-09-21T03:15:23.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.629+0000 7fa3e7400640 1 --2- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa3d0078630 0x7fa3d007ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:23.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.629+0000 7fa3e7400640 1 -- 172.21.15.90:0/730793760 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fa3e00bc1d0 con 0x7fa3f00aaf20 2024-09-21T03:15:23.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.629+0000 7fa3eea00640 1 --2- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa3d0078630 0x7fa3d007ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:23.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.630+0000 7fa3eea00640 1 --2- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa3d0078630 0x7fa3d007ab40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00ccc0 tx=0x7fa3dc00a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:23.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.634+0000 7fa3f4c00640 1 --2- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f0145460 0x7fa3f0145870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:23.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.634+0000 7fa3f4c00640 1 -- 172.21.15.90:0/730793760 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f00aa9e0 con 0x7fa3f0145460 2024-09-21T03:15:23.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.635+0000 7fa3efe00640 1 --2- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f0145460 0x7fa3f0145870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:23.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.635+0000 7fa3efe00640 1 -- 172.21.15.90:0/730793760 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa3f00c4810 con 0x7fa3f0145460 2024-09-21T03:15:23.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.636+0000 7fa3efe00640 1 --2- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f0145460 0x7fa3f0145870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8004a30 tx=0x7fa3e800ce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:23.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.636+0000 7fa3e7400640 1 -- 172.21.15.90:0/730793760 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8016030 con 0x7fa3f0145460 2024-09-21T03:15:23.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.637+0000 7fa3e7400640 1 -- 172.21.15.90:0/730793760 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4882 (secure 0 0 0) 0x7fa3e800a8f0 con 0x7fa3f0145460 2024-09-21T03:15:23.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.637+0000 7fa3e7400640 1 -- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f0145460 msgr2=0x7fa3f0145870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.637+0000 7fa3e7400640 1 --2- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f0145460 0x7fa3f0145870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8004a30 tx=0x7fa3e800ce80 comp rx=0 tx=0).stop 2024-09-21T03:15:23.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.637+0000 7fa3e7400640 1 -- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f0145460 msgr2=0x7fa3f0145870 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:15:23.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.637+0000 7fa3e7400640 1 --2- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f0145460 0x7fa3f0145870 secure :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8004a30 tx=0x7fa3e800ce80 comp rx=0 tx=0).stop 2024-09-21T03:15:23.639 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:15:23.639 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:15:23.639 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:15:23.639 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:15:23.639 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 4, 2024-09-21T03:15:23.639 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 74425, 2024-09-21T03:15:23.640 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:15:23.640 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:15:23.640 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:15:23.640 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:15:23.640 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:23.640 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 74, 2024-09-21T03:15:23.640 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:15:23.640 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:15:23.640 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:15:23.640 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:15:23.640 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:15:23.640 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:15:23.640 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:15:23.641 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:15:23.641 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:15:23.641 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:15:23.641 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:15:23.641 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:15:23.641 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:15:23.641 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:15:23.641 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:23.641 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:15:23.641 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:15:23.641 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:15:23.641 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:15:23.641 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:15:23.641 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:15:23.641 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:15:23.642 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:15:23.642 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:15:23.642 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:15:23.642 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:15:23.642 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:15:23.642 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:15:23.642 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:23.642 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.642 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:15:23.642 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:15:23.642 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:15:23.642 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:15:23.642 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:15:23.642 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:15:23.643 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:15:23.643 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:15:23.643 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:15:23.643 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:15:23.643 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:15:23.643 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:15:23.643 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:15:23.643 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:15:23.643 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:15:23.643 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:15:23.643 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:15:23.643 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:15:23.643 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:15:23.644 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:15:23.644 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:15:23.644 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:15:23.644 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:15:23.644 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:15:23.644 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:15:23.644 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:15:23.644 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:15:23.644 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:15:23.644 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:23.644 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:15:23.644 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.644 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:15:23.645 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.645 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:15:23.645 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:15:23.645 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:15:23.645 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:15:23.645 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.645 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:15:23.645 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:15:23.645 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:23.645 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.645 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.645 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:15:23.645 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:15:23.645 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:23.646 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.646 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:23.646 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.646 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:15:23.646 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:15:23.646 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:15:23.646 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:15:23.646 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:15:23.646 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.646 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.646 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:15:23.646 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:15:23.646 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:15:23.646 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:15:23.647 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.647 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:15:23.647 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:15:23.647 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:23.647 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.647 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.647 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:15:23.647 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:15:23.647 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:23.647 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.647 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:23.647 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.647 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:15:23.647 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:15:23.648 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:15:23.648 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:15:23.648 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:15:23.648 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.648 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.648 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:15:23.648 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:15:23.648 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:15:23.648 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:15:23.648 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.648 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:15:23.648 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:15:23.648 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:23.649 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.649 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.649 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:15:23.649 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:15:23.649 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:23.649 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.649 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:23.649 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.649 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:15:23.649 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:15:23.649 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:15:23.649 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:15:23.650 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:15:23.650 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.650 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:23.650 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.650 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:15:23.650 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:15:23.650 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.650 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:23.650 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:23.650 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:15:23.650 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.650 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:23.650 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:15:23.650 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.651 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:23.651 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:23.651 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:15:23.651 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.651 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:23.651 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:15:23.651 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.651 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:23.651 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:23.651 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:15:23.651 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.651 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:23.651 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:15:23.651 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.652 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:23.652 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:23.652 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:15:23.652 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.652 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:23.652 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.652 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:15:23.652 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:15:23.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.637+0000 7fa3f4c00640 1 -- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa3d0078630 msgr2=0x7fa3d007ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.637+0000 7fa3f4c00640 1 --2- 172.21.15.90:0/730793760 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa3d0078630 0x7fa3d007ab40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00ccc0 tx=0x7fa3dc00a000 comp rx=0 tx=0).stop 2024-09-21T03:15:23.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.637+0000 7fa3f4c00640 1 -- 172.21.15.90:0/730793760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f00aaf20 msgr2=0x7fa3f0148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.637+0000 7fa3f4c00640 1 --2- 172.21.15.90:0/730793760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f00aaf20 0x7fa3f0148d60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009950 tx=0x7fa3e0033c20 comp rx=0 tx=0).stop 2024-09-21T03:15:23.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.637+0000 7fa3efe00640 1 -- 172.21.15.90:0/730793760 reap_dead start 2024-09-21T03:15:23.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.637+0000 7fa3efe00640 1 -- 172.21.15.90:0/730793760 reap_dead start 2024-09-21T03:15:23.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.637+0000 7fa3f4c00640 1 -- 172.21.15.90:0/730793760 shutdown_connections 2024-09-21T03:15:23.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.637+0000 7fa3f4c00640 1 -- 172.21.15.90:0/730793760 >> 172.21.15.90:0/730793760 conn(0x7fa3f006d200 msgr2=0x7fa3f0155ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:23.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.637+0000 7fa3f4c00640 1 -- 172.21.15.90:0/730793760 shutdown_connections 2024-09-21T03:15:23.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.637+0000 7fa3f4c00640 1 -- 172.21.15.90:0/730793760 wait complete. 2024-09-21T03:15:23.659 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:15:23.659 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-21T03:15:23.660 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.879+0000 7f6fcea00640 1 -- 172.21.15.90:0/2018102277 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fc80c4c50 msgr2=0x7f6fc8156cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.879+0000 7f6fcea00640 1 --2- 172.21.15.90:0/2018102277 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fc80c4c50 0x7f6fc8156cb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4009820 tx=0x7f6fb402a480 comp rx=0 tx=0).stop 2024-09-21T03:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.880+0000 7f6fcea00640 1 -- 172.21.15.90:0/2018102277 shutdown_connections 2024-09-21T03:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.880+0000 7f6fcea00640 1 --2- 172.21.15.90:0/2018102277 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fc80722e0 0x7f6fc80726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.880+0000 7f6fcea00640 1 --2- 172.21.15.90:0/2018102277 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fc80c4c50 0x7f6fc8156cb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.880+0000 7f6fcea00640 1 -- 172.21.15.90:0/2018102277 >> 172.21.15.90:0/2018102277 conn(0x7f6fc806cde0 msgr2=0x7f6fc806d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.880+0000 7f6fcea00640 1 -- 172.21.15.90:0/2018102277 shutdown_connections 2024-09-21T03:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.880+0000 7f6fcea00640 1 -- 172.21.15.90:0/2018102277 wait complete. 2024-09-21T03:15:23.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.882+0000 7f6fcea00640 1 Processor -- start 2024-09-21T03:15:23.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.882+0000 7f6fcea00640 1 -- start start 2024-09-21T03:15:23.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.883+0000 7f6fcea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fc80722e0 0x7f6fc814ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:23.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.883+0000 7f6fcea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fc80c4c50 0x7f6fc81f03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:23.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.883+0000 7f6fcea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fc80c7920 0x7f6fc80a9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:23.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.883+0000 7f6fcea00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc80c65f0 con 0x7f6fc80c4c50 2024-09-21T03:15:23.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.883+0000 7f6fcea00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc80c6470 con 0x7f6fc80c7920 2024-09-21T03:15:23.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.883+0000 7f6fcea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6fc81581a0 con 0x7f6fc80722e0 2024-09-21T03:15:23.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.883+0000 7f6fccc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fc80c4c50 0x7f6fc81f03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:23.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.883+0000 7f6fccc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fc80c4c50 0x7f6fc81f03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47818/0 (socket says 172.21.15.90:47818) 2024-09-21T03:15:23.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.883+0000 7f6fccc00640 1 -- 172.21.15.90:0/1554573184 learned_addr learned my addr 172.21.15.90:0/1554573184 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:23.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.884+0000 7f6fcd600640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fc80722e0 0x7f6fc814ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:23.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.884+0000 7f6fce000640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fc80c7920 0x7f6fc80a9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:23.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.884+0000 7f6fccc00640 1 -- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fc80722e0 msgr2=0x7f6fc814ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.884+0000 7f6fccc00640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fc80722e0 0x7f6fc814ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.884+0000 7f6fccc00640 1 -- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fc80c7920 msgr2=0x7f6fc80a9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.884+0000 7f6fccc00640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fc80c7920 0x7f6fc80a9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.884+0000 7f6fccc00640 1 -- 172.21.15.90:0/1554573184 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc81f0930 con 0x7f6fc80c4c50 2024-09-21T03:15:23.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.884+0000 7f6fccc00640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fc80c4c50 0x7f6fc81f03f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6fb402aa70 tx=0x7f6fb4005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:23.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.884+0000 7f6fc5600640 1 -- 172.21.15.90:0/1554573184 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb403f070 con 0x7f6fc80c4c50 2024-09-21T03:15:23.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.884+0000 7f6fc5600640 1 -- 172.21.15.90:0/1554573184 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6fb4004340 con 0x7f6fc80c4c50 2024-09-21T03:15:23.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.884+0000 7f6fcea00640 1 -- 172.21.15.90:0/1554573184 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fc814f660 con 0x7f6fc80c4c50 2024-09-21T03:15:23.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.885+0000 7f6fc5600640 1 -- 172.21.15.90:0/1554573184 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4031bb0 con 0x7f6fc80c4c50 2024-09-21T03:15:23.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.885+0000 7f6fcea00640 1 -- 172.21.15.90:0/1554573184 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fc814f900 con 0x7f6fc80c4c50 2024-09-21T03:15:23.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.886+0000 7f6fcea00640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fc8152cc0 0x7f6fc8156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:23.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.886+0000 7f6fcea00640 1 -- 172.21.15.90:0/1554573184 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6fc81f0e00 con 0x7f6fc8152cc0 2024-09-21T03:15:23.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.886+0000 7f6fcd600640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fc8152cc0 0x7f6fc8156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:23.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.887+0000 7f6fcd600640 1 -- 172.21.15.90:0/1554573184 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6fc81586e0 con 0x7f6fc8152cc0 2024-09-21T03:15:23.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.887+0000 7f6fcd600640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fc8152cc0 0x7f6fc8156080 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00f540 tx=0x7f6fbc00fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:23.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.887+0000 7f6fc5600640 1 -- 172.21.15.90:0/1554573184 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6fb4042070 con 0x7f6fc80c4c50 2024-09-21T03:15:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.888+0000 7f6fc5600640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6fa8078bc0 0x7f6fa807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.888+0000 7f6fc5600640 1 -- 172.21.15.90:0/1554573184 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc0052e0 con 0x7f6fc8152cc0 2024-09-21T03:15:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.888+0000 7f6fc5600640 1 -- 172.21.15.90:0/1554573184 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f6fb40bc020 con 0x7f6fc80c4c50 2024-09-21T03:15:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.888+0000 7f6fc5600640 1 -- 172.21.15.90:0/1554573184 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6fbc018070 con 0x7f6fc8152cc0 2024-09-21T03:15:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.888+0000 7f6fc5600640 1 -- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fc8152cc0 msgr2=0x7f6fc8156080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.888+0000 7f6fc5600640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fc8152cc0 0x7f6fc8156080 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00f540 tx=0x7f6fbc00fa00 comp rx=0 tx=0).stop 2024-09-21T03:15:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.888+0000 7f6fc5600640 1 -- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fc8152cc0 msgr2=0x7f6fc8156080 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:15:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.888+0000 7f6fc5600640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fc8152cc0 0x7f6fc8156080 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00f540 tx=0x7f6fbc00fa00 comp rx=0 tx=0).stop 2024-09-21T03:15:23.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.889+0000 7f6fce000640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6fa8078bc0 0x7f6fa807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:23.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.889+0000 7f6fce000640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6fa8078bc0 0x7f6fa807b0d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6fc815a020 tx=0x7f6fc00095b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:23.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.895+0000 7f6fcea00640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fc81565c0 0x7f6fc81ece80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:23.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.895+0000 7f6fcea00640 1 -- 172.21.15.90:0/1554573184 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6fc8159d70 con 0x7f6fc81565c0 2024-09-21T03:15:23.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.895+0000 7f6fcd600640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fc81565c0 0x7f6fc81ece80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:23.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.896+0000 7f6fcd600640 1 -- 172.21.15.90:0/1554573184 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6fc8152a40 con 0x7f6fc81565c0 2024-09-21T03:15:23.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.896+0000 7f6fcd600640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fc81565c0 0x7f6fc81ece80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00f540 tx=0x7f6fbc001080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:23.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.896+0000 7f6fc5600640 1 -- 172.21.15.90:0/1554573184 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc003910 con 0x7f6fc81565c0 2024-09-21T03:15:23.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.897+0000 7f6fc5600640 1 -- 172.21.15.90:0/1554573184 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5192 (secure 0 0 0) 0x7f6fbc003910 con 0x7f6fc81565c0 2024-09-21T03:15:23.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.897+0000 7f6fc5600640 1 -- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fc81565c0 msgr2=0x7f6fc81ece80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.897+0000 7f6fc5600640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fc81565c0 0x7f6fc81ece80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00f540 tx=0x7f6fbc001080 comp rx=0 tx=0).stop 2024-09-21T03:15:23.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.897+0000 7f6fc5600640 1 -- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fc81565c0 msgr2=0x7f6fc81ece80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:15:23.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.897+0000 7f6fc5600640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fc81565c0 0x7f6fc81ece80 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00f540 tx=0x7f6fbc001080 comp rx=0 tx=0).stop 2024-09-21T03:15:23.899 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:15:23.900 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:15:23.900 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:15:23.900 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:15:23.900 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 4, 2024-09-21T03:15:23.900 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 74686, 2024-09-21T03:15:23.900 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:15:23.900 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:15:23.900 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:15:23.900 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:15:23.900 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:23.900 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 74, 2024-09-21T03:15:23.900 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:15:23.900 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:15:23.900 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:15:23.901 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:15:23.901 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:15:23.901 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:15:23.901 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:15:23.901 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:15:23.901 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:15:23.901 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:15:23.901 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:15:23.901 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:15:23.901 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:15:23.901 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:15:23.901 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:23.901 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:15:23.901 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:15:23.901 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:15:23.901 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:15:23.902 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:15:23.902 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:15:23.902 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:15:23.902 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:15:23.902 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:15:23.902 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:15:23.902 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:15:23.902 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:15:23.902 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:15:23.902 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:23.902 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.902 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:15:23.902 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:15:23.902 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:15:23.902 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:15:23.903 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:15:23.903 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:15:23.903 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:15:23.903 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:15:23.903 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:15:23.903 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:15:23.903 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:15:23.903 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:15:23.903 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:15:23.903 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:15:23.903 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:15:23.903 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:15:23.903 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:15:23.903 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:15:23.903 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:15:23.904 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:15:23.904 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:15:23.904 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:15:23.904 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:15:23.904 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:15:23.904 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:15:23.904 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:15:23.904 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:15:23.904 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:15:23.904 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:23.904 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:15:23.904 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.904 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:15:23.904 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.904 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:15:23.904 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:15:23.905 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:15:23.905 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:15:23.905 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.905 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:15:23.905 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:15:23.905 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:23.905 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.905 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.905 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:15:23.905 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:15:23.905 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:23.905 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.905 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:23.905 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.905 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:15:23.905 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:15:23.906 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:15:23.906 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:15:23.906 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:15:23.906 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.906 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.906 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:15:23.906 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:15:23.906 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:15:23.906 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:15:23.906 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.906 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:15:23.906 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:15:23.906 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:23.906 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.906 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.907 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:15:23.907 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:15:23.907 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:23.907 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.907 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:23.907 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.907 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:15:23.907 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:15:23.907 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:15:23.907 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:15:23.907 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:15:23.907 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.907 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.907 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:15:23.907 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:15:23.908 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:15:23.908 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:15:23.908 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.908 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:15:23.908 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:15:23.908 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:23.908 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.908 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.908 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:15:23.908 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:15:23.908 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:23.908 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.908 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:23.908 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.908 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:15:23.909 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:15:23.909 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:15:23.909 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:15:23.909 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:15:23.909 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.909 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:23.909 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.909 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:15:23.909 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:15:23.909 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.909 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:23.909 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:23.909 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:15:23.909 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.909 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:23.910 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:15:23.910 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.910 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:23.910 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:23.910 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:15:23.910 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.910 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:23.910 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:15:23.910 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.910 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:23.910 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:23.910 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 3 2024-09-21T03:15:23.910 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.910 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:23.911 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:15:23.911 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.911 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:15:23.911 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:15:23.911 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:15:23.911 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.911 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.911 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:23.911 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:23.911 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:15:23.911 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.911 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:23.911 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:15:23.911 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:23.911 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:23.912 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:23.912 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:15:23.912 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:23.912 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:23.912 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:23.912 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:15:23.912 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:15:23.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.897+0000 7f6fcea00640 1 -- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6fa8078bc0 msgr2=0x7f6fa807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.897+0000 7f6fcea00640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6fa8078bc0 0x7f6fa807b0d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6fc815a020 tx=0x7f6fc00095b0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.897+0000 7f6fcea00640 1 -- 172.21.15.90:0/1554573184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fc80c4c50 msgr2=0x7f6fc81f03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:23.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.897+0000 7f6fcea00640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fc80c4c50 0x7f6fc81f03f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6fb402aa70 tx=0x7f6fb4005270 comp rx=0 tx=0).stop 2024-09-21T03:15:23.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.897+0000 7f6fce000640 1 -- 172.21.15.90:0/1554573184 reap_dead start 2024-09-21T03:15:23.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.898+0000 7f6fcea00640 1 -- 172.21.15.90:0/1554573184 shutdown_connections 2024-09-21T03:15:23.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.898+0000 7f6fcea00640 1 --2- 172.21.15.90:0/1554573184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fc80c4c50 0x7f6fc81f03f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:23.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.898+0000 7f6fcea00640 1 -- 172.21.15.90:0/1554573184 >> 172.21.15.90:0/1554573184 conn(0x7f6fc806cde0 msgr2=0x7f6fc81e0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:23.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.898+0000 7f6fcea00640 1 -- 172.21.15.90:0/1554573184 shutdown_connections 2024-09-21T03:15:23.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:23.898+0000 7f6fcea00640 1 -- 172.21.15.90:0/1554573184 wait complete. 2024-09-21T03:15:23.920 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:15:23.920 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-21T03:15:23.921 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-21T03:15:23.921 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-21T03:15:23.921 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-21T03:15:23.921 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-21T03:15:23.921 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:15:23.958 INFO:tasks.ceph.mon.c:Stopped 2024-09-21T03:15:23.958 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-21T03:15:23.959 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:15:24.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.176+0000 7f7149800640 1 -- 172.21.15.90:0/140687329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71440acca0 msgr2=0x7f7144074220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:24.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.176+0000 7f7149800640 1 --2- 172.21.15.90:0/140687329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71440acca0 0x7f7144074220 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7144155680 tx=0x7f713c02a820 comp rx=0 tx=0).stop 2024-09-21T03:15:24.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.177+0000 7f7149800640 1 -- 172.21.15.90:0/140687329 shutdown_connections 2024-09-21T03:15:24.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.177+0000 7f7149800640 1 --2- 172.21.15.90:0/140687329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71440acca0 0x7f7144074220 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:24.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.177+0000 7f7149800640 1 --2- 172.21.15.90:0/140687329 >> v2:172.21.15.149:3300/0 conn(0x7f71440ac350 0x7f71440ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:24.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.177+0000 7f7149800640 1 -- 172.21.15.90:0/140687329 >> 172.21.15.90:0/140687329 conn(0x7f71440c8ba0 msgr2=0x7f714406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:24.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.177+0000 7f7149800640 1 -- 172.21.15.90:0/140687329 shutdown_connections 2024-09-21T03:15:24.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.177+0000 7f7149800640 1 -- 172.21.15.90:0/140687329 wait complete. 2024-09-21T03:15:24.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.179+0000 7f7149800640 1 Processor -- start 2024-09-21T03:15:24.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.179+0000 7f7149800640 1 -- start start 2024-09-21T03:15:24.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.180+0000 7f7149800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f714406d960 0x7f7144150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:24.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.180+0000 7f7149800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71440ac350 0x7f7144151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:24.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.180+0000 7f7149800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71440acca0 0x7f71440c0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:24.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.180+0000 7f7149800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7144074760 con 0x7f714406d960 2024-09-21T03:15:24.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.180+0000 7f7149800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f71440ab640 con 0x7f71440ac350 2024-09-21T03:15:24.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.180+0000 7f7149800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f71440748e0 con 0x7f71440acca0 2024-09-21T03:15:24.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.180+0000 7f7143400640 1 -- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71440acca0 msgr2=0x7f71440c0020 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:15:24.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.180+0000 7f7142a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f714406d960 0x7f7144150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:24.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.180+0000 7f7143400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71440acca0 0x7f71440c0020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:15:24.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.180+0000 7f7142a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f714406d960 0x7f7144150650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47854/0 (socket says 172.21.15.90:47854) 2024-09-21T03:15:24.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.180+0000 7f7142a00640 1 -- 172.21.15.90:0/2103093304 learned_addr learned my addr 172.21.15.90:0/2103093304 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:24.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.181+0000 7f7142000640 1 --2- 172.21.15.90:0/2103093304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71440ac350 0x7f7144151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:24.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.181+0000 7f7142a00640 1 -- 172.21.15.90:0/2103093304 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71440acca0 msgr2=0x7f71440c0020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:15:24.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.181+0000 7f7142a00640 1 --2- 172.21.15.90:0/2103093304 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71440acca0 0x7f71440c0020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:24.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.181+0000 7f7142a00640 1 -- 172.21.15.90:0/2103093304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71440ac350 msgr2=0x7f7144151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:24.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.181+0000 7f7142a00640 1 --2- 172.21.15.90:0/2103093304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71440ac350 0x7f7144151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:24.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.181+0000 7f7142a00640 1 -- 172.21.15.90:0/2103093304 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714413b240 con 0x7f714406d960 2024-09-21T03:15:24.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.181+0000 7f7142a00640 1 --2- 172.21.15.90:0/2103093304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f714406d960 0x7f7144150650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f713400c3f0 tx=0x7f713400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:24.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.181+0000 7f713aa00640 1 -- 172.21.15.90:0/2103093304 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134017070 con 0x7f714406d960 2024-09-21T03:15:24.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.181+0000 7f713aa00640 1 -- 172.21.15.90:0/2103093304 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71340053c0 con 0x7f714406d960 2024-09-21T03:15:24.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.181+0000 7f713aa00640 1 -- 172.21.15.90:0/2103093304 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134003850 con 0x7f714406d960 2024-09-21T03:15:24.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.181+0000 7f7149800640 1 -- 172.21.15.90:0/2103093304 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f714413a970 con 0x7f714406d960 2024-09-21T03:15:24.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.181+0000 7f7149800640 1 -- 172.21.15.90:0/2103093304 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f714413af60 con 0x7f714406d960 2024-09-21T03:15:24.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.183+0000 7f7149800640 1 -- 172.21.15.90:0/2103093304 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7144074d10 con 0x7f714406d960 2024-09-21T03:15:24.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.184+0000 7f713aa00640 1 -- 172.21.15.90:0/2103093304 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f713401a070 con 0x7f714406d960 2024-09-21T03:15:24.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.185+0000 7f713aa00640 1 --2- 172.21.15.90:0/2103093304 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7124078b70 0x7f712407b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:24.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.185+0000 7f713aa00640 1 -- 172.21.15.90:0/2103093304 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f713409a310 con 0x7f714406d960 2024-09-21T03:15:24.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.185+0000 7f7142000640 1 --2- 172.21.15.90:0/2103093304 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7124078b70 0x7f712407b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:24.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.186+0000 7f7142000640 1 --2- 172.21.15.90:0/2103093304 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7124078b70 0x7f712407b080 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f71300096c0 tx=0x7f7130009260 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:24.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.189+0000 7f713aa00640 1 -- 172.21.15.90:0/2103093304 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7134061e40 con 0x7f714406d960 2024-09-21T03:15:24.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.445+0000 7f7149800640 1 -- 172.21.15.90:0/2103093304 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f714413c590 con 0x7f714406d960 2024-09-21T03:15:24.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.445+0000 7f713aa00640 1 -- 172.21.15.90:0/2103093304 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f7134066870 con 0x7f714406d960 2024-09-21T03:15:24.447 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":75,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:15:24.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.447+0000 7f7149800640 1 -- 172.21.15.90:0/2103093304 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7124078b70 msgr2=0x7f712407b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:24.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.447+0000 7f7149800640 1 --2- 172.21.15.90:0/2103093304 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7124078b70 0x7f712407b080 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f71300096c0 tx=0x7f7130009260 comp rx=0 tx=0).stop 2024-09-21T03:15:24.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.447+0000 7f7149800640 1 -- 172.21.15.90:0/2103093304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f714406d960 msgr2=0x7f7144150650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:24.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.447+0000 7f7149800640 1 --2- 172.21.15.90:0/2103093304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f714406d960 0x7f7144150650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f713400c3f0 tx=0x7f713400c8b0 comp rx=0 tx=0).stop 2024-09-21T03:15:24.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.447+0000 7f7149800640 1 -- 172.21.15.90:0/2103093304 shutdown_connections 2024-09-21T03:15:24.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.447+0000 7f7149800640 1 --2- 172.21.15.90:0/2103093304 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7124078b70 0x7f712407b080 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:24.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.447+0000 7f7149800640 1 --2- 172.21.15.90:0/2103093304 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71440acca0 0x7f71440c0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:24.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.447+0000 7f7149800640 1 --2- 172.21.15.90:0/2103093304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71440ac350 0x7f7144151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:24.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.447+0000 7f7149800640 1 --2- 172.21.15.90:0/2103093304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f714406d960 0x7f7144150650 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:24.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.447+0000 7f7149800640 1 -- 172.21.15.90:0/2103093304 >> 172.21.15.90:0/2103093304 conn(0x7f71440c8ba0 msgr2=0x7f71440c78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:24.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.448+0000 7f7149800640 1 -- 172.21.15.90:0/2103093304 shutdown_connections 2024-09-21T03:15:24.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:24.448+0000 7f7149800640 1 -- 172.21.15.90:0/2103093304 wait complete. 2024-09-21T03:15:27.471 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:15:27.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.702+0000 7f8c21e00640 1 -- 172.21.15.90:0/995775720 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c1c06d940 msgr2=0x7f8c1c0ac600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:27.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.702+0000 7f8c21e00640 1 --2- 172.21.15.90:0/995775720 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c1c06d940 0x7f8c1c0ac600 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c071c50 tx=0x7f8c0402a5f0 comp rx=0 tx=0).stop 2024-09-21T03:15:27.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.702+0000 7f8c21e00640 1 -- 172.21.15.90:0/995775720 shutdown_connections 2024-09-21T03:15:27.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.702+0000 7f8c21e00640 1 --2- 172.21.15.90:0/995775720 >> v2:172.21.15.149:3300/0 conn(0x7f8c1c072a70 0x7f8c1c0acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:27.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.702+0000 7f8c21e00640 1 --2- 172.21.15.90:0/995775720 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c1c06d940 0x7f8c1c0ac600 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:27.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.702+0000 7f8c21e00640 1 -- 172.21.15.90:0/995775720 >> 172.21.15.90:0/995775720 conn(0x7f8c1c0c8ba0 msgr2=0x7f8c1c06cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:27.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.702+0000 7f8c21e00640 1 -- 172.21.15.90:0/995775720 shutdown_connections 2024-09-21T03:15:27.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.702+0000 7f8c21e00640 1 -- 172.21.15.90:0/995775720 wait complete. 2024-09-21T03:15:27.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.704+0000 7f8c21e00640 1 Processor -- start 2024-09-21T03:15:27.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.704+0000 7f8c21e00640 1 -- start start 2024-09-21T03:15:27.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.706+0000 7f8c21e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c1c06d940 0x7f8c1c156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:27.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.706+0000 7f8c21e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c1c072a70 0x7f8c1c0c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:27.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.706+0000 7f8c21e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c1c0c4730 0x7f8c1c156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:27.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.706+0000 7f8c21e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c0ab6f0 con 0x7f8c1c06d940 2024-09-21T03:15:27.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.706+0000 7f8c21e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c0ab410 con 0x7f8c1c072a70 2024-09-21T03:15:27.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.706+0000 7f8c21e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1c0749a0 con 0x7f8c1c0c4730 2024-09-21T03:15:27.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.706+0000 7f8c1aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c1c06d940 0x7f8c1c156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:27.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.706+0000 7f8c1b400640 1 -- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c1c0c4730 msgr2=0x7f8c1c156fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:15:27.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.706+0000 7f8c1b400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c1c0c4730 0x7f8c1c156fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:15:27.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.706+0000 7f8c1aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c1c06d940 0x7f8c1c156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45440/0 (socket says 172.21.15.90:45440) 2024-09-21T03:15:27.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.706+0000 7f8c1aa00640 1 -- 172.21.15.90:0/2600515210 learned_addr learned my addr 172.21.15.90:0/2600515210 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:27.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.706+0000 7f8c12000640 1 --2- 172.21.15.90:0/2600515210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c1c072a70 0x7f8c1c0c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:27.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.707+0000 7f8c1aa00640 1 -- 172.21.15.90:0/2600515210 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c1c0c4730 msgr2=0x7f8c1c156fe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:15:27.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.707+0000 7f8c1aa00640 1 --2- 172.21.15.90:0/2600515210 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c1c0c4730 0x7f8c1c156fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:27.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.707+0000 7f8c1aa00640 1 -- 172.21.15.90:0/2600515210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c1c072a70 msgr2=0x7f8c1c0c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:27.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.707+0000 7f8c1aa00640 1 --2- 172.21.15.90:0/2600515210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c1c072a70 0x7f8c1c0c5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:27.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.707+0000 7f8c1aa00640 1 -- 172.21.15.90:0/2600515210 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1c0c6240 con 0x7f8c1c06d940 2024-09-21T03:15:27.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.707+0000 7f8c12000640 1 --2- 172.21.15.90:0/2600515210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c1c072a70 0x7f8c1c0c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:15:27.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.707+0000 7f8c1aa00640 1 --2- 172.21.15.90:0/2600515210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c1c06d940 0x7f8c1c156060 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c00c3a0 tx=0x7f8c0c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:27.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.707+0000 7f8c13e00640 1 -- 172.21.15.90:0/2600515210 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c017070 con 0x7f8c1c06d940 2024-09-21T03:15:27.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.707+0000 7f8c13e00640 1 -- 172.21.15.90:0/2600515210 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c0c0053c0 con 0x7f8c1c06d940 2024-09-21T03:15:27.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.707+0000 7f8c13e00640 1 -- 172.21.15.90:0/2600515210 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c003850 con 0x7f8c1c06d940 2024-09-21T03:15:27.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.707+0000 7f8c21e00640 1 -- 172.21.15.90:0/2600515210 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c1c149210 con 0x7f8c1c06d940 2024-09-21T03:15:27.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.707+0000 7f8c21e00640 1 -- 172.21.15.90:0/2600515210 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c1c148f30 con 0x7f8c1c06d940 2024-09-21T03:15:27.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.708+0000 7f8c21e00640 1 -- 172.21.15.90:0/2600515210 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c1c0c6410 con 0x7f8c1c06d940 2024-09-21T03:15:27.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.710+0000 7f8c13e00640 1 -- 172.21.15.90:0/2600515210 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8c0c01a070 con 0x7f8c1c06d940 2024-09-21T03:15:27.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.711+0000 7f8c13e00640 1 --2- 172.21.15.90:0/2600515210 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8bf8078b40 0x7f8bf807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:27.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.711+0000 7f8c13e00640 1 -- 172.21.15.90:0/2600515210 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f8c0c09a4d0 con 0x7f8c1c06d940 2024-09-21T03:15:27.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.712+0000 7f8c12000640 1 --2- 172.21.15.90:0/2600515210 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8bf8078b40 0x7f8bf807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:27.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.713+0000 7f8c12000640 1 --2- 172.21.15.90:0/2600515210 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8bf8078b40 0x7f8bf807b050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8c04033000 tx=0x7f8c04004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:27.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:27.716+0000 7f8c13e00640 1 -- 172.21.15.90:0/2600515210 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8c0c062560 con 0x7f8c1c06d940 2024-09-21T03:15:27.830 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:15:27.835 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:15:28.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:28.008+0000 7f8c21e00640 1 -- 172.21.15.90:0/2600515210 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8c1c074290 con 0x7f8c1c06d940 2024-09-21T03:15:28.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:28.009+0000 7f8c13e00640 1 -- 172.21.15.90:0/2600515210 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f8c0c061e60 con 0x7f8c1c06d940 2024-09-21T03:15:28.010 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":78,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:15:28.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:28.011+0000 7f8c21e00640 1 -- 172.21.15.90:0/2600515210 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8bf8078b40 msgr2=0x7f8bf807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:28.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:28.011+0000 7f8c21e00640 1 --2- 172.21.15.90:0/2600515210 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8bf8078b40 0x7f8bf807b050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8c04033000 tx=0x7f8c04004730 comp rx=0 tx=0).stop 2024-09-21T03:15:28.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:28.011+0000 7f8c21e00640 1 -- 172.21.15.90:0/2600515210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c1c06d940 msgr2=0x7f8c1c156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:28.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:28.011+0000 7f8c21e00640 1 --2- 172.21.15.90:0/2600515210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c1c06d940 0x7f8c1c156060 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c00c3a0 tx=0x7f8c0c00c860 comp rx=0 tx=0).stop 2024-09-21T03:15:28.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:28.011+0000 7f8c21e00640 1 -- 172.21.15.90:0/2600515210 shutdown_connections 2024-09-21T03:15:28.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:28.011+0000 7f8c21e00640 1 --2- 172.21.15.90:0/2600515210 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8bf8078b40 0x7f8bf807b050 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:28.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:28.011+0000 7f8c21e00640 1 --2- 172.21.15.90:0/2600515210 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c1c0c4730 0x7f8c1c156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:28.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:28.011+0000 7f8c21e00640 1 --2- 172.21.15.90:0/2600515210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c1c072a70 0x7f8c1c0c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:28.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:28.011+0000 7f8c21e00640 1 --2- 172.21.15.90:0/2600515210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c1c06d940 0x7f8c1c156060 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:28.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:28.011+0000 7f8c21e00640 1 -- 172.21.15.90:0/2600515210 >> 172.21.15.90:0/2600515210 conn(0x7f8c1c0c8ba0 msgr2=0x7f8c1c0c2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:28.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:28.011+0000 7f8c21e00640 1 -- 172.21.15.90:0/2600515210 shutdown_connections 2024-09-21T03:15:28.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:28.011+0000 7f8c21e00640 1 -- 172.21.15.90:0/2600515210 wait complete. 2024-09-21T03:15:31.039 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:15:38.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.735+0000 7fc72c200640 1 -- 172.21.15.90:0/3103621739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc70c004800 msgr2=0x7fc70c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:38.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.735+0000 7fc72c200640 1 --2- 172.21.15.90:0/3103621739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc70c004800 0x7fc70c004c10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc710001330 tx=0x7fc70c005830 comp rx=0 tx=0).stop 2024-09-21T03:15:38.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.735+0000 7fc72c200640 1 -- 172.21.15.90:0/3103621739 shutdown_connections 2024-09-21T03:15:38.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.735+0000 7fc72c200640 1 --2- 172.21.15.90:0/3103621739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc70c004800 0x7fc70c004c10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:38.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.735+0000 7fc72c200640 1 -- 172.21.15.90:0/3103621739 >> 172.21.15.90:0/3103621739 conn(0x7fc7240c8ba0 msgr2=0x7fc72406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:38.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.735+0000 7fc72c200640 1 -- 172.21.15.90:0/3103621739 shutdown_connections 2024-09-21T03:15:38.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.735+0000 7fc72c200640 1 -- 172.21.15.90:0/3103621739 wait complete. 2024-09-21T03:15:38.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.738+0000 7fc72c200640 1 Processor -- start 2024-09-21T03:15:38.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.738+0000 7fc72c200640 1 -- start start 2024-09-21T03:15:38.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.739+0000 7fc72c200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc70c004800 0x7fc72414fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:38.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.739+0000 7fc72c200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc724151cd0 0x7fc7241520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:38.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.739+0000 7fc72c200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc72413f8a0 0x7fc72413fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:38.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.739+0000 7fc72c200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc7240708e0 con 0x7fc72413f8a0 2024-09-21T03:15:38.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.739+0000 7fc72c200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc7240abec0 con 0x7fc724151cd0 2024-09-21T03:15:38.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.739+0000 7fc72c200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc724070a60 con 0x7fc70c004800 2024-09-21T03:15:38.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.740+0000 7fc729800640 1 -- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc70c004800 msgr2=0x7fc72414fd10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:15:38.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.740+0000 7fc729800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc70c004800 0x7fc72414fd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:15:38.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.740+0000 7fc72a200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc72413f8a0 0x7fc72413fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:38.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.740+0000 7fc728e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc724151cd0 0x7fc7241520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:38.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.740+0000 7fc72a200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc72413f8a0 0x7fc72413fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47302/0 (socket says 172.21.15.90:47302) 2024-09-21T03:15:38.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.740+0000 7fc72a200640 1 -- 172.21.15.90:0/1673678036 learned_addr learned my addr 172.21.15.90:0/1673678036 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:38.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.740+0000 7fc72a200640 1 -- 172.21.15.90:0/1673678036 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc70c004800 msgr2=0x7fc72414fd10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:15:38.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.740+0000 7fc72a200640 1 --2- 172.21.15.90:0/1673678036 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc70c004800 0x7fc72414fd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:38.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.740+0000 7fc72a200640 1 -- 172.21.15.90:0/1673678036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc724151cd0 msgr2=0x7fc7241520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:38.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.741+0000 7fc72a200640 1 --2- 172.21.15.90:0/1673678036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc724151cd0 0x7fc7241520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:38.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.741+0000 7fc72a200640 1 -- 172.21.15.90:0/1673678036 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7241530f0 con 0x7fc72413f8a0 2024-09-21T03:15:38.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.741+0000 7fc728e00640 1 --2- 172.21.15.90:0/1673678036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc724151cd0 0x7fc7241520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:15:38.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.741+0000 7fc72a200640 1 --2- 172.21.15.90:0/1673678036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc72413f8a0 0x7fc72413fcb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc704008d00 tx=0x7fc71c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:38.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.744+0000 7fc721600640 1 -- 172.21.15.90:0/1673678036 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71c017070 con 0x7fc72413f8a0 2024-09-21T03:15:38.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.744+0000 7fc72c200640 1 -- 172.21.15.90:0/1673678036 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc724154530 con 0x7fc72413f8a0 2024-09-21T03:15:38.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.744+0000 7fc72c200640 1 -- 172.21.15.90:0/1673678036 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc724153390 con 0x7fc72413f8a0 2024-09-21T03:15:38.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.744+0000 7fc721600640 1 -- 172.21.15.90:0/1673678036 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc71c0050d0 con 0x7fc72413f8a0 2024-09-21T03:15:38.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.744+0000 7fc721600640 1 -- 172.21.15.90:0/1673678036 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71c021060 con 0x7fc72413f8a0 2024-09-21T03:15:38.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.746+0000 7fc72c200640 1 -- 172.21.15.90:0/1673678036 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc700005290 con 0x7fc72413f8a0 2024-09-21T03:15:38.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.747+0000 7fc721600640 1 -- 172.21.15.90:0/1673678036 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc71c01a070 con 0x7fc72413f8a0 2024-09-21T03:15:38.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.748+0000 7fc721600640 1 --2- 172.21.15.90:0/1673678036 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc70407a3e0 0x7fc70407c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:38.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.748+0000 7fc721600640 1 -- 172.21.15.90:0/1673678036 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fc71c09a0d0 con 0x7fc72413f8a0 2024-09-21T03:15:38.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.749+0000 7fc729800640 1 --2- 172.21.15.90:0/1673678036 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc70407a3e0 0x7fc70407c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:38.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.750+0000 7fc729800640 1 --2- 172.21.15.90:0/1673678036 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc70407a3e0 0x7fc70407c8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc7240521d0 tx=0x7fc718006f40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:38.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:38.752+0000 7fc721600640 1 -- 172.21.15.90:0/1673678036 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc71c061b80 con 0x7fc72413f8a0 2024-09-21T03:15:39.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.018+0000 7fc72c200640 1 -- 172.21.15.90:0/1673678036 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc700005580 con 0x7fc72413f8a0 2024-09-21T03:15:39.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.019+0000 7fc721600640 1 -- 172.21.15.90:0/1673678036 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7fc71c0665b0 con 0x7fc72413f8a0 2024-09-21T03:15:39.021 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":8,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:15:39.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.021+0000 7fc72c200640 1 -- 172.21.15.90:0/1673678036 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc70407a3e0 msgr2=0x7fc70407c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:39.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.021+0000 7fc72c200640 1 --2- 172.21.15.90:0/1673678036 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc70407a3e0 0x7fc70407c8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc7240521d0 tx=0x7fc718006f40 comp rx=0 tx=0).stop 2024-09-21T03:15:39.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.021+0000 7fc72c200640 1 -- 172.21.15.90:0/1673678036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc72413f8a0 msgr2=0x7fc72413fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:39.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.021+0000 7fc72c200640 1 --2- 172.21.15.90:0/1673678036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc72413f8a0 0x7fc72413fcb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc704008d00 tx=0x7fc71c00c960 comp rx=0 tx=0).stop 2024-09-21T03:15:39.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.021+0000 7fc72c200640 1 -- 172.21.15.90:0/1673678036 shutdown_connections 2024-09-21T03:15:39.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.021+0000 7fc72c200640 1 --2- 172.21.15.90:0/1673678036 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc70407a3e0 0x7fc70407c8f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:39.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.021+0000 7fc72c200640 1 --2- 172.21.15.90:0/1673678036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc72413f8a0 0x7fc72413fcb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:39.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.021+0000 7fc72c200640 1 --2- 172.21.15.90:0/1673678036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc724151cd0 0x7fc7241520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:39.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.021+0000 7fc72c200640 1 --2- 172.21.15.90:0/1673678036 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc70c004800 0x7fc72414fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:39.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.021+0000 7fc72c200640 1 -- 172.21.15.90:0/1673678036 >> 172.21.15.90:0/1673678036 conn(0x7fc7240c8ba0 msgr2=0x7fc7240c63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:39.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.022+0000 7fc72c200640 1 -- 172.21.15.90:0/1673678036 shutdown_connections 2024-09-21T03:15:39.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.022+0000 7fc72c200640 1 -- 172.21.15.90:0/1673678036 wait complete. 2024-09-21T03:15:39.048 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-21T03:15:39.048 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-21T03:15:39.048 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:15:39.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.267+0000 7fae18c00640 1 -- 172.21.15.90:0/4138292455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae1414b5a0 msgr2=0x7fae140c4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:39.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.267+0000 7fae18c00640 1 --2- 172.21.15.90:0/4138292455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae1414b5a0 0x7fae140c4f20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fadfc005fd0 tx=0x7fadfc02a4b0 comp rx=0 tx=0).stop 2024-09-21T03:15:39.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.267+0000 7fae18c00640 1 -- 172.21.15.90:0/4138292455 shutdown_connections 2024-09-21T03:15:39.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.267+0000 7fae18c00640 1 --2- 172.21.15.90:0/4138292455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae1414b5a0 0x7fae140c4f20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:39.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.267+0000 7fae18c00640 1 -- 172.21.15.90:0/4138292455 >> 172.21.15.90:0/4138292455 conn(0x7fae1406d200 msgr2=0x7fae1406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:39.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.267+0000 7fae18c00640 1 -- 172.21.15.90:0/4138292455 shutdown_connections 2024-09-21T03:15:39.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.267+0000 7fae18c00640 1 -- 172.21.15.90:0/4138292455 wait complete. 2024-09-21T03:15:39.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.269+0000 7fae18c00640 1 Processor -- start 2024-09-21T03:15:39.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.269+0000 7fae18c00640 1 -- start start 2024-09-21T03:15:39.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.270+0000 7fae18c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae140ad310 0x7fae140c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:39.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.270+0000 7fae18c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae140c5460 0x7fae141e0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:39.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.270+0000 7fae18c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae1414b5a0 0x7fae141f0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:39.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.270+0000 7fae18c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fae14070030 con 0x7fae140c5460 2024-09-21T03:15:39.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.270+0000 7fae18c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fae140ab0f0 con 0x7fae1414b5a0 2024-09-21T03:15:39.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.270+0000 7fae18c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fae140701b0 con 0x7fae140ad310 2024-09-21T03:15:39.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.271+0000 7fae13400640 1 -- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae140ad310 msgr2=0x7fae140c78f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:15:39.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.271+0000 7fae0be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae140c5460 0x7fae141e0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:39.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.271+0000 7fae13400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae140ad310 0x7fae140c78f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:15:39.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.271+0000 7fae0be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae140c5460 0x7fae141e0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47318/0 (socket says 172.21.15.90:47318) 2024-09-21T03:15:39.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.271+0000 7fae0be00640 1 -- 172.21.15.90:0/995294702 learned_addr learned my addr 172.21.15.90:0/995294702 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:39.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.271+0000 7fae13e00640 1 --2- 172.21.15.90:0/995294702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae1414b5a0 0x7fae141f0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:39.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.271+0000 7fae0be00640 1 -- 172.21.15.90:0/995294702 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae140ad310 msgr2=0x7fae140c78f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:15:39.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.271+0000 7fae0be00640 1 --2- 172.21.15.90:0/995294702 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae140ad310 0x7fae140c78f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:39.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.271+0000 7fae0be00640 1 -- 172.21.15.90:0/995294702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae1414b5a0 msgr2=0x7fae141f0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:39.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.271+0000 7fae0be00640 1 --2- 172.21.15.90:0/995294702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae1414b5a0 0x7fae141f0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:39.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.271+0000 7fae0be00640 1 -- 172.21.15.90:0/995294702 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae140c6b10 con 0x7fae140c5460 2024-09-21T03:15:39.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.271+0000 7fae0be00640 1 --2- 172.21.15.90:0/995294702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae140c5460 0x7fae141e0330 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fadfc034040 tx=0x7fadfc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:39.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.272+0000 7fae0b400640 1 -- 172.21.15.90:0/995294702 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc03e030 con 0x7fae140c5460 2024-09-21T03:15:39.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.272+0000 7fae0b400640 1 -- 172.21.15.90:0/995294702 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadfc0047a0 con 0x7fae140c5460 2024-09-21T03:15:39.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.272+0000 7fae18c00640 1 -- 172.21.15.90:0/995294702 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae140c84f0 con 0x7fae140c5460 2024-09-21T03:15:39.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.272+0000 7fae0b400640 1 -- 172.21.15.90:0/995294702 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc035040 con 0x7fae140c5460 2024-09-21T03:15:39.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.272+0000 7fae18c00640 1 -- 172.21.15.90:0/995294702 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae140c8a90 con 0x7fae140c5460 2024-09-21T03:15:39.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.273+0000 7fae18c00640 1 --2- 172.21.15.90:0/995294702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae141f09d0 0x7fae141466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:39.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.273+0000 7fae18c00640 1 -- 172.21.15.90:0/995294702 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fae140c8c60 con 0x7fae141f09d0 2024-09-21T03:15:39.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.273+0000 7fae13400640 1 --2- 172.21.15.90:0/995294702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae141f09d0 0x7fae141466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:39.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.273+0000 7fae13400640 1 -- 172.21.15.90:0/995294702 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae140c4f20 con 0x7fae141f09d0 2024-09-21T03:15:39.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.274+0000 7fae13400640 1 --2- 172.21.15.90:0/995294702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae141f09d0 0x7fae141466a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fae0400c310 tx=0x7fae0400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:39.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.274+0000 7fae0b400640 1 -- 172.21.15.90:0/995294702 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04017070 con 0x7fae141f09d0 2024-09-21T03:15:39.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.274+0000 7fae0b400640 1 -- 172.21.15.90:0/995294702 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fae040075a0 con 0x7fae141f09d0 2024-09-21T03:15:39.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.274+0000 7fae0b400640 1 -- 172.21.15.90:0/995294702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae141f09d0 msgr2=0x7fae141466a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:39.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.274+0000 7fae0b400640 1 --2- 172.21.15.90:0/995294702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae141f09d0 0x7fae141466a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fae0400c310 tx=0x7fae0400c7d0 comp rx=0 tx=0).stop 2024-09-21T03:15:39.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.274+0000 7fae0b400640 1 -- 172.21.15.90:0/995294702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae141f09d0 msgr2=0x7fae141466a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:15:39.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.274+0000 7fae0b400640 1 --2- 172.21.15.90:0/995294702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae141f09d0 0x7fae141466a0 secure :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fae0400c310 tx=0x7fae0400c7d0 comp rx=0 tx=0).stop 2024-09-21T03:15:39.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.274+0000 7fae0b400640 1 -- 172.21.15.90:0/995294702 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fadfc041030 con 0x7fae140c5460 2024-09-21T03:15:39.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.275+0000 7fae0b400640 1 --2- 172.21.15.90:0/995294702 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fadf00786a0 0x7fadf007abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:39.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.275+0000 7fae0b400640 1 -- 172.21.15.90:0/995294702 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fadfc0bb870 con 0x7fae140c5460 2024-09-21T03:15:39.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.276+0000 7fae13400640 1 --2- 172.21.15.90:0/995294702 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fadf00786a0 0x7fadf007abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:39.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.276+0000 7fae13400640 1 --2- 172.21.15.90:0/995294702 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fadf00786a0 0x7fadf007abb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fae04000c00 tx=0x7fae0400a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:39.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.281+0000 7fae18c00640 1 --2- 172.21.15.90:0/995294702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae14146be0 0x7fae140c13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:39.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.281+0000 7fae18c00640 1 -- 172.21.15.90:0/995294702 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fae140c4810 con 0x7fae14146be0 2024-09-21T03:15:39.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.281+0000 7fae13e00640 1 --2- 172.21.15.90:0/995294702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae14146be0 0x7fae140c13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:39.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.282+0000 7fae13e00640 1 -- 172.21.15.90:0/995294702 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fae14155d90 con 0x7fae14146be0 2024-09-21T03:15:39.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.282+0000 7fae13e00640 1 --2- 172.21.15.90:0/995294702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae14146be0 0x7fae140c13d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00f7e0 tx=0x7fae0c00fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:39.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.282+0000 7fae0b400640 1 -- 172.21.15.90:0/995294702 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c003b80 con 0x7fae14146be0 2024-09-21T03:15:39.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.282+0000 7fae0b400640 1 -- 172.21.15.90:0/995294702 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4872 (secure 0 0 0) 0x7fae0c003b80 con 0x7fae14146be0 2024-09-21T03:15:39.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.282+0000 7fae0b400640 1 -- 172.21.15.90:0/995294702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae14146be0 msgr2=0x7fae140c13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:39.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.282+0000 7fae0b400640 1 --2- 172.21.15.90:0/995294702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae14146be0 0x7fae140c13d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00f7e0 tx=0x7fae0c00fca0 comp rx=0 tx=0).stop 2024-09-21T03:15:39.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.282+0000 7fae0b400640 1 -- 172.21.15.90:0/995294702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae14146be0 msgr2=0x7fae140c13d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:15:39.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.282+0000 7fae0b400640 1 --2- 172.21.15.90:0/995294702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae14146be0 0x7fae140c13d0 secure :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00f7e0 tx=0x7fae0c00fca0 comp rx=0 tx=0).stop 2024-09-21T03:15:39.285 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:15:39.285 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:15:39.285 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:15:39.285 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:15:39.285 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 8, 2024-09-21T03:15:39.285 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 89997, 2024-09-21T03:15:39.285 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:15:39.285 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:15:39.285 INFO:teuthology.orchestra.run.smithi090.stdout: 1 2024-09-21T03:15:39.285 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:39.285 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 0, 2024-09-21T03:15:39.285 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:15:39.285 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:15:39.286 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:15:39.286 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:15:39.286 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:15:39.286 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:15:39.286 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:15:39.286 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:15:39.286 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:15:39.286 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:15:39.286 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:15:39.286 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:15:39.286 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:15:39.286 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:15:39.286 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:39.286 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:15:39.287 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:15:39.287 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:15:39.287 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:15:39.287 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:15:39.287 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:15:39.287 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:15:39.287 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:15:39.287 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:15:39.287 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:15:39.287 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:15:39.287 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:15:39.287 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:15:39.287 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:39.287 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.288 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:15:39.288 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:15:39.288 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:15:39.288 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:15:39.288 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:15:39.288 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:15:39.288 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:15:39.288 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:15:39.288 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:15:39.288 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:15:39.288 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:15:39.289 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:15:39.289 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:15:39.289 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:15:39.289 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:15:39.289 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:15:39.289 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:15:39.289 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:15:39.289 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:15:39.289 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:15:39.289 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:15:39.289 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:15:39.289 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:15:39.289 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:15:39.289 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:15:39.289 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:15:39.290 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:15:39.290 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:15:39.290 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:39.290 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:15:39.290 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.290 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:15:39.290 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.290 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:15:39.290 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:15:39.290 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:15:39.290 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:15:39.290 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.290 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:15:39.290 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:15:39.290 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:39.291 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.291 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.291 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:15:39.291 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:15:39.291 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:39.291 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:39.291 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:39.291 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.291 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:15:39.291 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:15:39.291 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:15:39.291 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:15:39.291 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:15:39.291 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.291 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.292 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:15:39.292 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:15:39.292 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:15:39.292 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:15:39.292 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.292 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:15:39.292 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:15:39.292 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:39.292 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.292 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.292 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:15:39.292 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:15:39.293 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:39.293 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:39.293 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:39.293 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.293 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:15:39.293 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:15:39.293 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:15:39.293 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:15:39.293 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:15:39.293 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.293 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.293 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:15:39.293 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:15:39.293 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:15:39.293 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:15:39.294 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.294 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:15:39.294 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:15:39.294 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:39.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.294 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.294 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:15:39.294 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:15:39.294 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:39.294 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:39.294 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:39.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.294 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:15:39.294 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:15:39.294 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:15:39.295 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:15:39.295 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:15:39.295 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:39.295 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:39.295 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.295 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:15:39.295 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:15:39.295 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.295 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:39.295 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:39.295 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:15:39.295 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:39.295 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:39.295 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:15:39.296 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.296 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:39.296 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:39.296 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 3 2024-09-21T03:15:39.296 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:39.296 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:39.296 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:15:39.296 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.296 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:39.296 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:39.296 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6 2024-09-21T03:15:39.296 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:39.296 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:39.296 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:15:39.297 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.297 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:39.297 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:39.297 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:15:39.297 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:39.297 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:39.297 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.297 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:15:39.297 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:15:39.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.283+0000 7fae18c00640 1 -- 172.21.15.90:0/995294702 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fadf00786a0 msgr2=0x7fadf007abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:39.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.283+0000 7fae18c00640 1 --2- 172.21.15.90:0/995294702 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fadf00786a0 0x7fadf007abb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fae04000c00 tx=0x7fae0400a000 comp rx=0 tx=0).stop 2024-09-21T03:15:39.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.283+0000 7fae18c00640 1 -- 172.21.15.90:0/995294702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae140c5460 msgr2=0x7fae141e0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:39.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.283+0000 7fae13e00640 1 -- 172.21.15.90:0/995294702 reap_dead start 2024-09-21T03:15:39.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.283+0000 7fae18c00640 1 --2- 172.21.15.90:0/995294702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae140c5460 0x7fae141e0330 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fadfc034040 tx=0x7fadfc0039e0 comp rx=0 tx=0).stop 2024-09-21T03:15:39.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.283+0000 7fae18c00640 1 -- 172.21.15.90:0/995294702 shutdown_connections 2024-09-21T03:15:39.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.283+0000 7fae18c00640 1 --2- 172.21.15.90:0/995294702 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae140c5460 0x7fae141e0330 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:39.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.283+0000 7fae18c00640 1 -- 172.21.15.90:0/995294702 >> 172.21.15.90:0/995294702 conn(0x7fae1406d200 msgr2=0x7fae14149d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:39.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.283+0000 7fae18c00640 1 -- 172.21.15.90:0/995294702 shutdown_connections 2024-09-21T03:15:39.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.283+0000 7fae18c00640 1 -- 172.21.15.90:0/995294702 wait complete. 2024-09-21T03:15:39.305 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-21T03:15:39.305 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-21T03:15:39.305 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:15:39.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.530+0000 7f4629800640 1 -- 172.21.15.90:0/2034358059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4608007330 msgr2=0x7f4608009770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:39.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.530+0000 7f4629800640 1 --2- 172.21.15.90:0/2034358059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4608007330 0x7f4608009770 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4610001050 tx=0x7f4608003810 comp rx=0 tx=0).stop 2024-09-21T03:15:39.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.530+0000 7f4628e00640 1 -- 172.21.15.90:0/2034358059 reap_dead start 2024-09-21T03:15:39.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.530+0000 7f4629800640 1 -- 172.21.15.90:0/2034358059 shutdown_connections 2024-09-21T03:15:39.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.530+0000 7f4629800640 1 -- 172.21.15.90:0/2034358059 >> 172.21.15.90:0/2034358059 conn(0x7f462406d200 msgr2=0x7f462406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:39.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.530+0000 7f4629800640 1 -- 172.21.15.90:0/2034358059 shutdown_connections 2024-09-21T03:15:39.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.530+0000 7f4629800640 1 -- 172.21.15.90:0/2034358059 wait complete. 2024-09-21T03:15:39.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.532+0000 7f4629800640 1 Processor -- start 2024-09-21T03:15:39.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.532+0000 7f4629800640 1 -- start start 2024-09-21T03:15:39.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.533+0000 7f4629800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4608007330 0x7f46240c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:39.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.533+0000 7f4629800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46241f0540 0x7f462413a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:39.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.533+0000 7f4629800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46241f0950 0x7f462413ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:39.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.533+0000 7f4629800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f46240aa690 con 0x7f46241f0540 2024-09-21T03:15:39.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.533+0000 7f4629800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4624152f40 con 0x7f46241f0950 2024-09-21T03:15:39.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.533+0000 7f4629800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4624156fd0 con 0x7f4608007330 2024-09-21T03:15:39.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.534+0000 7f4623400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46241f0540 0x7f462413a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:39.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.534+0000 7f4623e00640 1 -- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4608007330 msgr2=0x7f46240c7eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:15:39.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.534+0000 7f4623e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4608007330 0x7f46240c7eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:15:39.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.534+0000 7f4623400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46241f0540 0x7f462413a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47352/0 (socket says 172.21.15.90:47352) 2024-09-21T03:15:39.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.534+0000 7f4623400640 1 -- 172.21.15.90:0/2356059038 learned_addr learned my addr 172.21.15.90:0/2356059038 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:39.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.534+0000 7f4628e00640 1 --2- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46241f0950 0x7f462413ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:39.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.534+0000 7f4623400640 1 -- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4608007330 msgr2=0x7f46240c7eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:15:39.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.534+0000 7f4623400640 1 --2- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4608007330 0x7f46240c7eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:39.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.534+0000 7f4623400640 1 -- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46241f0950 msgr2=0x7f462413ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:39.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.534+0000 7f4623400640 1 --2- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46241f0950 0x7f462413ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:39.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.534+0000 7f4623400640 1 -- 172.21.15.90:0/2356059038 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462414e160 con 0x7f46241f0540 2024-09-21T03:15:39.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.534+0000 7f4623400640 1 --2- 172.21.15.90:0/2356059038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46241f0540 0x7f462413a800 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4610035040 tx=0x7f4610032df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:39.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.535+0000 7f461be00640 1 -- 172.21.15.90:0/2356059038 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4610037050 con 0x7f46241f0540 2024-09-21T03:15:39.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.535+0000 7f461be00640 1 -- 172.21.15.90:0/2356059038 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4610043070 con 0x7f46241f0540 2024-09-21T03:15:39.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.535+0000 7f4629800640 1 -- 172.21.15.90:0/2356059038 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4624148ea0 con 0x7f46241f0540 2024-09-21T03:15:39.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.535+0000 7f461be00640 1 -- 172.21.15.90:0/2356059038 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4610005c50 con 0x7f46241f0540 2024-09-21T03:15:39.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.535+0000 7f4629800640 1 -- 172.21.15.90:0/2356059038 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46240c8d80 con 0x7f46241f0540 2024-09-21T03:15:39.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.536+0000 7f4629800640 1 --2- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46240738e0 0x7f46241f0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:39.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.536+0000 7f4629800640 1 -- 172.21.15.90:0/2356059038 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f46240c72f0 con 0x7f46240738e0 2024-09-21T03:15:39.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.536+0000 7f4623e00640 1 --2- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46240738e0 0x7f46241f0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:39.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.537+0000 7f4623e00640 1 -- 172.21.15.90:0/2356059038 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4624150770 con 0x7f46240738e0 2024-09-21T03:15:39.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.537+0000 7f4623e00640 1 --2- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46240738e0 0x7f46241f0dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4614003610 tx=0x7f461400cb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:39.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.537+0000 7f461be00640 1 -- 172.21.15.90:0/2356059038 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f461003cba0 con 0x7f46241f0540 2024-09-21T03:15:39.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.538+0000 7f461be00640 1 --2- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4604078b40 0x7f460407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:39.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.538+0000 7f461be00640 1 -- 172.21.15.90:0/2356059038 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614017070 con 0x7f46240738e0 2024-09-21T03:15:39.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.538+0000 7f461be00640 1 -- 172.21.15.90:0/2356059038 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f46100bbe50 con 0x7f46241f0540 2024-09-21T03:15:39.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.539+0000 7f4628e00640 1 --2- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4604078b40 0x7f460407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:39.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.539+0000 7f461be00640 1 -- 172.21.15.90:0/2356059038 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f46140072d0 con 0x7f46240738e0 2024-09-21T03:15:39.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.539+0000 7f461be00640 1 -- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46240738e0 msgr2=0x7f46241f0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:39.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.539+0000 7f461be00640 1 --2- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46240738e0 0x7f46241f0dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4614003610 tx=0x7f461400cb10 comp rx=0 tx=0).stop 2024-09-21T03:15:39.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.539+0000 7f461be00640 1 -- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46240738e0 msgr2=0x7f46241f0dc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:15:39.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.539+0000 7f461be00640 1 --2- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46240738e0 0x7f46241f0dc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:39.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.539+0000 7f4628e00640 1 --2- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4604078b40 0x7f460407b050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f46240c4030 tx=0x7f461c009500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:39.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.545+0000 7f4629800640 1 --2- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46241ecdf0 0x7f46241ed200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:39.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.545+0000 7f4629800640 1 -- 172.21.15.90:0/2356059038 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f46240c47c0 con 0x7f46241ecdf0 2024-09-21T03:15:39.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.546+0000 7f4623e00640 1 --2- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46241ecdf0 0x7f46241ed200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:39.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.546+0000 7f4623e00640 1 -- 172.21.15.90:0/2356059038 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f46240c2680 con 0x7f46241ecdf0 2024-09-21T03:15:39.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.546+0000 7f4623e00640 1 --2- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46241ecdf0 0x7f46241ed200 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4614014000 tx=0x7f46240c3710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:39.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.547+0000 7f461be00640 1 -- 172.21.15.90:0/2356059038 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614017070 con 0x7f46241ecdf0 2024-09-21T03:15:39.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.547+0000 7f461be00640 1 -- 172.21.15.90:0/2356059038 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5180 (secure 0 0 0) 0x7f4614018040 con 0x7f46241ecdf0 2024-09-21T03:15:39.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.547+0000 7f461be00640 1 -- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46241ecdf0 msgr2=0x7f46241ed200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:39.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.547+0000 7f461be00640 1 --2- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46241ecdf0 0x7f46241ed200 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4614014000 tx=0x7f46240c3710 comp rx=0 tx=0).stop 2024-09-21T03:15:39.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.547+0000 7f461be00640 1 -- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46241ecdf0 msgr2=0x7f46241ed200 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:15:39.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.547+0000 7f461be00640 1 --2- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46241ecdf0 0x7f46241ed200 secure :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4614014000 tx=0x7f46240c3710 comp rx=0 tx=0).stop 2024-09-21T03:15:39.549 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:15:39.549 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:15:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:15:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:15:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 8, 2024-09-21T03:15:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 90337, 2024-09-21T03:15:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:15:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:15:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: 1 2024-09-21T03:15:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 0, 2024-09-21T03:15:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:15:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:15:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:15:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:15:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:15:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:15:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:15:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:15:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:15:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:15:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:15:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:15:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:15:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:15:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:15:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:15:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:15:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:15:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:15:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:15:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:15:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:15:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:15:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:15:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:15:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:15:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:15:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:15:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:15:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:15:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:15:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:15:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:15:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:15:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:15:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:15:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:15:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:15:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:15:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:15:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:15:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:15:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:15:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:15:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:15:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:15:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:15:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:15:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:15:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:15:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:15:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:15:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:15:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:15:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:15:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:15:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:15:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:15:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:15:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:15:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:15:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:15:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:15:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:15:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:15:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:15:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:15:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:15:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:15:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:15:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:15:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:15:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:15:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:15:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:15:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:15:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:15:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:15:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:15:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:15:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:15:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:15:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:15:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:15:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:15:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:15:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:15:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:15:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:15:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:15:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:15:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:15:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:15:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:15:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:15:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:15:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:15:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:15:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:15:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:15:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:15:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:15:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:15:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:15:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:15:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:15:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:15:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:15:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5 2024-09-21T03:15:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:15:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:15:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:15:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:15:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:15:39.563 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:15:39.563 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:15:39.563 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:15:39.563 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:15:39.563 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:15:39.563 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:15:39.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.548+0000 7f4629800640 1 -- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4604078b40 msgr2=0x7f460407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:39.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.548+0000 7f4629800640 1 --2- 172.21.15.90:0/2356059038 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4604078b40 0x7f460407b050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f46240c4030 tx=0x7f461c009500 comp rx=0 tx=0).stop 2024-09-21T03:15:39.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.548+0000 7f4629800640 1 -- 172.21.15.90:0/2356059038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46241f0540 msgr2=0x7f462413a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:39.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.548+0000 7f4629800640 1 --2- 172.21.15.90:0/2356059038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46241f0540 0x7f462413a800 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4610035040 tx=0x7f4610032df0 comp rx=0 tx=0).stop 2024-09-21T03:15:39.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.548+0000 7f4628e00640 1 -- 172.21.15.90:0/2356059038 reap_dead start 2024-09-21T03:15:39.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.548+0000 7f4629800640 1 -- 172.21.15.90:0/2356059038 shutdown_connections 2024-09-21T03:15:39.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.548+0000 7f4629800640 1 --2- 172.21.15.90:0/2356059038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46241f0540 0x7f462413a800 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:39.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.548+0000 7f4629800640 1 -- 172.21.15.90:0/2356059038 >> 172.21.15.90:0/2356059038 conn(0x7f462406d200 msgr2=0x7f46240ac6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:39.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.548+0000 7f4629800640 1 -- 172.21.15.90:0/2356059038 shutdown_connections 2024-09-21T03:15:39.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:39.548+0000 7f4629800640 1 -- 172.21.15.90:0/2356059038 wait complete. 2024-09-21T03:15:39.574 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-21T03:15:39.574 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-21T03:15:57.930 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:15:57.935 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:15:59.575 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-21T03:15:59.575 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-21T03:15:59.575 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-21T03:15:59.580 INFO:tasks.ceph.mon.c:Started 2024-09-21T03:15:59.580 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-21T03:15:59.581 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:15:59.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.869+0000 7f3255200640 1 -- 172.21.15.90:0/2445662303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f325008d510 msgr2=0x7f32501544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:59.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.869+0000 7f3255200640 1 --2- 172.21.15.90:0/2445662303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f325008d510 0x7f32501544f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3240009830 tx=0x7f324002a530 comp rx=0 tx=0).stop 2024-09-21T03:15:59.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.869+0000 7f3255200640 1 -- 172.21.15.90:0/2445662303 shutdown_connections 2024-09-21T03:15:59.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.869+0000 7f3255200640 1 --2- 172.21.15.90:0/2445662303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f325008d510 0x7f32501544f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:59.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.869+0000 7f3255200640 1 -- 172.21.15.90:0/2445662303 >> 172.21.15.90:0/2445662303 conn(0x7f32500c9350 msgr2=0x7f32500add90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:15:59.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.869+0000 7f3255200640 1 -- 172.21.15.90:0/2445662303 shutdown_connections 2024-09-21T03:15:59.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.869+0000 7f3255200640 1 -- 172.21.15.90:0/2445662303 wait complete. 2024-09-21T03:15:59.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.872+0000 7f3255200640 1 Processor -- start 2024-09-21T03:15:59.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.872+0000 7f3255200640 1 -- start start 2024-09-21T03:15:59.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.874+0000 7f3255200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f325006d530 0x7f325014d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:59.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.874+0000 7f3255200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f325008d510 0x7f32501f0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:59.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.874+0000 7f3255200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32500cb2b0 0x7f32501532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:59.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.874+0000 7f3255200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f325008dc30 con 0x7f32500cb2b0 2024-09-21T03:15:59.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.874+0000 7f3255200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f325015acb0 con 0x7f325008d510 2024-09-21T03:15:59.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.874+0000 7f3255200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f325008ddb0 con 0x7f325006d530 2024-09-21T03:15:59.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.875+0000 7f324fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32500cb2b0 0x7f32501532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:59.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.875+0000 7f324ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f325008d510 0x7f32501f0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:59.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.875+0000 7f324ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f325008d510 0x7f32501f0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:39562/0 (socket says 172.21.15.90:39562) 2024-09-21T03:15:59.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.875+0000 7f324ea00640 1 -- 172.21.15.90:0/4138955477 learned_addr learned my addr 172.21.15.90:0/4138955477 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:15:59.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.875+0000 7f324f400640 1 --2- 172.21.15.90:0/4138955477 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f325006d530 0x7f325014d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:59.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.875+0000 7f324f400640 1 -- 172.21.15.90:0/4138955477 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f325006d530 msgr2=0x7f325014d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-21T03:15:59.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.875+0000 7f324f400640 1 -- 172.21.15.90:0/4138955477 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f325006d530 msgr2=0x7f325014d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T03:15:59.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.875+0000 7f324f400640 1 --2- 172.21.15.90:0/4138955477 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f325006d530 0x7f325014d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T03:15:59.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.875+0000 7f324ea00640 1 -- 172.21.15.90:0/4138955477 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f325006d530 msgr2=0x7f325014d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:59.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.875+0000 7f324f400640 1 --2- 172.21.15.90:0/4138955477 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f325006d530 0x7f325014d250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:15:59.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.875+0000 7f324ea00640 1 --2- 172.21.15.90:0/4138955477 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f325006d530 0x7f325014d250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:59.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.875+0000 7f324ea00640 1 -- 172.21.15.90:0/4138955477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32500cb2b0 msgr2=0x7f32501532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:15:59.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.875+0000 7f324ea00640 1 --2- 172.21.15.90:0/4138955477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32500cb2b0 0x7f32501532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:15:59.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.875+0000 7f324ea00640 1 -- 172.21.15.90:0/4138955477 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32500b1aa0 con 0x7f325008d510 2024-09-21T03:15:59.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.875+0000 7f324fe00640 1 --2- 172.21.15.90:0/4138955477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32500cb2b0 0x7f32501532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:15:59.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.876+0000 7f324ea00640 1 --2- 172.21.15.90:0/4138955477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f325008d510 0x7f32501f0750 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c3c0 tx=0x7f323c00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:59.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.876+0000 7f3247400640 1 -- 172.21.15.90:0/4138955477 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c017070 con 0x7f325008d510 2024-09-21T03:15:59.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.876+0000 7f3255200640 1 -- 172.21.15.90:0/4138955477 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32501edd60 con 0x7f325008d510 2024-09-21T03:15:59.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.876+0000 7f3247400640 1 -- 172.21.15.90:0/4138955477 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f323c0035f0 con 0x7f325008d510 2024-09-21T03:15:59.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.876+0000 7f3255200640 1 -- 172.21.15.90:0/4138955477 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32501eda80 con 0x7f325008d510 2024-09-21T03:15:59.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.876+0000 7f3247400640 1 -- 172.21.15.90:0/4138955477 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c003a40 con 0x7f325008d510 2024-09-21T03:15:59.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.878+0000 7f3255200640 1 -- 172.21.15.90:0/4138955477 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3228005290 con 0x7f325008d510 2024-09-21T03:15:59.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.880+0000 7f3247400640 1 -- 172.21.15.90:0/4138955477 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f323c01a070 con 0x7f325008d510 2024-09-21T03:15:59.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.882+0000 7f3247400640 1 --2- 172.21.15.90:0/4138955477 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3230078b90 0x7f323007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:15:59.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.882+0000 7f3247400640 1 -- 172.21.15.90:0/4138955477 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f323c09a3a0 con 0x7f325008d510 2024-09-21T03:15:59.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.882+0000 7f324f400640 1 --2- 172.21.15.90:0/4138955477 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3230078b90 0x7f323007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:15:59.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.883+0000 7f324f400640 1 --2- 172.21.15.90:0/4138955477 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3230078b90 0x7f323007b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3240034000 tx=0x7f3240004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:15:59.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:15:59.892+0000 7f3247400640 1 -- 172.21.15.90:0/4138955477 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f323c061d30 con 0x7f325008d510 2024-09-21T03:16:00.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.221+0000 7f3255200640 1 -- 172.21.15.90:0/4138955477 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3228005580 con 0x7f325008d510 2024-09-21T03:16:00.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.222+0000 7f3247400640 1 -- 172.21.15.90:0/4138955477 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f323c066760 con 0x7f325008d510 2024-09-21T03:16:00.224 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:16:00.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.226+0000 7f3255200640 1 -- 172.21.15.90:0/4138955477 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3230078b90 msgr2=0x7f323007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:00.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.226+0000 7f3255200640 1 --2- 172.21.15.90:0/4138955477 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3230078b90 0x7f323007b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3240034000 tx=0x7f3240004730 comp rx=0 tx=0).stop 2024-09-21T03:16:00.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.226+0000 7f3255200640 1 -- 172.21.15.90:0/4138955477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f325008d510 msgr2=0x7f32501f0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:00.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.226+0000 7f3255200640 1 --2- 172.21.15.90:0/4138955477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f325008d510 0x7f32501f0750 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c3c0 tx=0x7f323c00c880 comp rx=0 tx=0).stop 2024-09-21T03:16:00.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.226+0000 7f3255200640 1 -- 172.21.15.90:0/4138955477 shutdown_connections 2024-09-21T03:16:00.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.226+0000 7f3255200640 1 --2- 172.21.15.90:0/4138955477 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3230078b90 0x7f323007b0a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:00.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.226+0000 7f3255200640 1 --2- 172.21.15.90:0/4138955477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32500cb2b0 0x7f32501532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:00.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.226+0000 7f3255200640 1 --2- 172.21.15.90:0/4138955477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f325008d510 0x7f32501f0750 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:00.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.226+0000 7f3255200640 1 --2- 172.21.15.90:0/4138955477 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f325006d530 0x7f325014d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:00.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.226+0000 7f3255200640 1 -- 172.21.15.90:0/4138955477 >> 172.21.15.90:0/4138955477 conn(0x7f32500c9350 msgr2=0x7f3250157f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:00.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.226+0000 7f3255200640 1 -- 172.21.15.90:0/4138955477 shutdown_connections 2024-09-21T03:16:00.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.226+0000 7f3255200640 1 -- 172.21.15.90:0/4138955477 wait complete. 2024-09-21T03:16:00.253 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-21T03:16:00.253 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-21T03:16:00.253 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:16:00.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.506+0000 7fcb5e400640 1 -- 172.21.15.90:0/3794069576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb40005280 msgr2=0x7fcb4000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:00.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.506+0000 7fcb5e400640 1 --2- 172.21.15.90:0/3794069576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb40005280 0x7fcb4000b9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcb580a80d0 tx=0x7fcb40005830 comp rx=0 tx=0).stop 2024-09-21T03:16:00.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.506+0000 7fcb5e400640 1 -- 172.21.15.90:0/3794069576 shutdown_connections 2024-09-21T03:16:00.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.506+0000 7fcb5e400640 1 --2- 172.21.15.90:0/3794069576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb40005280 0x7fcb4000b9c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:00.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.506+0000 7fcb5e400640 1 -- 172.21.15.90:0/3794069576 >> 172.21.15.90:0/3794069576 conn(0x7fcb5806cde0 msgr2=0x7fcb5806d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:00.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.506+0000 7fcb5e400640 1 -- 172.21.15.90:0/3794069576 shutdown_connections 2024-09-21T03:16:00.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.507+0000 7fcb5e400640 1 -- 172.21.15.90:0/3794069576 wait complete. 2024-09-21T03:16:00.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.509+0000 7fcb5e400640 1 Processor -- start 2024-09-21T03:16:00.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.510+0000 7fcb5e400640 1 -- start start 2024-09-21T03:16:00.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.512+0000 7fcb5e400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb40005280 0x7fcb58152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:00.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.512+0000 7fcb5e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb580c1d20 0x7fcb580749b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:00.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.512+0000 7fcb5e400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb580c2130 0x7fcb5814b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:00.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.512+0000 7fcb5e400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcb580ab330 con 0x7fcb40005280 2024-09-21T03:16:00.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.512+0000 7fcb5e400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcb580ab1b0 con 0x7fcb580c2130 2024-09-21T03:16:00.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.512+0000 7fcb5e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcb580c4370 con 0x7fcb580c1d20 2024-09-21T03:16:00.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.512+0000 7fcb5d000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb40005280 0x7fcb58152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:00.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.512+0000 7fcb5d000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb40005280 0x7fcb58152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44130/0 (socket says 172.21.15.90:44130) 2024-09-21T03:16:00.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.512+0000 7fcb5d000640 1 -- 172.21.15.90:0/2776572488 learned_addr learned my addr 172.21.15.90:0/2776572488 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:16:00.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.512+0000 7fcb57e00640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb580c1d20 0x7fcb580749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:00.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.512+0000 7fcb5da00640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb580c2130 0x7fcb5814b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:00.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.512+0000 7fcb57e00640 1 -- 172.21.15.90:0/2776572488 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb580c1d20 msgr2=0x7fcb580749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-21T03:16:00.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.512+0000 7fcb57e00640 1 -- 172.21.15.90:0/2776572488 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb580c1d20 msgr2=0x7fcb580749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T03:16:00.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.512+0000 7fcb57e00640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb580c1d20 0x7fcb580749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T03:16:00.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.513+0000 7fcb5d000640 1 -- 172.21.15.90:0/2776572488 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb580c1d20 msgr2=0x7fcb580749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:00.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.513+0000 7fcb57e00640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb580c1d20 0x7fcb580749b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:16:00.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.513+0000 7fcb5d000640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb580c1d20 0x7fcb580749b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:00.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.513+0000 7fcb5d000640 1 -- 172.21.15.90:0/2776572488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb580c2130 msgr2=0x7fcb5814b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:00.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.513+0000 7fcb5d000640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb580c2130 0x7fcb5814b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:00.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.513+0000 7fcb5d000640 1 -- 172.21.15.90:0/2776572488 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb581eac80 con 0x7fcb40005280 2024-09-21T03:16:00.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.513+0000 7fcb5d000640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb40005280 0x7fcb58152e00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c003d80 tx=0x7fcb4c001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:00.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.513+0000 7fcb54c00640 1 -- 172.21.15.90:0/2776572488 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c011640 con 0x7fcb40005280 2024-09-21T03:16:00.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.513+0000 7fcb54c00640 1 -- 172.21.15.90:0/2776572488 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb4c016020 con 0x7fcb40005280 2024-09-21T03:16:00.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.513+0000 7fcb5e400640 1 -- 172.21.15.90:0/2776572488 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb581debb0 con 0x7fcb40005280 2024-09-21T03:16:00.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.513+0000 7fcb54c00640 1 -- 172.21.15.90:0/2776572488 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c011a80 con 0x7fcb40005280 2024-09-21T03:16:00.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.514+0000 7fcb5e400640 1 -- 172.21.15.90:0/2776572488 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb581e0540 con 0x7fcb40005280 2024-09-21T03:16:00.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.515+0000 7fcb5e400640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb581f0690 0x7fcb5814bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:00.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.515+0000 7fcb5e400640 1 -- 172.21.15.90:0/2776572488 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcb581dedd0 con 0x7fcb581f0690 2024-09-21T03:16:00.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.515+0000 7fcb57e00640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb581f0690 0x7fcb5814bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:00.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.516+0000 7fcb57e00640 1 -- 172.21.15.90:0/2776572488 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcb581eda60 con 0x7fcb581f0690 2024-09-21T03:16:00.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.516+0000 7fcb57e00640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb581f0690 0x7fcb5814bc10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcb580c2c80 tx=0x7fcb440039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:00.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.517+0000 7fcb54c00640 1 -- 172.21.15.90:0/2776572488 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44012970 con 0x7fcb581f0690 2024-09-21T03:16:00.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.518+0000 7fcb54c00640 1 -- 172.21.15.90:0/2776572488 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fcb44016070 con 0x7fcb581f0690 2024-09-21T03:16:00.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.518+0000 7fcb54c00640 1 -- 172.21.15.90:0/2776572488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb581f0690 msgr2=0x7fcb5814bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:00.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.518+0000 7fcb54c00640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb581f0690 0x7fcb5814bc10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcb580c2c80 tx=0x7fcb440039c0 comp rx=0 tx=0).stop 2024-09-21T03:16:00.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.518+0000 7fcb54c00640 1 -- 172.21.15.90:0/2776572488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb581f0690 msgr2=0x7fcb5814bc10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:16:00.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.518+0000 7fcb54c00640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb581f0690 0x7fcb5814bc10 secure :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcb580c2c80 tx=0x7fcb440039c0 comp rx=0 tx=0).stop 2024-09-21T03:16:00.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.519+0000 7fcb54c00640 1 -- 172.21.15.90:0/2776572488 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcb4c011c20 con 0x7fcb40005280 2024-09-21T03:16:00.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.520+0000 7fcb54c00640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcb38078650 0x7fcb3807ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:00.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.520+0000 7fcb54c00640 1 -- 172.21.15.90:0/2776572488 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fcb4c09bd00 con 0x7fcb40005280 2024-09-21T03:16:00.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.521+0000 7fcb57e00640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcb38078650 0x7fcb3807ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:00.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.521+0000 7fcb57e00640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcb38078650 0x7fcb3807ab60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb58051620 tx=0x7fcb4400f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:00.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.528+0000 7fcb5e400640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb581df200 0x7fcb581df610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:00.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.528+0000 7fcb5e400640 1 -- 172.21.15.90:0/2776572488 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcb581edef0 con 0x7fcb581df200 2024-09-21T03:16:00.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.528+0000 7fcb5da00640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb581df200 0x7fcb581df610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:00.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.529+0000 7fcb5da00640 1 -- 172.21.15.90:0/2776572488 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcb5814c150 con 0x7fcb581df200 2024-09-21T03:16:00.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.529+0000 7fcb5da00640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb581df200 0x7fcb581df610 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcb580aaa40 tx=0x7fcb500334f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:00.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.530+0000 7fcb54c00640 1 -- 172.21.15.90:0/2776572488 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb50038040 con 0x7fcb581df200 2024-09-21T03:16:00.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.530+0000 7fcb54c00640 1 -- 172.21.15.90:0/2776572488 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4885 (secure 0 0 0) 0x7fcb50004b20 con 0x7fcb581df200 2024-09-21T03:16:00.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.530+0000 7fcb54c00640 1 -- 172.21.15.90:0/2776572488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb581df200 msgr2=0x7fcb581df610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:00.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.530+0000 7fcb54c00640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb581df200 0x7fcb581df610 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcb580aaa40 tx=0x7fcb500334f0 comp rx=0 tx=0).stop 2024-09-21T03:16:00.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.530+0000 7fcb54c00640 1 -- 172.21.15.90:0/2776572488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb581df200 msgr2=0x7fcb581df610 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:16:00.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.530+0000 7fcb54c00640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb581df200 0x7fcb581df610 secure :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcb580aaa40 tx=0x7fcb500334f0 comp rx=0 tx=0).stop 2024-09-21T03:16:00.532 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:16:00.532 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:16:00.532 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:16:00.532 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:16:00.532 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 10, 2024-09-21T03:16:00.532 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 111246, 2024-09-21T03:16:00.533 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:16:00.533 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:16:00.533 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:16:00.533 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:16:00.533 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:00.533 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 0, 2024-09-21T03:16:00.533 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:16:00.533 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:16:00.533 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:16:00.533 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:00.533 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:00.533 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:00.533 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:00.533 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:00.533 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:00.534 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:00.534 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:00.534 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:00.534 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:00.534 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:00.534 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:00.534 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:16:00.534 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:16:00.534 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:00.534 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:00.534 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:00.534 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:00.534 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:00.534 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:00.534 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:00.535 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:00.535 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:00.535 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:00.535 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:00.535 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:00.535 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.535 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:16:00.535 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:16:00.535 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:16:00.535 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:16:00.535 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:16:00.535 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:16:00.535 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:16:00.535 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:16:00.536 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:16:00.536 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:16:00.536 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:16:00.536 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:16:00.536 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:16:00.536 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:16:00.536 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:16:00.536 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:16:00.536 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:16:00.536 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:00.536 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:00.536 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:00.536 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:00.536 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:00.537 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:00.537 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:00.537 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:00.537 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:00.537 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:00.537 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:00.537 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:00.537 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:16:00.537 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.537 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:16:00.537 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.537 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:16:00.537 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:16:00.537 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:00.537 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:00.538 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.538 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:00.538 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:16:00.538 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:00.538 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.538 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.538 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:00.538 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:16:00.538 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:00.538 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:00.538 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:00.538 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.538 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:16:00.538 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:16:00.539 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:00.539 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:00.539 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:00.539 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.539 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.539 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:16:00.539 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:16:00.539 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:00.539 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:00.539 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.539 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:00.539 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:16:00.539 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:00.540 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.540 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.540 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:00.540 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:16:00.540 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:00.540 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:00.540 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:00.540 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.540 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:16:00.540 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:16:00.540 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:00.540 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:00.540 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:00.540 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.540 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.541 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:16:00.541 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:16:00.541 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:00.541 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:00.541 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.541 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:00.541 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:16:00.541 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:00.541 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.541 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.541 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:00.541 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:16:00.541 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:00.541 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:00.542 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:00.542 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.542 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:16:00.542 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:16:00.542 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:00.542 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:00.542 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:00.542 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:00.542 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:00.542 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.542 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:16:00.542 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:16:00.542 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.542 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:00.543 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:00.543 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:16:00.543 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:00.543 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:00.543 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:16:00.543 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.543 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:00.543 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:00.543 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 3 2024-09-21T03:16:00.543 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:00.543 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:00.543 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:16:00.543 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.543 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:00.544 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:00.544 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6 2024-09-21T03:16:00.544 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:00.544 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:00.544 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:16:00.544 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.544 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:00.544 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:00.544 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:16:00.544 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:00.544 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:00.544 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.544 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:16:00.544 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:16:00.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.530+0000 7fcb5e400640 1 -- 172.21.15.90:0/2776572488 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcb38078650 msgr2=0x7fcb3807ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:00.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.530+0000 7fcb5e400640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcb38078650 0x7fcb3807ab60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb58051620 tx=0x7fcb4400f000 comp rx=0 tx=0).stop 2024-09-21T03:16:00.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.530+0000 7fcb5e400640 1 -- 172.21.15.90:0/2776572488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb40005280 msgr2=0x7fcb58152e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:00.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.530+0000 7fcb5e400640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb40005280 0x7fcb58152e00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c003d80 tx=0x7fcb4c001800 comp rx=0 tx=0).stop 2024-09-21T03:16:00.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.530+0000 7fcb5da00640 1 -- 172.21.15.90:0/2776572488 reap_dead start 2024-09-21T03:16:00.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.531+0000 7fcb5e400640 1 -- 172.21.15.90:0/2776572488 shutdown_connections 2024-09-21T03:16:00.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.531+0000 7fcb5e400640 1 --2- 172.21.15.90:0/2776572488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb40005280 0x7fcb58152e00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:00.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.531+0000 7fcb5e400640 1 -- 172.21.15.90:0/2776572488 >> 172.21.15.90:0/2776572488 conn(0x7fcb5806cde0 msgr2=0x7fcb5814f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:00.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.531+0000 7fcb5e400640 1 -- 172.21.15.90:0/2776572488 shutdown_connections 2024-09-21T03:16:00.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.531+0000 7fcb5e400640 1 -- 172.21.15.90:0/2776572488 wait complete. 2024-09-21T03:16:00.568 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:16:00.568 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-21T03:16:00.568 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:16:00.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.903+0000 7fc20ca00640 1 -- 172.21.15.90:0/647165677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1ec0037a0 msgr2=0x7fc1ec003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:00.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.903+0000 7fc20ca00640 1 --2- 172.21.15.90:0/647165677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1ec0037a0 0x7fc1ec003bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4001720 tx=0x7fc1ec005830 comp rx=0 tx=0).stop 2024-09-21T03:16:00.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.903+0000 7fc207e00640 1 -- 172.21.15.90:0/647165677 reap_dead start 2024-09-21T03:16:00.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.903+0000 7fc20ca00640 1 -- 172.21.15.90:0/647165677 shutdown_connections 2024-09-21T03:16:00.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.903+0000 7fc20ca00640 1 -- 172.21.15.90:0/647165677 >> 172.21.15.90:0/647165677 conn(0x7fc2080cc270 msgr2=0x7fc2080cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:00.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.903+0000 7fc20ca00640 1 -- 172.21.15.90:0/647165677 shutdown_connections 2024-09-21T03:16:00.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.903+0000 7fc20ca00640 1 -- 172.21.15.90:0/647165677 wait complete. 2024-09-21T03:16:00.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.907+0000 7fc20ca00640 1 Processor -- start 2024-09-21T03:16:00.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.907+0000 7fc20ca00640 1 -- start start 2024-09-21T03:16:00.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.909+0000 7fc20ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1ec0037a0 0x7fc2081f07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:00.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.909+0000 7fc20ca00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc20815a910 0x7fc208158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:00.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.909+0000 7fc20ca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2081592a0 0x7fc2080ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:00.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.909+0000 7fc20ca00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc2080cba00 con 0x7fc20815a910 2024-09-21T03:16:00.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.909+0000 7fc20ca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc208154680 con 0x7fc1ec0037a0 2024-09-21T03:16:00.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.909+0000 7fc20ca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc2080c8840 con 0x7fc2081592a0 2024-09-21T03:16:00.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.909+0000 7fc206a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc20815a910 0x7fc208158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:00.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.909+0000 7fc206a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc20815a910 0x7fc208158d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44168/0 (socket says 172.21.15.90:44168) 2024-09-21T03:16:00.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.909+0000 7fc206a00640 1 -- 172.21.15.90:0/2849922510 learned_addr learned my addr 172.21.15.90:0/2849922510 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:16:00.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.909+0000 7fc207400640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1ec0037a0 0x7fc2081f07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:00.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.910+0000 7fc207e00640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2081592a0 0x7fc2080ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:00.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.910+0000 7fc207e00640 1 -- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2081592a0 msgr2=0x7fc2080ad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-21T03:16:00.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.910+0000 7fc207e00640 1 -- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2081592a0 msgr2=0x7fc2080ad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T03:16:00.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.910+0000 7fc207e00640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2081592a0 0x7fc2080ad650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T03:16:00.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.910+0000 7fc207e00640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2081592a0 0x7fc2080ad650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:16:00.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.910+0000 7fc207400640 1 -- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2081592a0 msgr2=0x7fc2080ad650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:16:00.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.910+0000 7fc207400640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2081592a0 0x7fc2080ad650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:00.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.910+0000 7fc207400640 1 -- 172.21.15.90:0/2849922510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc20815a910 msgr2=0x7fc208158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:00.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.910+0000 7fc207400640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc20815a910 0x7fc208158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:00.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.910+0000 7fc207400640 1 -- 172.21.15.90:0/2849922510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2081588a0 con 0x7fc1ec0037a0 2024-09-21T03:16:00.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.910+0000 7fc206a00640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc20815a910 0x7fc208158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:16:00.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.910+0000 7fc207400640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1ec0037a0 0x7fc2081f07d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8005e50 tx=0x7fc1f8003b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:00.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.911+0000 7fc1ff400640 1 -- 172.21.15.90:0/2849922510 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8005220 con 0x7fc1ec0037a0 2024-09-21T03:16:00.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.911+0000 7fc1ff400640 1 -- 172.21.15.90:0/2849922510 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1f80053c0 con 0x7fc1ec0037a0 2024-09-21T03:16:00.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.911+0000 7fc20ca00640 1 -- 172.21.15.90:0/2849922510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2081f13e0 con 0x7fc1ec0037a0 2024-09-21T03:16:00.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.911+0000 7fc1ff400640 1 -- 172.21.15.90:0/2849922510 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f80047a0 con 0x7fc1ec0037a0 2024-09-21T03:16:00.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.911+0000 7fc20ca00640 1 -- 172.21.15.90:0/2849922510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2080ae730 con 0x7fc1ec0037a0 2024-09-21T03:16:00.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.912+0000 7fc20ca00640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2080adb90 0x7fc2081ed000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:00.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.912+0000 7fc20ca00640 1 -- 172.21.15.90:0/2849922510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc2081e2e30 con 0x7fc2080adb90 2024-09-21T03:16:00.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.912+0000 7fc206a00640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2080adb90 0x7fc2081ed000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:00.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.913+0000 7fc206a00640 1 -- 172.21.15.90:0/2849922510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc208159710 con 0x7fc2080adb90 2024-09-21T03:16:00.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.913+0000 7fc206a00640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2080adb90 0x7fc2081ed000 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc2081e0560 tx=0x7fc1f4003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:00.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.913+0000 7fc1ff400640 1 -- 172.21.15.90:0/2849922510 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4038040 con 0x7fc2080adb90 2024-09-21T03:16:00.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.913+0000 7fc1ff400640 1 -- 172.21.15.90:0/2849922510 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc1f8004940 con 0x7fc1ec0037a0 2024-09-21T03:16:00.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.914+0000 7fc1ff400640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc1e8078ac0 0x7fc1e807afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:00.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.915+0000 7fc1ff400640 1 -- 172.21.15.90:0/2849922510 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fc1f809ba40 con 0x7fc1ec0037a0 2024-09-21T03:16:00.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.915+0000 7fc1ff400640 1 -- 172.21.15.90:0/2849922510 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc1f4041070 con 0x7fc2080adb90 2024-09-21T03:16:00.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.915+0000 7fc1ff400640 1 -- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2080adb90 msgr2=0x7fc2081ed000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:00.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.915+0000 7fc1ff400640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2080adb90 0x7fc2081ed000 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc2081e0560 tx=0x7fc1f4003820 comp rx=0 tx=0).stop 2024-09-21T03:16:00.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.915+0000 7fc207e00640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc1e8078ac0 0x7fc1e807afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:00.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.915+0000 7fc1ff400640 1 -- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2080adb90 msgr2=0x7fc2081ed000 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:16:00.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.915+0000 7fc1ff400640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2080adb90 0x7fc2081ed000 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc2081e0560 tx=0x7fc1f4003820 comp rx=0 tx=0).stop 2024-09-21T03:16:00.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.916+0000 7fc207e00640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc1e8078ac0 0x7fc1e807afd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc2080cd130 tx=0x7fc200006f70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:00.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.921+0000 7fc20ca00640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2081ed540 0x7fc2081ed950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:00.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.921+0000 7fc20ca00640 1 -- 172.21.15.90:0/2849922510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc2081f1190 con 0x7fc2081ed540 2024-09-21T03:16:00.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.922+0000 7fc206a00640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2081ed540 0x7fc2081ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:00.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.922+0000 7fc206a00640 1 -- 172.21.15.90:0/2849922510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc2081ede90 con 0x7fc2081ed540 2024-09-21T03:16:00.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.922+0000 7fc206a00640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2081ed540 0x7fc2081ed950 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc20806ab40 tx=0x7fc1f4006b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:00.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.923+0000 7fc1ff400640 1 -- 172.21.15.90:0/2849922510 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f403c840 con 0x7fc2081ed540 2024-09-21T03:16:00.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.923+0000 7fc1ff400640 1 -- 172.21.15.90:0/2849922510 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5193 (secure 0 0 0) 0x7fc1f402e070 con 0x7fc2081ed540 2024-09-21T03:16:00.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.923+0000 7fc1ff400640 1 -- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2081ed540 msgr2=0x7fc2081ed950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:00.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.923+0000 7fc1ff400640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2081ed540 0x7fc2081ed950 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc20806ab40 tx=0x7fc1f4006b10 comp rx=0 tx=0).stop 2024-09-21T03:16:00.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.923+0000 7fc1ff400640 1 -- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2081ed540 msgr2=0x7fc2081ed950 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:16:00.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.923+0000 7fc1ff400640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2081ed540 0x7fc2081ed950 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc20806ab40 tx=0x7fc1f4006b10 comp rx=0 tx=0).stop 2024-09-21T03:16:00.925 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:16:00.925 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:16:00.925 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:16:00.925 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:16:00.925 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 10, 2024-09-21T03:16:00.925 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 111712, 2024-09-21T03:16:00.926 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:16:00.926 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:16:00.926 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:16:00.926 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:16:00.926 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:00.926 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 0, 2024-09-21T03:16:00.926 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:16:00.926 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:16:00.926 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:16:00.926 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:00.926 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:00.926 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:00.926 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:00.927 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:00.927 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:00.927 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:00.927 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:00.927 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:00.927 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:00.927 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:00.927 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:00.927 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:16:00.927 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:16:00.927 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:00.927 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:00.927 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:00.927 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:00.928 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:00.928 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:00.928 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:00.928 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:00.928 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:00.928 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:00.928 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:00.928 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:00.928 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.928 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:16:00.928 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:16:00.928 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:16:00.928 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:16:00.928 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:16:00.929 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:16:00.929 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:16:00.929 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:16:00.929 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:16:00.929 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:16:00.929 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:16:00.929 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:16:00.929 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:16:00.929 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:16:00.929 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:16:00.929 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:16:00.929 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:16:00.929 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:00.930 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:00.930 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:00.930 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:00.930 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:00.930 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:00.930 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:00.930 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:00.930 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:00.930 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:00.930 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:00.930 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:00.930 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:16:00.930 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.930 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:16:00.931 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.931 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:16:00.931 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:16:00.931 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:00.931 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:00.931 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.931 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:00.931 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:16:00.931 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:00.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.931 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.931 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:00.931 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:16:00.931 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:00.932 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:00.932 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:00.932 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.932 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:16:00.932 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:16:00.932 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:00.932 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:00.932 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:00.932 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.932 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.932 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:16:00.932 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:16:00.932 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:00.932 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:00.932 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.933 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:00.933 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:16:00.933 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:00.933 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.933 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.933 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:00.933 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:16:00.933 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:00.933 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:00.933 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:00.933 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.933 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:16:00.933 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:16:00.933 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:00.934 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:00.934 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:00.934 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.934 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.934 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:16:00.934 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:16:00.934 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:00.934 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:00.934 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.934 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:00.934 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:16:00.934 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:00.934 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.934 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.934 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:00.935 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:16:00.935 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:00.935 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:00.935 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:00.935 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.935 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:16:00.935 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:16:00.935 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:00.935 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:00.935 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:00.935 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:00.935 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:00.935 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.935 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:16:00.936 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:16:00.936 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.936 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:00.936 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:00.936 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:16:00.936 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:00.936 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:00.936 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:16:00.936 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.936 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:00.936 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:00.936 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:16:00.936 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:00.936 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:00.936 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:16:00.937 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.937 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:00.937 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:00.937 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:16:00.937 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:00.937 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:00.937 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:16:00.937 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.937 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:16:00.937 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:16:00.937 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:16:00.937 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.937 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.937 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:00.937 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:00.938 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6 2024-09-21T03:16:00.938 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:00.938 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:00.938 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:16:00.938 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:00.938 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:00.938 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:00.938 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:16:00.938 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:00.938 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:00.938 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:00.938 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:16:00.938 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:16:00.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.923+0000 7fc20ca00640 1 -- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc1e8078ac0 msgr2=0x7fc1e807afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:00.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.923+0000 7fc20ca00640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc1e8078ac0 0x7fc1e807afd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc2080cd130 tx=0x7fc200006f70 comp rx=0 tx=0).stop 2024-09-21T03:16:00.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.923+0000 7fc20ca00640 1 -- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1ec0037a0 msgr2=0x7fc2081f07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:00.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.923+0000 7fc20ca00640 1 --2- 172.21.15.90:0/2849922510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1ec0037a0 0x7fc2081f07d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8005e50 tx=0x7fc1f8003b00 comp rx=0 tx=0).stop 2024-09-21T03:16:00.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.923+0000 7fc207e00640 1 -- 172.21.15.90:0/2849922510 reap_dead start 2024-09-21T03:16:00.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.923+0000 7fc207e00640 1 -- 172.21.15.90:0/2849922510 reap_dead start 2024-09-21T03:16:00.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.924+0000 7fc20ca00640 1 -- 172.21.15.90:0/2849922510 shutdown_connections 2024-09-21T03:16:00.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.924+0000 7fc20ca00640 1 -- 172.21.15.90:0/2849922510 >> 172.21.15.90:0/2849922510 conn(0x7fc2080cc270 msgr2=0x7fc2080cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:00.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.924+0000 7fc20ca00640 1 -- 172.21.15.90:0/2849922510 shutdown_connections 2024-09-21T03:16:00.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:00.924+0000 7fc20ca00640 1 -- 172.21.15.90:0/2849922510 wait complete. 2024-09-21T03:16:00.946 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:16:00.946 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-21T03:16:00.946 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:16:01.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.249+0000 7f8e66600640 1 -- 172.21.15.90:0/464748385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e600c8c50 msgr2=0x7f8e600c9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:01.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.249+0000 7f8e66600640 1 --2- 172.21.15.90:0/464748385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e600c8c50 0x7f8e600c9060 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c005fd0 tx=0x7f8e4c02a540 comp rx=0 tx=0).stop 2024-09-21T03:16:01.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.249+0000 7f8e66600640 1 -- 172.21.15.90:0/464748385 shutdown_connections 2024-09-21T03:16:01.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.249+0000 7f8e66600640 1 --2- 172.21.15.90:0/464748385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e600c8c50 0x7f8e600c9060 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:01.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.249+0000 7f8e66600640 1 --2- 172.21.15.90:0/464748385 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e600c7120 0x7f8e60154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:01.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.249+0000 7f8e66600640 1 -- 172.21.15.90:0/464748385 >> 172.21.15.90:0/464748385 conn(0x7f8e600cc270 msgr2=0x7f8e600cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:01.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.249+0000 7f8e66600640 1 -- 172.21.15.90:0/464748385 shutdown_connections 2024-09-21T03:16:01.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.249+0000 7f8e66600640 1 -- 172.21.15.90:0/464748385 wait complete. 2024-09-21T03:16:01.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.253+0000 7f8e66600640 1 Processor -- start 2024-09-21T03:16:01.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.253+0000 7f8e66600640 1 -- start start 2024-09-21T03:16:01.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.255+0000 7f8e66600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e600c7120 0x7f8e601f02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:01.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.255+0000 7f8e66600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e600c8c50 0x7f8e601e1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:01.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.255+0000 7f8e66600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e60156ad0 0x7f8e601e0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:01.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.255+0000 7f8e66600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8e60154680 con 0x7f8e600c7120 2024-09-21T03:16:01.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.255+0000 7f8e66600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8e600cba00 con 0x7f8e60156ad0 2024-09-21T03:16:01.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.255+0000 7f8e66600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8e600c8840 con 0x7f8e600c8c50 2024-09-21T03:16:01.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.255+0000 7f8e65200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e600c7120 0x7f8e601f02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:01.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.255+0000 7f8e65200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e600c7120 0x7f8e601f02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44184/0 (socket says 172.21.15.90:44184) 2024-09-21T03:16:01.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.255+0000 7f8e65200640 1 -- 172.21.15.90:0/1307971815 learned_addr learned my addr 172.21.15.90:0/1307971815 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:16:01.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.255+0000 7f8e65c00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e60156ad0 0x7f8e601e0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:01.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.256+0000 7f8e5fe00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e600c8c50 0x7f8e601e1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:01.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.256+0000 7f8e65200640 1 -- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e600c8c50 msgr2=0x7f8e601e1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:01.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.256+0000 7f8e65200640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e600c8c50 0x7f8e601e1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:01.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.256+0000 7f8e65200640 1 -- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e60156ad0 msgr2=0x7f8e601e0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:01.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.256+0000 7f8e65200640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e60156ad0 0x7f8e601e0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:01.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.256+0000 7f8e65200640 1 -- 172.21.15.90:0/1307971815 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e601f0c90 con 0x7f8e600c7120 2024-09-21T03:16:01.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.256+0000 7f8e65c00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e60156ad0 0x7f8e601e0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:16:01.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.256+0000 7f8e65200640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e600c7120 0x7f8e601f02c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400d980 tx=0x7f8e5400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:01.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.256+0000 7f8e5cc00640 1 -- 172.21.15.90:0/1307971815 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e54017070 con 0x7f8e600c7120 2024-09-21T03:16:01.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.257+0000 7f8e5cc00640 1 -- 172.21.15.90:0/1307971815 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e54009d40 con 0x7f8e600c7120 2024-09-21T03:16:01.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.257+0000 7f8e5cc00640 1 -- 172.21.15.90:0/1307971815 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e54005280 con 0x7f8e600c7120 2024-09-21T03:16:01.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.257+0000 7f8e66600640 1 -- 172.21.15.90:0/1307971815 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e60158470 con 0x7f8e600c7120 2024-09-21T03:16:01.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.257+0000 7f8e66600640 1 -- 172.21.15.90:0/1307971815 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e601e1570 con 0x7f8e600c7120 2024-09-21T03:16:01.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.258+0000 7f8e66600640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 0x7f8e601e1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:01.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.258+0000 7f8e66600640 1 -- 172.21.15.90:0/1307971815 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8e6014ab60 con 0x7f8e601e0970 2024-09-21T03:16:01.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.258+0000 7f8e5fe00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 0x7f8e601e1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:01.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.259+0000 7f8e5fe00640 1 -- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 msgr2=0x7f8e601e1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-21T03:16:01.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.259+0000 7f8e5fe00640 1 -- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 msgr2=0x7f8e601e1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T03:16:01.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.259+0000 7f8e5fe00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 0x7f8e601e1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T03:16:01.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.259+0000 7f8e5fe00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 0x7f8e601e1fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:16:01.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.261+0000 7f8e5cc00640 1 -- 172.21.15.90:0/1307971815 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8e54005420 con 0x7f8e600c7120 2024-09-21T03:16:01.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.262+0000 7f8e5cc00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8e40078bc0 0x7f8e4007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:01.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.263+0000 7f8e5cc00640 1 -- 172.21.15.90:0/1307971815 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f8e5409b250 con 0x7f8e600c7120 2024-09-21T03:16:01.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.263+0000 7f8e65c00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8e40078bc0 0x7f8e4007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:01.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.264+0000 7f8e65c00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8e40078bc0 0x7f8e4007b0d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8e580012e0 tx=0x7f8e58009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:01.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.461+0000 7f8e5fe00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 0x7f8e601e1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:01.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.461+0000 7f8e5fe00640 1 -- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 msgr2=0x7f8e601e1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-21T03:16:01.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.461+0000 7f8e5fe00640 1 -- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 msgr2=0x7f8e601e1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T03:16:01.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.461+0000 7f8e5fe00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 0x7f8e601e1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T03:16:01.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.461+0000 7f8e5fe00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 0x7f8e601e1fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-21T03:16:01.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.863+0000 7f8e5fe00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 0x7f8e601e1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:01.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.863+0000 7f8e5fe00640 1 -- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 msgr2=0x7f8e601e1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-21T03:16:01.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.863+0000 7f8e5fe00640 1 -- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 msgr2=0x7f8e601e1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T03:16:01.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.863+0000 7f8e5fe00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 0x7f8e601e1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T03:16:01.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:01.863+0000 7f8e5fe00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 0x7f8e601e1fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-21T03:16:02.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:02.664+0000 7f8e5fe00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 0x7f8e601e1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:02.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:02.665+0000 7f8e5fe00640 1 -- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 msgr2=0x7f8e601e1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-21T03:16:02.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:02.665+0000 7f8e5fe00640 1 -- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 msgr2=0x7f8e601e1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T03:16:02.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:02.665+0000 7f8e5fe00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 0x7f8e601e1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T03:16:02.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:02.665+0000 7f8e5fe00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 0x7f8e601e1fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-21T03:16:04.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:04.266+0000 7f8e5fe00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 0x7f8e601e1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:04.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:04.266+0000 7f8e5fe00640 1 -- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 msgr2=0x7f8e601e1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-21T03:16:04.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:04.266+0000 7f8e5fe00640 1 -- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 msgr2=0x7f8e601e1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T03:16:04.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:04.266+0000 7f8e5fe00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 0x7f8e601e1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T03:16:04.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:04.266+0000 7f8e5fe00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 0x7f8e601e1fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-21T03:16:05.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.255+0000 7f8e53400640 1 -- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 msgr2=0x7f8e601e1fd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:16:05.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.255+0000 7f8e53400640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 0x7f8e601e1fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:05.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.255+0000 7f8e53400640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e34003540 0x7f8e34005a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:05.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.255+0000 7f8e53400640 1 -- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 msgr2=0x7f8e601e1fd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:16:05.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.255+0000 7f8e53400640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e601e0970 0x7f8e601e1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:05.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.255+0000 7f8e53400640 1 -- 172.21.15.90:0/1307971815 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8e6014ab60 con 0x7f8e34003540 2024-09-21T03:16:05.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.256+0000 7f8e5fe00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e34003540 0x7f8e34005a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:05.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.257+0000 7f8e5fe00640 1 -- 172.21.15.90:0/1307971815 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8e34006100 con 0x7f8e34003540 2024-09-21T03:16:05.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.257+0000 7f8e5fe00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e34003540 0x7f8e34005a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8e6006f8d0 tx=0x7f8e4c0045e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:05.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.257+0000 7f8e5cc00640 1 -- 172.21.15.90:0/1307971815 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c035040 con 0x7f8e34003540 2024-09-21T03:16:05.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.258+0000 7f8e5cc00640 1 -- 172.21.15.90:0/1307971815 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8e4c003920 con 0x7f8e34003540 2024-09-21T03:16:05.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.258+0000 7f8e5cc00640 1 -- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e34003540 msgr2=0x7f8e34005a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:05.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.258+0000 7f8e5cc00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e34003540 0x7f8e34005a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8e6006f8d0 tx=0x7f8e4c0045e0 comp rx=0 tx=0).stop 2024-09-21T03:16:05.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.258+0000 7f8e5cc00640 1 -- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e34003540 msgr2=0x7f8e34005a20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:16:05.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.258+0000 7f8e5cc00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e34003540 0x7f8e34005a20 secure :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8e6006f8d0 tx=0x7f8e4c0045e0 comp rx=0 tx=0).stop 2024-09-21T03:16:05.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.270+0000 7f8e66600640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e60147ff0 0x7f8e60148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:05.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.270+0000 7f8e66600640 1 -- 172.21.15.90:0/1307971815 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8e600ca2b0 con 0x7f8e60147ff0 2024-09-21T03:16:05.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.271+0000 7f8e5fe00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e60147ff0 0x7f8e60148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:05.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.271+0000 7f8e5fe00640 1 -- 172.21.15.90:0/1307971815 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8e601e0d80 con 0x7f8e60147ff0 2024-09-21T03:16:05.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.272+0000 7f8e5fe00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e60147ff0 0x7f8e60148400 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c009850 tx=0x7f8e4c02a540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:05.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.272+0000 7f8e5cc00640 1 -- 172.21.15.90:0/1307971815 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c035030 con 0x7f8e60147ff0 2024-09-21T03:16:05.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.272+0000 7f8e5cc00640 1 -- 172.21.15.90:0/1307971815 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4547 (secure 0 0 0) 0x7f8e4c03b430 con 0x7f8e60147ff0 2024-09-21T03:16:05.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.272+0000 7f8e5cc00640 1 -- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e60147ff0 msgr2=0x7f8e60148400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:05.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.272+0000 7f8e5cc00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e60147ff0 0x7f8e60148400 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c009850 tx=0x7f8e4c02a540 comp rx=0 tx=0).stop 2024-09-21T03:16:05.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.272+0000 7f8e5cc00640 1 -- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e60147ff0 msgr2=0x7f8e60148400 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:16:05.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.272+0000 7f8e5cc00640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e60147ff0 0x7f8e60148400 secure :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c009850 tx=0x7f8e4c02a540 comp rx=0 tx=0).stop 2024-09-21T03:16:05.275 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:16:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:16:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:16:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:16:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 10, 2024-09-21T03:16:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 5464, 2024-09-21T03:16:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:16:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:16:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:16:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:16:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 5, 2024-09-21T03:16:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:16:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:16:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:16:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:05.278 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:05.278 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:05.278 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:05.278 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:05.278 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:05.278 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:05.278 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:05.278 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:05.279 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:05.279 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:05.279 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:05.279 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:16:05.279 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:16:05.279 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:05.279 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:05.279 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:05.280 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:05.280 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:05.280 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:05.280 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:05.280 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:05.280 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:05.281 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:05.281 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:05.281 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:05.281 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:05.281 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:16:05.281 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:16:05.281 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:16:05.282 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:16:05.282 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:16:05.282 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:16:05.282 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:16:05.282 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:16:05.282 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:16:05.283 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:16:05.283 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:16:05.283 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:16:05.283 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:16:05.283 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:16:05.283 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:16:05.283 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:16:05.284 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:16:05.284 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:05.284 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:05.284 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:05.284 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:05.284 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:05.284 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:05.285 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:05.285 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:05.285 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:05.285 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:05.285 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:05.285 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:05.285 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:16:05.285 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:05.285 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:16:05.285 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:05.286 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:16:05.286 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:16:05.286 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:05.286 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:05.286 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:05.286 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:05.286 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:16:05.286 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:05.286 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:05.287 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:05.287 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:05.287 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:16:05.287 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:05.287 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:05.287 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:05.287 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:05.287 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:16:05.287 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:16:05.288 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:05.288 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:05.288 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:05.288 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:05.288 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:05.288 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:16:05.289 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:16:05.289 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:05.289 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:05.289 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:05.289 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:05.289 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:16:05.289 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:05.289 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:05.290 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:05.290 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:05.290 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:16:05.290 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:05.290 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:05.290 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:05.290 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:05.290 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:16:05.290 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:16:05.290 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:05.290 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:05.290 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:05.290 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:05.290 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:05.291 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:16:05.291 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:16:05.291 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:05.291 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:05.291 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:05.291 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:05.291 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:16:05.291 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:05.291 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:05.291 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:05.291 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:05.291 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:16:05.291 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:05.291 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:05.291 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:05.292 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:05.292 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:16:05.292 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:16:05.292 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:05.292 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:05.292 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:05.292 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:05.292 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:05.292 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:05.292 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:16:05.292 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:16:05.292 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:05.292 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:05.292 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:05.292 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:16:05.293 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:05.293 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:05.293 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:16:05.293 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:05.293 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:05.293 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:05.293 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:16:05.293 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:05.293 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:05.293 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:05.293 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:16:05.293 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:16:05.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.272+0000 7f8e65c00640 1 -- 172.21.15.90:0/1307971815 reap_dead start 2024-09-21T03:16:05.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.273+0000 7f8e66600640 1 -- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8e40078bc0 msgr2=0x7f8e4007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:05.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.273+0000 7f8e66600640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8e40078bc0 0x7f8e4007b0d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8e580012e0 tx=0x7f8e58009040 comp rx=0 tx=0).stop 2024-09-21T03:16:05.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.273+0000 7f8e66600640 1 -- 172.21.15.90:0/1307971815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e600c7120 msgr2=0x7f8e601f02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:05.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.273+0000 7f8e66600640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e600c7120 0x7f8e601f02c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400d980 tx=0x7f8e5400de40 comp rx=0 tx=0).stop 2024-09-21T03:16:05.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.273+0000 7f8e66600640 1 -- 172.21.15.90:0/1307971815 shutdown_connections 2024-09-21T03:16:05.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.273+0000 7f8e66600640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8e40078bc0 0x7f8e4007b0d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:05.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.273+0000 7f8e66600640 1 --2- 172.21.15.90:0/1307971815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e600c7120 0x7f8e601f02c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:05.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.273+0000 7f8e66600640 1 -- 172.21.15.90:0/1307971815 >> 172.21.15.90:0/1307971815 conn(0x7f8e600cc270 msgr2=0x7f8e60156360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:05.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.273+0000 7f8e66600640 1 -- 172.21.15.90:0/1307971815 shutdown_connections 2024-09-21T03:16:05.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.273+0000 7f8e66600640 1 -- 172.21.15.90:0/1307971815 wait complete. 2024-09-21T03:16:05.309 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:16:05.309 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-21T03:16:05.309 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-21T03:16:05.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.561+0000 7fa899400640 1 -- 172.21.15.90:0/3700314142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa89406db70 msgr2=0x7fa894153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:05.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.561+0000 7fa899400640 1 --2- 172.21.15.90:0/3700314142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa89406db70 0x7fa894153ff0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa88c005fd0 tx=0x7fa88c02aaa0 comp rx=0 tx=0).stop 2024-09-21T03:16:05.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.562+0000 7fa899400640 1 -- 172.21.15.90:0/3700314142 shutdown_connections 2024-09-21T03:16:05.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.562+0000 7fa899400640 1 --2- 172.21.15.90:0/3700314142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa89406db70 0x7fa894153ff0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:05.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.562+0000 7fa899400640 1 --2- 172.21.15.90:0/3700314142 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa89406e5f0 0x7fa89415ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:05.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.562+0000 7fa899400640 1 -- 172.21.15.90:0/3700314142 >> 172.21.15.90:0/3700314142 conn(0x7fa8940ccda0 msgr2=0x7fa8940c8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:05.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.562+0000 7fa899400640 1 -- 172.21.15.90:0/3700314142 shutdown_connections 2024-09-21T03:16:05.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.562+0000 7fa899400640 1 -- 172.21.15.90:0/3700314142 wait complete. 2024-09-21T03:16:05.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.565+0000 7fa899400640 1 Processor -- start 2024-09-21T03:16:05.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.566+0000 7fa899400640 1 -- start start 2024-09-21T03:16:05.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.568+0000 7fa899400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa89406db70 0x7fa8940af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:05.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.568+0000 7fa899400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa89406e5f0 0x7fa8940b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:05.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.568+0000 7fa899400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8940c7fe0 0x7fa8941464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:05.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.568+0000 7fa899400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8940c83f0 con 0x7fa89406e5f0 2024-09-21T03:16:05.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.568+0000 7fa899400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa8940c77e0 con 0x7fa89406db70 2024-09-21T03:16:05.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.568+0000 7fa899400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa8940c8570 con 0x7fa8940c7fe0 2024-09-21T03:16:05.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.568+0000 7fa893e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa89406db70 0x7fa8940af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:05.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.568+0000 7fa893400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa89406e5f0 0x7fa8940b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:05.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.568+0000 7fa898a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8940c7fe0 0x7fa8941464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:05.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.568+0000 7fa893e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa89406db70 0x7fa8940af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:44754/0 (socket says 172.21.15.90:44754) 2024-09-21T03:16:05.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.568+0000 7fa893e00640 1 -- 172.21.15.90:0/2479630877 learned_addr learned my addr 172.21.15.90:0/2479630877 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:16:05.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.569+0000 7fa893e00640 1 -- 172.21.15.90:0/2479630877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8940c7fe0 msgr2=0x7fa8941464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:05.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.569+0000 7fa893e00640 1 --2- 172.21.15.90:0/2479630877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8940c7fe0 0x7fa8941464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:05.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.569+0000 7fa893e00640 1 -- 172.21.15.90:0/2479630877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa89406e5f0 msgr2=0x7fa8940b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:05.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.569+0000 7fa893e00640 1 --2- 172.21.15.90:0/2479630877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa89406e5f0 0x7fa8940b1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:05.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.569+0000 7fa893e00640 1 -- 172.21.15.90:0/2479630877 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8940af7b0 con 0x7fa89406db70 2024-09-21T03:16:05.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.569+0000 7fa898a00640 1 --2- 172.21.15.90:0/2479630877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8940c7fe0 0x7fa8941464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:16:05.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.569+0000 7fa893e00640 1 --2- 172.21.15.90:0/2479630877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa89406db70 0x7fa8940af270 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa88400e790 tx=0x7fa88400ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:05.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.570+0000 7fa88be00640 1 -- 172.21.15.90:0/2479630877 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88400eea0 con 0x7fa89406db70 2024-09-21T03:16:05.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.570+0000 7fa88be00640 1 -- 172.21.15.90:0/2479630877 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa88400cdb0 con 0x7fa89406db70 2024-09-21T03:16:05.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.570+0000 7fa899400640 1 -- 172.21.15.90:0/2479630877 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8940ac650 con 0x7fa89406db70 2024-09-21T03:16:05.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.570+0000 7fa88be00640 1 -- 172.21.15.90:0/2479630877 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa884010690 con 0x7fa89406db70 2024-09-21T03:16:05.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.570+0000 7fa899400640 1 -- 172.21.15.90:0/2479630877 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8940acc10 con 0x7fa89406db70 2024-09-21T03:16:05.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.572+0000 7fa899400640 1 -- 172.21.15.90:0/2479630877 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa89415ab90 con 0x7fa89406db70 2024-09-21T03:16:05.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.574+0000 7fa88be00640 1 -- 172.21.15.90:0/2479630877 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa884010830 con 0x7fa89406db70 2024-09-21T03:16:05.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.575+0000 7fa88be00640 1 --2- 172.21.15.90:0/2479630877 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa874078b90 0x7fa87407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:05.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.575+0000 7fa88be00640 1 -- 172.21.15.90:0/2479630877 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fa88409b9d0 con 0x7fa89406db70 2024-09-21T03:16:05.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.576+0000 7fa893400640 1 --2- 172.21.15.90:0/2479630877 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa874078b90 0x7fa87407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:05.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.576+0000 7fa893400640 1 --2- 172.21.15.90:0/2479630877 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa874078b90 0x7fa87407b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa8941579a0 tx=0x7fa880009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:05.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:05.580+0000 7fa88be00640 1 -- 172.21.15.90:0/2479630877 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa884063480 con 0x7fa89406db70 2024-09-21T03:16:06.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:06.116+0000 7fa899400640 1 -- 172.21.15.90:0/2479630877 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fa8940cbb80 con 0x7fa89406db70 2024-09-21T03:16:06.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:06.118+0000 7fa88be00640 1 -- 172.21.15.90:0/2479630877 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fa884067eb0 con 0x7fa89406db70 2024-09-21T03:16:06.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:06.121+0000 7fa899400640 1 -- 172.21.15.90:0/2479630877 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa874078b90 msgr2=0x7fa87407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:06.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:06.121+0000 7fa899400640 1 --2- 172.21.15.90:0/2479630877 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa874078b90 0x7fa87407b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa8941579a0 tx=0x7fa880009040 comp rx=0 tx=0).stop 2024-09-21T03:16:06.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:06.121+0000 7fa899400640 1 -- 172.21.15.90:0/2479630877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa89406db70 msgr2=0x7fa8940af270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:06.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:06.121+0000 7fa899400640 1 --2- 172.21.15.90:0/2479630877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa89406db70 0x7fa8940af270 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa88400e790 tx=0x7fa88400ec50 comp rx=0 tx=0).stop 2024-09-21T03:16:06.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:06.121+0000 7fa899400640 1 -- 172.21.15.90:0/2479630877 shutdown_connections 2024-09-21T03:16:06.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:06.121+0000 7fa899400640 1 --2- 172.21.15.90:0/2479630877 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa874078b90 0x7fa87407b0a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:06.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:06.121+0000 7fa899400640 1 --2- 172.21.15.90:0/2479630877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8940c7fe0 0x7fa8941464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:06.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:06.121+0000 7fa899400640 1 --2- 172.21.15.90:0/2479630877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa89406e5f0 0x7fa8940b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:06.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:06.121+0000 7fa899400640 1 --2- 172.21.15.90:0/2479630877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa89406db70 0x7fa8940af270 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:06.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:06.121+0000 7fa899400640 1 -- 172.21.15.90:0/2479630877 >> 172.21.15.90:0/2479630877 conn(0x7fa8940ccda0 msgr2=0x7fa8940caa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:06.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:06.122+0000 7fa899400640 1 -- 172.21.15.90:0/2479630877 shutdown_connections 2024-09-21T03:16:06.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:06.122+0000 7fa899400640 1 -- 172.21.15.90:0/2479630877 wait complete. 2024-09-21T03:16:06.159 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-21T03:16:16.160 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-21T03:16:16.160 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:16:16.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.398+0000 7f607de00640 1 -- 172.21.15.90:0/3608721257 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f607814d4e0 msgr2=0x7f60780c5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:16.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.398+0000 7f607de00640 1 --2- 172.21.15.90:0/3608721257 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f607814d4e0 0x7f60780c5020 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6064005fd0 tx=0x7f606402a4b0 comp rx=0 tx=0).stop 2024-09-21T03:16:16.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.398+0000 7f607de00640 1 -- 172.21.15.90:0/3608721257 shutdown_connections 2024-09-21T03:16:16.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.398+0000 7f607de00640 1 --2- 172.21.15.90:0/3608721257 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f607814d4e0 0x7f60780c5020 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:16.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.398+0000 7f607de00640 1 --2- 172.21.15.90:0/3608721257 >> v2:172.21.15.149:3300/0 conn(0x7f60780c44f0 0x7f60781576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:16.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.398+0000 7f607de00640 1 -- 172.21.15.90:0/3608721257 >> 172.21.15.90:0/3608721257 conn(0x7f60780c84c0 msgr2=0x7f60780c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:16.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.398+0000 7f607de00640 1 -- 172.21.15.90:0/3608721257 shutdown_connections 2024-09-21T03:16:16.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.399+0000 7f607de00640 1 -- 172.21.15.90:0/3608721257 wait complete. 2024-09-21T03:16:16.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.401+0000 7f607de00640 1 Processor -- start 2024-09-21T03:16:16.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.401+0000 7f607de00640 1 -- start start 2024-09-21T03:16:16.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.402+0000 7f607de00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60780c44f0 0x7f607806cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:16.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.402+0000 7f607de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f607814d4e0 0x7f60781f06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:16.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.402+0000 7f607de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f607814d8f0 0x7f6078147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:16.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.402+0000 7f607de00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f607815b120 con 0x7f60780c44f0 2024-09-21T03:16:16.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.402+0000 7f607de00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f607815afa0 con 0x7f607814d8f0 2024-09-21T03:16:16.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.402+0000 7f607de00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f607806ea40 con 0x7f607814d4e0 2024-09-21T03:16:16.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.402+0000 7f607ca00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60780c44f0 0x7f607806cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:16.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.403+0000 7f607ca00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60780c44f0 0x7f607806cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53748/0 (socket says 172.21.15.90:53748) 2024-09-21T03:16:16.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.403+0000 7f607ca00640 1 -- 172.21.15.90:0/182813179 learned_addr learned my addr 172.21.15.90:0/182813179 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:16:16.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.403+0000 7f607d400640 1 --2- 172.21.15.90:0/182813179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f607814d8f0 0x7f6078147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:16.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.403+0000 7f6077e00640 1 --2- 172.21.15.90:0/182813179 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f607814d4e0 0x7f60781f06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:16.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.403+0000 7f607ca00640 1 -- 172.21.15.90:0/182813179 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f607814d4e0 msgr2=0x7f60781f06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:16.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.403+0000 7f607ca00640 1 --2- 172.21.15.90:0/182813179 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f607814d4e0 0x7f60781f06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:16.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.403+0000 7f607ca00640 1 -- 172.21.15.90:0/182813179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f607814d8f0 msgr2=0x7f6078147c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:16.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.403+0000 7f607ca00640 1 --2- 172.21.15.90:0/182813179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f607814d8f0 0x7f6078147c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:16.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.403+0000 7f607ca00640 1 -- 172.21.15.90:0/182813179 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60781548c0 con 0x7f60780c44f0 2024-09-21T03:16:16.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.403+0000 7f6077e00640 1 --2- 172.21.15.90:0/182813179 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f607814d4e0 0x7f60781f06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:16:16.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.403+0000 7f607ca00640 1 --2- 172.21.15.90:0/182813179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60780c44f0 0x7f607806cfc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f606c00e9f0 tx=0x7f606c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:16.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.404+0000 7f6074c00640 1 -- 172.21.15.90:0/182813179 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c00cd80 con 0x7f60780c44f0 2024-09-21T03:16:16.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.404+0000 7f6074c00640 1 -- 172.21.15.90:0/182813179 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f606c004020 con 0x7f60780c44f0 2024-09-21T03:16:16.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.404+0000 7f607de00640 1 -- 172.21.15.90:0/182813179 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6078072950 con 0x7f60780c44f0 2024-09-21T03:16:16.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.404+0000 7f6074c00640 1 -- 172.21.15.90:0/182813179 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c004470 con 0x7f60780c44f0 2024-09-21T03:16:16.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.404+0000 7f607de00640 1 -- 172.21.15.90:0/182813179 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60780c7020 con 0x7f60780c44f0 2024-09-21T03:16:16.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.405+0000 7f607de00640 1 -- 172.21.15.90:0/182813179 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60781576d0 con 0x7f60780c44f0 2024-09-21T03:16:16.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.408+0000 7f6074c00640 1 -- 172.21.15.90:0/182813179 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f606c0035f0 con 0x7f60780c44f0 2024-09-21T03:16:16.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.410+0000 7f6074c00640 1 --2- 172.21.15.90:0/182813179 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6058078bc0 0x7f605807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:16.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.410+0000 7f6074c00640 1 -- 172.21.15.90:0/182813179 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f606c09bdf0 con 0x7f60780c44f0 2024-09-21T03:16:16.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.410+0000 7f6077e00640 1 --2- 172.21.15.90:0/182813179 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6058078bc0 0x7f605807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:16.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.411+0000 7f6077e00640 1 --2- 172.21.15.90:0/182813179 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6058078bc0 0x7f605807b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6064033000 tx=0x7f6064004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:16.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.413+0000 7f6074c00640 1 -- 172.21.15.90:0/182813179 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f60781548c0 con 0x7f60780c44f0 2024-09-21T03:16:16.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.678+0000 7f607de00640 1 -- 172.21.15.90:0/182813179 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f607814d280 con 0x7f60780c44f0 2024-09-21T03:16:16.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.679+0000 7f6074c00640 1 -- 172.21.15.90:0/182813179 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f606c063f70 con 0x7f60780c44f0 2024-09-21T03:16:16.681 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:16:16.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.681+0000 7f607de00640 1 -- 172.21.15.90:0/182813179 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6058078bc0 msgr2=0x7f605807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:16.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.681+0000 7f607de00640 1 --2- 172.21.15.90:0/182813179 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6058078bc0 0x7f605807b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6064033000 tx=0x7f6064004730 comp rx=0 tx=0).stop 2024-09-21T03:16:16.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.681+0000 7f607de00640 1 -- 172.21.15.90:0/182813179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60780c44f0 msgr2=0x7f607806cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:16.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.681+0000 7f607de00640 1 --2- 172.21.15.90:0/182813179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60780c44f0 0x7f607806cfc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f606c00e9f0 tx=0x7f606c00eeb0 comp rx=0 tx=0).stop 2024-09-21T03:16:16.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.682+0000 7f607de00640 1 -- 172.21.15.90:0/182813179 shutdown_connections 2024-09-21T03:16:16.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.682+0000 7f607de00640 1 --2- 172.21.15.90:0/182813179 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6058078bc0 0x7f605807b0d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:16.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.682+0000 7f607de00640 1 --2- 172.21.15.90:0/182813179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f607814d8f0 0x7f6078147c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:16.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.682+0000 7f607de00640 1 --2- 172.21.15.90:0/182813179 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f607814d4e0 0x7f60781f06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:16.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.682+0000 7f607de00640 1 --2- 172.21.15.90:0/182813179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60780c44f0 0x7f607806cfc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:16.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.682+0000 7f607de00640 1 -- 172.21.15.90:0/182813179 >> 172.21.15.90:0/182813179 conn(0x7f60780c84c0 msgr2=0x7f60780764d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:16.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.682+0000 7f607de00640 1 -- 172.21.15.90:0/182813179 shutdown_connections 2024-09-21T03:16:16.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.682+0000 7f607de00640 1 -- 172.21.15.90:0/182813179 wait complete. 2024-09-21T03:16:16.707 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-21T03:16:16.707 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-21T03:16:16.707 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-21T03:16:16.707 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:16:16.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.996+0000 7f42d5a00640 1 -- 172.21.15.90:0/2563124516 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42d0157010 msgr2=0x7f42d0161450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:16.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.996+0000 7f42d5a00640 1 --2- 172.21.15.90:0/2563124516 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42d0157010 0x7f42d0161450 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f42c8005fd0 tx=0x7f42c802a820 comp rx=0 tx=0).stop 2024-09-21T03:16:16.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.997+0000 7f42d5a00640 1 -- 172.21.15.90:0/2563124516 shutdown_connections 2024-09-21T03:16:16.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.997+0000 7f42d5a00640 1 --2- 172.21.15.90:0/2563124516 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42d0157010 0x7f42d0161450 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:16.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.997+0000 7f42d5a00640 1 --2- 172.21.15.90:0/2563124516 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42d0154070 0x7f42d0156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:16.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.997+0000 7f42d5a00640 1 -- 172.21.15.90:0/2563124516 >> 172.21.15.90:0/2563124516 conn(0x7f42d00cc270 msgr2=0x7f42d00cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:16.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.997+0000 7f42d5a00640 1 -- 172.21.15.90:0/2563124516 shutdown_connections 2024-09-21T03:16:16.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:16.997+0000 7f42d5a00640 1 -- 172.21.15.90:0/2563124516 wait complete. 2024-09-21T03:16:17.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.000+0000 7f42d5a00640 1 Processor -- start 2024-09-21T03:16:17.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.000+0000 7f42d5a00640 1 -- start start 2024-09-21T03:16:17.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.002+0000 7f42d5a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42d00c7120 0x7f42d0159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:17.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.002+0000 7f42d5a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42d0154070 0x7f42d0155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:17.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.003+0000 7f42d5a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d0157010 0x7f42d01560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:17.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.003+0000 7f42d5a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f42d00cba00 con 0x7f42d0157010 2024-09-21T03:16:17.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.003+0000 7f42d5a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f42d00cb720 con 0x7f42d00c7120 2024-09-21T03:16:17.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.003+0000 7f42d5a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f42d0154680 con 0x7f42d0154070 2024-09-21T03:16:17.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.003+0000 7f42cf400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42d0154070 0x7f42d0155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:17.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.003+0000 7f42d5000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d0157010 0x7f42d01560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:17.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.003+0000 7f42cf400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42d0154070 0x7f42d0155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:39086/0 (socket says 172.21.15.90:39086) 2024-09-21T03:16:17.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.003+0000 7f42cf400640 1 -- 172.21.15.90:0/3015257673 learned_addr learned my addr 172.21.15.90:0/3015257673 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:16:17.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.003+0000 7f42cfe00640 1 --2- 172.21.15.90:0/3015257673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42d00c7120 0x7f42d0159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:17.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.004+0000 7f42cf400640 1 -- 172.21.15.90:0/3015257673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42d00c7120 msgr2=0x7f42d0159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:17.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.004+0000 7f42cf400640 1 --2- 172.21.15.90:0/3015257673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42d00c7120 0x7f42d0159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:17.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.004+0000 7f42cf400640 1 -- 172.21.15.90:0/3015257673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d0157010 msgr2=0x7f42d01560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:17.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.004+0000 7f42cf400640 1 --2- 172.21.15.90:0/3015257673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d0157010 0x7f42d01560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:17.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.004+0000 7f42cf400640 1 -- 172.21.15.90:0/3015257673 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d01e18e0 con 0x7f42d0154070 2024-09-21T03:16:17.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.004+0000 7f42d5000640 1 --2- 172.21.15.90:0/3015257673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d0157010 0x7f42d01560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:16:17.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.004+0000 7f42cf400640 1 --2- 172.21.15.90:0/3015257673 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42d0154070 0x7f42d0155bb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00ea20 tx=0x7f42bc00eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:17.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.004+0000 7f42c7e00640 1 -- 172.21.15.90:0/3015257673 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc00ce40 con 0x7f42d0154070 2024-09-21T03:16:17.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.004+0000 7f42c7e00640 1 -- 172.21.15.90:0/3015257673 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42bc004020 con 0x7f42d0154070 2024-09-21T03:16:17.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.004+0000 7f42d5a00640 1 -- 172.21.15.90:0/3015257673 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d0157f60 con 0x7f42d0154070 2024-09-21T03:16:17.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.005+0000 7f42c7e00640 1 -- 172.21.15.90:0/3015257673 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc004470 con 0x7f42d0154070 2024-09-21T03:16:17.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.005+0000 7f42d5a00640 1 -- 172.21.15.90:0/3015257673 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d01eaba0 con 0x7f42d0154070 2024-09-21T03:16:17.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.006+0000 7f42d5a00640 1 --2- 172.21.15.90:0/3015257673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d0159d90 0x7f42d01f0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:17.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.006+0000 7f42d5a00640 1 -- 172.21.15.90:0/3015257673 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f42d015a530 con 0x7f42d0159d90 2024-09-21T03:16:17.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.006+0000 7f42cfe00640 1 --2- 172.21.15.90:0/3015257673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d0159d90 0x7f42d01f0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:17.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.007+0000 7f42cfe00640 1 -- 172.21.15.90:0/3015257673 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42d0157420 con 0x7f42d0159d90 2024-09-21T03:16:17.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.007+0000 7f42cfe00640 1 --2- 172.21.15.90:0/3015257673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d0159d90 0x7f42d01f0590 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f42c00013f0 tx=0x7f42c000fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:17.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.007+0000 7f42c7e00640 1 -- 172.21.15.90:0/3015257673 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0018020 con 0x7f42d0159d90 2024-09-21T03:16:17.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.008+0000 7f42c7e00640 1 -- 172.21.15.90:0/3015257673 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f42c000d630 con 0x7f42d0159d90 2024-09-21T03:16:17.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.008+0000 7f42c7e00640 1 -- 172.21.15.90:0/3015257673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d0159d90 msgr2=0x7f42d01f0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:17.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.008+0000 7f42c7e00640 1 --2- 172.21.15.90:0/3015257673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d0159d90 0x7f42d01f0590 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f42c00013f0 tx=0x7f42c000fc00 comp rx=0 tx=0).stop 2024-09-21T03:16:17.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.008+0000 7f42c7e00640 1 -- 172.21.15.90:0/3015257673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d0159d90 msgr2=0x7f42d01f0590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:16:17.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.008+0000 7f42c7e00640 1 --2- 172.21.15.90:0/3015257673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d0159d90 0x7f42d01f0590 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:17.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.009+0000 7f42c7e00640 1 -- 172.21.15.90:0/3015257673 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f42bc0035f0 con 0x7f42d0154070 2024-09-21T03:16:17.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.010+0000 7f42c7e00640 1 --2- 172.21.15.90:0/3015257673 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f42b0078600 0x7f42b007ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:17.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.010+0000 7f42c7e00640 1 -- 172.21.15.90:0/3015257673 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f42bc09b850 con 0x7f42d0154070 2024-09-21T03:16:17.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.010+0000 7f42cfe00640 1 --2- 172.21.15.90:0/3015257673 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f42b0078600 0x7f42b007ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:17.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.011+0000 7f42cfe00640 1 --2- 172.21.15.90:0/3015257673 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f42b0078600 0x7f42b007ab10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f42d006a390 tx=0x7f42c0009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:17.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.020+0000 7f42d5a00640 1 --2- 172.21.15.90:0/3015257673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d01f0ad0 0x7f42d01f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:17.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.020+0000 7f42d5a00640 1 -- 172.21.15.90:0/3015257673 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f42d01f1420 con 0x7f42d01f0ad0 2024-09-21T03:16:17.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.021+0000 7f42d5000640 1 --2- 172.21.15.90:0/3015257673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d01f0ad0 0x7f42d01f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:17.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.021+0000 7f42d5000640 1 -- 172.21.15.90:0/3015257673 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f42d00ca2b0 con 0x7f42d01f0ad0 2024-09-21T03:16:17.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.022+0000 7f42d5000640 1 --2- 172.21.15.90:0/3015257673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d01f0ad0 0x7f42d01f0ee0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f42d008df10 tx=0x7f42c80048e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:17.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.022+0000 7f42c7e00640 1 -- 172.21.15.90:0/3015257673 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8042070 con 0x7f42d01f0ad0 2024-09-21T03:16:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.022+0000 7f42c7e00640 1 -- 172.21.15.90:0/3015257673 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4886 (secure 0 0 0) 0x7f42c8009800 con 0x7f42d01f0ad0 2024-09-21T03:16:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.023+0000 7f42c7e00640 1 -- 172.21.15.90:0/3015257673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d01f0ad0 msgr2=0x7f42d01f0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.023+0000 7f42c7e00640 1 --2- 172.21.15.90:0/3015257673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d01f0ad0 0x7f42d01f0ee0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f42d008df10 tx=0x7f42c80048e0 comp rx=0 tx=0).stop 2024-09-21T03:16:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.023+0000 7f42c7e00640 1 -- 172.21.15.90:0/3015257673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d01f0ad0 msgr2=0x7f42d01f0ee0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:16:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.023+0000 7f42c7e00640 1 --2- 172.21.15.90:0/3015257673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d01f0ad0 0x7f42d01f0ee0 secure :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f42d008df10 tx=0x7f42c80048e0 comp rx=0 tx=0).stop 2024-09-21T03:16:17.025 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:16:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:16:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:16:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:16:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 10, 2024-09-21T03:16:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 127737, 2024-09-21T03:16:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:16:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:16:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:16:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:16:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 16, 2024-09-21T03:16:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:16:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:16:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:16:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:16:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:16:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:16:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:16:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:16:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:16:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:16:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:16:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:16:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:16:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:16:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:16:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:16:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:16:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:16:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:16:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:16:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:16:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:16:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:16:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:16:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:16:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:16:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:16:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:16:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:16:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:16:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:16:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:16:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:16:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:16:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:16:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:16:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:16:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:16:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:16:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:16:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:16:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:16:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:16:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:16:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:16:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:16:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 3 2024-09-21T03:16:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:16:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6 2024-09-21T03:16:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:16:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:16:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:16:17.037 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:16:17.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.023+0000 7f42d5a00640 1 -- 172.21.15.90:0/3015257673 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f42b0078600 msgr2=0x7f42b007ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:17.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.023+0000 7f42d5a00640 1 --2- 172.21.15.90:0/3015257673 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f42b0078600 0x7f42b007ab10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f42d006a390 tx=0x7f42c0009030 comp rx=0 tx=0).stop 2024-09-21T03:16:17.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.023+0000 7f42d5a00640 1 -- 172.21.15.90:0/3015257673 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42d0154070 msgr2=0x7f42d0155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:17.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.023+0000 7f42d5a00640 1 --2- 172.21.15.90:0/3015257673 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42d0154070 0x7f42d0155bb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00ea20 tx=0x7f42bc00eee0 comp rx=0 tx=0).stop 2024-09-21T03:16:17.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.023+0000 7f42d5000640 1 -- 172.21.15.90:0/3015257673 reap_dead start 2024-09-21T03:16:17.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.023+0000 7f42d5a00640 1 -- 172.21.15.90:0/3015257673 shutdown_connections 2024-09-21T03:16:17.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.023+0000 7f42d5a00640 1 -- 172.21.15.90:0/3015257673 >> 172.21.15.90:0/3015257673 conn(0x7f42d00cc270 msgr2=0x7f42d01533d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:17.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.023+0000 7f42d5a00640 1 -- 172.21.15.90:0/3015257673 shutdown_connections 2024-09-21T03:16:17.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.024+0000 7f42d5a00640 1 -- 172.21.15.90:0/3015257673 wait complete. 2024-09-21T03:16:17.063 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:16:17.063 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-21T03:16:17.063 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:16:17.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.439+0000 7f60e9200640 1 -- 172.21.15.90:0/4186711459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60e40c7120 msgr2=0x7f60e4154070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:17.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.439+0000 7f60e9200640 1 --2- 172.21.15.90:0/4186711459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60e40c7120 0x7f60e4154070 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f60d4005fd0 tx=0x7f60d402a540 comp rx=0 tx=0).stop 2024-09-21T03:16:17.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.439+0000 7f60e9200640 1 -- 172.21.15.90:0/4186711459 shutdown_connections 2024-09-21T03:16:17.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.439+0000 7f60e9200640 1 --2- 172.21.15.90:0/4186711459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60e40c9060 0x7f60e41571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:17.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.439+0000 7f60e9200640 1 --2- 172.21.15.90:0/4186711459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60e40c7120 0x7f60e4154070 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:17.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.439+0000 7f60e9200640 1 -- 172.21.15.90:0/4186711459 >> 172.21.15.90:0/4186711459 conn(0x7f60e40cc270 msgr2=0x7f60e40cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:17.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.440+0000 7f60e9200640 1 -- 172.21.15.90:0/4186711459 shutdown_connections 2024-09-21T03:16:17.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.440+0000 7f60e9200640 1 -- 172.21.15.90:0/4186711459 wait complete. 2024-09-21T03:16:17.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.443+0000 7f60e9200640 1 Processor -- start 2024-09-21T03:16:17.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.443+0000 7f60e9200640 1 -- start start 2024-09-21T03:16:17.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.445+0000 7f60e9200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60e40c7120 0x7f60e4152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:17.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.445+0000 7f60e9200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60e40c8c50 0x7f60e4155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:17.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.445+0000 7f60e9200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40c9060 0x7f60e414ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:17.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.445+0000 7f60e9200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f60e40cb720 con 0x7f60e40c8c50 2024-09-21T03:16:17.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.445+0000 7f60e9200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f60e40cb440 con 0x7f60e40c9060 2024-09-21T03:16:17.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.445+0000 7f60e9200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f60e40cba00 con 0x7f60e40c7120 2024-09-21T03:16:17.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.446+0000 7f60e2a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60e40c8c50 0x7f60e4155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:17.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.446+0000 7f60e3e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40c9060 0x7f60e414ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:17.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.446+0000 7f60e3400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60e40c7120 0x7f60e4152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:17.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.446+0000 7f60e3e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40c9060 0x7f60e414ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:57434/0 (socket says 172.21.15.90:57434) 2024-09-21T03:16:17.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.446+0000 7f60e3e00640 1 -- 172.21.15.90:0/3395714570 learned_addr learned my addr 172.21.15.90:0/3395714570 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:16:17.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.446+0000 7f60e2a00640 1 -- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60e40c7120 msgr2=0x7f60e4152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:17.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.446+0000 7f60e2a00640 1 --2- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60e40c7120 0x7f60e4152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:17.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.446+0000 7f60e2a00640 1 -- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40c9060 msgr2=0x7f60e414ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:17.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.446+0000 7f60e2a00640 1 --2- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40c9060 0x7f60e414ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:17.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.446+0000 7f60e2a00640 1 -- 172.21.15.90:0/3395714570 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e414b5d0 con 0x7f60e40c8c50 2024-09-21T03:16:17.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.446+0000 7f60e3e00640 1 --2- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e40c9060 0x7f60e414ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:16:17.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.447+0000 7f60e2a00640 1 --2- 172.21.15.90:0/3395714570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60e40c8c50 0x7f60e4155990 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f60d000c3f0 tx=0x7f60d000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:17.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.447+0000 7f60db400640 1 -- 172.21.15.90:0/3395714570 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d0017070 con 0x7f60e40c8c50 2024-09-21T03:16:17.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.447+0000 7f60db400640 1 -- 172.21.15.90:0/3395714570 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60d00053c0 con 0x7f60e40c8c50 2024-09-21T03:16:17.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.447+0000 7f60db400640 1 -- 172.21.15.90:0/3395714570 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d0003850 con 0x7f60e40c8c50 2024-09-21T03:16:17.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.447+0000 7f60e9200640 1 -- 172.21.15.90:0/3395714570 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e41ecd00 con 0x7f60e40c8c50 2024-09-21T03:16:17.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.447+0000 7f60e9200640 1 -- 172.21.15.90:0/3395714570 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e41ed2c0 con 0x7f60e40c8c50 2024-09-21T03:16:17.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.449+0000 7f60e9200640 1 --2- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e41ed4c0 0x7f60e41effa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:17.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.449+0000 7f60e9200640 1 -- 172.21.15.90:0/3395714570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f60e41566b0 con 0x7f60e41ed4c0 2024-09-21T03:16:17.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.449+0000 7f60e3400640 1 --2- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e41ed4c0 0x7f60e41effa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:17.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.450+0000 7f60e3400640 1 -- 172.21.15.90:0/3395714570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f60e414b840 con 0x7f60e41ed4c0 2024-09-21T03:16:17.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.450+0000 7f60e3400640 1 --2- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e41ed4c0 0x7f60e41effa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f60e415b080 tx=0x7f60d4004530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:17.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.451+0000 7f60db400640 1 -- 172.21.15.90:0/3395714570 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d4040070 con 0x7f60e41ed4c0 2024-09-21T03:16:17.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.451+0000 7f60db400640 1 -- 172.21.15.90:0/3395714570 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f60d4003b40 con 0x7f60e41ed4c0 2024-09-21T03:16:17.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.451+0000 7f60db400640 1 -- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e41ed4c0 msgr2=0x7f60e41effa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:17.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.451+0000 7f60db400640 1 --2- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e41ed4c0 0x7f60e41effa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f60e415b080 tx=0x7f60d4004530 comp rx=0 tx=0).stop 2024-09-21T03:16:17.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.451+0000 7f60db400640 1 -- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e41ed4c0 msgr2=0x7f60e41effa0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:16:17.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.451+0000 7f60db400640 1 --2- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e41ed4c0 0x7f60e41effa0 secure :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f60e415b080 tx=0x7f60d4004530 comp rx=0 tx=0).stop 2024-09-21T03:16:17.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.452+0000 7f60db400640 1 -- 172.21.15.90:0/3395714570 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f60d001a070 con 0x7f60e40c8c50 2024-09-21T03:16:17.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.454+0000 7f60db400640 1 --2- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f60c40786f0 0x7f60c407ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:17.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.454+0000 7f60db400640 1 -- 172.21.15.90:0/3395714570 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f60d009a220 con 0x7f60e40c8c50 2024-09-21T03:16:17.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.455+0000 7f60e3400640 1 --2- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f60c40786f0 0x7f60c407ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:17.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.456+0000 7f60e3400640 1 --2- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f60c40786f0 0x7f60c407ac00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f60e40c9a90 tx=0x7f60d403f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:17.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.458+0000 7f60e9200640 1 --2- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e414bb20 0x7f60e41f04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:17.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.458+0000 7f60e9200640 1 -- 172.21.15.90:0/3395714570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f60e40c8840 con 0x7f60e414bb20 2024-09-21T03:16:17.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.458+0000 7f60e3e00640 1 --2- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e414bb20 0x7f60e41f04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:17.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.459+0000 7f60e3e00640 1 -- 172.21.15.90:0/3395714570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f60e40ca2b0 con 0x7f60e414bb20 2024-09-21T03:16:17.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.459+0000 7f60e3e00640 1 --2- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e414bb20 0x7f60e41f04e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00f3e0 tx=0x7f60dc00f8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:17.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.460+0000 7f60db400640 1 -- 172.21.15.90:0/3395714570 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc00e740 con 0x7f60e414bb20 2024-09-21T03:16:17.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.460+0000 7f60db400640 1 -- 172.21.15.90:0/3395714570 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5194 (secure 0 0 0) 0x7f60dc00e740 con 0x7f60e414bb20 2024-09-21T03:16:17.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.460+0000 7f60db400640 1 -- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e414bb20 msgr2=0x7f60e41f04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:17.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.460+0000 7f60db400640 1 --2- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e414bb20 0x7f60e41f04e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00f3e0 tx=0x7f60dc00f8a0 comp rx=0 tx=0).stop 2024-09-21T03:16:17.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.460+0000 7f60db400640 1 -- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e414bb20 msgr2=0x7f60e41f04e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:16:17.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.460+0000 7f60db400640 1 --2- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e414bb20 0x7f60e41f04e0 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00f3e0 tx=0x7f60dc00f8a0 comp rx=0 tx=0).stop 2024-09-21T03:16:17.462 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:16:17.462 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:16:17.463 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:16:17.463 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:16:17.463 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 10, 2024-09-21T03:16:17.463 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 128249, 2024-09-21T03:16:17.463 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:16:17.463 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:16:17.463 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:16:17.463 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:16:17.463 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:17.463 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 17, 2024-09-21T03:16:17.463 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:16:17.463 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:16:17.463 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:16:17.464 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:17.464 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:17.464 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:17.464 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:17.464 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:17.464 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:17.464 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:17.464 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:17.464 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:17.464 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:17.464 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:17.464 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:17.464 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:16:17.464 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:16:17.464 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:17.465 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:17.465 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:17.465 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:17.465 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:17.465 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:17.465 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:17.465 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:17.465 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:17.465 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:17.465 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:17.465 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:17.465 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.465 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:16:17.466 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:16:17.466 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:16:17.466 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:16:17.466 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:16:17.466 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:16:17.466 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:16:17.466 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:16:17.466 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:16:17.466 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:16:17.466 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:16:17.466 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:16:17.466 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:16:17.466 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:16:17.466 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:16:17.466 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:16:17.467 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:16:17.467 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:17.467 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:17.467 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:17.467 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:17.467 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:17.467 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:17.467 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:17.467 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:17.467 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:17.467 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:17.467 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:17.467 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:17.467 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:16:17.468 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.468 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:16:17.468 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.468 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:16:17.468 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:16:17.468 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:17.468 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:17.468 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.468 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:17.468 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:16:17.468 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:17.468 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.468 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.468 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:17.469 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:16:17.469 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:17.469 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.469 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:17.469 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.469 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:16:17.469 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:16:17.469 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:17.469 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:17.469 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:17.469 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.469 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.469 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:16:17.469 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:16:17.470 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:17.470 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:17.470 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.470 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:17.470 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:16:17.470 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:17.470 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.470 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.470 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:17.470 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:16:17.470 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:17.470 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.470 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:17.470 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.471 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:16:17.471 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:16:17.471 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:17.471 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:17.471 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:17.471 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.471 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:16:17.471 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:16:17.471 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:17.471 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:17.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.471 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:17.471 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:16:17.472 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:17.472 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.472 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.472 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:17.472 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:16:17.472 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:17.472 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.472 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:17.472 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.472 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:16:17.472 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:16:17.472 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:17.472 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:17.472 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:17.472 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.473 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:17.473 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.473 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:16:17.473 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:16:17.473 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.473 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:17.473 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:17.473 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:16:17.473 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.473 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:17.473 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:16:17.473 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.473 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:17.473 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:17.473 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:16:17.474 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.474 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:17.474 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:16:17.474 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.474 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:17.474 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:17.474 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:16:17.474 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.474 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:17.474 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:16:17.474 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.474 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:16:17.474 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:16:17.474 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:16:17.475 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.475 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.475 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:17.475 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:17.475 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5 2024-09-21T03:16:17.475 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.475 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:17.475 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:16:17.475 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.475 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:17.475 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:17.475 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:16:17.475 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.475 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:17.476 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.476 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:16:17.476 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:16:17.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.461+0000 7f60e9200640 1 -- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f60c40786f0 msgr2=0x7f60c407ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:17.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.461+0000 7f60e9200640 1 --2- 172.21.15.90:0/3395714570 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f60c40786f0 0x7f60c407ac00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f60e40c9a90 tx=0x7f60d403f000 comp rx=0 tx=0).stop 2024-09-21T03:16:17.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.461+0000 7f60e9200640 1 -- 172.21.15.90:0/3395714570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60e40c8c50 msgr2=0x7f60e4155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:17.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.461+0000 7f60e9200640 1 --2- 172.21.15.90:0/3395714570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60e40c8c50 0x7f60e4155990 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f60d000c3f0 tx=0x7f60d000c8b0 comp rx=0 tx=0).stop 2024-09-21T03:16:17.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.461+0000 7f60e3e00640 1 -- 172.21.15.90:0/3395714570 reap_dead start 2024-09-21T03:16:17.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.462+0000 7f60e9200640 1 -- 172.21.15.90:0/3395714570 shutdown_connections 2024-09-21T03:16:17.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.462+0000 7f60e9200640 1 -- 172.21.15.90:0/3395714570 >> 172.21.15.90:0/3395714570 conn(0x7f60e40cc270 msgr2=0x7f60e41e2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:17.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.462+0000 7f60e9200640 1 -- 172.21.15.90:0/3395714570 shutdown_connections 2024-09-21T03:16:17.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.462+0000 7f60e9200640 1 -- 172.21.15.90:0/3395714570 wait complete. 2024-09-21T03:16:17.487 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:16:17.487 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-21T03:16:17.487 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:16:17.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.868+0000 7f028be00640 1 -- 172.21.15.90:0/3795090326 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c0c4260 msgr2=0x7f028c0728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:17.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.868+0000 7f028be00640 1 --2- 172.21.15.90:0/3795090326 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c0c4260 0x7f028c0728e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f027c009860 tx=0x7f027c02a3d0 comp rx=0 tx=0).stop 2024-09-21T03:16:17.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.868+0000 7f028be00640 1 -- 172.21.15.90:0/3795090326 shutdown_connections 2024-09-21T03:16:17.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.868+0000 7f028be00640 1 --2- 172.21.15.90:0/3795090326 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c0c4260 0x7f028c0728e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:17.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.868+0000 7f028be00640 1 -- 172.21.15.90:0/3795090326 >> 172.21.15.90:0/3795090326 conn(0x7f028c06d200 msgr2=0x7f028c06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:17.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.868+0000 7f028be00640 1 -- 172.21.15.90:0/3795090326 shutdown_connections 2024-09-21T03:16:17.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.869+0000 7f028be00640 1 -- 172.21.15.90:0/3795090326 wait complete. 2024-09-21T03:16:17.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.871+0000 7f028be00640 1 Processor -- start 2024-09-21T03:16:17.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.871+0000 7f028be00640 1 -- start start 2024-09-21T03:16:17.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.872+0000 7f028be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f028c0c2c40 0x7f028c0bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:17.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.872+0000 7f028be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f028c0c4260 0x7f028c140540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:17.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.872+0000 7f028be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c0c4670 0x7f028c0c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:17.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.872+0000 7f028be00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f028c0c3760 con 0x7f028c0c4260 2024-09-21T03:16:17.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.872+0000 7f028be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f028c154920 con 0x7f028c0c2c40 2024-09-21T03:16:17.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.872+0000 7f028be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f028c0c38e0 con 0x7f028c0c4670 2024-09-21T03:16:17.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.873+0000 7f028a000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f028c0c4260 0x7f028c140540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:17.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.873+0000 7f028aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f028c0c2c40 0x7f028c0bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:17.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.873+0000 7f028b400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c0c4670 0x7f028c0c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:17.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.873+0000 7f028a000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f028c0c4260 0x7f028c140540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53806/0 (socket says 172.21.15.90:53806) 2024-09-21T03:16:17.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.873+0000 7f028a000640 1 -- 172.21.15.90:0/3396459572 learned_addr learned my addr 172.21.15.90:0/3396459572 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:16:17.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.873+0000 7f028a000640 1 -- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c0c4670 msgr2=0x7f028c0c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:17.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.873+0000 7f028a000640 1 --2- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c0c4670 0x7f028c0c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:17.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.873+0000 7f028a000640 1 -- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f028c0c2c40 msgr2=0x7f028c0bdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:17.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.873+0000 7f028a000640 1 --2- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f028c0c2c40 0x7f028c0bdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:17.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.873+0000 7f028a000640 1 -- 172.21.15.90:0/3396459572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f028c0beb30 con 0x7f028c0c4260 2024-09-21T03:16:17.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.873+0000 7f028aa00640 1 --2- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f028c0c2c40 0x7f028c0bdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:16:17.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.874+0000 7f028a000640 1 --2- 172.21.15.90:0/3396459572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f028c0c4260 0x7f028c140540 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f027800c370 tx=0x7f027800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:17.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.874+0000 7f0282a00640 1 -- 172.21.15.90:0/3396459572 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0278011a30 con 0x7f028c0c4260 2024-09-21T03:16:17.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.874+0000 7f0282a00640 1 -- 172.21.15.90:0/3396459572 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0278011cc0 con 0x7f028c0c4260 2024-09-21T03:16:17.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.874+0000 7f0282a00640 1 -- 172.21.15.90:0/3396459572 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0278019650 con 0x7f028c0c4260 2024-09-21T03:16:17.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.874+0000 7f028be00640 1 -- 172.21.15.90:0/3396459572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f028c0c8c00 con 0x7f028c0c4260 2024-09-21T03:16:17.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.874+0000 7f028be00640 1 -- 172.21.15.90:0/3396459572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f028c0c5b90 con 0x7f028c0c4260 2024-09-21T03:16:17.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.876+0000 7f028be00640 1 --2- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c140a80 0x7f028c0c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:17.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.876+0000 7f028be00640 1 -- 172.21.15.90:0/3396459572 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f028c0bd9d0 con 0x7f028c140a80 2024-09-21T03:16:17.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.877+0000 7f028aa00640 1 --2- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c140a80 0x7f028c0c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:17.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.877+0000 7f028aa00640 1 -- 172.21.15.90:0/3396459572 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f028c1632d0 con 0x7f028c140a80 2024-09-21T03:16:17.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.877+0000 7f0282a00640 1 -- 172.21.15.90:0/3396459572 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f02780197f0 con 0x7f028c0c4260 2024-09-21T03:16:17.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.877+0000 7f028aa00640 1 --2- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c140a80 0x7f028c0c8560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f028c0c5b60 tx=0x7f027c003f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:17.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.878+0000 7f0282a00640 1 --2- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f026c078b90 0x7f026c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:17.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.878+0000 7f0282a00640 1 -- 172.21.15.90:0/3396459572 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c03ca40 con 0x7f028c140a80 2024-09-21T03:16:17.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.878+0000 7f0282a00640 1 -- 172.21.15.90:0/3396459572 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f027c03cbe0 con 0x7f028c140a80 2024-09-21T03:16:17.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.878+0000 7f0282a00640 1 -- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c140a80 msgr2=0x7f028c0c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:17.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.878+0000 7f0282a00640 1 --2- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c140a80 0x7f028c0c8560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f028c0c5b60 tx=0x7f027c003f20 comp rx=0 tx=0).stop 2024-09-21T03:16:17.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.878+0000 7f0282a00640 1 -- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c140a80 msgr2=0x7f028c0c8560 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:16:17.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.878+0000 7f0282a00640 1 --2- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c140a80 0x7f028c0c8560 secure :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f028c0c5b60 tx=0x7f027c003f20 comp rx=0 tx=0).stop 2024-09-21T03:16:17.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.879+0000 7f0282a00640 1 -- 172.21.15.90:0/3396459572 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f027809cad0 con 0x7f028c0c4260 2024-09-21T03:16:17.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.879+0000 7f028b400640 1 --2- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f026c078b90 0x7f026c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:17.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.880+0000 7f028b400640 1 --2- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f026c078b90 0x7f026c07b0a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f028c0ab380 tx=0x7f028400d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:17.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.885+0000 7f028be00640 1 --2- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c0bee80 0x7f028c0bf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:17.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.885+0000 7f028be00640 1 -- 172.21.15.90:0/3396459572 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f028c152a30 con 0x7f028c0bee80 2024-09-21T03:16:17.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.885+0000 7f028aa00640 1 --2- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c0bee80 0x7f028c0bf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:17.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.886+0000 7f028aa00640 1 -- 172.21.15.90:0/3396459572 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f028c0c3460 con 0x7f028c0bee80 2024-09-21T03:16:17.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.886+0000 7f028aa00640 1 --2- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c0bee80 0x7f028c0bf290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f027c000c00 tx=0x7f027c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:17.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.887+0000 7f0282a00640 1 -- 172.21.15.90:0/3396459572 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c045440 con 0x7f028c0bee80 2024-09-21T03:16:17.888 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:16:17.889 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:16:17.889 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:16:17.889 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:16:17.889 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 10, 2024-09-21T03:16:17.889 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 18079, 2024-09-21T03:16:17.889 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:16:17.889 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:16:17.889 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:16:17.889 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:16:17.889 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:17.889 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 17, 2024-09-21T03:16:17.889 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:16:17.889 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:16:17.890 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:16:17.890 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:17.890 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:17.890 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:17.890 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:17.890 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:17.890 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:17.890 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:17.890 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:17.890 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:17.890 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:17.890 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:17.890 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:17.890 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:16:17.890 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:16:17.891 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:17.891 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:17.891 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:17.891 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:17.891 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:17.891 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:17.891 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:17.891 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:17.891 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:17.891 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:17.891 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:17.891 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:17.891 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.891 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:16:17.891 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:16:17.892 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:16:17.892 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:16:17.892 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:16:17.892 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:16:17.892 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:16:17.892 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:16:17.892 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:16:17.892 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:16:17.892 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:16:17.892 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:16:17.892 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:16:17.892 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:16:17.892 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:16:17.892 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:16:17.892 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:16:17.893 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:17.893 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:17.893 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:17.893 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:17.893 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:17.893 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:17.893 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:17.893 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:17.893 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:17.893 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:17.893 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:17.893 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:17.893 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:16:17.893 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.894 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:16:17.894 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.894 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:16:17.894 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:16:17.894 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:17.894 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:17.894 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.894 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:17.894 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:16:17.894 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:17.894 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.894 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.894 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:17.894 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:16:17.894 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:17.895 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.895 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:17.895 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.895 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:16:17.895 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:16:17.895 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:17.895 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:17.895 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:17.895 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.895 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.895 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:16:17.895 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:16:17.895 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:17.895 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:17.896 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.896 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:17.896 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:16:17.896 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:17.896 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.896 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.896 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:17.896 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:16:17.896 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:17.896 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.896 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:17.896 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.896 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:16:17.896 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:16:17.896 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:17.897 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:17.897 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:17.897 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.897 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.897 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:16:17.897 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:16:17.897 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:17.897 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:17.897 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.897 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:17.897 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:16:17.897 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:17.897 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.897 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.898 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:17.898 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:16:17.898 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:17.898 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.898 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:17.898 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.898 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:16:17.898 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:16:17.898 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:17.898 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:17.898 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:17.898 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.898 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:17.898 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.898 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:16:17.899 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:16:17.899 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.899 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:17.899 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:17.899 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:16:17.899 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.899 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:17.899 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:16:17.899 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:17.899 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:17.899 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:17.899 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:16:17.899 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:17.899 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:17.899 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:17.900 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:16:17.900 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:16:17.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.887+0000 7f0282a00640 1 -- 172.21.15.90:0/3396459572 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4549 (secure 0 0 0) 0x7f027c0455e0 con 0x7f028c0bee80 2024-09-21T03:16:17.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.887+0000 7f0282a00640 1 -- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c0bee80 msgr2=0x7f028c0bf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:17.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.887+0000 7f0282a00640 1 --2- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c0bee80 0x7f028c0bf290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f027c000c00 tx=0x7f027c005f90 comp rx=0 tx=0).stop 2024-09-21T03:16:17.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.887+0000 7f0282a00640 1 -- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c0bee80 msgr2=0x7f028c0bf290 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:16:17.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.887+0000 7f0282a00640 1 --2- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f028c0bee80 0x7f028c0bf290 secure :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f027c000c00 tx=0x7f027c005f90 comp rx=0 tx=0).stop 2024-09-21T03:16:17.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.887+0000 7f028be00640 1 -- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f026c078b90 msgr2=0x7f026c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:17.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.887+0000 7f028be00640 1 --2- 172.21.15.90:0/3396459572 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f026c078b90 0x7f026c07b0a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f028c0ab380 tx=0x7f028400d040 comp rx=0 tx=0).stop 2024-09-21T03:16:17.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.887+0000 7f028be00640 1 -- 172.21.15.90:0/3396459572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f028c0c4260 msgr2=0x7f028c140540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:17.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.887+0000 7f028be00640 1 --2- 172.21.15.90:0/3396459572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f028c0c4260 0x7f028c140540 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f027800c370 tx=0x7f027800c830 comp rx=0 tx=0).stop 2024-09-21T03:16:17.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.887+0000 7f028b400640 1 -- 172.21.15.90:0/3396459572 reap_dead start 2024-09-21T03:16:17.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.887+0000 7f028b400640 1 -- 172.21.15.90:0/3396459572 reap_dead start 2024-09-21T03:16:17.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.888+0000 7f028be00640 1 -- 172.21.15.90:0/3396459572 shutdown_connections 2024-09-21T03:16:17.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.888+0000 7f028be00640 1 -- 172.21.15.90:0/3396459572 >> 172.21.15.90:0/3396459572 conn(0x7f028c06d200 msgr2=0x7f028c0ac400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:17.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.888+0000 7f028be00640 1 -- 172.21.15.90:0/3396459572 shutdown_connections 2024-09-21T03:16:17.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:17.888+0000 7f028be00640 1 -- 172.21.15.90:0/3396459572 wait complete. 2024-09-21T03:16:17.914 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:16:17.914 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-21T03:16:17.914 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-21T03:16:17.914 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-21T03:16:17.915 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-21T03:16:17.915 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-21T03:16:17.915 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:16:17.959 INFO:tasks.ceph.mon.a:Stopped 2024-09-21T03:16:17.959 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-21T03:16:17.959 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:16:18.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.187+0000 7f52fdc00640 1 -- 172.21.15.90:0/3457252668 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52f80cb140 msgr2=0x7f52f80cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:18.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.187+0000 7f52fdc00640 1 --2- 172.21.15.90:0/3457252668 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52f80cb140 0x7f52f80cb550 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f52f808df20 tx=0x7f52e402a4f0 comp rx=0 tx=0).stop 2024-09-21T03:16:18.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.187+0000 7f52fdc00640 1 -- 172.21.15.90:0/3457252668 shutdown_connections 2024-09-21T03:16:18.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.187+0000 7f52fdc00640 1 --2- 172.21.15.90:0/3457252668 >> v2:172.21.15.90:3300/0 conn(0x7f52f80c7460 0x7f52f80c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:18.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.187+0000 7f52fdc00640 1 --2- 172.21.15.90:0/3457252668 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52f80cb140 0x7f52f80cb550 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:18.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.187+0000 7f52fdc00640 1 --2- 172.21.15.90:0/3457252668 >> v2:172.21.15.149:3300/0 conn(0x7f52f806e630 0x7f52f8154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:18.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.187+0000 7f52fdc00640 1 -- 172.21.15.90:0/3457252668 >> 172.21.15.90:0/3457252668 conn(0x7f52f80c8d60 msgr2=0x7f52f80c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:18.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.187+0000 7f52fdc00640 1 -- 172.21.15.90:0/3457252668 shutdown_connections 2024-09-21T03:16:18.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.187+0000 7f52fdc00640 1 -- 172.21.15.90:0/3457252668 wait complete. 2024-09-21T03:16:18.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.189+0000 7f52fdc00640 1 Processor -- start 2024-09-21T03:16:18.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.190+0000 7f52fdc00640 1 -- start start 2024-09-21T03:16:18.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.191+0000 7f52fdc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52f806e630 0x7f52f8152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:18.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.191+0000 7f52fdc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52f80c7460 0x7f52f80c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:18.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.191+0000 7f52fdc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52f80cb140 0x7f52f815a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:18.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.191+0000 7f52fdc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f52f80cba90 con 0x7f52f80cb140 2024-09-21T03:16:18.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.191+0000 7f52fdc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f52f80ca940 con 0x7f52f806e630 2024-09-21T03:16:18.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.191+0000 7f52fdc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f52f81582a0 con 0x7f52f80c7460 2024-09-21T03:16:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.191+0000 7f52fd200640 1 -- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52f80cb140 msgr2=0x7f52f815a230 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.90:3300/0 2024-09-21T03:16:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.191+0000 7f52fd200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52f80cb140 0x7f52f815a230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:16:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.191+0000 7f52f7400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52f80c7460 0x7f52f80c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.191+0000 7f52f7400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52f80c7460 0x7f52f80c3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:39218/0 (socket says 172.21.15.90:39218) 2024-09-21T03:16:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.191+0000 7f52f7400640 1 -- 172.21.15.90:0/1770688290 learned_addr learned my addr 172.21.15.90:0/1770688290 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:16:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.191+0000 7f52f7e00640 1 --2- 172.21.15.90:0/1770688290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52f806e630 0x7f52f8152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:18.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.192+0000 7f52f7400640 1 -- 172.21.15.90:0/1770688290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52f806e630 msgr2=0x7f52f8152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:18.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.192+0000 7f52f7400640 1 --2- 172.21.15.90:0/1770688290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52f806e630 0x7f52f8152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:18.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.192+0000 7f52f7400640 1 -- 172.21.15.90:0/1770688290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52f80cb140 msgr2=0x7f52f815a230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:16:18.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.192+0000 7f52f7400640 1 --2- 172.21.15.90:0/1770688290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52f80cb140 0x7f52f815a230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:18.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.192+0000 7f52f7400640 1 -- 172.21.15.90:0/1770688290 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f815af90 con 0x7f52f80c7460 2024-09-21T03:16:18.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.192+0000 7f52f7400640 1 --2- 172.21.15.90:0/1770688290 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52f80c7460 0x7f52f80c3bc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009850 tx=0x7f52e40038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:18.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.193+0000 7f52efe00640 1 -- 172.21.15.90:0/1770688290 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e403e030 con 0x7f52f80c7460 2024-09-21T03:16:18.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.193+0000 7f52efe00640 1 -- 172.21.15.90:0/1770688290 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52e4003d90 con 0x7f52f80c7460 2024-09-21T03:16:18.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.193+0000 7f52fdc00640 1 -- 172.21.15.90:0/1770688290 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f8153a70 con 0x7f52f80c7460 2024-09-21T03:16:18.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.193+0000 7f52fdc00640 1 -- 172.21.15.90:0/1770688290 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f80c5830 con 0x7f52f80c7460 2024-09-21T03:16:18.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.193+0000 7f52efe00640 1 -- 172.21.15.90:0/1770688290 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e4035040 con 0x7f52f80c7460 2024-09-21T03:16:18.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.194+0000 7f52fdc00640 1 -- 172.21.15.90:0/1770688290 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f8154530 con 0x7f52f80c7460 2024-09-21T03:16:18.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.195+0000 7f52efe00640 1 -- 172.21.15.90:0/1770688290 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f52e4041030 con 0x7f52f80c7460 2024-09-21T03:16:18.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.196+0000 7f52efe00640 1 --2- 172.21.15.90:0/1770688290 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f52d8078b40 0x7f52d807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:18.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.196+0000 7f52efe00640 1 -- 172.21.15.90:0/1770688290 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f52e40bb9b0 con 0x7f52f80c7460 2024-09-21T03:16:18.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.197+0000 7f52f7e00640 1 --2- 172.21.15.90:0/1770688290 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f52d8078b40 0x7f52d807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:18.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.197+0000 7f52f7e00640 1 --2- 172.21.15.90:0/1770688290 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f52d8078b40 0x7f52d807b050 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f52e8009b30 tx=0x7f52e8005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:18.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.206+0000 7f52efe00640 1 -- 172.21.15.90:0/1770688290 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f52e4083500 con 0x7f52f80c7460 2024-09-21T03:16:18.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.569+0000 7f52fdc00640 1 -- 172.21.15.90:0/1770688290 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f52f81537d0 con 0x7f52f80c7460 2024-09-21T03:16:18.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.570+0000 7f52efe00640 1 -- 172.21.15.90:0/1770688290 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f52e4087f30 con 0x7f52f80c7460 2024-09-21T03:16:18.572 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:16:18.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.572+0000 7f52fdc00640 1 -- 172.21.15.90:0/1770688290 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f52d8078b40 msgr2=0x7f52d807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:18.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.572+0000 7f52fdc00640 1 --2- 172.21.15.90:0/1770688290 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f52d8078b40 0x7f52d807b050 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f52e8009b30 tx=0x7f52e8005f90 comp rx=0 tx=0).stop 2024-09-21T03:16:18.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.572+0000 7f52fdc00640 1 -- 172.21.15.90:0/1770688290 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52f80c7460 msgr2=0x7f52f80c3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:18.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.572+0000 7f52fdc00640 1 --2- 172.21.15.90:0/1770688290 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52f80c7460 0x7f52f80c3bc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009850 tx=0x7f52e40038a0 comp rx=0 tx=0).stop 2024-09-21T03:16:18.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.572+0000 7f52fdc00640 1 -- 172.21.15.90:0/1770688290 shutdown_connections 2024-09-21T03:16:18.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.572+0000 7f52fdc00640 1 --2- 172.21.15.90:0/1770688290 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f52d8078b40 0x7f52d807b050 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:18.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.572+0000 7f52fdc00640 1 --2- 172.21.15.90:0/1770688290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52f80cb140 0x7f52f815a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:18.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.572+0000 7f52fdc00640 1 --2- 172.21.15.90:0/1770688290 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52f80c7460 0x7f52f80c3bc0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:18.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.572+0000 7f52fdc00640 1 --2- 172.21.15.90:0/1770688290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52f806e630 0x7f52f8152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:18.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.572+0000 7f52fdc00640 1 -- 172.21.15.90:0/1770688290 >> 172.21.15.90:0/1770688290 conn(0x7f52f80c8d60 msgr2=0x7f52f80c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:18.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.573+0000 7f52fdc00640 1 -- 172.21.15.90:0/1770688290 shutdown_connections 2024-09-21T03:16:18.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:18.573+0000 7f52fdc00640 1 -- 172.21.15.90:0/1770688290 wait complete. 2024-09-21T03:16:21.602 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:16:21.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.983+0000 7f49d0e00640 1 -- 172.21.15.90:0/831025500 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49cc0c51a0 msgr2=0x7f49cc150b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:21.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.983+0000 7f49d0e00640 1 --2- 172.21.15.90:0/831025500 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49cc0c51a0 0x7f49cc150b00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009900 tx=0x7f49b802a530 comp rx=0 tx=0).stop 2024-09-21T03:16:21.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.983+0000 7f49d0e00640 1 -- 172.21.15.90:0/831025500 shutdown_connections 2024-09-21T03:16:21.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.983+0000 7f49d0e00640 1 --2- 172.21.15.90:0/831025500 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49cc0c51a0 0x7f49cc150b00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:21.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.983+0000 7f49d0e00640 1 -- 172.21.15.90:0/831025500 >> 172.21.15.90:0/831025500 conn(0x7f49cc0c84c0 msgr2=0x7f49cc0c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:21.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.984+0000 7f49d0e00640 1 -- 172.21.15.90:0/831025500 shutdown_connections 2024-09-21T03:16:21.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.984+0000 7f49d0e00640 1 -- 172.21.15.90:0/831025500 wait complete. 2024-09-21T03:16:21.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.988+0000 7f49d0e00640 1 Processor -- start 2024-09-21T03:16:21.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.988+0000 7f49d0e00640 1 -- start start 2024-09-21T03:16:21.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.991+0000 7f49d0e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49cc06fd00 0x7f49cc152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:21.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.991+0000 7f49cb400640 1 -- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49cc06fd00 msgr2=0x7f49cc152da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.90:3300/0 2024-09-21T03:16:21.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.991+0000 7f49cb400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49cc06fd00 0x7f49cc152da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:16:21.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.991+0000 7f49d0e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49cc0c51a0 0x7f49cc1ed4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:21.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.991+0000 7f49d0e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49cc141cf0 0x7f49cc142100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:21.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.991+0000 7f49d0e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc1513d0 con 0x7f49cc06fd00 2024-09-21T03:16:21.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.992+0000 7f49d0e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc151250 con 0x7f49cc141cf0 2024-09-21T03:16:21.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.992+0000 7f49d0e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f49cc06f430 con 0x7f49cc0c51a0 2024-09-21T03:16:21.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.992+0000 7f49caa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49cc0c51a0 0x7f49cc1ed4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:21.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.992+0000 7f49caa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49cc0c51a0 0x7f49cc1ed4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:39234/0 (socket says 172.21.15.90:39234) 2024-09-21T03:16:21.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.992+0000 7f49caa00640 1 -- 172.21.15.90:0/3034335599 learned_addr learned my addr 172.21.15.90:0/3034335599 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:16:21.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.992+0000 7f49cbe00640 1 --2- 172.21.15.90:0/3034335599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49cc141cf0 0x7f49cc142100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:21.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.992+0000 7f49caa00640 1 -- 172.21.15.90:0/3034335599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49cc141cf0 msgr2=0x7f49cc142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:21.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.992+0000 7f49caa00640 1 --2- 172.21.15.90:0/3034335599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49cc141cf0 0x7f49cc142100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:21.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.992+0000 7f49caa00640 1 -- 172.21.15.90:0/3034335599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49cc06fd00 msgr2=0x7f49cc152da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:16:21.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.992+0000 7f49caa00640 1 --2- 172.21.15.90:0/3034335599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49cc06fd00 0x7f49cc152da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:21.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.993+0000 7f49caa00640 1 -- 172.21.15.90:0/3034335599 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49cc072e50 con 0x7f49cc0c51a0 2024-09-21T03:16:21.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.993+0000 7f49caa00640 1 --2- 172.21.15.90:0/3034335599 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49cc0c51a0 0x7f49cc1ed4f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f49b8006010 tx=0x7f49b80039e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:21.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.993+0000 7f49c3400640 1 -- 172.21.15.90:0/3034335599 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b803e030 con 0x7f49cc0c51a0 2024-09-21T03:16:21.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.993+0000 7f49c3400640 1 -- 172.21.15.90:0/3034335599 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49b80047a0 con 0x7f49cc0c51a0 2024-09-21T03:16:21.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.994+0000 7f49c3400640 1 -- 172.21.15.90:0/3034335599 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b8035040 con 0x7f49cc0c51a0 2024-09-21T03:16:21.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.994+0000 7f49d0e00640 1 -- 172.21.15.90:0/3034335599 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49cc1449d0 con 0x7f49cc0c51a0 2024-09-21T03:16:21.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.994+0000 7f49d0e00640 1 -- 172.21.15.90:0/3034335599 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f49cc074a40 con 0x7f49cc0c51a0 2024-09-21T03:16:21.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.995+0000 7f49d0e00640 1 -- 172.21.15.90:0/3034335599 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49cc140920 con 0x7f49cc0c51a0 2024-09-21T03:16:21.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.998+0000 7f49c3400640 1 -- 172.21.15.90:0/3034335599 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f49b8041030 con 0x7f49cc0c51a0 2024-09-21T03:16:22.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.999+0000 7f49c3400640 1 --2- 172.21.15.90:0/3034335599 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f49ac078b40 0x7f49ac07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:22.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:21.999+0000 7f49c3400640 1 -- 172.21.15.90:0/3034335599 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f49b80bba30 con 0x7f49cc0c51a0 2024-09-21T03:16:22.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:22.000+0000 7f49cb400640 1 --2- 172.21.15.90:0/3034335599 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f49ac078b40 0x7f49ac07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:22.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:22.000+0000 7f49cb400640 1 --2- 172.21.15.90:0/3034335599 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f49ac078b40 0x7f49ac07b050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f49bc006fd0 tx=0x7f49bc006d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:22.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:22.006+0000 7f49c3400640 1 -- 172.21.15.90:0/3034335599 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f49b8083560 con 0x7f49cc0c51a0 2024-09-21T03:16:22.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:22.472+0000 7f49d0e00640 1 -- 172.21.15.90:0/3034335599 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f49cc06f920 con 0x7f49cc0c51a0 2024-09-21T03:16:22.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:22.473+0000 7f49c3400640 1 -- 172.21.15.90:0/3034335599 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f49b8087f90 con 0x7f49cc0c51a0 2024-09-21T03:16:22.474 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:16:22.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:22.476+0000 7f49d0e00640 1 -- 172.21.15.90:0/3034335599 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f49ac078b40 msgr2=0x7f49ac07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:22.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:22.476+0000 7f49d0e00640 1 --2- 172.21.15.90:0/3034335599 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f49ac078b40 0x7f49ac07b050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f49bc006fd0 tx=0x7f49bc006d60 comp rx=0 tx=0).stop 2024-09-21T03:16:22.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:22.476+0000 7f49d0e00640 1 -- 172.21.15.90:0/3034335599 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49cc0c51a0 msgr2=0x7f49cc1ed4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:22.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:22.476+0000 7f49d0e00640 1 --2- 172.21.15.90:0/3034335599 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49cc0c51a0 0x7f49cc1ed4f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f49b8006010 tx=0x7f49b80039e0 comp rx=0 tx=0).stop 2024-09-21T03:16:22.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:22.476+0000 7f49d0e00640 1 -- 172.21.15.90:0/3034335599 shutdown_connections 2024-09-21T03:16:22.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:22.476+0000 7f49d0e00640 1 --2- 172.21.15.90:0/3034335599 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f49ac078b40 0x7f49ac07b050 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:22.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:22.476+0000 7f49d0e00640 1 --2- 172.21.15.90:0/3034335599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49cc141cf0 0x7f49cc142100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:22.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:22.476+0000 7f49d0e00640 1 --2- 172.21.15.90:0/3034335599 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49cc0c51a0 0x7f49cc1ed4f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:22.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:22.476+0000 7f49d0e00640 1 --2- 172.21.15.90:0/3034335599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49cc06fd00 0x7f49cc152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:22.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:22.476+0000 7f49d0e00640 1 -- 172.21.15.90:0/3034335599 >> 172.21.15.90:0/3034335599 conn(0x7f49cc0c84c0 msgr2=0x7f49cc154150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:22.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:22.477+0000 7f49d0e00640 1 -- 172.21.15.90:0/3034335599 shutdown_connections 2024-09-21T03:16:22.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:22.477+0000 7f49d0e00640 1 -- 172.21.15.90:0/3034335599 wait complete. 2024-09-21T03:16:25.503 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:16:25.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.737+0000 7efc11600640 1 -- 172.21.15.90:0/207591854 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc0c0abd10 msgr2=0x7efc0c151f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:25.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.737+0000 7efc11600640 1 --2- 172.21.15.90:0/207591854 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc0c0abd10 0x7efc0c151f50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efc04005fd0 tx=0x7efc0402aa10 comp rx=0 tx=0).stop 2024-09-21T03:16:25.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.737+0000 7efc11600640 1 -- 172.21.15.90:0/207591854 shutdown_connections 2024-09-21T03:16:25.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.737+0000 7efc11600640 1 --2- 172.21.15.90:0/207591854 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc0c0abd10 0x7efc0c151f50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:25.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.737+0000 7efc11600640 1 --2- 172.21.15.90:0/207591854 >> v2:172.21.15.90:3300/0 conn(0x7efc0c0ab900 0x7efc0c151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:25.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.737+0000 7efc11600640 1 -- 172.21.15.90:0/207591854 >> 172.21.15.90:0/207591854 conn(0x7efc0c0c9330 msgr2=0x7efc0c0c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:25.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.737+0000 7efc11600640 1 -- 172.21.15.90:0/207591854 shutdown_connections 2024-09-21T03:16:25.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.737+0000 7efc11600640 1 -- 172.21.15.90:0/207591854 wait complete. 2024-09-21T03:16:25.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.739+0000 7efc11600640 1 Processor -- start 2024-09-21T03:16:25.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.740+0000 7efc11600640 1 -- start start 2024-09-21T03:16:25.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.741+0000 7efc11600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc0c0ab900 0x7efc0c14ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:25.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.741+0000 7efc11600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc0c0abd10 0x7efc0c1ec720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:25.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.741+0000 7efc11600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc0c1ecc60 0x7efc0c13a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:25.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.741+0000 7efc11600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c157f90 con 0x7efc0c1ecc60 2024-09-21T03:16:25.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.741+0000 7efc11600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c152550 con 0x7efc0c0ab900 2024-09-21T03:16:25.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.741+0000 7efc11600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efc0c158110 con 0x7efc0c0abd10 2024-09-21T03:16:25.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.741+0000 7efc10c00640 1 -- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc0c1ecc60 msgr2=0x7efc0c13a9a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.90:3300/0 2024-09-21T03:16:25.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.741+0000 7efc10c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc0c1ecc60 0x7efc0c13a9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:16:25.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.742+0000 7efc0be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc0c0ab900 0x7efc0c14ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:25.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.742+0000 7efc0b400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc0c0abd10 0x7efc0c1ec720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:25.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.742+0000 7efc0b400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc0c0abd10 0x7efc0c1ec720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:60210/0 (socket says 172.21.15.90:60210) 2024-09-21T03:16:25.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.742+0000 7efc0b400640 1 -- 172.21.15.90:0/366534831 learned_addr learned my addr 172.21.15.90:0/366534831 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:16:25.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.742+0000 7efc0be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc0c0ab900 0x7efc0c14ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:51676/0 (socket says 172.21.15.90:51676) 2024-09-21T03:16:25.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.742+0000 7efc0b400640 1 -- 172.21.15.90:0/366534831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc0c0ab900 msgr2=0x7efc0c14ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:25.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.742+0000 7efc0b400640 1 --2- 172.21.15.90:0/366534831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc0c0ab900 0x7efc0c14ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:25.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.742+0000 7efc0b400640 1 -- 172.21.15.90:0/366534831 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc0c1ecc60 msgr2=0x7efc0c13a9a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:16:25.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.742+0000 7efc0b400640 1 --2- 172.21.15.90:0/366534831 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc0c1ecc60 0x7efc0c13a9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:25.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.742+0000 7efc0b400640 1 -- 172.21.15.90:0/366534831 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0c148ca0 con 0x7efc0c0abd10 2024-09-21T03:16:25.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.742+0000 7efc0b400640 1 --2- 172.21.15.90:0/366534831 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc0c0abd10 0x7efc0c1ec720 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efbf800b4a0 tx=0x7efbf800b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:25.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.743+0000 7efc03e00640 1 -- 172.21.15.90:0/366534831 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf8014070 con 0x7efc0c0abd10 2024-09-21T03:16:25.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.743+0000 7efc03e00640 1 -- 172.21.15.90:0/366534831 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efbf8010700 con 0x7efc0c0abd10 2024-09-21T03:16:25.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.743+0000 7efc11600640 1 -- 172.21.15.90:0/366534831 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc0c0c6ee0 con 0x7efc0c0abd10 2024-09-21T03:16:25.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.743+0000 7efc03e00640 1 -- 172.21.15.90:0/366534831 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf8010b50 con 0x7efc0c0abd10 2024-09-21T03:16:25.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.743+0000 7efc11600640 1 -- 172.21.15.90:0/366534831 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efc0c14f6f0 con 0x7efc0c0abd10 2024-09-21T03:16:25.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.745+0000 7efc11600640 1 -- 172.21.15.90:0/366534831 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc0c0c4a30 con 0x7efc0c0abd10 2024-09-21T03:16:25.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.746+0000 7efc03e00640 1 -- 172.21.15.90:0/366534831 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efbf8017070 con 0x7efc0c0abd10 2024-09-21T03:16:25.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.747+0000 7efc03e00640 1 --2- 172.21.15.90:0/366534831 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efbec078b70 0x7efbec07b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:25.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.747+0000 7efc03e00640 1 -- 172.21.15.90:0/366534831 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7efbf809ab20 con 0x7efc0c0abd10 2024-09-21T03:16:25.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.747+0000 7efc0be00640 1 --2- 172.21.15.90:0/366534831 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efbec078b70 0x7efbec07b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:25.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.748+0000 7efc0be00640 1 --2- 172.21.15.90:0/366534831 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efbec078b70 0x7efbec07b080 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efbfc006b00 tx=0x7efbfc006a90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:25.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:25.756+0000 7efc03e00640 1 -- 172.21.15.90:0/366534831 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efbf8062540 con 0x7efc0c0abd10 2024-09-21T03:16:26.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:26.074+0000 7efc11600640 1 -- 172.21.15.90:0/366534831 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7efc0c149420 con 0x7efc0c0abd10 2024-09-21T03:16:26.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:26.074+0000 7efc03e00640 1 -- 172.21.15.90:0/366534831 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7efbf8066f70 con 0x7efc0c0abd10 2024-09-21T03:16:26.076 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":26,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:16:26.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:26.078+0000 7efc11600640 1 -- 172.21.15.90:0/366534831 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efbec078b70 msgr2=0x7efbec07b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:26.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:26.078+0000 7efc11600640 1 --2- 172.21.15.90:0/366534831 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efbec078b70 0x7efbec07b080 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efbfc006b00 tx=0x7efbfc006a90 comp rx=0 tx=0).stop 2024-09-21T03:16:26.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:26.078+0000 7efc11600640 1 -- 172.21.15.90:0/366534831 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc0c0abd10 msgr2=0x7efc0c1ec720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:26.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:26.078+0000 7efc11600640 1 --2- 172.21.15.90:0/366534831 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc0c0abd10 0x7efc0c1ec720 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efbf800b4a0 tx=0x7efbf800b960 comp rx=0 tx=0).stop 2024-09-21T03:16:26.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:26.078+0000 7efc11600640 1 -- 172.21.15.90:0/366534831 shutdown_connections 2024-09-21T03:16:26.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:26.078+0000 7efc11600640 1 --2- 172.21.15.90:0/366534831 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efbec078b70 0x7efbec07b080 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:26.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:26.078+0000 7efc11600640 1 --2- 172.21.15.90:0/366534831 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc0c1ecc60 0x7efc0c13a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:26.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:26.078+0000 7efc11600640 1 --2- 172.21.15.90:0/366534831 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc0c0abd10 0x7efc0c1ec720 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:26.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:26.078+0000 7efc11600640 1 --2- 172.21.15.90:0/366534831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc0c0ab900 0x7efc0c14ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:26.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:26.078+0000 7efc11600640 1 -- 172.21.15.90:0/366534831 >> 172.21.15.90:0/366534831 conn(0x7efc0c0c9330 msgr2=0x7efc0c0c2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:26.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:26.078+0000 7efc11600640 1 -- 172.21.15.90:0/366534831 shutdown_connections 2024-09-21T03:16:26.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:26.078+0000 7efc11600640 1 -- 172.21.15.90:0/366534831 wait complete. 2024-09-21T03:16:28.070 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:16:28.075 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:16:29.105 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:16:32.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.944+0000 7f578b000640 1 -- 172.21.15.90:0/2651687529 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57600073d0 msgr2=0x7f57600098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:32.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.944+0000 7f578b000640 1 --2- 172.21.15.90:0/2651687529 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57600073d0 0x7f57600098e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f576c005f10 tx=0x7f576c02c410 comp rx=0 tx=0).stop 2024-09-21T03:16:32.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.944+0000 7f5789000640 1 -- 172.21.15.90:0/2651687529 reap_dead start 2024-09-21T03:16:32.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.944+0000 7f578b000640 1 -- 172.21.15.90:0/2651687529 shutdown_connections 2024-09-21T03:16:32.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.944+0000 7f578b000640 1 -- 172.21.15.90:0/2651687529 >> 172.21.15.90:0/2651687529 conn(0x7f57840c8ba0 msgr2=0x7f578406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:32.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.944+0000 7f578b000640 1 -- 172.21.15.90:0/2651687529 shutdown_connections 2024-09-21T03:16:32.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.945+0000 7f578b000640 1 -- 172.21.15.90:0/2651687529 wait complete. 2024-09-21T03:16:32.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.947+0000 7f578b000640 1 Processor -- start 2024-09-21T03:16:32.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.947+0000 7f578b000640 1 -- start start 2024-09-21T03:16:32.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.949+0000 7f578b000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57600073d0 0x7f5784150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:32.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.949+0000 7f578b000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57841ed250 0x7f578414ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:32.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.949+0000 7f578b000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57841479d0 0x7f5784147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:32.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.949+0000 7f578b000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f57840c26e0 con 0x7f57600073d0 2024-09-21T03:16:32.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.949+0000 7f578b000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f578406fcb0 con 0x7f57841ed250 2024-09-21T03:16:32.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.949+0000 7f578b000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5784157850 con 0x7f57841479d0 2024-09-21T03:16:32.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.949+0000 7f5783e00640 1 -- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57600073d0 msgr2=0x7f5784150390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.90:3300/0 2024-09-21T03:16:32.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.949+0000 7f5783e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57600073d0 0x7f5784150390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:16:32.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.949+0000 7f577be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57841ed250 0x7f578414ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:32.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.949+0000 7f5789000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57841479d0 0x7f5784147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:32.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.949+0000 7f577be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57841ed250 0x7f578414ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:51718/0 (socket says 172.21.15.90:51718) 2024-09-21T03:16:32.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.949+0000 7f577be00640 1 -- 172.21.15.90:0/283729852 learned_addr learned my addr 172.21.15.90:0/283729852 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:16:32.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.949+0000 7f577be00640 1 -- 172.21.15.90:0/283729852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57841479d0 msgr2=0x7f5784147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:32.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.949+0000 7f577be00640 1 --2- 172.21.15.90:0/283729852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57841479d0 0x7f5784147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:32.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.949+0000 7f577be00640 1 -- 172.21.15.90:0/283729852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57600073d0 msgr2=0x7f5784150390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:16:32.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.949+0000 7f577be00640 1 --2- 172.21.15.90:0/283729852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57600073d0 0x7f5784150390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:32.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.950+0000 7f577be00640 1 -- 172.21.15.90:0/283729852 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5784156470 con 0x7f57841ed250 2024-09-21T03:16:32.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.950+0000 7f577be00640 1 --2- 172.21.15.90:0/283729852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57841ed250 0x7f578414ebc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f576c02ca00 tx=0x7f576c0058d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:32.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.950+0000 7f5780c00640 1 -- 172.21.15.90:0/283729852 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c005020 con 0x7f57841ed250 2024-09-21T03:16:32.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.950+0000 7f5780c00640 1 -- 172.21.15.90:0/283729852 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f576c0052f0 con 0x7f57841ed250 2024-09-21T03:16:32.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.950+0000 7f578b000640 1 -- 172.21.15.90:0/283729852 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5784156750 con 0x7f57841ed250 2024-09-21T03:16:32.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.950+0000 7f5780c00640 1 -- 172.21.15.90:0/283729852 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c0047a0 con 0x7f57841ed250 2024-09-21T03:16:32.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.950+0000 7f578b000640 1 -- 172.21.15.90:0/283729852 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f578414fe70 con 0x7f57841ed250 2024-09-21T03:16:32.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.952+0000 7f578b000640 1 -- 172.21.15.90:0/283729852 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f578414f980 con 0x7f57841ed250 2024-09-21T03:16:32.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.953+0000 7f5780c00640 1 -- 172.21.15.90:0/283729852 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f576c014190 con 0x7f57841ed250 2024-09-21T03:16:32.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.954+0000 7f5780c00640 1 --2- 172.21.15.90:0/283729852 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5760079920 0x7f576007be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:32.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.954+0000 7f5780c00640 1 -- 172.21.15.90:0/283729852 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f576c0bc910 con 0x7f57841ed250 2024-09-21T03:16:32.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.954+0000 7f5783e00640 1 --2- 172.21.15.90:0/283729852 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5760079920 0x7f576007be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:32.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.955+0000 7f5783e00640 1 --2- 172.21.15.90:0/283729852 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5760079920 0x7f576007be30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f57740010a0 tx=0x7f5774009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:32.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:32.960+0000 7f5780c00640 1 -- 172.21.15.90:0/283729852 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f576c084330 con 0x7f57841ed250 2024-09-21T03:16:33.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.219+0000 7f578b000640 1 -- 172.21.15.90:0/283729852 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f57840c1540 con 0x7f57841ed250 2024-09-21T03:16:33.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.220+0000 7f5780c00640 1 -- 172.21.15.90:0/283729852 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f576c088d60 con 0x7f57841ed250 2024-09-21T03:16:33.222 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":12,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:16:33.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.222+0000 7f578b000640 1 -- 172.21.15.90:0/283729852 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5760079920 msgr2=0x7f576007be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:33.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.222+0000 7f578b000640 1 --2- 172.21.15.90:0/283729852 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5760079920 0x7f576007be30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f57740010a0 tx=0x7f5774009060 comp rx=0 tx=0).stop 2024-09-21T03:16:33.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.222+0000 7f578b000640 1 -- 172.21.15.90:0/283729852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57841ed250 msgr2=0x7f578414ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:33.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.222+0000 7f578b000640 1 --2- 172.21.15.90:0/283729852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57841ed250 0x7f578414ebc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f576c02ca00 tx=0x7f576c0058d0 comp rx=0 tx=0).stop 2024-09-21T03:16:33.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.222+0000 7f578b000640 1 -- 172.21.15.90:0/283729852 shutdown_connections 2024-09-21T03:16:33.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.222+0000 7f578b000640 1 --2- 172.21.15.90:0/283729852 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5760079920 0x7f576007be30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:33.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.222+0000 7f578b000640 1 --2- 172.21.15.90:0/283729852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57841479d0 0x7f5784147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:33.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.222+0000 7f578b000640 1 --2- 172.21.15.90:0/283729852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57841ed250 0x7f578414ebc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:33.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.222+0000 7f578b000640 1 --2- 172.21.15.90:0/283729852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57600073d0 0x7f5784150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:33.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.222+0000 7f578b000640 1 -- 172.21.15.90:0/283729852 >> 172.21.15.90:0/283729852 conn(0x7f57840c8ba0 msgr2=0x7f57840ac390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:33.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.222+0000 7f578b000640 1 -- 172.21.15.90:0/283729852 shutdown_connections 2024-09-21T03:16:33.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.223+0000 7f578b000640 1 -- 172.21.15.90:0/283729852 wait complete. 2024-09-21T03:16:33.251 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-21T03:16:33.251 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-21T03:16:33.251 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:16:33.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.472+0000 7f1ae0400640 1 -- 172.21.15.90:0/2496307090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ad8074ec0 msgr2=0x7f1ad80add50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:33.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.472+0000 7f1ae0400640 1 --2- 172.21.15.90:0/2496307090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ad8074ec0 0x7f1ad80add50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0098e0 tx=0x7f1acc02a4b0 comp rx=0 tx=0).stop 2024-09-21T03:16:33.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.473+0000 7f1ae0400640 1 -- 172.21.15.90:0/2496307090 shutdown_connections 2024-09-21T03:16:33.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.473+0000 7f1ae0400640 1 --2- 172.21.15.90:0/2496307090 >> v2:172.21.15.149:3300/0 conn(0x7f1ad8156ee0 0x7f1ad81572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:33.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.473+0000 7f1ae0400640 1 --2- 172.21.15.90:0/2496307090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ad8074ec0 0x7f1ad80add50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:33.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.473+0000 7f1ae0400640 1 -- 172.21.15.90:0/2496307090 >> 172.21.15.90:0/2496307090 conn(0x7f1ad80c85a0 msgr2=0x7f1ad80c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:33.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.473+0000 7f1ae0400640 1 -- 172.21.15.90:0/2496307090 shutdown_connections 2024-09-21T03:16:33.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.473+0000 7f1ae0400640 1 -- 172.21.15.90:0/2496307090 wait complete. 2024-09-21T03:16:33.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.475+0000 7f1ae0400640 1 Processor -- start 2024-09-21T03:16:33.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.475+0000 7f1ae0400640 1 -- start start 2024-09-21T03:16:33.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.476+0000 7f1ae0400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ad8074ec0 0x7f1ad814e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:33.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.476+0000 7f1ae0400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ad80ac750 0x7f1ad814aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:33.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.476+0000 7f1ae0400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad8156ee0 0x7f1ad8147df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:33.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.476+0000 7f1ae0400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad80ad3f0 con 0x7f1ad8074ec0 2024-09-21T03:16:33.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.476+0000 7f1ae0400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad80ad270 con 0x7f1ad8156ee0 2024-09-21T03:16:33.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.476+0000 7f1ae0400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1ad8073be0 con 0x7f1ad80ac750 2024-09-21T03:16:33.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.476+0000 7f1adda00640 1 -- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ad8074ec0 msgr2=0x7f1ad814e1c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.90:3300/0 2024-09-21T03:16:33.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.476+0000 7f1adda00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ad8074ec0 0x7f1ad814e1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:16:33.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.478+0000 7f1ade400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad8156ee0 0x7f1ad8147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:33.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.478+0000 7f1ade400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad8156ee0 0x7f1ad8147df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:51734/0 (socket says 172.21.15.90:51734) 2024-09-21T03:16:33.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.478+0000 7f1ade400640 1 -- 172.21.15.90:0/1129544551 learned_addr learned my addr 172.21.15.90:0/1129544551 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:16:33.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.478+0000 7f1add000640 1 --2- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ad80ac750 0x7f1ad814aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:33.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.478+0000 7f1ade400640 1 -- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ad80ac750 msgr2=0x7f1ad814aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:33.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.478+0000 7f1ade400640 1 --2- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ad80ac750 0x7f1ad814aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:33.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.478+0000 7f1ade400640 1 -- 172.21.15.90:0/1129544551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ad8074ec0 msgr2=0x7f1ad814e1c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:16:33.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.478+0000 7f1ade400640 1 --2- 172.21.15.90:0/1129544551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ad8074ec0 0x7f1ad814e1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:33.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.478+0000 7f1ade400640 1 -- 172.21.15.90:0/1129544551 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad81edce0 con 0x7f1ad8156ee0 2024-09-21T03:16:33.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.478+0000 7f1ade400640 1 --2- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad8156ee0 0x7f1ad8147df0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000ebf0 tx=0x7f1ad000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:33.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.478+0000 7f1ad5600640 1 -- 172.21.15.90:0/1129544551 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0003b70 con 0x7f1ad8156ee0 2024-09-21T03:16:33.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.478+0000 7f1ad5600640 1 -- 172.21.15.90:0/1129544551 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ad0003d10 con 0x7f1ad8156ee0 2024-09-21T03:16:33.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.478+0000 7f1ae0400640 1 -- 172.21.15.90:0/1129544551 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ad81edfc0 con 0x7f1ad8156ee0 2024-09-21T03:16:33.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.478+0000 7f1ad5600640 1 -- 172.21.15.90:0/1129544551 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0004280 con 0x7f1ad8156ee0 2024-09-21T03:16:33.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.478+0000 7f1ae0400640 1 -- 172.21.15.90:0/1129544551 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ad8070500 con 0x7f1ad8156ee0 2024-09-21T03:16:33.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.479+0000 7f1ae0400640 1 --2- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad80c15e0 0x7f1ad80c19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:33.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.479+0000 7f1ae0400640 1 -- 172.21.15.90:0/1129544551 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad81e0500 con 0x7f1ad80c15e0 2024-09-21T03:16:33.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.479+0000 7f1adda00640 1 --2- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad80c15e0 0x7f1ad80c19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:33.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.480+0000 7f1adda00640 1 -- 172.21.15.90:0/1129544551 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1ad806e820 con 0x7f1ad80c15e0 2024-09-21T03:16:33.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.480+0000 7f1adda00640 1 --2- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad80c15e0 0x7f1ad80c19f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80c4bd0 tx=0x7f1acc031630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:33.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.481+0000 7f1ad5600640 1 -- 172.21.15.90:0/1129544551 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc03f070 con 0x7f1ad80c15e0 2024-09-21T03:16:33.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.481+0000 7f1ad5600640 1 -- 172.21.15.90:0/1129544551 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1acc005050 con 0x7f1ad80c15e0 2024-09-21T03:16:33.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.481+0000 7f1ad5600640 1 -- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad80c15e0 msgr2=0x7f1ad80c19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:33.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.481+0000 7f1ad5600640 1 --2- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad80c15e0 0x7f1ad80c19f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80c4bd0 tx=0x7f1acc031630 comp rx=0 tx=0).stop 2024-09-21T03:16:33.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.481+0000 7f1ad5600640 1 -- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad80c15e0 msgr2=0x7f1ad80c19f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:16:33.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.481+0000 7f1ad5600640 1 --2- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad80c15e0 0x7f1ad80c19f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:33.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.481+0000 7f1ad5600640 1 -- 172.21.15.90:0/1129544551 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1ad0004420 con 0x7f1ad8156ee0 2024-09-21T03:16:33.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.482+0000 7f1ad5600640 1 --2- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1ab80786a0 0x7f1ab807abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:33.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.482+0000 7f1ad5600640 1 -- 172.21.15.90:0/1129544551 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f1ad009bb90 con 0x7f1ad8156ee0 2024-09-21T03:16:33.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.482+0000 7f1adda00640 1 --2- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1ab80786a0 0x7f1ab807abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:33.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.483+0000 7f1adda00640 1 --2- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1ab80786a0 0x7f1ab807abb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8151730 tx=0x7f1acc03d000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:33.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.488+0000 7f1ae0400640 1 --2- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad81f07b0 0x7f1ad81f0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:33.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.488+0000 7f1ae0400640 1 -- 172.21.15.90:0/1129544551 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad80add50 con 0x7f1ad81f07b0 2024-09-21T03:16:33.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.488+0000 7f1add000640 1 --2- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad81f07b0 0x7f1ad81f0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:33.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.489+0000 7f1add000640 1 -- 172.21.15.90:0/1129544551 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1ad80acb60 con 0x7f1ad81f07b0 2024-09-21T03:16:33.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.489+0000 7f1add000640 1 --2- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad81f07b0 0x7f1ad81f0bc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80c5ea0 tx=0x7f1ac400fc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:33.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.489+0000 7f1ad5600640 1 -- 172.21.15.90:0/1129544551 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac40050d0 con 0x7f1ad81f07b0 2024-09-21T03:16:33.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.489+0000 7f1ad5600640 1 -- 172.21.15.90:0/1129544551 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5184 (secure 0 0 0) 0x7f1ac40050d0 con 0x7f1ad81f07b0 2024-09-21T03:16:33.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.489+0000 7f1ad5600640 1 -- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad81f07b0 msgr2=0x7f1ad81f0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:33.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.489+0000 7f1ad5600640 1 --2- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad81f07b0 0x7f1ad81f0bc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80c5ea0 tx=0x7f1ac400fc00 comp rx=0 tx=0).stop 2024-09-21T03:16:33.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.489+0000 7f1ad5600640 1 -- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad81f07b0 msgr2=0x7f1ad81f0bc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:16:33.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.489+0000 7f1ad5600640 1 --2- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad81f07b0 0x7f1ad81f0bc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:33.492 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:16:33.492 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:16:33.492 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:16:33.492 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:16:33.492 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 12, 2024-09-21T03:16:33.492 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 144279, 2024-09-21T03:16:33.492 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:16:33.492 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:16:33.492 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:16:33.492 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:33.493 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 0, 2024-09-21T03:16:33.493 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:16:33.493 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:16:33.493 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:16:33.493 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:33.493 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:33.493 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:33.493 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:33.493 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:33.493 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:33.493 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:33.493 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:33.493 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:33.493 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:33.494 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:33.494 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:33.494 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:16:33.494 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:16:33.494 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:33.494 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:33.494 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:33.494 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:33.494 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:33.494 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:33.494 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:33.494 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:33.494 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:33.494 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:33.494 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:33.495 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:33.495 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.495 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:16:33.495 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:16:33.495 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:16:33.495 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:16:33.495 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:16:33.495 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:16:33.495 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:16:33.495 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:16:33.495 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:16:33.495 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:16:33.495 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:16:33.495 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:16:33.496 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:16:33.496 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:16:33.496 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:16:33.496 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:16:33.496 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:16:33.496 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:33.496 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:33.496 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:33.496 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:33.496 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:33.496 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:33.496 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:33.496 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:33.496 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:33.497 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:33.497 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:33.497 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:33.497 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:16:33.497 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.497 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:16:33.497 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.497 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:16:33.498 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:16:33.498 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:33.498 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:33.498 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.498 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:33.498 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:16:33.498 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:33.498 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.498 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.498 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:33.498 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:16:33.498 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:33.498 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:33.499 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:33.499 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.499 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:16:33.499 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:16:33.499 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:33.499 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:33.499 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:33.499 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.499 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.499 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:16:33.499 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:16:33.499 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:33.499 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:33.499 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.499 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:33.500 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:16:33.500 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:33.500 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.500 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.500 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:33.500 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:16:33.500 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:33.500 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:33.500 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:33.500 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.500 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:16:33.500 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:16:33.500 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:33.500 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:33.500 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:33.501 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.501 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.501 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:16:33.501 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:16:33.501 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:33.501 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:33.501 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.501 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:33.501 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:16:33.501 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:33.501 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.501 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.501 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:33.501 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:16:33.502 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:33.502 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:33.502 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:33.502 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.502 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:16:33.502 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:16:33.502 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:33.502 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:33.502 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:33.502 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:33.502 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:33.502 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.502 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:16:33.502 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:16:33.503 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.503 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:33.503 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:33.503 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:16:33.503 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:33.503 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:33.503 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:16:33.503 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.503 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:33.503 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:33.503 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:16:33.503 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:33.503 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:33.504 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:16:33.504 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.504 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:33.504 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:33.504 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6 2024-09-21T03:16:33.504 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:33.504 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:33.505 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:16:33.505 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.505 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:16:33.505 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:16:33.505 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:16:33.505 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.505 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.505 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:33.505 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:33.505 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6 2024-09-21T03:16:33.505 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:33.505 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:33.505 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:16:33.505 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.505 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:33.506 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:33.506 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:16:33.506 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:33.506 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:33.506 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.506 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:16:33.506 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:16:33.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.490+0000 7f1ae0400640 1 -- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1ab80786a0 msgr2=0x7f1ab807abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:33.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.490+0000 7f1ae0400640 1 --2- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1ab80786a0 0x7f1ab807abb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8151730 tx=0x7f1acc03d000 comp rx=0 tx=0).stop 2024-09-21T03:16:33.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.490+0000 7f1ae0400640 1 -- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad8156ee0 msgr2=0x7f1ad8147df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:33.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.490+0000 7f1ae0400640 1 --2- 172.21.15.90:0/1129544551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad8156ee0 0x7f1ad8147df0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000ebf0 tx=0x7f1ad000c6a0 comp rx=0 tx=0).stop 2024-09-21T03:16:33.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.490+0000 7f1ade400640 1 -- 172.21.15.90:0/1129544551 reap_dead start 2024-09-21T03:16:33.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.490+0000 7f1ade400640 1 -- 172.21.15.90:0/1129544551 reap_dead start 2024-09-21T03:16:33.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.490+0000 7f1ae0400640 1 -- 172.21.15.90:0/1129544551 shutdown_connections 2024-09-21T03:16:33.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.490+0000 7f1ae0400640 1 -- 172.21.15.90:0/1129544551 >> 172.21.15.90:0/1129544551 conn(0x7f1ad80c85a0 msgr2=0x7f1ad80c41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:33.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.490+0000 7f1ae0400640 1 -- 172.21.15.90:0/1129544551 shutdown_connections 2024-09-21T03:16:33.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.490+0000 7f1ae0400640 1 -- 172.21.15.90:0/1129544551 wait complete. 2024-09-21T03:16:33.515 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-21T03:16:33.515 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-21T03:16:33.515 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:16:33.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.740+0000 7f06b5200640 1 -- 172.21.15.90:0/3700836521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06b00c7150 msgr2=0x7f06b01553f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:33.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.740+0000 7f06b5200640 1 --2- 172.21.15.90:0/3700836521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06b00c7150 0x7f06b01553f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f06b00ca1a0 tx=0x7f06a802a9a0 comp rx=0 tx=0).stop 2024-09-21T03:16:33.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.740+0000 7f06b5200640 1 -- 172.21.15.90:0/3700836521 shutdown_connections 2024-09-21T03:16:33.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.740+0000 7f06b5200640 1 --2- 172.21.15.90:0/3700836521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06b00c7150 0x7f06b01553f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:33.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.740+0000 7f06b5200640 1 --2- 172.21.15.90:0/3700836521 >> v2:172.21.15.90:3300/0 conn(0x7f06b00c65a0 0x7f06b00c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:33.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.740+0000 7f06b5200640 1 -- 172.21.15.90:0/3700836521 >> 172.21.15.90:0/3700836521 conn(0x7f06b006d860 msgr2=0x7f06b00abdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:33.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.740+0000 7f06b5200640 1 -- 172.21.15.90:0/3700836521 shutdown_connections 2024-09-21T03:16:33.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.740+0000 7f06b5200640 1 -- 172.21.15.90:0/3700836521 wait complete. 2024-09-21T03:16:33.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.742+0000 7f06b5200640 1 Processor -- start 2024-09-21T03:16:33.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.742+0000 7f06b5200640 1 -- start start 2024-09-21T03:16:33.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.743+0000 7f06b5200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06b0071c80 0x7f06b00a9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:33.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.743+0000 7f06b5200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b00c65a0 0x7f06b00a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:33.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.744+0000 7f06b5200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06b00c7150 0x7f06b01f0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:33.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.744+0000 7f06b5200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f06b00aff60 con 0x7f06b00c7150 2024-09-21T03:16:33.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.744+0000 7f06b5200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f06b00c4d90 con 0x7f06b0071c80 2024-09-21T03:16:33.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.744+0000 7f06b5200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f06b00b00e0 con 0x7f06b00c65a0 2024-09-21T03:16:33.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.744+0000 7f06ae800640 1 -- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06b00c7150 msgr2=0x7f06b01f0de0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.90:3300/0 2024-09-21T03:16:33.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.744+0000 7f06ae800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06b00c7150 0x7f06b01f0de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:16:33.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.744+0000 7f06ade00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06b0071c80 0x7f06b00a9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:33.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.744+0000 7f06a7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b00c65a0 0x7f06b00a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:33.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.744+0000 7f06a7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b00c65a0 0x7f06b00a95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:60272/0 (socket says 172.21.15.90:60272) 2024-09-21T03:16:33.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.744+0000 7f06a7e00640 1 -- 172.21.15.90:0/209014119 learned_addr learned my addr 172.21.15.90:0/209014119 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:16:33.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.744+0000 7f06a7e00640 1 -- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06b0071c80 msgr2=0x7f06b00a9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:33.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.744+0000 7f06a7e00640 1 --2- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06b0071c80 0x7f06b00a9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:33.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.744+0000 7f06a7e00640 1 -- 172.21.15.90:0/209014119 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06b00c7150 msgr2=0x7f06b01f0de0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:16:33.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.744+0000 7f06a7e00640 1 --2- 172.21.15.90:0/209014119 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06b00c7150 0x7f06b01f0de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:33.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.744+0000 7f06a7e00640 1 -- 172.21.15.90:0/209014119 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b006f860 con 0x7f06b00c65a0 2024-09-21T03:16:33.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.745+0000 7f06a7e00640 1 --2- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b00c65a0 0x7f06b00a95b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f069800b550 tx=0x7f069800b950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:33.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.745+0000 7f06a6000640 1 -- 172.21.15.90:0/209014119 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0698015020 con 0x7f06b00c65a0 2024-09-21T03:16:33.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.745+0000 7f06a6000640 1 -- 172.21.15.90:0/209014119 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0698011940 con 0x7f06b00c65a0 2024-09-21T03:16:33.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.745+0000 7f06b5200640 1 -- 172.21.15.90:0/209014119 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06b00aec70 con 0x7f06b00c65a0 2024-09-21T03:16:33.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.745+0000 7f06a6000640 1 -- 172.21.15.90:0/209014119 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0698011d90 con 0x7f06b00c65a0 2024-09-21T03:16:33.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.745+0000 7f06b5200640 1 -- 172.21.15.90:0/209014119 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f06b0149260 con 0x7f06b00c65a0 2024-09-21T03:16:33.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.747+0000 7f06b5200640 1 --2- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b0151e50 0x7f06b01f1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:33.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.747+0000 7f06b5200640 1 -- 172.21.15.90:0/209014119 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f06b006fa70 con 0x7f06b0151e50 2024-09-21T03:16:33.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.747+0000 7f06ade00640 1 --2- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b0151e50 0x7f06b01f1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:33.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.747+0000 7f06a6000640 1 -- 172.21.15.90:0/209014119 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0698018020 con 0x7f06b00c65a0 2024-09-21T03:16:33.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.747+0000 7f06ade00640 1 -- 172.21.15.90:0/209014119 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f06b006def0 con 0x7f06b0151e50 2024-09-21T03:16:33.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.748+0000 7f06ade00640 1 --2- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b0151e50 0x7f06b01f1320 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f06a000e770 tx=0x7f06a000ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:33.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.748+0000 7f06a6000640 1 --2- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f068c078b40 0x7f068c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:33.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.748+0000 7f06a6000640 1 -- 172.21.15.90:0/209014119 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f069809b090 con 0x7f06b00c65a0 2024-09-21T03:16:33.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.749+0000 7f06a6000640 1 -- 172.21.15.90:0/209014119 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a0005a20 con 0x7f06b0151e50 2024-09-21T03:16:33.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.749+0000 7f06a6000640 1 -- 172.21.15.90:0/209014119 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f06a0005bc0 con 0x7f06b0151e50 2024-09-21T03:16:33.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.749+0000 7f06a6000640 1 -- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b0151e50 msgr2=0x7f06b01f1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:33.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.749+0000 7f06a6000640 1 --2- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b0151e50 0x7f06b01f1320 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f06a000e770 tx=0x7f06a000ec30 comp rx=0 tx=0).stop 2024-09-21T03:16:33.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.749+0000 7f06ae800640 1 --2- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f068c078b40 0x7f068c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:33.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.749+0000 7f06a6000640 1 -- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b0151e50 msgr2=0x7f06b01f1320 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:16:33.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.749+0000 7f06a6000640 1 --2- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b0151e50 0x7f06b01f1320 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f06a000e770 tx=0x7f06a000ec30 comp rx=0 tx=0).stop 2024-09-21T03:16:33.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.749+0000 7f06ae800640 1 --2- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f068c078b40 0x7f068c07b050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f06a8035000 tx=0x7f06a8004ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:33.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.755+0000 7f06b5200640 1 --2- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b00ab8c0 0x7f06b014fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:33.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.755+0000 7f06b5200640 1 -- 172.21.15.90:0/209014119 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f06b01490c0 con 0x7f06b00ab8c0 2024-09-21T03:16:33.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.756+0000 7f06ade00640 1 --2- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b00ab8c0 0x7f06b014fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:33.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.756+0000 7f06ade00640 1 -- 172.21.15.90:0/209014119 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f06b00c6c10 con 0x7f06b00ab8c0 2024-09-21T03:16:33.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.756+0000 7f06ade00640 1 --2- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b00ab8c0 0x7f06b014fa20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f06a000e770 tx=0x7f06a0004800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:33.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.757+0000 7f06a6000640 1 -- 172.21.15.90:0/209014119 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a00066c0 con 0x7f06b00ab8c0 2024-09-21T03:16:33.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.757+0000 7f06a6000640 1 -- 172.21.15.90:0/209014119 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4871 (secure 0 0 0) 0x7f06a00066c0 con 0x7f06b00ab8c0 2024-09-21T03:16:33.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.757+0000 7f06a6000640 1 -- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b00ab8c0 msgr2=0x7f06b014fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:33.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.757+0000 7f06a6000640 1 --2- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b00ab8c0 0x7f06b014fa20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f06a000e770 tx=0x7f06a0004800 comp rx=0 tx=0).stop 2024-09-21T03:16:33.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.757+0000 7f06a6000640 1 -- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b00ab8c0 msgr2=0x7f06b014fa20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:16:33.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.757+0000 7f06a6000640 1 --2- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b00ab8c0 0x7f06b014fa20 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f06a000e770 tx=0x7f06a0004800 comp rx=0 tx=0).stop 2024-09-21T03:16:33.760 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:16:33.760 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:16:33.760 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:16:33.760 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:16:33.760 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 12, 2024-09-21T03:16:33.760 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 33950, 2024-09-21T03:16:33.760 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:16:33.760 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:16:33.760 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:16:33.761 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:33.761 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 0, 2024-09-21T03:16:33.761 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:16:33.761 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:16:33.761 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:16:33.761 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:33.761 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:33.761 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:33.761 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:33.762 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:33.762 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:33.762 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:33.762 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:33.762 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:33.762 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:33.762 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:33.762 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:33.762 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:16:33.763 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:16:33.763 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:33.763 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:33.763 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:33.763 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:33.763 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:33.763 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:33.763 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:33.763 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:33.763 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:33.764 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:33.764 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:33.764 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:33.764 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.764 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:16:33.764 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:16:33.764 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:16:33.764 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:16:33.764 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:16:33.765 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:16:33.765 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:16:33.765 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:16:33.765 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:16:33.765 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:16:33.765 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:16:33.765 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:16:33.765 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:16:33.765 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:16:33.765 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:16:33.766 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:16:33.766 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:16:33.766 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:16:33.766 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:16:33.766 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:16:33.766 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:16:33.766 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:16:33.766 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:16:33.767 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:16:33.767 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:16:33.767 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:16:33.767 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:16:33.767 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:16:33.767 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:33.767 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:16:33.767 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.767 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:16:33.767 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.767 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:16:33.768 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:16:33.768 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:33.768 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:33.768 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.768 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:33.768 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:16:33.768 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:33.769 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.769 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.769 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:33.769 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:16:33.769 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:33.769 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:33.769 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:33.769 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.769 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:16:33.769 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:16:33.769 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:33.770 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:33.770 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:33.770 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.770 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.770 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:16:33.770 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:16:33.771 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:33.771 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:33.771 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.771 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:33.771 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:16:33.771 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:33.771 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.771 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.772 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:33.772 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:16:33.772 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:33.772 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:33.772 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:33.772 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.772 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:16:33.773 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:16:33.773 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:33.773 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:33.773 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:33.773 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.773 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.773 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:16:33.774 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:16:33.774 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:16:33.774 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:16:33.774 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.774 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:16:33.774 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:16:33.774 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:33.774 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.774 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.774 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:16:33.774 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:16:33.774 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:16:33.775 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:33.775 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:33.775 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.775 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:16:33.775 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:16:33.775 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:16:33.775 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:16:33.775 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:16:33.775 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:33.775 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:33.775 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.775 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:16:33.775 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:16:33.776 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.776 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:33.776 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:33.776 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:16:33.776 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:33.776 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:33.776 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:16:33.776 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.776 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:33.776 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:33.776 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:16:33.776 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:33.776 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:33.776 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:16:33.777 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.777 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:33.777 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:33.777 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:16:33.777 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:33.777 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:16:33.777 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:16:33.777 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:16:33.777 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:16:33.777 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:16:33.777 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:16:33.777 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:16:33.777 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:16:33.778 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:16:33.778 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:16:33.778 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:16:33.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.757+0000 7f06b5200640 1 -- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f068c078b40 msgr2=0x7f068c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:33.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.757+0000 7f06b5200640 1 --2- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f068c078b40 0x7f068c07b050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f06a8035000 tx=0x7f06a8004ab0 comp rx=0 tx=0).stop 2024-09-21T03:16:33.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.757+0000 7f06b5200640 1 -- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b00c65a0 msgr2=0x7f06b00a95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:33.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.757+0000 7f06b5200640 1 --2- 172.21.15.90:0/209014119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06b00c65a0 0x7f06b00a95b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f069800b550 tx=0x7f069800b950 comp rx=0 tx=0).stop 2024-09-21T03:16:33.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.758+0000 7f06ae800640 1 -- 172.21.15.90:0/209014119 reap_dead start 2024-09-21T03:16:33.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.758+0000 7f06ae800640 1 -- 172.21.15.90:0/209014119 reap_dead start 2024-09-21T03:16:33.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.758+0000 7f06b5200640 1 -- 172.21.15.90:0/209014119 shutdown_connections 2024-09-21T03:16:33.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.758+0000 7f06b5200640 1 -- 172.21.15.90:0/209014119 >> 172.21.15.90:0/209014119 conn(0x7f06b006d860 msgr2=0x7f06b00ad3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:33.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.758+0000 7f06b5200640 1 -- 172.21.15.90:0/209014119 shutdown_connections 2024-09-21T03:16:33.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:33.758+0000 7f06b5200640 1 -- 172.21.15.90:0/209014119 wait complete. 2024-09-21T03:16:33.781 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-21T03:16:33.781 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-21T03:16:34.428 INFO:tasks.workunit.client.1.smithi149.stderr:Updating files: 62% (7936/12697) Updating files: 63% (8000/12697) Updating files: 64% (8127/12697) Updating files: 65% (8254/12697) Updating files: 66% (8381/12697) Updating files: 67% (8507/12697) Updating files: 68% (8634/12697) Updating files: 69% (8761/12697) Updating files: 70% (8888/12697) Updating files: 71% (9015/12697) Updating files: 72% (9142/12697) Updating files: 73% (9269/12697) Updating files: 74% (9396/12697) Updating files: 75% (9523/12697) Updating files: 76% (9650/12697) Updating files: 77% (9777/12697) Updating files: 78% (9904/12697) Updating files: 79% (10031/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T03:16:35.287 INFO:tasks.workunit.client.1.smithi149.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T03:16:35.287 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-21T03:16:35.287 INFO:tasks.workunit.client.1.smithi149.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T03:16:35.287 INFO:tasks.workunit.client.1.smithi149.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T03:16:35.287 INFO:tasks.workunit.client.1.smithi149.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T03:16:35.287 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-21T03:16:35.287 INFO:tasks.workunit.client.1.smithi149.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T03:16:35.287 INFO:tasks.workunit.client.1.smithi149.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T03:16:35.289 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-21T03:16:35.289 INFO:tasks.workunit.client.1.smithi149.stderr: git switch -c 2024-09-21T03:16:35.289 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-21T03:16:35.289 INFO:tasks.workunit.client.1.smithi149.stderr:Or undo this operation with: 2024-09-21T03:16:35.290 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-21T03:16:35.290 INFO:tasks.workunit.client.1.smithi149.stderr: git switch - 2024-09-21T03:16:35.290 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-21T03:16:35.290 INFO:tasks.workunit.client.1.smithi149.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T03:16:35.290 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-21T03:16:35.290 INFO:tasks.workunit.client.1.smithi149.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T03:16:35.300 DEBUG:teuthology.orchestra.run.smithi149:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-21T03:16:35.420 INFO:tasks.workunit.client.1.smithi149.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T03:16:35.425 INFO:tasks.workunit.client.1.smithi149.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-21T03:16:35.425 INFO:tasks.workunit.client.1.smithi149.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T03:16:35.630 INFO:tasks.workunit.client.0.smithi090.stderr:Updating files: 63% (8076/12697) Updating files: 64% (8127/12697) Updating files: 65% (8254/12697) Updating files: 66% (8381/12697) Updating files: 67% (8507/12697) Updating files: 68% (8634/12697) Updating files: 69% (8761/12697) Updating files: 70% (8888/12697) Updating files: 71% (9015/12697) Updating files: 72% (9142/12697) Updating files: 73% (9269/12697) Updating files: 74% (9396/12697) Updating files: 75% (9523/12697) Updating files: 76% (9650/12697) Updating files: 77% (9777/12697) Updating files: 78% (9904/12697) Updating files: 79% (10031/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T03:16:36.075 INFO:tasks.workunit.client.1.smithi149.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T03:16:36.176 INFO:tasks.workunit.client.1.smithi149.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T03:16:36.242 INFO:tasks.workunit.client.1.smithi149.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-21T03:16:36.246 INFO:tasks.workunit.client.1.smithi149.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-21T03:16:36.246 INFO:tasks.workunit.client.1.smithi149.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T03:16:36.311 INFO:tasks.workunit.client.1.smithi149.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-21T03:16:36.318 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:16:36.318 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-21T03:16:36.353 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.1... 2024-09-21T03:16:36.355 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-09-21T03:16:36.355 DEBUG:teuthology.orchestra.run.smithi149:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/ffsb.sh 2024-09-21T03:16:36.445 INFO:tasks.workunit.client.1.smithi149.stderr:++ dirname /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/ffsb.sh 2024-09-21T03:16:36.447 INFO:tasks.workunit.client.1.smithi149.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.1/qa/workunits/suites 2024-09-21T03:16:36.447 INFO:tasks.workunit.client.1.smithi149.stderr:+ trap -- retry EXIT 2024-09-21T03:16:36.447 INFO:tasks.workunit.client.1.smithi149.stderr:+ rm -rf ffsb 2024-09-21T03:16:36.449 INFO:tasks.workunit.client.1.smithi149.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-09-21T03:16:36.455 INFO:tasks.workunit.client.1.smithi149.stderr:Cloning into 'ffsb'... 2024-09-21T03:16:36.587 INFO:tasks.workunit.client.0.smithi090.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T03:16:36.587 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-09-21T03:16:36.587 INFO:tasks.workunit.client.0.smithi090.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T03:16:36.587 INFO:tasks.workunit.client.0.smithi090.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T03:16:36.587 INFO:tasks.workunit.client.0.smithi090.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T03:16:36.587 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-09-21T03:16:36.587 INFO:tasks.workunit.client.0.smithi090.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T03:16:36.587 INFO:tasks.workunit.client.0.smithi090.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T03:16:36.587 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-09-21T03:16:36.587 INFO:tasks.workunit.client.0.smithi090.stderr: git switch -c 2024-09-21T03:16:36.588 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-09-21T03:16:36.588 INFO:tasks.workunit.client.0.smithi090.stderr:Or undo this operation with: 2024-09-21T03:16:36.588 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-09-21T03:16:36.588 INFO:tasks.workunit.client.0.smithi090.stderr: git switch - 2024-09-21T03:16:36.588 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-09-21T03:16:36.588 INFO:tasks.workunit.client.0.smithi090.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T03:16:36.588 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-09-21T03:16:36.588 INFO:tasks.workunit.client.0.smithi090.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T03:16:36.601 DEBUG:teuthology.orchestra.run.smithi090:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T03:16:36.646 INFO:tasks.workunit.client.0.smithi090.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T03:16:36.651 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T03:16:36.651 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T03:16:37.436 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T03:16:37.566 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T03:16:37.631 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T03:16:37.635 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T03:16:37.635 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T03:16:37.699 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T03:16:37.706 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:16:37.706 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T03:16:37.782 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-09-21T03:16:37.785 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-09-21T03:16:37.785 DEBUG:teuthology.orchestra.run.smithi090:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-21T03:16:37.875 INFO:tasks.workunit.client.0.smithi090.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-21T03:16:37.877 INFO:tasks.workunit.client.0.smithi090.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-09-21T03:16:37.877 INFO:tasks.workunit.client.0.smithi090.stderr:+ trap -- retry EXIT 2024-09-21T03:16:37.877 INFO:tasks.workunit.client.0.smithi090.stderr:+ rm -rf ffsb 2024-09-21T03:16:37.879 INFO:tasks.workunit.client.0.smithi090.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-09-21T03:16:37.885 INFO:tasks.workunit.client.0.smithi090.stderr:Cloning into 'ffsb'... 2024-09-21T03:16:39.708 INFO:tasks.workunit.client.1.smithi149.stderr:+ trap - EXIT 2024-09-21T03:16:39.708 INFO:tasks.workunit.client.1.smithi149.stderr:+ cd ffsb 2024-09-21T03:16:39.708 INFO:tasks.workunit.client.1.smithi149.stderr:+ ./configure 2024-09-21T03:16:39.956 INFO:tasks.workunit.client.1.smithi149.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-21T03:16:40.968 INFO:tasks.workunit.client.1.smithi149.stdout:checking whether build environment is sane... yes 2024-09-21T03:16:41.248 INFO:tasks.workunit.client.1.smithi149.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-21T03:16:41.248 INFO:tasks.workunit.client.1.smithi149.stdout:checking for gawk... gawk 2024-09-21T03:16:41.270 INFO:tasks.workunit.client.1.smithi149.stdout:checking whether make sets $(MAKE)... yes 2024-09-21T03:16:41.336 INFO:tasks.workunit.client.1.smithi149.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-21T03:16:41.337 INFO:tasks.workunit.client.1.smithi149.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-21T03:16:41.352 INFO:tasks.workunit.client.1.smithi149.stdout:checking for style of include used by make... GNU 2024-09-21T03:16:41.357 INFO:tasks.workunit.client.1.smithi149.stdout:checking for gcc... gcc 2024-09-21T03:16:41.449 INFO:tasks.workunit.client.1.smithi149.stdout:checking for C compiler default output file name... a.out 2024-09-21T03:16:41.454 INFO:tasks.workunit.client.1.smithi149.stdout:checking whether the C compiler works... yes 2024-09-21T03:16:41.457 INFO:tasks.workunit.client.1.smithi149.stdout:checking whether we are cross compiling... no 2024-09-21T03:16:41.516 INFO:tasks.workunit.client.1.smithi149.stdout:checking for suffix of executables... 2024-09-21T03:16:41.571 INFO:tasks.workunit.client.1.smithi149.stdout:checking for suffix of object files... o 2024-09-21T03:16:41.572 INFO:tasks.workunit.client.0.smithi090.stderr:+ trap - EXIT 2024-09-21T03:16:41.572 INFO:tasks.workunit.client.0.smithi090.stderr:+ cd ffsb 2024-09-21T03:16:41.572 INFO:tasks.workunit.client.0.smithi090.stderr:+ ./configure 2024-09-21T03:16:41.627 INFO:tasks.workunit.client.1.smithi149.stdout:checking whether we are using the GNU C compiler... yes 2024-09-21T03:16:41.869 INFO:tasks.workunit.client.0.smithi090.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-21T03:16:42.444 INFO:tasks.workunit.client.1.smithi149.stdout:checking whether gcc accepts -g... yes 2024-09-21T03:16:42.576 INFO:tasks.workunit.client.1.smithi149.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-21T03:16:42.709 INFO:tasks.workunit.client.1.smithi149.stdout:checking dependency style of gcc... gcc3 2024-09-21T03:16:42.800 INFO:tasks.workunit.client.1.smithi149.stdout:checking how to run the C preprocessor... gcc -E 2024-09-21T03:16:42.881 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether build environment is sane... yes 2024-09-21T03:16:42.897 INFO:tasks.workunit.client.0.smithi090.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-21T03:16:42.897 INFO:tasks.workunit.client.0.smithi090.stdout:checking for gawk... gawk 2024-09-21T03:16:42.920 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether make sets $(MAKE)... yes 2024-09-21T03:16:42.985 INFO:tasks.workunit.client.0.smithi090.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-21T03:16:42.985 INFO:tasks.workunit.client.0.smithi090.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-21T03:16:43.001 INFO:tasks.workunit.client.0.smithi090.stdout:checking for style of include used by make... GNU 2024-09-21T03:16:43.005 INFO:tasks.workunit.client.0.smithi090.stdout:checking for gcc... gcc 2024-09-21T03:16:43.098 INFO:tasks.workunit.client.0.smithi090.stdout:checking for C compiler default output file name... a.out 2024-09-21T03:16:43.102 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether the C compiler works... yes 2024-09-21T03:16:43.105 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether we are cross compiling... no 2024-09-21T03:16:43.111 INFO:tasks.workunit.client.1.smithi149.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-21T03:16:43.114 INFO:tasks.workunit.client.1.smithi149.stdout:checking for egrep... /usr/bin/grep -E 2024-09-21T03:16:43.134 INFO:tasks.workunit.client.1.smithi149.stdout:checking for AIX... no 2024-09-21T03:16:43.155 INFO:tasks.workunit.client.1.smithi149.stdout:checking for gcc... (cached) gcc 2024-09-21T03:16:43.166 INFO:tasks.workunit.client.0.smithi090.stdout:checking for suffix of executables... 2024-09-21T03:16:43.176 INFO:tasks.workunit.client.1.smithi149.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-21T03:16:43.177 INFO:tasks.workunit.client.1.smithi149.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-21T03:16:43.177 INFO:tasks.workunit.client.1.smithi149.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-21T03:16:43.178 INFO:tasks.workunit.client.1.smithi149.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-21T03:16:43.224 INFO:tasks.workunit.client.0.smithi090.stdout:checking for suffix of object files... o 2024-09-21T03:16:43.278 INFO:tasks.workunit.client.1.smithi149.stdout:checking for main in -lm... yes 2024-09-21T03:16:43.281 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether we are using the GNU C compiler... yes 2024-09-21T03:16:43.385 INFO:tasks.workunit.client.1.smithi149.stdout:checking for main in -lpthread... yes 2024-09-21T03:16:43.447 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether gcc accepts -g... yes 2024-09-21T03:16:43.564 INFO:tasks.workunit.client.0.smithi090.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-21T03:16:43.647 INFO:tasks.workunit.client.1.smithi149.stdout:checking for ANSI C header files... yes 2024-09-21T03:16:43.720 INFO:tasks.workunit.client.0.smithi090.stdout:checking dependency style of gcc... gcc3 2024-09-21T03:16:43.739 INFO:tasks.workunit.client.1.smithi149.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-21T03:16:43.819 INFO:tasks.workunit.client.1.smithi149.stdout:checking for sys/types.h... yes 2024-09-21T03:16:43.846 INFO:tasks.workunit.client.0.smithi090.stdout:checking how to run the C preprocessor... gcc -E 2024-09-21T03:16:43.906 INFO:tasks.workunit.client.1.smithi149.stdout:checking for sys/stat.h... yes 2024-09-21T03:16:43.925 INFO:tasks.workunit.client.0.smithi090.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-21T03:16:43.928 INFO:tasks.workunit.client.0.smithi090.stdout:checking for egrep... /usr/bin/grep -E 2024-09-21T03:16:43.948 INFO:tasks.workunit.client.0.smithi090.stdout:checking for AIX... no 2024-09-21T03:16:43.980 INFO:tasks.workunit.client.0.smithi090.stdout:checking for gcc... (cached) gcc 2024-09-21T03:16:43.989 INFO:tasks.workunit.client.1.smithi149.stdout:checking for stdlib.h... yes 2024-09-21T03:16:43.999 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-21T03:16:44.001 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-21T03:16:44.001 INFO:tasks.workunit.client.0.smithi090.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-21T03:16:44.001 INFO:tasks.workunit.client.0.smithi090.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-21T03:16:44.072 INFO:tasks.workunit.client.1.smithi149.stdout:checking for string.h... yes 2024-09-21T03:16:44.100 INFO:tasks.workunit.client.0.smithi090.stdout:checking for main in -lm... yes 2024-09-21T03:16:44.154 INFO:tasks.workunit.client.1.smithi149.stdout:checking for memory.h... yes 2024-09-21T03:16:44.187 INFO:tasks.workunit.client.0.smithi090.stdout:checking for main in -lpthread... yes 2024-09-21T03:16:44.238 INFO:tasks.workunit.client.1.smithi149.stdout:checking for strings.h... yes 2024-09-21T03:16:44.325 INFO:tasks.workunit.client.1.smithi149.stdout:checking for inttypes.h... yes 2024-09-21T03:16:44.407 INFO:tasks.workunit.client.1.smithi149.stdout:checking for stdint.h... yes 2024-09-21T03:16:44.468 INFO:tasks.workunit.client.0.smithi090.stdout:checking for ANSI C header files... yes 2024-09-21T03:16:44.497 INFO:tasks.workunit.client.1.smithi149.stdout:checking for unistd.h... yes 2024-09-21T03:16:44.590 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-21T03:16:44.606 INFO:tasks.workunit.client.1.smithi149.stdout:checking pthread.h usability... yes 2024-09-21T03:16:44.646 INFO:tasks.workunit.client.1.smithi149.stdout:checking pthread.h presence... yes 2024-09-21T03:16:44.646 INFO:tasks.workunit.client.1.smithi149.stdout:checking for pthread.h... yes 2024-09-21T03:16:44.664 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sys/types.h... yes 2024-09-21T03:16:44.738 INFO:tasks.workunit.client.1.smithi149.stdout:checking fcntl.h usability... yes 2024-09-21T03:16:44.752 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sys/stat.h... yes 2024-09-21T03:16:44.777 INFO:tasks.workunit.client.1.smithi149.stdout:checking fcntl.h presence... yes 2024-09-21T03:16:44.778 INFO:tasks.workunit.client.1.smithi149.stdout:checking for fcntl.h... yes 2024-09-21T03:16:44.833 INFO:tasks.workunit.client.0.smithi090.stdout:checking for stdlib.h... yes 2024-09-21T03:16:44.916 INFO:tasks.workunit.client.0.smithi090.stdout:checking for string.h... yes 2024-09-21T03:16:44.999 INFO:tasks.workunit.client.0.smithi090.stdout:checking for memory.h... yes 2024-09-21T03:16:45.062 INFO:tasks.workunit.client.1.smithi149.stdout:checking limits.h usability... yes 2024-09-21T03:16:45.084 INFO:tasks.workunit.client.0.smithi090.stdout:checking for strings.h... yes 2024-09-21T03:16:45.168 INFO:tasks.workunit.client.0.smithi090.stdout:checking for inttypes.h... yes 2024-09-21T03:16:45.250 INFO:tasks.workunit.client.0.smithi090.stdout:checking for stdint.h... yes 2024-09-21T03:16:45.338 INFO:tasks.workunit.client.0.smithi090.stdout:checking for unistd.h... yes 2024-09-21T03:16:45.440 INFO:tasks.workunit.client.0.smithi090.stdout:checking pthread.h usability... yes 2024-09-21T03:16:45.458 INFO:tasks.workunit.client.1.smithi149.stdout:checking limits.h presence... yes 2024-09-21T03:16:45.459 INFO:tasks.workunit.client.1.smithi149.stdout:checking for limits.h... yes 2024-09-21T03:16:45.480 INFO:tasks.workunit.client.0.smithi090.stdout:checking pthread.h presence... yes 2024-09-21T03:16:45.482 INFO:tasks.workunit.client.0.smithi090.stdout:checking for pthread.h... yes 2024-09-21T03:16:45.488 INFO:tasks.workunit.client.1.smithi149.stdout:checking for stdint.h... (cached) yes 2024-09-21T03:16:45.566 INFO:tasks.workunit.client.1.smithi149.stdout:checking sys/time.h usability... yes 2024-09-21T03:16:45.569 INFO:tasks.workunit.client.0.smithi090.stdout:checking fcntl.h usability... yes 2024-09-21T03:16:45.604 INFO:tasks.workunit.client.1.smithi149.stdout:checking sys/time.h presence... yes 2024-09-21T03:16:45.605 INFO:tasks.workunit.client.1.smithi149.stdout:checking for sys/time.h... yes 2024-09-21T03:16:45.608 INFO:tasks.workunit.client.0.smithi090.stdout:checking fcntl.h presence... yes 2024-09-21T03:16:45.609 INFO:tasks.workunit.client.0.smithi090.stdout:checking for fcntl.h... yes 2024-09-21T03:16:45.629 INFO:tasks.workunit.client.1.smithi149.stdout:checking for unistd.h... (cached) yes 2024-09-21T03:16:45.705 INFO:tasks.workunit.client.0.smithi090.stdout:checking limits.h usability... yes 2024-09-21T03:16:45.719 INFO:tasks.workunit.client.1.smithi149.stdout:checking sys/vfs.h usability... yes 2024-09-21T03:16:45.742 INFO:tasks.workunit.client.0.smithi090.stdout:checking limits.h presence... yes 2024-09-21T03:16:45.743 INFO:tasks.workunit.client.0.smithi090.stdout:checking for limits.h... yes 2024-09-21T03:16:45.762 INFO:tasks.workunit.client.1.smithi149.stdout:checking sys/vfs.h presence... yes 2024-09-21T03:16:45.762 INFO:tasks.workunit.client.1.smithi149.stdout:checking for sys/vfs.h... yes 2024-09-21T03:16:45.767 INFO:tasks.workunit.client.0.smithi090.stdout:checking for stdint.h... (cached) yes 2024-09-21T03:16:45.851 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/time.h usability... yes 2024-09-21T03:16:45.888 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/time.h presence... yes 2024-09-21T03:16:45.889 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sys/time.h... yes 2024-09-21T03:16:45.912 INFO:tasks.workunit.client.0.smithi090.stdout:checking for unistd.h... (cached) yes 2024-09-21T03:16:45.998 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/vfs.h usability... yes 2024-09-21T03:16:46.035 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/vfs.h presence... yes 2024-09-21T03:16:46.035 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sys/vfs.h... yes 2024-09-21T03:16:46.114 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/limits.h usability... no 2024-09-21T03:16:46.151 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/limits.h presence... no 2024-09-21T03:16:46.152 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sys/limits.h... no 2024-09-21T03:16:46.175 INFO:tasks.workunit.client.1.smithi149.stdout:checking sys/limits.h usability... no 2024-09-21T03:16:46.210 INFO:tasks.workunit.client.0.smithi090.stdout:checking for an ANSI C-conforming const... yes 2024-09-21T03:16:46.214 INFO:tasks.workunit.client.1.smithi149.stdout:checking sys/limits.h presence... no 2024-09-21T03:16:46.215 INFO:tasks.workunit.client.1.smithi149.stdout:checking for sys/limits.h... no 2024-09-21T03:16:46.270 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-21T03:16:46.272 INFO:tasks.workunit.client.0.smithi090.stdout:checking for function prototypes... yes 2024-09-21T03:16:46.274 INFO:tasks.workunit.client.1.smithi149.stdout:checking for an ANSI C-conforming const... yes 2024-09-21T03:16:46.322 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether setvbuf arguments are reversed... no 2024-09-21T03:16:46.339 INFO:tasks.workunit.client.1.smithi149.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-21T03:16:46.341 INFO:tasks.workunit.client.1.smithi149.stdout:checking for function prototypes... yes 2024-09-21T03:16:46.393 INFO:tasks.workunit.client.1.smithi149.stdout:checking whether setvbuf arguments are reversed... no 2024-09-21T03:16:46.436 INFO:tasks.workunit.client.0.smithi090.stdout:checking for system... yes 2024-09-21T03:16:46.509 INFO:tasks.workunit.client.1.smithi149.stdout:checking for system... yes 2024-09-21T03:16:46.841 INFO:tasks.workunit.client.0.smithi090.stdout:checking for gettimeofday... yes 2024-09-21T03:16:46.883 INFO:tasks.workunit.client.1.smithi149.stdout:checking for gettimeofday... yes 2024-09-21T03:16:46.948 INFO:tasks.workunit.client.0.smithi090.stdout:checking for mkdir... yes 2024-09-21T03:16:46.991 INFO:tasks.workunit.client.1.smithi149.stdout:checking for mkdir... yes 2024-09-21T03:16:47.053 INFO:tasks.workunit.client.0.smithi090.stdout:checking for strerror... yes 2024-09-21T03:16:47.097 INFO:tasks.workunit.client.1.smithi149.stdout:checking for strerror... yes 2024-09-21T03:16:47.161 INFO:tasks.workunit.client.0.smithi090.stdout:checking for open64... yes 2024-09-21T03:16:47.213 INFO:tasks.workunit.client.1.smithi149.stdout:checking for open64... yes 2024-09-21T03:16:47.530 INFO:tasks.workunit.client.0.smithi090.stdout:checking for stat64... yes 2024-09-21T03:16:47.593 INFO:tasks.workunit.client.1.smithi149.stdout:checking for stat64... yes 2024-09-21T03:16:47.649 INFO:tasks.workunit.client.0.smithi090.stdout:checking for fseeko64... yes 2024-09-21T03:16:47.758 INFO:tasks.workunit.client.0.smithi090.stdout:checking for lrand48_r... yes 2024-09-21T03:16:47.862 INFO:tasks.workunit.client.0.smithi090.stdout:checking for srand48_r... yes 2024-09-21T03:16:47.903 INFO:tasks.workunit.client.0.smithi090.stdout:configure: creating ./config.status 2024-09-21T03:16:48.106 INFO:tasks.workunit.client.0.smithi090.stdout:config.status: creating Makefile 2024-09-21T03:16:48.135 INFO:tasks.workunit.client.0.smithi090.stdout:config.status: creating config.h 2024-09-21T03:16:48.150 INFO:tasks.workunit.client.1.smithi149.stdout:checking for fseeko64... yes 2024-09-21T03:16:48.169 INFO:tasks.workunit.client.0.smithi090.stdout:config.status: executing depfiles commands 2024-09-21T03:16:48.258 INFO:tasks.workunit.client.1.smithi149.stdout:checking for lrand48_r... yes 2024-09-21T03:16:48.264 INFO:tasks.workunit.client.0.smithi090.stdout:config.status: executing default commands 2024-09-21T03:16:48.367 INFO:tasks.workunit.client.1.smithi149.stdout:checking for srand48_r... yes 2024-09-21T03:16:48.408 INFO:tasks.workunit.client.1.smithi149.stdout:configure: creating ./config.status 2024-09-21T03:16:48.609 INFO:tasks.workunit.client.1.smithi149.stdout:config.status: creating Makefile 2024-09-21T03:16:48.637 INFO:tasks.workunit.client.1.smithi149.stdout:config.status: creating config.h 2024-09-21T03:16:48.670 INFO:tasks.workunit.client.1.smithi149.stdout:config.status: executing depfiles commands 2024-09-21T03:16:48.766 INFO:tasks.workunit.client.1.smithi149.stdout:config.status: executing default commands 2024-09-21T03:16:48.770 INFO:tasks.workunit.client.0.smithi090.stderr:+ make 2024-09-21T03:16:48.782 INFO:tasks.workunit.client.0.smithi090.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-09-21T03:16:48.787 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-09-21T03:16:48.789 INFO:tasks.workunit.client.0.smithi090.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-09-21T03:16:48.789 INFO:tasks.workunit.client.0.smithi090.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-09-21T03:16:48.789 INFO:tasks.workunit.client.0.smithi090.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-09-21T03:16:48.789 INFO:tasks.workunit.client.0.smithi090.stderr: any GNU archive site. 2024-09-21T03:16:48.793 INFO:tasks.workunit.client.0.smithi090.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-09-21T03:16:48.796 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-09-21T03:16:48.798 INFO:tasks.workunit.client.0.smithi090.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-09-21T03:16:48.799 INFO:tasks.workunit.client.0.smithi090.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-09-21T03:16:48.799 INFO:tasks.workunit.client.0.smithi090.stderr: You might want to install the `Automake' and `Perl' packages. 2024-09-21T03:16:48.799 INFO:tasks.workunit.client.0.smithi090.stderr: Grab them from any GNU archive site. 2024-09-21T03:16:48.829 INFO:tasks.workunit.client.1.smithi149.stderr:+ make 2024-09-21T03:16:48.838 INFO:tasks.workunit.client.1.smithi149.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run aclocal-1.10 2024-09-21T03:16:48.843 INFO:tasks.workunit.client.1.smithi149.stderr:/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-09-21T03:16:48.844 INFO:tasks.workunit.client.1.smithi149.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-09-21T03:16:48.845 INFO:tasks.workunit.client.1.smithi149.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-09-21T03:16:48.845 INFO:tasks.workunit.client.1.smithi149.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-09-21T03:16:48.845 INFO:tasks.workunit.client.1.smithi149.stderr: any GNU archive site. 2024-09-21T03:16:48.849 INFO:tasks.workunit.client.1.smithi149.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run automake-1.10 --gnu 2024-09-21T03:16:48.852 INFO:tasks.workunit.client.1.smithi149.stderr:/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-09-21T03:16:48.854 INFO:tasks.workunit.client.1.smithi149.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-09-21T03:16:48.854 INFO:tasks.workunit.client.1.smithi149.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-09-21T03:16:48.854 INFO:tasks.workunit.client.1.smithi149.stderr: You might want to install the `Automake' and `Perl' packages. 2024-09-21T03:16:48.854 INFO:tasks.workunit.client.1.smithi149.stderr: Grab them from any GNU archive site. 2024-09-21T03:16:49.183 INFO:tasks.workunit.client.1.smithi149.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run autoconf 2024-09-21T03:16:49.536 INFO:tasks.workunit.client.1.smithi149.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-09-21T03:16:49.537 INFO:tasks.workunit.client.1.smithi149.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-09-21T03:16:49.537 INFO:tasks.workunit.client.1.smithi149.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-09-21T03:16:49.537 INFO:tasks.workunit.client.1.smithi149.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-09-21T03:16:49.677 INFO:tasks.workunit.client.1.smithi149.stdout:/bin/sh ./config.status --recheck 2024-09-21T03:16:49.795 INFO:tasks.workunit.client.1.smithi149.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-09-21T03:16:49.818 INFO:tasks.workunit.client.0.smithi090.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-09-21T03:16:50.110 INFO:tasks.workunit.client.1.smithi149.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-21T03:16:50.244 INFO:tasks.workunit.client.0.smithi090.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-09-21T03:16:50.245 INFO:tasks.workunit.client.0.smithi090.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-09-21T03:16:50.245 INFO:tasks.workunit.client.0.smithi090.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-09-21T03:16:50.245 INFO:tasks.workunit.client.0.smithi090.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-09-21T03:16:50.383 INFO:tasks.workunit.client.0.smithi090.stdout:/bin/sh ./config.status --recheck 2024-09-21T03:16:50.497 INFO:tasks.workunit.client.0.smithi090.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-09-21T03:16:50.696 INFO:tasks.workunit.client.0.smithi090.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-21T03:16:51.122 INFO:tasks.workunit.client.1.smithi149.stdout:checking whether build environment is sane... yes 2024-09-21T03:16:51.132 INFO:tasks.workunit.client.1.smithi149.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-21T03:16:51.132 INFO:tasks.workunit.client.1.smithi149.stdout:checking for gawk... gawk 2024-09-21T03:16:51.154 INFO:tasks.workunit.client.1.smithi149.stdout:checking whether make sets $(MAKE)... yes 2024-09-21T03:16:51.219 INFO:tasks.workunit.client.1.smithi149.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-21T03:16:51.219 INFO:tasks.workunit.client.1.smithi149.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-21T03:16:51.235 INFO:tasks.workunit.client.1.smithi149.stdout:checking for style of include used by make... GNU 2024-09-21T03:16:51.240 INFO:tasks.workunit.client.1.smithi149.stdout:checking for gcc... gcc 2024-09-21T03:16:51.708 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether build environment is sane... yes 2024-09-21T03:16:51.719 INFO:tasks.workunit.client.0.smithi090.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-21T03:16:51.719 INFO:tasks.workunit.client.0.smithi090.stdout:checking for gawk... gawk 2024-09-21T03:16:51.737 INFO:tasks.workunit.client.1.smithi149.stdout:checking whether the C compiler works... yes 2024-09-21T03:16:51.737 INFO:tasks.workunit.client.1.smithi149.stdout:checking for C compiler default output file name... a.out 2024-09-21T03:16:51.743 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether make sets $(MAKE)... yes 2024-09-21T03:16:51.800 INFO:tasks.workunit.client.1.smithi149.stdout:checking for suffix of executables... 2024-09-21T03:16:51.807 INFO:tasks.workunit.client.0.smithi090.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-21T03:16:51.807 INFO:tasks.workunit.client.0.smithi090.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-21T03:16:51.824 INFO:tasks.workunit.client.0.smithi090.stdout:checking for style of include used by make... GNU 2024-09-21T03:16:51.830 INFO:tasks.workunit.client.0.smithi090.stdout:checking for gcc... gcc 2024-09-21T03:16:51.866 INFO:tasks.workunit.client.1.smithi149.stdout:checking whether we are cross compiling... no 2024-09-21T03:16:51.920 INFO:tasks.workunit.client.1.smithi149.stdout:checking for suffix of object files... o 2024-09-21T03:16:52.131 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether the C compiler works... yes 2024-09-21T03:16:52.131 INFO:tasks.workunit.client.0.smithi090.stdout:checking for C compiler default output file name... a.out 2024-09-21T03:16:52.197 INFO:tasks.workunit.client.0.smithi090.stdout:checking for suffix of executables... 2024-09-21T03:16:52.262 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether we are cross compiling... no 2024-09-21T03:16:52.327 INFO:tasks.workunit.client.0.smithi090.stdout:checking for suffix of object files... o 2024-09-21T03:16:52.370 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether we are using the GNU C compiler... yes 2024-09-21T03:16:52.414 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether gcc accepts -g... yes 2024-09-21T03:16:52.751 INFO:tasks.workunit.client.0.smithi090.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-21T03:16:52.912 INFO:tasks.workunit.client.1.smithi149.stdout:checking whether we are using the GNU C compiler... yes 2024-09-21T03:16:52.952 INFO:tasks.workunit.client.1.smithi149.stdout:checking whether gcc accepts -g... yes 2024-09-21T03:16:53.014 INFO:tasks.workunit.client.1.smithi149.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-21T03:16:53.782 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-21T03:16:53.782 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-21T03:16:53.782 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-21T03:16:53.787 INFO:tasks.ceph.mon.a:Started 2024-09-21T03:16:53.787 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-21T03:16:53.787 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:16:53.791 INFO:tasks.workunit.client.0.smithi090.stdout:checking dependency style of gcc... gcc3 2024-09-21T03:16:53.873 INFO:tasks.workunit.client.1.smithi149.stdout:checking dependency style of gcc... gcc3 2024-09-21T03:16:53.882 INFO:tasks.workunit.client.0.smithi090.stdout:checking how to run the C preprocessor... gcc -E 2024-09-21T03:16:53.951 INFO:tasks.workunit.client.1.smithi149.stdout:checking how to run the C preprocessor... gcc -E 2024-09-21T03:16:53.966 INFO:tasks.workunit.client.0.smithi090.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-21T03:16:53.970 INFO:tasks.workunit.client.0.smithi090.stdout:checking for egrep... /usr/bin/grep -E 2024-09-21T03:16:54.035 INFO:tasks.workunit.client.1.smithi149.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-21T03:16:54.038 INFO:tasks.workunit.client.1.smithi149.stdout:checking for egrep... /usr/bin/grep -E 2024-09-21T03:16:54.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.040+0000 7f2936200640 1 -- 172.21.15.90:0/7161918 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29300cb140 msgr2=0x7f29300cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:54.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.040+0000 7f2936200640 1 --2- 172.21.15.90:0/7161918 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29300cb140 0x7f29300cb550 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f291c009830 tx=0x7f291c02a480 comp rx=0 tx=0).stop 2024-09-21T03:16:54.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.040+0000 7f2936200640 1 -- 172.21.15.90:0/7161918 shutdown_connections 2024-09-21T03:16:54.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.040+0000 7f2936200640 1 --2- 172.21.15.90:0/7161918 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29300cb140 0x7f29300cb550 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:54.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.040+0000 7f2936200640 1 --2- 172.21.15.90:0/7161918 >> v2:172.21.15.90:3300/0 conn(0x7f293006e630 0x7f2930154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:54.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.040+0000 7f2936200640 1 -- 172.21.15.90:0/7161918 >> 172.21.15.90:0/7161918 conn(0x7f29300c8d60 msgr2=0x7f29300c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:54.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.040+0000 7f2936200640 1 -- 172.21.15.90:0/7161918 shutdown_connections 2024-09-21T03:16:54.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.040+0000 7f2936200640 1 -- 172.21.15.90:0/7161918 wait complete. 2024-09-21T03:16:54.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.043+0000 7f2936200640 1 Processor -- start 2024-09-21T03:16:54.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.043+0000 7f2936200640 1 -- start start 2024-09-21T03:16:54.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.044+0000 7f2936200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f293006e630 0x7f29300c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:54.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.044+0000 7f2936200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29300c7460 0x7f29300c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:54.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.044+0000 7f2936200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29300cb140 0x7f29300c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:54.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.044+0000 7f2936200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f29300cba90 con 0x7f29300c7460 2024-09-21T03:16:54.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.044+0000 7f2936200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f29300ca940 con 0x7f293006e630 2024-09-21T03:16:54.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.044+0000 7f2936200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f29301582a0 con 0x7f29300cb140 2024-09-21T03:16:54.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.044+0000 7f292fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29300c7460 0x7f29300c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:54.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.044+0000 7f292fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29300c7460 0x7f29300c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57778/0 (socket says 172.21.15.90:57778) 2024-09-21T03:16:54.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.044+0000 7f292fe00640 1 -- 172.21.15.90:0/1770154616 learned_addr learned my addr 172.21.15.90:0/1770154616 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:16:54.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.044+0000 7f2934e00640 1 --2- 172.21.15.90:0/1770154616 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f293006e630 0x7f29300c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:54.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.045+0000 7f2935800640 1 --2- 172.21.15.90:0/1770154616 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29300cb140 0x7f29300c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:54.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.045+0000 7f292fe00640 1 -- 172.21.15.90:0/1770154616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29300c7460 msgr2=0x7f29300c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-21T03:16:54.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.045+0000 7f292fe00640 1 -- 172.21.15.90:0/1770154616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29300c7460 msgr2=0x7f29300c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T03:16:54.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.045+0000 7f292fe00640 1 --2- 172.21.15.90:0/1770154616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29300c7460 0x7f29300c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T03:16:54.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.045+0000 7f292fe00640 1 --2- 172.21.15.90:0/1770154616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29300c7460 0x7f29300c5bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:16:54.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.045+0000 7f2934e00640 1 -- 172.21.15.90:0/1770154616 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29300cb140 msgr2=0x7f29300c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:54.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.045+0000 7f2934e00640 1 --2- 172.21.15.90:0/1770154616 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29300cb140 0x7f29300c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:54.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.045+0000 7f2934e00640 1 -- 172.21.15.90:0/1770154616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29300c7460 msgr2=0x7f29300c5bf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:16:54.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.045+0000 7f2934e00640 1 --2- 172.21.15.90:0/1770154616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29300c7460 0x7f29300c5bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:54.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.045+0000 7f2934e00640 1 -- 172.21.15.90:0/1770154616 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29300c0740 con 0x7f293006e630 2024-09-21T03:16:54.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.045+0000 7f2935800640 1 --2- 172.21.15.90:0/1770154616 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29300cb140 0x7f29300c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:16:54.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.045+0000 7f2934e00640 1 --2- 172.21.15.90:0/1770154616 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f293006e630 0x7f29300c4b90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f292400b440 tx=0x7f292400b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:54.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.046+0000 7f292cc00640 1 -- 172.21.15.90:0/1770154616 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2924011830 con 0x7f293006e630 2024-09-21T03:16:54.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.046+0000 7f292cc00640 1 -- 172.21.15.90:0/1770154616 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2924016070 con 0x7f293006e630 2024-09-21T03:16:54.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.046+0000 7f292cc00640 1 -- 172.21.15.90:0/1770154616 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2924011d60 con 0x7f293006e630 2024-09-21T03:16:54.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.046+0000 7f2936200640 1 -- 172.21.15.90:0/1770154616 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29300c4670 con 0x7f293006e630 2024-09-21T03:16:54.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.046+0000 7f2936200640 1 -- 172.21.15.90:0/1770154616 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29301ea970 con 0x7f293006e630 2024-09-21T03:16:54.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.047+0000 7f2936200640 1 -- 172.21.15.90:0/1770154616 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f293006d750 con 0x7f293006e630 2024-09-21T03:16:54.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.048+0000 7f292cc00640 1 -- 172.21.15.90:0/1770154616 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f292401b460 con 0x7f293006e630 2024-09-21T03:16:54.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.049+0000 7f292cc00640 1 --2- 172.21.15.90:0/1770154616 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2910078b90 0x7f291007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:16:54.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.049+0000 7f292cc00640 1 -- 172.21.15.90:0/1770154616 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f292409aca0 con 0x7f293006e630 2024-09-21T03:16:54.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.050+0000 7f292fe00640 1 --2- 172.21.15.90:0/1770154616 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2910078b90 0x7f291007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:16:54.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.050+0000 7f292fe00640 1 --2- 172.21.15.90:0/1770154616 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2910078b90 0x7f291007b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f291c009830 tx=0x7f291c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:16:54.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.054+0000 7f292cc00640 1 -- 172.21.15.90:0/1770154616 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2924062d50 con 0x7f293006e630 2024-09-21T03:16:54.273 INFO:tasks.workunit.client.1.smithi149.stdout:checking for ANSI C header files... yes 2024-09-21T03:16:54.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:54.316+0000 7f2936200640 1 -- 172.21.15.90:0/1770154616 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f29301549f0 con 0x7f293006e630 2024-09-21T03:16:54.333 INFO:tasks.workunit.client.1.smithi149.stdout:checking for sys/types.h... yes 2024-09-21T03:16:54.405 INFO:tasks.workunit.client.1.smithi149.stdout:checking for sys/stat.h... yes 2024-09-21T03:16:54.474 INFO:tasks.workunit.client.1.smithi149.stdout:checking for stdlib.h... yes 2024-09-21T03:16:54.543 INFO:tasks.workunit.client.1.smithi149.stdout:checking for string.h... yes 2024-09-21T03:16:54.746 INFO:tasks.workunit.client.1.smithi149.stdout:checking for memory.h... yes 2024-09-21T03:16:54.811 INFO:tasks.workunit.client.1.smithi149.stdout:checking for strings.h... yes 2024-09-21T03:16:54.881 INFO:tasks.workunit.client.1.smithi149.stdout:checking for inttypes.h... yes 2024-09-21T03:16:54.950 INFO:tasks.workunit.client.1.smithi149.stdout:checking for stdint.h... yes 2024-09-21T03:16:55.022 INFO:tasks.workunit.client.1.smithi149.stdout:checking for unistd.h... yes 2024-09-21T03:16:55.098 INFO:tasks.workunit.client.1.smithi149.stdout:checking minix/config.h usability... no 2024-09-21T03:16:55.140 INFO:tasks.workunit.client.1.smithi149.stdout:checking minix/config.h presence... no 2024-09-21T03:16:55.140 INFO:tasks.workunit.client.1.smithi149.stdout:checking for minix/config.h... no 2024-09-21T03:16:55.197 INFO:tasks.workunit.client.1.smithi149.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-09-21T03:16:55.198 INFO:tasks.workunit.client.1.smithi149.stdout:checking for gcc... (cached) gcc 2024-09-21T03:16:55.259 INFO:tasks.workunit.client.1.smithi149.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-21T03:16:55.259 INFO:tasks.workunit.client.1.smithi149.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-21T03:16:55.259 INFO:tasks.workunit.client.1.smithi149.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-21T03:16:55.259 INFO:tasks.workunit.client.1.smithi149.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-21T03:16:55.332 INFO:tasks.workunit.client.1.smithi149.stdout:checking for main in -lm... yes 2024-09-21T03:16:55.337 INFO:tasks.workunit.client.0.smithi090.stdout:checking for ANSI C header files... yes 2024-09-21T03:16:55.392 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sys/types.h... yes 2024-09-21T03:16:55.405 INFO:tasks.workunit.client.1.smithi149.stdout:checking for main in -lpthread... yes 2024-09-21T03:16:55.407 INFO:tasks.workunit.client.1.smithi149.stdout:checking for ANSI C header files... (cached) yes 2024-09-21T03:16:55.456 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sys/stat.h... yes 2024-09-21T03:16:55.464 INFO:tasks.workunit.client.1.smithi149.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-21T03:16:55.521 INFO:tasks.workunit.client.0.smithi090.stdout:checking for stdlib.h... yes 2024-09-21T03:16:55.555 INFO:tasks.workunit.client.1.smithi149.stdout:checking pthread.h usability... yes 2024-09-21T03:16:55.586 INFO:tasks.workunit.client.1.smithi149.stdout:checking pthread.h presence... yes 2024-09-21T03:16:55.586 INFO:tasks.workunit.client.1.smithi149.stdout:checking for pthread.h... yes 2024-09-21T03:16:55.591 INFO:tasks.workunit.client.0.smithi090.stdout:checking for string.h... yes 2024-09-21T03:16:55.658 INFO:tasks.workunit.client.0.smithi090.stdout:checking for memory.h... yes 2024-09-21T03:16:55.668 INFO:tasks.workunit.client.1.smithi149.stdout:checking fcntl.h usability... yes 2024-09-21T03:16:55.698 INFO:tasks.workunit.client.1.smithi149.stdout:checking fcntl.h presence... yes 2024-09-21T03:16:55.698 INFO:tasks.workunit.client.1.smithi149.stdout:checking for fcntl.h... yes 2024-09-21T03:16:55.728 INFO:tasks.workunit.client.0.smithi090.stdout:checking for strings.h... yes 2024-09-21T03:16:55.786 INFO:tasks.workunit.client.1.smithi149.stdout:checking limits.h usability... yes 2024-09-21T03:16:55.794 INFO:tasks.workunit.client.0.smithi090.stdout:checking for inttypes.h... yes 2024-09-21T03:16:55.813 INFO:tasks.workunit.client.1.smithi149.stdout:checking limits.h presence... yes 2024-09-21T03:16:55.813 INFO:tasks.workunit.client.1.smithi149.stdout:checking for limits.h... yes 2024-09-21T03:16:55.834 INFO:tasks.workunit.client.1.smithi149.stdout:checking for stdint.h... (cached) yes 2024-09-21T03:16:55.862 INFO:tasks.workunit.client.0.smithi090.stdout:checking for stdint.h... yes 2024-09-21T03:16:55.909 INFO:tasks.workunit.client.1.smithi149.stdout:checking sys/time.h usability... yes 2024-09-21T03:16:55.936 INFO:tasks.workunit.client.0.smithi090.stdout:checking for unistd.h... yes 2024-09-21T03:16:55.938 INFO:tasks.workunit.client.1.smithi149.stdout:checking sys/time.h presence... yes 2024-09-21T03:16:55.938 INFO:tasks.workunit.client.1.smithi149.stdout:checking for sys/time.h... yes 2024-09-21T03:16:55.959 INFO:tasks.workunit.client.1.smithi149.stdout:checking for unistd.h... (cached) yes 2024-09-21T03:16:56.005 INFO:tasks.workunit.client.0.smithi090.stdout:checking minix/config.h usability... no 2024-09-21T03:16:56.030 INFO:tasks.workunit.client.1.smithi149.stdout:checking sys/vfs.h usability... yes 2024-09-21T03:16:56.048 INFO:tasks.workunit.client.0.smithi090.stdout:checking minix/config.h presence... no 2024-09-21T03:16:56.048 INFO:tasks.workunit.client.0.smithi090.stdout:checking for minix/config.h... no 2024-09-21T03:16:56.058 INFO:tasks.workunit.client.1.smithi149.stdout:checking sys/vfs.h presence... yes 2024-09-21T03:16:56.058 INFO:tasks.workunit.client.1.smithi149.stdout:checking for sys/vfs.h... yes 2024-09-21T03:16:56.108 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-09-21T03:16:56.109 INFO:tasks.workunit.client.0.smithi090.stdout:checking for gcc... (cached) gcc 2024-09-21T03:16:56.173 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-21T03:16:56.173 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-21T03:16:56.173 INFO:tasks.workunit.client.0.smithi090.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-21T03:16:56.174 INFO:tasks.workunit.client.0.smithi090.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-21T03:16:56.246 INFO:tasks.workunit.client.0.smithi090.stdout:checking for main in -lm... yes 2024-09-21T03:16:56.321 INFO:tasks.workunit.client.0.smithi090.stdout:checking for main in -lpthread... yes 2024-09-21T03:16:56.323 INFO:tasks.workunit.client.0.smithi090.stdout:checking for ANSI C header files... (cached) yes 2024-09-21T03:16:56.349 INFO:tasks.workunit.client.1.smithi149.stdout:checking sys/limits.h usability... no 2024-09-21T03:16:56.387 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-21T03:16:56.391 INFO:tasks.workunit.client.1.smithi149.stdout:checking sys/limits.h presence... no 2024-09-21T03:16:56.391 INFO:tasks.workunit.client.1.smithi149.stdout:checking for sys/limits.h... no 2024-09-21T03:16:56.434 INFO:tasks.workunit.client.1.smithi149.stdout:checking for an ANSI C-conforming const... yes 2024-09-21T03:16:56.482 INFO:tasks.workunit.client.1.smithi149.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-21T03:16:56.486 INFO:tasks.workunit.client.0.smithi090.stdout:checking pthread.h usability... yes 2024-09-21T03:16:56.522 INFO:tasks.workunit.client.0.smithi090.stdout:checking pthread.h presence... yes 2024-09-21T03:16:56.522 INFO:tasks.workunit.client.0.smithi090.stdout:checking for pthread.h... yes 2024-09-21T03:16:56.576 INFO:tasks.workunit.client.1.smithi149.stdout:checking for system... yes 2024-09-21T03:16:56.599 INFO:tasks.workunit.client.0.smithi090.stdout:checking fcntl.h usability... yes 2024-09-21T03:16:56.626 INFO:tasks.workunit.client.0.smithi090.stdout:checking fcntl.h presence... yes 2024-09-21T03:16:56.626 INFO:tasks.workunit.client.0.smithi090.stdout:checking for fcntl.h... yes 2024-09-21T03:16:56.708 INFO:tasks.workunit.client.0.smithi090.stdout:checking limits.h usability... yes 2024-09-21T03:16:56.735 INFO:tasks.workunit.client.0.smithi090.stdout:checking limits.h presence... yes 2024-09-21T03:16:56.735 INFO:tasks.workunit.client.0.smithi090.stdout:checking for limits.h... yes 2024-09-21T03:16:56.761 INFO:tasks.workunit.client.0.smithi090.stdout:checking for stdint.h... (cached) yes 2024-09-21T03:16:56.825 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/time.h usability... yes 2024-09-21T03:16:56.852 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/time.h presence... yes 2024-09-21T03:16:56.852 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sys/time.h... yes 2024-09-21T03:16:56.878 INFO:tasks.workunit.client.0.smithi090.stdout:checking for unistd.h... (cached) yes 2024-09-21T03:16:56.943 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/vfs.h usability... yes 2024-09-21T03:16:56.969 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/vfs.h presence... yes 2024-09-21T03:16:56.969 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sys/vfs.h... yes 2024-09-21T03:16:57.047 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/limits.h usability... no 2024-09-21T03:16:57.087 INFO:tasks.workunit.client.0.smithi090.stdout:checking sys/limits.h presence... no 2024-09-21T03:16:57.088 INFO:tasks.workunit.client.0.smithi090.stdout:checking for sys/limits.h... no 2024-09-21T03:16:57.131 INFO:tasks.workunit.client.0.smithi090.stdout:checking for an ANSI C-conforming const... yes 2024-09-21T03:16:57.200 INFO:tasks.workunit.client.0.smithi090.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-21T03:16:57.543 INFO:tasks.workunit.client.1.smithi149.stdout:checking for gettimeofday... yes 2024-09-21T03:16:57.547 INFO:tasks.workunit.client.0.smithi090.stdout:checking for system... yes 2024-09-21T03:16:57.640 INFO:tasks.workunit.client.0.smithi090.stdout:checking for gettimeofday... yes 2024-09-21T03:16:57.643 INFO:tasks.workunit.client.1.smithi149.stdout:checking for mkdir... yes 2024-09-21T03:16:57.742 INFO:tasks.workunit.client.1.smithi149.stdout:checking for strerror... yes 2024-09-21T03:16:57.834 INFO:tasks.workunit.client.1.smithi149.stdout:checking for open64... yes 2024-09-21T03:16:57.925 INFO:tasks.workunit.client.1.smithi149.stdout:checking for stat64... yes 2024-09-21T03:16:57.991 INFO:tasks.workunit.client.0.smithi090.stdout:checking for mkdir... yes 2024-09-21T03:16:58.017 INFO:tasks.workunit.client.1.smithi149.stdout:checking for fseeko64... yes 2024-09-21T03:16:58.088 INFO:tasks.workunit.client.0.smithi090.stdout:checking for strerror... yes 2024-09-21T03:16:58.112 INFO:tasks.workunit.client.1.smithi149.stdout:checking for lrand48_r... yes 2024-09-21T03:16:58.161 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:16:58.165 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:16:58.184 INFO:tasks.workunit.client.0.smithi090.stdout:checking for open64... yes 2024-09-21T03:16:58.207 INFO:tasks.workunit.client.1.smithi149.stdout:checking for srand48_r... yes 2024-09-21T03:16:58.278 INFO:tasks.workunit.client.0.smithi090.stdout:checking for stat64... yes 2024-09-21T03:16:58.369 INFO:tasks.workunit.client.0.smithi090.stdout:checking for fseeko64... yes 2024-09-21T03:16:58.455 INFO:tasks.workunit.client.1.smithi149.stdout:configure: creating ./config.status 2024-09-21T03:16:58.459 INFO:tasks.workunit.client.0.smithi090.stdout:checking for lrand48_r... yes 2024-09-21T03:16:58.554 INFO:tasks.workunit.client.0.smithi090.stdout:checking for srand48_r... yes 2024-09-21T03:16:58.581 INFO:tasks.workunit.client.1.smithi149.stdout: /bin/sh ./config.status 2024-09-21T03:16:58.605 INFO:tasks.workunit.client.0.smithi090.stdout:configure: creating ./config.status 2024-09-21T03:16:58.681 INFO:tasks.workunit.client.1.smithi149.stdout:config.status: creating Makefile 2024-09-21T03:16:58.706 INFO:tasks.workunit.client.1.smithi149.stdout:config.status: creating config.h 2024-09-21T03:16:58.728 INFO:tasks.workunit.client.0.smithi090.stdout: /bin/sh ./config.status 2024-09-21T03:16:58.740 INFO:tasks.workunit.client.1.smithi149.stdout:config.status: executing depfiles commands 2024-09-21T03:16:58.769 INFO:tasks.workunit.client.1.smithi149.stdout:config.status: executing default commands 2024-09-21T03:16:58.959 INFO:tasks.workunit.client.0.smithi090.stdout:config.status: creating Makefile 2024-09-21T03:16:58.985 INFO:tasks.workunit.client.0.smithi090.stdout:config.status: creating config.h 2024-09-21T03:16:59.018 INFO:tasks.workunit.client.0.smithi090.stdout:config.status: executing depfiles commands 2024-09-21T03:16:59.046 INFO:tasks.workunit.client.0.smithi090.stdout:config.status: executing default commands 2024-09-21T03:16:59.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:59.050+0000 7f292cc00640 1 -- 172.21.15.90:0/1770154616 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f2924062650 con 0x7f293006e630 2024-09-21T03:16:59.051 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":16,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:16:59.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:59.052+0000 7f2936200640 1 -- 172.21.15.90:0/1770154616 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2910078b90 msgr2=0x7f291007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:59.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:59.052+0000 7f2936200640 1 --2- 172.21.15.90:0/1770154616 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2910078b90 0x7f291007b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f291c009830 tx=0x7f291c004730 comp rx=0 tx=0).stop 2024-09-21T03:16:59.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:59.052+0000 7f2936200640 1 -- 172.21.15.90:0/1770154616 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f293006e630 msgr2=0x7f29300c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:16:59.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:59.052+0000 7f2936200640 1 --2- 172.21.15.90:0/1770154616 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f293006e630 0x7f29300c4b90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f292400b440 tx=0x7f292400b900 comp rx=0 tx=0).stop 2024-09-21T03:16:59.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:59.053+0000 7f2936200640 1 -- 172.21.15.90:0/1770154616 shutdown_connections 2024-09-21T03:16:59.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:59.053+0000 7f2936200640 1 --2- 172.21.15.90:0/1770154616 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2910078b90 0x7f291007b0a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:59.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:59.053+0000 7f2936200640 1 --2- 172.21.15.90:0/1770154616 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29300cb140 0x7f29300c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:59.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:59.053+0000 7f2936200640 1 --2- 172.21.15.90:0/1770154616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29300c7460 0x7f29300c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:59.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:59.053+0000 7f2936200640 1 --2- 172.21.15.90:0/1770154616 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f293006e630 0x7f29300c4b90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:16:59.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:59.053+0000 7f2936200640 1 -- 172.21.15.90:0/1770154616 >> 172.21.15.90:0/1770154616 conn(0x7f29300c8d60 msgr2=0x7f29300addd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:16:59.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:59.053+0000 7f2936200640 1 -- 172.21.15.90:0/1770154616 shutdown_connections 2024-09-21T03:16:59.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:16:59.053+0000 7f2936200640 1 -- 172.21.15.90:0/1770154616 wait complete. 2024-09-21T03:16:59.076 INFO:tasks.workunit.client.0.smithi090.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-09-21T03:16:59.282 INFO:tasks.workunit.client.0.smithi090.stdout:rm -f stamp-h1 2024-09-21T03:16:59.285 INFO:tasks.workunit.client.0.smithi090.stdout:touch config.h.in 2024-09-21T03:16:59.288 INFO:tasks.workunit.client.0.smithi090.stdout:cd . && /bin/sh ./config.status config.h 2024-09-21T03:16:59.353 INFO:tasks.workunit.client.1.smithi149.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run autoheader 2024-09-21T03:16:59.365 INFO:tasks.workunit.client.0.smithi090.stdout:config.status: creating config.h 2024-09-21T03:16:59.402 INFO:tasks.workunit.client.0.smithi090.stdout:make all-am 2024-09-21T03:16:59.409 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-21T03:16:59.409 INFO:tasks.workunit.client.0.smithi090.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-09-21T03:16:59.556 INFO:tasks.workunit.client.1.smithi149.stdout:rm -f stamp-h1 2024-09-21T03:16:59.560 INFO:tasks.workunit.client.1.smithi149.stdout:touch config.h.in 2024-09-21T03:16:59.563 INFO:tasks.workunit.client.1.smithi149.stdout:cd . && /bin/sh ./config.status config.h 2024-09-21T03:16:59.618 INFO:tasks.workunit.client.0.smithi090.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-09-21T03:16:59.622 INFO:tasks.workunit.client.0.smithi090.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-09-21T03:16:59.642 INFO:tasks.workunit.client.1.smithi149.stdout:config.status: creating config.h 2024-09-21T03:16:59.679 INFO:tasks.workunit.client.1.smithi149.stdout:make all-am 2024-09-21T03:16:59.687 INFO:tasks.workunit.client.1.smithi149.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb' 2024-09-21T03:16:59.687 INFO:tasks.workunit.client.1.smithi149.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-09-21T03:16:59.749 INFO:tasks.workunit.client.0.smithi090.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-09-21T03:16:59.753 INFO:tasks.workunit.client.0.smithi090.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-09-21T03:16:59.867 INFO:tasks.workunit.client.0.smithi090.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-09-21T03:16:59.871 INFO:tasks.workunit.client.0.smithi090.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-09-21T03:16:59.899 INFO:tasks.workunit.client.1.smithi149.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-09-21T03:16:59.903 INFO:tasks.workunit.client.1.smithi149.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-09-21T03:16:59.982 INFO:tasks.workunit.client.0.smithi090.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-09-21T03:16:59.986 INFO:tasks.workunit.client.0.smithi090.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-09-21T03:17:00.024 INFO:tasks.workunit.client.1.smithi149.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-09-21T03:17:00.028 INFO:tasks.workunit.client.1.smithi149.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-09-21T03:17:00.143 INFO:tasks.workunit.client.1.smithi149.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-09-21T03:17:00.149 INFO:tasks.workunit.client.1.smithi149.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-09-21T03:17:00.162 INFO:tasks.workunit.client.0.smithi090.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-09-21T03:17:00.166 INFO:tasks.workunit.client.0.smithi090.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-09-21T03:17:00.236 INFO:tasks.workunit.client.0.smithi090.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-09-21T03:17:00.241 INFO:tasks.workunit.client.0.smithi090.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-09-21T03:17:00.265 INFO:tasks.workunit.client.1.smithi149.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-09-21T03:17:00.270 INFO:tasks.workunit.client.1.smithi149.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-09-21T03:17:00.306 INFO:tasks.workunit.client.0.smithi090.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-09-21T03:17:00.310 INFO:tasks.workunit.client.0.smithi090.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-09-21T03:17:00.377 INFO:tasks.workunit.client.0.smithi090.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-09-21T03:17:00.381 INFO:tasks.workunit.client.0.smithi090.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-09-21T03:17:00.418 INFO:tasks.workunit.client.1.smithi149.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-09-21T03:17:00.424 INFO:tasks.workunit.client.1.smithi149.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-09-21T03:17:00.496 INFO:tasks.workunit.client.1.smithi149.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-09-21T03:17:00.502 INFO:tasks.workunit.client.1.smithi149.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-09-21T03:17:00.564 INFO:tasks.workunit.client.1.smithi149.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-09-21T03:17:00.570 INFO:tasks.workunit.client.1.smithi149.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-09-21T03:17:00.622 INFO:tasks.workunit.client.0.smithi090.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-09-21T03:17:00.627 INFO:tasks.workunit.client.0.smithi090.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-09-21T03:17:00.639 INFO:tasks.workunit.client.1.smithi149.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-09-21T03:17:00.643 INFO:tasks.workunit.client.1.smithi149.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-09-21T03:17:00.893 INFO:tasks.workunit.client.1.smithi149.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-09-21T03:17:00.898 INFO:tasks.workunit.client.1.smithi149.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-09-21T03:17:01.047 INFO:tasks.workunit.client.1.smithi149.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-09-21T03:17:01.051 INFO:tasks.workunit.client.1.smithi149.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-09-21T03:17:01.229 INFO:tasks.workunit.client.1.smithi149.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-09-21T03:17:01.233 INFO:tasks.workunit.client.1.smithi149.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-09-21T03:17:01.309 INFO:tasks.workunit.client.0.smithi090.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-09-21T03:17:01.313 INFO:tasks.workunit.client.0.smithi090.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-09-21T03:17:01.321 INFO:tasks.workunit.client.1.smithi149.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-09-21T03:17:01.326 INFO:tasks.workunit.client.1.smithi149.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-09-21T03:17:01.426 INFO:tasks.workunit.client.1.smithi149.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-09-21T03:17:01.430 INFO:tasks.workunit.client.1.smithi149.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-09-21T03:17:01.502 INFO:tasks.workunit.client.0.smithi090.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-09-21T03:17:01.506 INFO:tasks.workunit.client.0.smithi090.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-09-21T03:17:01.564 INFO:tasks.workunit.client.1.smithi149.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-09-21T03:17:01.568 INFO:tasks.workunit.client.1.smithi149.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-09-21T03:17:01.604 INFO:tasks.workunit.client.0.smithi090.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-09-21T03:17:01.609 INFO:tasks.workunit.client.0.smithi090.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-09-21T03:17:01.625 INFO:tasks.workunit.client.1.smithi149.stderr:In file included from parser.h:22, 2024-09-21T03:17:01.625 INFO:tasks.workunit.client.1.smithi149.stderr: from parser.c:25: 2024-09-21T03:17:01.625 INFO:tasks.workunit.client.1.smithi149.stderr:parser.c: In function ‘init_filesys’: 2024-09-21T03:17:01.626 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T03:17:01.626 INFO:tasks.workunit.client.1.smithi149.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T03:17:01.627 INFO:tasks.workunit.client.1.smithi149.stderr: | ^ 2024-09-21T03:17:01.627 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T03:17:01.627 INFO:tasks.workunit.client.1.smithi149.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T03:17:01.627 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~ 2024-09-21T03:17:01.627 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T03:17:01.627 INFO:tasks.workunit.client.1.smithi149.stderr: 36 | container_of(ptr, type, member) 2024-09-21T03:17:01.627 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~~~ 2024-09-21T03:17:01.627 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-21T03:17:01.627 INFO:tasks.workunit.client.1.smithi149.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-21T03:17:01.627 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~ 2024-09-21T03:17:01.627 INFO:tasks.workunit.client.1.smithi149.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T03:17:01.627 INFO:tasks.workunit.client.1.smithi149.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-21T03:17:01.628 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T03:17:01.628 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T03:17:01.628 INFO:tasks.workunit.client.1.smithi149.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T03:17:01.628 INFO:tasks.workunit.client.1.smithi149.stderr: | ^ 2024-09-21T03:17:01.628 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T03:17:01.628 INFO:tasks.workunit.client.1.smithi149.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T03:17:01.628 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~ 2024-09-21T03:17:01.628 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T03:17:01.628 INFO:tasks.workunit.client.1.smithi149.stderr: 36 | container_of(ptr, type, member) 2024-09-21T03:17:01.628 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~~~ 2024-09-21T03:17:01.628 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-21T03:17:01.628 INFO:tasks.workunit.client.1.smithi149.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-21T03:17:01.628 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~ 2024-09-21T03:17:01.628 INFO:tasks.workunit.client.1.smithi149.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T03:17:01.629 INFO:tasks.workunit.client.1.smithi149.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-21T03:17:01.629 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T03:17:01.629 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T03:17:01.629 INFO:tasks.workunit.client.1.smithi149.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T03:17:01.629 INFO:tasks.workunit.client.1.smithi149.stderr: | ^ 2024-09-21T03:17:01.629 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T03:17:01.629 INFO:tasks.workunit.client.1.smithi149.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T03:17:01.629 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~ 2024-09-21T03:17:01.629 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T03:17:01.629 INFO:tasks.workunit.client.1.smithi149.stderr: 36 | container_of(ptr, type, member) 2024-09-21T03:17:01.629 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~~~ 2024-09-21T03:17:01.629 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-21T03:17:01.630 INFO:tasks.workunit.client.1.smithi149.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-21T03:17:01.630 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~ 2024-09-21T03:17:01.630 INFO:tasks.workunit.client.1.smithi149.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T03:17:01.630 INFO:tasks.workunit.client.1.smithi149.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-21T03:17:01.630 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T03:17:01.630 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T03:17:01.630 INFO:tasks.workunit.client.1.smithi149.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T03:17:01.630 INFO:tasks.workunit.client.1.smithi149.stderr: | ^ 2024-09-21T03:17:01.630 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T03:17:01.630 INFO:tasks.workunit.client.1.smithi149.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T03:17:01.630 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~ 2024-09-21T03:17:01.630 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T03:17:01.631 INFO:tasks.workunit.client.1.smithi149.stderr: 36 | container_of(ptr, type, member) 2024-09-21T03:17:01.631 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~~~ 2024-09-21T03:17:01.631 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-21T03:17:01.631 INFO:tasks.workunit.client.1.smithi149.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-21T03:17:01.631 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~ 2024-09-21T03:17:01.631 INFO:tasks.workunit.client.1.smithi149.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T03:17:01.631 INFO:tasks.workunit.client.1.smithi149.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-21T03:17:01.632 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T03:17:01.632 INFO:tasks.workunit.client.1.smithi149.stderr:parser.c: In function ‘init_tg_stats’: 2024-09-21T03:17:01.632 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T03:17:01.632 INFO:tasks.workunit.client.1.smithi149.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T03:17:01.632 INFO:tasks.workunit.client.1.smithi149.stderr: | ^ 2024-09-21T03:17:01.632 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T03:17:01.632 INFO:tasks.workunit.client.1.smithi149.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T03:17:01.632 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~ 2024-09-21T03:17:01.632 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T03:17:01.632 INFO:tasks.workunit.client.1.smithi149.stderr: 36 | container_of(ptr, type, member) 2024-09-21T03:17:01.633 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~~~ 2024-09-21T03:17:01.633 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-21T03:17:01.633 INFO:tasks.workunit.client.1.smithi149.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-21T03:17:01.633 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~ 2024-09-21T03:17:01.633 INFO:tasks.workunit.client.1.smithi149.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T03:17:01.633 INFO:tasks.workunit.client.1.smithi149.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-21T03:17:01.633 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T03:17:01.633 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T03:17:01.633 INFO:tasks.workunit.client.1.smithi149.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T03:17:01.633 INFO:tasks.workunit.client.1.smithi149.stderr: | ^ 2024-09-21T03:17:01.634 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T03:17:01.634 INFO:tasks.workunit.client.1.smithi149.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T03:17:01.634 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~ 2024-09-21T03:17:01.634 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T03:17:01.634 INFO:tasks.workunit.client.1.smithi149.stderr: 36 | container_of(ptr, type, member) 2024-09-21T03:17:01.634 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~~~ 2024-09-21T03:17:01.634 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-21T03:17:01.634 INFO:tasks.workunit.client.1.smithi149.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-21T03:17:01.634 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~ 2024-09-21T03:17:01.634 INFO:tasks.workunit.client.1.smithi149.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T03:17:01.634 INFO:tasks.workunit.client.1.smithi149.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-21T03:17:01.634 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T03:17:01.634 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T03:17:01.634 INFO:tasks.workunit.client.1.smithi149.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T03:17:01.635 INFO:tasks.workunit.client.1.smithi149.stderr: | ^ 2024-09-21T03:17:01.635 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T03:17:01.635 INFO:tasks.workunit.client.1.smithi149.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T03:17:01.635 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~ 2024-09-21T03:17:01.635 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T03:17:01.635 INFO:tasks.workunit.client.1.smithi149.stderr: 36 | container_of(ptr, type, member) 2024-09-21T03:17:01.635 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~~~ 2024-09-21T03:17:01.635 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-21T03:17:01.635 INFO:tasks.workunit.client.1.smithi149.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-21T03:17:01.636 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~ 2024-09-21T03:17:01.636 INFO:tasks.workunit.client.1.smithi149.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T03:17:01.636 INFO:tasks.workunit.client.1.smithi149.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-21T03:17:01.636 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T03:17:01.636 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T03:17:01.636 INFO:tasks.workunit.client.1.smithi149.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T03:17:01.636 INFO:tasks.workunit.client.1.smithi149.stderr: | ^ 2024-09-21T03:17:01.636 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T03:17:01.636 INFO:tasks.workunit.client.1.smithi149.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T03:17:01.636 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~ 2024-09-21T03:17:01.636 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T03:17:01.636 INFO:tasks.workunit.client.1.smithi149.stderr: 36 | container_of(ptr, type, member) 2024-09-21T03:17:01.636 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~~~ 2024-09-21T03:17:01.636 INFO:tasks.workunit.client.1.smithi149.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-21T03:17:01.637 INFO:tasks.workunit.client.1.smithi149.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-21T03:17:01.637 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~ 2024-09-21T03:17:01.637 INFO:tasks.workunit.client.1.smithi149.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T03:17:01.637 INFO:tasks.workunit.client.1.smithi149.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-21T03:17:01.637 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T03:17:01.677 INFO:tasks.workunit.client.1.smithi149.stderr:parser.c: In function ‘get_optstr’: 2024-09-21T03:17:01.678 INFO:tasks.workunit.client.1.smithi149.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-09-21T03:17:01.678 INFO:tasks.workunit.client.1.smithi149.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-09-21T03:17:01.678 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T03:17:01.678 INFO:tasks.workunit.client.1.smithi149.stderr:parser.c:200:14: note: source object declared here 2024-09-21T03:17:01.678 INFO:tasks.workunit.client.1.smithi149.stderr: 200 | char temp[BUFSIZE]; 2024-09-21T03:17:01.678 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~ 2024-09-21T03:17:01.684 INFO:tasks.workunit.client.1.smithi149.stderr:parser.c: In function ‘size64_convert’: 2024-09-21T03:17:01.685 INFO:tasks.workunit.client.1.smithi149.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-09-21T03:17:01.685 INFO:tasks.workunit.client.1.smithi149.stderr: 119 | memcpy(unit, "\0", 3); 2024-09-21T03:17:01.685 INFO:tasks.workunit.client.1.smithi149.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-09-21T03:17:01.702 INFO:tasks.workunit.client.0.smithi090.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-09-21T03:17:01.706 INFO:tasks.workunit.client.0.smithi090.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-09-21T03:17:01.834 INFO:tasks.workunit.client.0.smithi090.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-09-21T03:17:01.838 INFO:tasks.workunit.client.0.smithi090.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-09-21T03:17:01.879 INFO:tasks.workunit.client.0.smithi090.stderr:In file included from parser.h:22, 2024-09-21T03:17:01.879 INFO:tasks.workunit.client.0.smithi090.stderr: from parser.c:25: 2024-09-21T03:17:01.879 INFO:tasks.workunit.client.0.smithi090.stderr:parser.c: In function ‘init_filesys’: 2024-09-21T03:17:01.879 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T03:17:01.879 INFO:tasks.workunit.client.0.smithi090.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T03:17:01.879 INFO:tasks.workunit.client.0.smithi090.stderr: | ^ 2024-09-21T03:17:01.879 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T03:17:01.879 INFO:tasks.workunit.client.0.smithi090.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T03:17:01.880 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~ 2024-09-21T03:17:01.880 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T03:17:01.880 INFO:tasks.workunit.client.0.smithi090.stderr: 36 | container_of(ptr, type, member) 2024-09-21T03:17:01.880 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~~~ 2024-09-21T03:17:01.880 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-21T03:17:01.880 INFO:tasks.workunit.client.0.smithi090.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-21T03:17:01.880 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~ 2024-09-21T03:17:01.880 INFO:tasks.workunit.client.0.smithi090.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T03:17:01.880 INFO:tasks.workunit.client.0.smithi090.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-21T03:17:01.880 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T03:17:01.880 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T03:17:01.880 INFO:tasks.workunit.client.0.smithi090.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T03:17:01.880 INFO:tasks.workunit.client.0.smithi090.stderr: | ^ 2024-09-21T03:17:01.880 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T03:17:01.881 INFO:tasks.workunit.client.0.smithi090.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T03:17:01.881 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~ 2024-09-21T03:17:01.881 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T03:17:01.881 INFO:tasks.workunit.client.0.smithi090.stderr: 36 | container_of(ptr, type, member) 2024-09-21T03:17:01.881 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~~~ 2024-09-21T03:17:01.881 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-21T03:17:01.881 INFO:tasks.workunit.client.0.smithi090.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-21T03:17:01.881 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~ 2024-09-21T03:17:01.881 INFO:tasks.workunit.client.0.smithi090.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T03:17:01.881 INFO:tasks.workunit.client.0.smithi090.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-21T03:17:01.881 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T03:17:01.881 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T03:17:01.881 INFO:tasks.workunit.client.0.smithi090.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T03:17:01.881 INFO:tasks.workunit.client.0.smithi090.stderr: | ^ 2024-09-21T03:17:01.881 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T03:17:01.882 INFO:tasks.workunit.client.0.smithi090.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T03:17:01.882 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~ 2024-09-21T03:17:01.882 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T03:17:01.882 INFO:tasks.workunit.client.0.smithi090.stderr: 36 | container_of(ptr, type, member) 2024-09-21T03:17:01.882 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~~~ 2024-09-21T03:17:01.882 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-21T03:17:01.882 INFO:tasks.workunit.client.0.smithi090.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-21T03:17:01.882 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~ 2024-09-21T03:17:01.882 INFO:tasks.workunit.client.0.smithi090.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T03:17:01.882 INFO:tasks.workunit.client.0.smithi090.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-21T03:17:01.882 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T03:17:01.882 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T03:17:01.882 INFO:tasks.workunit.client.0.smithi090.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T03:17:01.882 INFO:tasks.workunit.client.0.smithi090.stderr: | ^ 2024-09-21T03:17:01.883 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T03:17:01.883 INFO:tasks.workunit.client.0.smithi090.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T03:17:01.883 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~ 2024-09-21T03:17:01.883 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T03:17:01.883 INFO:tasks.workunit.client.0.smithi090.stderr: 36 | container_of(ptr, type, member) 2024-09-21T03:17:01.883 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~~~ 2024-09-21T03:17:01.883 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-21T03:17:01.883 INFO:tasks.workunit.client.0.smithi090.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-21T03:17:01.883 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~ 2024-09-21T03:17:01.883 INFO:tasks.workunit.client.0.smithi090.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T03:17:01.883 INFO:tasks.workunit.client.0.smithi090.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-21T03:17:01.883 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T03:17:01.883 INFO:tasks.workunit.client.0.smithi090.stderr:parser.c: In function ‘init_tg_stats’: 2024-09-21T03:17:01.884 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T03:17:01.884 INFO:tasks.workunit.client.0.smithi090.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T03:17:01.884 INFO:tasks.workunit.client.0.smithi090.stderr: | ^ 2024-09-21T03:17:01.884 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T03:17:01.884 INFO:tasks.workunit.client.0.smithi090.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T03:17:01.884 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~ 2024-09-21T03:17:01.884 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T03:17:01.884 INFO:tasks.workunit.client.0.smithi090.stderr: 36 | container_of(ptr, type, member) 2024-09-21T03:17:01.884 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~~~ 2024-09-21T03:17:01.884 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-21T03:17:01.885 INFO:tasks.workunit.client.0.smithi090.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-21T03:17:01.885 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~ 2024-09-21T03:17:01.885 INFO:tasks.workunit.client.0.smithi090.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T03:17:01.885 INFO:tasks.workunit.client.0.smithi090.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-21T03:17:01.885 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T03:17:01.885 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T03:17:01.885 INFO:tasks.workunit.client.0.smithi090.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T03:17:01.885 INFO:tasks.workunit.client.0.smithi090.stderr: | ^ 2024-09-21T03:17:01.885 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T03:17:01.885 INFO:tasks.workunit.client.0.smithi090.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T03:17:01.885 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~ 2024-09-21T03:17:01.885 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T03:17:01.885 INFO:tasks.workunit.client.0.smithi090.stderr: 36 | container_of(ptr, type, member) 2024-09-21T03:17:01.885 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~~~ 2024-09-21T03:17:01.885 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-21T03:17:01.886 INFO:tasks.workunit.client.0.smithi090.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-21T03:17:01.886 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~ 2024-09-21T03:17:01.886 INFO:tasks.workunit.client.0.smithi090.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T03:17:01.886 INFO:tasks.workunit.client.0.smithi090.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-21T03:17:01.886 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T03:17:01.886 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T03:17:01.886 INFO:tasks.workunit.client.0.smithi090.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T03:17:01.886 INFO:tasks.workunit.client.0.smithi090.stderr: | ^ 2024-09-21T03:17:01.886 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T03:17:01.886 INFO:tasks.workunit.client.0.smithi090.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T03:17:01.886 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~ 2024-09-21T03:17:01.886 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T03:17:01.886 INFO:tasks.workunit.client.0.smithi090.stderr: 36 | container_of(ptr, type, member) 2024-09-21T03:17:01.886 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~~~ 2024-09-21T03:17:01.887 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-21T03:17:01.887 INFO:tasks.workunit.client.0.smithi090.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-21T03:17:01.887 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~ 2024-09-21T03:17:01.887 INFO:tasks.workunit.client.0.smithi090.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T03:17:01.887 INFO:tasks.workunit.client.0.smithi090.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-21T03:17:01.887 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T03:17:01.887 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T03:17:01.887 INFO:tasks.workunit.client.0.smithi090.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T03:17:01.887 INFO:tasks.workunit.client.0.smithi090.stderr: | ^ 2024-09-21T03:17:01.887 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T03:17:01.887 INFO:tasks.workunit.client.0.smithi090.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T03:17:01.887 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~ 2024-09-21T03:17:01.887 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T03:17:01.888 INFO:tasks.workunit.client.0.smithi090.stderr: 36 | container_of(ptr, type, member) 2024-09-21T03:17:01.888 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~~~ 2024-09-21T03:17:01.888 INFO:tasks.workunit.client.0.smithi090.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-21T03:17:01.888 INFO:tasks.workunit.client.0.smithi090.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-21T03:17:01.888 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~ 2024-09-21T03:17:01.888 INFO:tasks.workunit.client.0.smithi090.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T03:17:01.888 INFO:tasks.workunit.client.0.smithi090.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-21T03:17:01.888 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T03:17:01.929 INFO:tasks.workunit.client.0.smithi090.stderr:parser.c: In function ‘get_optstr’: 2024-09-21T03:17:01.930 INFO:tasks.workunit.client.0.smithi090.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-09-21T03:17:01.930 INFO:tasks.workunit.client.0.smithi090.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-09-21T03:17:01.930 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T03:17:01.930 INFO:tasks.workunit.client.0.smithi090.stderr:parser.c:200:14: note: source object declared here 2024-09-21T03:17:01.930 INFO:tasks.workunit.client.0.smithi090.stderr: 200 | char temp[BUFSIZE]; 2024-09-21T03:17:01.930 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~ 2024-09-21T03:17:01.936 INFO:tasks.workunit.client.0.smithi090.stderr:parser.c: In function ‘size64_convert’: 2024-09-21T03:17:01.936 INFO:tasks.workunit.client.0.smithi090.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-09-21T03:17:01.936 INFO:tasks.workunit.client.0.smithi090.stderr: 119 | memcpy(unit, "\0", 3); 2024-09-21T03:17:01.936 INFO:tasks.workunit.client.0.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-09-21T03:17:02.007 INFO:tasks.workunit.client.1.smithi149.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-09-21T03:17:02.012 INFO:tasks.workunit.client.1.smithi149.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-09-21T03:17:02.080 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:17:02.091 INFO:tasks.workunit.client.1.smithi149.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-09-21T03:17:02.095 INFO:tasks.workunit.client.1.smithi149.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-09-21T03:17:02.305 INFO:tasks.workunit.client.0.smithi090.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-09-21T03:17:02.310 INFO:tasks.workunit.client.0.smithi090.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-09-21T03:17:02.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.340+0000 7fd022c00640 1 -- 172.21.15.90:0/253547409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd004004800 msgr2=0x7fd004004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:02.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.340+0000 7fd022c00640 1 --2- 172.21.15.90:0/253547409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd004004800 0x7fd004004c10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd008001830 tx=0x7fd004005830 comp rx=0 tx=0).stop 2024-09-21T03:17:02.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.340+0000 7fd022c00640 1 -- 172.21.15.90:0/253547409 shutdown_connections 2024-09-21T03:17:02.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.340+0000 7fd022c00640 1 --2- 172.21.15.90:0/253547409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd004004800 0x7fd004004c10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:02.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.340+0000 7fd022c00640 1 -- 172.21.15.90:0/253547409 >> 172.21.15.90:0/253547409 conn(0x7fd01c0c84c0 msgr2=0x7fd01c0c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:02.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.340+0000 7fd022c00640 1 -- 172.21.15.90:0/253547409 shutdown_connections 2024-09-21T03:17:02.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.340+0000 7fd022c00640 1 -- 172.21.15.90:0/253547409 wait complete. 2024-09-21T03:17:02.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.342+0000 7fd022c00640 1 Processor -- start 2024-09-21T03:17:02.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.342+0000 7fd022c00640 1 -- start start 2024-09-21T03:17:02.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.343+0000 7fd022c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd004004800 0x7fd01c14db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:02.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.343+0000 7fd022c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd01c14e070 0x7fd01c14c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:02.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.343+0000 7fd022c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd01c14c7c0 0x7fd01c13c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:02.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.343+0000 7fd022c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c072bd0 con 0x7fd004004800 2024-09-21T03:17:02.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.343+0000 7fd022c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c072a50 con 0x7fd01c14c7c0 2024-09-21T03:17:02.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.343+0000 7fd022c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd01c155030 con 0x7fd01c14e070 2024-09-21T03:17:02.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.344+0000 7fd021800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd004004800 0x7fd01c14db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:02.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.344+0000 7fd022200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd01c14c7c0 0x7fd01c13c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:02.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.344+0000 7fd022200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd01c14c7c0 0x7fd01c13c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:42294/0 (socket says 172.21.15.90:42294) 2024-09-21T03:17:02.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.344+0000 7fd021800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd004004800 0x7fd01c14db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36926/0 (socket says 172.21.15.90:36926) 2024-09-21T03:17:02.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.344+0000 7fd022200640 1 -- 172.21.15.90:0/3964881190 learned_addr learned my addr 172.21.15.90:0/3964881190 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:17:02.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.344+0000 7fd020e00640 1 --2- 172.21.15.90:0/3964881190 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd01c14e070 0x7fd01c14c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:02.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.344+0000 7fd022200640 1 -- 172.21.15.90:0/3964881190 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd01c14e070 msgr2=0x7fd01c14c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:02.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.344+0000 7fd022200640 1 --2- 172.21.15.90:0/3964881190 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd01c14e070 0x7fd01c14c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:02.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.344+0000 7fd022200640 1 -- 172.21.15.90:0/3964881190 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd004004800 msgr2=0x7fd01c14db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:02.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.344+0000 7fd022200640 1 --2- 172.21.15.90:0/3964881190 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd004004800 0x7fd01c14db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:02.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.344+0000 7fd022200640 1 -- 172.21.15.90:0/3964881190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01c1ed980 con 0x7fd01c14c7c0 2024-09-21T03:17:02.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.344+0000 7fd021800640 1 --2- 172.21.15.90:0/3964881190 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd004004800 0x7fd01c14db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:17:02.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.345+0000 7fd022200640 1 --2- 172.21.15.90:0/3964881190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd01c14c7c0 0x7fd01c13c690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd01c071980 tx=0x7fd01400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:02.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.345+0000 7fd019600640 1 -- 172.21.15.90:0/3964881190 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01400ce80 con 0x7fd01c14c7c0 2024-09-21T03:17:02.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.345+0000 7fd019600640 1 -- 172.21.15.90:0/3964881190 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd014003a60 con 0x7fd01c14c7c0 2024-09-21T03:17:02.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.345+0000 7fd022c00640 1 -- 172.21.15.90:0/3964881190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd01c14cbd0 con 0x7fd01c14c7c0 2024-09-21T03:17:02.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.345+0000 7fd019600640 1 -- 172.21.15.90:0/3964881190 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd014004020 con 0x7fd01c14c7c0 2024-09-21T03:17:02.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.345+0000 7fd022c00640 1 -- 172.21.15.90:0/3964881190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd01c14ad00 con 0x7fd01c14c7c0 2024-09-21T03:17:02.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.346+0000 7fd022c00640 1 -- 172.21.15.90:0/3964881190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd01c074a70 con 0x7fd01c14c7c0 2024-09-21T03:17:02.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.347+0000 7fd019600640 1 -- 172.21.15.90:0/3964881190 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd014004b40 con 0x7fd01c14c7c0 2024-09-21T03:17:02.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.348+0000 7fd019600640 1 --2- 172.21.15.90:0/3964881190 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcffc078b90 0x7fcffc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:02.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.348+0000 7fd019600640 1 -- 172.21.15.90:0/3964881190 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fd01409b170 con 0x7fd01c14c7c0 2024-09-21T03:17:02.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.349+0000 7fd021800640 1 --2- 172.21.15.90:0/3964881190 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcffc078b90 0x7fcffc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:02.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.349+0000 7fd021800640 1 --2- 172.21.15.90:0/3964881190 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcffc078b90 0x7fcffc07b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd010001eb0 tx=0x7fd010009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:02.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.352+0000 7fd019600640 1 -- 172.21.15.90:0/3964881190 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd014062ce0 con 0x7fd01c14c7c0 2024-09-21T03:17:02.394 INFO:tasks.workunit.client.0.smithi090.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-09-21T03:17:02.398 INFO:tasks.workunit.client.0.smithi090.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-09-21T03:17:02.515 INFO:tasks.workunit.client.0.smithi090.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-09-21T03:17:02.519 INFO:tasks.workunit.client.0.smithi090.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-09-21T03:17:02.567 INFO:tasks.workunit.client.0.smithi090.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-09-21T03:17:02.573 INFO:tasks.workunit.client.0.smithi090.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-09-21T03:17:02.623 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-21T03:17:02.625 INFO:tasks.workunit.client.0.smithi090.stderr:+ cd .. 2024-09-21T03:17:02.625 INFO:tasks.workunit.client.0.smithi090.stderr:+ mkdir tmp 2024-09-21T03:17:02.629 INFO:tasks.workunit.client.0.smithi090.stderr:+ cd tmp 2024-09-21T03:17:02.629 INFO:tasks.workunit.client.0.smithi090.stderr:+ for f in $mydir/*.ffsb 2024-09-21T03:17:02.629 INFO:tasks.workunit.client.0.smithi090.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-09-21T03:17:02.631 INFO:tasks.workunit.client.0.smithi090.stdout:FFSB version 6.0-RC2 started 2024-09-21T03:17:02.631 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-09-21T03:17:02.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.629+0000 7fd022c00640 1 -- 172.21.15.90:0/3964881190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd01c0c3ae0 con 0x7fd01c14c7c0 2024-09-21T03:17:02.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.629+0000 7fd019600640 1 -- 172.21.15.90:0/3964881190 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7fd014067710 con 0x7fd01c14c7c0 2024-09-21T03:17:02.632 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:17:02.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.633+0000 7fd022c00640 1 -- 172.21.15.90:0/3964881190 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcffc078b90 msgr2=0x7fcffc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:02.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.633+0000 7fd022c00640 1 --2- 172.21.15.90:0/3964881190 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcffc078b90 0x7fcffc07b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd010001eb0 tx=0x7fd010009040 comp rx=0 tx=0).stop 2024-09-21T03:17:02.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.633+0000 7fd022c00640 1 -- 172.21.15.90:0/3964881190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd01c14c7c0 msgr2=0x7fd01c13c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:02.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.633+0000 7fd022c00640 1 --2- 172.21.15.90:0/3964881190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd01c14c7c0 0x7fd01c13c690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd01c071980 tx=0x7fd01400c6a0 comp rx=0 tx=0).stop 2024-09-21T03:17:02.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.633+0000 7fd022c00640 1 -- 172.21.15.90:0/3964881190 shutdown_connections 2024-09-21T03:17:02.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.633+0000 7fd022c00640 1 --2- 172.21.15.90:0/3964881190 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcffc078b90 0x7fcffc07b0a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:02.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.633+0000 7fd022c00640 1 --2- 172.21.15.90:0/3964881190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd01c14c7c0 0x7fd01c13c690 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:02.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.633+0000 7fd022c00640 1 --2- 172.21.15.90:0/3964881190 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd01c14e070 0x7fd01c14c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:02.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.633+0000 7fd022c00640 1 --2- 172.21.15.90:0/3964881190 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd004004800 0x7fd01c14db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:02.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.633+0000 7fd022c00640 1 -- 172.21.15.90:0/3964881190 >> 172.21.15.90:0/3964881190 conn(0x7fd01c0c84c0 msgr2=0x7fd01c0c71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:02.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.633+0000 7fd022c00640 1 -- 172.21.15.90:0/3964881190 shutdown_connections 2024-09-21T03:17:02.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.633+0000 7fd022c00640 1 -- 172.21.15.90:0/3964881190 wait complete. 2024-09-21T03:17:02.636 INFO:tasks.workunit.client.0.smithi090.stdout:benchmark time = 300 2024-09-21T03:17:02.636 INFO:tasks.workunit.client.0.smithi090.stdout:ThreadGroup 0 2024-09-21T03:17:02.636 INFO:tasks.workunit.client.0.smithi090.stdout:================ 2024-09-21T03:17:02.637 INFO:tasks.workunit.client.0.smithi090.stdout: num_threads = 32 2024-09-21T03:17:02.637 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-09-21T03:17:02.637 INFO:tasks.workunit.client.0.smithi090.stdout: read_random = off 2024-09-21T03:17:02.637 INFO:tasks.workunit.client.0.smithi090.stdout: read_size = 0 (0B) 2024-09-21T03:17:02.637 INFO:tasks.workunit.client.0.smithi090.stdout: read_blocksize = 0 (0B) 2024-09-21T03:17:02.637 INFO:tasks.workunit.client.0.smithi090.stdout: read_skip = off 2024-09-21T03:17:02.637 INFO:tasks.workunit.client.0.smithi090.stdout: read_skipsize = 0 (0B) 2024-09-21T03:17:02.637 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-09-21T03:17:02.637 INFO:tasks.workunit.client.0.smithi090.stdout: write_random = on 2024-09-21T03:17:02.637 INFO:tasks.workunit.client.0.smithi090.stdout: write_size = 5242880 (5MB) 2024-09-21T03:17:02.638 INFO:tasks.workunit.client.0.smithi090.stdout: fsync_file = 0 2024-09-21T03:17:02.638 INFO:tasks.workunit.client.0.smithi090.stdout: write_blocksize = 4096 (4KB) 2024-09-21T03:17:02.639 INFO:tasks.workunit.client.0.smithi090.stdout: wait time = 0 2024-09-21T03:17:02.639 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-09-21T03:17:02.639 INFO:tasks.workunit.client.0.smithi090.stdout: op weights 2024-09-21T03:17:02.639 INFO:tasks.workunit.client.0.smithi090.stdout: read = 0 (0.00%) 2024-09-21T03:17:02.639 INFO:tasks.workunit.client.0.smithi090.stdout: readall = 0 (0.00%) 2024-09-21T03:17:02.639 INFO:tasks.workunit.client.0.smithi090.stdout: write = 1 (100.00%) 2024-09-21T03:17:02.639 INFO:tasks.workunit.client.0.smithi090.stdout: create = 0 (0.00%) 2024-09-21T03:17:02.639 INFO:tasks.workunit.client.0.smithi090.stdout: append = 0 (0.00%) 2024-09-21T03:17:02.639 INFO:tasks.workunit.client.0.smithi090.stdout: delete = 0 (0.00%) 2024-09-21T03:17:02.639 INFO:tasks.workunit.client.0.smithi090.stdout: metaop = 0 (0.00%) 2024-09-21T03:17:02.639 INFO:tasks.workunit.client.0.smithi090.stdout: createdir = 0 (0.00%) 2024-09-21T03:17:02.639 INFO:tasks.workunit.client.0.smithi090.stdout: stat = 0 (0.00%) 2024-09-21T03:17:02.639 INFO:tasks.workunit.client.0.smithi090.stdout: writeall = 0 (0.00%) 2024-09-21T03:17:02.639 INFO:tasks.workunit.client.0.smithi090.stdout: writeall_fsync = 0 (0.00%) 2024-09-21T03:17:02.639 INFO:tasks.workunit.client.0.smithi090.stdout: open_close = 0 (0.00%) 2024-09-21T03:17:02.640 INFO:tasks.workunit.client.0.smithi090.stdout: write_fsync = 0 (0.00%) 2024-09-21T03:17:02.640 INFO:tasks.workunit.client.0.smithi090.stdout: create_fsync = 0 (0.00%) 2024-09-21T03:17:02.640 INFO:tasks.workunit.client.0.smithi090.stdout: append_fsync = 0 (0.00%) 2024-09-21T03:17:02.640 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-09-21T03:17:02.640 INFO:tasks.workunit.client.0.smithi090.stdout:FileSystem . 2024-09-21T03:17:02.640 INFO:tasks.workunit.client.0.smithi090.stdout:========== 2024-09-21T03:17:02.640 INFO:tasks.workunit.client.0.smithi090.stdout: num_dirs = 0 2024-09-21T03:17:02.640 INFO:tasks.workunit.client.0.smithi090.stdout: starting files = 128 2024-09-21T03:17:02.640 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-09-21T03:17:02.640 INFO:tasks.workunit.client.0.smithi090.stdout: min file size = 104857600 (100MB) 2024-09-21T03:17:02.640 INFO:tasks.workunit.client.0.smithi090.stdout: max file size = 104857600 (100MB) 2024-09-21T03:17:02.640 INFO:tasks.workunit.client.0.smithi090.stdout: directio = off 2024-09-21T03:17:02.640 INFO:tasks.workunit.client.0.smithi090.stdout: alignedio = on 2024-09-21T03:17:02.640 INFO:tasks.workunit.client.0.smithi090.stdout: bufferedio = off 2024-09-21T03:17:02.640 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-09-21T03:17:02.641 INFO:tasks.workunit.client.0.smithi090.stdout: aging is off 2024-09-21T03:17:02.641 INFO:tasks.workunit.client.0.smithi090.stdout: current utilization = 0.00% 2024-09-21T03:17:02.641 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-09-21T03:17:02.641 INFO:tasks.workunit.client.0.smithi090.stdout:checking existing fs: . 2024-09-21T03:17:02.641 INFO:tasks.workunit.client.0.smithi090.stderr:opendir: No such file or directory 2024-09-21T03:17:02.641 INFO:tasks.workunit.client.0.smithi090.stdout:recreating new fileset 2024-09-21T03:17:02.659 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-21T03:17:02.659 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-21T03:17:02.660 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:17:02.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.917+0000 7f518e800640 1 -- 172.21.15.90:0/2649999530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51880c8c50 msgr2=0x7f51880c9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:02.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.917+0000 7f518e800640 1 --2- 172.21.15.90:0/2649999530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51880c8c50 0x7f51880c9060 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f51880c78d0 tx=0x7f517402a4b0 comp rx=0 tx=0).stop 2024-09-21T03:17:02.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.917+0000 7f518e800640 1 -- 172.21.15.90:0/2649999530 shutdown_connections 2024-09-21T03:17:02.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.917+0000 7f518e800640 1 --2- 172.21.15.90:0/2649999530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51880c8c50 0x7f51880c9060 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:02.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.917+0000 7f518e800640 1 --2- 172.21.15.90:0/2649999530 >> v2:172.21.15.149:3300/0 conn(0x7f5188156ad0 0x7f5188156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:02.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.917+0000 7f518e800640 1 --2- 172.21.15.90:0/2649999530 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51880c7120 0x7f5188154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:02.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.917+0000 7f518e800640 1 -- 172.21.15.90:0/2649999530 >> 172.21.15.90:0/2649999530 conn(0x7f51880cc270 msgr2=0x7f51880cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:02.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.917+0000 7f518e800640 1 -- 172.21.15.90:0/2649999530 shutdown_connections 2024-09-21T03:17:02.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.917+0000 7f518e800640 1 -- 172.21.15.90:0/2649999530 wait complete. 2024-09-21T03:17:02.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.919+0000 7f518e800640 1 Processor -- start 2024-09-21T03:17:02.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.920+0000 7f518e800640 1 -- start start 2024-09-21T03:17:02.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.921+0000 7f518e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51880c7120 0x7f51881f0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:02.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.921+0000 7f518e800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51880c8c50 0x7f51881e0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:02.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.921+0000 7f518e800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5188156ad0 0x7f5188143c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:02.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.921+0000 7f518e800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5188154680 con 0x7f51880c7120 2024-09-21T03:17:02.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.921+0000 7f518e800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f51880cba00 con 0x7f5188156ad0 2024-09-21T03:17:02.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.921+0000 7f518e800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f51880c8840 con 0x7f51880c8c50 2024-09-21T03:17:02.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.921+0000 7f518d400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51880c7120 0x7f51881f0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:02.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.921+0000 7f518d400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51880c7120 0x7f51881f0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36944/0 (socket says 172.21.15.90:36944) 2024-09-21T03:17:02.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.921+0000 7f518d400640 1 -- 172.21.15.90:0/2514973897 learned_addr learned my addr 172.21.15.90:0/2514973897 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:17:02.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.921+0000 7f518de00640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5188156ad0 0x7f5188143c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:02.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.921+0000 7f518ca00640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51880c8c50 0x7f51881e0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:02.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.922+0000 7f518de00640 1 -- 172.21.15.90:0/2514973897 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51880c8c50 msgr2=0x7f51881e0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:02.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.922+0000 7f518de00640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51880c8c50 0x7f51881e0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:02.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.922+0000 7f518de00640 1 -- 172.21.15.90:0/2514973897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51880c7120 msgr2=0x7f51881f0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:02.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.922+0000 7f518de00640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51880c7120 0x7f51881f0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:02.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.922+0000 7f518de00640 1 -- 172.21.15.90:0/2514973897 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5188144900 con 0x7f5188156ad0 2024-09-21T03:17:02.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.922+0000 7f518d400640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51880c7120 0x7f51881f0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:17:02.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.922+0000 7f518de00640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5188156ad0 0x7f5188143c00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f51880af200 tx=0x7f518000ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:02.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.922+0000 7f5185600640 1 -- 172.21.15.90:0/2514973897 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518000cd50 con 0x7f5188156ad0 2024-09-21T03:17:02.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.922+0000 7f5185600640 1 -- 172.21.15.90:0/2514973897 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5180004b20 con 0x7f5188156ad0 2024-09-21T03:17:02.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.922+0000 7f518e800640 1 -- 172.21.15.90:0/2514973897 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51881e20e0 con 0x7f5188156ad0 2024-09-21T03:17:02.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.923+0000 7f5185600640 1 -- 172.21.15.90:0/2514973897 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180005020 con 0x7f5188156ad0 2024-09-21T03:17:02.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.923+0000 7f518e800640 1 -- 172.21.15.90:0/2514973897 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51881e1760 con 0x7f5188156ad0 2024-09-21T03:17:02.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.924+0000 7f518e800640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51881e12e0 0x7f5188144140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:02.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.924+0000 7f518e800640 1 -- 172.21.15.90:0/2514973897 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f518815b270 con 0x7f51881e12e0 2024-09-21T03:17:02.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.924+0000 7f518d400640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51881e12e0 0x7f5188144140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:02.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.925+0000 7f518d400640 1 -- 172.21.15.90:0/2514973897 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f51881e1a00 con 0x7f51881e12e0 2024-09-21T03:17:02.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.925+0000 7f518d400640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51881e12e0 0x7f5188144140 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f517c011d20 tx=0x7f517c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:02.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.925+0000 7f5185600640 1 -- 172.21.15.90:0/2514973897 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c01e070 con 0x7f51881e12e0 2024-09-21T03:17:02.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.925+0000 7f5185600640 1 -- 172.21.15.90:0/2514973897 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f51800051c0 con 0x7f5188156ad0 2024-09-21T03:17:02.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.926+0000 7f5185600640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5168078ac0 0x7f516807afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:02.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.926+0000 7f5185600640 1 -- 172.21.15.90:0/2514973897 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f518009bcd0 con 0x7f5188156ad0 2024-09-21T03:17:02.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.927+0000 7f5185600640 1 -- 172.21.15.90:0/2514973897 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f517c00e7c0 con 0x7f51881e12e0 2024-09-21T03:17:02.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.927+0000 7f5185600640 1 -- 172.21.15.90:0/2514973897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51881e12e0 msgr2=0x7f5188144140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:02.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.927+0000 7f5185600640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51881e12e0 0x7f5188144140 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f517c011d20 tx=0x7f517c00f790 comp rx=0 tx=0).stop 2024-09-21T03:17:02.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.927+0000 7f5185600640 1 -- 172.21.15.90:0/2514973897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51881e12e0 msgr2=0x7f5188144140 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:17:02.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.927+0000 7f5185600640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51881e12e0 0x7f5188144140 secure :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f517c011d20 tx=0x7f517c00f790 comp rx=0 tx=0).stop 2024-09-21T03:17:02.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.927+0000 7f518ca00640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5168078ac0 0x7f516807afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:02.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.927+0000 7f518ca00640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5168078ac0 0x7f516807afd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5174033000 tx=0x7f5174004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:02.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.933+0000 7f518e800640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5188144ad0 0x7f51881ec870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:02.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.933+0000 7f518e800640 1 -- 172.21.15.90:0/2514973897 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5188154070 con 0x7f5188144ad0 2024-09-21T03:17:02.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.933+0000 7f518d400640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5188144ad0 0x7f51881ec870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:02.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.934+0000 7f518d400640 1 -- 172.21.15.90:0/2514973897 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f51880ca2b0 con 0x7f5188144ad0 2024-09-21T03:17:02.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.934+0000 7f518d400640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5188144ad0 0x7f51881ec870 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f517c011d20 tx=0x7f517c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:02.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.934+0000 7f5185600640 1 -- 172.21.15.90:0/2514973897 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c005220 con 0x7f5188144ad0 2024-09-21T03:17:02.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.935+0000 7f5185600640 1 -- 172.21.15.90:0/2514973897 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4549 (secure 0 0 0) 0x7f517c005220 con 0x7f5188144ad0 2024-09-21T03:17:02.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.935+0000 7f5185600640 1 -- 172.21.15.90:0/2514973897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5188144ad0 msgr2=0x7f51881ec870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:02.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.935+0000 7f5185600640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5188144ad0 0x7f51881ec870 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f517c011d20 tx=0x7f517c0046c0 comp rx=0 tx=0).stop 2024-09-21T03:17:02.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.935+0000 7f5185600640 1 -- 172.21.15.90:0/2514973897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5188144ad0 msgr2=0x7f51881ec870 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:17:02.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.935+0000 7f5185600640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5188144ad0 0x7f51881ec870 secure :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f517c011d20 tx=0x7f517c0046c0 comp rx=0 tx=0).stop 2024-09-21T03:17:02.937 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:17:02.937 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:17:02.937 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:17:02.937 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:17:02.937 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 20, 2024-09-21T03:17:02.938 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 8906, 2024-09-21T03:17:02.938 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:17:02.938 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:17:02.938 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:17:02.938 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:17:02.938 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:02.938 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 2, 2024-09-21T03:17:02.938 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:17:02.938 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:17:02.938 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:17:02.938 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:02.938 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:02.938 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:02.938 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:02.938 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:02.939 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:02.939 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:02.939 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:02.939 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:02.939 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:02.939 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:02.939 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:02.939 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:17:02.939 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:17:02.939 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:02.939 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:02.939 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:02.939 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:02.939 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:02.940 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:02.940 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:02.940 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:02.940 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:02.940 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:02.940 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:02.940 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:02.940 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:02.940 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:17:02.940 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:17:02.940 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:17:02.940 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:17:02.940 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:17:02.940 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:17:02.940 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:17:02.941 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:17:02.941 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:17:02.941 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:17:02.941 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:17:02.941 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:17:02.941 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:17:02.941 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:17:02.941 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:17:02.941 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:17:02.941 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:17:02.941 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:02.941 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:02.941 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:02.941 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:02.941 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:02.942 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:02.942 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:02.942 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:02.942 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:02.942 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:02.942 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:02.942 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:02.942 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:17:02.942 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:02.942 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:17:02.942 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:02.942 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:17:02.942 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:17:02.942 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:02.943 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:02.943 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:02.943 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:02.943 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:17:02.943 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:02.943 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:02.943 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:02.943 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:02.943 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:17:02.943 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:02.943 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:02.943 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:02.943 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:02.943 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:17:02.943 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:17:02.944 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:02.944 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:02.944 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:02.944 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:02.944 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:02.944 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:17:02.944 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:17:02.944 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:02.944 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:02.944 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:02.944 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:02.944 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:17:02.944 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:02.944 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:02.944 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:02.945 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:02.945 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:17:02.945 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:02.945 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:02.945 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:02.945 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:02.945 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:17:02.945 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:17:02.945 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:02.945 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:02.945 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:02.945 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:02.945 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:02.945 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:17:02.945 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:17:02.946 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:02.946 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:02.946 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:02.946 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:02.946 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:17:02.946 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:02.946 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:02.946 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:02.946 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:02.946 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:17:02.946 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:02.946 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:02.946 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:02.946 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:02.946 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:17:02.947 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:17:02.947 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:02.947 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:02.947 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:02.947 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:02.947 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:02.947 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:02.947 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:17:02.947 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:17:02.947 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:02.947 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:02.947 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:02.947 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:17:02.947 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:02.947 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:02.948 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:17:02.948 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:02.948 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:02.948 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:02.948 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:17:02.948 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:02.948 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:02.948 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:02.948 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:17:02.948 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:17:02.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.935+0000 7f518e800640 1 -- 172.21.15.90:0/2514973897 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5168078ac0 msgr2=0x7f516807afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:02.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.935+0000 7f518e800640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5168078ac0 0x7f516807afd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5174033000 tx=0x7f5174004730 comp rx=0 tx=0).stop 2024-09-21T03:17:02.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.935+0000 7f518e800640 1 -- 172.21.15.90:0/2514973897 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5188156ad0 msgr2=0x7f5188143c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:02.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.935+0000 7f518e800640 1 --2- 172.21.15.90:0/2514973897 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5188156ad0 0x7f5188143c00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f51880af200 tx=0x7f518000ee40 comp rx=0 tx=0).stop 2024-09-21T03:17:02.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.935+0000 7f518de00640 1 -- 172.21.15.90:0/2514973897 reap_dead start 2024-09-21T03:17:02.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.935+0000 7f518de00640 1 -- 172.21.15.90:0/2514973897 reap_dead start 2024-09-21T03:17:02.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.935+0000 7f518e800640 1 -- 172.21.15.90:0/2514973897 shutdown_connections 2024-09-21T03:17:02.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.935+0000 7f518e800640 1 -- 172.21.15.90:0/2514973897 >> 172.21.15.90:0/2514973897 conn(0x7f51880cc270 msgr2=0x7f51880cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:02.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.935+0000 7f518e800640 1 -- 172.21.15.90:0/2514973897 shutdown_connections 2024-09-21T03:17:02.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:02.935+0000 7f518e800640 1 -- 172.21.15.90:0/2514973897 wait complete. 2024-09-21T03:17:02.960 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:17:02.960 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-21T03:17:02.960 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:17:03.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.192+0000 7f41a8400640 1 -- 172.21.15.90:0/1926007084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a006ddf0 msgr2=0x7f41a006e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:03.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.192+0000 7f41a8400640 1 --2- 172.21.15.90:0/1926007084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a006ddf0 0x7f41a006e200 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4198005fd0 tx=0x7f419802aa90 comp rx=0 tx=0).stop 2024-09-21T03:17:03.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.192+0000 7f41a8400640 1 -- 172.21.15.90:0/1926007084 shutdown_connections 2024-09-21T03:17:03.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.192+0000 7f41a8400640 1 --2- 172.21.15.90:0/1926007084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a006ddf0 0x7f41a006e200 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.192+0000 7f41a8400640 1 --2- 172.21.15.90:0/1926007084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f41a00c7860 0x7f41a01577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.192+0000 7f41a8400640 1 -- 172.21.15.90:0/1926007084 >> 172.21.15.90:0/1926007084 conn(0x7f41a00c54b0 msgr2=0x7f41a00c58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:03.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.192+0000 7f41a8400640 1 -- 172.21.15.90:0/1926007084 shutdown_connections 2024-09-21T03:17:03.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.192+0000 7f41a8400640 1 -- 172.21.15.90:0/1926007084 wait complete. 2024-09-21T03:17:03.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.194+0000 7f41a8400640 1 Processor -- start 2024-09-21T03:17:03.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.194+0000 7f41a8400640 1 -- start start 2024-09-21T03:17:03.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.195+0000 7f41a8400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a006ddf0 0x7f41a01f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:03.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.195+0000 7f41a8400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f41a00c7330 0x7f41a00abd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:03.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.196+0000 7f41a8400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a00c7860 0x7f41a0150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:03.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.196+0000 7f41a8400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f41a00c3dd0 con 0x7f41a006ddf0 2024-09-21T03:17:03.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.196+0000 7f41a8400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f41a00c33b0 con 0x7f41a00c7860 2024-09-21T03:17:03.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.196+0000 7f41a8400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f41a00c3f50 con 0x7f41a00c7330 2024-09-21T03:17:03.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.196+0000 7f41a5a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a006ddf0 0x7f41a01f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:03.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.196+0000 7f41a5a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a006ddf0 0x7f41a01f0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36980/0 (socket says 172.21.15.90:36980) 2024-09-21T03:17:03.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.196+0000 7f41a5a00640 1 -- 172.21.15.90:0/3746340592 learned_addr learned my addr 172.21.15.90:0/3746340592 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:17:03.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.196+0000 7f41a6400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a00c7860 0x7f41a0150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:03.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.196+0000 7f41a5000640 1 --2- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f41a00c7330 0x7f41a00abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:03.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.196+0000 7f41a6400640 1 -- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f41a00c7330 msgr2=0x7f41a00abd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:03.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.196+0000 7f41a6400640 1 --2- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f41a00c7330 0x7f41a00abd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.196+0000 7f41a6400640 1 -- 172.21.15.90:0/3746340592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a006ddf0 msgr2=0x7f41a01f0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:03.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.196+0000 7f41a6400640 1 --2- 172.21.15.90:0/3746340592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a006ddf0 0x7f41a01f0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.196+0000 7f41a6400640 1 -- 172.21.15.90:0/3746340592 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a0151de0 con 0x7f41a00c7860 2024-09-21T03:17:03.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.196+0000 7f41a5a00640 1 --2- 172.21.15.90:0/3746340592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a006ddf0 0x7f41a01f0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:17:03.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.197+0000 7f41a6400640 1 --2- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a00c7860 0x7f41a0150ce0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4198032000 tx=0x7f4198003ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:03.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.197+0000 7f419d600640 1 -- 172.21.15.90:0/3746340592 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4198044070 con 0x7f41a00c7860 2024-09-21T03:17:03.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.197+0000 7f419d600640 1 -- 172.21.15.90:0/3746340592 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4198003e50 con 0x7f41a00c7860 2024-09-21T03:17:03.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.197+0000 7f419d600640 1 -- 172.21.15.90:0/3746340592 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41980044b0 con 0x7f41a00c7860 2024-09-21T03:17:03.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.197+0000 7f41a8400640 1 -- 172.21.15.90:0/3746340592 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a01518e0 con 0x7f41a00c7860 2024-09-21T03:17:03.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.197+0000 7f41a8400640 1 -- 172.21.15.90:0/3746340592 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a0152640 con 0x7f41a00c7860 2024-09-21T03:17:03.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.198+0000 7f41a8400640 1 --2- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a0151220 0x7f41a01533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:03.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.198+0000 7f41a8400640 1 -- 172.21.15.90:0/3746340592 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f41a0151760 con 0x7f41a0151220 2024-09-21T03:17:03.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.199+0000 7f41a5a00640 1 --2- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a0151220 0x7f41a01533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:03.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.199+0000 7f41a5a00640 1 -- 172.21.15.90:0/3746340592 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41a00ad360 con 0x7f41a0151220 2024-09-21T03:17:03.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.199+0000 7f41a5a00640 1 --2- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a0151220 0x7f41a01533f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4194009ec0 tx=0x7f419400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:03.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.200+0000 7f419d600640 1 -- 172.21.15.90:0/3746340592 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419401e070 con 0x7f41a0151220 2024-09-21T03:17:03.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.200+0000 7f419d600640 1 -- 172.21.15.90:0/3746340592 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4198004650 con 0x7f41a00c7860 2024-09-21T03:17:03.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.201+0000 7f419d600640 1 --2- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4180078a90 0x7f418007afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:03.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.201+0000 7f419d600640 1 -- 172.21.15.90:0/3746340592 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f41980bbe70 con 0x7f41a00c7860 2024-09-21T03:17:03.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.201+0000 7f419d600640 1 -- 172.21.15.90:0/3746340592 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f419400e880 con 0x7f41a0151220 2024-09-21T03:17:03.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.201+0000 7f419d600640 1 -- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a0151220 msgr2=0x7f41a01533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:03.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.201+0000 7f419d600640 1 --2- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a0151220 0x7f41a01533f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4194009ec0 tx=0x7f419400f790 comp rx=0 tx=0).stop 2024-09-21T03:17:03.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.201+0000 7f419d600640 1 -- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a0151220 msgr2=0x7f41a01533f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:17:03.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.201+0000 7f419d600640 1 --2- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a0151220 0x7f41a01533f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.201+0000 7f41a5000640 1 --2- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4180078a90 0x7f418007afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:03.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.202+0000 7f41a5000640 1 --2- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4180078a90 0x7f418007afa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f41a00a7d80 tx=0x7f418c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:03.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.208+0000 7f41a8400640 1 --2- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a00ac8a0 0x7f41a00accb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:03.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.208+0000 7f41a8400640 1 -- 172.21.15.90:0/3746340592 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f41a0153fb0 con 0x7f41a00ac8a0 2024-09-21T03:17:03.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.219+0000 7f41a5a00640 1 --2- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a00ac8a0 0x7f41a00accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:03.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.242+0000 7f41a5a00640 1 -- 172.21.15.90:0/3746340592 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f41a0156d90 con 0x7f41a00ac8a0 2024-09-21T03:17:03.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.266+0000 7f41a5a00640 1 --2- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a00ac8a0 0x7f41a00accb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f419401b000 tx=0x7f41940046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:03.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.278+0000 7f419d600640 1 -- 172.21.15.90:0/3746340592 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4194019840 con 0x7f41a00ac8a0 2024-09-21T03:17:03.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.278+0000 7f419d600640 1 -- 172.21.15.90:0/3746340592 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5193 (secure 0 0 0) 0x7f419402c430 con 0x7f41a00ac8a0 2024-09-21T03:17:03.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.278+0000 7f419d600640 1 -- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a00ac8a0 msgr2=0x7f41a00accb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:03.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.278+0000 7f419d600640 1 --2- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a00ac8a0 0x7f41a00accb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f419401b000 tx=0x7f41940046c0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.280 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:17:03.280 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:17:03.280 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:17:03.281 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:17:03.281 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 20, 2024-09-21T03:17:03.281 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 174067, 2024-09-21T03:17:03.281 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:17:03.281 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:17:03.281 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:17:03.281 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:17:03.281 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:03.281 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 3, 2024-09-21T03:17:03.281 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:17:03.281 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:17:03.281 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:17:03.281 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:03.282 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:03.282 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:03.282 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:03.282 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:03.282 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:03.282 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:03.282 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:03.282 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:03.282 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:03.282 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:03.282 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:03.282 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:17:03.282 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:17:03.282 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:03.283 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:03.283 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:03.283 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:03.283 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:03.283 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:03.283 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:03.283 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:03.283 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:03.283 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:03.283 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:03.283 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:03.284 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.284 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:17:03.284 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:17:03.284 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:17:03.284 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:17:03.284 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:17:03.284 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:17:03.284 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:17:03.284 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:17:03.284 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:17:03.284 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:17:03.284 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:17:03.284 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:17:03.284 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:17:03.285 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:17:03.285 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:17:03.285 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:17:03.285 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:17:03.285 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:03.285 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:03.285 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:03.285 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:03.285 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:03.285 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:03.285 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:03.285 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:03.285 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:03.285 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:03.286 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:03.286 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:03.286 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:17:03.286 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.286 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:17:03.286 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.286 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:17:03.286 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:17:03.286 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:03.286 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:03.286 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.286 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:03.286 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:17:03.286 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:03.287 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.287 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.287 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:03.287 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:17:03.287 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:03.287 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:03.287 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:03.287 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.287 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:17:03.287 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:17:03.287 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:03.287 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:03.287 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:03.287 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.288 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.288 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:17:03.288 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:17:03.288 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:03.288 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:03.288 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.288 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:03.288 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:17:03.288 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:03.288 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.288 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.288 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:03.288 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:17:03.288 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:03.289 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:03.289 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:03.289 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.289 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:17:03.289 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:17:03.289 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:03.289 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:03.289 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:03.289 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.289 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.289 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:17:03.289 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:17:03.289 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:03.289 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:03.289 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.290 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:03.290 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:17:03.290 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:03.290 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.290 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.290 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:03.290 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:17:03.290 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:03.290 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:03.290 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:03.290 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.290 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:17:03.290 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:17:03.290 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:03.291 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:03.291 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:03.291 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:03.291 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:03.291 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.291 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:17:03.291 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:17:03.291 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.291 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:03.291 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:03.291 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:17:03.291 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:03.291 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:03.291 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:17:03.291 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.292 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:03.292 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:03.292 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:17:03.292 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:03.292 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:03.292 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:17:03.292 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.292 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:03.292 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:03.292 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6 2024-09-21T03:17:03.292 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:03.292 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:03.292 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:17:03.292 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.293 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:17:03.293 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:17:03.293 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:17:03.293 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.293 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.293 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:03.293 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:03.293 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6 2024-09-21T03:17:03.293 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:03.293 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:03.293 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:17:03.293 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.293 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:03.293 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:03.293 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:17:03.294 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:03.294 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:03.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.294 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:17:03.294 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:17:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.278+0000 7f419d600640 1 -- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a00ac8a0 msgr2=0x7f41a00accb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:17:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.278+0000 7f419d600640 1 --2- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a00ac8a0 0x7f41a00accb0 secure :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f419401b000 tx=0x7f41940046c0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.279+0000 7f41a8400640 1 -- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4180078a90 msgr2=0x7f418007afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.279+0000 7f41a8400640 1 --2- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4180078a90 0x7f418007afa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f41a00a7d80 tx=0x7f418c009040 comp rx=0 tx=0).stop 2024-09-21T03:17:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.279+0000 7f41a8400640 1 -- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a00c7860 msgr2=0x7f41a0150ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.279+0000 7f41a8400640 1 --2- 172.21.15.90:0/3746340592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41a00c7860 0x7f41a0150ce0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4198032000 tx=0x7f4198003ce0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.279+0000 7f41a6400640 1 -- 172.21.15.90:0/3746340592 reap_dead start 2024-09-21T03:17:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.279+0000 7f41a6400640 1 -- 172.21.15.90:0/3746340592 reap_dead start 2024-09-21T03:17:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.279+0000 7f41a8400640 1 -- 172.21.15.90:0/3746340592 shutdown_connections 2024-09-21T03:17:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.279+0000 7f41a8400640 1 -- 172.21.15.90:0/3746340592 >> 172.21.15.90:0/3746340592 conn(0x7f41a00c54b0 msgr2=0x7f41a00c58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.279+0000 7f41a8400640 1 -- 172.21.15.90:0/3746340592 shutdown_connections 2024-09-21T03:17:03.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.279+0000 7f41a8400640 1 -- 172.21.15.90:0/3746340592 wait complete. 2024-09-21T03:17:03.301 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:17:03.301 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-21T03:17:03.301 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:17:03.439 INFO:tasks.workunit.client.1.smithi149.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-09-21T03:17:03.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.529+0000 7f2f3a400640 1 -- 172.21.15.90:0/2985413087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f34073210 msgr2=0x7f2f34073620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:03.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.529+0000 7f2f3a400640 1 --2- 172.21.15.90:0/2985413087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f34073210 0x7f2f34073620 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c005fd0 tx=0x7f2f2c02a710 comp rx=0 tx=0).stop 2024-09-21T03:17:03.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.529+0000 7f2f3a400640 1 -- 172.21.15.90:0/2985413087 shutdown_connections 2024-09-21T03:17:03.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.529+0000 7f2f3a400640 1 --2- 172.21.15.90:0/2985413087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f34073210 0x7f2f34073620 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.529+0000 7f2f3a400640 1 --2- 172.21.15.90:0/2985413087 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f340ab3d0 0x7f2f34154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.529+0000 7f2f3a400640 1 -- 172.21.15.90:0/2985413087 >> 172.21.15.90:0/2985413087 conn(0x7f2f340c85a0 msgr2=0x7f2f340c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:03.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.529+0000 7f2f3a400640 1 -- 172.21.15.90:0/2985413087 shutdown_connections 2024-09-21T03:17:03.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.529+0000 7f2f3a400640 1 -- 172.21.15.90:0/2985413087 wait complete. 2024-09-21T03:17:03.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.531+0000 7f2f3a400640 1 Processor -- start 2024-09-21T03:17:03.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.531+0000 7f2f3a400640 1 -- start start 2024-09-21T03:17:03.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.532+0000 7f2f3a400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f34073210 0x7f2f34158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:03.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.532+0000 7f2f3a400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f340ab3d0 0x7f2f34073d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:03.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.532+0000 7f2f3a400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f340abd30 0x7f2f3406faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:03.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.532+0000 7f2f3a400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2f340ae290 con 0x7f2f340abd30 2024-09-21T03:17:03.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.532+0000 7f2f3a400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2f340ae110 con 0x7f2f34073210 2024-09-21T03:17:03.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.532+0000 7f2f3a400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2f340add10 con 0x7f2f340ab3d0 2024-09-21T03:17:03.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.533+0000 7f2f33e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f340abd30 0x7f2f3406faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:03.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.533+0000 7f2f32a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f340ab3d0 0x7f2f34073d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:03.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.533+0000 7f2f33e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f340abd30 0x7f2f3406faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36992/0 (socket says 172.21.15.90:36992) 2024-09-21T03:17:03.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.533+0000 7f2f33e00640 1 -- 172.21.15.90:0/2574116733 learned_addr learned my addr 172.21.15.90:0/2574116733 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:17:03.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.533+0000 7f2f33400640 1 --2- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f34073210 0x7f2f34158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:03.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.533+0000 7f2f33e00640 1 -- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f340ab3d0 msgr2=0x7f2f34073d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:03.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.533+0000 7f2f33e00640 1 --2- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f340ab3d0 0x7f2f34073d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.533+0000 7f2f33e00640 1 -- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f34073210 msgr2=0x7f2f34158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:03.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.533+0000 7f2f33e00640 1 --2- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f34073210 0x7f2f34158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.533+0000 7f2f33e00640 1 -- 172.21.15.90:0/2574116733 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f340c7cb0 con 0x7f2f340abd30 2024-09-21T03:17:03.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.533+0000 7f2f33400640 1 --2- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f34073210 0x7f2f34158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:17:03.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.534+0000 7f2f33e00640 1 --2- 172.21.15.90:0/2574116733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f340abd30 0x7f2f3406faa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c009cd0 tx=0x7f2f2c032be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:03.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.534+0000 7f2f2b400640 1 -- 172.21.15.90:0/2574116733 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c041020 con 0x7f2f340abd30 2024-09-21T03:17:03.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.534+0000 7f2f2b400640 1 -- 172.21.15.90:0/2574116733 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f2c004040 con 0x7f2f340abd30 2024-09-21T03:17:03.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.534+0000 7f2f2b400640 1 -- 172.21.15.90:0/2574116733 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c036040 con 0x7f2f340abd30 2024-09-21T03:17:03.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.534+0000 7f2f3a400640 1 -- 172.21.15.90:0/2574116733 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f340c2130 con 0x7f2f340abd30 2024-09-21T03:17:03.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.534+0000 7f2f3a400640 1 -- 172.21.15.90:0/2574116733 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f341de1f0 con 0x7f2f340abd30 2024-09-21T03:17:03.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.535+0000 7f2f3a400640 1 --2- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f341de610 0x7f2f3406ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:03.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.535+0000 7f2f3a400640 1 -- 172.21.15.90:0/2574116733 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2f34159000 con 0x7f2f341de610 2024-09-21T03:17:03.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.536+0000 7f2f33400640 1 --2- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f341de610 0x7f2f3406ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:03.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.536+0000 7f2f33400640 1 -- 172.21.15.90:0/2574116733 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f341ed2b0 con 0x7f2f341de610 2024-09-21T03:17:03.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.537+0000 7f2f33400640 1 --2- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f341de610 0x7f2f3406ffe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2f24011c20 tx=0x7f2f2400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:03.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.537+0000 7f2f2b400640 1 -- 172.21.15.90:0/2574116733 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f2c044020 con 0x7f2f340abd30 2024-09-21T03:17:03.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.538+0000 7f2f2b400640 1 --2- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2f14078b90 0x7f2f1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:03.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.538+0000 7f2f2b400640 1 -- 172.21.15.90:0/2574116733 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f2f2c0bbf30 con 0x7f2f340abd30 2024-09-21T03:17:03.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.538+0000 7f2f2b400640 1 -- 172.21.15.90:0/2574116733 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f24005440 con 0x7f2f341de610 2024-09-21T03:17:03.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.538+0000 7f2f2b400640 1 -- 172.21.15.90:0/2574116733 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2f240055e0 con 0x7f2f341de610 2024-09-21T03:17:03.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.538+0000 7f2f2b400640 1 -- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f341de610 msgr2=0x7f2f3406ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:03.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.538+0000 7f2f2b400640 1 --2- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f341de610 0x7f2f3406ffe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2f24011c20 tx=0x7f2f2400f790 comp rx=0 tx=0).stop 2024-09-21T03:17:03.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.538+0000 7f2f2b400640 1 -- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f341de610 msgr2=0x7f2f3406ffe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:17:03.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.538+0000 7f2f2b400640 1 --2- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f341de610 0x7f2f3406ffe0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.538+0000 7f2f32a00640 1 --2- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2f14078b90 0x7f2f1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:03.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.539+0000 7f2f32a00640 1 --2- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2f14078b90 0x7f2f1407b0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2f34076d00 tx=0x7f2f20001ad0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:03.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.545+0000 7f2f3a400640 1 --2- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f341efdd0 0x7f2f341f01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:03.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.545+0000 7f2f3a400640 1 -- 172.21.15.90:0/2574116733 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2f341ded10 con 0x7f2f341efdd0 2024-09-21T03:17:03.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.545+0000 7f2f33400640 1 --2- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f341efdd0 0x7f2f341f01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:03.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.546+0000 7f2f33400640 1 -- 172.21.15.90:0/2574116733 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2f34070520 con 0x7f2f341efdd0 2024-09-21T03:17:03.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.546+0000 7f2f33400640 1 --2- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f341efdd0 0x7f2f341f01e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2f24011c20 tx=0x7f2f240046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:03.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.546+0000 7f2f2b400640 1 -- 172.21.15.90:0/2574116733 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f24020c20 con 0x7f2f341efdd0 2024-09-21T03:17:03.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.547+0000 7f2f2b400640 1 -- 172.21.15.90:0/2574116733 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4882 (secure 0 0 0) 0x7f2f24020c20 con 0x7f2f341efdd0 2024-09-21T03:17:03.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.547+0000 7f2f2b400640 1 -- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f341efdd0 msgr2=0x7f2f341f01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:03.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.547+0000 7f2f2b400640 1 --2- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f341efdd0 0x7f2f341f01e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2f24011c20 tx=0x7f2f240046c0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.547+0000 7f2f2b400640 1 -- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f341efdd0 msgr2=0x7f2f341f01e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:17:03.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.547+0000 7f2f2b400640 1 --2- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f341efdd0 0x7f2f341f01e0 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2f24011c20 tx=0x7f2f240046c0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.549 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:17:03.549 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:17:03.549 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:17:03.549 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:17:03.549 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 20, 2024-09-21T03:17:03.549 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 63739, 2024-09-21T03:17:03.550 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:17:03.550 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:17:03.550 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:17:03.550 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:17:03.550 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:03.550 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 3, 2024-09-21T03:17:03.550 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:17:03.550 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:17:03.550 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:17:03.550 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:03.550 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:03.550 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:03.550 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:03.550 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:03.551 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:03.551 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:03.551 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:03.551 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:03.551 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:03.551 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:03.551 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:03.551 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:17:03.551 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:17:03.551 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:03.551 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:03.551 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:03.551 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:03.551 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:03.552 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:03.552 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:03.552 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:03.552 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:03.552 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:03.552 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:03.552 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:03.552 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.552 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:17:03.552 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:17:03.552 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:17:03.552 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:17:03.552 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:17:03.552 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:17:03.553 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:17:03.553 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:17:03.553 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:17:03.553 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:17:03.553 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:17:03.553 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:17:03.553 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:17:03.553 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:17:03.553 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:17:03.553 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:17:03.553 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:17:03.553 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:03.553 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:03.553 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:03.554 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:03.554 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:03.554 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:03.554 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:03.554 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:03.554 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:03.554 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:03.554 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:03.554 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:03.554 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:17:03.554 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.554 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:17:03.554 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.554 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:17:03.555 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:17:03.555 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:03.555 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:03.555 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.555 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:03.555 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:17:03.555 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:03.555 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.555 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.555 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:03.555 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:17:03.555 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:03.555 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:03.555 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:03.556 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.556 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:17:03.556 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:17:03.556 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:03.556 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:03.556 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:03.556 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.556 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.556 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:17:03.556 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:17:03.556 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:03.556 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:03.556 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.556 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:03.557 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:17:03.557 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:03.557 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.557 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.557 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:03.557 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:17:03.557 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:03.557 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:03.557 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:03.557 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.557 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:17:03.557 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:17:03.557 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:03.557 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:03.557 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:03.558 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.558 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.558 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:17:03.558 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:17:03.558 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:03.558 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:03.558 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.558 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:03.558 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:17:03.558 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:03.558 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.558 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.558 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:03.558 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:17:03.558 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:03.559 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:03.559 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:03.559 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.559 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:17:03.559 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:17:03.559 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:03.559 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:03.559 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:03.559 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:03.559 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:03.559 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.559 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:17:03.559 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:17:03.559 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.560 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:03.560 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:03.560 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:17:03.560 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:03.560 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:03.560 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:17:03.560 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.560 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:03.560 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:03.560 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:17:03.560 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:03.560 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:03.560 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:17:03.560 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.560 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:03.561 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:03.561 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:17:03.561 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:03.561 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:03.561 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:17:03.561 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:03.561 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:03.561 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:03.561 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:17:03.561 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:03.561 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:03.561 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:03.561 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:17:03.561 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:17:03.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.547+0000 7f2f3a400640 1 -- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2f14078b90 msgr2=0x7f2f1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:03.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.547+0000 7f2f3a400640 1 --2- 172.21.15.90:0/2574116733 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2f14078b90 0x7f2f1407b0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2f34076d00 tx=0x7f2f20001ad0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.547+0000 7f2f3a400640 1 -- 172.21.15.90:0/2574116733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f340abd30 msgr2=0x7f2f3406faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:03.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.547+0000 7f2f3a400640 1 --2- 172.21.15.90:0/2574116733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f340abd30 0x7f2f3406faa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c009cd0 tx=0x7f2f2c032be0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.547+0000 7f2f33e00640 1 -- 172.21.15.90:0/2574116733 reap_dead start 2024-09-21T03:17:03.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.547+0000 7f2f33e00640 1 -- 172.21.15.90:0/2574116733 reap_dead start 2024-09-21T03:17:03.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.547+0000 7f2f3a400640 1 -- 172.21.15.90:0/2574116733 shutdown_connections 2024-09-21T03:17:03.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.547+0000 7f2f3a400640 1 -- 172.21.15.90:0/2574116733 >> 172.21.15.90:0/2574116733 conn(0x7f2f340c85a0 msgr2=0x7f2f3414a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:03.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.547+0000 7f2f3a400640 1 -- 172.21.15.90:0/2574116733 shutdown_connections 2024-09-21T03:17:03.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.547+0000 7f2f3a400640 1 -- 172.21.15.90:0/2574116733 wait complete. 2024-09-21T03:17:03.575 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:17:03.575 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-21T03:17:03.575 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-21T03:17:03.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.805+0000 7f76bd200640 1 -- 172.21.15.90:0/964127833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76b80ca7d0 msgr2=0x7f76b80cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:03.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.805+0000 7f76bd200640 1 --2- 172.21.15.90:0/964127833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76b80ca7d0 0x7f76b80cabe0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f76b8073ab0 tx=0x7f76b002a8f0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.805+0000 7f76bd200640 1 -- 172.21.15.90:0/964127833 shutdown_connections 2024-09-21T03:17:03.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.805+0000 7f76bd200640 1 --2- 172.21.15.90:0/964127833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76b80ca7d0 0x7f76b80cabe0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.805+0000 7f76bd200640 1 --2- 172.21.15.90:0/964127833 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76b81520e0 0x7f76b8158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.805+0000 7f76bd200640 1 --2- 172.21.15.90:0/964127833 >> v2:172.21.15.149:3300/0 conn(0x7f76b80bf920 0x7f76b8154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.805+0000 7f76bd200640 1 -- 172.21.15.90:0/964127833 >> 172.21.15.90:0/964127833 conn(0x7f76b80ac360 msgr2=0x7f76b80ca0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:03.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.805+0000 7f76bd200640 1 -- 172.21.15.90:0/964127833 shutdown_connections 2024-09-21T03:17:03.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.805+0000 7f76bd200640 1 -- 172.21.15.90:0/964127833 wait complete. 2024-09-21T03:17:03.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.807+0000 7f76bd200640 1 Processor -- start 2024-09-21T03:17:03.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.807+0000 7f76bd200640 1 -- start start 2024-09-21T03:17:03.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.809+0000 7f76bd200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76b80bf920 0x7f76b806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:03.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.809+0000 7f76bd200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76b80ca7d0 0x7f76b81e0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:03.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.809+0000 7f76bd200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76b81520e0 0x7f76b81efba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:03.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.809+0000 7f76bd200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f76b80c5bb0 con 0x7f76b81520e0 2024-09-21T03:17:03.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.809+0000 7f76bd200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f76b80c5a30 con 0x7f76b80bf920 2024-09-21T03:17:03.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.809+0000 7f76bd200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f76b8158bd0 con 0x7f76b80ca7d0 2024-09-21T03:17:03.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.809+0000 7f76b7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76b81520e0 0x7f76b81efba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:03.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.809+0000 7f76b7400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76b80bf920 0x7f76b806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:03.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.809+0000 7f76b7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76b81520e0 0x7f76b81efba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37016/0 (socket says 172.21.15.90:37016) 2024-09-21T03:17:03.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.809+0000 7f76b7e00640 1 -- 172.21.15.90:0/2294146057 learned_addr learned my addr 172.21.15.90:0/2294146057 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:17:03.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.809+0000 7f76afe00640 1 --2- 172.21.15.90:0/2294146057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76b80ca7d0 0x7f76b81e0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:03.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.810+0000 7f76b7e00640 1 -- 172.21.15.90:0/2294146057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76b80ca7d0 msgr2=0x7f76b81e0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:03.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.810+0000 7f76b7e00640 1 --2- 172.21.15.90:0/2294146057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76b80ca7d0 0x7f76b81e0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.810+0000 7f76b7e00640 1 -- 172.21.15.90:0/2294146057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76b80bf920 msgr2=0x7f76b806e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:03.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.810+0000 7f76b7e00640 1 --2- 172.21.15.90:0/2294146057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76b80bf920 0x7f76b806e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:03.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.810+0000 7f76b7e00640 1 -- 172.21.15.90:0/2294146057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b814fbc0 con 0x7f76b81520e0 2024-09-21T03:17:03.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.810+0000 7f76b7e00640 1 --2- 172.21.15.90:0/2294146057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76b81520e0 0x7f76b81efba0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009d60 tx=0x7f76b0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:03.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.810+0000 7f76af400640 1 -- 172.21.15.90:0/2294146057 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b0004040 con 0x7f76b81520e0 2024-09-21T03:17:03.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.810+0000 7f76af400640 1 -- 172.21.15.90:0/2294146057 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76b002d070 con 0x7f76b81520e0 2024-09-21T03:17:03.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.810+0000 7f76bd200640 1 -- 172.21.15.90:0/2294146057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b81ed060 con 0x7f76b81520e0 2024-09-21T03:17:03.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.810+0000 7f76af400640 1 -- 172.21.15.90:0/2294146057 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b0004460 con 0x7f76b81520e0 2024-09-21T03:17:03.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.810+0000 7f76bd200640 1 -- 172.21.15.90:0/2294146057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b81ea060 con 0x7f76b81520e0 2024-09-21T03:17:03.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.812+0000 7f76bd200640 1 -- 172.21.15.90:0/2294146057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76b80c63c0 con 0x7f76b81520e0 2024-09-21T03:17:03.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.812+0000 7f76af400640 1 -- 172.21.15.90:0/2294146057 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f76b0004600 con 0x7f76b81520e0 2024-09-21T03:17:03.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.813+0000 7f76af400640 1 --2- 172.21.15.90:0/2294146057 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7694078b90 0x7f769407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:03.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.813+0000 7f76af400640 1 -- 172.21.15.90:0/2294146057 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f76b00bc900 con 0x7f76b81520e0 2024-09-21T03:17:03.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.814+0000 7f76b7400640 1 --2- 172.21.15.90:0/2294146057 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7694078b90 0x7f769407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:03.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.814+0000 7f76b7400640 1 --2- 172.21.15.90:0/2294146057 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7694078b90 0x7f769407b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009ab0 tx=0x7f76a8005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:03.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:03.819+0000 7f76af400640 1 -- 172.21.15.90:0/2294146057 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f76b0084330 con 0x7f76b81520e0 2024-09-21T03:17:03.858 INFO:tasks.workunit.client.1.smithi149.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-09-21T03:17:04.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:04.085+0000 7f76bd200640 1 -- 172.21.15.90:0/2294146057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f76b806a2e0 con 0x7f76b81520e0 2024-09-21T03:17:04.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:04.087+0000 7f76af400640 1 -- 172.21.15.90:0/2294146057 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f76b0088d60 con 0x7f76b81520e0 2024-09-21T03:17:04.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:04.089+0000 7f76bd200640 1 -- 172.21.15.90:0/2294146057 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7694078b90 msgr2=0x7f769407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:04.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:04.089+0000 7f76bd200640 1 --2- 172.21.15.90:0/2294146057 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7694078b90 0x7f769407b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009ab0 tx=0x7f76a8005f90 comp rx=0 tx=0).stop 2024-09-21T03:17:04.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:04.089+0000 7f76bd200640 1 -- 172.21.15.90:0/2294146057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76b81520e0 msgr2=0x7f76b81efba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:04.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:04.089+0000 7f76bd200640 1 --2- 172.21.15.90:0/2294146057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76b81520e0 0x7f76b81efba0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009d60 tx=0x7f76b0003ba0 comp rx=0 tx=0).stop 2024-09-21T03:17:04.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:04.089+0000 7f76bd200640 1 -- 172.21.15.90:0/2294146057 shutdown_connections 2024-09-21T03:17:04.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:04.089+0000 7f76bd200640 1 --2- 172.21.15.90:0/2294146057 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7694078b90 0x7f769407b0a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:04.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:04.089+0000 7f76bd200640 1 --2- 172.21.15.90:0/2294146057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76b81520e0 0x7f76b81efba0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:04.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:04.089+0000 7f76bd200640 1 --2- 172.21.15.90:0/2294146057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76b80ca7d0 0x7f76b81e0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:04.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:04.089+0000 7f76bd200640 1 --2- 172.21.15.90:0/2294146057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76b80bf920 0x7f76b806e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:04.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:04.089+0000 7f76bd200640 1 -- 172.21.15.90:0/2294146057 >> 172.21.15.90:0/2294146057 conn(0x7f76b80ac360 msgr2=0x7f76b81505c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:04.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:04.090+0000 7f76bd200640 1 -- 172.21.15.90:0/2294146057 shutdown_connections 2024-09-21T03:17:04.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:04.090+0000 7f76bd200640 1 -- 172.21.15.90:0/2294146057 wait complete. 2024-09-21T03:17:04.113 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-21T03:17:04.363 INFO:tasks.workunit.client.1.smithi149.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-09-21T03:17:04.369 INFO:tasks.workunit.client.1.smithi149.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-09-21T03:17:04.418 INFO:tasks.workunit.client.1.smithi149.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb' 2024-09-21T03:17:04.419 INFO:tasks.workunit.client.1.smithi149.stderr:+ cd .. 2024-09-21T03:17:04.419 INFO:tasks.workunit.client.1.smithi149.stderr:+ mkdir tmp 2024-09-21T03:17:04.422 INFO:tasks.workunit.client.1.smithi149.stderr:+ cd tmp 2024-09-21T03:17:04.423 INFO:tasks.workunit.client.1.smithi149.stderr:+ for f in $mydir/*.ffsb 2024-09-21T03:17:04.423 INFO:tasks.workunit.client.1.smithi149.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/random_write.32.ffsb 2024-09-21T03:17:04.424 INFO:tasks.workunit.client.1.smithi149.stdout:FFSB version 6.0-RC2 started 2024-09-21T03:17:04.424 INFO:tasks.workunit.client.1.smithi149.stdout: 2024-09-21T03:17:04.430 INFO:tasks.workunit.client.1.smithi149.stdout:benchmark time = 300 2024-09-21T03:17:04.430 INFO:tasks.workunit.client.1.smithi149.stdout:ThreadGroup 0 2024-09-21T03:17:04.430 INFO:tasks.workunit.client.1.smithi149.stdout:================ 2024-09-21T03:17:04.430 INFO:tasks.workunit.client.1.smithi149.stdout: num_threads = 32 2024-09-21T03:17:04.430 INFO:tasks.workunit.client.1.smithi149.stdout: 2024-09-21T03:17:04.430 INFO:tasks.workunit.client.1.smithi149.stdout: read_random = off 2024-09-21T03:17:04.430 INFO:tasks.workunit.client.1.smithi149.stdout: read_size = 0 (0B) 2024-09-21T03:17:04.430 INFO:tasks.workunit.client.1.smithi149.stdout: read_blocksize = 0 (0B) 2024-09-21T03:17:04.431 INFO:tasks.workunit.client.1.smithi149.stdout: read_skip = off 2024-09-21T03:17:04.431 INFO:tasks.workunit.client.1.smithi149.stdout: read_skipsize = 0 (0B) 2024-09-21T03:17:04.431 INFO:tasks.workunit.client.1.smithi149.stdout: 2024-09-21T03:17:04.431 INFO:tasks.workunit.client.1.smithi149.stdout: write_random = on 2024-09-21T03:17:04.431 INFO:tasks.workunit.client.1.smithi149.stdout: write_size = 5242880 (5MB) 2024-09-21T03:17:04.431 INFO:tasks.workunit.client.1.smithi149.stdout: fsync_file = 0 2024-09-21T03:17:04.431 INFO:tasks.workunit.client.1.smithi149.stdout: write_blocksize = 4096 (4KB) 2024-09-21T03:17:04.431 INFO:tasks.workunit.client.1.smithi149.stdout: wait time = 0 2024-09-21T03:17:04.431 INFO:tasks.workunit.client.1.smithi149.stdout: 2024-09-21T03:17:04.431 INFO:tasks.workunit.client.1.smithi149.stdout: op weights 2024-09-21T03:17:04.431 INFO:tasks.workunit.client.1.smithi149.stdout: read = 0 (0.00%) 2024-09-21T03:17:04.431 INFO:tasks.workunit.client.1.smithi149.stdout: readall = 0 (0.00%) 2024-09-21T03:17:04.431 INFO:tasks.workunit.client.1.smithi149.stdout: write = 1 (100.00%) 2024-09-21T03:17:04.431 INFO:tasks.workunit.client.1.smithi149.stdout: create = 0 (0.00%) 2024-09-21T03:17:04.431 INFO:tasks.workunit.client.1.smithi149.stdout: append = 0 (0.00%) 2024-09-21T03:17:04.432 INFO:tasks.workunit.client.1.smithi149.stdout: delete = 0 (0.00%) 2024-09-21T03:17:04.432 INFO:tasks.workunit.client.1.smithi149.stdout: metaop = 0 (0.00%) 2024-09-21T03:17:04.432 INFO:tasks.workunit.client.1.smithi149.stdout: createdir = 0 (0.00%) 2024-09-21T03:17:04.432 INFO:tasks.workunit.client.1.smithi149.stdout: stat = 0 (0.00%) 2024-09-21T03:17:04.432 INFO:tasks.workunit.client.1.smithi149.stdout: writeall = 0 (0.00%) 2024-09-21T03:17:04.432 INFO:tasks.workunit.client.1.smithi149.stdout: writeall_fsync = 0 (0.00%) 2024-09-21T03:17:04.432 INFO:tasks.workunit.client.1.smithi149.stdout: open_close = 0 (0.00%) 2024-09-21T03:17:04.432 INFO:tasks.workunit.client.1.smithi149.stdout: write_fsync = 0 (0.00%) 2024-09-21T03:17:04.432 INFO:tasks.workunit.client.1.smithi149.stdout: create_fsync = 0 (0.00%) 2024-09-21T03:17:04.432 INFO:tasks.workunit.client.1.smithi149.stdout: append_fsync = 0 (0.00%) 2024-09-21T03:17:04.432 INFO:tasks.workunit.client.1.smithi149.stdout: 2024-09-21T03:17:04.432 INFO:tasks.workunit.client.1.smithi149.stdout:FileSystem . 2024-09-21T03:17:04.432 INFO:tasks.workunit.client.1.smithi149.stdout:========== 2024-09-21T03:17:04.432 INFO:tasks.workunit.client.1.smithi149.stdout: num_dirs = 0 2024-09-21T03:17:04.433 INFO:tasks.workunit.client.1.smithi149.stdout: starting files = 128 2024-09-21T03:17:04.433 INFO:tasks.workunit.client.1.smithi149.stdout: 2024-09-21T03:17:04.433 INFO:tasks.workunit.client.1.smithi149.stdout: min file size = 104857600 (100MB) 2024-09-21T03:17:04.433 INFO:tasks.workunit.client.1.smithi149.stdout: max file size = 104857600 (100MB) 2024-09-21T03:17:04.433 INFO:tasks.workunit.client.1.smithi149.stdout: directio = off 2024-09-21T03:17:04.433 INFO:tasks.workunit.client.1.smithi149.stdout: alignedio = on 2024-09-21T03:17:04.433 INFO:tasks.workunit.client.1.smithi149.stdout: bufferedio = off 2024-09-21T03:17:04.433 INFO:tasks.workunit.client.1.smithi149.stdout: 2024-09-21T03:17:04.433 INFO:tasks.workunit.client.1.smithi149.stdout: aging is off 2024-09-21T03:17:04.433 INFO:tasks.workunit.client.1.smithi149.stdout: current utilization = 0.00% 2024-09-21T03:17:04.433 INFO:tasks.workunit.client.1.smithi149.stdout: 2024-09-21T03:17:04.433 INFO:tasks.workunit.client.1.smithi149.stdout:checking existing fs: . 2024-09-21T03:17:04.434 INFO:tasks.workunit.client.1.smithi149.stdout:recreating new fileset 2024-09-21T03:17:04.434 INFO:tasks.workunit.client.1.smithi149.stderr:opendir: No such file or directory 2024-09-21T03:17:14.114 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-21T03:17:14.114 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:17:14.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.603+0000 7f8d4c000640 1 -- 172.21.15.90:0/2934179664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d44070dd0 msgr2=0x7f8d44150320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:14.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.603+0000 7f8d4c000640 1 --2- 172.21.15.90:0/2934179664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d44070dd0 0x7f8d44150320 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8d44072840 tx=0x7f8d3c02a9e0 comp rx=0 tx=0).stop 2024-09-21T03:17:14.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.606+0000 7f8d4c000640 1 -- 172.21.15.90:0/2934179664 shutdown_connections 2024-09-21T03:17:14.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.606+0000 7f8d4c000640 1 --2- 172.21.15.90:0/2934179664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d44070dd0 0x7f8d44150320 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:14.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.606+0000 7f8d4c000640 1 -- 172.21.15.90:0/2934179664 >> 172.21.15.90:0/2934179664 conn(0x7f8d440c8ba0 msgr2=0x7f8d4406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:14.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.606+0000 7f8d4c000640 1 -- 172.21.15.90:0/2934179664 shutdown_connections 2024-09-21T03:17:14.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.606+0000 7f8d4c000640 1 -- 172.21.15.90:0/2934179664 wait complete. 2024-09-21T03:17:14.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.610+0000 7f8d4c000640 1 Processor -- start 2024-09-21T03:17:14.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.610+0000 7f8d4c000640 1 -- start start 2024-09-21T03:17:14.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.613+0000 7f8d4c000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d44070dd0 0x7f8d440bdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:14.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.614+0000 7f8d4c000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d440ab760 0x7f8d440bd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:14.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.614+0000 7f8d4c000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d440abb70 0x7f8d441540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:14.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.614+0000 7f8d4c000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8d44074ec0 con 0x7f8d44070dd0 2024-09-21T03:17:14.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.615+0000 7f8d49600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d44070dd0 0x7f8d440bdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:14.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.615+0000 7f8d49600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d44070dd0 0x7f8d440bdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57432/0 (socket says 172.21.15.90:57432) 2024-09-21T03:17:14.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.615+0000 7f8d49600640 1 -- 172.21.15.90:0/1849418088 learned_addr learned my addr 172.21.15.90:0/1849418088 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:17:14.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.615+0000 7f8d4a000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d440abb70 0x7f8d441540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:14.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.615+0000 7f8d4c000640 1 -- 172.21.15.90:0/1849418088 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8d440ad720 con 0x7f8d440abb70 2024-09-21T03:17:14.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.615+0000 7f8d48c00640 1 --2- 172.21.15.90:0/1849418088 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d440ab760 0x7f8d440bd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:14.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.615+0000 7f8d4c000640 1 -- 172.21.15.90:0/1849418088 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8d44075040 con 0x7f8d440ab760 2024-09-21T03:17:14.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.618+0000 7f8d49600640 1 -- 172.21.15.90:0/1849418088 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d440ab760 msgr2=0x7f8d440bd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:14.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.618+0000 7f8d49600640 1 --2- 172.21.15.90:0/1849418088 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d440ab760 0x7f8d440bd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:14.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.618+0000 7f8d49600640 1 -- 172.21.15.90:0/1849418088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d440abb70 msgr2=0x7f8d441540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:14.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.618+0000 7f8d49600640 1 --2- 172.21.15.90:0/1849418088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d440abb70 0x7f8d441540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:14.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.619+0000 7f8d49600640 1 -- 172.21.15.90:0/1849418088 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d4413fdc0 con 0x7f8d44070dd0 2024-09-21T03:17:14.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.619+0000 7f8d4a000640 1 --2- 172.21.15.90:0/1849418088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d440abb70 0x7f8d441540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:17:14.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.620+0000 7f8d49600640 1 --2- 172.21.15.90:0/1849418088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d44070dd0 0x7f8d440bdf50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009d60 tx=0x7f8d3c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:14.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.620+0000 7f8d41600640 1 -- 172.21.15.90:0/1849418088 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c033050 con 0x7f8d44070dd0 2024-09-21T03:17:14.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.620+0000 7f8d4c000640 1 -- 172.21.15.90:0/1849418088 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d44140060 con 0x7f8d44070dd0 2024-09-21T03:17:14.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.621+0000 7f8d4c000640 1 -- 172.21.15.90:0/1849418088 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d440c7a20 con 0x7f8d44070dd0 2024-09-21T03:17:14.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.621+0000 7f8d41600640 1 -- 172.21.15.90:0/1849418088 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d3c038450 con 0x7f8d44070dd0 2024-09-21T03:17:14.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.621+0000 7f8d41600640 1 -- 172.21.15.90:0/1849418088 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c033050 con 0x7f8d44070dd0 2024-09-21T03:17:14.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.623+0000 7f8d4c000640 1 -- 172.21.15.90:0/1849418088 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d20005290 con 0x7f8d44070dd0 2024-09-21T03:17:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.627+0000 7f8d41600640 1 -- 172.21.15.90:0/1849418088 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8d3c036070 con 0x7f8d44070dd0 2024-09-21T03:17:14.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.628+0000 7f8d41600640 1 --2- 172.21.15.90:0/1849418088 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8d24078dc0 0x7f8d2407b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:14.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.628+0000 7f8d41600640 1 -- 172.21.15.90:0/1849418088 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f8d3c0bc210 con 0x7f8d44070dd0 2024-09-21T03:17:14.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.629+0000 7f8d48c00640 1 --2- 172.21.15.90:0/1849418088 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8d24078dc0 0x7f8d2407b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:14.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.630+0000 7f8d48c00640 1 --2- 172.21.15.90:0/1849418088 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8d24078dc0 0x7f8d2407b2d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8d440c7d40 tx=0x7f8d38009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:14.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:14.638+0000 7f8d41600640 1 -- 172.21.15.90:0/1849418088 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8d3c047060 con 0x7f8d44070dd0 2024-09-21T03:17:15.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.149+0000 7f8d4c000640 1 -- 172.21.15.90:0/1849418088 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8d20005580 con 0x7f8d44070dd0 2024-09-21T03:17:15.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.150+0000 7f8d41600640 1 -- 172.21.15.90:0/1849418088 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f8d3c083d40 con 0x7f8d44070dd0 2024-09-21T03:17:15.152 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:17:15.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.154+0000 7f8d4c000640 1 -- 172.21.15.90:0/1849418088 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8d24078dc0 msgr2=0x7f8d2407b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:15.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.154+0000 7f8d4c000640 1 --2- 172.21.15.90:0/1849418088 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8d24078dc0 0x7f8d2407b2d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8d440c7d40 tx=0x7f8d38009060 comp rx=0 tx=0).stop 2024-09-21T03:17:15.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.154+0000 7f8d4c000640 1 -- 172.21.15.90:0/1849418088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d44070dd0 msgr2=0x7f8d440bdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:15.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.154+0000 7f8d4c000640 1 --2- 172.21.15.90:0/1849418088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d44070dd0 0x7f8d440bdf50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009d60 tx=0x7f8d3c0046b0 comp rx=0 tx=0).stop 2024-09-21T03:17:15.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.154+0000 7f8d4c000640 1 -- 172.21.15.90:0/1849418088 shutdown_connections 2024-09-21T03:17:15.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.154+0000 7f8d4c000640 1 --2- 172.21.15.90:0/1849418088 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8d24078dc0 0x7f8d2407b2d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:15.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.154+0000 7f8d4c000640 1 --2- 172.21.15.90:0/1849418088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d440abb70 0x7f8d441540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:15.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.154+0000 7f8d4c000640 1 --2- 172.21.15.90:0/1849418088 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d440ab760 0x7f8d440bd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:15.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.154+0000 7f8d4c000640 1 --2- 172.21.15.90:0/1849418088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d44070dd0 0x7f8d440bdf50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:15.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.154+0000 7f8d4c000640 1 -- 172.21.15.90:0/1849418088 >> 172.21.15.90:0/1849418088 conn(0x7f8d440c8ba0 msgr2=0x7f8d4414d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:15.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.154+0000 7f8d4c000640 1 -- 172.21.15.90:0/1849418088 shutdown_connections 2024-09-21T03:17:15.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.154+0000 7f8d4c000640 1 -- 172.21.15.90:0/1849418088 wait complete. 2024-09-21T03:17:15.219 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-21T03:17:15.219 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-21T03:17:15.219 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-21T03:17:15.220 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:17:15.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.784+0000 7f8dfe200640 1 -- 172.21.15.90:0/3575369357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8df8073080 msgr2=0x7f8df8073490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:15.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.784+0000 7f8dfe200640 1 --2- 172.21.15.90:0/3575369357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8df8073080 0x7f8df8073490 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8df80ab5a0 tx=0x7f8de802a4a0 comp rx=0 tx=0).stop 2024-09-21T03:17:15.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.784+0000 7f8dfe200640 1 -- 172.21.15.90:0/3575369357 shutdown_connections 2024-09-21T03:17:15.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.784+0000 7f8dfe200640 1 --2- 172.21.15.90:0/3575369357 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8df8154aa0 0x7f8df8154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:15.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.784+0000 7f8dfe200640 1 --2- 172.21.15.90:0/3575369357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8df8073080 0x7f8df8073490 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:15.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.784+0000 7f8dfe200640 1 -- 172.21.15.90:0/3575369357 >> 172.21.15.90:0/3575369357 conn(0x7f8df80c85a0 msgr2=0x7f8df80c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:15.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.784+0000 7f8dfe200640 1 -- 172.21.15.90:0/3575369357 shutdown_connections 2024-09-21T03:17:15.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.784+0000 7f8dfe200640 1 -- 172.21.15.90:0/3575369357 wait complete. 2024-09-21T03:17:15.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.787+0000 7f8dfe200640 1 Processor -- start 2024-09-21T03:17:15.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.787+0000 7f8dfe200640 1 -- start start 2024-09-21T03:17:15.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.788+0000 7f8dfe200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8df8073080 0x7f8df8148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:15.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.788+0000 7f8dfe200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df80ae0a0 0x7f8df81df280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:15.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.788+0000 7f8dfe200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8df8154aa0 0x7f8df81f4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:15.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.788+0000 7f8dfe200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8df80abf10 con 0x7f8df80ae0a0 2024-09-21T03:17:15.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.788+0000 7f8dfe200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8df80abd90 con 0x7f8df8154aa0 2024-09-21T03:17:15.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.788+0000 7f8dfe200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8df8074220 con 0x7f8df8073080 2024-09-21T03:17:15.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.789+0000 7f8df6a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df80ae0a0 0x7f8df81df280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:15.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.789+0000 7f8df6a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df80ae0a0 0x7f8df81df280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48926/0 (socket says 172.21.15.90:48926) 2024-09-21T03:17:15.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.789+0000 7f8df6a00640 1 -- 172.21.15.90:0/4021267558 learned_addr learned my addr 172.21.15.90:0/4021267558 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:17:15.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.789+0000 7f8df7e00640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8df8154aa0 0x7f8df81f4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:15.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.789+0000 7f8df7400640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8df8073080 0x7f8df8148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:15.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.789+0000 7f8df6a00640 1 -- 172.21.15.90:0/4021267558 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8df8073080 msgr2=0x7f8df8148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:15.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.789+0000 7f8df6a00640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8df8073080 0x7f8df8148d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:15.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.789+0000 7f8df6a00640 1 -- 172.21.15.90:0/4021267558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8df8154aa0 msgr2=0x7f8df81f4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:15.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.789+0000 7f8df6a00640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8df8154aa0 0x7f8df81f4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:15.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.789+0000 7f8df6a00640 1 -- 172.21.15.90:0/4021267558 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df80c79f0 con 0x7f8df80ae0a0 2024-09-21T03:17:15.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.790+0000 7f8df6a00640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df80ae0a0 0x7f8df81df280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8de8000c00 tx=0x7f8de8003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:15.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.790+0000 7f8def400640 1 -- 172.21.15.90:0/4021267558 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de803e030 con 0x7f8df80ae0a0 2024-09-21T03:17:15.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.790+0000 7f8def400640 1 -- 172.21.15.90:0/4021267558 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8de8003d10 con 0x7f8df80ae0a0 2024-09-21T03:17:15.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.790+0000 7f8def400640 1 -- 172.21.15.90:0/4021267558 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de8035040 con 0x7f8df80ae0a0 2024-09-21T03:17:15.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.790+0000 7f8dfe200640 1 -- 172.21.15.90:0/4021267558 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8df814c0b0 con 0x7f8df80ae0a0 2024-09-21T03:17:15.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.790+0000 7f8dfe200640 1 -- 172.21.15.90:0/4021267558 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8df81dff20 con 0x7f8df80ae0a0 2024-09-21T03:17:15.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.792+0000 7f8dfe200640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df80c55d0 0x7f8df814fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:15.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.792+0000 7f8dfe200640 1 -- 172.21.15.90:0/4021267558 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8df806e860 con 0x7f8df80c55d0 2024-09-21T03:17:15.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.792+0000 7f8df7400640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df80c55d0 0x7f8df814fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:15.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.793+0000 7f8df7400640 1 -- 172.21.15.90:0/4021267558 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8df8073490 con 0x7f8df80c55d0 2024-09-21T03:17:15.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.793+0000 7f8df7400640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df80c55d0 0x7f8df814fa60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8de400d500 tx=0x7f8de400d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:15.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.793+0000 7f8def400640 1 -- 172.21.15.90:0/4021267558 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de4018030 con 0x7f8df80c55d0 2024-09-21T03:17:15.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.794+0000 7f8def400640 1 -- 172.21.15.90:0/4021267558 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8de4005960 con 0x7f8df80c55d0 2024-09-21T03:17:15.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.794+0000 7f8def400640 1 -- 172.21.15.90:0/4021267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df80c55d0 msgr2=0x7f8df814fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:15.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.794+0000 7f8def400640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df80c55d0 0x7f8df814fa60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8de400d500 tx=0x7f8de400d9c0 comp rx=0 tx=0).stop 2024-09-21T03:17:15.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.794+0000 7f8def400640 1 -- 172.21.15.90:0/4021267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df80c55d0 msgr2=0x7f8df814fa60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:17:15.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.794+0000 7f8def400640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df80c55d0 0x7f8df814fa60 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8de400d500 tx=0x7f8de400d9c0 comp rx=0 tx=0).stop 2024-09-21T03:17:15.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.794+0000 7f8def400640 1 -- 172.21.15.90:0/4021267558 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8de8041030 con 0x7f8df80ae0a0 2024-09-21T03:17:15.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.796+0000 7f8def400640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8dd80786a0 0x7f8dd807abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:15.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.796+0000 7f8def400640 1 -- 172.21.15.90:0/4021267558 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f8de80bb830 con 0x7f8df80ae0a0 2024-09-21T03:17:15.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.797+0000 7f8df7400640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8dd80786a0 0x7f8dd807abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:15.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.799+0000 7f8df7400640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8dd80786a0 0x7f8dd807abb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8de4001f00 tx=0x7f8de4012000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:15.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.803+0000 7f8dfe200640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df81df7c0 0x7f8df814ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:15.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.803+0000 7f8dfe200640 1 -- 172.21.15.90:0/4021267558 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8df814bf10 con 0x7f8df81df7c0 2024-09-21T03:17:15.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.804+0000 7f8df7e00640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df81df7c0 0x7f8df814ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:15.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.804+0000 7f8df7e00640 1 -- 172.21.15.90:0/4021267558 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8df8073a90 con 0x7f8df81df7c0 2024-09-21T03:17:15.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.805+0000 7f8df7e00640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df81df7c0 0x7f8df814ffa0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8df0005fd0 tx=0x7f8df000e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:15.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.805+0000 7f8def400640 1 -- 172.21.15.90:0/4021267558 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df0017070 con 0x7f8df81df7c0 2024-09-21T03:17:15.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.805+0000 7f8def400640 1 -- 172.21.15.90:0/4021267558 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4551 (secure 0 0 0) 0x7f8df0003970 con 0x7f8df81df7c0 2024-09-21T03:17:15.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.805+0000 7f8def400640 1 -- 172.21.15.90:0/4021267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df81df7c0 msgr2=0x7f8df814ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:15.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.805+0000 7f8def400640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df81df7c0 0x7f8df814ffa0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8df0005fd0 tx=0x7f8df000e350 comp rx=0 tx=0).stop 2024-09-21T03:17:15.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.805+0000 7f8def400640 1 -- 172.21.15.90:0/4021267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df81df7c0 msgr2=0x7f8df814ffa0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:17:15.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.805+0000 7f8def400640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df81df7c0 0x7f8df814ffa0 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8df0005fd0 tx=0x7f8df000e350 comp rx=0 tx=0).stop 2024-09-21T03:17:15.808 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:17:15.808 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:17:15.808 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:17:15.808 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:17:15.808 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 20, 2024-09-21T03:17:15.808 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 21777, 2024-09-21T03:17:15.808 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:17:15.808 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:17:15.808 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:17:15.808 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:17:15.808 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:15.808 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 15, 2024-09-21T03:17:15.809 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:17:15.809 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:17:15.809 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:17:15.809 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:15.809 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:15.809 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:15.809 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:15.809 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:15.809 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:15.809 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:15.809 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:15.809 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:15.809 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:15.809 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:15.809 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:15.810 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:17:15.810 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:17:15.810 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:15.810 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:15.810 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:15.810 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:15.810 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:15.810 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:15.810 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:15.810 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:15.810 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:15.810 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:15.810 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:15.810 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:15.811 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:15.811 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:17:15.811 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:17:15.811 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:17:15.811 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:17:15.811 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:17:15.811 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:17:15.811 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:17:15.811 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:17:15.811 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:17:15.811 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:17:15.811 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:17:15.811 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:17:15.811 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:17:15.811 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:17:15.812 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:17:15.812 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:17:15.812 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:17:15.812 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:15.812 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:15.812 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:15.812 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:15.812 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:15.812 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:15.812 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:15.812 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:15.812 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:15.812 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:15.812 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:15.813 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:15.813 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:17:15.813 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:15.813 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:17:15.813 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:15.813 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:17:15.813 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:17:15.813 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:15.813 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:15.813 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:15.813 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:15.813 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:17:15.813 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:15.813 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:15.813 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:15.814 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:15.814 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:17:15.814 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:15.814 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:15.814 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:15.814 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:15.814 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:17:15.814 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:17:15.814 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:15.814 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:15.814 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:15.814 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:15.814 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:15.814 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:17:15.815 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:17:15.815 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:15.815 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:15.815 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:15.815 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:15.815 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:17:15.815 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:15.815 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:15.815 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:15.815 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:15.815 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:17:15.815 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:15.815 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:15.815 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:15.815 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:15.816 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:17:15.816 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:17:15.816 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:15.816 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:15.816 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:15.816 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:15.816 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:15.816 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:17:15.816 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:17:15.816 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:15.816 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:15.816 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:15.816 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:15.816 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:17:15.817 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:15.817 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:15.817 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:15.817 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:15.817 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:17:15.817 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:15.817 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:15.817 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:15.817 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:15.817 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:17:15.817 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:17:15.817 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:15.817 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:15.817 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:15.817 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:15.818 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:15.818 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:15.818 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:17:15.818 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:17:15.818 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:15.818 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:15.818 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:15.818 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:17:15.818 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:15.818 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:15.818 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:17:15.818 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:15.818 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:15.818 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:15.819 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:17:15.819 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:15.819 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:15.819 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:15.819 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:17:15.819 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:17:15.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.806+0000 7f8dfe200640 1 -- 172.21.15.90:0/4021267558 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8dd80786a0 msgr2=0x7f8dd807abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:15.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.806+0000 7f8dfe200640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8dd80786a0 0x7f8dd807abb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8de4001f00 tx=0x7f8de4012000 comp rx=0 tx=0).stop 2024-09-21T03:17:15.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.806+0000 7f8dfe200640 1 -- 172.21.15.90:0/4021267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df80ae0a0 msgr2=0x7f8df81df280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:15.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.806+0000 7f8dfe200640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df80ae0a0 0x7f8df81df280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8de8000c00 tx=0x7f8de8003820 comp rx=0 tx=0).stop 2024-09-21T03:17:15.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.806+0000 7f8df7e00640 1 -- 172.21.15.90:0/4021267558 reap_dead start 2024-09-21T03:17:15.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.806+0000 7f8dfe200640 1 -- 172.21.15.90:0/4021267558 shutdown_connections 2024-09-21T03:17:15.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.806+0000 7f8dfe200640 1 --2- 172.21.15.90:0/4021267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8df80ae0a0 0x7f8df81df280 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:15.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.806+0000 7f8dfe200640 1 -- 172.21.15.90:0/4021267558 >> 172.21.15.90:0/4021267558 conn(0x7f8df80c85a0 msgr2=0x7f8df81521b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:15.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.806+0000 7f8dfe200640 1 -- 172.21.15.90:0/4021267558 shutdown_connections 2024-09-21T03:17:15.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:15.806+0000 7f8dfe200640 1 -- 172.21.15.90:0/4021267558 wait complete. 2024-09-21T03:17:15.868 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:17:15.868 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-21T03:17:15.868 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:17:16.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.430+0000 7f1b52800640 1 -- 172.21.15.90:0/366838015 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b34004800 msgr2=0x7f1b34004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:16.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.430+0000 7f1b52800640 1 --2- 172.21.15.90:0/366838015 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b34004800 0x7f1b34004c10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1b38001dc0 tx=0x7f1b34005830 comp rx=0 tx=0).stop 2024-09-21T03:17:16.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.431+0000 7f1b52800640 1 -- 172.21.15.90:0/366838015 shutdown_connections 2024-09-21T03:17:16.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.431+0000 7f1b52800640 1 --2- 172.21.15.90:0/366838015 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b34004800 0x7f1b34004c10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:16.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.431+0000 7f1b52800640 1 -- 172.21.15.90:0/366838015 >> 172.21.15.90:0/366838015 conn(0x7f1b4c06d570 msgr2=0x7f1b4c0c7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:16.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.431+0000 7f1b52800640 1 -- 172.21.15.90:0/366838015 shutdown_connections 2024-09-21T03:17:16.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.431+0000 7f1b52800640 1 -- 172.21.15.90:0/366838015 wait complete. 2024-09-21T03:17:16.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.439+0000 7f1b52800640 1 Processor -- start 2024-09-21T03:17:16.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.439+0000 7f1b52800640 1 -- start start 2024-09-21T03:17:16.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.446+0000 7f1b52800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b34004800 0x7f1b4c0abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:16.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.446+0000 7f1b52800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b4c0ac4e0 0x7f1b4c158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:16.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.446+0000 7f1b52800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c1f9d20 0x7f1b4c1fa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:16.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.446+0000 7f1b52800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c074190 con 0x7f1b34004800 2024-09-21T03:17:16.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.446+0000 7f1b52800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c074470 con 0x7f1b4c1f9d20 2024-09-21T03:17:16.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.446+0000 7f1b52800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4c073860 con 0x7f1b4c0ac4e0 2024-09-21T03:17:16.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.447+0000 7f1b51e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c1f9d20 0x7f1b4c1fa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:16.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.447+0000 7f1b51400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b34004800 0x7f1b4c0abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:16.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.447+0000 7f1b50a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b4c0ac4e0 0x7f1b4c158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:16.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.449+0000 7f1b50a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b4c0ac4e0 0x7f1b4c158ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:47852/0 (socket says 172.21.15.90:47852) 2024-09-21T03:17:16.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.449+0000 7f1b50a00640 1 -- 172.21.15.90:0/3735407840 learned_addr learned my addr 172.21.15.90:0/3735407840 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:17:16.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.450+0000 7f1b51e00640 1 -- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b4c0ac4e0 msgr2=0x7f1b4c158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:16.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.450+0000 7f1b51e00640 1 --2- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b4c0ac4e0 0x7f1b4c158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:16.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.450+0000 7f1b51e00640 1 -- 172.21.15.90:0/3735407840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b34004800 msgr2=0x7f1b4c0abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:16.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.450+0000 7f1b51e00640 1 --2- 172.21.15.90:0/3735407840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b34004800 0x7f1b4c0abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:16.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.450+0000 7f1b51e00640 1 -- 172.21.15.90:0/3735407840 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c159ab0 con 0x7f1b4c1f9d20 2024-09-21T03:17:16.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.450+0000 7f1b51400640 1 --2- 172.21.15.90:0/3735407840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b34004800 0x7f1b4c0abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:17:16.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.451+0000 7f1b51e00640 1 --2- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c1f9d20 0x7f1b4c1fa130 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c072d70 tx=0x7f1b40009b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:16.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.451+0000 7f1b49600640 1 -- 172.21.15.90:0/3735407840 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40004b20 con 0x7f1b4c1f9d20 2024-09-21T03:17:16.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.451+0000 7f1b49600640 1 -- 172.21.15.90:0/3735407840 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b40004dd0 con 0x7f1b4c1f9d20 2024-09-21T03:17:16.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.451+0000 7f1b49600640 1 -- 172.21.15.90:0/3735407840 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40010900 con 0x7f1b4c1f9d20 2024-09-21T03:17:16.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.451+0000 7f1b52800640 1 -- 172.21.15.90:0/3735407840 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4c159810 con 0x7f1b4c1f9d20 2024-09-21T03:17:16.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.452+0000 7f1b52800640 1 -- 172.21.15.90:0/3735407840 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b4c0aa5c0 con 0x7f1b4c1f9d20 2024-09-21T03:17:16.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.453+0000 7f1b52800640 1 --2- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c0ac8f0 0x7f1b4c1fcd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:16.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.453+0000 7f1b52800640 1 -- 172.21.15.90:0/3735407840 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c15ab70 con 0x7f1b4c0ac8f0 2024-09-21T03:17:16.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.454+0000 7f1b51400640 1 --2- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c0ac8f0 0x7f1b4c1fcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:16.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.455+0000 7f1b51400640 1 -- 172.21.15.90:0/3735407840 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b4c1fa670 con 0x7f1b4c0ac8f0 2024-09-21T03:17:16.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.455+0000 7f1b51400640 1 --2- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c0ac8f0 0x7f1b4c1fcd00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c052860 tx=0x7f1b4400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:16.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.456+0000 7f1b49600640 1 -- 172.21.15.90:0/3735407840 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b44009510 con 0x7f1b4c0ac8f0 2024-09-21T03:17:16.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.456+0000 7f1b49600640 1 -- 172.21.15.90:0/3735407840 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1b44004460 con 0x7f1b4c0ac8f0 2024-09-21T03:17:16.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.456+0000 7f1b49600640 1 -- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c0ac8f0 msgr2=0x7f1b4c1fcd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:16.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.456+0000 7f1b49600640 1 --2- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c0ac8f0 0x7f1b4c1fcd00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c052860 tx=0x7f1b4400f790 comp rx=0 tx=0).stop 2024-09-21T03:17:16.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.456+0000 7f1b49600640 1 -- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c0ac8f0 msgr2=0x7f1b4c1fcd00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:17:16.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.456+0000 7f1b49600640 1 --2- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c0ac8f0 0x7f1b4c1fcd00 secure :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c052860 tx=0x7f1b4400f790 comp rx=0 tx=0).stop 2024-09-21T03:17:16.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.460+0000 7f1b49600640 1 -- 172.21.15.90:0/3735407840 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1b4001a020 con 0x7f1b4c1f9d20 2024-09-21T03:17:16.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.464+0000 7f1b49600640 1 --2- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1b2c0785b0 0x7f1b2c07aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:16.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.465+0000 7f1b51400640 1 --2- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1b2c0785b0 0x7f1b2c07aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:16.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.466+0000 7f1b49600640 1 -- 172.21.15.90:0/3735407840 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f1b4009aff0 con 0x7f1b4c1f9d20 2024-09-21T03:17:16.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.467+0000 7f1b51400640 1 --2- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1b2c0785b0 0x7f1b2c07aac0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400f7d0 tx=0x7f1b44015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:16.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.470+0000 7f1b52800640 1 --2- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c1fd240 0x7f1b4c1fd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:16.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.470+0000 7f1b52800640 1 -- 172.21.15.90:0/3735407840 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c1fdb90 con 0x7f1b4c1fd240 2024-09-21T03:17:16.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.470+0000 7f1b50a00640 1 --2- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c1fd240 0x7f1b4c1fd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:16.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.471+0000 7f1b50a00640 1 -- 172.21.15.90:0/3735407840 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1b4c1576b0 con 0x7f1b4c1fd240 2024-09-21T03:17:16.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.471+0000 7f1b50a00640 1 --2- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c1fd240 0x7f1b4c1fd650 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1b38000c00 tx=0x7f1b38003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:16.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.472+0000 7f1b49600640 1 -- 172.21.15.90:0/3735407840 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b38001d20 con 0x7f1b4c1fd240 2024-09-21T03:17:16.475 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:17:16.475 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:17:16.475 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:17:16.475 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:17:16.475 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 20, 2024-09-21T03:17:16.475 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 187262, 2024-09-21T03:17:16.475 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:17:16.475 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:17:16.475 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:17:16.475 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:17:16.475 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:16.475 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 16, 2024-09-21T03:17:16.475 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:17:16.476 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:17:16.476 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:17:16.476 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:16.476 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:16.476 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:16.476 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:16.476 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:16.476 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:16.476 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:16.476 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:16.476 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:16.476 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:16.476 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:16.477 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:16.477 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:17:16.477 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:17:16.477 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:16.477 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:16.477 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:16.477 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:16.477 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:16.477 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:16.477 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:16.477 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:16.477 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:16.477 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:16.477 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:16.478 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:16.478 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.478 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:17:16.478 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:17:16.478 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:17:16.478 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:17:16.478 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:17:16.478 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:17:16.478 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:17:16.478 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:17:16.478 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:17:16.478 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:17:16.478 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:17:16.479 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:17:16.479 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:17:16.479 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:17:16.479 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:17:16.479 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:17:16.479 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:17:16.479 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:16.479 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:16.479 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:16.479 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:16.479 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:16.479 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:16.479 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:16.479 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:16.479 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:16.480 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:16.480 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:16.480 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:16.480 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:17:16.480 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.480 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:17:16.480 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.480 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:17:16.480 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:17:16.480 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:16.480 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:16.480 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.480 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:16.480 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:17:16.481 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:16.481 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.481 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.481 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:16.481 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:17:16.481 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:16.481 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:16.481 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:16.481 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.481 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:17:16.481 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:17:16.481 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:16.481 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:16.481 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:16.482 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.482 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.482 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:17:16.482 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:17:16.482 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:16.482 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:16.482 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.482 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:16.482 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:17:16.482 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:16.482 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.482 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.482 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:16.482 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:17:16.483 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:16.483 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:16.483 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:16.483 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.483 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:17:16.483 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:17:16.483 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:16.483 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:16.483 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:16.483 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.483 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.483 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:17:16.483 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:17:16.484 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:16.484 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:16.484 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.484 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:16.484 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:17:16.484 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:16.484 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.484 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.484 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:16.484 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:17:16.484 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:16.484 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:16.485 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:16.485 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.485 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:17:16.485 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:17:16.485 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:16.485 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:16.485 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:16.485 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:16.485 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:16.485 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.485 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:17:16.485 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:17:16.485 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.485 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:16.485 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:16.485 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:17:16.486 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:16.486 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:16.486 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:17:16.486 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.486 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:16.486 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:16.486 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:17:16.486 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:16.486 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:16.486 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:17:16.486 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.486 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:16.486 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:16.486 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6 2024-09-21T03:17:16.486 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:16.487 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:16.487 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:17:16.487 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.487 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:17:16.487 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:17:16.487 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:17:16.487 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.487 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.487 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:16.487 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:16.487 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6 2024-09-21T03:17:16.487 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:16.487 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:16.487 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:17:16.487 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.487 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:16.488 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:16.488 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:17:16.488 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:16.488 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:16.488 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.488 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:17:16.488 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:17:16.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.473+0000 7f1b49600640 1 -- 172.21.15.90:0/3735407840 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5194 (secure 0 0 0) 0x7f1b38001d20 con 0x7f1b4c1fd240 2024-09-21T03:17:16.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.473+0000 7f1b49600640 1 -- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c1fd240 msgr2=0x7f1b4c1fd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:16.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.473+0000 7f1b49600640 1 --2- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c1fd240 0x7f1b4c1fd650 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1b38000c00 tx=0x7f1b38003f10 comp rx=0 tx=0).stop 2024-09-21T03:17:16.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.473+0000 7f1b49600640 1 -- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c1fd240 msgr2=0x7f1b4c1fd650 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:17:16.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.473+0000 7f1b49600640 1 --2- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c1fd240 0x7f1b4c1fd650 secure :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1b38000c00 tx=0x7f1b38003f10 comp rx=0 tx=0).stop 2024-09-21T03:17:16.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.478+0000 7f1b52800640 1 -- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1b2c0785b0 msgr2=0x7f1b2c07aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:16.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.478+0000 7f1b52800640 1 --2- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1b2c0785b0 0x7f1b2c07aac0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400f7d0 tx=0x7f1b44015000 comp rx=0 tx=0).stop 2024-09-21T03:17:16.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.478+0000 7f1b52800640 1 -- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c1f9d20 msgr2=0x7f1b4c1fa130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:16.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.478+0000 7f1b52800640 1 --2- 172.21.15.90:0/3735407840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b4c1f9d20 0x7f1b4c1fa130 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c072d70 tx=0x7f1b40009b00 comp rx=0 tx=0).stop 2024-09-21T03:17:16.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.478+0000 7f1b51e00640 1 -- 172.21.15.90:0/3735407840 reap_dead start 2024-09-21T03:17:16.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.478+0000 7f1b51e00640 1 -- 172.21.15.90:0/3735407840 reap_dead start 2024-09-21T03:17:16.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.479+0000 7f1b52800640 1 -- 172.21.15.90:0/3735407840 shutdown_connections 2024-09-21T03:17:16.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.479+0000 7f1b52800640 1 -- 172.21.15.90:0/3735407840 >> 172.21.15.90:0/3735407840 conn(0x7f1b4c06d570 msgr2=0x7f1b4c0c2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:16.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.482+0000 7f1b52800640 1 -- 172.21.15.90:0/3735407840 shutdown_connections 2024-09-21T03:17:16.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.482+0000 7f1b52800640 1 -- 172.21.15.90:0/3735407840 wait complete. 2024-09-21T03:17:16.519 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:17:16.519 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-21T03:17:16.519 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:17:16.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.825+0000 7fbdd3e00640 1 -- 172.21.15.90:0/2953501542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd40c7740 msgr2=0x7fbdd406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:16.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.825+0000 7fbdd3e00640 1 --2- 172.21.15.90:0/2953501542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd40c7740 0x7fbdd406db40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc005fd0 tx=0x7fbdcc02aaa0 comp rx=0 tx=0).stop 2024-09-21T03:17:16.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.825+0000 7fbdd3e00640 1 -- 172.21.15.90:0/2953501542 shutdown_connections 2024-09-21T03:17:16.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.825+0000 7fbdd3e00640 1 --2- 172.21.15.90:0/2953501542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd40c7740 0x7fbdd406db40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:16.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.825+0000 7fbdd3e00640 1 --2- 172.21.15.90:0/2953501542 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd40b1750 0x7fbdd40c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:16.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.825+0000 7fbdd3e00640 1 -- 172.21.15.90:0/2953501542 >> 172.21.15.90:0/2953501542 conn(0x7fbdd40add50 msgr2=0x7fbdd40ae160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:16.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.825+0000 7fbdd3e00640 1 -- 172.21.15.90:0/2953501542 shutdown_connections 2024-09-21T03:17:16.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.825+0000 7fbdd3e00640 1 -- 172.21.15.90:0/2953501542 wait complete. 2024-09-21T03:17:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.828+0000 7fbdd3e00640 1 Processor -- start 2024-09-21T03:17:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.829+0000 7fbdd3e00640 1 -- start start 2024-09-21T03:17:16.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.830+0000 7fbdd3e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd40b1750 0x7fbdd40af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:16.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.830+0000 7fbdd3e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdd40c7740 0x7fbdd41f0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:16.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.830+0000 7fbdd3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd40c85e0 0x7fbdd41ed160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:16.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.830+0000 7fbdd3e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd40cb070 con 0x7fbdd40c85e0 2024-09-21T03:17:16.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.830+0000 7fbdd3e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd40cad90 con 0x7fbdd40c7740 2024-09-21T03:17:16.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.830+0000 7fbdd3e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd406e080 con 0x7fbdd40b1750 2024-09-21T03:17:16.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.831+0000 7fbdd3400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd40c85e0 0x7fbdd41ed160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:16.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.831+0000 7fbdd2000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdd40c7740 0x7fbdd41f0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:16.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.831+0000 7fbdd3400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd40c85e0 0x7fbdd41ed160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48984/0 (socket says 172.21.15.90:48984) 2024-09-21T03:17:16.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.831+0000 7fbdd3400640 1 -- 172.21.15.90:0/2007422444 learned_addr learned my addr 172.21.15.90:0/2007422444 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:17:16.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.831+0000 7fbdd2a00640 1 --2- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd40b1750 0x7fbdd40af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:16.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.831+0000 7fbdd3400640 1 -- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd40b1750 msgr2=0x7fbdd40af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:16.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.831+0000 7fbdd3400640 1 --2- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd40b1750 0x7fbdd40af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:16.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.831+0000 7fbdd3400640 1 -- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdd40c7740 msgr2=0x7fbdd41f0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:16.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.831+0000 7fbdd3400640 1 --2- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdd40c7740 0x7fbdd41f0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:16.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.831+0000 7fbdd3400640 1 -- 172.21.15.90:0/2007422444 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd40c5370 con 0x7fbdd40c85e0 2024-09-21T03:17:16.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.832+0000 7fbdd3400640 1 --2- 172.21.15.90:0/2007422444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd40c85e0 0x7fbdd41ed160 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009d90 tx=0x7fbdcc003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:16.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.832+0000 7fbdcaa00640 1 -- 172.21.15.90:0/2007422444 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc044070 con 0x7fbdd40c85e0 2024-09-21T03:17:16.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.832+0000 7fbdcaa00640 1 -- 172.21.15.90:0/2007422444 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdcc004250 con 0x7fbdd40c85e0 2024-09-21T03:17:16.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.832+0000 7fbdd3e00640 1 -- 172.21.15.90:0/2007422444 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd41ecb30 con 0x7fbdd40c85e0 2024-09-21T03:17:16.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.832+0000 7fbdd3e00640 1 -- 172.21.15.90:0/2007422444 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd40c58f0 con 0x7fbdd40c85e0 2024-09-21T03:17:16.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.832+0000 7fbdcaa00640 1 -- 172.21.15.90:0/2007422444 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc004660 con 0x7fbdd40c85e0 2024-09-21T03:17:16.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.834+0000 7fbdd3e00640 1 --2- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd41ed6a0 0x7fbdd41f09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:16.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.834+0000 7fbdd3e00640 1 -- 172.21.15.90:0/2007422444 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd41edab0 con 0x7fbdd41ed6a0 2024-09-21T03:17:16.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.834+0000 7fbdd2a00640 1 --2- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd41ed6a0 0x7fbdd41f09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:16.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.835+0000 7fbdd2a00640 1 -- 172.21.15.90:0/2007422444 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbdd406e500 con 0x7fbdd41ed6a0 2024-09-21T03:17:16.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.835+0000 7fbdd2a00640 1 --2- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd41ed6a0 0x7fbdd41f09c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400f570 tx=0x7fbdc400fa30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:16.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.835+0000 7fbdcaa00640 1 -- 172.21.15.90:0/2007422444 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbdcc047070 con 0x7fbdd40c85e0 2024-09-21T03:17:16.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.836+0000 7fbdcaa00640 1 --2- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbdb4078bc0 0x7fbdb407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:16.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.837+0000 7fbdcaa00640 1 -- 172.21.15.90:0/2007422444 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fbdcc0bbfa0 con 0x7fbdd40c85e0 2024-09-21T03:17:16.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.837+0000 7fbdcaa00640 1 -- 172.21.15.90:0/2007422444 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40052e0 con 0x7fbdd41ed6a0 2024-09-21T03:17:16.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.837+0000 7fbdcaa00640 1 -- 172.21.15.90:0/2007422444 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbdc4018070 con 0x7fbdd41ed6a0 2024-09-21T03:17:16.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.837+0000 7fbdcaa00640 1 -- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd41ed6a0 msgr2=0x7fbdd41f09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:16.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.837+0000 7fbdcaa00640 1 --2- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd41ed6a0 0x7fbdd41f09c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400f570 tx=0x7fbdc400fa30 comp rx=0 tx=0).stop 2024-09-21T03:17:16.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.837+0000 7fbdcaa00640 1 -- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd41ed6a0 msgr2=0x7fbdd41f09c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:17:16.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.837+0000 7fbdcaa00640 1 --2- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd41ed6a0 0x7fbdd41f09c0 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400f570 tx=0x7fbdc400fa30 comp rx=0 tx=0).stop 2024-09-21T03:17:16.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.837+0000 7fbdd2000640 1 --2- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbdb4078bc0 0x7fbdb407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:16.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.838+0000 7fbdd2000640 1 --2- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbdb4078bc0 0x7fbdb407b0d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40b0330 tx=0x7fbdc000b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:16.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.846+0000 7fbdd3e00640 1 --2- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd4152a10 0x7fbdd40bfc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:16.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.846+0000 7fbdd3e00640 1 -- 172.21.15.90:0/2007422444 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd41579b0 con 0x7fbdd4152a10 2024-09-21T03:17:16.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.847+0000 7fbdd2a00640 1 --2- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd4152a10 0x7fbdd40bfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:16.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.848+0000 7fbdd2a00640 1 -- 172.21.15.90:0/2007422444 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbdd4156290 con 0x7fbdd4152a10 2024-09-21T03:17:16.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.850+0000 7fbdd2a00640 1 --2- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd4152a10 0x7fbdd40bfc00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400f570 tx=0x7fbdc4000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:16.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.850+0000 7fbdcaa00640 1 -- 172.21.15.90:0/2007422444 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc401d030 con 0x7fbdd4152a10 2024-09-21T03:17:16.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.850+0000 7fbdcaa00640 1 -- 172.21.15.90:0/2007422444 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4883 (secure 0 0 0) 0x7fbdc401d030 con 0x7fbdd4152a10 2024-09-21T03:17:16.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.850+0000 7fbdcaa00640 1 -- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd4152a10 msgr2=0x7fbdd40bfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:16.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.850+0000 7fbdcaa00640 1 --2- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd4152a10 0x7fbdd40bfc00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400f570 tx=0x7fbdc4000ed0 comp rx=0 tx=0).stop 2024-09-21T03:17:16.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.850+0000 7fbdcaa00640 1 -- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd4152a10 msgr2=0x7fbdd40bfc00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:17:16.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.850+0000 7fbdcaa00640 1 --2- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdd4152a10 0x7fbdd40bfc00 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400f570 tx=0x7fbdc4000ed0 comp rx=0 tx=0).stop 2024-09-21T03:17:16.853 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:17:16.853 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:17:16.853 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:17:16.853 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:17:16.853 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 20, 2024-09-21T03:17:16.853 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 77043, 2024-09-21T03:17:16.853 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:17:16.853 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:17:16.853 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:17:16.853 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:17:16.854 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:16.854 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 16, 2024-09-21T03:17:16.854 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:17:16.854 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:17:16.854 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:17:16.854 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:16.854 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:16.854 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:16.854 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:16.854 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:16.854 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:16.854 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:16.854 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:16.854 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:16.855 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:16.855 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:16.855 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:16.855 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:17:16.855 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:17:16.855 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:16.855 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:16.855 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:16.855 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:16.855 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:16.855 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:16.855 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:16.855 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:16.855 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:16.856 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:16.856 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:16.856 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:16.856 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.856 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:17:16.856 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:17:16.856 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:17:16.856 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:17:16.856 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:17:16.856 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:17:16.856 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:17:16.856 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:17:16.856 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:17:16.856 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:17:16.856 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:17:16.857 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:17:16.857 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:17:16.857 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:17:16.857 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:17:16.857 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:17:16.857 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:17:16.857 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:16.857 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:16.857 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:16.857 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:16.857 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:16.857 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:16.857 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:16.857 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:16.858 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:16.858 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:16.858 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:16.858 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:16.858 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:17:16.858 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.858 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:17:16.858 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.858 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:17:16.858 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:17:16.858 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:16.858 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:16.858 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.858 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:16.859 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:17:16.859 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:16.859 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.859 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.859 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:16.859 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:17:16.859 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:16.859 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:16.859 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:16.859 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.859 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:17:16.859 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:17:16.859 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:16.859 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:16.860 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:16.860 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.860 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.860 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:17:16.860 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:17:16.860 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:16.860 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:16.860 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.860 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:16.860 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:17:16.860 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:16.860 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.860 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.860 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:16.860 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:17:16.861 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:16.861 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:16.861 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:16.861 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.861 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:17:16.861 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:17:16.861 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:16.861 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:16.861 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:16.861 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.861 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.861 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:17:16.861 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:17:16.861 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:16.861 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:16.861 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.862 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:16.862 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:17:16.862 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:16.862 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.862 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.862 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:16.862 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:17:16.862 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:16.862 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:16.862 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:16.862 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.862 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:17:16.862 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:17:16.862 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:16.863 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:16.863 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:16.863 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:16.863 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:16.863 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.863 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:17:16.863 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:17:16.863 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.863 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:16.863 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:16.863 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:17:16.863 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:16.863 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:16.863 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:17:16.863 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.864 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:16.864 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:16.864 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:17:16.864 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:16.864 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:16.864 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:17:16.864 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.864 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:16.864 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:16.864 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:17:16.864 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:16.864 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:16.864 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:17:16.864 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:16.864 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:16.865 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:16.865 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:17:16.865 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:16.865 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:16.865 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:16.865 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:17:16.865 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:17:16.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.851+0000 7fbdd3e00640 1 -- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbdb4078bc0 msgr2=0x7fbdb407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:16.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.851+0000 7fbdd3e00640 1 --2- 172.21.15.90:0/2007422444 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbdb4078bc0 0x7fbdb407b0d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40b0330 tx=0x7fbdc000b2e0 comp rx=0 tx=0).stop 2024-09-21T03:17:16.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.851+0000 7fbdd3e00640 1 -- 172.21.15.90:0/2007422444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd40c85e0 msgr2=0x7fbdd41ed160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:16.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.851+0000 7fbdd3e00640 1 --2- 172.21.15.90:0/2007422444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd40c85e0 0x7fbdd41ed160 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009d90 tx=0x7fbdcc003ce0 comp rx=0 tx=0).stop 2024-09-21T03:17:16.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.851+0000 7fbdd3400640 1 -- 172.21.15.90:0/2007422444 reap_dead start 2024-09-21T03:17:16.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.851+0000 7fbdd3400640 1 -- 172.21.15.90:0/2007422444 reap_dead start 2024-09-21T03:17:16.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.851+0000 7fbdd3e00640 1 -- 172.21.15.90:0/2007422444 shutdown_connections 2024-09-21T03:17:16.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.851+0000 7fbdd3e00640 1 -- 172.21.15.90:0/2007422444 >> 172.21.15.90:0/2007422444 conn(0x7fbdd40add50 msgr2=0x7fbdd40b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:16.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.852+0000 7fbdd3e00640 1 -- 172.21.15.90:0/2007422444 shutdown_connections 2024-09-21T03:17:16.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:16.852+0000 7fbdd3e00640 1 -- 172.21.15.90:0/2007422444 wait complete. 2024-09-21T03:17:16.879 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:17:16.880 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-21T03:17:16.880 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2024-09-21T03:17:16.880 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-21T03:17:16.880 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-21T03:17:16.881 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-21T03:17:16.882 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:17:16.920 INFO:tasks.ceph.mon.c:Stopped 2024-09-21T03:17:16.920 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-09-21T03:17:16.921 INFO:tasks.ceph.mon.b:Sent signal 19 2024-09-21T03:17:16.921 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-21T03:17:28.249 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:17:28.253 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:17:31.921 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-09-21T03:17:31.922 INFO:tasks.ceph.mon.b:Sent signal 18 2024-09-21T03:17:31.922 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-21T03:17:31.922 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:17:42.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.687+0000 7f71b0800640 1 -- 172.21.15.90:0/3535918279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f718c00ec50 msgr2=0x7f718c00f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:42.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.688+0000 7f71b0800640 1 --2- 172.21.15.90:0/3535918279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f718c00ec50 0x7f718c00f060 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f718c00f700 tx=0x7f719c02bac0 comp rx=0 tx=0).stop 2024-09-21T03:17:42.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.688+0000 7f71ae800640 1 -- 172.21.15.90:0/3535918279 reap_dead start 2024-09-21T03:17:42.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.688+0000 7f71b0800640 1 -- 172.21.15.90:0/3535918279 shutdown_connections 2024-09-21T03:17:42.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.688+0000 7f71b0800640 1 --2- 172.21.15.90:0/3535918279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f718c00ec50 0x7f718c00f060 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:42.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.688+0000 7f71b0800640 1 -- 172.21.15.90:0/3535918279 >> 172.21.15.90:0/3535918279 conn(0x7f71a80c8ba0 msgr2=0x7f71a806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:42.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.688+0000 7f71b0800640 1 -- 172.21.15.90:0/3535918279 shutdown_connections 2024-09-21T03:17:42.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.688+0000 7f71b0800640 1 -- 172.21.15.90:0/3535918279 wait complete. 2024-09-21T03:17:42.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.690+0000 7f71b0800640 1 Processor -- start 2024-09-21T03:17:42.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.691+0000 7f71b0800640 1 -- start start 2024-09-21T03:17:42.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.692+0000 7f71b0800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f718c00ec50 0x7f71a81531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:42.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.692+0000 7f71b0800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71a8144f40 0x7f71a80c1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:42.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.692+0000 7f71b0800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71a80c1a80 0x7f71a8156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:42.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.692+0000 7f71b0800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f71a80708e0 con 0x7f71a80c1a80 2024-09-21T03:17:42.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.692+0000 7f71b0800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f71a80ac150 con 0x7f71a8144f40 2024-09-21T03:17:42.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.692+0000 7f71b0800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f71a8070a60 con 0x7f718c00ec50 2024-09-21T03:17:42.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.692+0000 7f71ade00640 1 -- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f718c00ec50 msgr2=0x7f71a81531f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:17:42.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.692+0000 7f71ade00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f718c00ec50 0x7f71a81531f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:17:42.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.692+0000 7f71ae800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71a80c1a80 0x7f71a8156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:42.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.693+0000 7f71ad400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71a8144f40 0x7f71a80c1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:42.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.693+0000 7f71ae800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71a80c1a80 0x7f71a8156450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53594/0 (socket says 172.21.15.90:53594) 2024-09-21T03:17:42.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.693+0000 7f71ae800640 1 -- 172.21.15.90:0/1330838769 learned_addr learned my addr 172.21.15.90:0/1330838769 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:17:42.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.693+0000 7f71ae800640 1 -- 172.21.15.90:0/1330838769 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f718c00ec50 msgr2=0x7f71a81531f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:17:42.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.693+0000 7f71ae800640 1 --2- 172.21.15.90:0/1330838769 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f718c00ec50 0x7f71a81531f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:42.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.693+0000 7f71ae800640 1 -- 172.21.15.90:0/1330838769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71a8144f40 msgr2=0x7f71a80c1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:42.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.693+0000 7f71ae800640 1 --2- 172.21.15.90:0/1330838769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71a8144f40 0x7f71a80c1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:42.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.693+0000 7f71ae800640 1 -- 172.21.15.90:0/1330838769 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a8152410 con 0x7f71a80c1a80 2024-09-21T03:17:42.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.694+0000 7f71ae800640 1 --2- 172.21.15.90:0/1330838769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71a80c1a80 0x7f71a8156450 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f71a40016f0 tx=0x7f71a400bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:42.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.694+0000 7f71a2000640 1 -- 172.21.15.90:0/1330838769 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a400c780 con 0x7f71a80c1a80 2024-09-21T03:17:42.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.694+0000 7f71a2000640 1 -- 172.21.15.90:0/1330838769 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71a4010070 con 0x7f71a80c1a80 2024-09-21T03:17:42.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.694+0000 7f71b0800640 1 -- 172.21.15.90:0/1330838769 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a80c61d0 con 0x7f71a80c1a80 2024-09-21T03:17:42.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.694+0000 7f71a2000640 1 -- 172.21.15.90:0/1330838769 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a400cbe0 con 0x7f71a80c1a80 2024-09-21T03:17:42.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.694+0000 7f71b0800640 1 -- 172.21.15.90:0/1330838769 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a81456d0 con 0x7f71a80c1a80 2024-09-21T03:17:42.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.696+0000 7f71b0800640 1 -- 172.21.15.90:0/1330838769 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71a8074b80 con 0x7f71a80c1a80 2024-09-21T03:17:42.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.697+0000 7f71a2000640 1 -- 172.21.15.90:0/1330838769 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f71a4013370 con 0x7f71a80c1a80 2024-09-21T03:17:42.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.698+0000 7f71a2000640 1 --2- 172.21.15.90:0/1330838769 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f718c07b290 0x7f718c07d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:42.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.698+0000 7f71a2000640 1 -- 172.21.15.90:0/1330838769 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f71a409a650 con 0x7f71a80c1a80 2024-09-21T03:17:42.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.698+0000 7f71ade00640 1 --2- 172.21.15.90:0/1330838769 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f718c07b290 0x7f718c07d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:42.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.699+0000 7f71ade00640 1 --2- 172.21.15.90:0/1330838769 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f718c07b290 0x7f718c07d7a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f719c035000 tx=0x7f719c016040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:42.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.703+0000 7f71a2000640 1 -- 172.21.15.90:0/1330838769 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f71a4062750 con 0x7f71a80c1a80 2024-09-21T03:17:42.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.964+0000 7f71b0800640 1 -- 172.21.15.90:0/1330838769 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f71a8152150 con 0x7f71a80c1a80 2024-09-21T03:17:42.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.964+0000 7f71a2000640 1 -- 172.21.15.90:0/1330838769 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f71a4062050 con 0x7f71a80c1a80 2024-09-21T03:17:42.967 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":24,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:17:42.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.967+0000 7f71b0800640 1 -- 172.21.15.90:0/1330838769 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f718c07b290 msgr2=0x7f718c07d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:42.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.967+0000 7f71b0800640 1 --2- 172.21.15.90:0/1330838769 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f718c07b290 0x7f718c07d7a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f719c035000 tx=0x7f719c016040 comp rx=0 tx=0).stop 2024-09-21T03:17:42.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.967+0000 7f71b0800640 1 -- 172.21.15.90:0/1330838769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71a80c1a80 msgr2=0x7f71a8156450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:42.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.967+0000 7f71b0800640 1 --2- 172.21.15.90:0/1330838769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71a80c1a80 0x7f71a8156450 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f71a40016f0 tx=0x7f71a400bb30 comp rx=0 tx=0).stop 2024-09-21T03:17:42.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.967+0000 7f71b0800640 1 -- 172.21.15.90:0/1330838769 shutdown_connections 2024-09-21T03:17:42.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.967+0000 7f71b0800640 1 --2- 172.21.15.90:0/1330838769 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f718c07b290 0x7f718c07d7a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:42.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.967+0000 7f71b0800640 1 --2- 172.21.15.90:0/1330838769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71a80c1a80 0x7f71a8156450 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:42.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.967+0000 7f71b0800640 1 --2- 172.21.15.90:0/1330838769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71a8144f40 0x7f71a80c1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:42.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.967+0000 7f71b0800640 1 --2- 172.21.15.90:0/1330838769 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f718c00ec50 0x7f71a81531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:42.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.967+0000 7f71b0800640 1 -- 172.21.15.90:0/1330838769 >> 172.21.15.90:0/1330838769 conn(0x7f71a80c8ba0 msgr2=0x7f71a80c5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:42.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.967+0000 7f71b0800640 1 -- 172.21.15.90:0/1330838769 shutdown_connections 2024-09-21T03:17:42.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:42.967+0000 7f71b0800640 1 -- 172.21.15.90:0/1330838769 wait complete. 2024-09-21T03:17:42.992 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-21T03:17:42.992 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-21T03:17:42.993 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:17:43.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.214+0000 7fbb42c00640 1 -- 172.21.15.90:0/565763730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c070030 msgr2=0x7fbb3c160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:43.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.214+0000 7fbb42c00640 1 --2- 172.21.15.90:0/565763730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c070030 0x7fbb3c160340 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbb34005fd0 tx=0x7fbb3402aa90 comp rx=0 tx=0).stop 2024-09-21T03:17:43.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.214+0000 7fbb42c00640 1 -- 172.21.15.90:0/565763730 shutdown_connections 2024-09-21T03:17:43.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.214+0000 7fbb42c00640 1 --2- 172.21.15.90:0/565763730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c070030 0x7fbb3c160340 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:43.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.214+0000 7fbb42c00640 1 -- 172.21.15.90:0/565763730 >> 172.21.15.90:0/565763730 conn(0x7fbb3c06d200 msgr2=0x7fbb3c06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:43.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.214+0000 7fbb42c00640 1 -- 172.21.15.90:0/565763730 shutdown_connections 2024-09-21T03:17:43.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.214+0000 7fbb42c00640 1 -- 172.21.15.90:0/565763730 wait complete. 2024-09-21T03:17:43.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.216+0000 7fbb42c00640 1 Processor -- start 2024-09-21T03:17:43.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.216+0000 7fbb42c00640 1 -- start start 2024-09-21T03:17:43.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.217+0000 7fbb42c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb3c070030 0x7fbb3c14de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:43.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.217+0000 7fbb42c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb3c0c4fc0 0x7fbb3c1de3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:43.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.217+0000 7fbb42c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c0c53d0 0x7fbb3c14ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:43.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.217+0000 7fbb42c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c154da0 con 0x7fbb3c0c53d0 2024-09-21T03:17:43.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.217+0000 7fbb42c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c0aaf80 con 0x7fbb3c070030 2024-09-21T03:17:43.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.217+0000 7fbb42c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbb3c155080 con 0x7fbb3c0c4fc0 2024-09-21T03:17:43.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.218+0000 7fbb40e00640 1 -- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb3c0c4fc0 msgr2=0x7fbb3c1de3d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:17:43.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.218+0000 7fbb42200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c0c53d0 0x7fbb3c14ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:43.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.218+0000 7fbb40e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb3c0c4fc0 0x7fbb3c1de3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:17:43.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.218+0000 7fbb42200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c0c53d0 0x7fbb3c14ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53608/0 (socket says 172.21.15.90:53608) 2024-09-21T03:17:43.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.218+0000 7fbb42200640 1 -- 172.21.15.90:0/4159376399 learned_addr learned my addr 172.21.15.90:0/4159376399 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:17:43.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.218+0000 7fbb41800640 1 --2- 172.21.15.90:0/4159376399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb3c070030 0x7fbb3c14de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:43.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.218+0000 7fbb42200640 1 -- 172.21.15.90:0/4159376399 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb3c0c4fc0 msgr2=0x7fbb3c1de3d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:17:43.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.218+0000 7fbb42200640 1 --2- 172.21.15.90:0/4159376399 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb3c0c4fc0 0x7fbb3c1de3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:43.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.218+0000 7fbb42200640 1 -- 172.21.15.90:0/4159376399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb3c070030 msgr2=0x7fbb3c14de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:43.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.218+0000 7fbb42200640 1 --2- 172.21.15.90:0/4159376399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb3c070030 0x7fbb3c14de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:43.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.218+0000 7fbb42200640 1 -- 172.21.15.90:0/4159376399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3c1e0ee0 con 0x7fbb3c0c53d0 2024-09-21T03:17:43.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.219+0000 7fbb42200640 1 --2- 172.21.15.90:0/4159376399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c0c53d0 0x7fbb3c14ba40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009bf0 tx=0x7fbb34003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:43.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.219+0000 7fbb39600640 1 -- 172.21.15.90:0/4159376399 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34044070 con 0x7fbb3c0c53d0 2024-09-21T03:17:43.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.219+0000 7fbb39600640 1 -- 172.21.15.90:0/4159376399 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb34004250 con 0x7fbb3c0c53d0 2024-09-21T03:17:43.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.219+0000 7fbb39600640 1 -- 172.21.15.90:0/4159376399 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34004660 con 0x7fbb3c0c53d0 2024-09-21T03:17:43.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.219+0000 7fbb42c00640 1 -- 172.21.15.90:0/4159376399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3c1ebe50 con 0x7fbb3c0c53d0 2024-09-21T03:17:43.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.219+0000 7fbb42c00640 1 -- 172.21.15.90:0/4159376399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb3c1ebb70 con 0x7fbb3c0c53d0 2024-09-21T03:17:43.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.220+0000 7fbb42c00640 1 --2- 172.21.15.90:0/4159376399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c1de910 0x7fbb3c14bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:43.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.220+0000 7fbb42c00640 1 -- 172.21.15.90:0/4159376399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c1df0f0 con 0x7fbb3c1de910 2024-09-21T03:17:43.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.220+0000 7fbb41800640 1 --2- 172.21.15.90:0/4159376399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c1de910 0x7fbb3c14bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:43.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.221+0000 7fbb41800640 1 -- 172.21.15.90:0/4159376399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb3c14c7a0 con 0x7fbb3c1de910 2024-09-21T03:17:43.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.221+0000 7fbb41800640 1 --2- 172.21.15.90:0/4159376399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c1de910 0x7fbb3c14bf80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbb30000f60 tx=0x7fbb3000e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:43.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.221+0000 7fbb39600640 1 -- 172.21.15.90:0/4159376399 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30019070 con 0x7fbb3c1de910 2024-09-21T03:17:43.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.221+0000 7fbb39600640 1 -- 172.21.15.90:0/4159376399 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbb300052e0 con 0x7fbb3c1de910 2024-09-21T03:17:43.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.221+0000 7fbb39600640 1 -- 172.21.15.90:0/4159376399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c1de910 msgr2=0x7fbb3c14bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:43.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.221+0000 7fbb39600640 1 --2- 172.21.15.90:0/4159376399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c1de910 0x7fbb3c14bf80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbb30000f60 tx=0x7fbb3000e8b0 comp rx=0 tx=0).stop 2024-09-21T03:17:43.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.221+0000 7fbb39600640 1 -- 172.21.15.90:0/4159376399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c1de910 msgr2=0x7fbb3c14bf80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:17:43.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.221+0000 7fbb39600640 1 --2- 172.21.15.90:0/4159376399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c1de910 0x7fbb3c14bf80 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbb30000f60 tx=0x7fbb3000e8b0 comp rx=0 tx=0).stop 2024-09-21T03:17:43.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.221+0000 7fbb39600640 1 -- 172.21.15.90:0/4159376399 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbb34047070 con 0x7fbb3c0c53d0 2024-09-21T03:17:43.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.222+0000 7fbb39600640 1 --2- 172.21.15.90:0/4159376399 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbb1c0785b0 0x7fbb1c07aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:43.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.222+0000 7fbb39600640 1 -- 172.21.15.90:0/4159376399 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fbb340bc0e0 con 0x7fbb3c0c53d0 2024-09-21T03:17:43.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.223+0000 7fbb41800640 1 --2- 172.21.15.90:0/4159376399 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbb1c0785b0 0x7fbb1c07aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:43.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.224+0000 7fbb41800640 1 --2- 172.21.15.90:0/4159376399 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbb1c0785b0 0x7fbb1c07aac0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000ee00 tx=0x7fbb30005000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:43.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.228+0000 7fbb42c00640 1 --2- 172.21.15.90:0/4159376399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c1ee560 0x7fbb3c1ee970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:43.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.228+0000 7fbb42c00640 1 -- 172.21.15.90:0/4159376399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c13f400 con 0x7fbb3c1ee560 2024-09-21T03:17:43.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.228+0000 7fbb40e00640 1 --2- 172.21.15.90:0/4159376399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c1ee560 0x7fbb3c1ee970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:43.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.228+0000 7fbb40e00640 1 -- 172.21.15.90:0/4159376399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbb3c1eb980 con 0x7fbb3c1ee560 2024-09-21T03:17:43.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.229+0000 7fbb40e00640 1 --2- 172.21.15.90:0/4159376399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c1ee560 0x7fbb3c1ee970 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c06fbd0 tx=0x7fbb2800c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:43.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.229+0000 7fbb39600640 1 -- 172.21.15.90:0/4159376399 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb280074e0 con 0x7fbb3c1ee560 2024-09-21T03:17:43.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.229+0000 7fbb39600640 1 -- 172.21.15.90:0/4159376399 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5016 (secure 0 0 0) 0x7fbb280074e0 con 0x7fbb3c1ee560 2024-09-21T03:17:43.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.229+0000 7fbb39600640 1 -- 172.21.15.90:0/4159376399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c1ee560 msgr2=0x7fbb3c1ee970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:43.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.229+0000 7fbb39600640 1 --2- 172.21.15.90:0/4159376399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c1ee560 0x7fbb3c1ee970 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c06fbd0 tx=0x7fbb2800c7a0 comp rx=0 tx=0).stop 2024-09-21T03:17:43.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.229+0000 7fbb39600640 1 -- 172.21.15.90:0/4159376399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c1ee560 msgr2=0x7fbb3c1ee970 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:17:43.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.229+0000 7fbb39600640 1 --2- 172.21.15.90:0/4159376399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c1ee560 0x7fbb3c1ee970 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c06fbd0 tx=0x7fbb2800c7a0 comp rx=0 tx=0).stop 2024-09-21T03:17:43.232 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:17:43.232 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:17:43.232 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:17:43.232 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:17:43.233 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 24, 2024-09-21T03:17:43.233 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 49201, 2024-09-21T03:17:43.233 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:17:43.233 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:17:43.233 INFO:teuthology.orchestra.run.smithi090.stdout: 1 2024-09-21T03:17:43.233 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:43.233 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 1, 2024-09-21T03:17:43.233 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:17:43.233 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:17:43.233 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:17:43.233 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:43.233 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:43.234 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:43.234 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:43.234 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:43.234 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:43.234 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:43.234 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:43.234 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:43.234 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:43.234 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:43.234 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:43.234 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:17:43.234 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:17:43.234 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:43.234 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:43.235 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:43.235 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:43.235 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:43.235 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:43.235 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:43.235 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:43.235 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:43.235 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:43.235 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:43.235 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:43.235 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.235 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:17:43.235 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:17:43.235 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:17:43.236 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:17:43.236 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:17:43.236 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:17:43.236 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:17:43.236 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:17:43.236 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:17:43.236 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:17:43.236 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:17:43.236 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:17:43.236 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:17:43.236 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:17:43.236 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:17:43.236 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:17:43.237 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:17:43.237 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:43.237 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:43.237 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:43.237 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:43.237 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:43.237 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:43.237 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:43.237 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:43.237 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:43.237 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:43.237 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:43.237 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:43.237 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:17:43.238 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.238 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:17:43.238 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.238 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:17:43.238 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:17:43.238 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:43.238 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:43.238 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.238 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:43.238 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:17:43.239 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:43.239 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.239 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.239 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:43.239 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:17:43.239 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:43.239 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:43.239 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:43.239 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.239 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:17:43.239 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:17:43.239 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:43.240 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:43.240 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:43.240 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.240 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.240 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:17:43.240 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:17:43.240 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:43.240 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:43.240 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.240 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:43.240 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:17:43.240 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:43.240 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.240 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.241 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:43.241 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:17:43.241 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:43.241 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:43.241 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:43.241 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.241 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:17:43.241 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:17:43.241 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:43.241 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:43.241 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:43.241 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.241 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.242 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:17:43.242 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:17:43.242 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:43.242 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:43.242 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.242 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:43.242 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:17:43.242 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:43.242 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.242 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.242 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:43.242 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:17:43.242 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:43.242 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:43.243 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:43.243 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.243 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:17:43.243 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:17:43.243 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:43.243 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:43.243 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:43.243 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:43.243 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:43.243 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.243 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:17:43.243 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:17:43.243 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.243 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:43.244 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:43.244 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:17:43.244 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:43.244 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:43.244 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:17:43.244 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.244 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:43.244 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:43.244 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:17:43.244 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:43.244 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:43.244 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:17:43.244 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.244 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:43.245 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:43.245 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 7 2024-09-21T03:17:43.245 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:43.245 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:43.245 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:17:43.245 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.245 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:17:43.245 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:17:43.245 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:17:43.245 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.245 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.245 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:43.245 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:43.245 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 3 2024-09-21T03:17:43.245 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:43.245 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:43.246 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.246 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:17:43.246 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:17:43.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.230+0000 7fbb42c00640 1 -- 172.21.15.90:0/4159376399 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbb1c0785b0 msgr2=0x7fbb1c07aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:43.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.230+0000 7fbb42c00640 1 --2- 172.21.15.90:0/4159376399 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbb1c0785b0 0x7fbb1c07aac0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000ee00 tx=0x7fbb30005000 comp rx=0 tx=0).stop 2024-09-21T03:17:43.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.230+0000 7fbb42c00640 1 -- 172.21.15.90:0/4159376399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c0c53d0 msgr2=0x7fbb3c14ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:43.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.230+0000 7fbb42c00640 1 --2- 172.21.15.90:0/4159376399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb3c0c53d0 0x7fbb3c14ba40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009bf0 tx=0x7fbb34003d00 comp rx=0 tx=0).stop 2024-09-21T03:17:43.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.230+0000 7fbb42200640 1 -- 172.21.15.90:0/4159376399 reap_dead start 2024-09-21T03:17:43.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.230+0000 7fbb42200640 1 -- 172.21.15.90:0/4159376399 reap_dead start 2024-09-21T03:17:43.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.230+0000 7fbb42c00640 1 -- 172.21.15.90:0/4159376399 shutdown_connections 2024-09-21T03:17:43.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.230+0000 7fbb42c00640 1 -- 172.21.15.90:0/4159376399 >> 172.21.15.90:0/4159376399 conn(0x7fbb3c06d200 msgr2=0x7fbb3c0ac910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:43.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.230+0000 7fbb42c00640 1 -- 172.21.15.90:0/4159376399 shutdown_connections 2024-09-21T03:17:43.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.230+0000 7fbb42c00640 1 -- 172.21.15.90:0/4159376399 wait complete. 2024-09-21T03:17:43.254 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-21T03:17:43.254 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-21T03:17:43.255 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:17:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.475+0000 7fbc43000640 1 -- 172.21.15.90:0/3831774264 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc3c074b90 msgr2=0x7fbc3c154e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.475+0000 7fbc43000640 1 --2- 172.21.15.90:0/3831774264 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc3c074b90 0x7fbc3c154e70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c074920 tx=0x7fbc2c02a560 comp rx=0 tx=0).stop 2024-09-21T03:17:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.475+0000 7fbc43000640 1 -- 172.21.15.90:0/3831774264 shutdown_connections 2024-09-21T03:17:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.475+0000 7fbc43000640 1 --2- 172.21.15.90:0/3831774264 >> v2:172.21.15.149:3300/0 conn(0x7fbc3c0adfc0 0x7fbc3c0730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.475+0000 7fbc43000640 1 --2- 172.21.15.90:0/3831774264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc3c0ad670 0x7fbc3c0ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.475+0000 7fbc43000640 1 --2- 172.21.15.90:0/3831774264 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc3c074b90 0x7fbc3c154e70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.475+0000 7fbc43000640 1 -- 172.21.15.90:0/3831774264 >> 172.21.15.90:0/3831774264 conn(0x7fbc3c0c85a0 msgr2=0x7fbc3c0c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:43.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.475+0000 7fbc43000640 1 -- 172.21.15.90:0/3831774264 shutdown_connections 2024-09-21T03:17:43.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.475+0000 7fbc43000640 1 -- 172.21.15.90:0/3831774264 wait complete. 2024-09-21T03:17:43.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.477+0000 7fbc43000640 1 Processor -- start 2024-09-21T03:17:43.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.477+0000 7fbc43000640 1 -- start start 2024-09-21T03:17:43.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.479+0000 7fbc43000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc3c074b90 0x7fbc3c150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:43.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.479+0000 7fbc43000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc3c0ad670 0x7fbc3c1f0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:43.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.479+0000 7fbc43000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc3c0adfc0 0x7fbc3c151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:43.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.479+0000 7fbc43000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c0737b0 con 0x7fbc3c0ad670 2024-09-21T03:17:43.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.479+0000 7fbc43000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c073630 con 0x7fbc3c074b90 2024-09-21T03:17:43.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.479+0000 7fbc43000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbc3c073930 con 0x7fbc3c0adfc0 2024-09-21T03:17:43.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.479+0000 7fbc33400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc3c0ad670 0x7fbc3c1f0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:43.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.479+0000 7fbc41000640 1 -- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc3c0adfc0 msgr2=0x7fbc3c151d10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:17:43.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.479+0000 7fbc41000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc3c0adfc0 0x7fbc3c151d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:17:43.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.479+0000 7fbc33400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc3c0ad670 0x7fbc3c1f0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53644/0 (socket says 172.21.15.90:53644) 2024-09-21T03:17:43.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.479+0000 7fbc33400640 1 -- 172.21.15.90:0/2183341834 learned_addr learned my addr 172.21.15.90:0/2183341834 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:17:43.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.479+0000 7fbc3be00640 1 --2- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc3c074b90 0x7fbc3c150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:43.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.479+0000 7fbc33400640 1 -- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc3c0adfc0 msgr2=0x7fbc3c151d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:17:43.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.479+0000 7fbc33400640 1 --2- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc3c0adfc0 0x7fbc3c151d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:43.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.479+0000 7fbc33400640 1 -- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc3c074b90 msgr2=0x7fbc3c150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:43.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.479+0000 7fbc33400640 1 --2- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc3c074b90 0x7fbc3c150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:17:43.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.479+0000 7fbc33400640 1 -- 172.21.15.90:0/2183341834 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc3c1516a0 con 0x7fbc3c0ad670 2024-09-21T03:17:43.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.480+0000 7fbc33400640 1 --2- 172.21.15.90:0/2183341834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc3c0ad670 0x7fbc3c1f0140 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400b550 tx=0x7fbc2400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:43.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.480+0000 7fbc38c00640 1 -- 172.21.15.90:0/2183341834 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2400f850 con 0x7fbc3c0ad670 2024-09-21T03:17:43.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.480+0000 7fbc38c00640 1 -- 172.21.15.90:0/2183341834 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc2400fae0 con 0x7fbc3c0ad670 2024-09-21T03:17:43.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.480+0000 7fbc43000640 1 -- 172.21.15.90:0/2183341834 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc3c14f910 con 0x7fbc3c0ad670 2024-09-21T03:17:43.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.480+0000 7fbc38c00640 1 -- 172.21.15.90:0/2183341834 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc24017400 con 0x7fbc3c0ad670 2024-09-21T03:17:43.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.480+0000 7fbc43000640 1 -- 172.21.15.90:0/2183341834 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc3c14f1f0 con 0x7fbc3c0ad670 2024-09-21T03:17:43.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.481+0000 7fbc43000640 1 --2- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc3c070570 0x7fbc3c144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:43.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.481+0000 7fbc43000640 1 -- 172.21.15.90:0/2183341834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c1f09d0 con 0x7fbc3c070570 2024-09-21T03:17:43.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.482+0000 7fbc3be00640 1 --2- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc3c070570 0x7fbc3c144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:43.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.482+0000 7fbc3be00640 1 -- 172.21.15.90:0/2183341834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc3c0ada80 con 0x7fbc3c070570 2024-09-21T03:17:43.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.482+0000 7fbc3be00640 1 --2- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc3c070570 0x7fbc3c144f00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0725b0 tx=0x7fbc2c0055e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:43.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.483+0000 7fbc38c00640 1 -- 172.21.15.90:0/2183341834 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbc240175a0 con 0x7fbc3c0ad670 2024-09-21T03:17:43.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.484+0000 7fbc38c00640 1 --2- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbc18078b70 0x7fbc1807b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:43.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.484+0000 7fbc38c00640 1 -- 172.21.15.90:0/2183341834 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fbc2409b050 con 0x7fbc3c0ad670 2024-09-21T03:17:43.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.484+0000 7fbc38c00640 1 -- 172.21.15.90:0/2183341834 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c004bb0 con 0x7fbc3c070570 2024-09-21T03:17:43.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.484+0000 7fbc38c00640 1 -- 172.21.15.90:0/2183341834 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbc2c040030 con 0x7fbc3c070570 2024-09-21T03:17:43.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.484+0000 7fbc38c00640 1 -- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc3c070570 msgr2=0x7fbc3c144f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:43.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.484+0000 7fbc38c00640 1 --2- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc3c070570 0x7fbc3c144f00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0725b0 tx=0x7fbc2c0055e0 comp rx=0 tx=0).stop 2024-09-21T03:17:43.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.484+0000 7fbc38c00640 1 -- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc3c070570 msgr2=0x7fbc3c144f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:17:43.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.484+0000 7fbc38c00640 1 --2- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc3c070570 0x7fbc3c144f00 secure :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0725b0 tx=0x7fbc2c0055e0 comp rx=0 tx=0).stop 2024-09-21T03:17:43.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.484+0000 7fbc41000640 1 --2- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbc18078b70 0x7fbc1807b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:43.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.485+0000 7fbc41000640 1 --2- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbc18078b70 0x7fbc1807b080 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c1f11b0 tx=0x7fbc34009680 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:43.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.490+0000 7fbc43000640 1 --2- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc3c145440 0x7fbc3c14a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:17:43.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.490+0000 7fbc43000640 1 -- 172.21.15.90:0/2183341834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c145850 con 0x7fbc3c145440 2024-09-21T03:17:43.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.491+0000 7fbc3be00640 1 --2- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc3c145440 0x7fbc3c14a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:17:43.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.491+0000 7fbc3be00640 1 -- 172.21.15.90:0/2183341834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbc3c06a2e0 con 0x7fbc3c145440 2024-09-21T03:17:43.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.492+0000 7fbc3be00640 1 --2- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc3c145440 0x7fbc3c14a330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0acb50 tx=0x7fbc2c0091e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:17:43.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.492+0000 7fbc38c00640 1 -- 172.21.15.90:0/2183341834 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c003ca0 con 0x7fbc3c145440 2024-09-21T03:17:43.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.493+0000 7fbc38c00640 1 -- 172.21.15.90:0/2183341834 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5039 (secure 0 0 0) 0x7fbc2c003c80 con 0x7fbc3c145440 2024-09-21T03:17:43.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.493+0000 7fbc38c00640 1 -- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc3c145440 msgr2=0x7fbc3c14a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:43.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.493+0000 7fbc38c00640 1 --2- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc3c145440 0x7fbc3c14a330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0acb50 tx=0x7fbc2c0091e0 comp rx=0 tx=0).stop 2024-09-21T03:17:43.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.493+0000 7fbc38c00640 1 -- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc3c145440 msgr2=0x7fbc3c14a330 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:17:43.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.493+0000 7fbc38c00640 1 --2- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc3c145440 0x7fbc3c14a330 secure :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0acb50 tx=0x7fbc2c0091e0 comp rx=0 tx=0).stop 2024-09-21T03:17:43.495 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:17:43.495 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:17:43.495 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:17:43.495 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:17:43.495 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 24, 2024-09-21T03:17:43.495 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 214282, 2024-09-21T03:17:43.496 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:17:43.496 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:17:43.496 INFO:teuthology.orchestra.run.smithi090.stdout: 1 2024-09-21T03:17:43.496 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:43.496 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 1, 2024-09-21T03:17:43.496 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:17:43.496 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:17:43.496 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:17:43.496 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:43.496 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:43.496 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:43.496 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:43.496 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:43.496 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:43.497 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:43.497 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:43.497 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:43.497 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:43.497 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:43.497 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:43.498 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:17:43.498 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:17:43.498 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:43.498 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:43.498 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:43.498 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:43.498 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:43.498 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:43.498 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:43.498 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:43.498 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:43.498 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:43.498 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:43.498 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:43.499 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.499 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:17:43.499 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:17:43.499 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:17:43.499 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:17:43.499 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:17:43.499 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:17:43.499 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:17:43.499 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:17:43.499 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:17:43.499 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:17:43.499 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:17:43.499 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:17:43.499 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:17:43.499 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:17:43.500 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:17:43.500 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:17:43.500 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:17:43.500 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:17:43.500 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:17:43.500 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:17:43.500 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:17:43.500 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:17:43.500 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:17:43.500 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:17:43.500 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:17:43.500 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:17:43.500 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:17:43.500 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:17:43.500 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:43.501 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:17:43.501 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.501 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:17:43.501 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.501 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:17:43.501 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:17:43.501 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:43.501 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:43.501 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.501 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:43.501 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:17:43.501 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:43.501 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.501 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.501 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:43.502 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:17:43.502 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:43.502 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:43.502 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:43.502 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.502 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:17:43.502 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:17:43.502 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:43.502 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:43.502 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:43.502 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.502 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.502 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:17:43.502 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:17:43.502 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:43.503 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:43.503 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.503 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:43.503 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:17:43.503 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:43.503 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.503 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.503 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:43.503 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:17:43.503 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:43.503 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:43.503 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:43.503 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.503 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:17:43.503 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:17:43.504 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:43.504 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:43.504 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:43.504 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.504 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.504 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:17:43.504 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:17:43.504 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:17:43.504 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:17:43.504 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.504 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:17:43.504 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:17:43.504 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:43.504 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.504 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.505 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:17:43.505 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:17:43.505 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:17:43.505 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:43.505 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:43.505 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.505 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:17:43.505 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:17:43.505 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:17:43.505 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:17:43.505 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:17:43.505 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:43.505 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:43.505 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.506 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:17:43.506 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:17:43.506 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.506 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:43.506 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:43.506 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:17:43.506 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:43.506 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:43.506 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:17:43.506 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.506 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:43.506 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:43.506 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:17:43.506 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:43.506 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:43.507 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:17:43.507 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.507 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:43.507 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:43.507 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:17:43.507 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:43.507 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:43.507 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:17:43.507 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.507 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:43.507 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:43.507 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:17:43.507 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:43.507 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:17:43.507 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:17:43.508 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:17:43.508 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:17:43.508 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:17:43.508 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:17:43.508 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:17:43.508 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:17:43.508 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:17:43.508 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:17:43.508 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:17:43.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.493+0000 7fbc43000640 1 -- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbc18078b70 msgr2=0x7fbc1807b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:43.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.493+0000 7fbc43000640 1 --2- 172.21.15.90:0/2183341834 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbc18078b70 0x7fbc1807b080 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c1f11b0 tx=0x7fbc34009680 comp rx=0 tx=0).stop 2024-09-21T03:17:43.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.493+0000 7fbc43000640 1 -- 172.21.15.90:0/2183341834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc3c0ad670 msgr2=0x7fbc3c1f0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:17:43.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.493+0000 7fbc43000640 1 --2- 172.21.15.90:0/2183341834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc3c0ad670 0x7fbc3c1f0140 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400b550 tx=0x7fbc2400ba10 comp rx=0 tx=0).stop 2024-09-21T03:17:43.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.493+0000 7fbc41000640 1 -- 172.21.15.90:0/2183341834 reap_dead start 2024-09-21T03:17:43.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.493+0000 7fbc41000640 1 -- 172.21.15.90:0/2183341834 reap_dead start 2024-09-21T03:17:43.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.493+0000 7fbc43000640 1 -- 172.21.15.90:0/2183341834 shutdown_connections 2024-09-21T03:17:43.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.493+0000 7fbc43000640 1 -- 172.21.15.90:0/2183341834 >> 172.21.15.90:0/2183341834 conn(0x7fbc3c0c85a0 msgr2=0x7fbc3c1de180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:17:43.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.493+0000 7fbc43000640 1 -- 172.21.15.90:0/2183341834 shutdown_connections 2024-09-21T03:17:43.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:17:43.493+0000 7fbc43000640 1 -- 172.21.15.90:0/2183341834 wait complete. 2024-09-21T03:17:43.515 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-21T03:17:43.515 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-21T03:17:58.375 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:17:58.381 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:18:03.515 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-21T03:18:03.515 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-21T03:18:03.516 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-21T03:18:03.521 INFO:tasks.ceph.mon.c:Started 2024-09-21T03:18:03.521 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-09-21T03:18:03.521 INFO:tasks.ceph.mon.b:Sent signal 19 2024-09-21T03:18:03.521 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-21T03:18:08.587 INFO:tasks.workunit.client.0.smithi090.stdout:fs setup took 65 secs 2024-09-21T03:18:13.463 INFO:tasks.workunit.client.1.smithi149.stdout:fs setup took 69 secs 2024-09-21T03:18:16.664 INFO:tasks.workunit.client.0.smithi090.stdout:Syncing()...8 sec 2024-09-21T03:18:16.666 INFO:tasks.workunit.client.0.smithi090.stdout:Starting Actual Benchmark At: Sat Sep 21 03:18:16 2024 2024-09-21T03:18:16.667 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-09-21T03:18:17.383 INFO:tasks.workunit.client.1.smithi149.stdout:Syncing()...3 sec 2024-09-21T03:18:17.384 INFO:tasks.workunit.client.1.smithi149.stdout:Starting Actual Benchmark At: Sat Sep 21 03:18:17 2024 2024-09-21T03:18:17.384 INFO:tasks.workunit.client.1.smithi149.stdout: 2024-09-21T03:18:18.522 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-09-21T03:18:18.523 INFO:tasks.ceph.mon.b:Sent signal 18 2024-09-21T03:18:18.523 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-21T03:18:18.523 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:18:19.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.115+0000 7f6d0b200640 1 -- 172.21.15.90:0/1688941020 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d040d7a80 msgr2=0x7f6d0404ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:19.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.115+0000 7f6d0b200640 1 --2- 172.21.15.90:0/1688941020 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d040d7a80 0x7f6d0404ab80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400fd50 tx=0x7f6cfc02a580 comp rx=0 tx=0).stop 2024-09-21T03:18:19.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.117+0000 7f6d0b200640 1 -- 172.21.15.90:0/1688941020 shutdown_connections 2024-09-21T03:18:19.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.117+0000 7f6d0b200640 1 --2- 172.21.15.90:0/1688941020 >> v2:172.21.15.149:3300/0 conn(0x7f6d04007350 0x7f6d040dded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:19.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.117+0000 7f6d0b200640 1 --2- 172.21.15.90:0/1688941020 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d040d7a80 0x7f6d0404ab80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:19.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.118+0000 7f6d0b200640 1 -- 172.21.15.90:0/1688941020 >> 172.21.15.90:0/1688941020 conn(0x7f6d040312e0 msgr2=0x7f6d040316f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:19.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.119+0000 7f6d0b200640 1 -- 172.21.15.90:0/1688941020 shutdown_connections 2024-09-21T03:18:19.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.119+0000 7f6d0b200640 1 -- 172.21.15.90:0/1688941020 wait complete. 2024-09-21T03:18:19.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.131+0000 7f6d0b200640 1 Processor -- start 2024-09-21T03:18:19.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.132+0000 7f6d0b200640 1 -- start start 2024-09-21T03:18:19.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.138+0000 7f6d0b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d04006f40 0x7f6d040d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:19.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.138+0000 7f6d0b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d04007350 0x7f6d04174730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:19.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.139+0000 7f6d0b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d040d7a80 0x7f6d040c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:19.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.140+0000 7f6d0a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d040d7a80 0x7f6d040c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:19.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.140+0000 7f6d09400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d04007350 0x7f6d04174730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:19.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.140+0000 7f6d09400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d04007350 0x7f6d04174730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:43924/0 (socket says 172.21.15.90:43924) 2024-09-21T03:18:19.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.140+0000 7f6d0a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d040d7a80 0x7f6d040c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:45084/0 (socket says 172.21.15.90:45084) 2024-09-21T03:18:19.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.141+0000 7f6d09400640 1 -- 172.21.15.90:0/2162588089 learned_addr learned my addr 172.21.15.90:0/2162588089 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:18:19.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.141+0000 7f6d09e00640 1 --2- 172.21.15.90:0/2162588089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d04006f40 0x7f6d040d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:19.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.142+0000 7f6d0b200640 1 -- 172.21.15.90:0/2162588089 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0404a740 con 0x7f6d04006f40 2024-09-21T03:18:19.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.142+0000 7f6d0b200640 1 -- 172.21.15.90:0/2162588089 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6d040de410 con 0x7f6d040d7a80 2024-09-21T03:18:19.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.142+0000 7f6d0b200640 1 -- 172.21.15.90:0/2162588089 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6d0404a8c0 con 0x7f6d04007350 2024-09-21T03:18:19.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.142+0000 7f6d09400640 1 -- 172.21.15.90:0/2162588089 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d04007350 msgr2=0x7f6d04174730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-21T03:18:19.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.142+0000 7f6d09400640 1 -- 172.21.15.90:0/2162588089 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d04007350 msgr2=0x7f6d04174730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T03:18:19.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.142+0000 7f6d09400640 1 --2- 172.21.15.90:0/2162588089 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d04007350 0x7f6d04174730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T03:18:19.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.143+0000 7f6d09400640 1 --2- 172.21.15.90:0/2162588089 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d04007350 0x7f6d04174730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:18:19.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.144+0000 7f6d0a800640 1 -- 172.21.15.90:0/2162588089 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d04007350 msgr2=0x7f6d04174730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:18:19.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.144+0000 7f6d0a800640 1 --2- 172.21.15.90:0/2162588089 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d04007350 0x7f6d04174730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:19.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.144+0000 7f6d0a800640 1 -- 172.21.15.90:0/2162588089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d04006f40 msgr2=0x7f6d040d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:19.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.144+0000 7f6d0a800640 1 --2- 172.21.15.90:0/2162588089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d04006f40 0x7f6d040d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:19.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.144+0000 7f6d0a800640 1 -- 172.21.15.90:0/2162588089 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d040c9650 con 0x7f6d040d7a80 2024-09-21T03:18:19.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.144+0000 7f6d09e00640 1 --2- 172.21.15.90:0/2162588089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d04006f40 0x7f6d040d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:19.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.145+0000 7f6d0a800640 1 --2- 172.21.15.90:0/2162588089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d040d7a80 0x7f6d040c8540 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c06c380 tx=0x7f6d0c06a1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:19.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.146+0000 7f6d02000640 1 -- 172.21.15.90:0/2162588089 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c076920 con 0x7f6d040d7a80 2024-09-21T03:18:19.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.147+0000 7f6d0b200640 1 -- 172.21.15.90:0/2162588089 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d040d8e00 con 0x7f6d040d7a80 2024-09-21T03:18:19.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.147+0000 7f6d0b200640 1 -- 172.21.15.90:0/2162588089 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d040d9580 con 0x7f6d040d7a80 2024-09-21T03:18:19.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.147+0000 7f6d02000640 1 -- 172.21.15.90:0/2162588089 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d0c076bb0 con 0x7f6d040d7a80 2024-09-21T03:18:19.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.150+0000 7f6d02000640 1 -- 172.21.15.90:0/2162588089 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c094400 con 0x7f6d040d7a80 2024-09-21T03:18:19.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.159+0000 7f6d02000640 1 -- 172.21.15.90:0/2162588089 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6d0c0945a0 con 0x7f6d040d7a80 2024-09-21T03:18:19.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.160+0000 7f6d0b200640 1 -- 172.21.15.90:0/2162588089 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ce4005290 con 0x7f6d040d7a80 2024-09-21T03:18:19.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.164+0000 7f6d02000640 1 --2- 172.21.15.90:0/2162588089 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6cec078c60 0x7f6cec07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:19.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.169+0000 7f6d02000640 1 -- 172.21.15.90:0/2162588089 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f6d0c117390 con 0x7f6d040d7a80 2024-09-21T03:18:19.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.171+0000 7f6d09e00640 1 --2- 172.21.15.90:0/2162588089 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6cec078c60 0x7f6cec07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:19.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.175+0000 7f6d09e00640 1 --2- 172.21.15.90:0/2162588089 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6cec078c60 0x7f6cec07b170 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc033000 tx=0x7f6cfc004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:19.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.180+0000 7f6d02000640 1 -- 172.21.15.90:0/2162588089 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6d0c090030 con 0x7f6d040d7a80 2024-09-21T03:18:19.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.912+0000 7f6d0b200640 1 -- 172.21.15.90:0/2162588089 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6ce4005580 con 0x7f6d040d7a80 2024-09-21T03:18:19.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.913+0000 7f6d02000640 1 -- 172.21.15.90:0/2162588089 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f6d0c0df3f0 con 0x7f6d040d7a80 2024-09-21T03:18:19.917 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:18:19.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.920+0000 7f6d0b200640 1 -- 172.21.15.90:0/2162588089 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6cec078c60 msgr2=0x7f6cec07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:19.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.920+0000 7f6d0b200640 1 --2- 172.21.15.90:0/2162588089 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6cec078c60 0x7f6cec07b170 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc033000 tx=0x7f6cfc004730 comp rx=0 tx=0).stop 2024-09-21T03:18:19.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.920+0000 7f6d0b200640 1 -- 172.21.15.90:0/2162588089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d040d7a80 msgr2=0x7f6d040c8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:19.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.921+0000 7f6d0b200640 1 --2- 172.21.15.90:0/2162588089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d040d7a80 0x7f6d040c8540 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c06c380 tx=0x7f6d0c06a1d0 comp rx=0 tx=0).stop 2024-09-21T03:18:19.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.923+0000 7f6d0b200640 1 -- 172.21.15.90:0/2162588089 shutdown_connections 2024-09-21T03:18:19.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.923+0000 7f6d0b200640 1 --2- 172.21.15.90:0/2162588089 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6cec078c60 0x7f6cec07b170 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:19.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.923+0000 7f6d0b200640 1 --2- 172.21.15.90:0/2162588089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d040d7a80 0x7f6d040c8540 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:19.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.923+0000 7f6d0b200640 1 --2- 172.21.15.90:0/2162588089 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d04007350 0x7f6d04174730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:19.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.923+0000 7f6d0b200640 1 --2- 172.21.15.90:0/2162588089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d04006f40 0x7f6d040d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:19.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.923+0000 7f6d0b200640 1 -- 172.21.15.90:0/2162588089 >> 172.21.15.90:0/2162588089 conn(0x7f6d040312e0 msgr2=0x7f6d040ce010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:19.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.925+0000 7f6d0b200640 1 -- 172.21.15.90:0/2162588089 shutdown_connections 2024-09-21T03:18:19.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:19.925+0000 7f6d0b200640 1 -- 172.21.15.90:0/2162588089 wait complete. 2024-09-21T03:18:19.983 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-21T03:18:19.983 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-21T03:18:19.983 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:18:20.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.579+0000 7f7c60800640 1 -- 172.21.15.90:0/1532127145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c580ad590 msgr2=0x7f7c580ad9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:20.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.579+0000 7f7c60800640 1 --2- 172.21.15.90:0/1532127145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c580ad590 0x7f7c580ad9a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7c58152530 tx=0x7f7c4802a5c0 comp rx=0 tx=0).stop 2024-09-21T03:18:20.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.581+0000 7f7c60800640 1 -- 172.21.15.90:0/1532127145 shutdown_connections 2024-09-21T03:18:20.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.581+0000 7f7c60800640 1 --2- 172.21.15.90:0/1532127145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c580ad590 0x7f7c580ad9a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:20.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.581+0000 7f7c60800640 1 --2- 172.21.15.90:0/1532127145 >> v2:172.21.15.90:3300/0 conn(0x7f7c580abde0 0x7f7c5814ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:20.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.581+0000 7f7c60800640 1 -- 172.21.15.90:0/1532127145 >> 172.21.15.90:0/1532127145 conn(0x7f7c580c81b0 msgr2=0x7f7c580c85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:20.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.583+0000 7f7c60800640 1 -- 172.21.15.90:0/1532127145 shutdown_connections 2024-09-21T03:18:20.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.583+0000 7f7c60800640 1 -- 172.21.15.90:0/1532127145 wait complete. 2024-09-21T03:18:20.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.592+0000 7f7c60800640 1 Processor -- start 2024-09-21T03:18:20.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.595+0000 7f7c60800640 1 -- start start 2024-09-21T03:18:20.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.603+0000 7f7c60800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c580730d0 0x7f7c580c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:20.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.608+0000 7f7c60800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c580abde0 0x7f7c581ed2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:20.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.608+0000 7f7c5de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c580730d0 0x7f7c580c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:20.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.608+0000 7f7c5de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c580730d0 0x7f7c580c2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:45106/0 (socket says 172.21.15.90:45106) 2024-09-21T03:18:20.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.608+0000 7f7c5de00640 1 -- 172.21.15.90:0/3238082069 learned_addr learned my addr 172.21.15.90:0/3238082069 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:18:20.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.610+0000 7f7c60800640 1 --2- 172.21.15.90:0/3238082069 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c580ad590 0x7f7c5814b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:20.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.610+0000 7f7c60800640 1 -- 172.21.15.90:0/3238082069 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7c58073d70 con 0x7f7c580abde0 2024-09-21T03:18:20.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.610+0000 7f7c60800640 1 -- 172.21.15.90:0/3238082069 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7c58073bf0 con 0x7f7c580730d0 2024-09-21T03:18:20.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.610+0000 7f7c60800640 1 -- 172.21.15.90:0/3238082069 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7c580adee0 con 0x7f7c580ad590 2024-09-21T03:18:20.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.611+0000 7f7c5de00640 1 -- 172.21.15.90:0/3238082069 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c580ad590 msgr2=0x7f7c5814b5d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:18:20.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.611+0000 7f7c5de00640 1 --2- 172.21.15.90:0/3238082069 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c580ad590 0x7f7c5814b5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:20.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.611+0000 7f7c5de00640 1 -- 172.21.15.90:0/3238082069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c580abde0 msgr2=0x7f7c581ed2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:20.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.611+0000 7f7c5de00640 1 --2- 172.21.15.90:0/3238082069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c580abde0 0x7f7c581ed2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:20.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.611+0000 7f7c5de00640 1 -- 172.21.15.90:0/3238082069 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c581f0260 con 0x7f7c580730d0 2024-09-21T03:18:20.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.613+0000 7f7c5de00640 1 --2- 172.21.15.90:0/3238082069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c580730d0 0x7f7c580c2c90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00c970 tx=0x7f7c4c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:20.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.614+0000 7f7c52000640 1 -- 172.21.15.90:0/3238082069 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c007bb0 con 0x7f7c580730d0 2024-09-21T03:18:20.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.614+0000 7f7c52000640 1 -- 172.21.15.90:0/3238082069 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c4c007e40 con 0x7f7c580730d0 2024-09-21T03:18:20.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.614+0000 7f7c52000640 1 -- 172.21.15.90:0/3238082069 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c00f690 con 0x7f7c580730d0 2024-09-21T03:18:20.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.615+0000 7f7c60800640 1 -- 172.21.15.90:0/3238082069 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c58150e40 con 0x7f7c580730d0 2024-09-21T03:18:20.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.615+0000 7f7c60800640 1 -- 172.21.15.90:0/3238082069 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c581513c0 con 0x7f7c580730d0 2024-09-21T03:18:20.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.619+0000 7f7c60800640 1 --2- 172.21.15.90:0/3238082069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c34002a70 0x7f7c34004f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:20.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.619+0000 7f7c60800640 1 -- 172.21.15.90:0/3238082069 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7c34007f10 con 0x7f7c34002a70 2024-09-21T03:18:20.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.621+0000 7f7c5d400640 1 --2- 172.21.15.90:0/3238082069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c34002a70 0x7f7c34004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:20.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.623+0000 7f7c5d400640 1 -- 172.21.15.90:0/3238082069 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c34008110 con 0x7f7c34002a70 2024-09-21T03:18:20.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.624+0000 7f7c5d400640 1 --2- 172.21.15.90:0/3238082069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c34002a70 0x7f7c34004f80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7c58155f10 tx=0x7f7c5400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:20.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.625+0000 7f7c52000640 1 -- 172.21.15.90:0/3238082069 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54003b70 con 0x7f7c34002a70 2024-09-21T03:18:20.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.625+0000 7f7c52000640 1 -- 172.21.15.90:0/3238082069 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7c54003d10 con 0x7f7c34002a70 2024-09-21T03:18:20.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.625+0000 7f7c52000640 1 -- 172.21.15.90:0/3238082069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c34002a70 msgr2=0x7f7c34004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:20.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.625+0000 7f7c52000640 1 --2- 172.21.15.90:0/3238082069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c34002a70 0x7f7c34004f80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7c58155f10 tx=0x7f7c5400ca60 comp rx=0 tx=0).stop 2024-09-21T03:18:20.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.625+0000 7f7c52000640 1 -- 172.21.15.90:0/3238082069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c34002a70 msgr2=0x7f7c34004f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:18:20.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.625+0000 7f7c52000640 1 --2- 172.21.15.90:0/3238082069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c34002a70 0x7f7c34004f80 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7c58155f10 tx=0x7f7c5400ca60 comp rx=0 tx=0).stop 2024-09-21T03:18:20.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.636+0000 7f7c52000640 1 -- 172.21.15.90:0/3238082069 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7c4c018400 con 0x7f7c580730d0 2024-09-21T03:18:20.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.640+0000 7f7c52000640 1 --2- 172.21.15.90:0/3238082069 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7c3c0786f0 0x7f7c3c07ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:20.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.642+0000 7f7c52000640 1 -- 172.21.15.90:0/3238082069 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f7c4c05f4e0 con 0x7f7c580730d0 2024-09-21T03:18:20.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.643+0000 7f7c5d400640 1 --2- 172.21.15.90:0/3238082069 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7c3c0786f0 0x7f7c3c07ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:20.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.646+0000 7f7c5d400640 1 --2- 172.21.15.90:0/3238082069 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7c3c0786f0 0x7f7c3c07ac00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400d010 tx=0x7f7c54009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:20.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.705+0000 7f7c60800640 1 --2- 172.21.15.90:0/3238082069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c34006f80 0x7f7c34007440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:20.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.705+0000 7f7c60800640 1 -- 172.21.15.90:0/3238082069 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3400a4f0 con 0x7f7c34006f80 2024-09-21T03:18:20.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.706+0000 7f7c5e800640 1 --2- 172.21.15.90:0/3238082069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c34006f80 0x7f7c34007440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:20.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.709+0000 7f7c5e800640 1 -- 172.21.15.90:0/3238082069 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7c34007980 con 0x7f7c34006f80 2024-09-21T03:18:20.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.711+0000 7f7c5e800640 1 --2- 172.21.15.90:0/3238082069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c34006f80 0x7f7c34007440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7c580c2a80 tx=0x7f7c48003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:20.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.712+0000 7f7c52000640 1 -- 172.21.15.90:0/3238082069 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48041070 con 0x7f7c34006f80 2024-09-21T03:18:20.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.713+0000 7f7c52000640 1 -- 172.21.15.90:0/3238082069 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5027 (secure 0 0 0) 0x7f7c48005020 con 0x7f7c34006f80 2024-09-21T03:18:20.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.713+0000 7f7c52000640 1 -- 172.21.15.90:0/3238082069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c34006f80 msgr2=0x7f7c34007440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:20.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.713+0000 7f7c52000640 1 --2- 172.21.15.90:0/3238082069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c34006f80 0x7f7c34007440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7c580c2a80 tx=0x7f7c48003960 comp rx=0 tx=0).stop 2024-09-21T03:18:20.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.713+0000 7f7c52000640 1 -- 172.21.15.90:0/3238082069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c34006f80 msgr2=0x7f7c34007440 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:18:20.715 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:18:20.716 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:18:20.716 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:18:20.716 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:18:20.716 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 28, 2024-09-21T03:18:20.716 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 86684, 2024-09-21T03:18:20.716 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:18:20.716 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:18:20.716 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:18:20.716 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:18:20.716 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:20.717 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 2, 2024-09-21T03:18:20.717 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:18:20.717 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:18:20.717 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:18:20.717 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:20.717 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:20.717 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:20.717 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:20.717 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:20.717 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:20.717 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:20.717 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:20.718 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:20.718 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:20.718 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:20.718 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:20.718 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:18:20.718 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:18:20.718 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:20.718 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:20.718 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:20.718 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:20.718 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:20.719 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:20.719 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:20.719 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:20.719 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:20.719 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:20.719 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:20.719 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:20.719 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:20.719 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:18:20.719 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:18:20.719 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:18:20.719 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:18:20.720 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:18:20.720 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:18:20.720 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:18:20.720 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:18:20.720 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:18:20.720 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:18:20.720 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:18:20.720 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:18:20.720 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:18:20.720 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:18:20.720 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:18:20.720 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:18:20.720 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:18:20.720 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:20.721 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:20.721 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:20.721 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:20.721 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:20.721 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:20.721 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:20.721 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:20.721 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:20.721 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:20.721 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:20.721 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:20.721 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:18:20.722 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:20.722 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:18:20.722 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:20.722 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:18:20.722 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:18:20.722 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:20.722 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:20.722 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:20.722 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:20.722 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:18:20.723 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:20.723 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:20.723 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:20.723 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:20.723 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:18:20.723 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:20.723 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:20.723 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:20.723 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:20.723 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:18:20.724 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:18:20.724 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:20.724 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:20.724 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:20.724 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:20.724 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:20.724 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:18:20.724 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:18:20.724 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:20.724 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:20.725 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:20.725 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:20.725 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:18:20.725 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:20.725 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:20.725 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:20.725 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:20.725 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:18:20.725 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:20.725 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:20.725 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:20.726 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:20.726 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:18:20.726 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:18:20.726 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:20.726 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:20.726 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:20.726 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:20.726 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:20.726 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:18:20.726 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:18:20.726 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:20.726 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:20.726 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:20.726 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:20.727 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:18:20.727 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:20.727 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:20.727 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:20.727 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:20.727 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:18:20.727 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:20.727 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:20.727 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:20.727 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:20.727 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:18:20.727 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:18:20.727 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:20.727 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:20.728 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:20.728 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:20.728 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:20.728 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:20.728 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:18:20.728 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:18:20.728 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:20.728 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:20.728 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:20.728 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:18:20.728 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:20.728 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:20.728 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:18:20.728 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:20.728 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:20.729 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:20.729 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:18:20.729 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:20.729 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:20.729 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:18:20.729 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:20.729 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:20.729 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:20.729 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 7 2024-09-21T03:18:20.729 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:20.729 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:20.729 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:18:20.729 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:20.729 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:18:20.729 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:18:20.729 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:18:20.729 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:20.730 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:20.730 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:20.730 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:20.730 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:18:20.730 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:20.730 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:20.730 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:20.730 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:18:20.730 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:18:20.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.713+0000 7f7c52000640 1 --2- 172.21.15.90:0/3238082069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c34006f80 0x7f7c34007440 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7c580c2a80 tx=0x7f7c48003960 comp rx=0 tx=0).stop 2024-09-21T03:18:20.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.715+0000 7f7c60800640 1 -- 172.21.15.90:0/3238082069 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7c3c0786f0 msgr2=0x7f7c3c07ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:20.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.715+0000 7f7c60800640 1 --2- 172.21.15.90:0/3238082069 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7c3c0786f0 0x7f7c3c07ac00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400d010 tx=0x7f7c54009030 comp rx=0 tx=0).stop 2024-09-21T03:18:20.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.715+0000 7f7c5e800640 1 -- 172.21.15.90:0/3238082069 reap_dead start 2024-09-21T03:18:20.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.715+0000 7f7c60800640 1 -- 172.21.15.90:0/3238082069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c580730d0 msgr2=0x7f7c580c2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:20.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.715+0000 7f7c60800640 1 --2- 172.21.15.90:0/3238082069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c580730d0 0x7f7c580c2c90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00c970 tx=0x7f7c4c00ce30 comp rx=0 tx=0).stop 2024-09-21T03:18:20.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.718+0000 7f7c5e800640 1 -- 172.21.15.90:0/3238082069 reap_dead start 2024-09-21T03:18:20.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.718+0000 7f7c60800640 1 -- 172.21.15.90:0/3238082069 shutdown_connections 2024-09-21T03:18:20.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.718+0000 7f7c60800640 1 -- 172.21.15.90:0/3238082069 >> 172.21.15.90:0/3238082069 conn(0x7f7c580c81b0 msgr2=0x7f7c580c6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:20.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.718+0000 7f7c60800640 1 -- 172.21.15.90:0/3238082069 shutdown_connections 2024-09-21T03:18:20.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:20.718+0000 7f7c60800640 1 -- 172.21.15.90:0/3238082069 wait complete. 2024-09-21T03:18:20.771 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:18:20.771 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-21T03:18:20.771 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:18:21.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.305+0000 7f0440e00640 1 -- 172.21.15.90:0/4228922541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f043c0ad590 msgr2=0x7f043c0ad9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:21.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.305+0000 7f0440e00640 1 --2- 172.21.15.90:0/4228922541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f043c0ad590 0x7f043c0ad9a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f043c152530 tx=0x7f043402aa30 comp rx=0 tx=0).stop 2024-09-21T03:18:21.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.306+0000 7f0440e00640 1 -- 172.21.15.90:0/4228922541 shutdown_connections 2024-09-21T03:18:21.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.306+0000 7f0440e00640 1 --2- 172.21.15.90:0/4228922541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f043c0ad590 0x7f043c0ad9a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:21.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.307+0000 7f0440e00640 1 --2- 172.21.15.90:0/4228922541 >> v2:172.21.15.90:3300/0 conn(0x7f043c0abde0 0x7f043c14ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:21.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.307+0000 7f0440e00640 1 -- 172.21.15.90:0/4228922541 >> 172.21.15.90:0/4228922541 conn(0x7f043c0c81b0 msgr2=0x7f043c0c85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:21.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.307+0000 7f0440e00640 1 -- 172.21.15.90:0/4228922541 shutdown_connections 2024-09-21T03:18:21.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.307+0000 7f0440e00640 1 -- 172.21.15.90:0/4228922541 wait complete. 2024-09-21T03:18:21.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.311+0000 7f0440e00640 1 Processor -- start 2024-09-21T03:18:21.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.311+0000 7f0440e00640 1 -- start start 2024-09-21T03:18:21.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.313+0000 7f0440e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f043c0730d0 0x7f043c145100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:21.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.313+0000 7f0440e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f043c0abde0 0x7f043c1de380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:21.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.313+0000 7f0440e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f043c0ad590 0x7f043c157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:21.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.314+0000 7f0440e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f043c073d70 con 0x7f043c0abde0 2024-09-21T03:18:21.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.314+0000 7f0440e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f043c073bf0 con 0x7f043c0730d0 2024-09-21T03:18:21.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.314+0000 7f0440e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f043c0adee0 con 0x7f043c0ad590 2024-09-21T03:18:21.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.314+0000 7f0439e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f043c0730d0 0x7f043c145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:21.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.314+0000 7f0439e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f043c0730d0 0x7f043c145100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:45122/0 (socket says 172.21.15.90:45122) 2024-09-21T03:18:21.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.314+0000 7f0439e00640 1 -- 172.21.15.90:0/3953316305 learned_addr learned my addr 172.21.15.90:0/3953316305 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:18:21.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.315+0000 7f0439e00640 1 -- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f043c0ad590 msgr2=0x7f043c157210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:18:21.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.315+0000 7f0439e00640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f043c0ad590 0x7f043c157210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:21.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.315+0000 7f0439e00640 1 -- 172.21.15.90:0/3953316305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f043c0abde0 msgr2=0x7f043c1de380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:18:21.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.317+0000 7f0439400640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f043c0abde0 0x7f043c1de380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:21.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.317+0000 7f0439e00640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f043c0abde0 0x7f043c1de380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:21.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.317+0000 7f0439e00640 1 -- 172.21.15.90:0/3953316305 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043c0c3bb0 con 0x7f043c0730d0 2024-09-21T03:18:21.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.320+0000 7f0439400640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f043c0abde0 0x7f043c1de380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:21.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.320+0000 7f0439e00640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f043c0730d0 0x7f043c145100 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f042c00c970 tx=0x7f042c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:21.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.321+0000 7f0432000640 1 -- 172.21.15.90:0/3953316305 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c007bb0 con 0x7f043c0730d0 2024-09-21T03:18:21.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.321+0000 7f0432000640 1 -- 172.21.15.90:0/3953316305 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f042c007e40 con 0x7f043c0730d0 2024-09-21T03:18:21.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.321+0000 7f0432000640 1 -- 172.21.15.90:0/3953316305 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c00f690 con 0x7f043c0730d0 2024-09-21T03:18:21.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.323+0000 7f0440e00640 1 -- 172.21.15.90:0/3953316305 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f043c145640 con 0x7f043c0730d0 2024-09-21T03:18:21.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.323+0000 7f0440e00640 1 -- 172.21.15.90:0/3953316305 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f043c157fa0 con 0x7f043c0730d0 2024-09-21T03:18:21.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.327+0000 7f0440e00640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0414002a70 0x7f0414004f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:21.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.327+0000 7f0440e00640 1 -- 172.21.15.90:0/3953316305 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0414007f10 con 0x7f0414002a70 2024-09-21T03:18:21.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.330+0000 7f0432000640 1 -- 172.21.15.90:0/3953316305 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f042c018400 con 0x7f043c0730d0 2024-09-21T03:18:21.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.333+0000 7f0432000640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f041c078c10 0x7f041c07b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:21.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.333+0000 7f0432000640 1 -- 172.21.15.90:0/3953316305 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f042c09b710 con 0x7f043c0730d0 2024-09-21T03:18:21.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.336+0000 7f043a800640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f041c078c10 0x7f041c07b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:21.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.349+0000 7f0439400640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0414002a70 0x7f0414004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:21.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.349+0000 7f043a800640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f041c078c10 0x7f041c07b120 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0434035000 tx=0x7f0434004ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:21.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.351+0000 7f0439400640 1 -- 172.21.15.90:0/3953316305 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0414008110 con 0x7f0414002a70 2024-09-21T03:18:21.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.352+0000 7f0439400640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0414002a70 0x7f0414004f80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0428000f60 tx=0x7f042800d8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:21.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.352+0000 7f0432000640 1 -- 172.21.15.90:0/3953316305 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0428016020 con 0x7f0414002a70 2024-09-21T03:18:21.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.354+0000 7f0432000640 1 -- 172.21.15.90:0/3953316305 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0428012800 con 0x7f0414002a70 2024-09-21T03:18:21.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.354+0000 7f0432000640 1 -- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0414002a70 msgr2=0x7f0414004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:21.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.354+0000 7f0432000640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0414002a70 0x7f0414004f80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0428000f60 tx=0x7f042800d8e0 comp rx=0 tx=0).stop 2024-09-21T03:18:21.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.354+0000 7f0432000640 1 -- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0414002a70 msgr2=0x7f0414004f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:18:21.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.354+0000 7f0432000640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0414002a70 0x7f0414004f80 secure :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0428000f60 tx=0x7f042800d8e0 comp rx=0 tx=0).stop 2024-09-21T03:18:21.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.373+0000 7f0440e00640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0414006f30 0x7f04140073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:21.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.373+0000 7f0440e00640 1 -- 172.21.15.90:0/3953316305 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f041400a4f0 con 0x7f0414006f30 2024-09-21T03:18:21.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.374+0000 7f0439400640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0414006f30 0x7f04140073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:21.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.377+0000 7f0439400640 1 -- 172.21.15.90:0/3953316305 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0414007930 con 0x7f0414006f30 2024-09-21T03:18:21.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.377+0000 7f0439400640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0414006f30 0x7f04140073f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0428000f60 tx=0x7f0428001080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:21.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.378+0000 7f0432000640 1 -- 172.21.15.90:0/3953316305 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0428016030 con 0x7f0414006f30 2024-09-21T03:18:21.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.378+0000 7f0432000640 1 -- 172.21.15.90:0/3953316305 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5050 (secure 0 0 0) 0x7f0428027640 con 0x7f0414006f30 2024-09-21T03:18:21.381 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:18:21.381 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:18:21.381 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:18:21.381 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:18:21.381 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 28, 2024-09-21T03:18:21.381 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 252167, 2024-09-21T03:18:21.381 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:18:21.381 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:18:21.381 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:18:21.381 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:18:21.381 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:21.381 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 2, 2024-09-21T03:18:21.381 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:18:21.382 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:18:21.382 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:18:21.382 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:21.382 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:21.382 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:21.382 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:21.382 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:21.382 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:21.382 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:21.382 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:21.382 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:21.382 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:21.382 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:21.382 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:21.382 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:18:21.383 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:18:21.383 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:21.383 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:21.383 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:21.383 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:21.383 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:21.383 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:21.383 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:21.383 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:21.383 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:21.383 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:21.383 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:21.383 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:21.383 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:21.383 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:18:21.383 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:18:21.384 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:18:21.384 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:18:21.384 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:18:21.384 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:18:21.384 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:18:21.384 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:18:21.384 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:18:21.384 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:18:21.384 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:18:21.384 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:18:21.384 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:18:21.384 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:18:21.384 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:18:21.384 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:18:21.384 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:18:21.385 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:21.385 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:21.385 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:21.385 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:21.385 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:21.385 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:21.385 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:21.385 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:21.385 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:21.385 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:21.385 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:21.385 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:21.385 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:18:21.385 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:21.385 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:18:21.385 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:21.386 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:18:21.386 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:18:21.386 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:21.386 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:21.386 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:21.386 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:21.386 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:18:21.386 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:21.386 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:21.386 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:21.386 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:21.386 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:18:21.386 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:21.386 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:21.386 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:21.387 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:21.387 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:18:21.387 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:18:21.387 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:21.387 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:21.387 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:21.387 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:21.387 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:21.387 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:18:21.387 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:18:21.387 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:21.387 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:21.387 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:21.387 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:21.387 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:18:21.388 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:21.388 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:21.388 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:21.388 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:21.388 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:18:21.388 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:21.388 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:21.388 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:21.388 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:21.388 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:18:21.388 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:18:21.388 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:21.388 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:21.388 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:21.388 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:21.389 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:21.389 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:18:21.389 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:18:21.389 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:21.389 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:21.389 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:21.389 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:21.389 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:18:21.389 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:21.389 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:21.389 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:21.389 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:21.389 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:18:21.389 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:21.390 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:21.390 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:21.390 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:21.390 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:18:21.390 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:18:21.390 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:21.390 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:21.390 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:21.390 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:21.390 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:21.390 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:21.390 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:18:21.390 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:18:21.390 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:21.391 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:21.391 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:21.391 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:18:21.391 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:21.391 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:21.391 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:18:21.391 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:21.391 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:21.391 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:21.391 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:18:21.391 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:21.391 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:21.391 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:18:21.391 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:18:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:18:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5 2024-09-21T03:18:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:18:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:18:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:18:21.393 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:18:21.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.379+0000 7f0432000640 1 -- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0414006f30 msgr2=0x7f04140073f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:21.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.379+0000 7f0432000640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0414006f30 0x7f04140073f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0428000f60 tx=0x7f0428001080 comp rx=0 tx=0).stop 2024-09-21T03:18:21.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.379+0000 7f0432000640 1 -- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0414006f30 msgr2=0x7f04140073f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:18:21.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.379+0000 7f0432000640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0414006f30 0x7f04140073f0 secure :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0428000f60 tx=0x7f0428001080 comp rx=0 tx=0).stop 2024-09-21T03:18:21.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.380+0000 7f0440e00640 1 -- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f041c078c10 msgr2=0x7f041c07b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:21.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.380+0000 7f0440e00640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f041c078c10 0x7f041c07b120 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0434035000 tx=0x7f0434004ab0 comp rx=0 tx=0).stop 2024-09-21T03:18:21.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.380+0000 7f043a800640 1 -- 172.21.15.90:0/3953316305 reap_dead start 2024-09-21T03:18:21.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.380+0000 7f0440e00640 1 -- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f043c0730d0 msgr2=0x7f043c145100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:21.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.380+0000 7f0440e00640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f043c0730d0 0x7f043c145100 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f042c00c970 tx=0x7f042c00ce30 comp rx=0 tx=0).stop 2024-09-21T03:18:21.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.380+0000 7f0440e00640 1 -- 172.21.15.90:0/3953316305 shutdown_connections 2024-09-21T03:18:21.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.380+0000 7f0440e00640 1 --2- 172.21.15.90:0/3953316305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f043c0730d0 0x7f043c145100 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:21.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.380+0000 7f0440e00640 1 -- 172.21.15.90:0/3953316305 >> 172.21.15.90:0/3953316305 conn(0x7f043c0c81b0 msgr2=0x7f043c1542b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:21.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.381+0000 7f0440e00640 1 -- 172.21.15.90:0/3953316305 shutdown_connections 2024-09-21T03:18:21.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:21.381+0000 7f0440e00640 1 -- 172.21.15.90:0/3953316305 wait complete. 2024-09-21T03:18:21.434 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:18:21.435 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-21T03:18:21.435 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:18:22.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.000+0000 7fc154e00640 1 -- 172.21.15.90:0/3489316601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1500731e0 msgr2=0x7fc15006fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:22.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.000+0000 7fc154e00640 1 --2- 172.21.15.90:0/3489316601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1500731e0 0x7fc15006fa00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc1500c5d50 tx=0x7fc13c02a560 comp rx=0 tx=0).stop 2024-09-21T03:18:22.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.000+0000 7fc154e00640 1 -- 172.21.15.90:0/3489316601 shutdown_connections 2024-09-21T03:18:22.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.000+0000 7fc154e00640 1 --2- 172.21.15.90:0/3489316601 >> v2:172.21.15.90:3300/0 conn(0x7fc1500c3500 0x7fc150073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:22.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.000+0000 7fc154e00640 1 --2- 172.21.15.90:0/3489316601 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc150150350 0x7fc1500c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:22.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.000+0000 7fc154e00640 1 --2- 172.21.15.90:0/3489316601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1500731e0 0x7fc15006fa00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:22.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.000+0000 7fc154e00640 1 -- 172.21.15.90:0/3489316601 >> 172.21.15.90:0/3489316601 conn(0x7fc1500c85a0 msgr2=0x7fc1500c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:22.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.000+0000 7fc154e00640 1 -- 172.21.15.90:0/3489316601 shutdown_connections 2024-09-21T03:18:22.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.000+0000 7fc154e00640 1 -- 172.21.15.90:0/3489316601 wait complete. 2024-09-21T03:18:22.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.004+0000 7fc154e00640 1 Processor -- start 2024-09-21T03:18:22.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.004+0000 7fc154e00640 1 -- start start 2024-09-21T03:18:22.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.007+0000 7fc154e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1500731e0 0x7fc15014bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:22.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.008+0000 7fc154e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1500c3500 0x7fc1501ebfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:22.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.008+0000 7fc154e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc150150350 0x7fc150149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:22.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.008+0000 7fc154e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc150150840 con 0x7fc1500731e0 2024-09-21T03:18:22.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.008+0000 7fc154e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc150153b20 con 0x7fc150150350 2024-09-21T03:18:22.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.008+0000 7fc154e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc150070a40 con 0x7fc1500c3500 2024-09-21T03:18:22.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.008+0000 7fc14de00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1500731e0 0x7fc15014bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:22.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.009+0000 7fc14de00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1500731e0 0x7fc15014bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:40410/0 (socket says 172.21.15.90:40410) 2024-09-21T03:18:22.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.009+0000 7fc14de00640 1 -- 172.21.15.90:0/2635874390 learned_addr learned my addr 172.21.15.90:0/2635874390 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:18:22.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.009+0000 7fc14e800640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc150150350 0x7fc150149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:22.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.009+0000 7fc14d400640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1500c3500 0x7fc1501ebfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:22.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.010+0000 7fc14de00640 1 -- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1500c3500 msgr2=0x7fc1501ebfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:22.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.012+0000 7fc14de00640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1500c3500 0x7fc1501ebfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:22.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.012+0000 7fc14de00640 1 -- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc150150350 msgr2=0x7fc150149b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:22.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.012+0000 7fc14de00640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc150150350 0x7fc150149b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:22.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.012+0000 7fc14de00640 1 -- 172.21.15.90:0/2635874390 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc150156590 con 0x7fc1500731e0 2024-09-21T03:18:22.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.012+0000 7fc14d400640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1500c3500 0x7fc1501ebfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:22.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.012+0000 7fc14e800640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc150150350 0x7fc150149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:22.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.013+0000 7fc14de00640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1500731e0 0x7fc15014bf30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc13c02ab50 tx=0x7fc13c005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:22.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.013+0000 7fc146000640 1 -- 172.21.15.90:0/2635874390 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13c033e60 con 0x7fc1500731e0 2024-09-21T03:18:22.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.014+0000 7fc154e00640 1 -- 172.21.15.90:0/2635874390 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1500c6a10 con 0x7fc1500731e0 2024-09-21T03:18:22.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.014+0000 7fc154e00640 1 -- 172.21.15.90:0/2635874390 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc150156eb0 con 0x7fc1500731e0 2024-09-21T03:18:22.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.016+0000 7fc146000640 1 -- 172.21.15.90:0/2635874390 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc13c031c40 con 0x7fc1500731e0 2024-09-21T03:18:22.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.016+0000 7fc146000640 1 -- 172.21.15.90:0/2635874390 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13c033e60 con 0x7fc1500731e0 2024-09-21T03:18:22.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.018+0000 7fc154e00640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc128002a70 0x7fc128004f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:22.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.019+0000 7fc154e00640 1 -- 172.21.15.90:0/2635874390 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc128007f10 con 0x7fc128002a70 2024-09-21T03:18:22.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.021+0000 7fc14d400640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc128002a70 0x7fc128004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:22.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.023+0000 7fc14d400640 1 -- 172.21.15.90:0/2635874390 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc128008110 con 0x7fc128002a70 2024-09-21T03:18:22.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.024+0000 7fc14d400640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc128002a70 0x7fc128004f80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc1500ae170 tx=0x7fc140011e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:22.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.024+0000 7fc146000640 1 -- 172.21.15.90:0/2635874390 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14001f070 con 0x7fc128002a70 2024-09-21T03:18:22.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.024+0000 7fc146000640 1 -- 172.21.15.90:0/2635874390 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc13c0330d0 con 0x7fc1500731e0 2024-09-21T03:18:22.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.028+0000 7fc146000640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc13007ae70 0x7fc13007d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:22.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.029+0000 7fc14e800640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc13007ae70 0x7fc13007d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:22.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.030+0000 7fc146000640 1 -- 172.21.15.90:0/2635874390 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fc13c0bbd90 con 0x7fc1500731e0 2024-09-21T03:18:22.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.030+0000 7fc146000640 1 -- 172.21.15.90:0/2635874390 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc14000fdc0 con 0x7fc128002a70 2024-09-21T03:18:22.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.031+0000 7fc146000640 1 -- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc128002a70 msgr2=0x7fc128004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:22.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.031+0000 7fc146000640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc128002a70 0x7fc128004f80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc1500ae170 tx=0x7fc140011e10 comp rx=0 tx=0).stop 2024-09-21T03:18:22.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.031+0000 7fc146000640 1 -- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc128002a70 msgr2=0x7fc128004f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:18:22.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.031+0000 7fc146000640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc128002a70 0x7fc128004f80 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc1500ae170 tx=0x7fc140011e10 comp rx=0 tx=0).stop 2024-09-21T03:18:22.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.031+0000 7fc14e800640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc13007ae70 0x7fc13007d380 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc150072900 tx=0x7fc148009500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:22.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.043+0000 7fc154e00640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc128006fa0 0x7fc128007480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:22.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.043+0000 7fc154e00640 1 -- 172.21.15.90:0/2635874390 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc12800a4f0 con 0x7fc128006fa0 2024-09-21T03:18:22.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.044+0000 7fc14d400640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc128006fa0 0x7fc128007480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:22.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.045+0000 7fc14d400640 1 -- 172.21.15.90:0/2635874390 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc1280079c0 con 0x7fc128006fa0 2024-09-21T03:18:22.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.045+0000 7fc14d400640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc128006fa0 0x7fc128007480 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc1500ae170 tx=0x7fc1400046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:22.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.046+0000 7fc146000640 1 -- 172.21.15.90:0/2635874390 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140012c00 con 0x7fc128006fa0 2024-09-21T03:18:22.049 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:18:22.049 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:18:22.049 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:18:22.049 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:18:22.049 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 28, 2024-09-21T03:18:22.049 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 17512, 2024-09-21T03:18:22.049 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:18:22.049 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:18:22.049 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:18:22.049 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:18:22.049 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:22.049 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 3, 2024-09-21T03:18:22.050 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:18:22.050 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:18:22.050 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:18:22.050 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:22.050 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:22.050 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:22.050 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:22.050 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:22.050 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:22.050 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:22.050 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:22.050 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:22.050 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:22.051 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:22.051 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:22.051 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:18:22.051 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:18:22.051 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:22.051 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:22.051 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:22.051 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:22.051 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:22.051 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:22.051 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:22.051 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:22.051 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:22.051 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:22.052 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:22.052 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:22.052 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:22.052 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:18:22.052 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:18:22.052 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:18:22.052 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:18:22.052 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:18:22.052 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:18:22.052 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:18:22.052 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:18:22.052 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:18:22.052 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:18:22.052 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:18:22.053 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:18:22.053 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:18:22.053 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:18:22.053 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:18:22.053 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:18:22.053 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:18:22.053 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:22.053 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:22.053 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:22.053 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:22.053 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:22.053 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:22.054 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:22.054 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:22.054 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:22.054 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:22.054 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:22.054 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:22.054 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:18:22.054 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:22.054 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:18:22.054 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:22.054 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:18:22.054 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:18:22.054 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:22.055 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:22.055 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:22.055 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:22.055 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:18:22.055 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:22.055 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:22.055 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:22.055 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:22.055 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:18:22.055 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:22.055 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:22.055 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:22.055 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:22.055 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:18:22.055 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:18:22.056 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:22.056 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:22.056 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:22.056 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:22.056 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:22.056 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:18:22.056 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:18:22.056 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:22.056 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:22.056 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:22.056 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:22.056 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:18:22.056 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:22.057 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:22.057 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:22.057 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:22.057 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:18:22.057 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:22.057 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:22.057 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:22.057 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:22.057 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:18:22.057 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:18:22.057 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:22.057 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:22.057 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:22.058 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:22.058 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:22.058 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:18:22.058 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:18:22.058 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:22.058 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:22.058 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:22.058 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:22.058 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:18:22.058 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:22.058 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:22.058 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:22.058 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:22.058 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:18:22.059 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:22.059 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:22.059 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:22.059 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:22.059 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:18:22.059 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:18:22.059 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:22.059 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:22.059 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:22.059 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:22.059 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:22.059 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:22.059 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:18:22.059 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:18:22.059 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:22.059 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:22.060 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:22.060 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:18:22.060 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:22.060 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:22.060 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:18:22.060 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:22.060 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:22.060 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:22.060 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:18:22.060 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:22.060 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:22.060 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:22.060 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:18:22.060 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:18:22.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.047+0000 7fc146000640 1 -- 172.21.15.90:0/2635874390 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4548 (secure 0 0 0) 0x7fc140012be0 con 0x7fc128006fa0 2024-09-21T03:18:22.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.047+0000 7fc146000640 1 -- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc128006fa0 msgr2=0x7fc128007480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:22.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.047+0000 7fc146000640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc128006fa0 0x7fc128007480 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc1500ae170 tx=0x7fc1400046c0 comp rx=0 tx=0).stop 2024-09-21T03:18:22.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.047+0000 7fc146000640 1 -- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc128006fa0 msgr2=0x7fc128007480 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:18:22.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.047+0000 7fc146000640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc128006fa0 0x7fc128007480 secure :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc1500ae170 tx=0x7fc1400046c0 comp rx=0 tx=0).stop 2024-09-21T03:18:22.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.049+0000 7fc154e00640 1 -- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc13007ae70 msgr2=0x7fc13007d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:22.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.049+0000 7fc154e00640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc13007ae70 0x7fc13007d380 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc150072900 tx=0x7fc148009500 comp rx=0 tx=0).stop 2024-09-21T03:18:22.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.050+0000 7fc14e800640 1 -- 172.21.15.90:0/2635874390 reap_dead start 2024-09-21T03:18:22.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.050+0000 7fc154e00640 1 -- 172.21.15.90:0/2635874390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1500731e0 msgr2=0x7fc15014bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:22.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.050+0000 7fc154e00640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1500731e0 0x7fc15014bf30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc13c02ab50 tx=0x7fc13c005270 comp rx=0 tx=0).stop 2024-09-21T03:18:22.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.050+0000 7fc154e00640 1 -- 172.21.15.90:0/2635874390 shutdown_connections 2024-09-21T03:18:22.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.050+0000 7fc154e00640 1 --2- 172.21.15.90:0/2635874390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1500731e0 0x7fc15014bf30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:22.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.050+0000 7fc154e00640 1 -- 172.21.15.90:0/2635874390 >> 172.21.15.90:0/2635874390 conn(0x7fc1500c85a0 msgr2=0x7fc15006f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:22.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.052+0000 7fc154e00640 1 -- 172.21.15.90:0/2635874390 shutdown_connections 2024-09-21T03:18:22.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.053+0000 7fc154e00640 1 -- 172.21.15.90:0/2635874390 wait complete. 2024-09-21T03:18:22.095 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:18:22.096 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-21T03:18:22.096 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-21T03:18:22.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.548+0000 7f3188a00640 1 -- 172.21.15.90:0/2671379506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f318406e380 msgr2=0x7f31841615a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:22.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.548+0000 7f3188a00640 1 --2- 172.21.15.90:0/2671379506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f318406e380 0x7f31841615a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f31840c9dd0 tx=0x7f317402a580 comp rx=0 tx=0).stop 2024-09-21T03:18:22.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.548+0000 7f3188a00640 1 -- 172.21.15.90:0/2671379506 shutdown_connections 2024-09-21T03:18:22.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.548+0000 7f3188a00640 1 --2- 172.21.15.90:0/2671379506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f318406e380 0x7f31841615a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:22.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.548+0000 7f3188a00640 1 --2- 172.21.15.90:0/2671379506 >> v2:172.21.15.149:3300/0 conn(0x7f31840c7900 0x7f31840c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:22.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.549+0000 7f3188a00640 1 -- 172.21.15.90:0/2671379506 >> 172.21.15.90:0/2671379506 conn(0x7f31840c8d90 msgr2=0x7f31840c91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:22.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.549+0000 7f3188a00640 1 -- 172.21.15.90:0/2671379506 shutdown_connections 2024-09-21T03:18:22.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.549+0000 7f3188a00640 1 -- 172.21.15.90:0/2671379506 wait complete. 2024-09-21T03:18:22.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.553+0000 7f3188a00640 1 Processor -- start 2024-09-21T03:18:22.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.554+0000 7f3188a00640 1 -- start start 2024-09-21T03:18:22.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.557+0000 7f3188a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f318406e380 0x7f31841fdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:22.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.557+0000 7f3188a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31840c5e80 0x7f31840be170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:22.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.557+0000 7f3188a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31841fd090 0x7f31841fd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:22.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.557+0000 7f3188a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3184157b10 con 0x7f318406e380 2024-09-21T03:18:22.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.558+0000 7f3183400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f318406e380 0x7f31841fdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:22.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.558+0000 7f3188a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f31840c75e0 con 0x7f31841fd090 2024-09-21T03:18:22.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.558+0000 7f3188a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f31840c89e0 con 0x7f31840c5e80 2024-09-21T03:18:22.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.558+0000 7f3183e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31841fd090 0x7f31841fd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:22.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.558+0000 7f3183400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f318406e380 0x7f31841fdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:40420/0 (socket says 172.21.15.90:40420) 2024-09-21T03:18:22.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.558+0000 7f3183400640 1 -- 172.21.15.90:0/1627500955 learned_addr learned my addr 172.21.15.90:0/1627500955 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:18:22.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.559+0000 7f3183400640 1 -- 172.21.15.90:0/1627500955 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31840c5e80 msgr2=0x7f31840be170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:18:22.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.559+0000 7f3183400640 1 --2- 172.21.15.90:0/1627500955 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31840c5e80 0x7f31840be170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:22.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.560+0000 7f3183400640 1 -- 172.21.15.90:0/1627500955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31841fd090 msgr2=0x7f31841fd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:22.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.560+0000 7f3183400640 1 --2- 172.21.15.90:0/1627500955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31841fd090 0x7f31841fd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:22.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.560+0000 7f3183400640 1 -- 172.21.15.90:0/1627500955 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31840bef40 con 0x7f318406e380 2024-09-21T03:18:22.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.561+0000 7f3183e00640 1 --2- 172.21.15.90:0/1627500955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31841fd090 0x7f31841fd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:22.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.561+0000 7f3183400640 1 --2- 172.21.15.90:0/1627500955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f318406e380 0x7f31841fdb10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f317c009eb0 tx=0x7f317c00c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:22.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.562+0000 7f317b400640 1 -- 172.21.15.90:0/1627500955 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c013600 con 0x7f318406e380 2024-09-21T03:18:22.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.563+0000 7f317b400640 1 -- 172.21.15.90:0/1627500955 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f317c0137e0 con 0x7f318406e380 2024-09-21T03:18:22.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.563+0000 7f317b400640 1 -- 172.21.15.90:0/1627500955 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c013c30 con 0x7f318406e380 2024-09-21T03:18:22.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.564+0000 7f3188a00640 1 -- 172.21.15.90:0/1627500955 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31840bea60 con 0x7f318406e380 2024-09-21T03:18:22.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.567+0000 7f3188a00640 1 -- 172.21.15.90:0/1627500955 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31840be6b0 con 0x7f318406e380 2024-09-21T03:18:22.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.570+0000 7f317b400640 1 -- 172.21.15.90:0/1627500955 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f317c01c400 con 0x7f318406e380 2024-09-21T03:18:22.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.570+0000 7f3188a00640 1 -- 172.21.15.90:0/1627500955 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31840c6e00 con 0x7f318406e380 2024-09-21T03:18:22.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.576+0000 7f317b400640 1 --2- 172.21.15.90:0/1627500955 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3164078be0 0x7f316407b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:22.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.578+0000 7f3182a00640 1 --2- 172.21.15.90:0/1627500955 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3164078be0 0x7f316407b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:22.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.578+0000 7f317b400640 1 -- 172.21.15.90:0/1627500955 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f317c09b5b0 con 0x7f318406e380 2024-09-21T03:18:22.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.582+0000 7f3182a00640 1 --2- 172.21.15.90:0/1627500955 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3164078be0 0x7f316407b0f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f31840ae820 tx=0x7f3170006bd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:22.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:22.591+0000 7f317b400640 1 -- 172.21.15.90:0/1627500955 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f317c063850 con 0x7f318406e380 2024-09-21T03:18:23.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:23.144+0000 7f3188a00640 1 -- 172.21.15.90:0/1627500955 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f31840c3350 con 0x7f318406e380 2024-09-21T03:18:23.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:23.146+0000 7f317b400640 1 -- 172.21.15.90:0/1627500955 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f317c063150 con 0x7f318406e380 2024-09-21T03:18:23.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:23.150+0000 7f3188a00640 1 -- 172.21.15.90:0/1627500955 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3164078be0 msgr2=0x7f316407b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:23.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:23.150+0000 7f3188a00640 1 --2- 172.21.15.90:0/1627500955 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3164078be0 0x7f316407b0f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f31840ae820 tx=0x7f3170006bd0 comp rx=0 tx=0).stop 2024-09-21T03:18:23.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:23.150+0000 7f3188a00640 1 -- 172.21.15.90:0/1627500955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f318406e380 msgr2=0x7f31841fdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:23.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:23.150+0000 7f3188a00640 1 --2- 172.21.15.90:0/1627500955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f318406e380 0x7f31841fdb10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f317c009eb0 tx=0x7f317c00c620 comp rx=0 tx=0).stop 2024-09-21T03:18:23.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:23.150+0000 7f3188a00640 1 -- 172.21.15.90:0/1627500955 shutdown_connections 2024-09-21T03:18:23.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:23.150+0000 7f3188a00640 1 --2- 172.21.15.90:0/1627500955 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3164078be0 0x7f316407b0f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:23.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:23.150+0000 7f3188a00640 1 --2- 172.21.15.90:0/1627500955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31841fd090 0x7f31841fd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:23.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:23.150+0000 7f3188a00640 1 --2- 172.21.15.90:0/1627500955 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31840c5e80 0x7f31840be170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:23.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:23.150+0000 7f3188a00640 1 --2- 172.21.15.90:0/1627500955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f318406e380 0x7f31841fdb10 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f317c009eb0 tx=0x7f317c00c620 comp rx=0 tx=0).stop 2024-09-21T03:18:23.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:23.150+0000 7f3188a00640 1 -- 172.21.15.90:0/1627500955 >> 172.21.15.90:0/1627500955 conn(0x7f31840c8d90 msgr2=0x7f3184159150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:23.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:23.151+0000 7f3188a00640 1 -- 172.21.15.90:0/1627500955 shutdown_connections 2024-09-21T03:18:23.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:23.152+0000 7f3188a00640 1 -- 172.21.15.90:0/1627500955 wait complete. 2024-09-21T03:18:23.207 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-21T03:18:28.550 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:18:28.555 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:18:33.208 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-21T03:18:33.208 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:18:33.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.478+0000 7f3297600640 1 -- 172.21.15.90:0/3008701972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32900c5ae0 msgr2=0x7f32900c5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:33.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.478+0000 7f3297600640 1 --2- 172.21.15.90:0/3008701972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32900c5ae0 0x7f32900c5ef0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f329014bc50 tx=0x7f328802a790 comp rx=0 tx=0).stop 2024-09-21T03:18:33.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.479+0000 7f3297600640 1 -- 172.21.15.90:0/3008701972 shutdown_connections 2024-09-21T03:18:33.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.479+0000 7f3297600640 1 --2- 172.21.15.90:0/3008701972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32900c5ae0 0x7f32900c5ef0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.479+0000 7f3297600640 1 --2- 172.21.15.90:0/3008701972 >> v2:172.21.15.149:3300/0 conn(0x7f3290071070 0x7f3290155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.479+0000 7f3297600640 1 -- 172.21.15.90:0/3008701972 >> 172.21.15.90:0/3008701972 conn(0x7f32900c91d0 msgr2=0x7f32900c53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:33.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.479+0000 7f3297600640 1 -- 172.21.15.90:0/3008701972 shutdown_connections 2024-09-21T03:18:33.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.479+0000 7f3297600640 1 -- 172.21.15.90:0/3008701972 wait complete. 2024-09-21T03:18:33.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.481+0000 7f3297600640 1 Processor -- start 2024-09-21T03:18:33.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.482+0000 7f3297600640 1 -- start start 2024-09-21T03:18:33.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.483+0000 7f3297600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3290071070 0x7f32900a8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:33.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.483+0000 7f3297600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32900c2b50 0x7f32900ad070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:33.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.483+0000 7f3297600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32900c5ae0 0x7f329014a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:33.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.483+0000 7f3297600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3290155150 con 0x7f32900c5ae0 2024-09-21T03:18:33.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.483+0000 7f3297600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3290154e70 con 0x7f3290071070 2024-09-21T03:18:33.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.483+0000 7f3297600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f32900a7b10 con 0x7f32900c2b50 2024-09-21T03:18:33.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.483+0000 7f328fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32900c2b50 0x7f32900ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:33.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.483+0000 7f3294c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3290071070 0x7f32900a8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:33.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.484+0000 7f3295600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32900c5ae0 0x7f329014a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:33.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.484+0000 7f328fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32900c2b50 0x7f32900ad070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:41900/0 (socket says 172.21.15.90:41900) 2024-09-21T03:18:33.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.484+0000 7f328fe00640 1 -- 172.21.15.90:0/876731478 learned_addr learned my addr 172.21.15.90:0/876731478 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:18:33.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.484+0000 7f3294c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3290071070 0x7f32900a8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:35046/0 (socket says 172.21.15.90:35046) 2024-09-21T03:18:33.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.484+0000 7f3294c00640 1 -- 172.21.15.90:0/876731478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32900c2b50 msgr2=0x7f32900ad070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:33.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.484+0000 7f3294c00640 1 --2- 172.21.15.90:0/876731478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32900c2b50 0x7f32900ad070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.484+0000 7f3294c00640 1 -- 172.21.15.90:0/876731478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32900c5ae0 msgr2=0x7f329014a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:33.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.484+0000 7f3294c00640 1 --2- 172.21.15.90:0/876731478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32900c5ae0 0x7f329014a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.484+0000 7f3294c00640 1 -- 172.21.15.90:0/876731478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329014f410 con 0x7f3290071070 2024-09-21T03:18:33.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.484+0000 7f328fe00640 1 --2- 172.21.15.90:0/876731478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32900c2b50 0x7f32900ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:18:33.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.484+0000 7f3295600640 1 --2- 172.21.15.90:0/876731478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32900c5ae0 0x7f329014a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:18:33.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.485+0000 7f3294c00640 1 --2- 172.21.15.90:0/876731478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3290071070 0x7f32900a8f90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f328400c3c0 tx=0x7f328400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:33.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.485+0000 7f328cc00640 1 -- 172.21.15.90:0/876731478 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3284011790 con 0x7f3290071070 2024-09-21T03:18:33.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.485+0000 7f328cc00640 1 -- 172.21.15.90:0/876731478 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3284017070 con 0x7f3290071070 2024-09-21T03:18:33.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.485+0000 7f328cc00640 1 -- 172.21.15.90:0/876731478 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3284011ce0 con 0x7f3290071070 2024-09-21T03:18:33.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.486+0000 7f3297600640 1 -- 172.21.15.90:0/876731478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3290151510 con 0x7f3290071070 2024-09-21T03:18:33.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.486+0000 7f3297600640 1 -- 172.21.15.90:0/876731478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32900a9640 con 0x7f3290071070 2024-09-21T03:18:33.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.487+0000 7f3297600640 1 -- 172.21.15.90:0/876731478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32900a98a0 con 0x7f3290071070 2024-09-21T03:18:33.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.489+0000 7f328cc00640 1 -- 172.21.15.90:0/876731478 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f328401c460 con 0x7f3290071070 2024-09-21T03:18:33.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.490+0000 7f328cc00640 1 --2- 172.21.15.90:0/876731478 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3270078b90 0x7f327007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:33.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.490+0000 7f328cc00640 1 -- 172.21.15.90:0/876731478 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f328409ac20 con 0x7f3290071070 2024-09-21T03:18:33.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.491+0000 7f328fe00640 1 --2- 172.21.15.90:0/876731478 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3270078b90 0x7f327007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:33.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.492+0000 7f328fe00640 1 --2- 172.21.15.90:0/876731478 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3270078b90 0x7f327007b0a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f32900aa170 tx=0x7f327c005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:33.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.498+0000 7f328cc00640 1 -- 172.21.15.90:0/876731478 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f32840626c0 con 0x7f3290071070 2024-09-21T03:18:33.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.822+0000 7f3297600640 1 -- 172.21.15.90:0/876731478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3290155670 con 0x7f3290071070 2024-09-21T03:18:33.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.823+0000 7f328cc00640 1 -- 172.21.15.90:0/876731478 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f32840670f0 con 0x7f3290071070 2024-09-21T03:18:33.825 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:18:33.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.826+0000 7f3297600640 1 -- 172.21.15.90:0/876731478 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3270078b90 msgr2=0x7f327007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:33.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.826+0000 7f3297600640 1 --2- 172.21.15.90:0/876731478 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3270078b90 0x7f327007b0a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f32900aa170 tx=0x7f327c005f90 comp rx=0 tx=0).stop 2024-09-21T03:18:33.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.826+0000 7f3297600640 1 -- 172.21.15.90:0/876731478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3290071070 msgr2=0x7f32900a8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:33.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.826+0000 7f3297600640 1 --2- 172.21.15.90:0/876731478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3290071070 0x7f32900a8f90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f328400c3c0 tx=0x7f328400c880 comp rx=0 tx=0).stop 2024-09-21T03:18:33.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.826+0000 7f3297600640 1 -- 172.21.15.90:0/876731478 shutdown_connections 2024-09-21T03:18:33.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.826+0000 7f3297600640 1 --2- 172.21.15.90:0/876731478 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3270078b90 0x7f327007b0a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.826+0000 7f3297600640 1 --2- 172.21.15.90:0/876731478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32900c5ae0 0x7f329014a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.826+0000 7f3297600640 1 --2- 172.21.15.90:0/876731478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32900c2b50 0x7f32900ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.826+0000 7f3297600640 1 --2- 172.21.15.90:0/876731478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3290071070 0x7f32900a8f90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.826+0000 7f3297600640 1 -- 172.21.15.90:0/876731478 >> 172.21.15.90:0/876731478 conn(0x7f32900c91d0 msgr2=0x7f32900c78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:33.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.826+0000 7f3297600640 1 -- 172.21.15.90:0/876731478 shutdown_connections 2024-09-21T03:18:33.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:33.826+0000 7f3297600640 1 -- 172.21.15.90:0/876731478 wait complete. 2024-09-21T03:18:33.851 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-21T03:18:33.851 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-21T03:18:33.851 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-21T03:18:33.851 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:18:34.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.082+0000 7f2713200640 1 -- 172.21.15.90:0/1863201160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27140aaec0 msgr2=0x7f271414e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.082+0000 7f2713200640 1 --2- 172.21.15.90:0/1863201160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27140aaec0 0x7f271414e890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2704009830 tx=0x7f270402a520 comp rx=0 tx=0).stop 2024-09-21T03:18:34.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.082+0000 7f2713200640 1 -- 172.21.15.90:0/1863201160 shutdown_connections 2024-09-21T03:18:34.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.082+0000 7f2713200640 1 --2- 172.21.15.90:0/1863201160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27140aaec0 0x7f271414e890 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.083+0000 7f2713200640 1 -- 172.21.15.90:0/1863201160 >> 172.21.15.90:0/1863201160 conn(0x7f271406d200 msgr2=0x7f271406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:34.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.083+0000 7f2713200640 1 -- 172.21.15.90:0/1863201160 shutdown_connections 2024-09-21T03:18:34.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.083+0000 7f2713200640 1 -- 172.21.15.90:0/1863201160 wait complete. 2024-09-21T03:18:34.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.085+0000 7f2713200640 1 Processor -- start 2024-09-21T03:18:34.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.085+0000 7f2713200640 1 -- start start 2024-09-21T03:18:34.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.086+0000 7f2713200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27140aaec0 0x7f2714150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.086+0000 7f2713200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27140c4fa0 0x7f27141edd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.086+0000 7f2713200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27140c53b0 0x7f27141575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.086+0000 7f2713200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f271414edd0 con 0x7f27140aaec0 2024-09-21T03:18:34.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.086+0000 7f2713200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f27141553c0 con 0x7f27140c4fa0 2024-09-21T03:18:34.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.086+0000 7f2713200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f27141525c0 con 0x7f27140c53b0 2024-09-21T03:18:34.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.086+0000 7f2711e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27140aaec0 0x7f2714150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.086+0000 7f2711e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27140aaec0 0x7f2714150ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33422/0 (socket says 172.21.15.90:33422) 2024-09-21T03:18:34.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.086+0000 7f2711e00640 1 -- 172.21.15.90:0/1179277097 learned_addr learned my addr 172.21.15.90:0/1179277097 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:18:34.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.086+0000 7f270be00640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27140c4fa0 0x7f27141edd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.086+0000 7f2712800640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27140c53b0 0x7f27141575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.087+0000 7f2711e00640 1 -- 172.21.15.90:0/1179277097 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27140c53b0 msgr2=0x7f27141575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.087+0000 7f2711e00640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27140c53b0 0x7f27141575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.087+0000 7f2711e00640 1 -- 172.21.15.90:0/1179277097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27140c4fa0 msgr2=0x7f27141edd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.087+0000 7f2711e00640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27140c4fa0 0x7f27141edd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.087+0000 7f2711e00640 1 -- 172.21.15.90:0/1179277097 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271414f970 con 0x7f27140aaec0 2024-09-21T03:18:34.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.087+0000 7f2712800640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27140c53b0 0x7f27141575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:34.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.087+0000 7f2711e00640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27140aaec0 0x7f2714150ae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2704000c00 tx=0x7f2704033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:34.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.087+0000 7f270a000640 1 -- 172.21.15.90:0/1179277097 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2704031d60 con 0x7f27140aaec0 2024-09-21T03:18:34.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.087+0000 7f270a000640 1 -- 172.21.15.90:0/1179277097 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27040330d0 con 0x7f27140aaec0 2024-09-21T03:18:34.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.087+0000 7f2713200640 1 -- 172.21.15.90:0/1179277097 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f271414fc50 con 0x7f27140aaec0 2024-09-21T03:18:34.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.087+0000 7f270a000640 1 -- 172.21.15.90:0/1179277097 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2704033520 con 0x7f27140aaec0 2024-09-21T03:18:34.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.087+0000 7f2713200640 1 -- 172.21.15.90:0/1179277097 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27141ed550 con 0x7f27140aaec0 2024-09-21T03:18:34.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.088+0000 7f2713200640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27141f0730 0x7f27141f0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.088+0000 7f2713200640 1 -- 172.21.15.90:0/1179277097 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f271414f6f0 con 0x7f27141f0730 2024-09-21T03:18:34.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.089+0000 7f270be00640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27141f0730 0x7f27141f0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.089+0000 7f270be00640 1 -- 172.21.15.90:0/1179277097 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27140ad3d0 con 0x7f27141f0730 2024-09-21T03:18:34.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.089+0000 7f270be00640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27141f0730 0x7f27141f0b40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f271414f490 tx=0x7f26fc00f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:34.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.090+0000 7f270a000640 1 -- 172.21.15.90:0/1179277097 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc0052e0 con 0x7f27141f0730 2024-09-21T03:18:34.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.090+0000 7f270a000640 1 -- 172.21.15.90:0/1179277097 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f26fc005480 con 0x7f27141f0730 2024-09-21T03:18:34.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.090+0000 7f270a000640 1 -- 172.21.15.90:0/1179277097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27141f0730 msgr2=0x7f27141f0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.090+0000 7f270a000640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27141f0730 0x7f27141f0b40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f271414f490 tx=0x7f26fc00f9d0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.090+0000 7f270a000640 1 -- 172.21.15.90:0/1179277097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27141f0730 msgr2=0x7f27141f0b40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:18:34.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.090+0000 7f270a000640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27141f0730 0x7f27141f0b40 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f271414f490 tx=0x7f26fc00f9d0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.090+0000 7f270a000640 1 -- 172.21.15.90:0/1179277097 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f27040035f0 con 0x7f27140aaec0 2024-09-21T03:18:34.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.091+0000 7f270a000640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f26f0078670 0x7f26f007ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.091+0000 7f270a000640 1 -- 172.21.15.90:0/1179277097 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f27040bc640 con 0x7f27140aaec0 2024-09-21T03:18:34.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.091+0000 7f270be00640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f26f0078670 0x7f26f007ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.092+0000 7f270be00640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f26f0078670 0x7f26f007ab80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f26fc001010 tx=0x7f26fc005000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:34.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.097+0000 7f2713200640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2714148a10 0x7f2714148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.097+0000 7f2713200640 1 -- 172.21.15.90:0/1179277097 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f27140ab3a0 con 0x7f2714148a10 2024-09-21T03:18:34.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.097+0000 7f2712800640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2714148a10 0x7f2714148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.098+0000 7f2712800640 1 -- 172.21.15.90:0/1179277097 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f27140c2030 con 0x7f2714148a10 2024-09-21T03:18:34.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.098+0000 7f2712800640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2714148a10 0x7f2714148e20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f27140c4960 tx=0x7f270c00c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:34.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.098+0000 7f270a000640 1 -- 172.21.15.90:0/1179277097 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270c00ee00 con 0x7f2714148a10 2024-09-21T03:18:34.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.099+0000 7f270a000640 1 -- 172.21.15.90:0/1179277097 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5029 (secure 0 0 0) 0x7f270c00ee00 con 0x7f2714148a10 2024-09-21T03:18:34.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.099+0000 7f270a000640 1 -- 172.21.15.90:0/1179277097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2714148a10 msgr2=0x7f2714148e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.099+0000 7f270a000640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2714148a10 0x7f2714148e20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f27140c4960 tx=0x7f270c00c4b0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.099+0000 7f270a000640 1 -- 172.21.15.90:0/1179277097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2714148a10 msgr2=0x7f2714148e20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:18:34.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.099+0000 7f270a000640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2714148a10 0x7f2714148e20 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f27140c4960 tx=0x7f270c00c4b0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.101 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:18:34.101 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:18:34.101 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:18:34.101 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:18:34.102 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 28, 2024-09-21T03:18:34.102 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 100070, 2024-09-21T03:18:34.102 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:18:34.102 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:18:34.102 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:18:34.102 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:18:34.102 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:34.102 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 15, 2024-09-21T03:18:34.102 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:18:34.102 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:18:34.102 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:18:34.102 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:34.102 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:34.103 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:34.103 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:34.103 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:34.103 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:34.103 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:34.103 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:34.103 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:34.103 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:34.103 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:34.103 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:34.103 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:18:34.103 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:18:34.103 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:34.103 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:34.104 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:34.104 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:34.104 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:34.104 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:34.104 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:34.104 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:34.104 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:34.104 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:34.104 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:34.104 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:34.104 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.104 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:18:34.104 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:18:34.104 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:18:34.104 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:18:34.105 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:18:34.105 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:18:34.105 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:18:34.105 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:18:34.105 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:18:34.105 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:18:34.105 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:18:34.105 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:18:34.105 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:18:34.105 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:18:34.105 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:18:34.105 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:18:34.105 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:18:34.105 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:34.106 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:34.106 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:34.106 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:34.106 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:34.106 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:34.106 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:34.106 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:34.106 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:34.106 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:34.106 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:34.106 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:34.106 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:18:34.106 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.106 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:18:34.107 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.107 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:18:34.107 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:18:34.107 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:34.107 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:34.107 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.107 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:34.107 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:18:34.107 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:34.107 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.107 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.107 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:34.107 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:18:34.107 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:34.108 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.108 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:34.108 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.108 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:18:34.108 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:18:34.108 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:34.108 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:34.108 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:34.108 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.108 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.108 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:18:34.108 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:18:34.108 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:34.109 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:34.109 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.109 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:34.109 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:18:34.109 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:34.109 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.109 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.109 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:34.109 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:18:34.109 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:34.109 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.109 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:34.109 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.109 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:18:34.109 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:18:34.109 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:34.110 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:34.110 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:34.110 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.110 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.110 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:18:34.110 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:18:34.110 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:34.110 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:34.110 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.110 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:34.110 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:18:34.110 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:34.110 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.110 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.111 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:34.111 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:18:34.111 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:34.111 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.111 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:34.111 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.111 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:18:34.111 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:18:34.112 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:34.112 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:34.112 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:34.112 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.112 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:34.112 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.112 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:18:34.112 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:18:34.112 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.112 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:34.112 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:34.112 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:18:34.112 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.113 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:34.113 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:18:34.113 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.113 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:34.113 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:34.113 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:18:34.113 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.113 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:34.113 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:18:34.113 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.113 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:34.113 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:34.113 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 7 2024-09-21T03:18:34.113 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.113 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:34.113 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:18:34.114 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.114 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:18:34.114 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:18:34.114 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:18:34.114 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.114 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.114 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:34.114 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:34.114 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 3 2024-09-21T03:18:34.114 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.114 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:34.114 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.114 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:18:34.114 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:18:34.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.099+0000 7f2713200640 1 -- 172.21.15.90:0/1179277097 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f26f0078670 msgr2=0x7f26f007ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.099+0000 7f2713200640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f26f0078670 0x7f26f007ab80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f26fc001010 tx=0x7f26fc005000 comp rx=0 tx=0).stop 2024-09-21T03:18:34.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.099+0000 7f2713200640 1 -- 172.21.15.90:0/1179277097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27140aaec0 msgr2=0x7f2714150ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.099+0000 7f2713200640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27140aaec0 0x7f2714150ae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2704000c00 tx=0x7f2704033d60 comp rx=0 tx=0).stop 2024-09-21T03:18:34.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.099+0000 7f2712800640 1 -- 172.21.15.90:0/1179277097 reap_dead start 2024-09-21T03:18:34.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.099+0000 7f2713200640 1 -- 172.21.15.90:0/1179277097 shutdown_connections 2024-09-21T03:18:34.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.099+0000 7f2713200640 1 --2- 172.21.15.90:0/1179277097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27140aaec0 0x7f2714150ae0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.099+0000 7f2713200640 1 -- 172.21.15.90:0/1179277097 >> 172.21.15.90:0/1179277097 conn(0x7f271406d200 msgr2=0x7f2714074310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:34.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.099+0000 7f2713200640 1 -- 172.21.15.90:0/1179277097 shutdown_connections 2024-09-21T03:18:34.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.099+0000 7f2713200640 1 -- 172.21.15.90:0/1179277097 wait complete. 2024-09-21T03:18:34.123 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:18:34.123 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-21T03:18:34.123 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:18:34.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.362+0000 7ff660600640 1 -- 172.21.15.90:0/1452361266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6580adfc0 msgr2=0x7ff6580730f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.362+0000 7ff660600640 1 --2- 172.21.15.90:0/1452361266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6580adfc0 0x7ff6580730f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff658152960 tx=0x7ff65002a890 comp rx=0 tx=0).stop 2024-09-21T03:18:34.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.362+0000 7ff660600640 1 -- 172.21.15.90:0/1452361266 shutdown_connections 2024-09-21T03:18:34.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.362+0000 7ff660600640 1 --2- 172.21.15.90:0/1452361266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6580adfc0 0x7ff6580730f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.362+0000 7ff660600640 1 --2- 172.21.15.90:0/1452361266 >> v2:172.21.15.149:3300/0 conn(0x7ff6580ad670 0x7ff6580ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.362+0000 7ff660600640 1 -- 172.21.15.90:0/1452361266 >> 172.21.15.90:0/1452361266 conn(0x7ff6580c85a0 msgr2=0x7ff6580c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:34.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.362+0000 7ff660600640 1 -- 172.21.15.90:0/1452361266 shutdown_connections 2024-09-21T03:18:34.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.362+0000 7ff660600640 1 -- 172.21.15.90:0/1452361266 wait complete. 2024-09-21T03:18:34.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.364+0000 7ff660600640 1 Processor -- start 2024-09-21T03:18:34.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.364+0000 7ff660600640 1 -- start start 2024-09-21T03:18:34.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.366+0000 7ff660600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff658074b90 0x7ff6581eac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.366+0000 7ff660600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6580ad670 0x7ff65814a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.366+0000 7ff660600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6580adfc0 0x7ff6581481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.366+0000 7ff660600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff6580739c0 con 0x7ff658074b90 2024-09-21T03:18:34.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.366+0000 7ff660600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff658073840 con 0x7ff6580adfc0 2024-09-21T03:18:34.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.366+0000 7ff660600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff658073b40 con 0x7ff6580ad670 2024-09-21T03:18:34.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.366+0000 7ff65dc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff658074b90 0x7ff6581eac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.366+0000 7ff65dc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff658074b90 0x7ff6581eac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33442/0 (socket says 172.21.15.90:33442) 2024-09-21T03:18:34.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.366+0000 7ff65dc00640 1 -- 172.21.15.90:0/3926256630 learned_addr learned my addr 172.21.15.90:0/3926256630 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:18:34.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.366+0000 7ff65e600640 1 --2- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6580adfc0 0x7ff6581481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.366+0000 7ff65d200640 1 --2- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6580ad670 0x7ff65814a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.366+0000 7ff65dc00640 1 -- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6580ad670 msgr2=0x7ff65814a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.366+0000 7ff65dc00640 1 --2- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6580ad670 0x7ff65814a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.366+0000 7ff65dc00640 1 -- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6580adfc0 msgr2=0x7ff6581481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.366+0000 7ff65dc00640 1 --2- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6580adfc0 0x7ff6581481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.367+0000 7ff65dc00640 1 -- 172.21.15.90:0/3926256630 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6581eee50 con 0x7ff658074b90 2024-09-21T03:18:34.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.367+0000 7ff65dc00640 1 --2- 172.21.15.90:0/3926256630 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff658074b90 0x7ff6581eac80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0046b0 tx=0x7ff64c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:34.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.367+0000 7ff655600640 1 -- 172.21.15.90:0/3926256630 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c011790 con 0x7ff658074b90 2024-09-21T03:18:34.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.367+0000 7ff655600640 1 -- 172.21.15.90:0/3926256630 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff64c017070 con 0x7ff658074b90 2024-09-21T03:18:34.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.367+0000 7ff655600640 1 -- 172.21.15.90:0/3926256630 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c011cc0 con 0x7ff658074b90 2024-09-21T03:18:34.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.367+0000 7ff660600640 1 -- 172.21.15.90:0/3926256630 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff658156250 con 0x7ff658074b90 2024-09-21T03:18:34.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.367+0000 7ff660600640 1 -- 172.21.15.90:0/3926256630 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff658156810 con 0x7ff658074b90 2024-09-21T03:18:34.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.368+0000 7ff660600640 1 --2- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff658148d80 0x7ff658148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.368+0000 7ff660600640 1 -- 172.21.15.90:0/3926256630 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff6581eec00 con 0x7ff658148d80 2024-09-21T03:18:34.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.369+0000 7ff65d200640 1 --2- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff658148d80 0x7ff658148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.369+0000 7ff65d200640 1 -- 172.21.15.90:0/3926256630 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6581ef130 con 0x7ff658148d80 2024-09-21T03:18:34.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.369+0000 7ff65d200640 1 --2- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff658148d80 0x7ff658148710 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff658154110 tx=0x7ff644011e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:34.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.370+0000 7ff655600640 1 -- 172.21.15.90:0/3926256630 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff64c01c460 con 0x7ff658074b90 2024-09-21T03:18:34.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.371+0000 7ff655600640 1 --2- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff638078bc0 0x7ff63807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.371+0000 7ff655600640 1 -- 172.21.15.90:0/3926256630 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7ff64c09ad60 con 0x7ff658074b90 2024-09-21T03:18:34.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.371+0000 7ff655600640 1 -- 172.21.15.90:0/3926256630 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64401e070 con 0x7ff658148d80 2024-09-21T03:18:34.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.371+0000 7ff65e600640 1 --2- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff638078bc0 0x7ff63807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.371+0000 7ff655600640 1 -- 172.21.15.90:0/3926256630 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff644004240 con 0x7ff658148d80 2024-09-21T03:18:34.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.371+0000 7ff655600640 1 -- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff658148d80 msgr2=0x7ff658148710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.371+0000 7ff655600640 1 --2- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff658148d80 0x7ff658148710 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff658154110 tx=0x7ff644011e70 comp rx=0 tx=0).stop 2024-09-21T03:18:34.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.371+0000 7ff655600640 1 -- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff658148d80 msgr2=0x7ff658148710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:18:34.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.371+0000 7ff655600640 1 --2- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff658148d80 0x7ff658148710 secure :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff658154110 tx=0x7ff644011e70 comp rx=0 tx=0).stop 2024-09-21T03:18:34.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.372+0000 7ff65e600640 1 --2- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff638078bc0 0x7ff63807b0d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff650034000 tx=0x7ff650004ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:34.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.378+0000 7ff660600640 1 --2- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6581eb1c0 0x7ff658158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.378+0000 7ff660600640 1 -- 172.21.15.90:0/3926256630 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff6580ac380 con 0x7ff6581eb1c0 2024-09-21T03:18:34.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.378+0000 7ff65d200640 1 --2- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6581eb1c0 0x7ff658158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.379+0000 7ff65d200640 1 -- 172.21.15.90:0/3926256630 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff6580ada80 con 0x7ff6581eb1c0 2024-09-21T03:18:34.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.379+0000 7ff65d200640 1 --2- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6581eb1c0 0x7ff658158400 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff658154110 tx=0x7ff6440046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:34.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.379+0000 7ff655600640 1 -- 172.21.15.90:0/3926256630 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64401e040 con 0x7ff6581eb1c0 2024-09-21T03:18:34.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.380+0000 7ff655600640 1 -- 172.21.15.90:0/3926256630 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5051 (secure 0 0 0) 0x7ff644022b00 con 0x7ff6581eb1c0 2024-09-21T03:18:34.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.380+0000 7ff655600640 1 -- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6581eb1c0 msgr2=0x7ff658158400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.380+0000 7ff655600640 1 --2- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6581eb1c0 0x7ff658158400 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff658154110 tx=0x7ff6440046c0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.380+0000 7ff655600640 1 -- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6581eb1c0 msgr2=0x7ff658158400 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:18:34.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.380+0000 7ff655600640 1 --2- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6581eb1c0 0x7ff658158400 secure :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff658154110 tx=0x7ff6440046c0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.382 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:18:34.382 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:18:34.382 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:18:34.382 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:18:34.382 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 28, 2024-09-21T03:18:34.382 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 265169, 2024-09-21T03:18:34.382 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:18:34.383 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:18:34.383 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:18:34.383 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:18:34.383 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:34.383 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 15, 2024-09-21T03:18:34.383 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:18:34.383 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:18:34.383 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:18:34.383 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:34.383 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:34.383 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:34.383 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:34.383 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:34.383 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:34.384 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:34.384 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:34.384 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:34.384 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:34.384 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:34.384 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:34.384 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:18:34.384 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:18:34.384 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:34.384 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:34.384 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:34.384 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:34.384 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:34.384 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:34.384 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:34.385 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:34.385 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:34.385 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:34.385 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:34.385 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:34.385 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.385 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:18:34.385 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:18:34.385 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:18:34.385 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:18:34.385 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:18:34.385 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:18:34.385 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:18:34.385 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:18:34.385 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:18:34.385 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:18:34.386 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:18:34.386 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:18:34.386 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:18:34.386 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:18:34.386 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:18:34.386 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:18:34.386 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:18:34.386 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:34.386 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:34.386 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:34.386 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:34.387 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:34.387 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:34.387 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:34.387 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:34.387 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:34.387 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:34.387 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:34.387 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:34.387 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:18:34.387 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.387 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:18:34.387 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.387 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:18:34.387 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:18:34.387 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:34.388 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:34.388 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.388 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:34.388 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:18:34.388 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:34.388 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.388 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.388 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:34.388 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:18:34.388 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:34.388 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.388 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:34.388 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.388 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:18:34.388 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:18:34.388 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:34.389 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:34.389 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:34.389 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.389 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.389 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:18:34.389 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:18:34.389 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:34.389 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:34.389 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.389 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:34.389 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:18:34.389 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:34.389 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.389 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.389 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:34.390 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:18:34.390 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:34.390 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.390 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:34.390 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.390 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:18:34.390 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:18:34.390 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:34.390 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:34.390 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:34.390 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.390 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.390 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:18:34.391 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:18:34.391 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:34.391 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:34.391 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.391 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:34.391 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:18:34.391 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:34.391 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.391 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.391 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:34.391 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:18:34.391 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:34.391 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.391 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:34.392 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.392 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:18:34.392 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:18:34.392 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:34.392 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:34.392 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:34.392 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.392 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:34.392 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.392 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:18:34.392 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:18:34.392 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.392 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:34.392 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:34.392 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:18:34.392 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.393 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:34.393 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:18:34.393 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.393 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:34.393 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:34.393 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:18:34.393 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.393 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:34.393 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:18:34.393 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.393 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:34.393 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:34.393 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:18:34.393 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.394 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:34.394 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:18:34.394 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.394 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:34.394 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:34.394 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:18:34.394 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.394 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:34.394 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:18:34.394 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.394 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:34.394 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:34.395 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:18:34.395 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.395 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:34.395 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.395 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:18:34.395 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:18:34.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.380+0000 7ff660600640 1 -- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff638078bc0 msgr2=0x7ff63807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.380+0000 7ff660600640 1 --2- 172.21.15.90:0/3926256630 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff638078bc0 0x7ff63807b0d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff650034000 tx=0x7ff650004ab0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.380+0000 7ff660600640 1 -- 172.21.15.90:0/3926256630 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff658074b90 msgr2=0x7ff6581eac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.380+0000 7ff660600640 1 --2- 172.21.15.90:0/3926256630 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff658074b90 0x7ff6581eac80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0046b0 tx=0x7ff64c00c890 comp rx=0 tx=0).stop 2024-09-21T03:18:34.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.380+0000 7ff65e600640 1 -- 172.21.15.90:0/3926256630 reap_dead start 2024-09-21T03:18:34.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.380+0000 7ff65e600640 1 -- 172.21.15.90:0/3926256630 reap_dead start 2024-09-21T03:18:34.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.380+0000 7ff660600640 1 -- 172.21.15.90:0/3926256630 shutdown_connections 2024-09-21T03:18:34.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.380+0000 7ff660600640 1 -- 172.21.15.90:0/3926256630 >> 172.21.15.90:0/3926256630 conn(0x7ff6580c85a0 msgr2=0x7ff6580c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:34.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.380+0000 7ff660600640 1 -- 172.21.15.90:0/3926256630 shutdown_connections 2024-09-21T03:18:34.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.380+0000 7ff660600640 1 -- 172.21.15.90:0/3926256630 wait complete. 2024-09-21T03:18:34.404 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:18:34.404 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-21T03:18:34.404 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:18:34.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.718+0000 7f0e64a00640 1 -- 172.21.15.90:0/3355792902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e6006ddf0 msgr2=0x7f0e600cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.718+0000 7f0e64a00640 1 --2- 172.21.15.90:0/3355792902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e6006ddf0 0x7f0e600cb7d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0e600cd260 tx=0x7f0e5802a980 comp rx=0 tx=0).stop 2024-09-21T03:18:34.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.718+0000 7f0e64a00640 1 -- 172.21.15.90:0/3355792902 shutdown_connections 2024-09-21T03:18:34.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.718+0000 7f0e64a00640 1 --2- 172.21.15.90:0/3355792902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e6006ddf0 0x7f0e600cb7d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.718+0000 7f0e64a00640 1 --2- 172.21.15.90:0/3355792902 >> v2:172.21.15.149:3300/0 conn(0x7f0e6006d9e0 0x7f0e600cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.718+0000 7f0e64a00640 1 --2- 172.21.15.90:0/3355792902 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e60157730 0x7f0e601542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.718+0000 7f0e64a00640 1 -- 172.21.15.90:0/3355792902 >> 172.21.15.90:0/3355792902 conn(0x7f0e600cc240 msgr2=0x7f0e600cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:34.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.719+0000 7f0e64a00640 1 -- 172.21.15.90:0/3355792902 shutdown_connections 2024-09-21T03:18:34.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.719+0000 7f0e64a00640 1 -- 172.21.15.90:0/3355792902 wait complete. 2024-09-21T03:18:34.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.721+0000 7f0e64a00640 1 Processor -- start 2024-09-21T03:18:34.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.721+0000 7f0e64a00640 1 -- start start 2024-09-21T03:18:34.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.722+0000 7f0e64a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e6006d9e0 0x7f0e600c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.722+0000 7f0e64a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e6006ddf0 0x7f0e601e1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.722+0000 7f0e64a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e60157730 0x7f0e6015a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.722+0000 7f0e64a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0e600cbd10 con 0x7f0e60157730 2024-09-21T03:18:34.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.722+0000 7f0e64a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0e60157210 con 0x7f0e6006d9e0 2024-09-21T03:18:34.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.722+0000 7f0e64a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0e600c7190 con 0x7f0e6006ddf0 2024-09-21T03:18:34.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.723+0000 7f0e5de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e6006ddf0 0x7f0e601e1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.723+0000 7f0e5f200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e60157730 0x7f0e6015a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.723+0000 7f0e5de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e6006ddf0 0x7f0e601e1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:41930/0 (socket says 172.21.15.90:41930) 2024-09-21T03:18:34.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.723+0000 7f0e5de00640 1 -- 172.21.15.90:0/714466681 learned_addr learned my addr 172.21.15.90:0/714466681 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:18:34.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.723+0000 7f0e5e800640 1 --2- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e6006d9e0 0x7f0e600c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.723+0000 7f0e5de00640 1 -- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e6006d9e0 msgr2=0x7f0e600c0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.723+0000 7f0e5de00640 1 --2- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e6006d9e0 0x7f0e600c0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.723+0000 7f0e5de00640 1 -- 172.21.15.90:0/714466681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e60157730 msgr2=0x7f0e6015a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.723+0000 7f0e5de00640 1 --2- 172.21.15.90:0/714466681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e60157730 0x7f0e6015a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.723+0000 7f0e5de00640 1 -- 172.21.15.90:0/714466681 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e60157ef0 con 0x7f0e6006ddf0 2024-09-21T03:18:34.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.724+0000 7f0e5de00640 1 --2- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e6006ddf0 0x7f0e601e1f60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00e740 tx=0x7f0e4c00ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:34.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.724+0000 7f0e56a00640 1 -- 172.21.15.90:0/714466681 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c00ccc0 con 0x7f0e6006ddf0 2024-09-21T03:18:34.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.724+0000 7f0e56a00640 1 -- 172.21.15.90:0/714466681 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e4c00ee50 con 0x7f0e6006ddf0 2024-09-21T03:18:34.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.724+0000 7f0e64a00640 1 -- 172.21.15.90:0/714466681 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e600bfcf0 con 0x7f0e6006ddf0 2024-09-21T03:18:34.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.724+0000 7f0e56a00640 1 -- 172.21.15.90:0/714466681 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c010670 con 0x7f0e6006ddf0 2024-09-21T03:18:34.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.724+0000 7f0e64a00640 1 -- 172.21.15.90:0/714466681 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e601ed7a0 con 0x7f0e6006ddf0 2024-09-21T03:18:34.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.725+0000 7f0e64a00640 1 --2- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e6015a100 0x7f0e601514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.725+0000 7f0e64a00640 1 -- 172.21.15.90:0/714466681 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0e600c7660 con 0x7f0e6015a100 2024-09-21T03:18:34.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.725+0000 7f0e5e800640 1 --2- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e6015a100 0x7f0e601514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.726+0000 7f0e5e800640 1 -- 172.21.15.90:0/714466681 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e60154f10 con 0x7f0e6015a100 2024-09-21T03:18:34.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.726+0000 7f0e5e800640 1 --2- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e6015a100 0x7f0e601514a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0e50011a10 tx=0x7f0e50011ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:34.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.726+0000 7f0e56a00640 1 -- 172.21.15.90:0/714466681 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5000fa10 con 0x7f0e6015a100 2024-09-21T03:18:34.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.726+0000 7f0e56a00640 1 -- 172.21.15.90:0/714466681 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0e5000fbb0 con 0x7f0e6015a100 2024-09-21T03:18:34.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.726+0000 7f0e56a00640 1 -- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e6015a100 msgr2=0x7f0e601514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.726+0000 7f0e56a00640 1 --2- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e6015a100 0x7f0e601514a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0e50011a10 tx=0x7f0e50011ed0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.726+0000 7f0e56a00640 1 -- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e6015a100 msgr2=0x7f0e601514a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:18:34.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.726+0000 7f0e56a00640 1 --2- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e6015a100 0x7f0e601514a0 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0e50011a10 tx=0x7f0e50011ed0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.727+0000 7f0e56a00640 1 -- 172.21.15.90:0/714466681 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0e4c010810 con 0x7f0e6006ddf0 2024-09-21T03:18:34.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.728+0000 7f0e56a00640 1 --2- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0e40078600 0x7f0e4007ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.728+0000 7f0e56a00640 1 -- 172.21.15.90:0/714466681 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f0e4c09ba50 con 0x7f0e6006ddf0 2024-09-21T03:18:34.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.728+0000 7f0e5e800640 1 --2- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0e40078600 0x7f0e4007ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.729+0000 7f0e5e800640 1 --2- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0e40078600 0x7f0e4007ab10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000a010 tx=0x7f0e50015000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:34.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.733+0000 7f0e64a00640 1 --2- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e601e2db0 0x7f0e601519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.733+0000 7f0e64a00640 1 -- 172.21.15.90:0/714466681 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0e600c1270 con 0x7f0e601e2db0 2024-09-21T03:18:34.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.734+0000 7f0e5f200640 1 --2- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e601e2db0 0x7f0e601519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.735+0000 7f0e5f200640 1 -- 172.21.15.90:0/714466681 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0e6006cde0 con 0x7f0e601e2db0 2024-09-21T03:18:34.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.735+0000 7f0e5f200640 1 --2- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e601e2db0 0x7f0e601519e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0e600c6820 tx=0x7f0e58003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:34.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.736+0000 7f0e56a00640 1 -- 172.21.15.90:0/714466681 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e58034040 con 0x7f0e601e2db0 2024-09-21T03:18:34.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.736+0000 7f0e56a00640 1 -- 172.21.15.90:0/714466681 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4549 (secure 0 0 0) 0x7f0e58030680 con 0x7f0e601e2db0 2024-09-21T03:18:34.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.736+0000 7f0e56a00640 1 -- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e601e2db0 msgr2=0x7f0e601519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.736+0000 7f0e56a00640 1 --2- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e601e2db0 0x7f0e601519e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0e600c6820 tx=0x7f0e58003ba0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.736+0000 7f0e56a00640 1 -- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e601e2db0 msgr2=0x7f0e601519e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:18:34.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.736+0000 7f0e56a00640 1 --2- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e601e2db0 0x7f0e601519e0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0e600c6820 tx=0x7f0e58003ba0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.739 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:18:34.739 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:18:34.739 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:18:34.739 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:18:34.739 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 28, 2024-09-21T03:18:34.739 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 30202, 2024-09-21T03:18:34.739 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:18:34.740 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:18:34.740 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:18:34.740 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:18:34.740 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:34.740 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 16, 2024-09-21T03:18:34.740 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:18:34.740 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:18:34.740 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:18:34.740 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:34.740 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:34.740 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:34.740 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:34.740 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:34.740 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:34.740 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:34.741 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:34.741 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:34.741 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:34.741 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:34.741 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:34.741 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:18:34.741 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:18:34.741 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:34.741 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:34.741 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:34.741 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:34.741 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:34.742 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:34.742 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:34.742 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:34.742 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:34.742 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:34.742 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:34.742 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:34.742 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.742 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:18:34.742 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:18:34.742 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:18:34.742 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:18:34.742 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:18:34.742 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:18:34.743 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:18:34.743 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:18:34.743 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:18:34.743 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:18:34.743 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:18:34.743 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:18:34.743 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:18:34.743 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:18:34.743 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:18:34.743 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:18:34.743 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:18:34.743 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:34.743 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:34.743 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:34.743 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:34.744 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:34.744 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:34.744 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:34.744 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:34.744 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:34.744 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:34.744 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:34.744 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:34.744 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:18:34.744 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.744 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:18:34.744 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.744 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:18:34.744 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:18:34.745 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:34.745 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:34.745 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.745 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:34.745 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:18:34.745 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:34.745 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.745 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.745 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:34.745 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:18:34.745 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:34.745 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.745 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:34.745 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.745 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:18:34.746 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:18:34.746 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:34.746 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:34.746 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:34.746 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.746 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.746 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:18:34.746 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:18:34.746 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:34.746 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:34.746 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.746 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:34.746 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:18:34.746 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:34.747 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.747 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.747 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:34.747 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:18:34.747 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:34.747 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.747 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:34.747 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.747 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:18:34.747 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:18:34.747 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:34.747 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:34.747 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:34.747 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.747 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.748 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:18:34.748 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:18:34.748 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:34.748 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:34.748 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.748 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:34.748 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:18:34.748 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:34.748 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.748 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.748 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:34.748 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:18:34.748 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:34.748 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.748 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:34.749 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.749 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:18:34.749 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:18:34.749 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:34.749 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:34.749 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:34.749 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.749 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:34.749 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.749 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:18:34.749 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:18:34.749 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.749 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:34.749 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:34.750 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:18:34.750 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.750 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:34.750 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:18:34.750 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:34.750 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:34.750 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:34.750 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:18:34.750 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:34.750 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:34.750 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:34.750 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:18:34.751 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:18:34.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.737+0000 7f0e64a00640 1 -- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0e40078600 msgr2=0x7f0e4007ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.737+0000 7f0e64a00640 1 --2- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0e40078600 0x7f0e4007ab10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000a010 tx=0x7f0e50015000 comp rx=0 tx=0).stop 2024-09-21T03:18:34.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.737+0000 7f0e64a00640 1 -- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e6006ddf0 msgr2=0x7f0e601e1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.737+0000 7f0e64a00640 1 --2- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e6006ddf0 0x7f0e601e1f60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00e740 tx=0x7f0e4c00ec00 comp rx=0 tx=0).stop 2024-09-21T03:18:34.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.737+0000 7f0e5f200640 1 -- 172.21.15.90:0/714466681 reap_dead start 2024-09-21T03:18:34.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.737+0000 7f0e64a00640 1 -- 172.21.15.90:0/714466681 shutdown_connections 2024-09-21T03:18:34.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.737+0000 7f0e64a00640 1 --2- 172.21.15.90:0/714466681 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e6006ddf0 0x7f0e601e1f60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.737+0000 7f0e64a00640 1 -- 172.21.15.90:0/714466681 >> 172.21.15.90:0/714466681 conn(0x7f0e600cc240 msgr2=0x7f0e601537d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:34.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.737+0000 7f0e64a00640 1 -- 172.21.15.90:0/714466681 shutdown_connections 2024-09-21T03:18:34.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:34.737+0000 7f0e64a00640 1 -- 172.21.15.90:0/714466681 wait complete. 2024-09-21T03:18:34.770 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:18:34.770 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-21T03:18:34.771 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2024-09-21T03:18:34.771 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-21T03:18:34.771 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-21T03:18:34.771 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-21T03:18:34.771 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:18:34.813 INFO:tasks.ceph.mon.a:Stopped 2024-09-21T03:18:34.813 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-09-21T03:18:34.813 INFO:tasks.ceph.mon.b:Sent signal 19 2024-09-21T03:18:34.813 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-21T03:18:49.814 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-09-21T03:18:49.814 INFO:tasks.ceph.mon.b:Sent signal 18 2024-09-21T03:18:49.815 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-21T03:18:49.815 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:18:54.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.842+0000 7f7fd6a00640 1 -- 172.21.15.90:0/529191664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fb8004800 msgr2=0x7f7fb8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:54.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.842+0000 7f7fd6a00640 1 --2- 172.21.15.90:0/529191664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fb8004800 0x7f7fb8004c10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc004690 tx=0x7f7fb8005830 comp rx=0 tx=0).stop 2024-09-21T03:18:54.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.842+0000 7f7fd6a00640 1 -- 172.21.15.90:0/529191664 shutdown_connections 2024-09-21T03:18:54.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.842+0000 7f7fd6a00640 1 --2- 172.21.15.90:0/529191664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fb80053a0 0x7f7fb800ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:54.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.842+0000 7f7fd6a00640 1 --2- 172.21.15.90:0/529191664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fb8004800 0x7f7fb8004c10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:54.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.842+0000 7f7fd6a00640 1 --2- 172.21.15.90:0/529191664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fb80039b0 0x7f7fb8003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:54.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.842+0000 7f7fd6a00640 1 -- 172.21.15.90:0/529191664 >> 172.21.15.90:0/529191664 conn(0x7f7fd00c84c0 msgr2=0x7f7fd00c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:54.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.842+0000 7f7fd6a00640 1 -- 172.21.15.90:0/529191664 shutdown_connections 2024-09-21T03:18:54.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.842+0000 7f7fd6a00640 1 -- 172.21.15.90:0/529191664 wait complete. 2024-09-21T03:18:54.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.844+0000 7f7fd6a00640 1 Processor -- start 2024-09-21T03:18:54.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.844+0000 7f7fd6a00640 1 -- start start 2024-09-21T03:18:54.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.846+0000 7f7fd6a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fb80039b0 0x7f7fd0153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:54.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.846+0000 7f7fd6a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fb8004800 0x7f7fd01f00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:54.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.846+0000 7f7fd6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fb80053a0 0x7f7fd0132920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:54.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.846+0000 7f7fd6a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd00ab1c0 con 0x7f7fb80039b0 2024-09-21T03:18:54.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.846+0000 7f7fd6a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd013da60 con 0x7f7fb80053a0 2024-09-21T03:18:54.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.846+0000 7f7fd6a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd00ab340 con 0x7f7fb8004800 2024-09-21T03:18:54.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.846+0000 7f7fd5600640 1 -- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fb80039b0 msgr2=0x7f7fd0153f70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.90:3300/0 2024-09-21T03:18:54.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.846+0000 7f7fd5600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fb80039b0 0x7f7fd0153f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:18:54.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.846+0000 7f7fd4c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fb8004800 0x7f7fd01f00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:54.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.846+0000 7f7fd4c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fb8004800 0x7f7fd01f00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:37798/0 (socket says 172.21.15.90:37798) 2024-09-21T03:18:54.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.846+0000 7f7fd4c00640 1 -- 172.21.15.90:0/2723943692 learned_addr learned my addr 172.21.15.90:0/2723943692 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:18:54.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.846+0000 7f7fd6000640 1 --2- 172.21.15.90:0/2723943692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fb80053a0 0x7f7fd0132920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:54.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.846+0000 7f7fd4c00640 1 -- 172.21.15.90:0/2723943692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fb80053a0 msgr2=0x7f7fd0132920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:54.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.846+0000 7f7fd4c00640 1 --2- 172.21.15.90:0/2723943692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fb80053a0 0x7f7fd0132920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:54.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.846+0000 7f7fd4c00640 1 -- 172.21.15.90:0/2723943692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fb80039b0 msgr2=0x7f7fd0153f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:18:54.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.846+0000 7f7fd4c00640 1 --2- 172.21.15.90:0/2723943692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fb80039b0 0x7f7fd0153f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:54.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.846+0000 7f7fd4c00640 1 -- 172.21.15.90:0/2723943692 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd01ecc20 con 0x7f7fb8004800 2024-09-21T03:18:54.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.847+0000 7f7fd4c00640 1 --2- 172.21.15.90:0/2723943692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fb8004800 0x7f7fd01f00f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc000c00 tx=0x7f7fbc00d5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:54.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.847+0000 7f7fcd600640 1 -- 172.21.15.90:0/2723943692 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc032040 con 0x7f7fb8004800 2024-09-21T03:18:54.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.847+0000 7f7fd6a00640 1 -- 172.21.15.90:0/2723943692 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd01ecf00 con 0x7f7fb8004800 2024-09-21T03:18:54.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.847+0000 7f7fd6a00640 1 -- 172.21.15.90:0/2723943692 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd01ed4c0 con 0x7f7fb8004800 2024-09-21T03:18:54.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.847+0000 7f7fcd600640 1 -- 172.21.15.90:0/2723943692 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fbc02c970 con 0x7f7fb8004800 2024-09-21T03:18:54.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.847+0000 7f7fcd600640 1 -- 172.21.15.90:0/2723943692 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc040810 con 0x7f7fb8004800 2024-09-21T03:18:54.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.848+0000 7f7fd6a00640 1 -- 172.21.15.90:0/2723943692 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fac005290 con 0x7f7fb8004800 2024-09-21T03:18:54.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.849+0000 7f7fcd600640 1 -- 172.21.15.90:0/2723943692 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7fbc0409b0 con 0x7f7fb8004800 2024-09-21T03:18:54.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.851+0000 7f7fcd600640 1 --2- 172.21.15.90:0/2723943692 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7fb0079100 0x7f7fb007b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:54.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.851+0000 7f7fcd600640 1 -- 172.21.15.90:0/2723943692 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f7fbc0bcf10 con 0x7f7fb8004800 2024-09-21T03:18:54.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.851+0000 7f7fd5600640 1 --2- 172.21.15.90:0/2723943692 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7fb0079100 0x7f7fb007b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:54.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.852+0000 7f7fd5600640 1 --2- 172.21.15.90:0/2723943692 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7fb0079100 0x7f7fb007b610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4005f10 tx=0x7f7fc4015040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:54.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:54.858+0000 7f7fcd600640 1 -- 172.21.15.90:0/2723943692 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7fbc04e070 con 0x7f7fb8004800 2024-09-21T03:18:55.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.133+0000 7f7fd6a00640 1 -- 172.21.15.90:0/2723943692 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7fac005580 con 0x7f7fb8004800 2024-09-21T03:18:55.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.134+0000 7f7fcd600640 1 -- 172.21.15.90:0/2723943692 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f7fbc084ef0 con 0x7f7fb8004800 2024-09-21T03:18:55.136 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":30,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:18:55.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.136+0000 7f7fd6a00640 1 -- 172.21.15.90:0/2723943692 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7fb0079100 msgr2=0x7f7fb007b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.136+0000 7f7fd6a00640 1 --2- 172.21.15.90:0/2723943692 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7fb0079100 0x7f7fb007b610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4005f10 tx=0x7f7fc4015040 comp rx=0 tx=0).stop 2024-09-21T03:18:55.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.136+0000 7f7fd6a00640 1 -- 172.21.15.90:0/2723943692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fb8004800 msgr2=0x7f7fd01f00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.136+0000 7f7fd6a00640 1 --2- 172.21.15.90:0/2723943692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fb8004800 0x7f7fd01f00f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc000c00 tx=0x7f7fbc00d5f0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.136+0000 7f7fd6a00640 1 -- 172.21.15.90:0/2723943692 shutdown_connections 2024-09-21T03:18:55.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.136+0000 7f7fd6a00640 1 --2- 172.21.15.90:0/2723943692 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7fb0079100 0x7f7fb007b610 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.136+0000 7f7fd6a00640 1 --2- 172.21.15.90:0/2723943692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fb80053a0 0x7f7fd0132920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.136+0000 7f7fd6a00640 1 --2- 172.21.15.90:0/2723943692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fb8004800 0x7f7fd01f00f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.136+0000 7f7fd6a00640 1 --2- 172.21.15.90:0/2723943692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fb80039b0 0x7f7fd0153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.136+0000 7f7fd6a00640 1 -- 172.21.15.90:0/2723943692 >> 172.21.15.90:0/2723943692 conn(0x7f7fd00c84c0 msgr2=0x7f7fd0137820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:55.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.137+0000 7f7fd6a00640 1 -- 172.21.15.90:0/2723943692 shutdown_connections 2024-09-21T03:18:55.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.137+0000 7f7fd6a00640 1 -- 172.21.15.90:0/2723943692 wait complete. 2024-09-21T03:18:55.161 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-21T03:18:55.161 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-21T03:18:55.161 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:18:55.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.394+0000 7f6318e00640 1 -- 172.21.15.90:0/2671578331 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6314156ad0 msgr2=0x7f6314156ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.394+0000 7f6318e00640 1 --2- 172.21.15.90:0/2671578331 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6314156ad0 0x7f6314156ee0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f63140c78d0 tx=0x7f630c02a7a0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.395+0000 7f6318e00640 1 -- 172.21.15.90:0/2671578331 shutdown_connections 2024-09-21T03:18:55.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.395+0000 7f6318e00640 1 --2- 172.21.15.90:0/2671578331 >> v2:172.21.15.90:3300/0 conn(0x7f63140c8c50 0x7f63140c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.395+0000 7f6318e00640 1 --2- 172.21.15.90:0/2671578331 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6314156ad0 0x7f6314156ee0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.395+0000 7f6318e00640 1 --2- 172.21.15.90:0/2671578331 >> v2:172.21.15.149:3300/0 conn(0x7f63140c7120 0x7f6314154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.395+0000 7f6318e00640 1 -- 172.21.15.90:0/2671578331 >> 172.21.15.90:0/2671578331 conn(0x7f63140cc270 msgr2=0x7f63140cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:55.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.395+0000 7f6318e00640 1 -- 172.21.15.90:0/2671578331 shutdown_connections 2024-09-21T03:18:55.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.395+0000 7f6318e00640 1 -- 172.21.15.90:0/2671578331 wait complete. 2024-09-21T03:18:55.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.398+0000 7f6318e00640 1 Processor -- start 2024-09-21T03:18:55.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.398+0000 7f6318e00640 1 -- start start 2024-09-21T03:18:55.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.399+0000 7f6318e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63140c7120 0x7f63140ac850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.399+0000 7f6318e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63140c8c50 0x7f63141e28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.399+0000 7f6318e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6314156ad0 0x7f63141e0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.399+0000 7f6318e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6314154680 con 0x7f63140c8c50 2024-09-21T03:18:55.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.399+0000 7f6318e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f63140cba00 con 0x7f6314156ad0 2024-09-21T03:18:55.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.399+0000 7f6318e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f63140c8840 con 0x7f63140c7120 2024-09-21T03:18:55.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.399+0000 7f6312a00640 1 -- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63140c8c50 msgr2=0x7f63141e28c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.90:3300/0 2024-09-21T03:18:55.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.400+0000 7f6312a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63140c8c50 0x7f63141e28c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:18:55.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.400+0000 7f6313400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63140c7120 0x7f63140ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.400+0000 7f6313e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6314156ad0 0x7f63141e0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.400+0000 7f6313400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63140c7120 0x7f63140ac850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:37830/0 (socket says 172.21.15.90:37830) 2024-09-21T03:18:55.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.400+0000 7f6313e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6314156ad0 0x7f63141e0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:48148/0 (socket says 172.21.15.90:48148) 2024-09-21T03:18:55.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.400+0000 7f6313400640 1 -- 172.21.15.90:0/3215341924 learned_addr learned my addr 172.21.15.90:0/3215341924 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:18:55.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.400+0000 7f6313400640 1 -- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6314156ad0 msgr2=0x7f63141e0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.400+0000 7f6313400640 1 --2- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6314156ad0 0x7f63141e0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.400+0000 7f6313400640 1 -- 172.21.15.90:0/3215341924 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63140c8c50 msgr2=0x7f63141e28c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:18:55.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.400+0000 7f6313400640 1 --2- 172.21.15.90:0/3215341924 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63140c8c50 0x7f63141e28c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.400+0000 7f6313400640 1 -- 172.21.15.90:0/3215341924 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63140abb80 con 0x7f63140c7120 2024-09-21T03:18:55.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.401+0000 7f6313400640 1 --2- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63140c7120 0x7f63140ac850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f630400e9f0 tx=0x7f630400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:55.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.401+0000 7f630b400640 1 -- 172.21.15.90:0/3215341924 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630400cd80 con 0x7f63140c7120 2024-09-21T03:18:55.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.401+0000 7f630b400640 1 -- 172.21.15.90:0/3215341924 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6304004020 con 0x7f63140c7120 2024-09-21T03:18:55.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.401+0000 7f6318e00640 1 -- 172.21.15.90:0/3215341924 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63141ed840 con 0x7f63140c7120 2024-09-21T03:18:55.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.401+0000 7f630b400640 1 -- 172.21.15.90:0/3215341924 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6304004450 con 0x7f63140c7120 2024-09-21T03:18:55.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.401+0000 7f6318e00640 1 -- 172.21.15.90:0/3215341924 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f63140ad230 con 0x7f63140c7120 2024-09-21T03:18:55.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.402+0000 7f6318e00640 1 --2- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63141e0940 0x7f63140ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.402+0000 7f6318e00640 1 -- 172.21.15.90:0/3215341924 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f63140ae750 con 0x7f63141e0940 2024-09-21T03:18:55.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.403+0000 7f6312a00640 1 --2- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63141e0940 0x7f63140ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.403+0000 7f6312a00640 1 -- 172.21.15.90:0/3215341924 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6314148a50 con 0x7f63141e0940 2024-09-21T03:18:55.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.403+0000 7f6312a00640 1 --2- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63141e0940 0x7f63140ada30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6314155de0 tx=0x7f630000b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:55.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.403+0000 7f630b400640 1 -- 172.21.15.90:0/3215341924 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f63040035f0 con 0x7f63140c7120 2024-09-21T03:18:55.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.404+0000 7f630b400640 1 --2- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f62f4078b40 0x7f62f407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.404+0000 7f630b400640 1 -- 172.21.15.90:0/3215341924 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f630409b910 con 0x7f63140c7120 2024-09-21T03:18:55.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.405+0000 7f630b400640 1 -- 172.21.15.90:0/3215341924 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300016070 con 0x7f63141e0940 2024-09-21T03:18:55.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.405+0000 7f6313e00640 1 --2- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f62f4078b40 0x7f62f407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.405+0000 7f630b400640 1 -- 172.21.15.90:0/3215341924 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6300003d70 con 0x7f63141e0940 2024-09-21T03:18:55.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.405+0000 7f630b400640 1 -- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63141e0940 msgr2=0x7f63140ada30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.405+0000 7f630b400640 1 --2- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63141e0940 0x7f63140ada30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6314155de0 tx=0x7f630000b870 comp rx=0 tx=0).stop 2024-09-21T03:18:55.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.405+0000 7f630b400640 1 -- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63141e0940 msgr2=0x7f63140ada30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:18:55.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.405+0000 7f630b400640 1 --2- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63141e0940 0x7f63140ada30 secure :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6314155de0 tx=0x7f630000b870 comp rx=0 tx=0).stop 2024-09-21T03:18:55.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.405+0000 7f6313e00640 1 --2- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f62f4078b40 0x7f62f407b050 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f630c033000 tx=0x7f630c004ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:55.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.411+0000 7f6318e00640 1 --2- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63140adf70 0x7f63141f0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.411+0000 7f6318e00640 1 -- 172.21.15.90:0/3215341924 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6314148800 con 0x7f63140adf70 2024-09-21T03:18:55.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.411+0000 7f6312a00640 1 --2- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63140adf70 0x7f63141f0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.412+0000 7f6312a00640 1 -- 172.21.15.90:0/3215341924 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f63140acd90 con 0x7f63140adf70 2024-09-21T03:18:55.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.412+0000 7f6312a00640 1 --2- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63140adf70 0x7f63141f0280 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f630000bd90 tx=0x7f6300005980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:55.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.412+0000 7f630b400640 1 -- 172.21.15.90:0/3215341924 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300016040 con 0x7f63140adf70 2024-09-21T03:18:55.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.413+0000 7f630b400640 1 -- 172.21.15.90:0/3215341924 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5184 (secure 0 0 0) 0x7f6300022420 con 0x7f63140adf70 2024-09-21T03:18:55.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.413+0000 7f630b400640 1 -- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63140adf70 msgr2=0x7f63141f0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.413+0000 7f630b400640 1 --2- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63140adf70 0x7f63141f0280 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f630000bd90 tx=0x7f6300005980 comp rx=0 tx=0).stop 2024-09-21T03:18:55.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.413+0000 7f630b400640 1 -- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63140adf70 msgr2=0x7f63141f0280 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:18:55.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.413+0000 7f630b400640 1 --2- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63140adf70 0x7f63141f0280 secure :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f630000bd90 tx=0x7f6300005980 comp rx=0 tx=0).stop 2024-09-21T03:18:55.415 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:18:55.415 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:18:55.415 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:18:55.415 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:18:55.416 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 30, 2024-09-21T03:18:55.416 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 286203, 2024-09-21T03:18:55.416 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:18:55.416 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:18:55.416 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:18:55.416 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:55.416 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 0, 2024-09-21T03:18:55.416 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:18:55.416 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:18:55.416 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:18:55.416 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:55.416 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:55.416 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:55.416 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:55.417 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:55.417 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:55.417 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:55.417 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:55.417 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:55.417 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:55.417 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:55.417 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:55.417 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:18:55.417 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:18:55.417 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:55.417 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:55.417 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:55.417 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:55.417 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:55.418 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:55.418 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:55.418 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:55.418 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:55.418 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:55.418 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:55.418 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:55.418 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.418 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:18:55.418 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:18:55.418 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:18:55.418 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:18:55.418 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:18:55.418 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:18:55.418 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:18:55.419 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:18:55.419 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:18:55.419 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:18:55.419 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:18:55.419 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:18:55.419 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:18:55.419 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:18:55.419 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:18:55.419 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:18:55.419 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:18:55.419 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:55.419 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:55.419 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:55.419 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:55.419 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:55.420 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:55.420 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:55.420 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:55.420 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:55.420 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:55.420 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:55.420 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:55.420 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:18:55.420 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.420 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:18:55.420 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.420 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:18:55.420 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:18:55.420 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:55.421 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:55.421 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.421 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:55.421 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:18:55.421 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:55.421 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.421 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.421 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:55.421 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:18:55.421 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:55.421 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:55.421 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:55.421 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.421 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:18:55.421 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:18:55.422 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:55.422 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:55.422 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:55.422 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.422 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.422 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:18:55.422 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:18:55.422 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:55.422 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:55.422 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.422 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:55.422 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:18:55.422 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:55.422 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.423 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.423 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:55.423 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:18:55.423 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:55.423 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:55.423 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:55.423 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.423 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:18:55.423 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:18:55.423 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:55.423 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:55.423 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:55.423 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.423 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.423 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:18:55.424 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:18:55.424 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:55.424 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:55.424 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.424 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:55.424 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:18:55.424 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:55.424 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.424 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.424 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:55.424 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:18:55.424 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:55.424 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:55.424 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:55.424 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.424 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:18:55.425 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:18:55.425 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:55.425 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:55.425 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:55.425 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:55.425 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:55.425 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.425 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:18:55.425 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:18:55.425 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.425 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:55.425 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:55.425 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:18:55.425 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:55.426 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:55.426 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:18:55.426 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.426 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:55.426 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:55.426 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:18:55.426 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:55.426 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:55.426 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:18:55.426 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.426 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:55.426 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:55.426 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:18:55.426 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:55.426 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:55.427 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:18:55.427 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.427 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:18:55.427 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:18:55.427 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:18:55.427 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.427 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.427 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:55.427 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:55.427 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5 2024-09-21T03:18:55.427 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:55.427 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:55.427 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:18:55.427 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.427 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:55.428 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:55.428 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:18:55.428 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:55.428 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:55.428 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.428 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:18:55.428 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:18:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.413+0000 7f6318e00640 1 -- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f62f4078b40 msgr2=0x7f62f407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.413+0000 7f6318e00640 1 --2- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f62f4078b40 0x7f62f407b050 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f630c033000 tx=0x7f630c004ab0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.413+0000 7f6318e00640 1 -- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63140c7120 msgr2=0x7f63140ac850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.413+0000 7f6318e00640 1 --2- 172.21.15.90:0/3215341924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63140c7120 0x7f63140ac850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f630400e9f0 tx=0x7f630400eeb0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.413+0000 7f6313e00640 1 -- 172.21.15.90:0/3215341924 reap_dead start 2024-09-21T03:18:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.413+0000 7f6313e00640 1 -- 172.21.15.90:0/3215341924 reap_dead start 2024-09-21T03:18:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.413+0000 7f6318e00640 1 -- 172.21.15.90:0/3215341924 shutdown_connections 2024-09-21T03:18:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.413+0000 7f6318e00640 1 -- 172.21.15.90:0/3215341924 >> 172.21.15.90:0/3215341924 conn(0x7f63140cc270 msgr2=0x7f63140cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.413+0000 7f6318e00640 1 -- 172.21.15.90:0/3215341924 shutdown_connections 2024-09-21T03:18:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.413+0000 7f6318e00640 1 -- 172.21.15.90:0/3215341924 wait complete. 2024-09-21T03:18:55.437 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-21T03:18:55.437 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-21T03:18:55.437 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:18:55.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.669+0000 7f2438a00640 1 -- 172.21.15.90:0/3691157251 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24180099b0 msgr2=0x7f241800bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.669+0000 7f2438a00640 1 --2- 172.21.15.90:0/3691157251 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24180099b0 0x7f241800bdd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f242c009f80 tx=0x7f2418005830 comp rx=0 tx=0).stop 2024-09-21T03:18:55.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.669+0000 7f2438a00640 1 -- 172.21.15.90:0/3691157251 shutdown_connections 2024-09-21T03:18:55.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.669+0000 7f2438a00640 1 --2- 172.21.15.90:0/3691157251 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24180099b0 0x7f241800bdd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.669+0000 7f2438a00640 1 -- 172.21.15.90:0/3691157251 >> 172.21.15.90:0/3691157251 conn(0x7f24340c85a0 msgr2=0x7f24340c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:55.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.670+0000 7f2438a00640 1 -- 172.21.15.90:0/3691157251 shutdown_connections 2024-09-21T03:18:55.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.670+0000 7f2438a00640 1 -- 172.21.15.90:0/3691157251 wait complete. 2024-09-21T03:18:55.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.673+0000 7f2438a00640 1 Processor -- start 2024-09-21T03:18:55.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.673+0000 7f2438a00640 1 -- start start 2024-09-21T03:18:55.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.675+0000 7f2438a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24180099b0 0x7f24341ebe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.676+0000 7f2438a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f243414d630 0x7f2434147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.676+0000 7f2438a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24340763d0 0x7f24340767e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.676+0000 7f2438a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2434073df0 con 0x7f24180099b0 2024-09-21T03:18:55.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.676+0000 7f2438a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f24340749b0 con 0x7f24340763d0 2024-09-21T03:18:55.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.676+0000 7f2438a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f24340add50 con 0x7f243414d630 2024-09-21T03:18:55.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.676+0000 7f2431e00640 1 -- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24180099b0 msgr2=0x7f24341ebe10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.90:3300/0 2024-09-21T03:18:55.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.676+0000 7f2431e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24180099b0 0x7f24341ebe10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:18:55.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.676+0000 7f2431400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f243414d630 0x7f2434147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.676+0000 7f2432800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24340763d0 0x7f24340767e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.676+0000 7f2431400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f243414d630 0x7f2434147590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:37840/0 (socket says 172.21.15.90:37840) 2024-09-21T03:18:55.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.676+0000 7f2431400640 1 -- 172.21.15.90:0/3441835585 learned_addr learned my addr 172.21.15.90:0/3441835585 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:18:55.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.677+0000 7f2431400640 1 -- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24340763d0 msgr2=0x7f24340767e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.677+0000 7f2431400640 1 --2- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24340763d0 0x7f24340767e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.677+0000 7f2431400640 1 -- 172.21.15.90:0/3441835585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24180099b0 msgr2=0x7f24341ebe10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:18:55.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.677+0000 7f2431400640 1 --2- 172.21.15.90:0/3441835585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24180099b0 0x7f24341ebe10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.677+0000 7f2431400640 1 -- 172.21.15.90:0/3441835585 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24341ec350 con 0x7f243414d630 2024-09-21T03:18:55.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.677+0000 7f2431400640 1 --2- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f243414d630 0x7f2434147590 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f242000e720 tx=0x7f242000ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:55.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.677+0000 7f242a000640 1 -- 172.21.15.90:0/3441835585 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242000ca50 con 0x7f243414d630 2024-09-21T03:18:55.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.677+0000 7f242a000640 1 -- 172.21.15.90:0/3441835585 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f242000cbf0 con 0x7f243414d630 2024-09-21T03:18:55.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.677+0000 7f2438a00640 1 -- 172.21.15.90:0/3441835585 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24341480d0 con 0x7f243414d630 2024-09-21T03:18:55.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.677+0000 7f242a000640 1 -- 172.21.15.90:0/3441835585 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2420010430 con 0x7f243414d630 2024-09-21T03:18:55.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.677+0000 7f2438a00640 1 -- 172.21.15.90:0/3441835585 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f24341e0b00 con 0x7f243414d630 2024-09-21T03:18:55.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.679+0000 7f2438a00640 1 --2- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f243414c5d0 0x7f24341edf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.679+0000 7f2438a00640 1 -- 172.21.15.90:0/3441835585 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f24341e0630 con 0x7f243414c5d0 2024-09-21T03:18:55.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.679+0000 7f2431e00640 1 --2- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f243414c5d0 0x7f24341edf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.680+0000 7f2431e00640 1 -- 172.21.15.90:0/3441835585 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f24340ae2b0 con 0x7f243414c5d0 2024-09-21T03:18:55.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.680+0000 7f2431e00640 1 --2- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f243414c5d0 0x7f24341edf10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2424003660 tx=0x7f242400c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:55.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.680+0000 7f242a000640 1 -- 172.21.15.90:0/3441835585 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2424004cb0 con 0x7f243414c5d0 2024-09-21T03:18:55.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.681+0000 7f242a000640 1 -- 172.21.15.90:0/3441835585 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2424004e50 con 0x7f243414c5d0 2024-09-21T03:18:55.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.681+0000 7f242a000640 1 -- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f243414c5d0 msgr2=0x7f24341edf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.681+0000 7f242a000640 1 --2- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f243414c5d0 0x7f24341edf10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2424003660 tx=0x7f242400c8e0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.681+0000 7f242a000640 1 -- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f243414c5d0 msgr2=0x7f24341edf10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:18:55.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.681+0000 7f242a000640 1 --2- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f243414c5d0 0x7f24341edf10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.681+0000 7f242a000640 1 -- 172.21.15.90:0/3441835585 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f242001f020 con 0x7f243414d630 2024-09-21T03:18:55.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.682+0000 7f242a000640 1 --2- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f24140785d0 0x7f241407aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.682+0000 7f242a000640 1 -- 172.21.15.90:0/3441835585 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f242009b730 con 0x7f243414d630 2024-09-21T03:18:55.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.682+0000 7f2431e00640 1 --2- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f24140785d0 0x7f241407aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.683+0000 7f2431e00640 1 --2- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f24140785d0 0x7f241407aae0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2424003660 tx=0x7f2424009070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:55.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.687+0000 7f2438a00640 1 --2- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24341ee450 0x7f24341ee860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.687+0000 7f2438a00640 1 -- 172.21.15.90:0/3441835585 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f24341eeda0 con 0x7f24341ee450 2024-09-21T03:18:55.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.688+0000 7f2432800640 1 --2- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24341ee450 0x7f24341ee860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.688+0000 7f2432800640 1 -- 172.21.15.90:0/3441835585 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2434155de0 con 0x7f24341ee450 2024-09-21T03:18:55.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.688+0000 7f2432800640 1 --2- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24341ee450 0x7f24341ee860 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f243414df60 tx=0x7f242c031e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:55.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.689+0000 7f242a000640 1 -- 172.21.15.90:0/3441835585 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c0094a0 con 0x7f24341ee450 2024-09-21T03:18:55.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.689+0000 7f242a000640 1 -- 172.21.15.90:0/3441835585 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4871 (secure 0 0 0) 0x7f242c044620 con 0x7f24341ee450 2024-09-21T03:18:55.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.689+0000 7f242a000640 1 -- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24341ee450 msgr2=0x7f24341ee860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.689+0000 7f242a000640 1 --2- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24341ee450 0x7f24341ee860 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f243414df60 tx=0x7f242c031e90 comp rx=0 tx=0).stop 2024-09-21T03:18:55.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.689+0000 7f242a000640 1 -- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24341ee450 msgr2=0x7f24341ee860 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:18:55.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.689+0000 7f242a000640 1 --2- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24341ee450 0x7f24341ee860 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.691 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:18:55.692 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:18:55.692 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:18:55.692 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:18:55.692 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 30, 2024-09-21T03:18:55.692 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 51155, 2024-09-21T03:18:55.692 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:18:55.692 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:18:55.692 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:18:55.692 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:55.692 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 0, 2024-09-21T03:18:55.692 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:18:55.692 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:18:55.692 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:18:55.692 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:55.693 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:55.693 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:55.693 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:55.693 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:55.693 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:55.693 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:55.693 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:55.693 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:55.693 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:55.693 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:55.693 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:55.693 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:18:55.693 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:18:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:18:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:18:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:18:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:18:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:18:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:18:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:18:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:18:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:18:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:18:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:18:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:18:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:18:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:18:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:18:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:18:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:18:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:18:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:18:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:18:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:18:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:18:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:18:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:18:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:18:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:18:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:18:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:18:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:18:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:18:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:18:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:18:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:18:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:18:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:18:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:18:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:18:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:18:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:18:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:18:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:18:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:18:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:18:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:18:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:18:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:18:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:18:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:18:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:18:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:18:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:18:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:18:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:18:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:18:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:18:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:18:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:18:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:18:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:18:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:18:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:18:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:18:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:18:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:18:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:18:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:18:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:18:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:18:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:18:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:18:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:18:55.705 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:18:55.705 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:18:55.705 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:18:55.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.689+0000 7f2438a00640 1 -- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f24140785d0 msgr2=0x7f241407aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.689+0000 7f2438a00640 1 --2- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f24140785d0 0x7f241407aae0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2424003660 tx=0x7f2424009070 comp rx=0 tx=0).stop 2024-09-21T03:18:55.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.689+0000 7f2438a00640 1 -- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f243414d630 msgr2=0x7f2434147590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.689+0000 7f2438a00640 1 --2- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f243414d630 0x7f2434147590 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f242000e720 tx=0x7f242000ebe0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.689+0000 7f2432800640 1 -- 172.21.15.90:0/3441835585 reap_dead start 2024-09-21T03:18:55.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.690+0000 7f2438a00640 1 -- 172.21.15.90:0/3441835585 shutdown_connections 2024-09-21T03:18:55.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.690+0000 7f2438a00640 1 --2- 172.21.15.90:0/3441835585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f243414d630 0x7f2434147590 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.690+0000 7f2438a00640 1 -- 172.21.15.90:0/3441835585 >> 172.21.15.90:0/3441835585 conn(0x7f24340c85a0 msgr2=0x7f243414ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:55.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.690+0000 7f2438a00640 1 -- 172.21.15.90:0/3441835585 shutdown_connections 2024-09-21T03:18:55.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:18:55.690+0000 7f2438a00640 1 -- 172.21.15.90:0/3441835585 wait complete. 2024-09-21T03:18:55.716 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-21T03:18:55.716 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-21T03:18:58.823 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:18:58.827 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:19:15.716 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-21T03:19:15.717 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-21T03:19:15.717 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-21T03:19:15.728 INFO:tasks.ceph.mon.a:Started 2024-09-21T03:19:15.728 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-09-21T03:19:15.729 INFO:tasks.ceph.mon.b:Sent signal 19 2024-09-21T03:19:15.729 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-21T03:19:29.088 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:19:29.096 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:19:30.729 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-09-21T03:19:30.730 INFO:tasks.ceph.mon.b:Sent signal 18 2024-09-21T03:19:30.730 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-21T03:19:30.730 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:19:31.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.297+0000 7fd2fbe00640 1 -- 172.21.15.90:0/3979825062 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4033020 con 0x7fd2fc153010 2024-09-21T03:19:31.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.298+0000 7fd301600640 1 -- 172.21.15.90:0/3979825062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc153010 msgr2=0x7fd2fc156890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:31.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.298+0000 7fd301600640 1 --2- 172.21.15.90:0/3979825062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc153010 0x7fd2fc156890 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400ac50 tx=0x7fd2f402aaa0 comp rx=0 tx=0).stop 2024-09-21T03:19:31.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.298+0000 7fd301600640 1 -- 172.21.15.90:0/3979825062 shutdown_connections 2024-09-21T03:19:31.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.298+0000 7fd301600640 1 --2- 172.21.15.90:0/3979825062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc153010 0x7fd2fc156890 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:31.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.299+0000 7fd301600640 1 -- 172.21.15.90:0/3979825062 >> 172.21.15.90:0/3979825062 conn(0x7fd2fc06ead0 msgr2=0x7fd2fc06eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:31.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.299+0000 7fd301600640 1 -- 172.21.15.90:0/3979825062 shutdown_connections 2024-09-21T03:19:31.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.299+0000 7fd301600640 1 -- 172.21.15.90:0/3979825062 wait complete. 2024-09-21T03:19:31.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.306+0000 7fd301600640 1 Processor -- start 2024-09-21T03:19:31.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.306+0000 7fd301600640 1 -- start start 2024-09-21T03:19:31.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.309+0000 7fd301600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc0ad470 0x7fd2fc14ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:31.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.310+0000 7fd301600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2fc152c00 0x7fd2fc1f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:31.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.310+0000 7fd2fa000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc0ad470 0x7fd2fc14ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:31.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.310+0000 7fd2fa000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc0ad470 0x7fd2fc14ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:53098/0 (socket says 172.21.15.90:53098) 2024-09-21T03:19:31.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.310+0000 7fd2fa000640 1 -- 172.21.15.90:0/2545013429 learned_addr learned my addr 172.21.15.90:0/2545013429 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:19:31.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.310+0000 7fd301600640 1 --2- 172.21.15.90:0/2545013429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2fc153010 0x7fd2fc147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:31.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.310+0000 7fd2f9600640 1 --2- 172.21.15.90:0/2545013429 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2fc152c00 0x7fd2fc1f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:31.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.310+0000 7fd301600640 1 -- 172.21.15.90:0/2545013429 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd2fc0c2d40 con 0x7fd2fc153010 2024-09-21T03:19:31.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.311+0000 7fd301600640 1 -- 172.21.15.90:0/2545013429 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd2fc0acf00 con 0x7fd2fc0ad470 2024-09-21T03:19:31.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.311+0000 7fd301600640 1 -- 172.21.15.90:0/2545013429 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd2fc0c2ec0 con 0x7fd2fc152c00 2024-09-21T03:19:31.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.312+0000 7fd2faa00640 1 --2- 172.21.15.90:0/2545013429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2fc153010 0x7fd2fc147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:31.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.314+0000 7fd2faa00640 1 -- 172.21.15.90:0/2545013429 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2fc152c00 msgr2=0x7fd2fc1f4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:31.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.315+0000 7fd2faa00640 1 --2- 172.21.15.90:0/2545013429 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2fc152c00 0x7fd2fc1f4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:31.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.315+0000 7fd2faa00640 1 -- 172.21.15.90:0/2545013429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc0ad470 msgr2=0x7fd2fc14ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:31.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.315+0000 7fd2faa00640 1 --2- 172.21.15.90:0/2545013429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc0ad470 0x7fd2fc14ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:31.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.315+0000 7fd2faa00640 1 -- 172.21.15.90:0/2545013429 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2fc14ba80 con 0x7fd2fc153010 2024-09-21T03:19:31.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.315+0000 7fd2fa000640 1 --2- 172.21.15.90:0/2545013429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc0ad470 0x7fd2fc14ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:19:31.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.315+0000 7fd2f9600640 1 --2- 172.21.15.90:0/2545013429 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2fc152c00 0x7fd2fc1f4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:19:31.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.317+0000 7fd2faa00640 1 --2- 172.21.15.90:0/2545013429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2fc153010 0x7fd2fc147f50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0abbe0 tx=0x7fd2f4039dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:31.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.318+0000 7fd2f2a00640 1 -- 172.21.15.90:0/2545013429 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4033070 con 0x7fd2fc153010 2024-09-21T03:19:31.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.318+0000 7fd301600640 1 -- 172.21.15.90:0/2545013429 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2fc148ba0 con 0x7fd2fc153010 2024-09-21T03:19:31.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.318+0000 7fd2f2a00640 1 -- 172.21.15.90:0/2545013429 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2f40375c0 con 0x7fd2fc153010 2024-09-21T03:19:31.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.318+0000 7fd2f2a00640 1 -- 172.21.15.90:0/2545013429 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4033070 con 0x7fd2fc153010 2024-09-21T03:19:31.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.324+0000 7fd301600640 1 -- 172.21.15.90:0/2545013429 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2fc1f5150 con 0x7fd2fc153010 2024-09-21T03:19:31.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.328+0000 7fd2e7e00640 1 -- 172.21.15.90:0/2545013429 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2fc0c4120 con 0x7fd2fc153010 2024-09-21T03:19:31.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.333+0000 7fd2f2a00640 1 -- 172.21.15.90:0/2545013429 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd2f4036020 con 0x7fd2fc153010 2024-09-21T03:19:31.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.342+0000 7fd2f2a00640 1 --2- 172.21.15.90:0/2545013429 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd2dc078dc0 0x7fd2dc07b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:31.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.342+0000 7fd2f2a00640 1 -- 172.21.15.90:0/2545013429 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fd2f40bb1b0 con 0x7fd2fc153010 2024-09-21T03:19:31.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.348+0000 7fd2f2a00640 1 -- 172.21.15.90:0/2545013429 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd2f403e070 con 0x7fd2fc153010 2024-09-21T03:19:31.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.349+0000 7fd2fa000640 1 --2- 172.21.15.90:0/2545013429 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd2dc078dc0 0x7fd2dc07b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:31.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:31.351+0000 7fd2fa000640 1 --2- 172.21.15.90:0/2545013429 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd2dc078dc0 0x7fd2dc07b2d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec001400 tx=0x7fd2ec004640 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:32.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.034+0000 7fd2e7e00640 1 -- 172.21.15.90:0/2545013429 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd2fc0c3d20 con 0x7fd2fc153010 2024-09-21T03:19:32.038 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:19:32.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.036+0000 7fd2f2a00640 1 -- 172.21.15.90:0/2545013429 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7fd2f4083230 con 0x7fd2fc153010 2024-09-21T03:19:32.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.040+0000 7fd2e7e00640 1 -- 172.21.15.90:0/2545013429 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd2dc078dc0 msgr2=0x7fd2dc07b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:32.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.040+0000 7fd2e7e00640 1 --2- 172.21.15.90:0/2545013429 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd2dc078dc0 0x7fd2dc07b2d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec001400 tx=0x7fd2ec004640 comp rx=0 tx=0).stop 2024-09-21T03:19:32.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.041+0000 7fd2e7e00640 1 -- 172.21.15.90:0/2545013429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2fc153010 msgr2=0x7fd2fc147f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:32.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.041+0000 7fd2e7e00640 1 --2- 172.21.15.90:0/2545013429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2fc153010 0x7fd2fc147f50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0abbe0 tx=0x7fd2f4039dc0 comp rx=0 tx=0).stop 2024-09-21T03:19:32.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.041+0000 7fd2e7e00640 1 -- 172.21.15.90:0/2545013429 shutdown_connections 2024-09-21T03:19:32.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.041+0000 7fd2e7e00640 1 --2- 172.21.15.90:0/2545013429 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd2dc078dc0 0x7fd2dc07b2d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:32.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.041+0000 7fd2e7e00640 1 --2- 172.21.15.90:0/2545013429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2fc153010 0x7fd2fc147f50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:32.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.041+0000 7fd2e7e00640 1 --2- 172.21.15.90:0/2545013429 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2fc152c00 0x7fd2fc1f4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:32.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.041+0000 7fd2e7e00640 1 --2- 172.21.15.90:0/2545013429 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc0ad470 0x7fd2fc14ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:32.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.041+0000 7fd2e7e00640 1 -- 172.21.15.90:0/2545013429 >> 172.21.15.90:0/2545013429 conn(0x7fd2fc06ead0 msgr2=0x7fd2fc0c6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:32.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.042+0000 7fd2e7e00640 1 -- 172.21.15.90:0/2545013429 shutdown_connections 2024-09-21T03:19:32.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.042+0000 7fd2e7e00640 1 -- 172.21.15.90:0/2545013429 wait complete. 2024-09-21T03:19:32.095 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-21T03:19:32.095 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-21T03:19:32.096 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:19:32.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.567+0000 7efdd2800640 1 -- 172.21.15.90:0/2974024028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc40dd7c0 msgr2=0x7efdc40ddbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:32.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.568+0000 7efdd2800640 1 --2- 172.21.15.90:0/2974024028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc40dd7c0 0x7efdc40ddbd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efdcc06b310 tx=0x7efdcc0a7790 comp rx=0 tx=0).stop 2024-09-21T03:19:32.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.570+0000 7efdd2800640 1 -- 172.21.15.90:0/2974024028 shutdown_connections 2024-09-21T03:19:32.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.570+0000 7efdd2800640 1 --2- 172.21.15.90:0/2974024028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc40dd7c0 0x7efdc40ddbd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:32.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.570+0000 7efdd2800640 1 --2- 172.21.15.90:0/2974024028 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdc4006f40 0x7efdc4007350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:32.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.570+0000 7efdd2800640 1 --2- 172.21.15.90:0/2974024028 >> v2:172.21.15.149:3300/0 conn(0x7efdc40d7a80 0x7efdc404ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:32.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.570+0000 7efdd2800640 1 -- 172.21.15.90:0/2974024028 >> 172.21.15.90:0/2974024028 conn(0x7efdc40312e0 msgr2=0x7efdc40316f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:32.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.571+0000 7efdd2800640 1 -- 172.21.15.90:0/2974024028 shutdown_connections 2024-09-21T03:19:32.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.571+0000 7efdd2800640 1 -- 172.21.15.90:0/2974024028 wait complete. 2024-09-21T03:19:32.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.574+0000 7efdd2800640 1 Processor -- start 2024-09-21T03:19:32.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.577+0000 7efdd2800640 1 -- start start 2024-09-21T03:19:32.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.587+0000 7efdd2800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdc4006f40 0x7efdc40dcc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:32.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.587+0000 7efdd2800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdc40d7a80 0x7efdc417e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:32.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.587+0000 7efdd2800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc40dd7c0 0x7efdc40d65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:32.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.587+0000 7efdd2800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efdc404e480 con 0x7efdc40dd7c0 2024-09-21T03:19:32.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.587+0000 7efdd2800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efdc404e300 con 0x7efdc4006f40 2024-09-21T03:19:32.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.587+0000 7efdd2800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efdc40de110 con 0x7efdc40d7a80 2024-09-21T03:19:32.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.588+0000 7efdd1400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdc4006f40 0x7efdc40dcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:32.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.588+0000 7efdd1400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdc4006f40 0x7efdc40dcc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:53106/0 (socket says 172.21.15.90:53106) 2024-09-21T03:19:32.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.588+0000 7efdd1400640 1 -- 172.21.15.90:0/2966748399 learned_addr learned my addr 172.21.15.90:0/2966748399 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:19:32.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.588+0000 7efdd0a00640 1 --2- 172.21.15.90:0/2966748399 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdc40d7a80 0x7efdc417e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:32.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.589+0000 7efdd1400640 1 -- 172.21.15.90:0/2966748399 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdc40d7a80 msgr2=0x7efdc417e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:32.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.589+0000 7efdd1400640 1 --2- 172.21.15.90:0/2966748399 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdc40d7a80 0x7efdc417e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:32.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.589+0000 7efdd1400640 1 -- 172.21.15.90:0/2966748399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc40dd7c0 msgr2=0x7efdc40d65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:32.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.589+0000 7efdd1400640 1 --2- 172.21.15.90:0/2966748399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc40dd7c0 0x7efdc40d65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:32.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.589+0000 7efdd1400640 1 -- 172.21.15.90:0/2966748399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc40da070 con 0x7efdc4006f40 2024-09-21T03:19:32.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.590+0000 7efdd1400640 1 --2- 172.21.15.90:0/2966748399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdc4006f40 0x7efdc40dcc20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efdc000d770 tx=0x7efdc000dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:32.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.591+0000 7efdc9600640 1 -- 172.21.15.90:0/2966748399 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc0017070 con 0x7efdc4006f40 2024-09-21T03:19:32.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.591+0000 7efdc9600640 1 -- 172.21.15.90:0/2966748399 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdc0009d20 con 0x7efdc4006f40 2024-09-21T03:19:32.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.591+0000 7efdc9600640 1 -- 172.21.15.90:0/2966748399 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc0004280 con 0x7efdc4006f40 2024-09-21T03:19:32.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.594+0000 7efdd2800640 1 -- 172.21.15.90:0/2966748399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc40da350 con 0x7efdc4006f40 2024-09-21T03:19:32.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.594+0000 7efdd2800640 1 -- 172.21.15.90:0/2966748399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc417db30 con 0x7efdc4006f40 2024-09-21T03:19:32.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.596+0000 7efdd2800640 1 --2- 172.21.15.90:0/2966748399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc40d8c50 0x7efdc4034440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:32.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.596+0000 7efdd2800640 1 -- 172.21.15.90:0/2966748399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efdc4174ad0 con 0x7efdc40d8c50 2024-09-21T03:19:32.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.597+0000 7efdd0a00640 1 --2- 172.21.15.90:0/2966748399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc40d8c50 0x7efdc4034440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:32.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.599+0000 7efdd0a00640 1 -- 172.21.15.90:0/2966748399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efdc40d9060 con 0x7efdc40d8c50 2024-09-21T03:19:32.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.600+0000 7efdd0a00640 1 --2- 172.21.15.90:0/2966748399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc40d8c50 0x7efdc4034440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efdb8005fd0 tx=0x7efdb8010bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:32.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.600+0000 7efdc9600640 1 -- 172.21.15.90:0/2966748399 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb800edb0 con 0x7efdc40d8c50 2024-09-21T03:19:32.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.603+0000 7efdc9600640 1 -- 172.21.15.90:0/2966748399 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7efdb8011440 con 0x7efdc40d8c50 2024-09-21T03:19:32.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.603+0000 7efdc9600640 1 -- 172.21.15.90:0/2966748399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc40d8c50 msgr2=0x7efdc4034440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:32.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.603+0000 7efdc9600640 1 --2- 172.21.15.90:0/2966748399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc40d8c50 0x7efdc4034440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efdb8005fd0 tx=0x7efdb8010bf0 comp rx=0 tx=0).stop 2024-09-21T03:19:32.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.603+0000 7efdc9600640 1 -- 172.21.15.90:0/2966748399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc40d8c50 msgr2=0x7efdc4034440 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:19:32.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.603+0000 7efdc9600640 1 --2- 172.21.15.90:0/2966748399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc40d8c50 0x7efdc4034440 secure :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efdb8005fd0 tx=0x7efdb8010bf0 comp rx=0 tx=0).stop 2024-09-21T03:19:32.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.613+0000 7efdc9600640 1 -- 172.21.15.90:0/2966748399 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efdc0005020 con 0x7efdc4006f40 2024-09-21T03:19:32.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.628+0000 7efdc9600640 1 --2- 172.21.15.90:0/2966748399 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efdac078810 0x7efdac07ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:32.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.628+0000 7efdc9600640 1 -- 172.21.15.90:0/2966748399 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7efdc009b470 con 0x7efdc4006f40 2024-09-21T03:19:32.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.629+0000 7efdd0a00640 1 --2- 172.21.15.90:0/2966748399 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efdac078810 0x7efdac07ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:32.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.631+0000 7efdd0a00640 1 --2- 172.21.15.90:0/2966748399 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efdac078810 0x7efdac07ad20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efdb800e7c0 tx=0x7efdb801e040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:32.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.637+0000 7efdd2800640 1 --2- 172.21.15.90:0/2966748399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc4034980 0x7efdc4034d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:32.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.637+0000 7efdd2800640 1 -- 172.21.15.90:0/2966748399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efdc4049af0 con 0x7efdc4034980 2024-09-21T03:19:32.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.638+0000 7efdd1e00640 1 --2- 172.21.15.90:0/2966748399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc4034980 0x7efdc4034d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:32.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.642+0000 7efdd1e00640 1 -- 172.21.15.90:0/2966748399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efdc40d72a0 con 0x7efdc4034980 2024-09-21T03:19:32.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.643+0000 7efdd1e00640 1 --2- 172.21.15.90:0/2966748399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc4034980 0x7efdc4034d90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efdcc06ae60 tx=0x7efdcc0ae5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:32.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.645+0000 7efdc9600640 1 -- 172.21.15.90:0/2966748399 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc0bc030 con 0x7efdc4034980 2024-09-21T03:19:32.648 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:19:32.648 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:19:32.648 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:19:32.648 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:19:32.648 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 36, 2024-09-21T03:19:32.648 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 16417, 2024-09-21T03:19:32.648 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:19:32.648 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:19:32.648 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:19:32.648 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:19:32.648 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:32.649 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 1, 2024-09-21T03:19:32.649 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:19:32.649 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:19:32.649 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:19:32.649 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:19:32.649 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:19:32.649 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:19:32.649 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:19:32.649 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:19:32.649 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:19:32.649 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:19:32.649 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:19:32.649 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:19:32.649 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:19:32.650 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:19:32.650 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:32.650 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:19:32.650 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:19:32.650 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:19:32.650 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:19:32.650 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:19:32.650 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:19:32.650 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:19:32.650 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:19:32.650 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:19:32.650 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:19:32.650 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:19:32.650 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:19:32.651 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:19:32.651 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:32.651 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:32.651 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:19:32.651 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:19:32.651 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:19:32.651 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:19:32.651 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:19:32.651 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:19:32.651 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:19:32.651 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:19:32.651 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:19:32.651 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:19:32.651 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:19:32.651 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:19:32.652 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:19:32.652 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:19:32.652 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:19:32.652 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:19:32.652 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:19:32.652 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:19:32.652 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:19:32.652 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:19:32.652 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:19:32.652 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:19:32.652 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:19:32.652 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:19:32.652 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:19:32.652 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:19:32.652 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:19:32.653 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:19:32.653 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:32.653 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:19:32.653 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:32.653 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:19:32.653 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:32.653 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:19:32.653 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:19:32.653 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:19:32.653 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:19:32.653 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:32.653 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:19:32.653 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:19:32.653 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:32.653 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:32.654 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:32.654 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:19:32.654 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:19:32.654 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:32.654 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:32.654 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:32.654 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:32.654 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:19:32.654 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:19:32.654 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:19:32.654 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:19:32.654 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:19:32.654 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:32.654 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:32.655 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:19:32.655 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:19:32.655 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:19:32.655 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:19:32.655 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:32.655 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:19:32.655 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:19:32.655 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:32.655 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:32.655 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:32.655 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:19:32.655 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:19:32.655 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:32.655 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:32.655 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:32.656 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:32.656 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:19:32.656 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:19:32.656 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:19:32.656 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:19:32.656 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:19:32.656 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:32.656 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:32.656 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:19:32.656 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:19:32.656 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:19:32.656 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:19:32.656 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:32.656 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:19:32.656 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:19:32.657 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:32.657 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:32.657 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:32.657 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:19:32.657 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:19:32.657 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:32.657 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:32.657 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:32.657 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:32.657 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:19:32.657 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:19:32.657 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:19:32.657 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:19:32.657 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:19:32.657 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:32.658 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:32.658 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:32.658 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:19:32.658 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:19:32.658 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:32.658 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:32.658 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:32.658 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:19:32.658 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:32.658 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:32.658 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:19:32.658 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:32.658 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:32.658 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:32.658 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:19:32.658 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:32.659 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:32.659 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:32.659 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:19:32.659 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:19:32.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.646+0000 7efdc9600640 1 -- 172.21.15.90:0/2966748399 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4550 (secure 0 0 0) 0x7efdcc0af440 con 0x7efdc4034980 2024-09-21T03:19:32.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.646+0000 7efdc9600640 1 -- 172.21.15.90:0/2966748399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc4034980 msgr2=0x7efdc4034d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:32.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.649+0000 7efdc9600640 1 --2- 172.21.15.90:0/2966748399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc4034980 0x7efdc4034d90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efdcc06ae60 tx=0x7efdcc0ae5d0 comp rx=0 tx=0).stop 2024-09-21T03:19:32.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.649+0000 7efdc9600640 1 -- 172.21.15.90:0/2966748399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc4034980 msgr2=0x7efdc4034d90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:19:32.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.649+0000 7efdc9600640 1 --2- 172.21.15.90:0/2966748399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdc4034980 0x7efdc4034d90 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efdcc06ae60 tx=0x7efdcc0ae5d0 comp rx=0 tx=0).stop 2024-09-21T03:19:32.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.662+0000 7efdd2800640 1 -- 172.21.15.90:0/2966748399 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efdac078810 msgr2=0x7efdac07ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:32.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.662+0000 7efdd2800640 1 --2- 172.21.15.90:0/2966748399 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efdac078810 0x7efdac07ad20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efdb800e7c0 tx=0x7efdb801e040 comp rx=0 tx=0).stop 2024-09-21T03:19:32.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.662+0000 7efdd2800640 1 -- 172.21.15.90:0/2966748399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdc4006f40 msgr2=0x7efdc40dcc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:32.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.662+0000 7efdd2800640 1 --2- 172.21.15.90:0/2966748399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdc4006f40 0x7efdc40dcc20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efdc000d770 tx=0x7efdc000dc30 comp rx=0 tx=0).stop 2024-09-21T03:19:32.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.662+0000 7efdd1e00640 1 -- 172.21.15.90:0/2966748399 reap_dead start 2024-09-21T03:19:32.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.663+0000 7efdd2800640 1 -- 172.21.15.90:0/2966748399 shutdown_connections 2024-09-21T03:19:32.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.663+0000 7efdd2800640 1 -- 172.21.15.90:0/2966748399 >> 172.21.15.90:0/2966748399 conn(0x7efdc40312e0 msgr2=0x7efdc41656a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:32.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.666+0000 7efdd2800640 1 -- 172.21.15.90:0/2966748399 shutdown_connections 2024-09-21T03:19:32.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:32.666+0000 7efdd2800640 1 -- 172.21.15.90:0/2966748399 wait complete. 2024-09-21T03:19:32.718 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:19:32.718 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-21T03:19:32.718 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:19:33.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.316+0000 7f3c0b200640 1 -- 172.21.15.90:0/2335338489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c0c149580 msgr2=0x7f3c0c153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:33.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.317+0000 7f3c0b200640 1 --2- 172.21.15.90:0/2335338489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c0c149580 0x7f3c0c153460 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3c0400afd0 tx=0x7f3c0402b480 comp rx=0 tx=0).stop 2024-09-21T03:19:33.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.319+0000 7f3c0b200640 1 -- 172.21.15.90:0/2335338489 shutdown_connections 2024-09-21T03:19:33.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.319+0000 7f3c0b200640 1 --2- 172.21.15.90:0/2335338489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c0c149580 0x7f3c0c153460 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:33.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.319+0000 7f3c0b200640 1 --2- 172.21.15.90:0/2335338489 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c0c0728e0 0x7f3c0c156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:33.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.319+0000 7f3c0b200640 1 -- 172.21.15.90:0/2335338489 >> 172.21.15.90:0/2335338489 conn(0x7f3c0c06d200 msgr2=0x7f3c0c06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:33.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.320+0000 7f3c0b200640 1 -- 172.21.15.90:0/2335338489 shutdown_connections 2024-09-21T03:19:33.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.320+0000 7f3c0b200640 1 -- 172.21.15.90:0/2335338489 wait complete. 2024-09-21T03:19:33.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.327+0000 7f3c0b200640 1 Processor -- start 2024-09-21T03:19:33.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.327+0000 7f3c0b200640 1 -- start start 2024-09-21T03:19:33.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.335+0000 7f3c0b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c0c0728e0 0x7f3c0c0c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:33.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.336+0000 7f3c0b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c0c0c5160 0x7f3c0c14ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:33.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.336+0000 7f3c0b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c0c149580 0x7f3c0c1f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:33.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.338+0000 7f3c0b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c0c3b00 con 0x7f3c0c0c5160 2024-09-21T03:19:33.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.338+0000 7f3c0b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c0aa690 con 0x7f3c0c0728e0 2024-09-21T03:19:33.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.339+0000 7f3c0b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0c150770 con 0x7f3c0c149580 2024-09-21T03:19:33.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.339+0000 7f3c09e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c0c0728e0 0x7f3c0c0c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:33.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.339+0000 7f3c09e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c0c0728e0 0x7f3c0c0c6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:53116/0 (socket says 172.21.15.90:53116) 2024-09-21T03:19:33.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.339+0000 7f3c09e00640 1 -- 172.21.15.90:0/4089015923 learned_addr learned my addr 172.21.15.90:0/4089015923 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:19:33.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.339+0000 7f3c0a800640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c0c149580 0x7f3c0c1f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:33.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.339+0000 7f3c09400640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c0c0c5160 0x7f3c0c14ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:33.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.341+0000 7f3c09e00640 1 -- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c0c149580 msgr2=0x7f3c0c1f4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:33.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.343+0000 7f3c09e00640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c0c149580 0x7f3c0c1f4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:33.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.343+0000 7f3c09e00640 1 -- 172.21.15.90:0/4089015923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c0c0c5160 msgr2=0x7f3c0c14ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:33.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.343+0000 7f3c09e00640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c0c0c5160 0x7f3c0c14ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:33.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.343+0000 7f3c09e00640 1 -- 172.21.15.90:0/4089015923 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0c1504c0 con 0x7f3c0c0728e0 2024-09-21T03:19:33.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.343+0000 7f3c09400640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c0c0c5160 0x7f3c0c14ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:19:33.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.344+0000 7f3c0a800640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c0c149580 0x7f3c0c1f4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:19:33.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.348+0000 7f3c09e00640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c0c0728e0 0x7f3c0c0c6c90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc00e7c0 tx=0x7f3bfc00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:33.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.349+0000 7f3c02000640 1 -- 172.21.15.90:0/4089015923 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc00ccc0 con 0x7f3c0c0728e0 2024-09-21T03:19:33.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.349+0000 7f3c0b200640 1 -- 172.21.15.90:0/4089015923 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c0c1f5530 con 0x7f3c0c0728e0 2024-09-21T03:19:33.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.349+0000 7f3c02000640 1 -- 172.21.15.90:0/4089015923 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bfc00ce60 con 0x7f3c0c0728e0 2024-09-21T03:19:33.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.349+0000 7f3c0b200640 1 -- 172.21.15.90:0/4089015923 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c0c0c7cf0 con 0x7f3c0c0728e0 2024-09-21T03:19:33.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.351+0000 7f3c02000640 1 -- 172.21.15.90:0/4089015923 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc00ccc0 con 0x7f3c0c0728e0 2024-09-21T03:19:33.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.351+0000 7f3c0b200640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be4002a70 0x7f3be4004f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:33.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.351+0000 7f3c0b200640 1 -- 172.21.15.90:0/4089015923 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3be4007f10 con 0x7f3be4002a70 2024-09-21T03:19:33.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.352+0000 7f3c09400640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be4002a70 0x7f3be4004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:33.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.353+0000 7f3c09400640 1 -- 172.21.15.90:0/4089015923 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3be4008110 con 0x7f3be4002a70 2024-09-21T03:19:33.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.355+0000 7f3c09400640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be4002a70 0x7f3be4004f80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0c4000 tx=0x7f3c04003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:33.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.355+0000 7f3c02000640 1 -- 172.21.15.90:0/4089015923 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3bfc005020 con 0x7f3c0c0728e0 2024-09-21T03:19:33.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.357+0000 7f3c02000640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3bec078d30 0x7f3bec07b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:33.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.358+0000 7f3c02000640 1 -- 172.21.15.90:0/4089015923 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f3bfc09b5d0 con 0x7f3c0c0728e0 2024-09-21T03:19:33.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.358+0000 7f3c0a800640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3bec078d30 0x7f3bec07b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:33.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.359+0000 7f3c02000640 1 -- 172.21.15.90:0/4089015923 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c04040020 con 0x7f3be4002a70 2024-09-21T03:19:33.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.359+0000 7f3c02000640 1 -- 172.21.15.90:0/4089015923 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3c04038040 con 0x7f3be4002a70 2024-09-21T03:19:33.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.360+0000 7f3c02000640 1 -- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be4002a70 msgr2=0x7f3be4004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:33.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.360+0000 7f3c02000640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be4002a70 0x7f3be4004f80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0c4000 tx=0x7f3c04003f10 comp rx=0 tx=0).stop 2024-09-21T03:19:33.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.360+0000 7f3c02000640 1 -- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be4002a70 msgr2=0x7f3be4004f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:19:33.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.360+0000 7f3c02000640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be4002a70 0x7f3be4004f80 secure :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0c4000 tx=0x7f3c04003f10 comp rx=0 tx=0).stop 2024-09-21T03:19:33.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.360+0000 7f3c0a800640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3bec078d30 0x7f3bec07b240 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c14d1c0 tx=0x7f3bf8006f50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:33.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.374+0000 7f3c0b200640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be4006f80 0x7f3be4007440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:33.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.375+0000 7f3c0b200640 1 -- 172.21.15.90:0/4089015923 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3be400a4f0 con 0x7f3be4006f80 2024-09-21T03:19:33.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.377+0000 7f3c09400640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be4006f80 0x7f3be4007440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:33.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.378+0000 7f3c09400640 1 -- 172.21.15.90:0/4089015923 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3be4007980 con 0x7f3be4006f80 2024-09-21T03:19:33.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.379+0000 7f3c09400640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be4006f80 0x7f3be4007440 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3c04000f80 tx=0x7f3c0400aea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:33.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.381+0000 7f3c02000640 1 -- 172.21.15.90:0/4089015923 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c04040070 con 0x7f3be4006f80 2024-09-21T03:19:33.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.383+0000 7f3c02000640 1 -- 172.21.15.90:0/4089015923 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5193 (secure 0 0 0) 0x7f3c04048030 con 0x7f3be4006f80 2024-09-21T03:19:33.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.383+0000 7f3c02000640 1 -- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be4006f80 msgr2=0x7f3be4007440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:33.385 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:19:33.386 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:19:33.386 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:19:33.386 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:19:33.386 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 36, 2024-09-21T03:19:33.386 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 324170, 2024-09-21T03:19:33.386 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:19:33.386 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:19:33.386 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:19:33.387 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:19:33.387 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:33.387 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 2, 2024-09-21T03:19:33.387 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:19:33.387 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:19:33.387 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:19:33.387 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:19:33.387 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:19:33.387 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:19:33.387 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:19:33.387 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:19:33.387 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:19:33.387 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:19:33.387 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:19:33.388 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:19:33.388 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:19:33.388 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:19:33.388 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:33.388 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:19:33.388 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:19:33.388 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:19:33.388 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:19:33.388 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:19:33.388 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:19:33.388 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:19:33.388 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:19:33.388 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:19:33.388 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:19:33.389 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:19:33.389 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:19:33.389 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:19:33.389 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:33.389 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:33.389 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:19:33.389 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:19:33.389 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:19:33.389 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:19:33.389 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:19:33.389 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:19:33.389 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:19:33.389 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:19:33.389 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:19:33.390 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:19:33.390 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:19:33.390 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:19:33.390 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:19:33.390 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:19:33.390 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:19:33.390 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:19:33.390 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:19:33.390 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:19:33.390 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:19:33.390 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:19:33.390 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:19:33.390 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:19:33.390 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:19:33.391 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:19:33.391 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:19:33.391 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:19:33.391 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:19:33.391 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:19:33.391 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:33.391 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:19:33.391 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:33.391 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:19:33.391 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:33.391 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:19:33.391 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:19:33.391 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:19:33.391 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:19:33.392 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:33.392 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:19:33.392 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:19:33.392 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:33.392 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:33.392 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:33.392 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:19:33.392 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:19:33.392 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:33.392 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:33.392 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:33.392 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:33.392 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:19:33.392 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:19:33.393 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:19:33.393 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:19:33.393 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:19:33.393 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:33.393 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:33.393 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:19:33.393 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:19:33.393 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:19:33.393 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:19:33.393 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:33.393 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:19:33.393 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:19:33.393 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:33.393 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:33.393 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:33.394 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:19:33.394 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:19:33.394 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:33.394 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:33.394 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:33.394 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:33.394 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:19:33.394 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:19:33.394 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:19:33.394 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:19:33.394 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:19:33.394 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:33.394 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:33.394 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:19:33.395 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:19:33.395 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:19:33.395 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:19:33.395 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:33.395 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:19:33.395 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:19:33.395 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:33.395 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:33.395 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:33.395 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:19:33.395 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:19:33.395 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:33.395 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:33.395 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:33.395 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:33.396 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:19:33.396 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:19:33.396 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:19:33.396 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:19:33.396 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:19:33.396 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:33.396 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:33.396 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:33.396 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:19:33.396 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:19:33.396 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:33.396 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:33.396 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:33.397 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:19:33.397 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:33.397 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:33.397 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:19:33.397 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:33.397 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:33.397 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:33.397 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:19:33.397 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:33.397 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:33.397 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:19:33.398 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:33.398 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:33.398 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:33.398 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:19:33.398 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:33.398 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:33.398 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:19:33.398 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:33.398 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:19:33.398 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:19:33.398 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:19:33.398 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:33.398 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:33.398 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:33.399 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:33.399 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6 2024-09-21T03:19:33.399 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:33.399 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:33.399 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:19:33.399 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:33.399 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:33.399 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:33.399 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:19:33.399 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:33.399 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:33.399 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:33.399 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:19:33.399 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:19:33.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.384+0000 7f3c02000640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be4006f80 0x7f3be4007440 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3c04000f80 tx=0x7f3c0400aea0 comp rx=0 tx=0).stop 2024-09-21T03:19:33.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.384+0000 7f3c02000640 1 -- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be4006f80 msgr2=0x7f3be4007440 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:19:33.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.384+0000 7f3c02000640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be4006f80 0x7f3be4007440 secure :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3c04000f80 tx=0x7f3c0400aea0 comp rx=0 tx=0).stop 2024-09-21T03:19:33.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.387+0000 7f3c0b200640 1 -- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3bec078d30 msgr2=0x7f3bec07b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:33.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.387+0000 7f3c0b200640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3bec078d30 0x7f3bec07b240 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c14d1c0 tx=0x7f3bf8006f50 comp rx=0 tx=0).stop 2024-09-21T03:19:33.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.387+0000 7f3c0a800640 1 -- 172.21.15.90:0/4089015923 reap_dead start 2024-09-21T03:19:33.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.387+0000 7f3c0b200640 1 -- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c0c0728e0 msgr2=0x7f3c0c0c6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:33.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.388+0000 7f3c0b200640 1 --2- 172.21.15.90:0/4089015923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c0c0728e0 0x7f3c0c0c6c90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc00e7c0 tx=0x7f3bfc00ec80 comp rx=0 tx=0).stop 2024-09-21T03:19:33.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.388+0000 7f3c0a800640 1 -- 172.21.15.90:0/4089015923 reap_dead start 2024-09-21T03:19:33.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.389+0000 7f3c0b200640 1 -- 172.21.15.90:0/4089015923 shutdown_connections 2024-09-21T03:19:33.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.389+0000 7f3c0b200640 1 -- 172.21.15.90:0/4089015923 >> 172.21.15.90:0/4089015923 conn(0x7f3c0c06d200 msgr2=0x7f3c0c0ab950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:33.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.389+0000 7f3c0b200640 1 -- 172.21.15.90:0/4089015923 shutdown_connections 2024-09-21T03:19:33.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.389+0000 7f3c0b200640 1 -- 172.21.15.90:0/4089015923 wait complete. 2024-09-21T03:19:33.473 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:19:33.473 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-21T03:19:33.473 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:19:33.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.980+0000 7f2bf3000640 1 -- 172.21.15.90:0/3804317767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bec0c85e0 msgr2=0x7f2bec0c73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:33.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.980+0000 7f2bf3000640 1 --2- 172.21.15.90:0/3804317767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bec0c85e0 0x7f2bec0c73e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2bec08dee0 tx=0x7f2bd802a5a0 comp rx=0 tx=0).stop 2024-09-21T03:19:33.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.980+0000 7f2bf3000640 1 -- 172.21.15.90:0/3804317767 shutdown_connections 2024-09-21T03:19:33.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.980+0000 7f2bf3000640 1 --2- 172.21.15.90:0/3804317767 >> v2:172.21.15.90:3300/0 conn(0x7f2bec0b1750 0x7f2bec06db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:33.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.980+0000 7f2bf3000640 1 --2- 172.21.15.90:0/3804317767 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bec06e080 0x7f2bec06e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:33.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.980+0000 7f2bf3000640 1 --2- 172.21.15.90:0/3804317767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bec0c85e0 0x7f2bec0c73e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:33.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.980+0000 7f2bf3000640 1 -- 172.21.15.90:0/3804317767 >> 172.21.15.90:0/3804317767 conn(0x7f2bec0add50 msgr2=0x7f2bec0ae160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:33.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.980+0000 7f2bf3000640 1 -- 172.21.15.90:0/3804317767 shutdown_connections 2024-09-21T03:19:33.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.981+0000 7f2bf3000640 1 -- 172.21.15.90:0/3804317767 wait complete. 2024-09-21T03:19:33.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.988+0000 7f2bf3000640 1 Processor -- start 2024-09-21T03:19:33.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.989+0000 7f2bf3000640 1 -- start start 2024-09-21T03:19:33.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.991+0000 7f2bf3000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bec06e080 0x7f2bec159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:33.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.992+0000 7f2bf3000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bec0b1750 0x7f2bec0c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:33.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.992+0000 7f2bf3000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bec0c85e0 0x7f2bec152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:33.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.993+0000 7f2bf3000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2bec0cb070 con 0x7f2bec0b1750 2024-09-21T03:19:33.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.993+0000 7f2bf3000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2bec0cad90 con 0x7f2bec06e080 2024-09-21T03:19:33.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.993+0000 7f2bf3000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2bec0c7920 con 0x7f2bec0c85e0 2024-09-21T03:19:33.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.993+0000 7f2bf1200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bec0b1750 0x7f2bec0c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:33.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.993+0000 7f2bf1200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bec0b1750 0x7f2bec0c1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58560/0 (socket says 172.21.15.90:58560) 2024-09-21T03:19:33.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.993+0000 7f2bf1200640 1 -- 172.21.15.90:0/3768116117 learned_addr learned my addr 172.21.15.90:0/3768116117 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:19:33.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.994+0000 7f2bf2600640 1 --2- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bec0c85e0 0x7f2bec152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:34.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.998+0000 7f2bf1200640 1 -- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bec0c85e0 msgr2=0x7f2bec152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:34.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.998+0000 7f2bf1200640 1 --2- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bec0c85e0 0x7f2bec152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:34.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.998+0000 7f2bf1200640 1 -- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bec06e080 msgr2=0x7f2bec159e80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:19:34.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.998+0000 7f2bf1200640 1 --2- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bec06e080 0x7f2bec159e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:34.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.998+0000 7f2bf1200640 1 -- 172.21.15.90:0/3768116117 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bec153850 con 0x7f2bec0b1750 2024-09-21T03:19:34.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.999+0000 7f2bf1200640 1 --2- 172.21.15.90:0/3768116117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bec0b1750 0x7f2bec0c1e10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2be000d740 tx=0x7f2be000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:34.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:33.999+0000 7f2be9600640 1 -- 172.21.15.90:0/3768116117 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0017070 con 0x7f2bec0b1750 2024-09-21T03:19:34.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.000+0000 7f2bf3000640 1 -- 172.21.15.90:0/3768116117 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bec153d10 con 0x7f2bec0b1750 2024-09-21T03:19:34.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.000+0000 7f2bf3000640 1 -- 172.21.15.90:0/3768116117 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bec1f1bd0 con 0x7f2bec0b1750 2024-09-21T03:19:34.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.001+0000 7f2be9600640 1 -- 172.21.15.90:0/3768116117 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2be0009d20 con 0x7f2bec0b1750 2024-09-21T03:19:34.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.002+0000 7f2bf3000640 1 --2- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bec0c2d50 0x7f2bec152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:34.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.002+0000 7f2bf3000640 1 -- 172.21.15.90:0/3768116117 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2bec1f1da0 con 0x7f2bec0c2d50 2024-09-21T03:19:34.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.002+0000 7f2be9600640 1 -- 172.21.15.90:0/3768116117 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0017070 con 0x7f2bec0b1750 2024-09-21T03:19:34.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.003+0000 7f2bf1c00640 1 --2- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bec0c2d50 0x7f2bec152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:34.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.007+0000 7f2bf1c00640 1 -- 172.21.15.90:0/3768116117 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2bec153aa0 con 0x7f2bec0c2d50 2024-09-21T03:19:34.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.009+0000 7f2be9600640 1 -- 172.21.15.90:0/3768116117 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2be001a070 con 0x7f2bec0b1750 2024-09-21T03:19:34.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.010+0000 7f2be9600640 1 --2- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2bcc078d90 0x7f2bcc07b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:34.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.015+0000 7f2be9600640 1 -- 172.21.15.90:0/3768116117 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f2be00990a0 con 0x7f2bec0b1750 2024-09-21T03:19:34.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.015+0000 7f2bf2600640 1 --2- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2bcc078d90 0x7f2bcc07b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:34.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.018+0000 7f2bf1c00640 1 --2- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bec0c2d50 0x7f2bec152ed0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2bec08e1e0 tx=0x7f2bd80045e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:34.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.020+0000 7f2be9600640 1 -- 172.21.15.90:0/3768116117 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd803e030 con 0x7f2bec0c2d50 2024-09-21T03:19:34.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.020+0000 7f2be9600640 1 -- 172.21.15.90:0/3768116117 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2bd8003800 con 0x7f2bec0c2d50 2024-09-21T03:19:34.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.020+0000 7f2be9600640 1 -- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bec0c2d50 msgr2=0x7f2bec152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:34.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.020+0000 7f2be9600640 1 --2- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bec0c2d50 0x7f2bec152ed0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2bec08e1e0 tx=0x7f2bd80045e0 comp rx=0 tx=0).stop 2024-09-21T03:19:34.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.020+0000 7f2be9600640 1 -- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bec0c2d50 msgr2=0x7f2bec152ed0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:19:34.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.020+0000 7f2be9600640 1 --2- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bec0c2d50 0x7f2bec152ed0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2bec08e1e0 tx=0x7f2bd80045e0 comp rx=0 tx=0).stop 2024-09-21T03:19:34.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.023+0000 7f2bf2600640 1 --2- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2bcc078d90 0x7f2bcc07b2a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2bec08e3e0 tx=0x7f2be4009410 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:34.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.034+0000 7f2bf3000640 1 --2- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bec1f4620 0x7f2bec1f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:34.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.035+0000 7f2bf3000640 1 -- 172.21.15.90:0/3768116117 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2bec0cbf10 con 0x7f2bec1f4620 2024-09-21T03:19:34.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.035+0000 7f2bf1c00640 1 --2- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bec1f4620 0x7f2bec1f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:34.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.036+0000 7f2bf1c00640 1 -- 172.21.15.90:0/3768116117 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2bec0b10c0 con 0x7f2bec1f4620 2024-09-21T03:19:34.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.037+0000 7f2bf1c00640 1 --2- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bec1f4620 0x7f2bec1f4a30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2bec06ab40 tx=0x7f2bd802a5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:34.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.038+0000 7f2be9600640 1 -- 172.21.15.90:0/3768116117 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd8035040 con 0x7f2bec1f4620 2024-09-21T03:19:34.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.040+0000 7f2be9600640 1 -- 172.21.15.90:0/3768116117 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5025 (secure 0 0 0) 0x7f2bd803a3f0 con 0x7f2bec1f4620 2024-09-21T03:19:34.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.040+0000 7f2be9600640 1 -- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bec1f4620 msgr2=0x7f2bec1f4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:34.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.040+0000 7f2be9600640 1 --2- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bec1f4620 0x7f2bec1f4a30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2bec06ab40 tx=0x7f2bd802a5a0 comp rx=0 tx=0).stop 2024-09-21T03:19:34.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.040+0000 7f2be9600640 1 -- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bec1f4620 msgr2=0x7f2bec1f4a30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:19:34.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.040+0000 7f2be9600640 1 --2- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bec1f4620 0x7f2bec1f4a30 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2bec06ab40 tx=0x7f2bd802a5a0 comp rx=0 tx=0).stop 2024-09-21T03:19:34.043 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:19:34.043 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:19:34.043 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:19:34.043 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:19:34.043 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 36, 2024-09-21T03:19:34.043 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 89505, 2024-09-21T03:19:34.043 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:19:34.043 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:19:34.043 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:19:34.043 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:19:34.044 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:34.044 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 3, 2024-09-21T03:19:34.044 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:19:34.044 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:19:34.044 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:19:34.044 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:19:34.044 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:19:34.044 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:19:34.044 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:19:34.044 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:19:34.044 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:19:34.044 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:19:34.044 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:19:34.044 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:19:34.044 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:19:34.045 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:19:34.045 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:34.045 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:19:34.045 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:19:34.045 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:19:34.045 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:19:34.045 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:19:34.045 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:19:34.045 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:19:34.045 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:19:34.045 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:19:34.045 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:19:34.045 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:19:34.045 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:19:34.046 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:19:34.046 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:34.046 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:34.046 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:19:34.046 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:19:34.046 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:19:34.046 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:19:34.046 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:19:34.046 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:19:34.046 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:19:34.046 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:19:34.046 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:19:34.046 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:19:34.046 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:19:34.047 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:19:34.047 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:19:34.047 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:19:34.047 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:19:34.047 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:19:34.047 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:19:34.047 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:19:34.047 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:19:34.047 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:19:34.047 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:19:34.047 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:19:34.047 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:19:34.047 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:19:34.047 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:19:34.048 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:19:34.048 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:19:34.048 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:19:34.048 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:34.048 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:19:34.048 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:34.048 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:19:34.048 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:34.048 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:19:34.048 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:19:34.048 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:19:34.048 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:19:34.048 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:34.048 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:19:34.049 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:19:34.049 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:34.049 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:34.049 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:34.049 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:19:34.049 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:19:34.049 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:34.049 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:34.049 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:34.049 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:34.049 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:19:34.049 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:19:34.049 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:19:34.049 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:19:34.049 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:19:34.050 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:34.050 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:34.050 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:19:34.050 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:19:34.050 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:19:34.050 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:19:34.050 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:34.050 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:19:34.050 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:19:34.050 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:34.050 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:34.050 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:34.050 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:19:34.050 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:19:34.050 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:34.051 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:34.051 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:34.051 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:34.051 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:19:34.051 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:19:34.051 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:19:34.051 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:19:34.051 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:19:34.051 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:34.051 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:34.051 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:19:34.051 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:19:34.051 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:19:34.051 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:19:34.051 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:34.052 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:19:34.052 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:19:34.052 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:34.052 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:34.052 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:34.052 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:19:34.052 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:19:34.052 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:34.052 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:34.052 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:34.052 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:34.052 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:19:34.052 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:19:34.053 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:19:34.053 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:19:34.053 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:19:34.053 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:34.053 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:34.053 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:34.053 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:19:34.053 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:19:34.053 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:34.053 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:34.053 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:34.053 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:19:34.053 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:34.053 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:34.053 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:19:34.054 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:34.054 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:34.054 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:34.054 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:19:34.054 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:34.054 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:34.054 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:19:34.054 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:34.054 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:34.054 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:34.054 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:19:34.054 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:34.054 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:34.054 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:19:34.055 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:34.055 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:19:34.055 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:19:34.055 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:19:34.055 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:34.055 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:34.055 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:34.055 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:34.055 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:19:34.055 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:34.055 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:34.055 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:34.055 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:19:34.055 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:19:34.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.043+0000 7f2bf3000640 1 -- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2bcc078d90 msgr2=0x7f2bcc07b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:34.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.043+0000 7f2bf3000640 1 --2- 172.21.15.90:0/3768116117 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2bcc078d90 0x7f2bcc07b2a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2bec08e3e0 tx=0x7f2be4009410 comp rx=0 tx=0).stop 2024-09-21T03:19:34.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.043+0000 7f2bf3000640 1 -- 172.21.15.90:0/3768116117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bec0b1750 msgr2=0x7f2bec0c1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:34.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.043+0000 7f2bf3000640 1 --2- 172.21.15.90:0/3768116117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bec0b1750 0x7f2bec0c1e10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2be000d740 tx=0x7f2be000dc00 comp rx=0 tx=0).stop 2024-09-21T03:19:34.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.043+0000 7f2bf2600640 1 -- 172.21.15.90:0/3768116117 reap_dead start 2024-09-21T03:19:34.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.044+0000 7f2bf3000640 1 -- 172.21.15.90:0/3768116117 shutdown_connections 2024-09-21T03:19:34.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.044+0000 7f2bf3000640 1 --2- 172.21.15.90:0/3768116117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bec0b1750 0x7f2bec0c1e10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:34.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.044+0000 7f2bf3000640 1 -- 172.21.15.90:0/3768116117 >> 172.21.15.90:0/3768116117 conn(0x7f2bec0add50 msgr2=0x7f2bec156350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:34.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.044+0000 7f2bf3000640 1 -- 172.21.15.90:0/3768116117 shutdown_connections 2024-09-21T03:19:34.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.044+0000 7f2bf3000640 1 -- 172.21.15.90:0/3768116117 wait complete. 2024-09-21T03:19:34.104 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:19:34.104 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-21T03:19:34.104 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-21T03:19:34.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.622+0000 7fdaf1400640 1 -- 172.21.15.90:0/704442084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdaec157720 msgr2=0x7fdaec161650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:34.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.622+0000 7fdaf1400640 1 --2- 172.21.15.90:0/704442084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdaec157720 0x7fdaec161650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdaec0ab6e0 tx=0x7fdae402a8f0 comp rx=0 tx=0).stop 2024-09-21T03:19:34.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.623+0000 7fdaf1400640 1 -- 172.21.15.90:0/704442084 shutdown_connections 2024-09-21T03:19:34.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.623+0000 7fdaf1400640 1 --2- 172.21.15.90:0/704442084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdaec157720 0x7fdaec161650 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:34.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.623+0000 7fdaf1400640 1 --2- 172.21.15.90:0/704442084 >> v2:172.21.15.149:3300/0 conn(0x7fdaec156dd0 0x7fdaec1571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:34.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.623+0000 7fdaf1400640 1 -- 172.21.15.90:0/704442084 >> 172.21.15.90:0/704442084 conn(0x7fdaec0c8740 msgr2=0x7fdaec06cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:34.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.625+0000 7fdaf1400640 1 -- 172.21.15.90:0/704442084 shutdown_connections 2024-09-21T03:19:34.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.625+0000 7fdaf1400640 1 -- 172.21.15.90:0/704442084 wait complete. 2024-09-21T03:19:34.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.629+0000 7fdaf1400640 1 Processor -- start 2024-09-21T03:19:34.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.630+0000 7fdaf1400640 1 -- start start 2024-09-21T03:19:34.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.635+0000 7fdaf1400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdaec0ad490 0x7fdaec1434b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:34.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.635+0000 7fdaf1400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdaec156dd0 0x7fdaec151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:34.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.635+0000 7fdaf1400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdaec157720 0x7fdaec14fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:34.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.635+0000 7fdaf1400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec0c1c50 con 0x7fdaec156dd0 2024-09-21T03:19:34.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.635+0000 7fdaf1400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec15b0a0 con 0x7fdaec157720 2024-09-21T03:19:34.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.635+0000 7fdaf1400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdaec0c1dd0 con 0x7fdaec0ad490 2024-09-21T03:19:34.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.635+0000 7fdaea800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdaec0ad490 0x7fdaec1434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:34.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.635+0000 7fdaea800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdaec0ad490 0x7fdaec1434b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:34100/0 (socket says 172.21.15.90:34100) 2024-09-21T03:19:34.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.635+0000 7fdaea800640 1 -- 172.21.15.90:0/2250805018 learned_addr learned my addr 172.21.15.90:0/2250805018 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:19:34.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.636+0000 7fdaea800640 1 -- 172.21.15.90:0/2250805018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdaec157720 msgr2=0x7fdaec14fa40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:19:34.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.636+0000 7fdaea800640 1 --2- 172.21.15.90:0/2250805018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdaec157720 0x7fdaec14fa40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:34.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.636+0000 7fdaea800640 1 -- 172.21.15.90:0/2250805018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdaec156dd0 msgr2=0x7fdaec151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:34.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.636+0000 7fdaea800640 1 --2- 172.21.15.90:0/2250805018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdaec156dd0 0x7fdaec151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:34.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.636+0000 7fdaea800640 1 -- 172.21.15.90:0/2250805018 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaec1544d0 con 0x7fdaec0ad490 2024-09-21T03:19:34.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.637+0000 7fdaea800640 1 --2- 172.21.15.90:0/2250805018 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdaec0ad490 0x7fdaec1434b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00b3f0 tx=0x7fdadc00b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:34.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.637+0000 7fdae2a00640 1 -- 172.21.15.90:0/2250805018 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdadc015020 con 0x7fdaec0ad490 2024-09-21T03:19:34.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.637+0000 7fdae2a00640 1 -- 172.21.15.90:0/2250805018 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdadc011920 con 0x7fdaec0ad490 2024-09-21T03:19:34.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.637+0000 7fdae2a00640 1 -- 172.21.15.90:0/2250805018 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdadc011d70 con 0x7fdaec0ad490 2024-09-21T03:19:34.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.641+0000 7fdaf1400640 1 -- 172.21.15.90:0/2250805018 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaec1edea0 con 0x7fdaec0ad490 2024-09-21T03:19:34.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.641+0000 7fdaf1400640 1 -- 172.21.15.90:0/2250805018 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaec152800 con 0x7fdaec0ad490 2024-09-21T03:19:34.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.648+0000 7fdaf1400640 1 -- 172.21.15.90:0/2250805018 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaec0abd70 con 0x7fdaec0ad490 2024-09-21T03:19:34.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.655+0000 7fdae2a00640 1 -- 172.21.15.90:0/2250805018 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdadc018020 con 0x7fdaec0ad490 2024-09-21T03:19:34.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.667+0000 7fdae2a00640 1 --2- 172.21.15.90:0/2250805018 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdacc078bc0 0x7fdacc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:34.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.668+0000 7fdae2a00640 1 -- 172.21.15.90:0/2250805018 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fdadc09ac70 con 0x7fdaec0ad490 2024-09-21T03:19:34.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.668+0000 7fdae2a00640 1 -- 172.21.15.90:0/2250805018 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdaec0abd70 con 0x7fdaec0ad490 2024-09-21T03:19:34.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.679+0000 7fdae9e00640 1 --2- 172.21.15.90:0/2250805018 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdacc078bc0 0x7fdacc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:34.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:34.682+0000 7fdae9e00640 1 --2- 172.21.15.90:0/2250805018 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdacc078bc0 0x7fdacc07b0d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdaec1552c0 tx=0x7fdad8006bf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:35.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:35.381+0000 7fdaf1400640 1 -- 172.21.15.90:0/2250805018 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fdaec0ab1c0 con 0x7fdaec0ad490 2024-09-21T03:19:35.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:35.389+0000 7fdae2a00640 1 -- 172.21.15.90:0/2250805018 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fdadc01f030 con 0x7fdaec0ad490 2024-09-21T03:19:35.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:35.398+0000 7fdaf1400640 1 -- 172.21.15.90:0/2250805018 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdacc078bc0 msgr2=0x7fdacc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:35.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:35.398+0000 7fdaf1400640 1 --2- 172.21.15.90:0/2250805018 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdacc078bc0 0x7fdacc07b0d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdaec1552c0 tx=0x7fdad8006bf0 comp rx=0 tx=0).stop 2024-09-21T03:19:35.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:35.398+0000 7fdaf1400640 1 -- 172.21.15.90:0/2250805018 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdaec0ad490 msgr2=0x7fdaec1434b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:35.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:35.398+0000 7fdaf1400640 1 --2- 172.21.15.90:0/2250805018 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdaec0ad490 0x7fdaec1434b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00b3f0 tx=0x7fdadc00b8b0 comp rx=0 tx=0).stop 2024-09-21T03:19:35.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:35.399+0000 7fdaf1400640 1 -- 172.21.15.90:0/2250805018 shutdown_connections 2024-09-21T03:19:35.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:35.399+0000 7fdaf1400640 1 --2- 172.21.15.90:0/2250805018 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdacc078bc0 0x7fdacc07b0d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:35.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:35.399+0000 7fdaf1400640 1 --2- 172.21.15.90:0/2250805018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdaec157720 0x7fdaec14fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:35.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:35.399+0000 7fdaf1400640 1 --2- 172.21.15.90:0/2250805018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdaec156dd0 0x7fdaec151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:35.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:35.399+0000 7fdaf1400640 1 --2- 172.21.15.90:0/2250805018 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdaec0ad490 0x7fdaec1434b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:35.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:35.399+0000 7fdaf1400640 1 -- 172.21.15.90:0/2250805018 >> 172.21.15.90:0/2250805018 conn(0x7fdaec0c8740 msgr2=0x7fdaec0c1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:35.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:35.399+0000 7fdaf1400640 1 -- 172.21.15.90:0/2250805018 shutdown_connections 2024-09-21T03:19:35.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:35.399+0000 7fdaf1400640 1 -- 172.21.15.90:0/2250805018 wait complete. 2024-09-21T03:19:35.459 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-21T03:19:45.460 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-21T03:19:45.460 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:19:46.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.088+0000 7fd8cd600640 1 -- 172.21.15.90:0/787115919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8c806db70 msgr2=0x7fd8c8153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:46.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.088+0000 7fd8cd600640 1 --2- 172.21.15.90:0/787115919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8c806db70 0x7fd8c8153ff0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0005fd0 tx=0x7fd8c002aa90 comp rx=0 tx=0).stop 2024-09-21T03:19:46.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.088+0000 7fd8cd600640 1 -- 172.21.15.90:0/787115919 shutdown_connections 2024-09-21T03:19:46.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.088+0000 7fd8cd600640 1 --2- 172.21.15.90:0/787115919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8c806db70 0x7fd8c8153ff0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:46.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.088+0000 7fd8cd600640 1 --2- 172.21.15.90:0/787115919 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8c806e5f0 0x7fd8c815ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:46.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.088+0000 7fd8cd600640 1 -- 172.21.15.90:0/787115919 >> 172.21.15.90:0/787115919 conn(0x7fd8c80ccda0 msgr2=0x7fd8c80c8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:46.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.098+0000 7fd8cd600640 1 -- 172.21.15.90:0/787115919 shutdown_connections 2024-09-21T03:19:46.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.099+0000 7fd8cd600640 1 -- 172.21.15.90:0/787115919 wait complete. 2024-09-21T03:19:46.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.104+0000 7fd8cd600640 1 Processor -- start 2024-09-21T03:19:46.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.104+0000 7fd8cd600640 1 -- start start 2024-09-21T03:19:46.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.106+0000 7fd8cd600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8c806db70 0x7fd8c81ed040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:46.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.106+0000 7fd8cd600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8c806e5f0 0x7fd8c81f9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:46.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.106+0000 7fd8cd600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8c80c7fe0 0x7fd8c80c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:46.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.107+0000 7fd8cd600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c80c83f0 con 0x7fd8c80c7fe0 2024-09-21T03:19:46.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.107+0000 7fd8cd600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c80c77e0 con 0x7fd8c806db70 2024-09-21T03:19:46.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.107+0000 7fd8cd600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c80c8570 con 0x7fd8c806e5f0 2024-09-21T03:19:46.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.108+0000 7fd8c7400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8c806e5f0 0x7fd8c81f9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:46.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.108+0000 7fd8ccc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8c80c7fe0 0x7fd8c80c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:46.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.108+0000 7fd8ccc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8c80c7fe0 0x7fd8c80c5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46688/0 (socket says 172.21.15.90:46688) 2024-09-21T03:19:46.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.108+0000 7fd8ccc00640 1 -- 172.21.15.90:0/2297000122 learned_addr learned my addr 172.21.15.90:0/2297000122 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:19:46.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.108+0000 7fd8c7e00640 1 --2- 172.21.15.90:0/2297000122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8c806db70 0x7fd8c81ed040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:46.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.109+0000 7fd8ccc00640 1 -- 172.21.15.90:0/2297000122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8c806e5f0 msgr2=0x7fd8c81f9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:46.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.109+0000 7fd8ccc00640 1 --2- 172.21.15.90:0/2297000122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8c806e5f0 0x7fd8c81f9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:46.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.109+0000 7fd8ccc00640 1 -- 172.21.15.90:0/2297000122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8c806db70 msgr2=0x7fd8c81ed040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:46.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.109+0000 7fd8ccc00640 1 --2- 172.21.15.90:0/2297000122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8c806db70 0x7fd8c81ed040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:46.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.110+0000 7fd8ccc00640 1 -- 172.21.15.90:0/2297000122 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c8159e80 con 0x7fd8c80c7fe0 2024-09-21T03:19:46.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.110+0000 7fd8c7e00640 1 --2- 172.21.15.90:0/2297000122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8c806db70 0x7fd8c81ed040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:19:46.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.111+0000 7fd8ccc00640 1 --2- 172.21.15.90:0/2297000122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8c80c7fe0 0x7fd8c80c5890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0009d90 tx=0x7fd8c0003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:46.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.112+0000 7fd8c7400640 1 --2- 172.21.15.90:0/2297000122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8c806e5f0 0x7fd8c81f9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:19:46.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.114+0000 7fd8bfe00640 1 -- 172.21.15.90:0/2297000122 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0044070 con 0x7fd8c80c7fe0 2024-09-21T03:19:46.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.114+0000 7fd8bfe00640 1 -- 172.21.15.90:0/2297000122 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8c0004250 con 0x7fd8c80c7fe0 2024-09-21T03:19:46.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.114+0000 7fd8bfe00640 1 -- 172.21.15.90:0/2297000122 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0004660 con 0x7fd8c80c7fe0 2024-09-21T03:19:46.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.116+0000 7fd8cd600640 1 -- 172.21.15.90:0/2297000122 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c81fda80 con 0x7fd8c80c7fe0 2024-09-21T03:19:46.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.117+0000 7fd8cd600640 1 -- 172.21.15.90:0/2297000122 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c80ad7c0 con 0x7fd8c80c7fe0 2024-09-21T03:19:46.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.121+0000 7fd8bfe00640 1 -- 172.21.15.90:0/2297000122 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd8c0047070 con 0x7fd8c80c7fe0 2024-09-21T03:19:46.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.125+0000 7fd8bfe00640 1 --2- 172.21.15.90:0/2297000122 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd8a8078bc0 0x7fd8a807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:46.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.125+0000 7fd8cd600640 1 -- 172.21.15.90:0/2297000122 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8c815ab90 con 0x7fd8c80c7fe0 2024-09-21T03:19:46.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.127+0000 7fd8bfe00640 1 -- 172.21.15.90:0/2297000122 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fd8c00bbe30 con 0x7fd8c80c7fe0 2024-09-21T03:19:46.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.132+0000 7fd8c7e00640 1 --2- 172.21.15.90:0/2297000122 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd8a8078bc0 0x7fd8a807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:46.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.134+0000 7fd8c7e00640 1 --2- 172.21.15.90:0/2297000122 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd8a8078bc0 0x7fd8a807b0d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009ab0 tx=0x7fd8b8005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:46.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.147+0000 7fd8bfe00640 1 -- 172.21.15.90:0/2297000122 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd8c0032030 con 0x7fd8c80c7fe0 2024-09-21T03:19:46.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.804+0000 7fd8cd600640 1 -- 172.21.15.90:0/2297000122 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd8c8153020 con 0x7fd8c80c7fe0 2024-09-21T03:19:46.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.807+0000 7fd8bfe00640 1 -- 172.21.15.90:0/2297000122 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7fd8c00838e0 con 0x7fd8c80c7fe0 2024-09-21T03:19:46.809 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:19:46.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.811+0000 7fd8cd600640 1 -- 172.21.15.90:0/2297000122 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd8a8078bc0 msgr2=0x7fd8a807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:46.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.811+0000 7fd8cd600640 1 --2- 172.21.15.90:0/2297000122 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd8a8078bc0 0x7fd8a807b0d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009ab0 tx=0x7fd8b8005f90 comp rx=0 tx=0).stop 2024-09-21T03:19:46.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.813+0000 7fd8cd600640 1 -- 172.21.15.90:0/2297000122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8c80c7fe0 msgr2=0x7fd8c80c5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:46.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.813+0000 7fd8cd600640 1 --2- 172.21.15.90:0/2297000122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8c80c7fe0 0x7fd8c80c5890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0009d90 tx=0x7fd8c0003ce0 comp rx=0 tx=0).stop 2024-09-21T03:19:46.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.813+0000 7fd8cd600640 1 -- 172.21.15.90:0/2297000122 shutdown_connections 2024-09-21T03:19:46.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.813+0000 7fd8cd600640 1 --2- 172.21.15.90:0/2297000122 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd8a8078bc0 0x7fd8a807b0d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:46.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.813+0000 7fd8cd600640 1 --2- 172.21.15.90:0/2297000122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8c80c7fe0 0x7fd8c80c5890 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:46.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.813+0000 7fd8cd600640 1 --2- 172.21.15.90:0/2297000122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8c806e5f0 0x7fd8c81f9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:46.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.813+0000 7fd8cd600640 1 --2- 172.21.15.90:0/2297000122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8c806db70 0x7fd8c81ed040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:46.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.813+0000 7fd8cd600640 1 -- 172.21.15.90:0/2297000122 >> 172.21.15.90:0/2297000122 conn(0x7fd8c80ccda0 msgr2=0x7fd8c8151d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:46.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.814+0000 7fd8cd600640 1 -- 172.21.15.90:0/2297000122 shutdown_connections 2024-09-21T03:19:46.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:46.814+0000 7fd8cd600640 1 -- 172.21.15.90:0/2297000122 wait complete. 2024-09-21T03:19:46.883 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-21T03:19:46.883 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-21T03:19:46.883 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-21T03:19:46.883 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:19:47.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.402+0000 7fddbb200640 1 -- 172.21.15.90:0/436262047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc0c13d0 msgr2=0x7fddbc0c17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:47.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.402+0000 7fddbb200640 1 --2- 172.21.15.90:0/436262047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc0c13d0 0x7fddbc0c17e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0c47b0 tx=0x7fddac02a600 comp rx=0 tx=0).stop 2024-09-21T03:19:47.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.403+0000 7fddbb200640 1 -- 172.21.15.90:0/436262047 shutdown_connections 2024-09-21T03:19:47.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.403+0000 7fddbb200640 1 --2- 172.21.15.90:0/436262047 >> v2:172.21.15.149:3300/0 conn(0x7fddbc06fad0 0x7fddbc06fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:47.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.403+0000 7fddbb200640 1 --2- 172.21.15.90:0/436262047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc0c13d0 0x7fddbc0c17e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:47.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.403+0000 7fddbb200640 1 -- 172.21.15.90:0/436262047 >> 172.21.15.90:0/436262047 conn(0x7fddbc06d570 msgr2=0x7fddbc0c7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:47.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.404+0000 7fddbb200640 1 -- 172.21.15.90:0/436262047 shutdown_connections 2024-09-21T03:19:47.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.404+0000 7fddbb200640 1 -- 172.21.15.90:0/436262047 wait complete. 2024-09-21T03:19:47.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.415+0000 7fddbb200640 1 Processor -- start 2024-09-21T03:19:47.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.420+0000 7fddbb200640 1 -- start start 2024-09-21T03:19:47.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.427+0000 7fddbb200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fddbc06fad0 0x7fddbc151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:47.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.428+0000 7fddbb200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc0c13d0 0x7fddbc1f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:47.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.429+0000 7fddbb200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddbc156c30 0x7fddbc13e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:47.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.431+0000 7fddba800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddbc156c30 0x7fddbc13e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:47.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.432+0000 7fddbb200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc073860 con 0x7fddbc0c13d0 2024-09-21T03:19:47.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.432+0000 7fddba800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddbc156c30 0x7fddbc13e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:38874/0 (socket says 172.21.15.90:38874) 2024-09-21T03:19:47.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.432+0000 7fddba800640 1 -- 172.21.15.90:0/2663514431 learned_addr learned my addr 172.21.15.90:0/2663514431 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:19:47.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.432+0000 7fddbb200640 1 -- 172.21.15.90:0/2663514431 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc074470 con 0x7fddbc156c30 2024-09-21T03:19:47.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.432+0000 7fddb9e00640 1 --2- 172.21.15.90:0/2663514431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fddbc06fad0 0x7fddbc151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:47.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.432+0000 7fddbb200640 1 -- 172.21.15.90:0/2663514431 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fddbc0c2570 con 0x7fddbc06fad0 2024-09-21T03:19:47.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.433+0000 7fddb9400640 1 --2- 172.21.15.90:0/2663514431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc0c13d0 0x7fddbc1f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:47.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.434+0000 7fddb9e00640 1 -- 172.21.15.90:0/2663514431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddbc156c30 msgr2=0x7fddbc13e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:47.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.434+0000 7fddb9e00640 1 --2- 172.21.15.90:0/2663514431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddbc156c30 0x7fddbc13e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:47.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.434+0000 7fddb9e00640 1 -- 172.21.15.90:0/2663514431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc0c13d0 msgr2=0x7fddbc1f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:47.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.434+0000 7fddb9e00640 1 --2- 172.21.15.90:0/2663514431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc0c13d0 0x7fddbc1f4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:47.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.434+0000 7fddb9e00640 1 -- 172.21.15.90:0/2663514431 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddbc152f40 con 0x7fddbc06fad0 2024-09-21T03:19:47.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.441+0000 7fddb9e00640 1 --2- 172.21.15.90:0/2663514431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fddbc06fad0 0x7fddbc151f60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fddb400c730 tx=0x7fddb400cb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:47.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.443+0000 7fddb2000640 1 -- 172.21.15.90:0/2663514431 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4016020 con 0x7fddbc06fad0 2024-09-21T03:19:47.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.444+0000 7fddbb200640 1 -- 172.21.15.90:0/2663514431 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddbc1f20b0 con 0x7fddbc06fad0 2024-09-21T03:19:47.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.445+0000 7fddb2000640 1 -- 172.21.15.90:0/2663514431 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fddb4003990 con 0x7fddbc06fad0 2024-09-21T03:19:47.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.446+0000 7fddbb200640 1 -- 172.21.15.90:0/2663514431 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fddbc1eefd0 con 0x7fddbc06fad0 2024-09-21T03:19:47.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.446+0000 7fddb2000640 1 -- 172.21.15.90:0/2663514431 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4006e60 con 0x7fddbc06fad0 2024-09-21T03:19:47.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.449+0000 7fddb2000640 1 -- 172.21.15.90:0/2663514431 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fddb40050d0 con 0x7fddbc06fad0 2024-09-21T03:19:47.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.451+0000 7fddb2000640 1 --2- 172.21.15.90:0/2663514431 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdd9c078bc0 0x7fdd9c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:47.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.451+0000 7fddb2000640 1 -- 172.21.15.90:0/2663514431 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fddb409a920 con 0x7fddbc06fad0 2024-09-21T03:19:47.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.452+0000 7fddb9400640 1 --2- 172.21.15.90:0/2663514431 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdd9c078bc0 0x7fdd9c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:47.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.464+0000 7fddbb200640 1 --2- 172.21.15.90:0/2663514431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc151380 0x7fddbc13ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:47.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.464+0000 7fddbb200640 1 -- 172.21.15.90:0/2663514431 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc157840 con 0x7fddbc151380 2024-09-21T03:19:47.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.467+0000 7fddba800640 1 --2- 172.21.15.90:0/2663514431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc151380 0x7fddbc13ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:47.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.473+0000 7fddba800640 1 -- 172.21.15.90:0/2663514431 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fddbc157a90 con 0x7fddbc151380 2024-09-21T03:19:47.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.475+0000 7fddba800640 1 --2- 172.21.15.90:0/2663514431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc151380 0x7fddbc13ecf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdda8005d00 tx=0x7fdda8010e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:47.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.477+0000 7fddb2000640 1 -- 172.21.15.90:0/2663514431 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda800ee70 con 0x7fddbc151380 2024-09-21T03:19:47.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.477+0000 7fddb9400640 1 --2- 172.21.15.90:0/2663514431 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdd9c078bc0 0x7fdd9c07b0d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fddac033000 tx=0x7fddac004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:47.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.478+0000 7fddb2000640 1 -- 172.21.15.90:0/2663514431 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdda8005020 con 0x7fddbc151380 2024-09-21T03:19:47.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.478+0000 7fddb2000640 1 -- 172.21.15.90:0/2663514431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc151380 msgr2=0x7fddbc13ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:47.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.478+0000 7fddb2000640 1 --2- 172.21.15.90:0/2663514431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc151380 0x7fddbc13ecf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdda8005d00 tx=0x7fdda8010e00 comp rx=0 tx=0).stop 2024-09-21T03:19:47.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.478+0000 7fddb2000640 1 -- 172.21.15.90:0/2663514431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc151380 msgr2=0x7fddbc13ecf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:19:47.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.478+0000 7fddb2000640 1 --2- 172.21.15.90:0/2663514431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc151380 0x7fddbc13ecf0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdda8005d00 tx=0x7fdda8010e00 comp rx=0 tx=0).stop 2024-09-21T03:19:47.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.524+0000 7fddbb200640 1 --2- 172.21.15.90:0/2663514431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc1f5130 0x7fddbc153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:47.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.524+0000 7fddbb200640 1 -- 172.21.15.90:0/2663514431 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc1526e0 con 0x7fddbc1f5130 2024-09-21T03:19:47.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.527+0000 7fddba800640 1 --2- 172.21.15.90:0/2663514431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc1f5130 0x7fddbc153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:47.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.529+0000 7fddba800640 1 -- 172.21.15.90:0/2663514431 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fddbc071290 con 0x7fddbc1f5130 2024-09-21T03:19:47.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.533+0000 7fddba800640 1 --2- 172.21.15.90:0/2663514431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc1f5130 0x7fddbc153410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdda800f010 tx=0x7fdda80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:47.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.534+0000 7fddb2000640 1 -- 172.21.15.90:0/2663514431 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda8004e60 con 0x7fddbc1f5130 2024-09-21T03:19:47.538 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:19:47.539 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:19:47.539 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:19:47.539 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:19:47.539 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 36, 2024-09-21T03:19:47.539 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 31308, 2024-09-21T03:19:47.539 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:19:47.539 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:19:47.539 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:19:47.539 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:19:47.539 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:47.539 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 16, 2024-09-21T03:19:47.539 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:19:47.539 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:19:47.539 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:19:47.540 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:19:47.540 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:19:47.540 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:19:47.540 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:19:47.540 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:19:47.540 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:19:47.540 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:19:47.540 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:19:47.540 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:19:47.540 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:19:47.540 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:19:47.540 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:47.540 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:19:47.540 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:19:47.540 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:19:47.541 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:19:47.541 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:19:47.541 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:19:47.541 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:19:47.541 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:19:47.541 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:19:47.541 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:19:47.541 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:19:47.541 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:19:47.541 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:19:47.541 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:47.541 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:47.541 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:19:47.541 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:19:47.541 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:19:47.542 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:19:47.542 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:19:47.542 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:19:47.542 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:19:47.542 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:19:47.542 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:19:47.542 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:19:47.542 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:19:47.542 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:19:47.542 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:19:47.542 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:19:47.542 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:19:47.542 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:19:47.542 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:19:47.543 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:19:47.543 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:19:47.543 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:19:47.543 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:19:47.543 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:19:47.543 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:19:47.543 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:19:47.543 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:19:47.543 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:19:47.543 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:19:47.543 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:19:47.543 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:47.543 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:19:47.543 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:47.543 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:19:47.544 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:47.544 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:19:47.544 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:19:47.544 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:19:47.544 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:19:47.544 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:47.544 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:19:47.544 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:19:47.544 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:47.544 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:47.544 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:47.544 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:19:47.544 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:19:47.544 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:47.544 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:47.545 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:47.545 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:47.545 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:19:47.545 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:19:47.545 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:19:47.545 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:19:47.545 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:19:47.545 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:47.545 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:47.545 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:19:47.545 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:19:47.545 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:19:47.545 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:19:47.545 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:47.545 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:19:47.546 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:19:47.546 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:47.546 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:47.546 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:47.546 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:19:47.546 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:19:47.546 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:47.546 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:47.546 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:47.546 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:47.546 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:19:47.546 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:19:47.546 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:19:47.546 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:19:47.547 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:19:47.547 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:47.547 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:47.547 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:19:47.547 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:19:47.547 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:19:47.547 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:19:47.547 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:47.547 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:19:47.547 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:19:47.547 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:47.547 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:47.547 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:47.547 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:19:47.548 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:19:47.548 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:47.548 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:47.548 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:47.548 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:47.548 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:19:47.548 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:19:47.548 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:19:47.548 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:19:47.548 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:19:47.548 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:47.548 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:47.548 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:47.548 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:19:47.548 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:19:47.548 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:47.549 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:47.549 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:47.549 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:19:47.549 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:47.549 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:47.549 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:19:47.549 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:47.549 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:47.549 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:47.549 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:19:47.549 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:47.549 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:47.549 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:47.549 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:19:47.549 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:19:47.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.536+0000 7fddb2000640 1 -- 172.21.15.90:0/2663514431 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4551 (secure 0 0 0) 0x7fdda8020570 con 0x7fddbc1f5130 2024-09-21T03:19:47.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.536+0000 7fddb2000640 1 -- 172.21.15.90:0/2663514431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc1f5130 msgr2=0x7fddbc153410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:47.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.536+0000 7fddb2000640 1 --2- 172.21.15.90:0/2663514431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc1f5130 0x7fddbc153410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdda800f010 tx=0x7fdda80046c0 comp rx=0 tx=0).stop 2024-09-21T03:19:47.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.536+0000 7fddb2000640 1 -- 172.21.15.90:0/2663514431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc1f5130 msgr2=0x7fddbc153410 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:19:47.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.536+0000 7fddb2000640 1 --2- 172.21.15.90:0/2663514431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddbc1f5130 0x7fddbc153410 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdda800f010 tx=0x7fdda80046c0 comp rx=0 tx=0).stop 2024-09-21T03:19:47.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.538+0000 7fddbb200640 1 -- 172.21.15.90:0/2663514431 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdd9c078bc0 msgr2=0x7fdd9c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:47.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.538+0000 7fddbb200640 1 --2- 172.21.15.90:0/2663514431 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdd9c078bc0 0x7fdd9c07b0d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fddac033000 tx=0x7fddac004730 comp rx=0 tx=0).stop 2024-09-21T03:19:47.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.538+0000 7fddbb200640 1 -- 172.21.15.90:0/2663514431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fddbc06fad0 msgr2=0x7fddbc151f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:47.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.538+0000 7fddbb200640 1 --2- 172.21.15.90:0/2663514431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fddbc06fad0 0x7fddbc151f60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fddb400c730 tx=0x7fddb400cb30 comp rx=0 tx=0).stop 2024-09-21T03:19:47.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.539+0000 7fddba800640 1 -- 172.21.15.90:0/2663514431 reap_dead start 2024-09-21T03:19:47.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.539+0000 7fddbb200640 1 -- 172.21.15.90:0/2663514431 shutdown_connections 2024-09-21T03:19:47.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.539+0000 7fddbb200640 1 -- 172.21.15.90:0/2663514431 >> 172.21.15.90:0/2663514431 conn(0x7fddbc06d570 msgr2=0x7fddbc0c5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:47.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.542+0000 7fddbb200640 1 -- 172.21.15.90:0/2663514431 shutdown_connections 2024-09-21T03:19:47.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:47.542+0000 7fddbb200640 1 -- 172.21.15.90:0/2663514431 wait complete. 2024-09-21T03:19:47.618 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:19:47.618 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-21T03:19:47.618 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:19:48.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.160+0000 7fb346600640 1 -- 172.21.15.90:0/67558999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3380ddd00 msgr2=0x7fb3380de110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:48.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.160+0000 7fb346600640 1 --2- 172.21.15.90:0/67558999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3380ddd00 0x7fb3380de110 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb3380323c0 tx=0x7fb33402a5c0 comp rx=0 tx=0).stop 2024-09-21T03:19:48.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.161+0000 7fb346600640 1 -- 172.21.15.90:0/67558999 shutdown_connections 2024-09-21T03:19:48.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.161+0000 7fb346600640 1 --2- 172.21.15.90:0/67558999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3380ddd00 0x7fb3380de110 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:48.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.161+0000 7fb346600640 1 --2- 172.21.15.90:0/67558999 >> v2:172.21.15.149:3300/0 conn(0x7fb33804ab80 0x7fb3380dd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:48.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.161+0000 7fb346600640 1 -- 172.21.15.90:0/67558999 >> 172.21.15.90:0/67558999 conn(0x7fb3380312e0 msgr2=0x7fb3380316f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:48.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.162+0000 7fb346600640 1 -- 172.21.15.90:0/67558999 shutdown_connections 2024-09-21T03:19:48.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.162+0000 7fb346600640 1 -- 172.21.15.90:0/67558999 wait complete. 2024-09-21T03:19:48.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.176+0000 7fb346600640 1 Processor -- start 2024-09-21T03:19:48.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.176+0000 7fb346600640 1 -- start start 2024-09-21T03:19:48.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.182+0000 7fb346600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb33804ab80 0x7fb3380d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:48.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.183+0000 7fb346600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3380d7a80 0x7fb3380cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:48.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.183+0000 7fb345200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb33804ab80 0x7fb3380d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:48.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.184+0000 7fb345200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb33804ab80 0x7fb3380d31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46726/0 (socket says 172.21.15.90:46726) 2024-09-21T03:19:48.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.184+0000 7fb346600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3380ddd00 0x7fb338165950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:48.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.184+0000 7fb346600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb3380077d0 con 0x7fb33804ab80 2024-09-21T03:19:48.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.184+0000 7fb346600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb338007650 con 0x7fb3380ddd00 2024-09-21T03:19:48.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.184+0000 7fb346600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb33804a740 con 0x7fb3380d7a80 2024-09-21T03:19:48.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.185+0000 7fb345200640 1 -- 172.21.15.90:0/872138275 learned_addr learned my addr 172.21.15.90:0/872138275 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:19:48.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.185+0000 7fb345c00640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3380ddd00 0x7fb338165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:48.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.186+0000 7fb33fe00640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3380d7a80 0x7fb3380cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:48.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.186+0000 7fb345200640 1 -- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3380d7a80 msgr2=0x7fb3380cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:48.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.186+0000 7fb345200640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3380d7a80 0x7fb3380cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:48.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.186+0000 7fb345200640 1 -- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3380ddd00 msgr2=0x7fb338165950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:48.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.186+0000 7fb345200640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3380ddd00 0x7fb338165950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:48.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.186+0000 7fb345200640 1 -- 172.21.15.90:0/872138275 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb338170d20 con 0x7fb33804ab80 2024-09-21T03:19:48.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.187+0000 7fb345c00640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3380ddd00 0x7fb338165950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:19:48.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.188+0000 7fb345200640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb33804ab80 0x7fb3380d31b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb340066830 tx=0x7fb34006a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:48.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.189+0000 7fb33cc00640 1 -- 172.21.15.90:0/872138275 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb340076b20 con 0x7fb33804ab80 2024-09-21T03:19:48.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.190+0000 7fb346600640 1 -- 172.21.15.90:0/872138275 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb338163bb0 con 0x7fb33804ab80 2024-09-21T03:19:48.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.190+0000 7fb346600640 1 -- 172.21.15.90:0/872138275 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb338170fc0 con 0x7fb33804ab80 2024-09-21T03:19:48.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.192+0000 7fb33cc00640 1 -- 172.21.15.90:0/872138275 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb340076cc0 con 0x7fb33804ab80 2024-09-21T03:19:48.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.192+0000 7fb33cc00640 1 -- 172.21.15.90:0/872138275 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb340076b20 con 0x7fb33804ab80 2024-09-21T03:19:48.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.202+0000 7fb346600640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb31c002a70 0x7fb31c004f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:48.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.202+0000 7fb346600640 1 -- 172.21.15.90:0/872138275 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c007f10 con 0x7fb31c002a70 2024-09-21T03:19:48.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.202+0000 7fb33cc00640 1 -- 172.21.15.90:0/872138275 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb34009e3f0 con 0x7fb33804ab80 2024-09-21T03:19:48.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.204+0000 7fb33cc00640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb320078fc0 0x7fb32007b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:48.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.204+0000 7fb33fe00640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb31c002a70 0x7fb31c004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:48.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.204+0000 7fb33cc00640 1 -- 172.21.15.90:0/872138275 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fb340076920 con 0x7fb33804ab80 2024-09-21T03:19:48.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.205+0000 7fb33fe00640 1 -- 172.21.15.90:0/872138275 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb31c008110 con 0x7fb31c002a70 2024-09-21T03:19:48.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.205+0000 7fb345c00640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb320078fc0 0x7fb32007b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:48.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.206+0000 7fb33fe00640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb31c002a70 0x7fb31c004f80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00d4d0 tx=0x7fb32c00d990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:48.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.207+0000 7fb345c00640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb320078fc0 0x7fb32007b4d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb334033000 tx=0x7fb334004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:48.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.209+0000 7fb33cc00640 1 -- 172.21.15.90:0/872138275 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c018020 con 0x7fb31c002a70 2024-09-21T03:19:48.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.209+0000 7fb33cc00640 1 -- 172.21.15.90:0/872138275 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb32c014620 con 0x7fb31c002a70 2024-09-21T03:19:48.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.209+0000 7fb33cc00640 1 -- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb31c002a70 msgr2=0x7fb31c004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:48.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.209+0000 7fb33cc00640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb31c002a70 0x7fb31c004f80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00d4d0 tx=0x7fb32c00d990 comp rx=0 tx=0).stop 2024-09-21T03:19:48.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.209+0000 7fb33cc00640 1 -- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb31c002a70 msgr2=0x7fb31c004f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:19:48.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.209+0000 7fb33cc00640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb31c002a70 0x7fb31c004f80 secure :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00d4d0 tx=0x7fb32c00d990 comp rx=0 tx=0).stop 2024-09-21T03:19:48.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.224+0000 7fb346600640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb31c006f80 0x7fb31c007440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:48.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.224+0000 7fb346600640 1 -- 172.21.15.90:0/872138275 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c00a4f0 con 0x7fb31c006f80 2024-09-21T03:19:48.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.224+0000 7fb33fe00640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb31c006f80 0x7fb31c007440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:48.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.231+0000 7fb33fe00640 1 -- 172.21.15.90:0/872138275 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb31c007980 con 0x7fb31c006f80 2024-09-21T03:19:48.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.236+0000 7fb33fe00640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb31c006f80 0x7fb31c007440 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00d4d0 tx=0x7fb32c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:48.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.236+0000 7fb33cc00640 1 -- 172.21.15.90:0/872138275 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c018040 con 0x7fb31c006f80 2024-09-21T03:19:48.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.241+0000 7fb33cc00640 1 -- 172.21.15.90:0/872138275 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5194 (secure 0 0 0) 0x7fb32c01f2c0 con 0x7fb31c006f80 2024-09-21T03:19:48.245 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:19:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:19:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:19:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:19:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 36, 2024-09-21T03:19:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 339027, 2024-09-21T03:19:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:19:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:19:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:19:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:19:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 17, 2024-09-21T03:19:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:19:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:19:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:19:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:19:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:19:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:19:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:19:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:19:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:19:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:19:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:19:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:19:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:19:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:19:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:19:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:19:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:19:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:19:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:19:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:19:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:19:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:19:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:19:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:19:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:19:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:19:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:19:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:19:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:19:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:19:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:19:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:19:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:19:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:19:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:19:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:19:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:19:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:19:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:19:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:19:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:19:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:19:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:19:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:19:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:19:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:19:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:19:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:19:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:19:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:19:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:19:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:19:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:19:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:19:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:19:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:19:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:19:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:19:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:19:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:19:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:19:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:19:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:19:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:19:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:19:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:19:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:19:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:19:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:19:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:19:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:19:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:19:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:19:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:19:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:19:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:19:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:19:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:19:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:19:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:19:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:19:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:19:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:19:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:19:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:19:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:19:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:19:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:19:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:19:48.254 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:48.254 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.254 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.254 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:19:48.254 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:19:48.254 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:48.254 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:48.254 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:48.254 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.254 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:19:48.254 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:19:48.254 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:19:48.254 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:19:48.254 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:19:48.254 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:48.255 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:48.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.255 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:19:48.255 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:19:48.255 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.255 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:48.255 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:48.255 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:19:48.255 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:48.255 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:48.255 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:19:48.255 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.255 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:48.255 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:48.255 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:19:48.256 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:48.256 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:48.256 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:19:48.256 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.256 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:48.256 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:48.256 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:19:48.256 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:48.256 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:48.256 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:19:48.256 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.256 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:19:48.256 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:19:48.256 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:19:48.257 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.257 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.257 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:48.257 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:48.257 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5 2024-09-21T03:19:48.257 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:48.257 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:48.257 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:19:48.257 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.257 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:48.257 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:48.257 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:19:48.257 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:48.257 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:48.257 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.258 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:19:48.258 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:19:48.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.243+0000 7fb33cc00640 1 -- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb31c006f80 msgr2=0x7fb31c007440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:48.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.243+0000 7fb33cc00640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb31c006f80 0x7fb31c007440 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00d4d0 tx=0x7fb32c004730 comp rx=0 tx=0).stop 2024-09-21T03:19:48.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.243+0000 7fb33cc00640 1 -- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb31c006f80 msgr2=0x7fb31c007440 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:19:48.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.243+0000 7fb33cc00640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb31c006f80 0x7fb31c007440 secure :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00d4d0 tx=0x7fb32c004730 comp rx=0 tx=0).stop 2024-09-21T03:19:48.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.243+0000 7fb346600640 1 -- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb320078fc0 msgr2=0x7fb32007b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:48.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.244+0000 7fb346600640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb320078fc0 0x7fb32007b4d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb334033000 tx=0x7fb334004730 comp rx=0 tx=0).stop 2024-09-21T03:19:48.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.244+0000 7fb345c00640 1 -- 172.21.15.90:0/872138275 reap_dead start 2024-09-21T03:19:48.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.244+0000 7fb346600640 1 -- 172.21.15.90:0/872138275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb33804ab80 msgr2=0x7fb3380d31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:48.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.244+0000 7fb346600640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb33804ab80 0x7fb3380d31b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb340066830 tx=0x7fb34006a1d0 comp rx=0 tx=0).stop 2024-09-21T03:19:48.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.244+0000 7fb346600640 1 -- 172.21.15.90:0/872138275 shutdown_connections 2024-09-21T03:19:48.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.244+0000 7fb346600640 1 --2- 172.21.15.90:0/872138275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb33804ab80 0x7fb3380d31b0 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb340066830 tx=0x7fb34006a1d0 comp rx=0 tx=0).stop 2024-09-21T03:19:48.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.244+0000 7fb346600640 1 -- 172.21.15.90:0/872138275 >> 172.21.15.90:0/872138275 conn(0x7fb3380312e0 msgr2=0x7fb3380d6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:48.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.244+0000 7fb346600640 1 -- 172.21.15.90:0/872138275 shutdown_connections 2024-09-21T03:19:48.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.245+0000 7fb346600640 1 -- 172.21.15.90:0/872138275 wait complete. 2024-09-21T03:19:48.302 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:19:48.302 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-21T03:19:48.302 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:19:48.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.863+0000 7f9477000640 1 -- 172.21.15.90:0/2856789625 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94700cbd20 msgr2=0x7f94701541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:48.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.863+0000 7f9477000640 1 --2- 172.21.15.90:0/2856789625 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94700cbd20 0x7f94701541e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9460009830 tx=0x7f946002a4b0 comp rx=0 tx=0).stop 2024-09-21T03:19:48.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.864+0000 7f9477000640 1 -- 172.21.15.90:0/2856789625 shutdown_connections 2024-09-21T03:19:48.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.864+0000 7f9477000640 1 --2- 172.21.15.90:0/2856789625 >> v2:172.21.15.90:3300/0 conn(0x7f9470156cc0 0x7f94701570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:48.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.864+0000 7f9477000640 1 --2- 172.21.15.90:0/2856789625 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94700cbd20 0x7f94701541e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:48.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.864+0000 7f9477000640 1 -- 172.21.15.90:0/2856789625 >> 172.21.15.90:0/2856789625 conn(0x7f9470075110 msgr2=0x7f94700cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:48.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.865+0000 7f9477000640 1 -- 172.21.15.90:0/2856789625 shutdown_connections 2024-09-21T03:19:48.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.865+0000 7f9477000640 1 -- 172.21.15.90:0/2856789625 wait complete. 2024-09-21T03:19:48.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.869+0000 7f9477000640 1 Processor -- start 2024-09-21T03:19:48.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.869+0000 7f9477000640 1 -- start start 2024-09-21T03:19:48.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.871+0000 7f9477000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94700cae60 0x7f94701f2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:48.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.871+0000 7f9477000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94700cbd20 0x7f94701561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:48.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.871+0000 7f9477000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9470156cc0 0x7f94701497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:48.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.871+0000 7f9477000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f94700c8b70 con 0x7f94700cbd20 2024-09-21T03:19:48.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.872+0000 7f9477000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f94700c89f0 con 0x7f94700cae60 2024-09-21T03:19:48.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.872+0000 7f9477000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f94700c9510 con 0x7f9470156cc0 2024-09-21T03:19:48.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.874+0000 7f946fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94700cae60 0x7f94701f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:48.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.874+0000 7f946fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94700cae60 0x7f94701f2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:38920/0 (socket says 172.21.15.90:38920) 2024-09-21T03:19:48.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.874+0000 7f946fe00640 1 -- 172.21.15.90:0/3190086818 learned_addr learned my addr 172.21.15.90:0/3190086818 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:19:48.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.874+0000 7f946fe00640 1 -- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9470156cc0 msgr2=0x7f94701497c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:19:48.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.874+0000 7f946fe00640 1 --2- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9470156cc0 0x7f94701497c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:48.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.874+0000 7f946fe00640 1 -- 172.21.15.90:0/3190086818 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94700cbd20 msgr2=0x7f94701561c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:19:48.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.874+0000 7f946fe00640 1 --2- 172.21.15.90:0/3190086818 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94700cbd20 0x7f94701561c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:48.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.874+0000 7f946fe00640 1 -- 172.21.15.90:0/3190086818 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94701e0890 con 0x7f94700cae60 2024-09-21T03:19:48.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.875+0000 7f946fe00640 1 --2- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94700cae60 0x7f94701f2590 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9460000c00 tx=0x7f9460003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:48.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.876+0000 7f9467e00640 1 -- 172.21.15.90:0/3190086818 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94600317b0 con 0x7f94700cae60 2024-09-21T03:19:48.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.876+0000 7f9467e00640 1 -- 172.21.15.90:0/3190086818 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9460031950 con 0x7f94700cae60 2024-09-21T03:19:48.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.876+0000 7f9467e00640 1 -- 172.21.15.90:0/3190086818 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9460031da0 con 0x7f94700cae60 2024-09-21T03:19:48.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.876+0000 7f9477000640 1 -- 172.21.15.90:0/3190086818 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94701e2e10 con 0x7f94700cae60 2024-09-21T03:19:48.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.878+0000 7f9477000640 1 -- 172.21.15.90:0/3190086818 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94700ae8d0 con 0x7f94700cae60 2024-09-21T03:19:48.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.886+0000 7f9477000640 1 --2- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94701e0b90 0x7f9470149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:48.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.886+0000 7f9477000640 1 -- 172.21.15.90:0/3190086818 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f947014e430 con 0x7f94701e0b90 2024-09-21T03:19:48.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.889+0000 7f946f400640 1 --2- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94701e0b90 0x7f9470149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:48.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.890+0000 7f946f400640 1 -- 172.21.15.90:0/3190086818 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f947014a240 con 0x7f94701e0b90 2024-09-21T03:19:48.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.891+0000 7f946f400640 1 --2- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94701e0b90 0x7f9470149d00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f94700ae690 tx=0x7f945c00c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:48.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.892+0000 7f9467e00640 1 -- 172.21.15.90:0/3190086818 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945c017070 con 0x7f94701e0b90 2024-09-21T03:19:48.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.893+0000 7f9467e00640 1 -- 172.21.15.90:0/3190086818 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f945c0035f0 con 0x7f94701e0b90 2024-09-21T03:19:48.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.894+0000 7f9467e00640 1 -- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94701e0b90 msgr2=0x7f9470149d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:48.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.894+0000 7f9467e00640 1 --2- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94701e0b90 0x7f9470149d00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f94700ae690 tx=0x7f945c00c7a0 comp rx=0 tx=0).stop 2024-09-21T03:19:48.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.894+0000 7f9467e00640 1 -- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94701e0b90 msgr2=0x7f9470149d00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:19:48.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.895+0000 7f9467e00640 1 --2- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94701e0b90 0x7f9470149d00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:48.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.895+0000 7f9467e00640 1 -- 172.21.15.90:0/3190086818 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f946003b410 con 0x7f94700cae60 2024-09-21T03:19:48.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.898+0000 7f9467e00640 1 --2- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9450078650 0x7f945007ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:48.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.898+0000 7f9467e00640 1 -- 172.21.15.90:0/3190086818 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f94600bc2d0 con 0x7f94700cae60 2024-09-21T03:19:48.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.900+0000 7f946f400640 1 --2- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9450078650 0x7f945007ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:48.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.909+0000 7f946f400640 1 --2- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9450078650 0x7f945007ab60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f945c000c00 tx=0x7f945c005000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:48.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.913+0000 7f9477000640 1 --2- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94701e11e0 0x7f94701f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:48.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.913+0000 7f9477000640 1 -- 172.21.15.90:0/3190086818 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f94701e0640 con 0x7f94701e11e0 2024-09-21T03:19:48.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.914+0000 7f9475000640 1 --2- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94701e11e0 0x7f94701f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:48.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.915+0000 7f9475000640 1 -- 172.21.15.90:0/3190086818 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9470155560 con 0x7f94701e11e0 2024-09-21T03:19:48.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.916+0000 7f9475000640 1 --2- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94701e11e0 0x7f94701f4f10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9470157dc0 tx=0x7f946800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:48.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.916+0000 7f9467e00640 1 -- 172.21.15.90:0/3190086818 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946800ccc0 con 0x7f94701e11e0 2024-09-21T03:19:48.918 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:19:48.918 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:19:48.918 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:19:48.919 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:19:48.919 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 36, 2024-09-21T03:19:48.919 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 104382, 2024-09-21T03:19:48.919 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:19:48.919 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:19:48.919 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:19:48.919 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:19:48.919 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:48.919 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 18, 2024-09-21T03:19:48.919 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:19:48.919 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:19:48.919 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:19:48.919 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:19:48.919 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:19:48.920 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:19:48.920 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:19:48.920 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:19:48.920 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:19:48.920 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:19:48.920 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:19:48.920 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:19:48.920 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:19:48.920 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:19:48.920 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:48.920 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:19:48.920 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:19:48.920 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:19:48.921 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:19:48.921 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:19:48.921 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:19:48.921 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:19:48.921 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:19:48.921 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:19:48.921 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:19:48.921 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:19:48.921 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:19:48.921 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:19:48.921 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:48.921 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.921 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:19:48.921 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:19:48.922 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:19:48.922 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:19:48.922 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:19:48.922 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:19:48.922 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:19:48.922 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:19:48.922 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:19:48.922 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:19:48.922 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:19:48.922 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:19:48.922 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:19:48.922 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:19:48.922 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:19:48.922 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:19:48.922 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:19:48.923 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:19:48.923 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:19:48.923 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:19:48.923 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:19:48.923 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:19:48.923 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:19:48.923 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:19:48.923 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:19:48.923 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:19:48.923 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:19:48.923 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:19:48.923 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:48.923 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:19:48.923 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.923 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:19:48.924 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.924 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:19:48.924 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:19:48.924 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:19:48.924 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:19:48.924 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.924 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:19:48.924 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:19:48.924 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:48.924 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.924 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.924 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:19:48.924 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:19:48.924 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:48.924 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:48.925 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:48.925 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.925 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:19:48.925 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:19:48.925 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:19:48.925 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:19:48.925 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:19:48.925 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.925 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.925 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:19:48.925 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:19:48.925 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:19:48.925 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:19:48.925 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.926 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:19:48.926 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:19:48.926 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:48.926 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.926 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.926 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:19:48.926 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:19:48.926 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:48.926 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:48.926 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:48.926 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.926 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:19:48.926 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:19:48.926 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:19:48.927 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:19:48.927 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:19:48.927 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.927 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.927 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:19:48.927 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:19:48.927 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:19:48.927 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:19:48.927 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.927 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:19:48.927 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:19:48.927 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:48.927 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.927 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.927 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:19:48.928 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:19:48.928 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:19:48.928 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:48.928 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:48.928 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.928 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:19:48.928 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:19:48.928 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:19:48.928 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:19:48.928 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:19:48.928 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:48.928 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:48.928 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.928 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:19:48.929 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:19:48.929 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.929 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:48.929 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:48.929 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:19:48.929 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:48.929 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:48.929 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:19:48.929 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.929 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:48.929 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:48.929 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:19:48.929 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:48.929 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:48.929 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:19:48.930 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.930 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:48.930 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:48.930 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:19:48.930 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:48.930 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:19:48.930 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:19:48.930 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.930 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:19:48.930 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:19:48.930 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:19:48.930 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.930 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:19:48.930 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:19:48.931 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:19:48.931 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:19:48.931 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:19:48.931 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:19:48.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:19:48.931 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:19:48.931 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:19:48.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.916+0000 7f9467e00640 1 -- 172.21.15.90:0/3190086818 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5027 (secure 0 0 0) 0x7f946800ccc0 con 0x7f94701e11e0 2024-09-21T03:19:48.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.916+0000 7f9467e00640 1 -- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94701e11e0 msgr2=0x7f94701f4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:48.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.916+0000 7f9467e00640 1 --2- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94701e11e0 0x7f94701f4f10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9470157dc0 tx=0x7f946800edf0 comp rx=0 tx=0).stop 2024-09-21T03:19:48.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.917+0000 7f9467e00640 1 -- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94701e11e0 msgr2=0x7f94701f4f10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:19:48.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.917+0000 7f9467e00640 1 --2- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94701e11e0 0x7f94701f4f10 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9470157dc0 tx=0x7f946800edf0 comp rx=0 tx=0).stop 2024-09-21T03:19:48.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.918+0000 7f9477000640 1 -- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9450078650 msgr2=0x7f945007ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:48.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.919+0000 7f9477000640 1 --2- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9450078650 0x7f945007ab60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f945c000c00 tx=0x7f945c005000 comp rx=0 tx=0).stop 2024-09-21T03:19:48.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.919+0000 7f9477000640 1 -- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94700cae60 msgr2=0x7f94701f2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:48.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.919+0000 7f9475000640 1 -- 172.21.15.90:0/3190086818 reap_dead start 2024-09-21T03:19:48.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.919+0000 7f9477000640 1 --2- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94700cae60 0x7f94701f2590 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9460000c00 tx=0x7f9460003b90 comp rx=0 tx=0).stop 2024-09-21T03:19:48.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.919+0000 7f9477000640 1 -- 172.21.15.90:0/3190086818 shutdown_connections 2024-09-21T03:19:48.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.920+0000 7f9477000640 1 --2- 172.21.15.90:0/3190086818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94700cae60 0x7f94701f2590 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:48.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.920+0000 7f9477000640 1 -- 172.21.15.90:0/3190086818 >> 172.21.15.90:0/3190086818 conn(0x7f9470075110 msgr2=0x7f94700c5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:48.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.920+0000 7f9477000640 1 -- 172.21.15.90:0/3190086818 shutdown_connections 2024-09-21T03:19:48.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:48.920+0000 7f9477000640 1 -- 172.21.15.90:0/3190086818 wait complete. 2024-09-21T03:19:48.968 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:19:48.968 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-21T03:19:48.968 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-21T03:19:48.968 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-21T03:19:48.968 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-21T03:19:48.968 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-21T03:19:48.968 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:19:49.036 INFO:tasks.ceph.mon.c:Stopped 2024-09-21T03:19:49.036 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-21T03:19:49.036 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:19:49.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.589+0000 7f988a600640 1 -- 172.21.15.90:0/1430055129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98840c5070 msgr2=0x7f98840c2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:49.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.589+0000 7f988a600640 1 --2- 172.21.15.90:0/1430055129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98840c5070 0x7f98840c2aa0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f98841641f0 tx=0x7f987c02c9f0 comp rx=0 tx=0).stop 2024-09-21T03:19:49.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.590+0000 7f988a600640 1 -- 172.21.15.90:0/1430055129 shutdown_connections 2024-09-21T03:19:49.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.590+0000 7f988a600640 1 --2- 172.21.15.90:0/1430055129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98840c5070 0x7f98840c2aa0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:49.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.590+0000 7f988a600640 1 --2- 172.21.15.90:0/1430055129 >> v2:172.21.15.149:3300/0 conn(0x7f988406ea40 0x7f98840c4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:49.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.590+0000 7f988a600640 1 -- 172.21.15.90:0/1430055129 >> 172.21.15.90:0/1430055129 conn(0x7f98840c80a0 msgr2=0x7f98840c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:49.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.592+0000 7f988a600640 1 -- 172.21.15.90:0/1430055129 shutdown_connections 2024-09-21T03:19:49.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.593+0000 7f988a600640 1 -- 172.21.15.90:0/1430055129 wait complete. 2024-09-21T03:19:49.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.598+0000 7f988a600640 1 Processor -- start 2024-09-21T03:19:49.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.598+0000 7f988a600640 1 -- start start 2024-09-21T03:19:49.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.601+0000 7f988a600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f988406ea40 0x7f988415b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:49.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.601+0000 7f988a600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98840c42d0 0x7f9884160260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:49.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.601+0000 7f988a600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98840c5070 0x7f98840c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:49.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.602+0000 7f988a600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f98840c4930 con 0x7f98840c5070 2024-09-21T03:19:49.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.602+0000 7f988a600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f98840c47b0 con 0x7f988406ea40 2024-09-21T03:19:49.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.602+0000 7f988a600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9884164500 con 0x7f98840c42d0 2024-09-21T03:19:49.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.602+0000 7f9883e00640 1 -- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98840c42d0 msgr2=0x7f9884160260 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:19:49.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.602+0000 7f9889200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f988406ea40 0x7f988415b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:49.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.602+0000 7f9883e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98840c42d0 0x7f9884160260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:19:49.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.603+0000 7f9889c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98840c5070 0x7f98840c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:49.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.603+0000 7f9889200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f988406ea40 0x7f988415b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:38970/0 (socket says 172.21.15.90:38970) 2024-09-21T03:19:49.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.603+0000 7f9889200640 1 -- 172.21.15.90:0/4280996126 learned_addr learned my addr 172.21.15.90:0/4280996126 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:19:49.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.604+0000 7f9889c00640 1 -- 172.21.15.90:0/4280996126 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98840c42d0 msgr2=0x7f9884160260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:19:49.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.604+0000 7f9889c00640 1 --2- 172.21.15.90:0/4280996126 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98840c42d0 0x7f9884160260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:49.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.604+0000 7f9889c00640 1 -- 172.21.15.90:0/4280996126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f988406ea40 msgr2=0x7f988415b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:49.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.604+0000 7f9889c00640 1 --2- 172.21.15.90:0/4280996126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f988406ea40 0x7f988415b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:49.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.604+0000 7f9889c00640 1 -- 172.21.15.90:0/4280996126 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988415bad0 con 0x7f98840c5070 2024-09-21T03:19:49.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.605+0000 7f9889c00640 1 --2- 172.21.15.90:0/4280996126 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98840c5070 0x7f98840c6bb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f987c033000 tx=0x7f987c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:49.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.606+0000 7f9880c00640 1 -- 172.21.15.90:0/4280996126 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c040020 con 0x7f98840c5070 2024-09-21T03:19:49.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.606+0000 7f9880c00640 1 -- 172.21.15.90:0/4280996126 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f987c0045f0 con 0x7f98840c5070 2024-09-21T03:19:49.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.606+0000 7f9880c00640 1 -- 172.21.15.90:0/4280996126 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c035040 con 0x7f98840c5070 2024-09-21T03:19:49.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.607+0000 7f988a600640 1 -- 172.21.15.90:0/4280996126 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9884164a50 con 0x7f98840c5070 2024-09-21T03:19:49.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.607+0000 7f988a600640 1 -- 172.21.15.90:0/4280996126 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f988415bd80 con 0x7f98840c5070 2024-09-21T03:19:49.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.613+0000 7f9880c00640 1 -- 172.21.15.90:0/4280996126 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f987c043020 con 0x7f98840c5070 2024-09-21T03:19:49.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.615+0000 7f9880c00640 1 --2- 172.21.15.90:0/4280996126 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9864078b40 0x7f986407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:49.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.615+0000 7f9880c00640 1 -- 172.21.15.90:0/4280996126 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f987c0bb7f0 con 0x7f98840c5070 2024-09-21T03:19:49.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.615+0000 7f9889200640 1 --2- 172.21.15.90:0/4280996126 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9864078b40 0x7f986407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:49.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.617+0000 7f9889200640 1 --2- 172.21.15.90:0/4280996126 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9864078b40 0x7f986407b050 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f98740046b0 tx=0x7f9874007f50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:49.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.617+0000 7f988a600640 1 -- 172.21.15.90:0/4280996126 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f988408c9f0 con 0x7f98840c5070 2024-09-21T03:19:49.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:49.628+0000 7f9880c00640 1 -- 172.21.15.90:0/4280996126 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f987c04a020 con 0x7f98840c5070 2024-09-21T03:19:50.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:50.339+0000 7f988a600640 1 -- 172.21.15.90:0/4280996126 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f988406df10 con 0x7f98840c5070 2024-09-21T03:19:50.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:50.340+0000 7f9880c00640 1 -- 172.21.15.90:0/4280996126 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f987c0838f0 con 0x7f98840c5070 2024-09-21T03:19:50.342 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:19:50.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:50.351+0000 7f988a600640 1 -- 172.21.15.90:0/4280996126 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9864078b40 msgr2=0x7f986407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:50.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:50.351+0000 7f988a600640 1 --2- 172.21.15.90:0/4280996126 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9864078b40 0x7f986407b050 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f98740046b0 tx=0x7f9874007f50 comp rx=0 tx=0).stop 2024-09-21T03:19:50.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:50.351+0000 7f988a600640 1 -- 172.21.15.90:0/4280996126 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98840c5070 msgr2=0x7f98840c6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:50.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:50.351+0000 7f988a600640 1 --2- 172.21.15.90:0/4280996126 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98840c5070 0x7f98840c6bb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f987c033000 tx=0x7f987c004270 comp rx=0 tx=0).stop 2024-09-21T03:19:50.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:50.352+0000 7f988a600640 1 -- 172.21.15.90:0/4280996126 shutdown_connections 2024-09-21T03:19:50.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:50.352+0000 7f988a600640 1 --2- 172.21.15.90:0/4280996126 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9864078b40 0x7f986407b050 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:50.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:50.352+0000 7f988a600640 1 --2- 172.21.15.90:0/4280996126 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98840c5070 0x7f98840c6bb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:50.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:50.352+0000 7f988a600640 1 --2- 172.21.15.90:0/4280996126 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98840c42d0 0x7f9884160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:50.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:50.352+0000 7f988a600640 1 --2- 172.21.15.90:0/4280996126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f988406ea40 0x7f988415b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:50.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:50.352+0000 7f988a600640 1 -- 172.21.15.90:0/4280996126 >> 172.21.15.90:0/4280996126 conn(0x7f98840c80a0 msgr2=0x7f98840c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:50.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:50.353+0000 7f988a600640 1 -- 172.21.15.90:0/4280996126 shutdown_connections 2024-09-21T03:19:50.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:50.353+0000 7f988a600640 1 -- 172.21.15.90:0/4280996126 wait complete. 2024-09-21T03:19:53.408 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:19:53.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:53.995+0000 7fe27b600640 1 -- 172.21.15.90:0/2649796264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe27406ef00 msgr2=0x7fe27406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:53.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:53.996+0000 7fe27b600640 1 --2- 172.21.15.90:0/2649796264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe27406ef00 0x7fe27406f310 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe268007350 tx=0x7fe26802b1c0 comp rx=0 tx=0).stop 2024-09-21T03:19:53.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:53.996+0000 7fe27b600640 1 -- 172.21.15.90:0/2649796264 shutdown_connections 2024-09-21T03:19:53.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:53.996+0000 7fe27b600640 1 --2- 172.21.15.90:0/2649796264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe27415b650 0x7fe27415da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:53.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:53.996+0000 7fe27b600640 1 --2- 172.21.15.90:0/2649796264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe27406ef00 0x7fe27406f310 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:53.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:53.996+0000 7fe27b600640 1 -- 172.21.15.90:0/2649796264 >> 172.21.15.90:0/2649796264 conn(0x7fe2740c8ba0 msgr2=0x7fe27406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:54.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:53.997+0000 7fe27b600640 1 -- 172.21.15.90:0/2649796264 shutdown_connections 2024-09-21T03:19:54.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:53.998+0000 7fe27b600640 1 -- 172.21.15.90:0/2649796264 wait complete. 2024-09-21T03:19:54.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.012+0000 7fe27b600640 1 Processor -- start 2024-09-21T03:19:54.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.012+0000 7fe27b600640 1 -- start start 2024-09-21T03:19:54.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.020+0000 7fe27b600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe27406ef00 0x7fe274156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:54.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.020+0000 7fe27b600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe274150320 0x7fe2740c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:54.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.020+0000 7fe27b600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe27415b650 0x7fe2741550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:54.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.021+0000 7fe279600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe27415b650 0x7fe2741550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:54.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.021+0000 7fe279600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe27415b650 0x7fe2741550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46780/0 (socket says 172.21.15.90:46780) 2024-09-21T03:19:54.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.021+0000 7fe279600640 1 -- 172.21.15.90:0/1023996426 learned_addr learned my addr 172.21.15.90:0/1023996426 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:19:54.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.021+0000 7fe27b600640 1 -- 172.21.15.90:0/1023996426 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe27406f850 con 0x7fe27415b650 2024-09-21T03:19:54.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.021+0000 7fe27b600640 1 -- 172.21.15.90:0/1023996426 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe2740ad720 con 0x7fe27406ef00 2024-09-21T03:19:54.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.022+0000 7fe273e00640 1 -- 172.21.15.90:0/1023996426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe274150320 msgr2=0x7fe2740c6d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:19:54.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.022+0000 7fe273e00640 1 --2- 172.21.15.90:0/1023996426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe274150320 0x7fe2740c6d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:19:54.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.022+0000 7fe27b600640 1 -- 172.21.15.90:0/1023996426 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe274153ab0 con 0x7fe274150320 2024-09-21T03:19:54.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.022+0000 7fe278c00640 1 --2- 172.21.15.90:0/1023996426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe27406ef00 0x7fe274156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:54.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.023+0000 7fe278c00640 1 -- 172.21.15.90:0/1023996426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe274150320 msgr2=0x7fe2740c6d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:19:54.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.023+0000 7fe278c00640 1 --2- 172.21.15.90:0/1023996426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe274150320 0x7fe2740c6d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:54.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.023+0000 7fe278c00640 1 -- 172.21.15.90:0/1023996426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe27415b650 msgr2=0x7fe2741550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:54.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.024+0000 7fe278c00640 1 --2- 172.21.15.90:0/1023996426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe27415b650 0x7fe2741550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:54.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.024+0000 7fe278c00640 1 -- 172.21.15.90:0/1023996426 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2741ea1f0 con 0x7fe27406ef00 2024-09-21T03:19:54.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.024+0000 7fe279600640 1 --2- 172.21.15.90:0/1023996426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe27415b650 0x7fe2741550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:19:54.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.026+0000 7fe278c00640 1 --2- 172.21.15.90:0/1023996426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe27406ef00 0x7fe274156580 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe26400c370 tx=0x7fe26400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:54.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.027+0000 7fe270c00640 1 -- 172.21.15.90:0/1023996426 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe264011790 con 0x7fe27406ef00 2024-09-21T03:19:54.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.028+0000 7fe27b600640 1 -- 172.21.15.90:0/1023996426 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe274148bf0 con 0x7fe27406ef00 2024-09-21T03:19:54.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.028+0000 7fe27b600640 1 -- 172.21.15.90:0/1023996426 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe27415a680 con 0x7fe27406ef00 2024-09-21T03:19:54.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.029+0000 7fe270c00640 1 -- 172.21.15.90:0/1023996426 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe264017070 con 0x7fe27406ef00 2024-09-21T03:19:54.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.029+0000 7fe270c00640 1 -- 172.21.15.90:0/1023996426 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe264011790 con 0x7fe27406ef00 2024-09-21T03:19:54.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.031+0000 7fe27b600640 1 -- 172.21.15.90:0/1023996426 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe250005290 con 0x7fe27406ef00 2024-09-21T03:19:54.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.034+0000 7fe270c00640 1 -- 172.21.15.90:0/1023996426 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe264011a60 con 0x7fe27406ef00 2024-09-21T03:19:54.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.036+0000 7fe270c00640 1 --2- 172.21.15.90:0/1023996426 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe258078d70 0x7fe25807b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:54.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.036+0000 7fe270c00640 1 -- 172.21.15.90:0/1023996426 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fe26409a9d0 con 0x7fe27406ef00 2024-09-21T03:19:54.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.037+0000 7fe273e00640 1 --2- 172.21.15.90:0/1023996426 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe258078d70 0x7fe25807b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:54.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.039+0000 7fe273e00640 1 --2- 172.21.15.90:0/1023996426 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe258078d70 0x7fe25807b280 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe268034000 tx=0x7fe26802d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:54.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.047+0000 7fe270c00640 1 -- 172.21.15.90:0/1023996426 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe2640626c0 con 0x7fe27406ef00 2024-09-21T03:19:54.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.718+0000 7fe27b600640 1 -- 172.21.15.90:0/1023996426 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe250005580 con 0x7fe27406ef00 2024-09-21T03:19:54.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.721+0000 7fe270c00640 1 -- 172.21.15.90:0/1023996426 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7fe2640670f0 con 0x7fe27406ef00 2024-09-21T03:19:54.726 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:19:54.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.725+0000 7fe27b600640 1 -- 172.21.15.90:0/1023996426 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe258078d70 msgr2=0x7fe25807b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:54.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.725+0000 7fe27b600640 1 --2- 172.21.15.90:0/1023996426 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe258078d70 0x7fe25807b280 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe268034000 tx=0x7fe26802d040 comp rx=0 tx=0).stop 2024-09-21T03:19:54.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.725+0000 7fe27b600640 1 -- 172.21.15.90:0/1023996426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe27406ef00 msgr2=0x7fe274156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:54.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.725+0000 7fe27b600640 1 --2- 172.21.15.90:0/1023996426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe27406ef00 0x7fe274156580 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe26400c370 tx=0x7fe26400c830 comp rx=0 tx=0).stop 2024-09-21T03:19:54.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.726+0000 7fe27b600640 1 -- 172.21.15.90:0/1023996426 shutdown_connections 2024-09-21T03:19:54.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.726+0000 7fe27b600640 1 --2- 172.21.15.90:0/1023996426 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe258078d70 0x7fe25807b280 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:54.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.726+0000 7fe27b600640 1 --2- 172.21.15.90:0/1023996426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe27415b650 0x7fe2741550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:54.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.726+0000 7fe27b600640 1 --2- 172.21.15.90:0/1023996426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe274150320 0x7fe2740c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:54.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.726+0000 7fe27b600640 1 --2- 172.21.15.90:0/1023996426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe27406ef00 0x7fe274156580 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:54.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.726+0000 7fe27b600640 1 -- 172.21.15.90:0/1023996426 >> 172.21.15.90:0/1023996426 conn(0x7fe2740c8ba0 msgr2=0x7fe27414dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:54.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.727+0000 7fe27b600640 1 -- 172.21.15.90:0/1023996426 shutdown_connections 2024-09-21T03:19:54.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:19:54.728+0000 7fe27b600640 1 -- 172.21.15.90:0/1023996426 wait complete. 2024-09-21T03:19:57.785 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:19:59.389 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:19:59.401 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:20:03.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.143+0000 7fa39c200640 1 -- 172.21.15.90:0/4019178357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0039b0 msgr2=0x7fa37c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:03.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.143+0000 7fa39c200640 1 --2- 172.21.15.90:0/4019178357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0039b0 0x7fa37c003e00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa38800deb0 tx=0x7fa37c005830 comp rx=0 tx=0).stop 2024-09-21T03:20:03.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.144+0000 7fa39c200640 1 -- 172.21.15.90:0/4019178357 shutdown_connections 2024-09-21T03:20:03.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.144+0000 7fa39c200640 1 --2- 172.21.15.90:0/4019178357 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa37c0053a0 0x7fa37c00ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:03.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.144+0000 7fa39c200640 1 --2- 172.21.15.90:0/4019178357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa37c004800 0x7fa37c004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:03.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.144+0000 7fa39c200640 1 --2- 172.21.15.90:0/4019178357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0039b0 0x7fa37c003e00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:03.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.144+0000 7fa39c200640 1 -- 172.21.15.90:0/4019178357 >> 172.21.15.90:0/4019178357 conn(0x7fa3940c8ba0 msgr2=0x7fa39406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:03.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.145+0000 7fa39c200640 1 -- 172.21.15.90:0/4019178357 shutdown_connections 2024-09-21T03:20:03.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.145+0000 7fa39c200640 1 -- 172.21.15.90:0/4019178357 wait complete. 2024-09-21T03:20:03.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.150+0000 7fa39c200640 1 Processor -- start 2024-09-21T03:20:03.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.150+0000 7fa39c200640 1 -- start start 2024-09-21T03:20:03.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.153+0000 7fa39c200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0039b0 0x7fa394155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:03.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.154+0000 7fa39c200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa37c004800 0x7fa3941f08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:03.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.154+0000 7fa39c200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa37c0053a0 0x7fa3941479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:03.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.154+0000 7fa39c200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa394153ab0 con 0x7fa37c0039b0 2024-09-21T03:20:03.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.154+0000 7fa39a200640 1 -- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa37c0053a0 msgr2=0x7fa3941479d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:20:03.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.155+0000 7fa39a200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa37c0053a0 0x7fa3941479d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:20:03.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.155+0000 7fa398e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa37c004800 0x7fa3941f08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:03.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.155+0000 7fa398e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa37c004800 0x7fa3941f08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:41510/0 (socket says 172.21.15.90:41510) 2024-09-21T03:20:03.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.155+0000 7fa398e00640 1 -- 172.21.15.90:0/763315994 learned_addr learned my addr 172.21.15.90:0/763315994 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:20:03.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.157+0000 7fa39c200640 1 -- 172.21.15.90:0/763315994 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa394074ec0 con 0x7fa37c004800 2024-09-21T03:20:03.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.157+0000 7fa39c200640 1 -- 172.21.15.90:0/763315994 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa394154c20 con 0x7fa37c0053a0 2024-09-21T03:20:03.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.159+0000 7fa398e00640 1 -- 172.21.15.90:0/763315994 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa37c0053a0 msgr2=0x7fa3941479d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:20:03.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.159+0000 7fa398e00640 1 --2- 172.21.15.90:0/763315994 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa37c0053a0 0x7fa3941479d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:03.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.159+0000 7fa398e00640 1 -- 172.21.15.90:0/763315994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0039b0 msgr2=0x7fa394155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:03.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.159+0000 7fa398e00640 1 --2- 172.21.15.90:0/763315994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0039b0 0x7fa394155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:03.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.159+0000 7fa398e00640 1 -- 172.21.15.90:0/763315994 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3941555c0 con 0x7fa37c004800 2024-09-21T03:20:03.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.161+0000 7fa398e00640 1 --2- 172.21.15.90:0/763315994 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa37c004800 0x7fa3941f08d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa380005f10 tx=0x7fa380013f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:03.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.180+0000 7fa391600640 1 -- 172.21.15.90:0/763315994 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa380011db0 con 0x7fa37c004800 2024-09-21T03:20:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.181+0000 7fa39c200640 1 -- 172.21.15.90:0/763315994 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3940734c0 con 0x7fa37c004800 2024-09-21T03:20:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.181+0000 7fa39c200640 1 -- 172.21.15.90:0/763315994 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa394156070 con 0x7fa37c004800 2024-09-21T03:20:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.181+0000 7fa391600640 1 -- 172.21.15.90:0/763315994 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa38001d4e0 con 0x7fa37c004800 2024-09-21T03:20:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.181+0000 7fa391600640 1 -- 172.21.15.90:0/763315994 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38001d970 con 0x7fa37c004800 2024-09-21T03:20:03.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.183+0000 7fa39c200640 1 -- 172.21.15.90:0/763315994 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa370005290 con 0x7fa37c004800 2024-09-21T03:20:03.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.186+0000 7fa391600640 1 -- 172.21.15.90:0/763315994 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa380024020 con 0x7fa37c004800 2024-09-21T03:20:03.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.189+0000 7fa391600640 1 --2- 172.21.15.90:0/763315994 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa3740798a0 0x7fa37407bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:03.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.189+0000 7fa391600640 1 -- 172.21.15.90:0/763315994 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fa38009c920 con 0x7fa37c004800 2024-09-21T03:20:03.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.194+0000 7fa399800640 1 --2- 172.21.15.90:0/763315994 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa3740798a0 0x7fa37407bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:03.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.197+0000 7fa399800640 1 --2- 172.21.15.90:0/763315994 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa3740798a0 0x7fa37407bdb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa388036000 tx=0x7fa3880046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:03.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.200+0000 7fa391600640 1 -- 172.21.15.90:0/763315994 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa380018070 con 0x7fa37c004800 2024-09-21T03:20:03.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.860+0000 7fa39c200640 1 -- 172.21.15.90:0/763315994 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa370005580 con 0x7fa37c004800 2024-09-21T03:20:03.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.862+0000 7fa391600640 1 -- 172.21.15.90:0/763315994 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7fa380064b10 con 0x7fa37c004800 2024-09-21T03:20:03.866 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":40,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:20:03.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.873+0000 7fa39c200640 1 -- 172.21.15.90:0/763315994 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa3740798a0 msgr2=0x7fa37407bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:03.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.873+0000 7fa39c200640 1 --2- 172.21.15.90:0/763315994 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa3740798a0 0x7fa37407bdb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa388036000 tx=0x7fa3880046c0 comp rx=0 tx=0).stop 2024-09-21T03:20:03.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.873+0000 7fa39c200640 1 -- 172.21.15.90:0/763315994 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa37c004800 msgr2=0x7fa3941f08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:03.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.873+0000 7fa39c200640 1 --2- 172.21.15.90:0/763315994 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa37c004800 0x7fa3941f08d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa380005f10 tx=0x7fa380013f10 comp rx=0 tx=0).stop 2024-09-21T03:20:03.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.874+0000 7fa39c200640 1 -- 172.21.15.90:0/763315994 shutdown_connections 2024-09-21T03:20:03.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.874+0000 7fa39c200640 1 --2- 172.21.15.90:0/763315994 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa3740798a0 0x7fa37407bdb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:03.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.874+0000 7fa39c200640 1 --2- 172.21.15.90:0/763315994 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa37c0053a0 0x7fa3941479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:03.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.874+0000 7fa39c200640 1 --2- 172.21.15.90:0/763315994 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa37c004800 0x7fa3941f08d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:03.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.874+0000 7fa39c200640 1 --2- 172.21.15.90:0/763315994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0039b0 0x7fa394155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:03.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.874+0000 7fa39c200640 1 -- 172.21.15.90:0/763315994 >> 172.21.15.90:0/763315994 conn(0x7fa3940c8ba0 msgr2=0x7fa3940c2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:03.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.874+0000 7fa39c200640 1 -- 172.21.15.90:0/763315994 shutdown_connections 2024-09-21T03:20:03.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:03.874+0000 7fa39c200640 1 -- 172.21.15.90:0/763315994 wait complete. 2024-09-21T03:20:03.925 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-21T03:20:03.925 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-21T03:20:03.925 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:20:04.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.497+0000 7fce99e00640 1 -- 172.21.15.90:0/983437652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce8c049310 msgr2=0x7fce8c0da4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:04.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.497+0000 7fce99e00640 1 --2- 172.21.15.90:0/983437652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce8c049310 0x7fce8c0da4a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fce9406ca30 tx=0x7fce940a7670 comp rx=0 tx=0).stop 2024-09-21T03:20:04.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.498+0000 7fce99e00640 1 -- 172.21.15.90:0/983437652 shutdown_connections 2024-09-21T03:20:04.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.498+0000 7fce99e00640 1 --2- 172.21.15.90:0/983437652 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce8c0d7570 0x7fce8c0d7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:04.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.498+0000 7fce99e00640 1 --2- 172.21.15.90:0/983437652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce8c049310 0x7fce8c0da4a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:04.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.498+0000 7fce99e00640 1 -- 172.21.15.90:0/983437652 >> 172.21.15.90:0/983437652 conn(0x7fce8c0484c0 msgr2=0x7fce8c02cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:04.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.501+0000 7fce99e00640 1 -- 172.21.15.90:0/983437652 shutdown_connections 2024-09-21T03:20:04.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.501+0000 7fce99e00640 1 -- 172.21.15.90:0/983437652 wait complete. 2024-09-21T03:20:04.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.506+0000 7fce99e00640 1 Processor -- start 2024-09-21T03:20:04.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.506+0000 7fce99e00640 1 -- start start 2024-09-21T03:20:04.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.509+0000 7fce99e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce8c030ec0 0x7fce8c0d9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:04.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.510+0000 7fce99e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce8c049310 0x7fce8c0d0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:04.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.510+0000 7fce99e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce8c0d7570 0x7fce8c16d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:04.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.510+0000 7fce99e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c02e3f0 con 0x7fce8c030ec0 2024-09-21T03:20:04.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.510+0000 7fce99e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c0d70e0 con 0x7fce8c0d7570 2024-09-21T03:20:04.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.510+0000 7fce99e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fce8c0312d0 con 0x7fce8c049310 2024-09-21T03:20:04.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.511+0000 7fce92a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce8c030ec0 0x7fce8c0d9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:04.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.511+0000 7fce92000640 1 -- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce8c049310 msgr2=0x7fce8c0d0400 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:20:04.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.511+0000 7fce93400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce8c0d7570 0x7fce8c16d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:04.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.511+0000 7fce92000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce8c049310 0x7fce8c0d0400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:20:04.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.511+0000 7fce93400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce8c0d7570 0x7fce8c16d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:41526/0 (socket says 172.21.15.90:41526) 2024-09-21T03:20:04.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.511+0000 7fce93400640 1 -- 172.21.15.90:0/1307709545 learned_addr learned my addr 172.21.15.90:0/1307709545 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:20:04.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.511+0000 7fce92a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce8c030ec0 0x7fce8c0d9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39834/0 (socket says 172.21.15.90:39834) 2024-09-21T03:20:04.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.512+0000 7fce93400640 1 -- 172.21.15.90:0/1307709545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce8c049310 msgr2=0x7fce8c0d0400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:20:04.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.512+0000 7fce93400640 1 --2- 172.21.15.90:0/1307709545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce8c049310 0x7fce8c0d0400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:04.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.512+0000 7fce93400640 1 -- 172.21.15.90:0/1307709545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce8c030ec0 msgr2=0x7fce8c0d9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:04.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.512+0000 7fce93400640 1 --2- 172.21.15.90:0/1307709545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce8c030ec0 0x7fce8c0d9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:04.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.512+0000 7fce93400640 1 -- 172.21.15.90:0/1307709545 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8c0d0940 con 0x7fce8c0d7570 2024-09-21T03:20:04.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.516+0000 7fce92a00640 1 --2- 172.21.15.90:0/1307709545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce8c030ec0 0x7fce8c0d9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:20:04.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.517+0000 7fce93400640 1 --2- 172.21.15.90:0/1307709545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce8c0d7570 0x7fce8c16d440 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fce8000b3f0 tx=0x7fce8000b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:04.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.517+0000 7fce8b400640 1 -- 172.21.15.90:0/1307709545 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce80015020 con 0x7fce8c0d7570 2024-09-21T03:20:04.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.518+0000 7fce99e00640 1 -- 172.21.15.90:0/1307709545 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce8c16d980 con 0x7fce8c0d7570 2024-09-21T03:20:04.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.518+0000 7fce99e00640 1 -- 172.21.15.90:0/1307709545 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce8c1716a0 con 0x7fce8c0d7570 2024-09-21T03:20:04.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.519+0000 7fce99e00640 1 --2- 172.21.15.90:0/1307709545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce8c0d3550 0x7fce8c160510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:04.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.519+0000 7fce99e00640 1 -- 172.21.15.90:0/1307709545 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c16db90 con 0x7fce8c0d3550 2024-09-21T03:20:04.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.520+0000 7fce92a00640 1 --2- 172.21.15.90:0/1307709545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce8c0d3550 0x7fce8c160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:04.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.522+0000 7fce92a00640 1 -- 172.21.15.90:0/1307709545 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fce8c03f2c0 con 0x7fce8c0d3550 2024-09-21T03:20:04.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.522+0000 7fce92a00640 1 --2- 172.21.15.90:0/1307709545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce8c0d3550 0x7fce8c160510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fce9406ae60 tx=0x7fce94068c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:04.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.528+0000 7fce8b400640 1 -- 172.21.15.90:0/1307709545 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce80011940 con 0x7fce8c0d7570 2024-09-21T03:20:04.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.528+0000 7fce8b400640 1 -- 172.21.15.90:0/1307709545 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce940be020 con 0x7fce8c0d3550 2024-09-21T03:20:04.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.528+0000 7fce8b400640 1 -- 172.21.15.90:0/1307709545 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce80011d90 con 0x7fce8c0d7570 2024-09-21T03:20:04.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.528+0000 7fce8b400640 1 -- 172.21.15.90:0/1307709545 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fce940af930 con 0x7fce8c0d3550 2024-09-21T03:20:04.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.528+0000 7fce8b400640 1 -- 172.21.15.90:0/1307709545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce8c0d3550 msgr2=0x7fce8c160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:04.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.528+0000 7fce8b400640 1 --2- 172.21.15.90:0/1307709545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce8c0d3550 0x7fce8c160510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fce9406ae60 tx=0x7fce94068c40 comp rx=0 tx=0).stop 2024-09-21T03:20:04.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.528+0000 7fce8b400640 1 -- 172.21.15.90:0/1307709545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce8c0d3550 msgr2=0x7fce8c160510 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:20:04.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.528+0000 7fce8b400640 1 --2- 172.21.15.90:0/1307709545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce8c0d3550 0x7fce8c160510 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fce9406ae60 tx=0x7fce94068c40 comp rx=0 tx=0).stop 2024-09-21T03:20:04.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.543+0000 7fce8b400640 1 -- 172.21.15.90:0/1307709545 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce80018020 con 0x7fce8c0d7570 2024-09-21T03:20:04.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.547+0000 7fce8b400640 1 --2- 172.21.15.90:0/1307709545 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fce7407cac0 0x7fce7407efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:04.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.547+0000 7fce8b400640 1 -- 172.21.15.90:0/1307709545 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fce8009afa0 con 0x7fce8c0d7570 2024-09-21T03:20:04.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.548+0000 7fce92a00640 1 --2- 172.21.15.90:0/1307709545 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fce7407cac0 0x7fce7407efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:04.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.549+0000 7fce92a00640 1 --2- 172.21.15.90:0/1307709545 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fce7407cac0 0x7fce7407efd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fce8c171870 tx=0x7fce940c7040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:04.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.552+0000 7fce99e00640 1 --2- 172.21.15.90:0/1307709545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce8c160a50 0x7fce8c0d82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:04.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.554+0000 7fce99e00640 1 -- 172.21.15.90:0/1307709545 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c0d3980 con 0x7fce8c160a50 2024-09-21T03:20:04.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.554+0000 7fce92000640 1 --2- 172.21.15.90:0/1307709545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce8c160a50 0x7fce8c0d82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:04.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.556+0000 7fce92000640 1 -- 172.21.15.90:0/1307709545 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fce8c0d4860 con 0x7fce8c160a50 2024-09-21T03:20:04.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.557+0000 7fce92000640 1 --2- 172.21.15.90:0/1307709545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce8c160a50 0x7fce8c0d82a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fce8c161640 tx=0x7fce8400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:04.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.559+0000 7fce8b400640 1 -- 172.21.15.90:0/1307709545 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8400ce40 con 0x7fce8c160a50 2024-09-21T03:20:04.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.559+0000 7fce8b400640 1 -- 172.21.15.90:0/1307709545 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4706 (secure 0 0 0) 0x7fce84005880 con 0x7fce8c160a50 2024-09-21T03:20:04.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.559+0000 7fce8b400640 1 -- 172.21.15.90:0/1307709545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce8c160a50 msgr2=0x7fce8c0d82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:04.561 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:20:04.561 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:20:04.561 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:20:04.561 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:20:04.562 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 40, 2024-09-21T03:20:04.562 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 48333, 2024-09-21T03:20:04.562 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:20:04.562 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:20:04.562 INFO:teuthology.orchestra.run.smithi090.stdout: 1 2024-09-21T03:20:04.562 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:04.562 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 1, 2024-09-21T03:20:04.562 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:20:04.562 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:20:04.562 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:20:04.562 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:04.562 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:04.562 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:04.563 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:04.563 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:04.563 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:04.563 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:04.563 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:04.563 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:04.563 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:04.563 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:04.563 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:04.563 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:20:04.563 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:20:04.563 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:04.563 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:04.563 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:04.564 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:04.564 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:04.564 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:04.564 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:04.564 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:04.564 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:04.564 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:04.564 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:04.564 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:04.564 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:04.564 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:20:04.564 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:20:04.564 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:20:04.564 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:20:04.565 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:20:04.565 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:20:04.565 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:20:04.565 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:20:04.565 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:20:04.565 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:20:04.565 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:20:04.565 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:20:04.565 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:20:04.565 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:20:04.565 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:20:04.566 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:20:04.566 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:20:04.566 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:04.566 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:04.566 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:04.566 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:04.566 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:04.566 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:04.566 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:04.566 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:04.566 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:04.566 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:04.566 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:04.567 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:04.567 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:20:04.567 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:04.567 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:20:04.567 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:04.567 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:20:04.567 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:20:04.567 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:04.567 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:04.567 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:04.567 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:04.567 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:20:04.567 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:04.568 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:04.568 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:04.568 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:04.568 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:20:04.568 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:04.568 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:04.568 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:04.568 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:04.568 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:20:04.568 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:20:04.568 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:04.568 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:04.568 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:04.569 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:04.569 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:04.569 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:20:04.569 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:20:04.569 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:04.569 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:04.569 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:04.569 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:04.569 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:20:04.569 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:04.569 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:04.569 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:04.569 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:04.570 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:20:04.570 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:04.570 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:04.570 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:04.570 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:04.570 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:20:04.570 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:20:04.570 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:04.570 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:04.570 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:04.570 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:04.570 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:04.570 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:20:04.571 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:20:04.571 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:04.571 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:04.571 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:04.571 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:04.571 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:20:04.571 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:04.571 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:04.571 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:04.571 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:04.571 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:20:04.571 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:04.572 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:04.572 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:04.572 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:04.572 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:20:04.572 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:20:04.572 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:04.572 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:04.572 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:04.572 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:04.572 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:04.572 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:04.572 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:20:04.572 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:20:04.573 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:04.573 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:04.573 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:04.573 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:20:04.573 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:04.573 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:04.573 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:20:04.573 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:04.573 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:04.573 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:04.573 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:20:04.573 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:04.574 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:04.574 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:20:04.574 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:04.574 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:04.574 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:04.574 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:20:04.574 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:04.574 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:04.574 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:04.574 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:20:04.574 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:20:04.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.560+0000 7fce8b400640 1 --2- 172.21.15.90:0/1307709545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce8c160a50 0x7fce8c0d82a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fce8c161640 tx=0x7fce8400cb10 comp rx=0 tx=0).stop 2024-09-21T03:20:04.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.560+0000 7fce8b400640 1 -- 172.21.15.90:0/1307709545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce8c160a50 msgr2=0x7fce8c0d82a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:20:04.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.561+0000 7fce8b400640 1 --2- 172.21.15.90:0/1307709545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce8c160a50 0x7fce8c0d82a0 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fce8c161640 tx=0x7fce8400cb10 comp rx=0 tx=0).stop 2024-09-21T03:20:04.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.563+0000 7fce99e00640 1 -- 172.21.15.90:0/1307709545 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fce7407cac0 msgr2=0x7fce7407efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:04.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.563+0000 7fce99e00640 1 --2- 172.21.15.90:0/1307709545 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fce7407cac0 0x7fce7407efd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fce8c171870 tx=0x7fce940c7040 comp rx=0 tx=0).stop 2024-09-21T03:20:04.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.564+0000 7fce99e00640 1 -- 172.21.15.90:0/1307709545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce8c0d7570 msgr2=0x7fce8c16d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:04.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.564+0000 7fce99e00640 1 --2- 172.21.15.90:0/1307709545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce8c0d7570 0x7fce8c16d440 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fce8000b3f0 tx=0x7fce8000b8b0 comp rx=0 tx=0).stop 2024-09-21T03:20:04.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.566+0000 7fce93400640 1 -- 172.21.15.90:0/1307709545 reap_dead start 2024-09-21T03:20:04.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.566+0000 7fce93400640 1 -- 172.21.15.90:0/1307709545 reap_dead start 2024-09-21T03:20:04.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.570+0000 7fce99e00640 1 -- 172.21.15.90:0/1307709545 shutdown_connections 2024-09-21T03:20:04.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.570+0000 7fce99e00640 1 -- 172.21.15.90:0/1307709545 >> 172.21.15.90:0/1307709545 conn(0x7fce8c0484c0 msgr2=0x7fce8c0d57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:04.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.571+0000 7fce99e00640 1 -- 172.21.15.90:0/1307709545 shutdown_connections 2024-09-21T03:20:04.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:04.571+0000 7fce99e00640 1 -- 172.21.15.90:0/1307709545 wait complete. 2024-09-21T03:20:04.639 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-21T03:20:04.639 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-21T03:20:04.639 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:20:05.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.069+0000 7f8c49600640 1 -- 172.21.15.90:0/2379661747 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c031bf0 con 0x7f8c440d7240 2024-09-21T03:20:05.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.069+0000 7f8c51600640 1 -- 172.21.15.90:0/2379661747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c440d7240 msgr2=0x7f8c440d7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:05.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.069+0000 7f8c51600640 1 --2- 172.21.15.90:0/2379661747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c440d7240 0x7f8c440d7650 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c009830 tx=0x7f8c3c02a3f0 comp rx=0 tx=0).stop 2024-09-21T03:20:05.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.069+0000 7f8c51600640 1 -- 172.21.15.90:0/2379661747 shutdown_connections 2024-09-21T03:20:05.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.069+0000 7f8c51600640 1 --2- 172.21.15.90:0/2379661747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c440d7240 0x7f8c440d7650 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:05.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.069+0000 7f8c51600640 1 --2- 172.21.15.90:0/2379661747 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c4404a9f0 0x7f8c4402d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:05.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.069+0000 7f8c51600640 1 -- 172.21.15.90:0/2379661747 >> 172.21.15.90:0/2379661747 conn(0x7f8c44048490 msgr2=0x7f8c4402ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:05.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.070+0000 7f8c51600640 1 -- 172.21.15.90:0/2379661747 shutdown_connections 2024-09-21T03:20:05.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.070+0000 7f8c51600640 1 -- 172.21.15.90:0/2379661747 wait complete. 2024-09-21T03:20:05.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.075+0000 7f8c51600640 1 Processor -- start 2024-09-21T03:20:05.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.075+0000 7f8c51600640 1 -- start start 2024-09-21T03:20:05.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.077+0000 7f8c51600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c4404a9f0 0x7f8c4402c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:05.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.077+0000 7f8c51600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c440d7240 0x7f8c440cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:05.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.077+0000 7f8c51600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c440dda30 0x7f8c440d1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:05.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.077+0000 7f8c51600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8c44046b50 con 0x7f8c440d7240 2024-09-21T03:20:05.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.077+0000 7f8c51600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8c440469d0 con 0x7f8c4404a9f0 2024-09-21T03:20:05.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.077+0000 7f8c51600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8c440de550 con 0x7f8c440dda30 2024-09-21T03:20:05.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.078+0000 7f8c4aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c4404a9f0 0x7f8c4402c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:05.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.079+0000 7f8c4b400640 1 -- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c440dda30 msgr2=0x7f8c440d1350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:20:05.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.079+0000 7f8c4b400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c440dda30 0x7f8c440d1350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:20:05.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.079+0000 7f8c4aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c4404a9f0 0x7f8c4402c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:53924/0 (socket says 172.21.15.90:53924) 2024-09-21T03:20:05.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.079+0000 7f8c4aa00640 1 -- 172.21.15.90:0/1649038501 learned_addr learned my addr 172.21.15.90:0/1649038501 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:20:05.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.080+0000 7f8c4a000640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c440d7240 0x7f8c440cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:05.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.080+0000 7f8c4aa00640 1 -- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c440dda30 msgr2=0x7f8c440d1350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:20:05.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.080+0000 7f8c4aa00640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c440dda30 0x7f8c440d1350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:05.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.082+0000 7f8c4aa00640 1 -- 172.21.15.90:0/1649038501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c440d7240 msgr2=0x7f8c440cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:05.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.082+0000 7f8c4aa00640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c440d7240 0x7f8c440cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:05.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.082+0000 7f8c4aa00640 1 -- 172.21.15.90:0/1649038501 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c44178600 con 0x7f8c4404a9f0 2024-09-21T03:20:05.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.082+0000 7f8c4a000640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c440d7240 0x7f8c440cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:20:05.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.082+0000 7f8c4aa00640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c4404a9f0 0x7f8c4402c3b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c000b60 tx=0x7f8c4c0767a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:05.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.083+0000 7f8c42a00640 1 -- 172.21.15.90:0/1649038501 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c0751c0 con 0x7f8c4404a9f0 2024-09-21T03:20:05.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.083+0000 7f8c42a00640 1 -- 172.21.15.90:0/1649038501 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c4c063800 con 0x7f8c4404a9f0 2024-09-21T03:20:05.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.083+0000 7f8c42a00640 1 -- 172.21.15.90:0/1649038501 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c075450 con 0x7f8c4404a9f0 2024-09-21T03:20:05.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.086+0000 7f8c51600640 1 -- 172.21.15.90:0/1649038501 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c4402e670 con 0x7f8c4404a9f0 2024-09-21T03:20:05.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.086+0000 7f8c51600640 1 -- 172.21.15.90:0/1649038501 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c440cffe0 con 0x7f8c4404a9f0 2024-09-21T03:20:05.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.092+0000 7f8c51600640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c440d1890 0x7f8c440d6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:05.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.092+0000 7f8c51600640 1 -- 172.21.15.90:0/1649038501 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8c440daaf0 con 0x7f8c440d1890 2024-09-21T03:20:05.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.092+0000 7f8c4a000640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c440d1890 0x7f8c440d6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:05.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.093+0000 7f8c4a000640 1 -- 172.21.15.90:0/1649038501 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c440cfdd0 con 0x7f8c440d1890 2024-09-21T03:20:05.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.094+0000 7f8c4a000640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c440d1890 0x7f8c440d6820 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8c44041b40 tx=0x7f8c3800ff70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:05.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.094+0000 7f8c42a00640 1 -- 172.21.15.90:0/1649038501 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8c4c063c10 con 0x7f8c4404a9f0 2024-09-21T03:20:05.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.096+0000 7f8c42a00640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8c2c078bc0 0x7f8c2c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:05.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.096+0000 7f8c42a00640 1 -- 172.21.15.90:0/1649038501 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f8c4c1173b0 con 0x7f8c4404a9f0 2024-09-21T03:20:05.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.098+0000 7f8c42a00640 1 -- 172.21.15.90:0/1649038501 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c38018030 con 0x7f8c440d1890 2024-09-21T03:20:05.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.098+0000 7f8c42a00640 1 -- 172.21.15.90:0/1649038501 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8c38005020 con 0x7f8c440d1890 2024-09-21T03:20:05.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.098+0000 7f8c42a00640 1 -- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c440d1890 msgr2=0x7f8c440d6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:05.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.098+0000 7f8c42a00640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c440d1890 0x7f8c440d6820 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8c44041b40 tx=0x7f8c3800ff70 comp rx=0 tx=0).stop 2024-09-21T03:20:05.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.098+0000 7f8c42a00640 1 -- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c440d1890 msgr2=0x7f8c440d6820 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:20:05.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.098+0000 7f8c42a00640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c440d1890 0x7f8c440d6820 secure :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8c44041b40 tx=0x7f8c3800ff70 comp rx=0 tx=0).stop 2024-09-21T03:20:05.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.098+0000 7f8c4b400640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8c2c078bc0 0x7f8c2c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:05.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.106+0000 7f8c4b400640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8c2c078bc0 0x7f8c2c07b0d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c034000 tx=0x7f8c3c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:05.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.128+0000 7f8c51600640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c440d6d60 0x7f8c44174640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:05.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.128+0000 7f8c51600640 1 -- 172.21.15.90:0/1649038501 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4404a5d0 con 0x7f8c440d6d60 2024-09-21T03:20:05.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.129+0000 7f8c4a000640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c440d6d60 0x7f8c44174640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:05.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.131+0000 7f8c4a000640 1 -- 172.21.15.90:0/1649038501 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8c44030470 con 0x7f8c440d6d60 2024-09-21T03:20:05.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.132+0000 7f8c4a000640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c440d6d60 0x7f8c44174640 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8c44041b40 tx=0x7f8c38000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:05.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.136+0000 7f8c42a00640 1 -- 172.21.15.90:0/1649038501 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3801ec50 con 0x7f8c440d6d60 2024-09-21T03:20:05.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.136+0000 7f8c42a00640 1 -- 172.21.15.90:0/1649038501 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5182 (secure 0 0 0) 0x7f8c3801edf0 con 0x7f8c440d6d60 2024-09-21T03:20:05.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.136+0000 7f8c42a00640 1 -- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c440d6d60 msgr2=0x7f8c44174640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:05.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.136+0000 7f8c42a00640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c440d6d60 0x7f8c44174640 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8c44041b40 tx=0x7f8c38000ed0 comp rx=0 tx=0).stop 2024-09-21T03:20:05.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.136+0000 7f8c42a00640 1 -- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c440d6d60 msgr2=0x7f8c44174640 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:20:05.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.136+0000 7f8c42a00640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c440d6d60 0x7f8c44174640 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:05.138 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:20:05.138 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:20:05.139 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:20:05.139 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:20:05.139 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 40, 2024-09-21T03:20:05.139 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 355922, 2024-09-21T03:20:05.139 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:20:05.139 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:20:05.139 INFO:teuthology.orchestra.run.smithi090.stdout: 1 2024-09-21T03:20:05.139 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:05.139 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 2, 2024-09-21T03:20:05.139 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:20:05.139 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:20:05.139 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:20:05.139 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:05.139 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:05.140 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:05.140 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:05.140 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:05.140 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:05.140 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:05.140 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:05.140 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:05.140 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:05.140 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:05.140 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:05.140 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:20:05.140 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:20:05.140 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:05.140 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:20:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:20:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:20:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:20:05.142 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:20:05.142 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:20:05.142 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:20:05.142 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:20:05.142 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:20:05.142 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:20:05.142 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:20:05.142 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:20:05.142 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:20:05.142 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:20:05.142 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:20:05.142 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:20:05.142 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:20:05.142 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:20:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:20:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:20:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:20:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:20:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:20:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:20:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:20:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:20:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:20:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:20:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:20:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:20:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:20:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:20:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:20:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:20:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:20:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:20:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:20:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:20:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:20:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:20:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:20:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:20:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:20:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 7 2024-09-21T03:20:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:20:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:20:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:20:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:20:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5 2024-09-21T03:20:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:20:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:20:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:20:05.151 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:20:05.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.138+0000 7f8c51600640 1 -- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8c2c078bc0 msgr2=0x7f8c2c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:05.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.138+0000 7f8c51600640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8c2c078bc0 0x7f8c2c07b0d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c034000 tx=0x7f8c3c004730 comp rx=0 tx=0).stop 2024-09-21T03:20:05.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.138+0000 7f8c4b400640 1 -- 172.21.15.90:0/1649038501 reap_dead start 2024-09-21T03:20:05.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.138+0000 7f8c51600640 1 -- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c4404a9f0 msgr2=0x7f8c4402c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:05.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.138+0000 7f8c51600640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c4404a9f0 0x7f8c4402c3b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c000b60 tx=0x7f8c4c0767a0 comp rx=0 tx=0).stop 2024-09-21T03:20:05.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.138+0000 7f8c51600640 1 -- 172.21.15.90:0/1649038501 shutdown_connections 2024-09-21T03:20:05.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.138+0000 7f8c51600640 1 --2- 172.21.15.90:0/1649038501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c4404a9f0 0x7f8c4402c3b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:05.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.138+0000 7f8c51600640 1 -- 172.21.15.90:0/1649038501 >> 172.21.15.90:0/1649038501 conn(0x7f8c44048490 msgr2=0x7f8c440d6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:05.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.139+0000 7f8c51600640 1 -- 172.21.15.90:0/1649038501 shutdown_connections 2024-09-21T03:20:05.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:05.139+0000 7f8c51600640 1 -- 172.21.15.90:0/1649038501 wait complete. 2024-09-21T03:20:05.185 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-21T03:20:05.185 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-21T03:20:25.186 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-21T03:20:25.187 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-21T03:20:25.187 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-21T03:20:25.194 INFO:tasks.ceph.mon.c:Started 2024-09-21T03:20:25.194 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-21T03:20:25.194 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:20:25.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.672+0000 7efcdfe00640 1 -- 172.21.15.90:0/2961400060 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcc4004800 msgr2=0x7efcc4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:25.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.672+0000 7efcdfe00640 1 --2- 172.21.15.90:0/2961400060 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcc4004800 0x7efcc4004c10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efcd000c640 tx=0x7efcc4005830 comp rx=0 tx=0).stop 2024-09-21T03:20:25.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.672+0000 7efcdf400640 1 -- 172.21.15.90:0/2961400060 reap_dead start 2024-09-21T03:20:25.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.672+0000 7efcdfe00640 1 -- 172.21.15.90:0/2961400060 shutdown_connections 2024-09-21T03:20:25.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.672+0000 7efcdfe00640 1 -- 172.21.15.90:0/2961400060 >> 172.21.15.90:0/2961400060 conn(0x7efce00c80a0 msgr2=0x7efce00c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:25.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.674+0000 7efcdfe00640 1 -- 172.21.15.90:0/2961400060 shutdown_connections 2024-09-21T03:20:25.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.674+0000 7efcdfe00640 1 -- 172.21.15.90:0/2961400060 wait complete. 2024-09-21T03:20:25.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.687+0000 7efcdfe00640 1 Processor -- start 2024-09-21T03:20:25.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.688+0000 7efcdfe00640 1 -- start start 2024-09-21T03:20:25.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.698+0000 7efcdfe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efce0070300 0x7efce01620e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:25.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.698+0000 7efcdfe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efce0070710 0x7efce0163390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:25.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.699+0000 7efcdfe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efce01638d0 0x7efce0163ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:25.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.699+0000 7efcde000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efce0070710 0x7efce0163390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:25.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.699+0000 7efcde000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efce0070710 0x7efce0163390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:53306/0 (socket says 172.21.15.90:53306) 2024-09-21T03:20:25.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.699+0000 7efcde000640 1 -- 172.21.15.90:0/4141717519 learned_addr learned my addr 172.21.15.90:0/4141717519 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:20:25.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.700+0000 7efcdea00640 1 --2- 172.21.15.90:0/4141717519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efce0070300 0x7efce01620e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:25.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.700+0000 7efcdf400640 1 --2- 172.21.15.90:0/4141717519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efce01638d0 0x7efce0163ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:25.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.701+0000 7efcdfe00640 1 -- 172.21.15.90:0/4141717519 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efce00c5240 con 0x7efce0070300 2024-09-21T03:20:25.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.701+0000 7efcdfe00640 1 -- 172.21.15.90:0/4141717519 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efce00c2fd0 con 0x7efce01638d0 2024-09-21T03:20:25.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.701+0000 7efcdfe00640 1 -- 172.21.15.90:0/4141717519 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efce00c53c0 con 0x7efce0070710 2024-09-21T03:20:25.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.702+0000 7efcde000640 1 -- 172.21.15.90:0/4141717519 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efce0070710 msgr2=0x7efce0163390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-21T03:20:25.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.702+0000 7efcde000640 1 -- 172.21.15.90:0/4141717519 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efce0070710 msgr2=0x7efce0163390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T03:20:25.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.702+0000 7efcde000640 1 --2- 172.21.15.90:0/4141717519 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efce0070710 0x7efce0163390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T03:20:25.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.702+0000 7efcde000640 1 --2- 172.21.15.90:0/4141717519 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efce0070710 0x7efce0163390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:20:25.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.702+0000 7efcdea00640 1 -- 172.21.15.90:0/4141717519 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efce0070710 msgr2=0x7efce0163390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:20:25.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.702+0000 7efcdea00640 1 --2- 172.21.15.90:0/4141717519 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efce0070710 0x7efce0163390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:25.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.702+0000 7efcdea00640 1 -- 172.21.15.90:0/4141717519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efce01638d0 msgr2=0x7efce0163ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:25.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.702+0000 7efcdea00640 1 --2- 172.21.15.90:0/4141717519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efce01638d0 0x7efce0163ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:25.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.702+0000 7efcdea00640 1 -- 172.21.15.90:0/4141717519 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce014b350 con 0x7efce0070300 2024-09-21T03:20:25.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.703+0000 7efcdea00640 1 --2- 172.21.15.90:0/4141717519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efce0070300 0x7efce01620e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efce0072220 tx=0x7efcd800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:25.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.708+0000 7efcd6a00640 1 -- 172.21.15.90:0/4141717519 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd8019070 con 0x7efce0070300 2024-09-21T03:20:25.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.708+0000 7efcd6a00640 1 -- 172.21.15.90:0/4141717519 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efcd800c810 con 0x7efce0070300 2024-09-21T03:20:25.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.708+0000 7efcdfe00640 1 -- 172.21.15.90:0/4141717519 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce0162bd0 con 0x7efce0070300 2024-09-21T03:20:25.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.708+0000 7efcdfe00640 1 -- 172.21.15.90:0/4141717519 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce01611d0 con 0x7efce0070300 2024-09-21T03:20:25.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.708+0000 7efcd6a00640 1 -- 172.21.15.90:0/4141717519 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd800cc60 con 0x7efce0070300 2024-09-21T03:20:25.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.718+0000 7efcd6a00640 1 -- 172.21.15.90:0/4141717519 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efcd801c070 con 0x7efce0070300 2024-09-21T03:20:25.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.723+0000 7efcdfe00640 1 -- 172.21.15.90:0/4141717519 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb8005290 con 0x7efce0070300 2024-09-21T03:20:25.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.724+0000 7efcd6a00640 1 --2- 172.21.15.90:0/4141717519 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efcbc078c60 0x7efcbc07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:25.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.725+0000 7efcd6a00640 1 -- 172.21.15.90:0/4141717519 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7efcd809a490 con 0x7efce0070300 2024-09-21T03:20:25.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.737+0000 7efcde000640 1 --2- 172.21.15.90:0/4141717519 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efcbc078c60 0x7efcbc07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:25.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.743+0000 7efcd6a00640 1 -- 172.21.15.90:0/4141717519 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efce014b350 con 0x7efce0070300 2024-09-21T03:20:25.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:25.748+0000 7efcde000640 1 --2- 172.21.15.90:0/4141717519 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efcbc078c60 0x7efcbc07b170 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efcd0000f80 tx=0x7efcd0001cb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:26.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:26.333+0000 7efcdfe00640 1 -- 172.21.15.90:0/4141717519 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7efcb8005580 con 0x7efce0070300 2024-09-21T03:20:26.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:26.336+0000 7efcd6a00640 1 -- 172.21.15.90:0/4141717519 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7efcd80620d0 con 0x7efce0070300 2024-09-21T03:20:26.341 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":40,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:20:26.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:26.342+0000 7efcdfe00640 1 -- 172.21.15.90:0/4141717519 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efcbc078c60 msgr2=0x7efcbc07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:26.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:26.342+0000 7efcdfe00640 1 --2- 172.21.15.90:0/4141717519 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efcbc078c60 0x7efcbc07b170 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efcd0000f80 tx=0x7efcd0001cb0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:26.342+0000 7efcdfe00640 1 -- 172.21.15.90:0/4141717519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efce0070300 msgr2=0x7efce01620e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:26.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:26.342+0000 7efcdfe00640 1 --2- 172.21.15.90:0/4141717519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efce0070300 0x7efce01620e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efce0072220 tx=0x7efcd800bbe0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:26.344+0000 7efcdfe00640 1 -- 172.21.15.90:0/4141717519 shutdown_connections 2024-09-21T03:20:26.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:26.344+0000 7efcdfe00640 1 --2- 172.21.15.90:0/4141717519 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efcbc078c60 0x7efcbc07b170 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:26.344+0000 7efcdfe00640 1 --2- 172.21.15.90:0/4141717519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efce01638d0 0x7efce0163ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:26.344+0000 7efcdfe00640 1 --2- 172.21.15.90:0/4141717519 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efce0070710 0x7efce0163390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:26.344+0000 7efcdfe00640 1 --2- 172.21.15.90:0/4141717519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efce0070300 0x7efce01620e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:26.344+0000 7efcdfe00640 1 -- 172.21.15.90:0/4141717519 >> 172.21.15.90:0/4141717519 conn(0x7efce00c80a0 msgr2=0x7efce00c6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:26.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:26.345+0000 7efcdfe00640 1 -- 172.21.15.90:0/4141717519 shutdown_connections 2024-09-21T03:20:26.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:26.345+0000 7efcdfe00640 1 -- 172.21.15.90:0/4141717519 wait complete. 2024-09-21T03:20:29.411 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:20:29.839 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:20:29.849 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:20:34.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.416+0000 7fd585000640 1 -- 172.21.15.90:0/1960703394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd560006200 msgr2=0x7fd560008710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:34.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.416+0000 7fd585000640 1 --2- 172.21.15.90:0/1960703394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd560006200 0x7fd560008710 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd56c006b20 tx=0x7fd56c02b520 comp rx=0 tx=0).stop 2024-09-21T03:20:34.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.416+0000 7fd57fe00640 1 -- 172.21.15.90:0/1960703394 reap_dead start 2024-09-21T03:20:34.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.417+0000 7fd585000640 1 -- 172.21.15.90:0/1960703394 shutdown_connections 2024-09-21T03:20:34.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.417+0000 7fd585000640 1 --2- 172.21.15.90:0/1960703394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd560006200 0x7fd560008710 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:34.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.417+0000 7fd585000640 1 -- 172.21.15.90:0/1960703394 >> 172.21.15.90:0/1960703394 conn(0x7fd5780312b0 msgr2=0x7fd5780316c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:34.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.417+0000 7fd585000640 1 -- 172.21.15.90:0/1960703394 shutdown_connections 2024-09-21T03:20:34.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.417+0000 7fd585000640 1 -- 172.21.15.90:0/1960703394 wait complete. 2024-09-21T03:20:34.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.426+0000 7fd585000640 1 Processor -- start 2024-09-21T03:20:34.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.426+0000 7fd585000640 1 -- start start 2024-09-21T03:20:34.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.430+0000 7fd585000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd560006200 0x7fd5780d0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:34.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.431+0000 7fd57f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd560006200 0x7fd5780d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:34.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.431+0000 7fd57f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd560006200 0x7fd5780d0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:56108/0 (socket says 172.21.15.90:56108) 2024-09-21T03:20:34.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.432+0000 7fd57f400640 1 -- 172.21.15.90:0/1319704743 learned_addr learned my addr 172.21.15.90:0/1319704743 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:20:34.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.432+0000 7fd585000640 1 --2- 172.21.15.90:0/1319704743 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd578049030 0x7fd578166fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:34.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.434+0000 7fd57ea00640 1 --2- 172.21.15.90:0/1319704743 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd578049030 0x7fd578166fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:34.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.434+0000 7fd585000640 1 --2- 172.21.15.90:0/1319704743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd578167520 0x7fd578173a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:34.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.436+0000 7fd585000640 1 -- 172.21.15.90:0/1319704743 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd5780077a0 con 0x7fd578167520 2024-09-21T03:20:34.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.436+0000 7fd57fe00640 1 --2- 172.21.15.90:0/1319704743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd578167520 0x7fd578173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:34.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.438+0000 7fd585000640 1 -- 172.21.15.90:0/1319704743 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd578007620 con 0x7fd560006200 2024-09-21T03:20:34.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.438+0000 7fd585000640 1 -- 172.21.15.90:0/1319704743 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd57804a710 con 0x7fd578049030 2024-09-21T03:20:34.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.440+0000 7fd57fe00640 1 -- 172.21.15.90:0/1319704743 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd578049030 msgr2=0x7fd578166fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:34.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.440+0000 7fd57fe00640 1 --2- 172.21.15.90:0/1319704743 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd578049030 0x7fd578166fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:34.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.440+0000 7fd57fe00640 1 -- 172.21.15.90:0/1319704743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd560006200 msgr2=0x7fd5780d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:34.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.440+0000 7fd57fe00640 1 --2- 172.21.15.90:0/1319704743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd560006200 0x7fd5780d0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:34.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.440+0000 7fd57fe00640 1 -- 172.21.15.90:0/1319704743 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd578170de0 con 0x7fd578167520 2024-09-21T03:20:34.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.440+0000 7fd57f400640 1 --2- 172.21.15.90:0/1319704743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd560006200 0x7fd5780d0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:20:34.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.441+0000 7fd57fe00640 1 --2- 172.21.15.90:0/1319704743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd578167520 0x7fd578173a60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd580075920 tx=0x7fd580051660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:34.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.442+0000 7fd573400640 1 -- 172.21.15.90:0/1319704743 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd580093040 con 0x7fd578167520 2024-09-21T03:20:34.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.442+0000 7fd573400640 1 -- 172.21.15.90:0/1319704743 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd580097620 con 0x7fd578167520 2024-09-21T03:20:34.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.445+0000 7fd585000640 1 -- 172.21.15.90:0/1319704743 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5780d0ad0 con 0x7fd578167520 2024-09-21T03:20:34.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.445+0000 7fd585000640 1 -- 172.21.15.90:0/1319704743 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5780d0ea0 con 0x7fd578167520 2024-09-21T03:20:34.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.445+0000 7fd573400640 1 -- 172.21.15.90:0/1319704743 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd580097a50 con 0x7fd578167520 2024-09-21T03:20:34.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.456+0000 7fd570c00640 1 -- 172.21.15.90:0/1319704743 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd554005290 con 0x7fd578167520 2024-09-21T03:20:34.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.455+0000 7fd573400640 1 -- 172.21.15.90:0/1319704743 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd580097bf0 con 0x7fd578167520 2024-09-21T03:20:34.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.468+0000 7fd573400640 1 --2- 172.21.15.90:0/1319704743 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd560079bf0 0x7fd56007c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:34.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.468+0000 7fd573400640 1 -- 172.21.15.90:0/1319704743 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fd580118160 con 0x7fd578167520 2024-09-21T03:20:34.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.473+0000 7fd573400640 1 -- 172.21.15.90:0/1319704743 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd578170de0 con 0x7fd578167520 2024-09-21T03:20:34.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.474+0000 7fd57f400640 1 --2- 172.21.15.90:0/1319704743 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd560079bf0 0x7fd56007c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:34.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:34.477+0000 7fd57f400640 1 --2- 172.21.15.90:0/1319704743 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd560079bf0 0x7fd56007c100 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd574006af0 tx=0x7fd574006f50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:35.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.065+0000 7fd570c00640 1 -- 172.21.15.90:0/1319704743 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd554005580 con 0x7fd578167520 2024-09-21T03:20:35.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.068+0000 7fd573400640 1 -- 172.21.15.90:0/1319704743 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7fd5800e0260 con 0x7fd578167520 2024-09-21T03:20:35.070 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:20:35.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.080+0000 7fd570c00640 1 -- 172.21.15.90:0/1319704743 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd560079bf0 msgr2=0x7fd56007c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:35.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.080+0000 7fd570c00640 1 --2- 172.21.15.90:0/1319704743 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd560079bf0 0x7fd56007c100 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd574006af0 tx=0x7fd574006f50 comp rx=0 tx=0).stop 2024-09-21T03:20:35.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.080+0000 7fd570c00640 1 -- 172.21.15.90:0/1319704743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd578167520 msgr2=0x7fd578173a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:35.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.080+0000 7fd570c00640 1 --2- 172.21.15.90:0/1319704743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd578167520 0x7fd578173a60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd580075920 tx=0x7fd580051660 comp rx=0 tx=0).stop 2024-09-21T03:20:35.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.081+0000 7fd570c00640 1 -- 172.21.15.90:0/1319704743 shutdown_connections 2024-09-21T03:20:35.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.081+0000 7fd570c00640 1 --2- 172.21.15.90:0/1319704743 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd560079bf0 0x7fd56007c100 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.081+0000 7fd570c00640 1 --2- 172.21.15.90:0/1319704743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd578167520 0x7fd578173a60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.081+0000 7fd570c00640 1 --2- 172.21.15.90:0/1319704743 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd578049030 0x7fd578166fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.081+0000 7fd570c00640 1 --2- 172.21.15.90:0/1319704743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd560006200 0x7fd5780d0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.081+0000 7fd570c00640 1 -- 172.21.15.90:0/1319704743 >> 172.21.15.90:0/1319704743 conn(0x7fd5780312b0 msgr2=0x7fd578005ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:35.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.081+0000 7fd570c00640 1 -- 172.21.15.90:0/1319704743 shutdown_connections 2024-09-21T03:20:35.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.082+0000 7fd570c00640 1 -- 172.21.15.90:0/1319704743 wait complete. 2024-09-21T03:20:35.139 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-21T03:20:35.139 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-21T03:20:35.139 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:20:35.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.605+0000 7fa920e00640 1 -- 172.21.15.90:0/2971938615 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa904003b40 msgr2=0x7fa904003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:35.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.605+0000 7fa920e00640 1 --2- 172.21.15.90:0/2971938615 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa904003b40 0x7fa904003f70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa910009b00 tx=0x7fa904005830 comp rx=0 tx=0).stop 2024-09-21T03:20:35.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.605+0000 7fa920e00640 1 -- 172.21.15.90:0/2971938615 shutdown_connections 2024-09-21T03:20:35.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.606+0000 7fa920e00640 1 --2- 172.21.15.90:0/2971938615 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa904003b40 0x7fa904003f70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.606+0000 7fa920e00640 1 -- 172.21.15.90:0/2971938615 >> 172.21.15.90:0/2971938615 conn(0x7fa914048640 msgr2=0x7fa91402d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:35.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.608+0000 7fa920e00640 1 -- 172.21.15.90:0/2971938615 shutdown_connections 2024-09-21T03:20:35.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.608+0000 7fa920e00640 1 -- 172.21.15.90:0/2971938615 wait complete. 2024-09-21T03:20:35.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.618+0000 7fa920e00640 1 Processor -- start 2024-09-21T03:20:35.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.619+0000 7fa920e00640 1 -- start start 2024-09-21T03:20:35.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.621+0000 7fa920e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa904003b40 0x7fa91403efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:35.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.622+0000 7fa920e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa91417fd70 0x7fa914180180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:35.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.628+0000 7fa91aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa91417fd70 0x7fa914180180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:35.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.628+0000 7fa91aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa91417fd70 0x7fa914180180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59446/0 (socket says 172.21.15.90:59446) 2024-09-21T03:20:35.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.629+0000 7fa920e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9140d8a50 0x7fa9140d8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:35.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.629+0000 7fa91aa00640 1 -- 172.21.15.90:0/3572708294 learned_addr learned my addr 172.21.15.90:0/3572708294 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:20:35.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.629+0000 7fa91b400640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa904003b40 0x7fa91403efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:35.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.629+0000 7fa922400640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9140d8a50 0x7fa9140d8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:35.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.629+0000 7fa920e00640 1 -- 172.21.15.90:0/3572708294 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa91404b1d0 con 0x7fa91417fd70 2024-09-21T03:20:35.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.629+0000 7fa920e00640 1 -- 172.21.15.90:0/3572708294 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa914049a40 con 0x7fa904003b40 2024-09-21T03:20:35.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.629+0000 7fa920e00640 1 -- 172.21.15.90:0/3572708294 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa91404b350 con 0x7fa9140d8a50 2024-09-21T03:20:35.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.630+0000 7fa922400640 1 -- 172.21.15.90:0/3572708294 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9140d8a50 msgr2=0x7fa9140d8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-21T03:20:35.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.630+0000 7fa922400640 1 -- 172.21.15.90:0/3572708294 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9140d8a50 msgr2=0x7fa9140d8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T03:20:35.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.630+0000 7fa922400640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9140d8a50 0x7fa9140d8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T03:20:35.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.630+0000 7fa922400640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9140d8a50 0x7fa9140d8e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:20:35.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.631+0000 7fa91aa00640 1 -- 172.21.15.90:0/3572708294 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9140d8a50 msgr2=0x7fa9140d8e60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:20:35.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.631+0000 7fa91aa00640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9140d8a50 0x7fa9140d8e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.631+0000 7fa91aa00640 1 -- 172.21.15.90:0/3572708294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa904003b40 msgr2=0x7fa91403efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:35.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.631+0000 7fa91aa00640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa904003b40 0x7fa91403efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.631+0000 7fa91aa00640 1 -- 172.21.15.90:0/3572708294 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9141807f0 con 0x7fa91417fd70 2024-09-21T03:20:35.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.632+0000 7fa91b400640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa904003b40 0x7fa91403efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:20:35.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.632+0000 7fa91aa00640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa91417fd70 0x7fa914180180 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa908004d90 tx=0x7fa908001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:35.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.633+0000 7fa90f400640 1 -- 172.21.15.90:0/3572708294 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa908010890 con 0x7fa91417fd70 2024-09-21T03:20:35.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.633+0000 7fa90f400640 1 -- 172.21.15.90:0/3572708294 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa908016070 con 0x7fa91417fd70 2024-09-21T03:20:35.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.633+0000 7fa90f400640 1 -- 172.21.15.90:0/3572708294 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa908010c50 con 0x7fa91417fd70 2024-09-21T03:20:35.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.633+0000 7fa920e00640 1 -- 172.21.15.90:0/3572708294 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa914041d80 con 0x7fa91417fd70 2024-09-21T03:20:35.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.633+0000 7fa920e00640 1 -- 172.21.15.90:0/3572708294 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa914042970 con 0x7fa91417fd70 2024-09-21T03:20:35.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.635+0000 7fa90cc00640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8f0002a70 0x7fa8f0004f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:35.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.635+0000 7fa90cc00640 1 -- 172.21.15.90:0/3572708294 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f0007f10 con 0x7fa8f0002a70 2024-09-21T03:20:35.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.640+0000 7fa91b400640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8f0002a70 0x7fa8f0004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:35.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.642+0000 7fa91b400640 1 -- 172.21.15.90:0/3572708294 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa8f0008110 con 0x7fa8f0002a70 2024-09-21T03:20:35.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.645+0000 7fa90f400640 1 -- 172.21.15.90:0/3572708294 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa90801b460 con 0x7fa91417fd70 2024-09-21T03:20:35.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.647+0000 7fa91b400640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8f0002a70 0x7fa8f0004f80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa914047830 tx=0x7fa910033790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:35.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.647+0000 7fa90f400640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa8fc078be0 0x7fa8fc07b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:35.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.649+0000 7fa922400640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa8fc078be0 0x7fa8fc07b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:35.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.649+0000 7fa90f400640 1 -- 172.21.15.90:0/3572708294 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa910038040 con 0x7fa8f0002a70 2024-09-21T03:20:35.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.649+0000 7fa90f400640 1 -- 172.21.15.90:0/3572708294 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa910033b90 con 0x7fa8f0002a70 2024-09-21T03:20:35.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.649+0000 7fa90f400640 1 -- 172.21.15.90:0/3572708294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8f0002a70 msgr2=0x7fa8f0004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:35.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.649+0000 7fa90f400640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8f0002a70 0x7fa8f0004f80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa914047830 tx=0x7fa910033790 comp rx=0 tx=0).stop 2024-09-21T03:20:35.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.649+0000 7fa90f400640 1 -- 172.21.15.90:0/3572708294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8f0002a70 msgr2=0x7fa8f0004f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:20:35.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.649+0000 7fa90f400640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8f0002a70 0x7fa8f0004f80 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa914047830 tx=0x7fa910033790 comp rx=0 tx=0).stop 2024-09-21T03:20:35.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.654+0000 7fa90f400640 1 -- 172.21.15.90:0/3572708294 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fa908010df0 con 0x7fa91417fd70 2024-09-21T03:20:35.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.656+0000 7fa922400640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa8fc078be0 0x7fa8fc07b0f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0521d0 tx=0x7fa91c076290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:35.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.680+0000 7fa90cc00640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8f0007020 0x7fa8f0007430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:35.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.680+0000 7fa90cc00640 1 -- 172.21.15.90:0/3572708294 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f000a4d0 con 0x7fa8f0007020 2024-09-21T03:20:35.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.681+0000 7fa91b400640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8f0007020 0x7fa8f0007430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:35.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.683+0000 7fa91b400640 1 -- 172.21.15.90:0/3572708294 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa8f0007970 con 0x7fa8f0007020 2024-09-21T03:20:35.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.684+0000 7fa91b400640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8f0007020 0x7fa8f0007430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa8f00080e0 tx=0x7fa904005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:35.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.690+0000 7fa90f400640 1 -- 172.21.15.90:0/3572708294 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa910038040 con 0x7fa8f0007020 2024-09-21T03:20:35.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.692+0000 7fa90f400640 1 -- 172.21.15.90:0/3572708294 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4884 (secure 0 0 0) 0x7fa91003e3f0 con 0x7fa8f0007020 2024-09-21T03:20:35.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.692+0000 7fa90f400640 1 -- 172.21.15.90:0/3572708294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8f0007020 msgr2=0x7fa8f0007430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:35.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.692+0000 7fa90f400640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8f0007020 0x7fa8f0007430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa8f00080e0 tx=0x7fa904005830 comp rx=0 tx=0).stop 2024-09-21T03:20:35.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.692+0000 7fa90f400640 1 -- 172.21.15.90:0/3572708294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8f0007020 msgr2=0x7fa8f0007430 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:20:35.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.692+0000 7fa90f400640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8f0007020 0x7fa8f0007430 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa8f00080e0 tx=0x7fa904005830 comp rx=0 tx=0).stop 2024-09-21T03:20:35.695 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:20:35.695 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:20:35.695 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:20:35.695 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:20:35.695 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 46, 2024-09-21T03:20:35.695 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 79464, 2024-09-21T03:20:35.696 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:20:35.696 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:20:35.696 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:20:35.696 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:20:35.696 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:35.696 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 0, 2024-09-21T03:20:35.696 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:20:35.696 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:20:35.696 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:20:35.696 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:35.696 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:35.696 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:35.697 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:35.697 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:35.697 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:35.697 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:35.697 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:35.697 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:35.697 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:35.697 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:35.697 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:35.697 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:20:35.697 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:20:35.697 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:35.697 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:35.698 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:35.698 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:35.698 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:35.698 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:35.698 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:35.698 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:35.698 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:35.698 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:35.698 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:35.698 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:35.698 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:35.698 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:20:35.698 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:20:35.698 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:20:35.699 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:20:35.699 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:20:35.699 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:20:35.699 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:20:35.699 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:20:35.699 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:20:35.699 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:20:35.699 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:20:35.699 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:20:35.699 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:20:35.700 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:20:35.700 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:20:35.700 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:20:35.700 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:20:35.700 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:35.700 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:35.700 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:35.700 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:35.701 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:35.701 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:35.701 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:35.701 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:35.701 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:35.701 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:35.701 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:35.701 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:35.701 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:20:35.701 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:35.702 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:20:35.702 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:35.702 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:20:35.702 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:20:35.702 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:35.702 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:35.702 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:35.702 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:35.702 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:20:35.702 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:35.702 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:35.702 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:35.702 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:35.703 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:20:35.703 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:35.703 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:35.703 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:35.703 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:35.703 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:20:35.703 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:20:35.703 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:35.703 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:35.703 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:35.704 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:35.704 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:35.704 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:20:35.704 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:20:35.704 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:35.704 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:35.704 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:35.704 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:35.704 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:20:35.704 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:35.704 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:35.705 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:35.705 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:35.705 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:20:35.705 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:35.705 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:35.705 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:35.705 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:35.705 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:20:35.705 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:20:35.706 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:35.706 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:35.706 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:35.706 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:35.706 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:35.706 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:20:35.706 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:20:35.706 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:35.706 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:35.706 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:35.707 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:35.707 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:20:35.707 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:35.707 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:35.707 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:35.707 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:35.707 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:20:35.707 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:35.707 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:35.707 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:35.707 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:35.707 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:20:35.707 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:20:35.708 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:35.708 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:35.708 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:35.708 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:35.708 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:35.708 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:35.708 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:20:35.708 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:20:35.708 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:35.708 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:35.708 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:35.708 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:20:35.708 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:35.709 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:35.709 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:20:35.709 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:35.709 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:35.709 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:35.709 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:20:35.709 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:35.709 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:35.709 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:20:35.710 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:35.710 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:35.710 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:35.710 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:20:35.710 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:35.710 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:35.710 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:20:35.710 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:35.710 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:35.710 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:35.711 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 3 2024-09-21T03:20:35.711 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:35.711 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:35.711 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:35.711 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:20:35.711 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:20:35.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.695+0000 7fa90cc00640 1 -- 172.21.15.90:0/3572708294 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa8fc078be0 msgr2=0x7fa8fc07b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:35.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.695+0000 7fa90cc00640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa8fc078be0 0x7fa8fc07b0f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0521d0 tx=0x7fa91c076290 comp rx=0 tx=0).stop 2024-09-21T03:20:35.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.695+0000 7fa90cc00640 1 -- 172.21.15.90:0/3572708294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa91417fd70 msgr2=0x7fa914180180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:35.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.695+0000 7fa90cc00640 1 --2- 172.21.15.90:0/3572708294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa91417fd70 0x7fa914180180 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa908004d90 tx=0x7fa908001820 comp rx=0 tx=0).stop 2024-09-21T03:20:35.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.695+0000 7fa922400640 1 -- 172.21.15.90:0/3572708294 reap_dead start 2024-09-21T03:20:35.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.695+0000 7fa922400640 1 -- 172.21.15.90:0/3572708294 reap_dead start 2024-09-21T03:20:35.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.695+0000 7fa90cc00640 1 -- 172.21.15.90:0/3572708294 shutdown_connections 2024-09-21T03:20:35.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.695+0000 7fa90cc00640 1 -- 172.21.15.90:0/3572708294 >> 172.21.15.90:0/3572708294 conn(0x7fa914048640 msgr2=0x7fa914006020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:35.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.695+0000 7fa90cc00640 1 -- 172.21.15.90:0/3572708294 shutdown_connections 2024-09-21T03:20:35.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:35.699+0000 7fa90cc00640 1 -- 172.21.15.90:0/3572708294 wait complete. 2024-09-21T03:20:35.754 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:20:35.755 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-21T03:20:35.755 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:20:36.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.303+0000 7fc493800640 1 -- 172.21.15.90:0/721997281 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc48c0c2df0 msgr2=0x7fc48c155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.303+0000 7fc493800640 1 --2- 172.21.15.90:0/721997281 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc48c0c2df0 0x7fc48c155300 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc47c005fd0 tx=0x7fc47c02a5f0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.304+0000 7fc493800640 1 -- 172.21.15.90:0/721997281 shutdown_connections 2024-09-21T03:20:36.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.304+0000 7fc493800640 1 --2- 172.21.15.90:0/721997281 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc48c15e640 0x7fc48c15ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.304+0000 7fc493800640 1 --2- 172.21.15.90:0/721997281 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc48c0c2df0 0x7fc48c155300 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.305+0000 7fc493800640 1 -- 172.21.15.90:0/721997281 >> 172.21.15.90:0/721997281 conn(0x7fc48c0c85a0 msgr2=0x7fc48c0c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:36.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.305+0000 7fc493800640 1 -- 172.21.15.90:0/721997281 shutdown_connections 2024-09-21T03:20:36.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.305+0000 7fc493800640 1 -- 172.21.15.90:0/721997281 wait complete. 2024-09-21T03:20:36.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.311+0000 7fc493800640 1 Processor -- start 2024-09-21T03:20:36.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.312+0000 7fc493800640 1 -- start start 2024-09-21T03:20:36.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.314+0000 7fc493800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc48c06ede0 0x7fc48c1f5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.315+0000 7fc493800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc48c0c2df0 0x7fc48c1e4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.315+0000 7fc493800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc48c15e640 0x7fc48c158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.315+0000 7fc493800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc48c070630 con 0x7fc48c0c2df0 2024-09-21T03:20:36.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.315+0000 7fc490e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc48c06ede0 0x7fc48c1f5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.316+0000 7fc490e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc48c06ede0 0x7fc48c1f5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:44850/0 (socket says 172.21.15.90:44850) 2024-09-21T03:20:36.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.316+0000 7fc490e00640 1 -- 172.21.15.90:0/812473861 learned_addr learned my addr 172.21.15.90:0/812473861 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:20:36.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.317+0000 7fc493800640 1 -- 172.21.15.90:0/812473861 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc48c070350 con 0x7fc48c15e640 2024-09-21T03:20:36.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.317+0000 7fc493800640 1 -- 172.21.15.90:0/812473861 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc48c06f3a0 con 0x7fc48c06ede0 2024-09-21T03:20:36.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.316+0000 7fc48be00640 1 --2- 172.21.15.90:0/812473861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc48c0c2df0 0x7fc48c1e4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.318+0000 7fc491800640 1 --2- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc48c15e640 0x7fc48c158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.319+0000 7fc48be00640 1 -- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc48c06ede0 msgr2=0x7fc48c1f5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.319+0000 7fc48be00640 1 --2- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc48c06ede0 0x7fc48c1f5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.320+0000 7fc48be00640 1 -- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc48c15e640 msgr2=0x7fc48c158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.320+0000 7fc48be00640 1 --2- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc48c15e640 0x7fc48c158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.320+0000 7fc48be00640 1 -- 172.21.15.90:0/812473861 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48c1e4e50 con 0x7fc48c0c2df0 2024-09-21T03:20:36.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.320+0000 7fc48be00640 1 --2- 172.21.15.90:0/812473861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc48c0c2df0 0x7fc48c1e4910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc47c031000 tx=0x7fc47c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:36.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.321+0000 7fc488c00640 1 -- 172.21.15.90:0/812473861 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47c03e030 con 0x7fc48c0c2df0 2024-09-21T03:20:36.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.322+0000 7fc493800640 1 -- 172.21.15.90:0/812473861 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc48c0c70b0 con 0x7fc48c0c2df0 2024-09-21T03:20:36.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.322+0000 7fc493800640 1 -- 172.21.15.90:0/812473861 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc48c1f4990 con 0x7fc48c0c2df0 2024-09-21T03:20:36.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.322+0000 7fc488c00640 1 -- 172.21.15.90:0/812473861 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc47c003d10 con 0x7fc48c0c2df0 2024-09-21T03:20:36.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.324+0000 7fc493800640 1 --2- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc464002a70 0x7fc464004f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.324+0000 7fc493800640 1 -- 172.21.15.90:0/812473861 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc464007f10 con 0x7fc464002a70 2024-09-21T03:20:36.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.326+0000 7fc488c00640 1 -- 172.21.15.90:0/812473861 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47c03e030 con 0x7fc48c0c2df0 2024-09-21T03:20:36.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.328+0000 7fc490e00640 1 --2- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc464002a70 0x7fc464004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.337+0000 7fc488c00640 1 -- 172.21.15.90:0/812473861 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc47c041030 con 0x7fc48c0c2df0 2024-09-21T03:20:36.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.338+0000 7fc490e00640 1 -- 172.21.15.90:0/812473861 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc464008110 con 0x7fc464002a70 2024-09-21T03:20:36.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.339+0000 7fc488c00640 1 --2- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc46c078f90 0x7fc46c07b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.339+0000 7fc488c00640 1 -- 172.21.15.90:0/812473861 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fc47c03f070 con 0x7fc48c0c2df0 2024-09-21T03:20:36.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.339+0000 7fc490e00640 1 --2- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc464002a70 0x7fc464004f80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc48400fae0 tx=0x7fc484002070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:36.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.340+0000 7fc491800640 1 --2- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc46c078f90 0x7fc46c07b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.341+0000 7fc488c00640 1 -- 172.21.15.90:0/812473861 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc484003b80 con 0x7fc464002a70 2024-09-21T03:20:36.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.341+0000 7fc488c00640 1 -- 172.21.15.90:0/812473861 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc484018070 con 0x7fc464002a70 2024-09-21T03:20:36.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.341+0000 7fc488c00640 1 -- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc464002a70 msgr2=0x7fc464004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.341+0000 7fc488c00640 1 --2- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc464002a70 0x7fc464004f80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc48400fae0 tx=0x7fc484002070 comp rx=0 tx=0).stop 2024-09-21T03:20:36.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.341+0000 7fc488c00640 1 -- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc464002a70 msgr2=0x7fc464004f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:20:36.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.341+0000 7fc488c00640 1 --2- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc464002a70 0x7fc464004f80 secure :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc48400fae0 tx=0x7fc484002070 comp rx=0 tx=0).stop 2024-09-21T03:20:36.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.343+0000 7fc491800640 1 --2- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc46c078f90 0x7fc46c07b4a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc478005fd0 tx=0x7fc478005f40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:36.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.358+0000 7fc493800640 1 --2- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc464006f30 0x7fc4640073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.358+0000 7fc493800640 1 -- 172.21.15.90:0/812473861 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc46400a4f0 con 0x7fc464006f30 2024-09-21T03:20:36.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.359+0000 7fc490e00640 1 --2- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc464006f30 0x7fc4640073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.360+0000 7fc490e00640 1 -- 172.21.15.90:0/812473861 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc464007930 con 0x7fc464006f30 2024-09-21T03:20:36.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.362+0000 7fc490e00640 1 --2- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc464006f30 0x7fc4640073f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc48400fae0 tx=0x7fc4840012c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:36.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.363+0000 7fc488c00640 1 -- 172.21.15.90:0/812473861 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc484006e00 con 0x7fc464006f30 2024-09-21T03:20:36.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.364+0000 7fc488c00640 1 -- 172.21.15.90:0/812473861 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5193 (secure 0 0 0) 0x7fc484006e00 con 0x7fc464006f30 2024-09-21T03:20:36.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.364+0000 7fc488c00640 1 -- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc464006f30 msgr2=0x7fc4640073f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.364+0000 7fc488c00640 1 --2- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc464006f30 0x7fc4640073f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc48400fae0 tx=0x7fc4840012c0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.364+0000 7fc488c00640 1 -- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc464006f30 msgr2=0x7fc4640073f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:20:36.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.364+0000 7fc488c00640 1 --2- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc464006f30 0x7fc4640073f0 secure :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc48400fae0 tx=0x7fc4840012c0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.366 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:20:36.366 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:20:36.366 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:20:36.367 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:20:36.367 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 46, 2024-09-21T03:20:36.367 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 387153, 2024-09-21T03:20:36.367 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:20:36.367 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:20:36.367 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:20:36.367 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:20:36.367 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:36.367 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 1, 2024-09-21T03:20:36.367 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:20:36.367 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:20:36.368 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:20:36.368 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:36.368 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:36.368 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:36.368 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:36.368 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:36.368 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:36.368 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:36.368 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:36.368 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:36.368 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:36.368 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:36.368 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:36.369 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:20:36.369 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:20:36.369 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:36.369 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:36.369 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:36.369 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:36.369 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:36.369 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:36.369 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:36.369 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:36.369 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:36.369 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:36.369 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:36.369 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:36.369 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:36.370 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:20:36.370 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:20:36.370 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:20:36.370 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:20:36.370 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:20:36.370 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:20:36.370 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:20:36.370 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:20:36.370 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:20:36.370 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:20:36.370 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:20:36.370 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:20:36.370 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:20:36.371 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:20:36.371 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:20:36.371 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:20:36.371 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:20:36.371 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:36.371 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:36.371 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:36.371 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:36.371 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:36.371 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:36.371 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:36.371 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:36.371 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:36.371 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:36.372 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:36.372 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:36.372 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:20:36.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:36.372 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:20:36.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:36.372 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:20:36.372 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:20:36.372 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:36.372 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:36.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:36.372 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:36.372 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:20:36.372 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:36.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:36.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:36.373 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:36.373 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:20:36.373 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:36.373 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:36.373 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:36.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:36.373 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:20:36.373 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:20:36.373 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:36.373 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:36.373 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:36.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:36.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:36.374 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:20:36.374 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:20:36.374 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:36.374 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:36.374 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:36.374 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:36.374 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:20:36.374 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:36.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:36.374 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:36.374 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:36.374 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:20:36.374 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:36.375 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:36.375 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:36.375 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:36.375 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:20:36.375 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:20:36.375 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:36.375 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:36.375 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:36.375 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:36.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:36.375 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:20:36.375 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:20:36.375 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:36.375 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:36.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:36.376 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:36.376 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:20:36.376 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:36.376 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:36.376 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:36.376 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:36.376 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:20:36.376 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:36.376 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:36.376 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:36.376 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:36.376 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:20:36.376 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:20:36.376 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:36.376 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:36.377 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:36.377 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:36.377 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:36.377 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:36.377 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:20:36.377 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:20:36.377 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:36.377 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:36.377 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:36.377 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:20:36.377 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:36.377 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:36.377 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:20:36.377 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:36.378 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:36.378 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:36.378 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 3 2024-09-21T03:20:36.378 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:36.378 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:36.378 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:20:36.378 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:36.378 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:36.378 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:36.378 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 7 2024-09-21T03:20:36.378 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:36.378 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:36.378 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:20:36.378 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:36.379 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:20:36.379 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:20:36.379 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:20:36.379 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:36.379 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:36.379 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:36.379 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:36.379 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:20:36.379 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:36.379 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:36.379 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:20:36.379 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:36.379 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:36.379 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:36.380 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:20:36.380 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:36.380 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:36.380 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:36.380 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:20:36.380 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:20:36.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.366+0000 7fc493800640 1 -- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc46c078f90 msgr2=0x7fc46c07b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.366+0000 7fc493800640 1 --2- 172.21.15.90:0/812473861 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc46c078f90 0x7fc46c07b4a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc478005fd0 tx=0x7fc478005f40 comp rx=0 tx=0).stop 2024-09-21T03:20:36.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.366+0000 7fc493800640 1 -- 172.21.15.90:0/812473861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc48c0c2df0 msgr2=0x7fc48c1e4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.366+0000 7fc493800640 1 --2- 172.21.15.90:0/812473861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc48c0c2df0 0x7fc48c1e4910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc47c031000 tx=0x7fc47c003910 comp rx=0 tx=0).stop 2024-09-21T03:20:36.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.367+0000 7fc491800640 1 -- 172.21.15.90:0/812473861 reap_dead start 2024-09-21T03:20:36.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.367+0000 7fc491800640 1 -- 172.21.15.90:0/812473861 reap_dead start 2024-09-21T03:20:36.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.367+0000 7fc493800640 1 -- 172.21.15.90:0/812473861 shutdown_connections 2024-09-21T03:20:36.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.367+0000 7fc493800640 1 -- 172.21.15.90:0/812473861 >> 172.21.15.90:0/812473861 conn(0x7fc48c0c85a0 msgr2=0x7fc48c15d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:36.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.367+0000 7fc493800640 1 -- 172.21.15.90:0/812473861 shutdown_connections 2024-09-21T03:20:36.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.367+0000 7fc493800640 1 -- 172.21.15.90:0/812473861 wait complete. 2024-09-21T03:20:36.430 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:20:36.430 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-21T03:20:36.431 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:20:36.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.931+0000 7f111b000640 1 -- 172.21.15.90:0/789683346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1114154490 msgr2=0x7f11140cb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.931+0000 7f111b000640 1 --2- 172.21.15.90:0/789683346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1114154490 0x7f11140cb1e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1108005fd0 tx=0x7f110802a560 comp rx=0 tx=0).stop 2024-09-21T03:20:36.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.934+0000 7f111b000640 1 -- 172.21.15.90:0/789683346 shutdown_connections 2024-09-21T03:20:36.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.934+0000 7f111b000640 1 --2- 172.21.15.90:0/789683346 >> v2:172.21.15.90:3300/0 conn(0x7f11140cb720 0x7f11140cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.934+0000 7f111b000640 1 --2- 172.21.15.90:0/789683346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1114154490 0x7f11140cb1e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.934+0000 7f111b000640 1 -- 172.21.15.90:0/789683346 >> 172.21.15.90:0/789683346 conn(0x7f11140c92f0 msgr2=0x7f11140add30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:36.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.934+0000 7f111b000640 1 -- 172.21.15.90:0/789683346 shutdown_connections 2024-09-21T03:20:36.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.935+0000 7f111b000640 1 -- 172.21.15.90:0/789683346 wait complete. 2024-09-21T03:20:36.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.942+0000 7f111b000640 1 Processor -- start 2024-09-21T03:20:36.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.950+0000 7f111b000640 1 -- start start 2024-09-21T03:20:36.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.969+0000 7f111b000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11140c8720 0x7f111415a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.970+0000 7f111b000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11140cb720 0x7f1114158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.971+0000 7f111b000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1114154490 0x7f11141e2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.972+0000 7f111b000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f11140aeb50 con 0x7f11140c8720 2024-09-21T03:20:36.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.974+0000 7f111b000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f11141574d0 con 0x7f1114154490 2024-09-21T03:20:36.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.974+0000 7f111b000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1114159370 con 0x7f11140cb720 2024-09-21T03:20:36.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.974+0000 7f1119000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1114154490 0x7f11141e2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.975+0000 7f1119000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1114154490 0x7f11141e2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:53544/0 (socket says 172.21.15.90:53544) 2024-09-21T03:20:36.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.975+0000 7f1113e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11140c8720 0x7f111415a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.976+0000 7f1113e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11140c8720 0x7f111415a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59500/0 (socket says 172.21.15.90:59500) 2024-09-21T03:20:36.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.976+0000 7f1113e00640 1 -- 172.21.15.90:0/2857820949 learned_addr learned my addr 172.21.15.90:0/2857820949 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:20:36.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.976+0000 7f1113400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11140cb720 0x7f1114158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.986+0000 7f1113400640 1 -- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1114154490 msgr2=0x7f11141e2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.986+0000 7f1113400640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1114154490 0x7f11141e2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.986+0000 7f1113400640 1 -- 172.21.15.90:0/2857820949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11140c8720 msgr2=0x7f111415a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.986+0000 7f1113400640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11140c8720 0x7f111415a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.987+0000 7f1113400640 1 -- 172.21.15.90:0/2857820949 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11140c5da0 con 0x7f11140cb720 2024-09-21T03:20:36.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.987+0000 7f1113e00640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11140c8720 0x7f111415a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:20:36.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.988+0000 7f1119000640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1114154490 0x7f11141e2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:36.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.988+0000 7f1113400640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11140cb720 0x7f1114158ae0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1114156b40 tx=0x7f1108005a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:36.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.989+0000 7f1103e00640 1 -- 172.21.15.90:0/2857820949 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110803e030 con 0x7f11140cb720 2024-09-21T03:20:37.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.989+0000 7f111b000640 1 -- 172.21.15.90:0/2857820949 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11141fdfe0 con 0x7f11140cb720 2024-09-21T03:20:37.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.989+0000 7f111b000640 1 -- 172.21.15.90:0/2857820949 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f11141e2b50 con 0x7f11140cb720 2024-09-21T03:20:37.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.991+0000 7f1103e00640 1 -- 172.21.15.90:0/2857820949 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1108005310 con 0x7f11140cb720 2024-09-21T03:20:37.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.991+0000 7f1103e00640 1 -- 172.21.15.90:0/2857820949 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1108048060 con 0x7f11140cb720 2024-09-21T03:20:37.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.994+0000 7f1103e00640 1 -- 172.21.15.90:0/2857820949 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1108041030 con 0x7f11140cb720 2024-09-21T03:20:37.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.996+0000 7f1103e00640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f10f8078b90 0x7f10f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:37.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.996+0000 7f1103e00640 1 -- 172.21.15.90:0/2857820949 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f11080bb9f0 con 0x7f11140cb720 2024-09-21T03:20:37.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.997+0000 7f1113e00640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f10f8078b90 0x7f10f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:37.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.999+0000 7f1113e00640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f10f8078b90 0x7f10f807b0a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f110c00f370 tx=0x7f110c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:37.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.999+0000 7f111b000640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10f0002a70 0x7f10f0004f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:37.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:36.999+0000 7f111b000640 1 -- 172.21.15.90:0/2857820949 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f10f0007f10 con 0x7f10f0002a70 2024-09-21T03:20:37.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.003+0000 7f1119000640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10f0002a70 0x7f10f0004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:37.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.008+0000 7f1119000640 1 -- 172.21.15.90:0/2857820949 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10f0008110 con 0x7f10f0002a70 2024-09-21T03:20:37.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.011+0000 7f1119000640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10f0002a70 0x7f10f0004f80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f11140b1b30 tx=0x7f110400d960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:37.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.012+0000 7f1103e00640 1 -- 172.21.15.90:0/2857820949 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104018020 con 0x7f10f0002a70 2024-09-21T03:20:37.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.012+0000 7f1103e00640 1 -- 172.21.15.90:0/2857820949 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1104014620 con 0x7f10f0002a70 2024-09-21T03:20:37.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.012+0000 7f1103e00640 1 -- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10f0002a70 msgr2=0x7f10f0004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.012+0000 7f1103e00640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10f0002a70 0x7f10f0004f80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f11140b1b30 tx=0x7f110400d960 comp rx=0 tx=0).stop 2024-09-21T03:20:37.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.012+0000 7f1103e00640 1 -- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10f0002a70 msgr2=0x7f10f0004f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:20:37.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.012+0000 7f1103e00640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10f0002a70 0x7f10f0004f80 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f11140b1b30 tx=0x7f110400d960 comp rx=0 tx=0).stop 2024-09-21T03:20:37.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.031+0000 7f111b000640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10f0006f30 0x7f10f00073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:37.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.031+0000 7f111b000640 1 -- 172.21.15.90:0/2857820949 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f10f000a4f0 con 0x7f10f0006f30 2024-09-21T03:20:37.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.032+0000 7f1119000640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10f0006f30 0x7f10f00073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:37.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.038+0000 7f1119000640 1 -- 172.21.15.90:0/2857820949 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f10f0007930 con 0x7f10f0006f30 2024-09-21T03:20:37.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.039+0000 7f1119000640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10f0006f30 0x7f10f00073f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1104019000 tx=0x7f11040046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:37.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.039+0000 7f1103e00640 1 -- 172.21.15.90:0/2857820949 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104018030 con 0x7f10f0006f30 2024-09-21T03:20:37.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.040+0000 7f1103e00640 1 -- 172.21.15.90:0/2857820949 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4548 (secure 0 0 0) 0x7f1104029450 con 0x7f10f0006f30 2024-09-21T03:20:37.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.040+0000 7f1103e00640 1 -- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10f0006f30 msgr2=0x7f10f00073f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.042 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:20:37.042 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:20:37.042 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:20:37.042 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:20:37.042 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 46, 2024-09-21T03:20:37.042 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 11364, 2024-09-21T03:20:37.042 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:20:37.042 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:20:37.042 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:20:37.042 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:20:37.042 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:37.042 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 2, 2024-09-21T03:20:37.043 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:20:37.043 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:20:37.043 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:20:37.043 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:37.043 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:37.043 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:37.043 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:37.043 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:37.043 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:37.043 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:37.043 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:37.043 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:37.043 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:37.043 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:37.044 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:37.044 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:20:37.044 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:20:37.044 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:37.044 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:37.044 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:37.044 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:37.044 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:37.044 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:37.044 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:37.044 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:37.044 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:37.044 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:37.044 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:37.045 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:37.045 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:37.045 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:20:37.045 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:20:37.045 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:20:37.045 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:20:37.045 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:20:37.045 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:20:37.045 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:20:37.045 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:20:37.045 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:20:37.045 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:20:37.045 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:20:37.045 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:20:37.046 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:20:37.046 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:20:37.046 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:20:37.046 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:20:37.046 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:20:37.046 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:37.046 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:37.046 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:37.046 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:37.046 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:37.046 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:37.046 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:37.046 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:37.046 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:37.046 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:37.047 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:37.047 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:37.047 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:20:37.047 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:37.047 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:20:37.047 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:37.047 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:20:37.047 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:20:37.047 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:37.047 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:37.047 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:37.047 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:37.047 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:20:37.047 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:37.048 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:37.048 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:37.048 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:37.048 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:20:37.048 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:37.048 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:37.048 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:37.048 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:37.048 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:20:37.048 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:20:37.048 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:37.048 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:37.048 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:37.048 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:37.048 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:37.049 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:20:37.049 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:20:37.049 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:37.049 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:37.049 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:37.049 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:37.049 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:20:37.049 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:37.049 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:37.049 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:37.049 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:37.049 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:20:37.049 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:37.049 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:37.049 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:37.050 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:37.050 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:20:37.050 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:20:37.050 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:37.050 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:37.050 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:37.050 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:37.050 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:37.050 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:20:37.050 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:20:37.050 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:37.050 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:37.050 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:37.050 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:37.050 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:20:37.051 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:37.051 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:37.051 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:37.051 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:37.051 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:20:37.051 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:37.051 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:37.051 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:37.051 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:37.051 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:20:37.051 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:20:37.051 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:37.051 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:37.051 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:37.052 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:37.052 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:37.052 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:37.052 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:20:37.052 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:20:37.052 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:37.052 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:37.052 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:37.052 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:20:37.052 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:37.052 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:37.052 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:20:37.052 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:37.052 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:37.052 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:37.053 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:20:37.053 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:37.053 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:37.053 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:37.053 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:20:37.053 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:20:37.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.040+0000 7f1103e00640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10f0006f30 0x7f10f00073f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1104019000 tx=0x7f11040046c0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.040+0000 7f1103e00640 1 -- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10f0006f30 msgr2=0x7f10f00073f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:20:37.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.040+0000 7f1103e00640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10f0006f30 0x7f10f00073f0 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1104019000 tx=0x7f11040046c0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.041+0000 7f111b000640 1 -- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f10f8078b90 msgr2=0x7f10f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.041+0000 7f111b000640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f10f8078b90 0x7f10f807b0a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f110c00f370 tx=0x7f110c009040 comp rx=0 tx=0).stop 2024-09-21T03:20:37.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.041+0000 7f1119000640 1 -- 172.21.15.90:0/2857820949 reap_dead start 2024-09-21T03:20:37.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.041+0000 7f111b000640 1 -- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11140cb720 msgr2=0x7f1114158ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.041+0000 7f111b000640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11140cb720 0x7f1114158ae0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1114156b40 tx=0x7f1108005a70 comp rx=0 tx=0).stop 2024-09-21T03:20:37.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.043+0000 7f111b000640 1 -- 172.21.15.90:0/2857820949 shutdown_connections 2024-09-21T03:20:37.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.043+0000 7f111b000640 1 --2- 172.21.15.90:0/2857820949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11140cb720 0x7f1114158ae0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.043+0000 7f111b000640 1 -- 172.21.15.90:0/2857820949 >> 172.21.15.90:0/2857820949 conn(0x7f11140c92f0 msgr2=0x7f11140b0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:37.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.043+0000 7f111b000640 1 -- 172.21.15.90:0/2857820949 shutdown_connections 2024-09-21T03:20:37.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.043+0000 7f111b000640 1 -- 172.21.15.90:0/2857820949 wait complete. 2024-09-21T03:20:37.104 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:20:37.104 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-21T03:20:37.104 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-21T03:20:37.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.621+0000 7fc6c9c00640 1 -- 172.21.15.90:0/1099933994 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6c4160650 msgr2=0x7fc6c4162a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.621+0000 7fc6c9c00640 1 --2- 172.21.15.90:0/1099933994 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6c4160650 0x7fc6c4162a70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc009ca0 tx=0x7fc6bc02a970 comp rx=0 tx=0).stop 2024-09-21T03:20:37.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.627+0000 7fc6c9c00640 1 -- 172.21.15.90:0/1099933994 shutdown_connections 2024-09-21T03:20:37.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.627+0000 7fc6c9c00640 1 --2- 172.21.15.90:0/1099933994 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6c4160650 0x7fc6c4162a70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.627+0000 7fc6c9c00640 1 -- 172.21.15.90:0/1099933994 >> 172.21.15.90:0/1099933994 conn(0x7fc6c40c8740 msgr2=0x7fc6c406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:37.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.628+0000 7fc6c9c00640 1 -- 172.21.15.90:0/1099933994 shutdown_connections 2024-09-21T03:20:37.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.628+0000 7fc6c9c00640 1 -- 172.21.15.90:0/1099933994 wait complete. 2024-09-21T03:20:37.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.633+0000 7fc6c9c00640 1 Processor -- start 2024-09-21T03:20:37.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.634+0000 7fc6c9c00640 1 -- start start 2024-09-21T03:20:37.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.640+0000 7fc6c9c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6c40ad490 0x7fc6c414f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:37.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.641+0000 7fc6c9c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6c4156dd0 0x7fc6c4152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:37.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.641+0000 7fc6c9c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6c4160650 0x7fc6c41514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:37.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.641+0000 7fc6c9c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c40c1c50 con 0x7fc6c4156dd0 2024-09-21T03:20:37.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.641+0000 7fc6c9c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c415b0a0 con 0x7fc6c40ad490 2024-09-21T03:20:37.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.641+0000 7fc6c9c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc6c40c1dd0 con 0x7fc6c4160650 2024-09-21T03:20:37.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.642+0000 7fc6c2000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6c4156dd0 0x7fc6c4152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:37.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.642+0000 7fc6c2000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6c4156dd0 0x7fc6c4152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59516/0 (socket says 172.21.15.90:59516) 2024-09-21T03:20:37.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.642+0000 7fc6c2000640 1 -- 172.21.15.90:0/2410572074 learned_addr learned my addr 172.21.15.90:0/2410572074 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:20:37.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.643+0000 7fc6c2000640 1 -- 172.21.15.90:0/2410572074 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6c4160650 msgr2=0x7fc6c41514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.642+0000 7fc6c2a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6c40ad490 0x7fc6c414f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:37.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.642+0000 7fc6c3400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6c4160650 0x7fc6c41514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:37.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.649+0000 7fc6c2000640 1 --2- 172.21.15.90:0/2410572074 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6c4160650 0x7fc6c41514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.652+0000 7fc6c2000640 1 -- 172.21.15.90:0/2410572074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6c40ad490 msgr2=0x7fc6c414f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.652+0000 7fc6c2000640 1 --2- 172.21.15.90:0/2410572074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6c40ad490 0x7fc6c414f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.652+0000 7fc6c2000640 1 -- 172.21.15.90:0/2410572074 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c40c7bb0 con 0x7fc6c4156dd0 2024-09-21T03:20:37.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.653+0000 7fc6c2a00640 1 --2- 172.21.15.90:0/2410572074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6c40ad490 0x7fc6c414f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:37.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.653+0000 7fc6c3400640 1 --2- 172.21.15.90:0/2410572074 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6c4160650 0x7fc6c41514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:37.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.653+0000 7fc6c2000640 1 --2- 172.21.15.90:0/2410572074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6c4156dd0 0x7fc6c4152500 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400b410 tx=0x7fc6b400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:37.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.654+0000 7fc6baa00640 1 -- 172.21.15.90:0/2410572074 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4015020 con 0x7fc6c4156dd0 2024-09-21T03:20:37.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.654+0000 7fc6c9c00640 1 -- 172.21.15.90:0/2410572074 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c4074d40 con 0x7fc6c4156dd0 2024-09-21T03:20:37.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.656+0000 7fc6baa00640 1 -- 172.21.15.90:0/2410572074 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6b4011920 con 0x7fc6c4156dd0 2024-09-21T03:20:37.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.659+0000 7fc6baa00640 1 -- 172.21.15.90:0/2410572074 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4015020 con 0x7fc6c4156dd0 2024-09-21T03:20:37.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.659+0000 7fc6c9c00640 1 -- 172.21.15.90:0/2410572074 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c414f610 con 0x7fc6c4156dd0 2024-09-21T03:20:37.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.662+0000 7fc6c9c00640 1 -- 172.21.15.90:0/2410572074 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c40c2610 con 0x7fc6c4156dd0 2024-09-21T03:20:37.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.671+0000 7fc6baa00640 1 -- 172.21.15.90:0/2410572074 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc6b4018020 con 0x7fc6c4156dd0 2024-09-21T03:20:37.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.681+0000 7fc6baa00640 1 --2- 172.21.15.90:0/2410572074 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc6a4078d30 0x7fc6a407b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:37.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.681+0000 7fc6baa00640 1 -- 172.21.15.90:0/2410572074 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fc6b4099fb0 con 0x7fc6c4156dd0 2024-09-21T03:20:37.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.683+0000 7fc6c2a00640 1 --2- 172.21.15.90:0/2410572074 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc6a4078d30 0x7fc6a407b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:37.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.687+0000 7fc6c2a00640 1 --2- 172.21.15.90:0/2410572074 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc6a4078d30 0x7fc6a407b240 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00016a0 tx=0x7fc6b0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:37.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:37.694+0000 7fc6baa00640 1 -- 172.21.15.90:0/2410572074 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc6b40620c0 con 0x7fc6c4156dd0 2024-09-21T03:20:38.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:38.345+0000 7fc6c9c00640 1 -- 172.21.15.90:0/2410572074 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fc6c406f6e0 con 0x7fc6c4156dd0 2024-09-21T03:20:38.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:38.349+0000 7fc6baa00640 1 -- 172.21.15.90:0/2410572074 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fc6b40619c0 con 0x7fc6c4156dd0 2024-09-21T03:20:38.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:38.352+0000 7fc6c9c00640 1 -- 172.21.15.90:0/2410572074 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc6a4078d30 msgr2=0x7fc6a407b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:38.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:38.352+0000 7fc6c9c00640 1 --2- 172.21.15.90:0/2410572074 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc6a4078d30 0x7fc6a407b240 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00016a0 tx=0x7fc6b0009040 comp rx=0 tx=0).stop 2024-09-21T03:20:38.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:38.352+0000 7fc6c9c00640 1 -- 172.21.15.90:0/2410572074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6c4156dd0 msgr2=0x7fc6c4152500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:38.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:38.352+0000 7fc6c9c00640 1 --2- 172.21.15.90:0/2410572074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6c4156dd0 0x7fc6c4152500 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400b410 tx=0x7fc6b400b8d0 comp rx=0 tx=0).stop 2024-09-21T03:20:38.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:38.353+0000 7fc6c9c00640 1 -- 172.21.15.90:0/2410572074 shutdown_connections 2024-09-21T03:20:38.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:38.353+0000 7fc6c9c00640 1 --2- 172.21.15.90:0/2410572074 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc6a4078d30 0x7fc6a407b240 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:38.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:38.353+0000 7fc6c9c00640 1 --2- 172.21.15.90:0/2410572074 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6c4160650 0x7fc6c41514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:38.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:38.353+0000 7fc6c9c00640 1 --2- 172.21.15.90:0/2410572074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6c4156dd0 0x7fc6c4152500 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:38.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:38.353+0000 7fc6c9c00640 1 --2- 172.21.15.90:0/2410572074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6c40ad490 0x7fc6c414f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:38.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:38.353+0000 7fc6c9c00640 1 -- 172.21.15.90:0/2410572074 >> 172.21.15.90:0/2410572074 conn(0x7fc6c40c8740 msgr2=0x7fc6c40c32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:38.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:38.353+0000 7fc6c9c00640 1 -- 172.21.15.90:0/2410572074 shutdown_connections 2024-09-21T03:20:38.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:38.353+0000 7fc6c9c00640 1 -- 172.21.15.90:0/2410572074 wait complete. 2024-09-21T03:20:38.407 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-21T03:20:48.407 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-21T03:20:48.408 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:20:48.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.969+0000 7ff87f200640 1 -- 172.21.15.90:0/3210909782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff8740f7e70 msgr2=0x7ff874046770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:48.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.970+0000 7ff87ca00640 1 -- 172.21.15.90:0/3210909782 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86c004230 con 0x7ff8740f7e70 2024-09-21T03:20:48.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.970+0000 7ff87f200640 1 --2- 172.21.15.90:0/3210909782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff8740f7e70 0x7ff874046770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff86c005fd0 tx=0x7ff86c02a440 comp rx=0 tx=0).stop 2024-09-21T03:20:48.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.970+0000 7ff87f200640 1 -- 172.21.15.90:0/3210909782 shutdown_connections 2024-09-21T03:20:48.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.970+0000 7ff87f200640 1 --2- 172.21.15.90:0/3210909782 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8740f5870 0x7ff8740f9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:48.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.970+0000 7ff87f200640 1 --2- 172.21.15.90:0/3210909782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff8740f7e70 0x7ff874046770 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:48.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.970+0000 7ff87f200640 1 -- 172.21.15.90:0/3210909782 >> 172.21.15.90:0/3210909782 conn(0x7ff874048490 msgr2=0x7ff87402ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:48.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.972+0000 7ff87f200640 1 -- 172.21.15.90:0/3210909782 shutdown_connections 2024-09-21T03:20:48.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.972+0000 7ff87f200640 1 -- 172.21.15.90:0/3210909782 wait complete. 2024-09-21T03:20:48.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.985+0000 7ff87f200640 1 Processor -- start 2024-09-21T03:20:48.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.985+0000 7ff87f200640 1 -- start start 2024-09-21T03:20:48.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.989+0000 7ff87f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8740f5460 0x7ff87404a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:48.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.989+0000 7ff87f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8740f5870 0x7ff87402beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:48.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.989+0000 7ff87f200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff8740f7e70 0x7ff8740f35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:48.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.989+0000 7ff87f200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff87402dcf0 con 0x7ff8740f7e70 2024-09-21T03:20:48.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.989+0000 7ff87f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff8740f9940 con 0x7ff8740f5460 2024-09-21T03:20:48.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.989+0000 7ff87f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff8740f4050 con 0x7ff8740f5870 2024-09-21T03:20:48.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.990+0000 7ff87d400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8740f5870 0x7ff87402beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:48.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.992+0000 7ff87e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff8740f7e70 0x7ff8740f35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:48.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.992+0000 7ff87d400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8740f5870 0x7ff87402beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:60176/0 (socket says 172.21.15.90:60176) 2024-09-21T03:20:48.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.992+0000 7ff87d400640 1 -- 172.21.15.90:0/740608301 learned_addr learned my addr 172.21.15.90:0/740608301 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:20:48.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.992+0000 7ff87de00640 1 --2- 172.21.15.90:0/740608301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8740f5460 0x7ff87404a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:48.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.996+0000 7ff87de00640 1 -- 172.21.15.90:0/740608301 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8740f5870 msgr2=0x7ff87402beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:48.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.996+0000 7ff87de00640 1 --2- 172.21.15.90:0/740608301 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8740f5870 0x7ff87402beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:48.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.996+0000 7ff87de00640 1 -- 172.21.15.90:0/740608301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff8740f7e70 msgr2=0x7ff8740f35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:49.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.998+0000 7ff87de00640 1 --2- 172.21.15.90:0/740608301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff8740f7e70 0x7ff8740f35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:49.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.998+0000 7ff87de00640 1 -- 172.21.15.90:0/740608301 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8740494a0 con 0x7ff8740f5460 2024-09-21T03:20:49.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:48.998+0000 7ff87e800640 1 --2- 172.21.15.90:0/740608301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff8740f7e70 0x7ff8740f35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:20:49.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.000+0000 7ff87de00640 1 --2- 172.21.15.90:0/740608301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8740f5460 0x7ff87404a540 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff86c004000 tx=0x7ff86c031740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:49.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.003+0000 7ff872000640 1 -- 172.21.15.90:0/740608301 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86c040070 con 0x7ff8740f5460 2024-09-21T03:20:49.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.004+0000 7ff872000640 1 -- 172.21.15.90:0/740608301 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff86c031b40 con 0x7ff8740f5460 2024-09-21T03:20:49.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.004+0000 7ff872000640 1 -- 172.21.15.90:0/740608301 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86c005d50 con 0x7ff8740f5460 2024-09-21T03:20:49.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.005+0000 7ff87f200640 1 -- 172.21.15.90:0/740608301 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff87404aff0 con 0x7ff8740f5460 2024-09-21T03:20:49.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.011+0000 7ff87f200640 1 -- 172.21.15.90:0/740608301 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff874199bc0 con 0x7ff8740f5460 2024-09-21T03:20:49.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.013+0000 7ff872000640 1 -- 172.21.15.90:0/740608301 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff86c043070 con 0x7ff8740f5460 2024-09-21T03:20:49.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.014+0000 7ff872000640 1 --2- 172.21.15.90:0/740608301 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff85c078be0 0x7ff85c07b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:49.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.014+0000 7ff872000640 1 -- 172.21.15.90:0/740608301 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7ff86c0c0060 con 0x7ff8740f5460 2024-09-21T03:20:49.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.015+0000 7ff87f200640 1 -- 172.21.15.90:0/740608301 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff87404ae10 con 0x7ff8740f5460 2024-09-21T03:20:49.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.020+0000 7ff87d400640 1 --2- 172.21.15.90:0/740608301 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff85c078be0 0x7ff85c07b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:49.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.027+0000 7ff87d400640 1 --2- 172.21.15.90:0/740608301 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff85c078be0 0x7ff85c07b0f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff8740f2d10 tx=0x7ff8680090e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:49.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.044+0000 7ff872000640 1 -- 172.21.15.90:0/740608301 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff87404ae10 con 0x7ff8740f5460 2024-09-21T03:20:49.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.700+0000 7ff87f200640 1 -- 172.21.15.90:0/740608301 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff874049670 con 0x7ff8740f5460 2024-09-21T03:20:49.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.701+0000 7ff872000640 1 -- 172.21.15.90:0/740608301 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7ff86c083830 con 0x7ff8740f5460 2024-09-21T03:20:49.706 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:20:49.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.706+0000 7ff87f200640 1 -- 172.21.15.90:0/740608301 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff85c078be0 msgr2=0x7ff85c07b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:49.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.706+0000 7ff87f200640 1 --2- 172.21.15.90:0/740608301 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff85c078be0 0x7ff85c07b0f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff8740f2d10 tx=0x7ff8680090e0 comp rx=0 tx=0).stop 2024-09-21T03:20:49.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.706+0000 7ff87f200640 1 -- 172.21.15.90:0/740608301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8740f5460 msgr2=0x7ff87404a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:49.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.706+0000 7ff87f200640 1 --2- 172.21.15.90:0/740608301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8740f5460 0x7ff87404a540 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff86c004000 tx=0x7ff86c031740 comp rx=0 tx=0).stop 2024-09-21T03:20:49.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.706+0000 7ff87f200640 1 -- 172.21.15.90:0/740608301 shutdown_connections 2024-09-21T03:20:49.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.706+0000 7ff87f200640 1 --2- 172.21.15.90:0/740608301 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff85c078be0 0x7ff85c07b0f0 secure :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff8740f2d10 tx=0x7ff8680090e0 comp rx=0 tx=0).stop 2024-09-21T03:20:49.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.706+0000 7ff87f200640 1 --2- 172.21.15.90:0/740608301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff8740f7e70 0x7ff8740f35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:49.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.706+0000 7ff87f200640 1 --2- 172.21.15.90:0/740608301 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8740f5870 0x7ff87402beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:49.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.706+0000 7ff87f200640 1 --2- 172.21.15.90:0/740608301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8740f5460 0x7ff87404a540 secure :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff86c004000 tx=0x7ff86c031740 comp rx=0 tx=0).stop 2024-09-21T03:20:49.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.706+0000 7ff87f200640 1 -- 172.21.15.90:0/740608301 >> 172.21.15.90:0/740608301 conn(0x7ff874048490 msgr2=0x7ff8740f7610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:49.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.709+0000 7ff87f200640 1 -- 172.21.15.90:0/740608301 shutdown_connections 2024-09-21T03:20:49.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:49.709+0000 7ff87f200640 1 -- 172.21.15.90:0/740608301 wait complete. 2024-09-21T03:20:49.778 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-21T03:20:49.778 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-21T03:20:49.778 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-21T03:20:49.778 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:20:50.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.279+0000 7f8038600640 1 -- 172.21.15.90:0/3703343993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8030070770 msgr2=0x7f80300c2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:50.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.281+0000 7f802fe00640 1 -- 172.21.15.90:0/3703343993 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8028036070 con 0x7f8030070770 2024-09-21T03:20:50.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.281+0000 7f8038600640 1 --2- 172.21.15.90:0/3703343993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8030070770 0x7f80300c2c50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8028009f60 tx=0x7f802802a710 comp rx=0 tx=0).stop 2024-09-21T03:20:50.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.282+0000 7f8038600640 1 -- 172.21.15.90:0/3703343993 shutdown_connections 2024-09-21T03:20:50.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.282+0000 7f8038600640 1 --2- 172.21.15.90:0/3703343993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8030070770 0x7f80300c2c50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:50.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.282+0000 7f8038600640 1 --2- 172.21.15.90:0/3703343993 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80300c4630 0x7f8030156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:50.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.282+0000 7f8038600640 1 -- 172.21.15.90:0/3703343993 >> 172.21.15.90:0/3703343993 conn(0x7f803006d410 msgr2=0x7f80300c80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:50.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.283+0000 7f8038600640 1 -- 172.21.15.90:0/3703343993 shutdown_connections 2024-09-21T03:20:50.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.284+0000 7f8038600640 1 -- 172.21.15.90:0/3703343993 wait complete. 2024-09-21T03:20:50.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.290+0000 7f8038600640 1 Processor -- start 2024-09-21T03:20:50.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.290+0000 7f8038600640 1 -- start start 2024-09-21T03:20:50.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.294+0000 7f8038600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8030070770 0x7f80301f0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:50.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.295+0000 7f8038600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80300c4630 0x7f803014a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:50.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.295+0000 7f8038600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80301573f0 0x7f8030155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:50.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.295+0000 7f8035c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8030070770 0x7f80301f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:50.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.295+0000 7f8035c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8030070770 0x7f80301f0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:60184/0 (socket says 172.21.15.90:60184) 2024-09-21T03:20:50.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.296+0000 7f8035200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80300c4630 0x7f803014a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:50.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.296+0000 7f8035c00640 1 -- 172.21.15.90:0/1638508364 learned_addr learned my addr 172.21.15.90:0/1638508364 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:20:50.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.296+0000 7f8038600640 1 -- 172.21.15.90:0/1638508364 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f80300c26c0 con 0x7f80300c4630 2024-09-21T03:20:50.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.297+0000 7f8036600640 1 --2- 172.21.15.90:0/1638508364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80301573f0 0x7f8030155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:50.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.297+0000 7f8038600640 1 -- 172.21.15.90:0/1638508364 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8030157800 con 0x7f80301573f0 2024-09-21T03:20:50.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.297+0000 7f8038600640 1 -- 172.21.15.90:0/1638508364 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8030157980 con 0x7f8030070770 2024-09-21T03:20:50.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.298+0000 7f8035c00640 1 -- 172.21.15.90:0/1638508364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80301573f0 msgr2=0x7f8030155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:50.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.298+0000 7f8035c00640 1 --2- 172.21.15.90:0/1638508364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80301573f0 0x7f8030155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:50.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.298+0000 7f8035c00640 1 -- 172.21.15.90:0/1638508364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80300c4630 msgr2=0x7f803014a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:50.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.298+0000 7f8035c00640 1 --2- 172.21.15.90:0/1638508364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80300c4630 0x7f803014a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:50.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.298+0000 7f8035c00640 1 -- 172.21.15.90:0/1638508364 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f803014a8e0 con 0x7f8030070770 2024-09-21T03:20:50.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.299+0000 7f8035c00640 1 --2- 172.21.15.90:0/1638508364 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8030070770 0x7f80301f0d70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f802400e7c0 tx=0x7f802400ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:50.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.300+0000 7f802d600640 1 -- 172.21.15.90:0/1638508364 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802400ccc0 con 0x7f8030070770 2024-09-21T03:20:50.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.300+0000 7f8038600640 1 -- 172.21.15.90:0/1638508364 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8030154600 con 0x7f8030070770 2024-09-21T03:20:50.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.300+0000 7f802d600640 1 -- 172.21.15.90:0/1638508364 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8024010430 con 0x7f8030070770 2024-09-21T03:20:50.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.300+0000 7f802d600640 1 -- 172.21.15.90:0/1638508364 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802400ccc0 con 0x7f8030070770 2024-09-21T03:20:50.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.301+0000 7f8038600640 1 -- 172.21.15.90:0/1638508364 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8030155b50 con 0x7f8030070770 2024-09-21T03:20:50.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.309+0000 7f8022a00640 1 --2- 172.21.15.90:0/1638508364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8030147940 0x7f8030148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:50.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.309+0000 7f8022a00640 1 -- 172.21.15.90:0/1638508364 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f80300ac810 con 0x7f8030147940 2024-09-21T03:20:50.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.310+0000 7f8035200640 1 --2- 172.21.15.90:0/1638508364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8030147940 0x7f8030148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:50.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.310+0000 7f802d600640 1 -- 172.21.15.90:0/1638508364 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f80240105e0 con 0x7f8030070770 2024-09-21T03:20:50.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.313+0000 7f802d600640 1 --2- 172.21.15.90:0/1638508364 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8010078d90 0x7f801007b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:50.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.314+0000 7f8035200640 1 -- 172.21.15.90:0/1638508364 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80301548e0 con 0x7f8030147940 2024-09-21T03:20:50.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.314+0000 7f8035200640 1 --2- 172.21.15.90:0/1638508364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8030147940 0x7f8030148c80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8030150a70 tx=0x7f801c00d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:50.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.315+0000 7f802d600640 1 -- 172.21.15.90:0/1638508364 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f802405f6e0 con 0x7f8030070770 2024-09-21T03:20:50.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.316+0000 7f802d600640 1 -- 172.21.15.90:0/1638508364 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c018020 con 0x7f8030147940 2024-09-21T03:20:50.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.317+0000 7f802d600640 1 -- 172.21.15.90:0/1638508364 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f801c014620 con 0x7f8030147940 2024-09-21T03:20:50.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.317+0000 7f802d600640 1 -- 172.21.15.90:0/1638508364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8030147940 msgr2=0x7f8030148c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:50.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.317+0000 7f802d600640 1 --2- 172.21.15.90:0/1638508364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8030147940 0x7f8030148c80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8030150a70 tx=0x7f801c00d8f0 comp rx=0 tx=0).stop 2024-09-21T03:20:50.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.317+0000 7f802d600640 1 -- 172.21.15.90:0/1638508364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8030147940 msgr2=0x7f8030148c80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:20:50.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.317+0000 7f802d600640 1 --2- 172.21.15.90:0/1638508364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8030147940 0x7f8030148c80 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8030150a70 tx=0x7f801c00d8f0 comp rx=0 tx=0).stop 2024-09-21T03:20:50.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.317+0000 7f8036600640 1 --2- 172.21.15.90:0/1638508364 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8010078d90 0x7f801007b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:50.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.318+0000 7f8036600640 1 --2- 172.21.15.90:0/1638508364 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8010078d90 0x7f801007b2a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8028033000 tx=0x7f8028004a70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:50.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.341+0000 7f8022a00640 1 --2- 172.21.15.90:0/1638508364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8030147e90 0x7f80300c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:50.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.341+0000 7f8022a00640 1 -- 172.21.15.90:0/1638508364 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f80301f5210 con 0x7f8030147e90 2024-09-21T03:20:50.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.342+0000 7f8035200640 1 --2- 172.21.15.90:0/1638508364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8030147e90 0x7f80300c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:50.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.343+0000 7f8035200640 1 -- 172.21.15.90:0/1638508364 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f80300c24a0 con 0x7f8030147e90 2024-09-21T03:20:50.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.344+0000 7f8035200640 1 --2- 172.21.15.90:0/1638508364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8030147e90 0x7f80300c7670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f801c019000 tx=0x7f801c004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:50.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.347+0000 7f802d600640 1 -- 172.21.15.90:0/1638508364 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c025070 con 0x7f8030147e90 2024-09-21T03:20:50.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.347+0000 7f802d600640 1 -- 172.21.15.90:0/1638508364 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4885 (secure 0 0 0) 0x7f801c01fc70 con 0x7f8030147e90 2024-09-21T03:20:50.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.347+0000 7f802d600640 1 -- 172.21.15.90:0/1638508364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8030147e90 msgr2=0x7f80300c7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:50.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.347+0000 7f802d600640 1 --2- 172.21.15.90:0/1638508364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8030147e90 0x7f80300c7670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f801c019000 tx=0x7f801c004640 comp rx=0 tx=0).stop 2024-09-21T03:20:50.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.347+0000 7f802d600640 1 -- 172.21.15.90:0/1638508364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8030147e90 msgr2=0x7f80300c7670 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:20:50.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.347+0000 7f802d600640 1 --2- 172.21.15.90:0/1638508364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8030147e90 0x7f80300c7670 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f801c019000 tx=0x7f801c004640 comp rx=0 tx=0).stop 2024-09-21T03:20:50.350 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:20:50.350 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:20:50.350 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:20:50.350 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:20:50.350 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 46, 2024-09-21T03:20:50.350 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 94120, 2024-09-21T03:20:50.350 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:20:50.350 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:20:50.350 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:20:50.351 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:20:50.351 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:50.351 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 15, 2024-09-21T03:20:50.351 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:20:50.351 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:20:50.351 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:20:50.351 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:50.351 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:50.351 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:50.351 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:50.351 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:50.351 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:50.351 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:50.351 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:50.352 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:50.352 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:50.352 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:50.352 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:50.352 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:20:50.352 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:20:50.352 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:50.352 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:50.352 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:50.352 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:50.352 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:50.352 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:50.352 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:50.352 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:50.352 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:50.353 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:50.353 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:50.353 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:50.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:50.353 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:20:50.353 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:20:50.353 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:20:50.353 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:20:50.353 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:20:50.353 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:20:50.353 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:20:50.353 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:20:50.353 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:20:50.354 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:20:50.354 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:20:50.354 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:20:50.354 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:20:50.354 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:20:50.354 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:20:50.354 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:20:50.354 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:20:50.354 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:50.354 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:50.354 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:50.354 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:50.354 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:50.354 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:50.355 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:50.355 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:50.355 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:50.355 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:50.355 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:50.355 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:50.355 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:20:50.355 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:50.355 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:20:50.355 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:50.355 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:20:50.355 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:20:50.355 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:50.355 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:50.356 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:50.356 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:50.356 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:20:50.356 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:50.356 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:50.356 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:50.356 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:50.356 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:20:50.356 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:50.356 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:50.356 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:50.356 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:50.356 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:20:50.356 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:20:50.357 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:50.357 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:50.357 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:50.357 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:50.357 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:50.357 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:20:50.357 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:20:50.357 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:50.357 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:50.357 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:50.357 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:50.357 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:20:50.357 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:50.357 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:50.357 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:50.357 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:50.358 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:20:50.358 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:50.358 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:50.358 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:50.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:50.358 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:20:50.358 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:20:50.358 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:50.358 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:50.358 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:50.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:50.358 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:50.358 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:20:50.358 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:20:50.359 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:50.359 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:50.359 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:50.359 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:50.359 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:20:50.359 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:50.359 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:50.359 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:50.359 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:50.359 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:20:50.359 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:50.359 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:50.359 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:50.359 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:50.360 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:20:50.360 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:20:50.360 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:50.360 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:50.360 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:50.360 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:50.360 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:50.360 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:50.360 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:20:50.360 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:20:50.360 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:50.360 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:50.360 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:50.360 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:20:50.360 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:50.361 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:50.361 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:20:50.361 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:50.361 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:50.361 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:50.361 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:20:50.361 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:50.361 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:50.361 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:20:50.361 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:50.361 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:50.361 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:50.361 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:20:50.361 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:50.361 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:50.362 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:20:50.362 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:50.362 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:50.362 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:50.362 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:20:50.362 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:50.362 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:50.362 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:50.362 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:20:50.362 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:20:50.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.349+0000 7f8022a00640 1 -- 172.21.15.90:0/1638508364 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8010078d90 msgr2=0x7f801007b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:50.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.349+0000 7f8022a00640 1 --2- 172.21.15.90:0/1638508364 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8010078d90 0x7f801007b2a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8028033000 tx=0x7f8028004a70 comp rx=0 tx=0).stop 2024-09-21T03:20:50.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.349+0000 7f8022a00640 1 -- 172.21.15.90:0/1638508364 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8030070770 msgr2=0x7f80301f0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:50.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.349+0000 7f8022a00640 1 --2- 172.21.15.90:0/1638508364 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8030070770 0x7f80301f0d70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f802400e7c0 tx=0x7f802400ec80 comp rx=0 tx=0).stop 2024-09-21T03:20:50.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.350+0000 7f8036600640 1 -- 172.21.15.90:0/1638508364 reap_dead start 2024-09-21T03:20:50.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.353+0000 7f8022a00640 1 -- 172.21.15.90:0/1638508364 shutdown_connections 2024-09-21T03:20:50.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.353+0000 7f8022a00640 1 --2- 172.21.15.90:0/1638508364 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8030070770 0x7f80301f0d70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:50.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.353+0000 7f8022a00640 1 -- 172.21.15.90:0/1638508364 >> 172.21.15.90:0/1638508364 conn(0x7f803006d410 msgr2=0x7f8030156330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:50.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.353+0000 7f8022a00640 1 -- 172.21.15.90:0/1638508364 shutdown_connections 2024-09-21T03:20:50.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:50.353+0000 7f8022a00640 1 -- 172.21.15.90:0/1638508364 wait complete. 2024-09-21T03:20:50.441 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:20:50.441 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-21T03:20:50.441 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:20:51.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.019+0000 7fbbea200640 1 -- 172.21.15.90:0/2594023079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbbe414d7f0 msgr2=0x7fbbe40aa4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.019+0000 7fbbea200640 1 --2- 172.21.15.90:0/2594023079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbbe414d7f0 0x7fbbe40aa4b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40c3bb0 tx=0x7fbbd402a420 comp rx=0 tx=0).stop 2024-09-21T03:20:51.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.020+0000 7fbbea200640 1 -- 172.21.15.90:0/2594023079 shutdown_connections 2024-09-21T03:20:51.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.020+0000 7fbbea200640 1 --2- 172.21.15.90:0/2594023079 >> v2:172.21.15.90:3300/0 conn(0x7fbbe4070930 0x7fbbe4070d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.020+0000 7fbbea200640 1 --2- 172.21.15.90:0/2594023079 >> v2:172.21.15.149:3300/0 conn(0x7fbbe41537c0 0x7fbbe4153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.020+0000 7fbbea200640 1 --2- 172.21.15.90:0/2594023079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbbe414d7f0 0x7fbbe40aa4b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.020+0000 7fbbea200640 1 -- 172.21.15.90:0/2594023079 >> 172.21.15.90:0/2594023079 conn(0x7fbbe40c4aa0 msgr2=0x7fbbe40c4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:51.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.021+0000 7fbbea200640 1 -- 172.21.15.90:0/2594023079 shutdown_connections 2024-09-21T03:20:51.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.021+0000 7fbbea200640 1 -- 172.21.15.90:0/2594023079 wait complete. 2024-09-21T03:20:51.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.024+0000 7fbbea200640 1 Processor -- start 2024-09-21T03:20:51.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.025+0000 7fbbea200640 1 -- start start 2024-09-21T03:20:51.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.027+0000 7fbbea200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbe4070930 0x7fbbe40c0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.028+0000 7fbbe8e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbe4070930 0x7fbbe40c0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.028+0000 7fbbe8e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbe4070930 0x7fbbe40c0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57148/0 (socket says 172.21.15.90:57148) 2024-09-21T03:20:51.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.028+0000 7fbbe8e00640 1 -- 172.21.15.90:0/1885354254 learned_addr learned my addr 172.21.15.90:0/1885354254 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:20:51.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.028+0000 7fbbea200640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbbe414d7f0 0x7fbbe41fdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.029+0000 7fbbea200640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbe41537c0 0x7fbbe414bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.031+0000 7fbbea200640 1 -- 172.21.15.90:0/1885354254 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe40aad90 con 0x7fbbe4070930 2024-09-21T03:20:51.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.031+0000 7fbbea200640 1 -- 172.21.15.90:0/1885354254 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe40aa9f0 con 0x7fbbe41537c0 2024-09-21T03:20:51.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.032+0000 7fbbea200640 1 -- 172.21.15.90:0/1885354254 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbbe40aab70 con 0x7fbbe414d7f0 2024-09-21T03:20:51.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.033+0000 7fbbe8e00640 1 -- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbbe414d7f0 msgr2=0x7fbbe41fdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.032+0000 7fbbe9800640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbe41537c0 0x7fbbe414bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.032+0000 7fbbdbe00640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbbe414d7f0 0x7fbbe41fdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.036+0000 7fbbe8e00640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbbe414d7f0 0x7fbbe41fdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.036+0000 7fbbe8e00640 1 -- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbe41537c0 msgr2=0x7fbbe414bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.036+0000 7fbbe8e00640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbe41537c0 0x7fbbe414bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.036+0000 7fbbe8e00640 1 -- 172.21.15.90:0/1885354254 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe40bf2e0 con 0x7fbbe4070930 2024-09-21T03:20:51.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.040+0000 7fbbe8e00640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbe4070930 0x7fbbe40c0cd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009920 tx=0x7fbbd4033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:51.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.040+0000 7fbbdbe00640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbbe414d7f0 0x7fbbe41fdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:51.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.045+0000 7fbbe1600640 1 -- 172.21.15.90:0/1885354254 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4031d60 con 0x7fbbe4070930 2024-09-21T03:20:51.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.045+0000 7fbbe1600640 1 -- 172.21.15.90:0/1885354254 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbbd40330d0 con 0x7fbbe4070930 2024-09-21T03:20:51.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.045+0000 7fbbea200640 1 -- 172.21.15.90:0/1885354254 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe40c1c80 con 0x7fbbe4070930 2024-09-21T03:20:51.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.046+0000 7fbbea200640 1 -- 172.21.15.90:0/1885354254 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe40c1f60 con 0x7fbbe4070930 2024-09-21T03:20:51.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.046+0000 7fbbe1600640 1 -- 172.21.15.90:0/1885354254 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40334e0 con 0x7fbbe4070930 2024-09-21T03:20:51.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.053+0000 7fbbe1600640 1 -- 172.21.15.90:0/1885354254 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbbd4033680 con 0x7fbbe4070930 2024-09-21T03:20:51.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.054+0000 7fbbe1600640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbbc0078b90 0x7fbbc007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.055+0000 7fbbea200640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbbc002a70 0x7fbbbc004f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.055+0000 7fbbea200640 1 -- 172.21.15.90:0/1885354254 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc007f10 con 0x7fbbbc002a70 2024-09-21T03:20:51.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.057+0000 7fbbe1600640 1 -- 172.21.15.90:0/1885354254 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fbbd40b9e70 con 0x7fbbe4070930 2024-09-21T03:20:51.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.060+0000 7fbbdbe00640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbbc0078b90 0x7fbbc007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.061+0000 7fbbe9800640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbbc002a70 0x7fbbbc004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.061+0000 7fbbe9800640 1 -- 172.21.15.90:0/1885354254 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbbbc008110 con 0x7fbbbc002a70 2024-09-21T03:20:51.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.062+0000 7fbbe9800640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbbc002a70 0x7fbbbc004f80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00caa0 tx=0x7fbbdc00cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:51.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.063+0000 7fbbe1600640 1 -- 172.21.15.90:0/1885354254 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc015070 con 0x7fbbbc002a70 2024-09-21T03:20:51.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.063+0000 7fbbdbe00640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbbc0078b90 0x7fbbc007b0a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc005fd0 tx=0x7fbbcc005a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:51.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.064+0000 7fbbe1600640 1 -- 172.21.15.90:0/1885354254 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbbdc00ac00 con 0x7fbbbc002a70 2024-09-21T03:20:51.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.064+0000 7fbbe1600640 1 -- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbbc002a70 msgr2=0x7fbbbc004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.064+0000 7fbbe1600640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbbc002a70 0x7fbbbc004f80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00caa0 tx=0x7fbbdc00cf60 comp rx=0 tx=0).stop 2024-09-21T03:20:51.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.064+0000 7fbbe1600640 1 -- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbbc002a70 msgr2=0x7fbbbc004f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:20:51.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.064+0000 7fbbe1600640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbbc002a70 0x7fbbbc004f80 secure :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00caa0 tx=0x7fbbdc00cf60 comp rx=0 tx=0).stop 2024-09-21T03:20:51.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.123+0000 7fbbea200640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbbc006f30 0x7fbbbc0073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.124+0000 7fbbea200640 1 -- 172.21.15.90:0/1885354254 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc00a4f0 con 0x7fbbbc006f30 2024-09-21T03:20:51.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.124+0000 7fbbe9800640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbbc006f30 0x7fbbbc0073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.126+0000 7fbbe9800640 1 -- 172.21.15.90:0/1885354254 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbbbc007930 con 0x7fbbbc006f30 2024-09-21T03:20:51.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.127+0000 7fbbe9800640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbbc006f30 0x7fbbbc0073f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00caa0 tx=0x7fbbdc004a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:51.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.131+0000 7fbbe1600640 1 -- 172.21.15.90:0/1885354254 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc015070 con 0x7fbbbc006f30 2024-09-21T03:20:51.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.131+0000 7fbbe1600640 1 -- 172.21.15.90:0/1885354254 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5194 (secure 0 0 0) 0x7fbbdc011640 con 0x7fbbbc006f30 2024-09-21T03:20:51.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.131+0000 7fbbe1600640 1 -- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbbc006f30 msgr2=0x7fbbbc0073f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.131+0000 7fbbe1600640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbbc006f30 0x7fbbbc0073f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00caa0 tx=0x7fbbdc004a30 comp rx=0 tx=0).stop 2024-09-21T03:20:51.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.131+0000 7fbbe1600640 1 -- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbbc006f30 msgr2=0x7fbbbc0073f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:20:51.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.131+0000 7fbbe1600640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbbc006f30 0x7fbbbc0073f0 secure :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00caa0 tx=0x7fbbdc004a30 comp rx=0 tx=0).stop 2024-09-21T03:20:51.134 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:20:51.134 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:20:51.134 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:20:51.134 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:20:51.134 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 46, 2024-09-21T03:20:51.135 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 401917, 2024-09-21T03:20:51.135 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:20:51.135 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:20:51.135 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:20:51.135 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:20:51.135 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:51.135 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 16, 2024-09-21T03:20:51.135 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:20:51.135 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:20:51.135 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:20:51.135 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:51.135 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:51.135 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:51.135 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:51.136 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:51.136 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:51.136 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:51.136 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:51.136 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:51.136 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:51.136 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:51.136 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:51.136 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:20:51.136 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:20:51.136 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:51.136 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:51.136 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:51.136 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:51.137 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:51.137 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:51.137 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:51.137 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:51.137 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:51.137 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:51.137 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:51.137 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:51.137 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.137 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:20:51.137 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:20:51.137 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:20:51.137 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:20:51.137 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:20:51.137 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:20:51.138 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:20:51.138 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:20:51.138 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:20:51.138 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:20:51.138 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:20:51.138 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:20:51.138 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:20:51.138 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:20:51.138 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:20:51.138 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:20:51.138 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:20:51.138 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:51.138 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:51.138 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:51.139 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:51.139 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:51.139 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:51.139 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:51.139 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:51.139 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:51.139 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:51.139 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:51.139 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:51.139 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:20:51.139 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.139 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:20:51.139 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.139 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:20:51.139 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:20:51.140 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:51.140 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:51.140 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.140 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:51.140 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:20:51.140 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:51.140 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.140 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.140 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:51.140 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:20:51.140 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:51.140 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:51.140 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:51.140 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.141 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:20:51.141 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:20:51.141 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:51.141 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:51.141 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:51.141 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.141 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.141 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:20:51.141 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:20:51.141 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:51.141 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:51.141 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.141 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:51.141 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:20:51.142 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:51.142 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.142 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.142 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:51.142 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:20:51.142 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:51.142 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:51.142 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:51.142 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.142 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:20:51.142 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:20:51.142 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:51.142 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:51.142 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:51.143 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.143 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.143 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:20:51.143 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:20:51.143 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:51.143 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:51.143 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.143 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:51.143 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:20:51.143 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:51.143 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.143 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.143 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:51.144 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:20:51.144 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:51.144 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:51.144 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:51.144 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.144 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:20:51.144 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:20:51.144 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:51.144 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:51.144 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:51.144 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:51.144 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:51.144 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.144 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:20:51.145 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:20:51.145 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.145 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:51.145 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:51.145 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:20:51.145 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:51.145 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:51.145 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:20:51.145 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.145 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:51.145 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:51.145 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 3 2024-09-21T03:20:51.145 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:51.145 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:51.146 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:20:51.146 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.146 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:51.146 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:51.146 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 7 2024-09-21T03:20:51.146 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:51.146 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:51.146 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:20:51.146 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.146 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:20:51.146 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:20:51.146 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:20:51.146 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.147 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.147 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:51.147 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:51.147 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:20:51.147 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:51.147 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:51.147 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:20:51.147 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.147 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:51.147 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:51.147 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:20:51.147 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:51.147 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:51.147 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.147 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:20:51.148 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:20:51.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.134+0000 7fbbea200640 1 -- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbbc0078b90 msgr2=0x7fbbc007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.134+0000 7fbbea200640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbbc0078b90 0x7fbbc007b0a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc005fd0 tx=0x7fbbcc005a40 comp rx=0 tx=0).stop 2024-09-21T03:20:51.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.134+0000 7fbbea200640 1 -- 172.21.15.90:0/1885354254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbe4070930 msgr2=0x7fbbe40c0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.134+0000 7fbbea200640 1 --2- 172.21.15.90:0/1885354254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbe4070930 0x7fbbe40c0cd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009920 tx=0x7fbbd4033c10 comp rx=0 tx=0).stop 2024-09-21T03:20:51.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.134+0000 7fbbe9800640 1 -- 172.21.15.90:0/1885354254 reap_dead start 2024-09-21T03:20:51.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.134+0000 7fbbea200640 1 -- 172.21.15.90:0/1885354254 shutdown_connections 2024-09-21T03:20:51.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.134+0000 7fbbea200640 1 -- 172.21.15.90:0/1885354254 >> 172.21.15.90:0/1885354254 conn(0x7fbbe40c4aa0 msgr2=0x7fbbe40acec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:51.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.135+0000 7fbbea200640 1 -- 172.21.15.90:0/1885354254 shutdown_connections 2024-09-21T03:20:51.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.135+0000 7fbbea200640 1 -- 172.21.15.90:0/1885354254 wait complete. 2024-09-21T03:20:51.234 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:20:51.234 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-21T03:20:51.234 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:20:51.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.763+0000 7f65afe00640 1 -- 172.21.15.90:0/3271447383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6594003c30 msgr2=0x7f6594004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.763+0000 7f65afe00640 1 --2- 172.21.15.90:0/3271447383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6594003c30 0x7f6594004080 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f659c006ed0 tx=0x7f6594005830 comp rx=0 tx=0).stop 2024-09-21T03:20:51.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.767+0000 7f65afe00640 1 -- 172.21.15.90:0/3271447383 shutdown_connections 2024-09-21T03:20:51.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.767+0000 7f65afe00640 1 --2- 172.21.15.90:0/3271447383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6594003c30 0x7f6594004080 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.767+0000 7f65afe00640 1 -- 172.21.15.90:0/3271447383 >> 172.21.15.90:0/3271447383 conn(0x7f65a8048490 msgr2=0x7f65a802ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:51.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.771+0000 7f65afe00640 1 -- 172.21.15.90:0/3271447383 shutdown_connections 2024-09-21T03:20:51.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.773+0000 7f65afe00640 1 -- 172.21.15.90:0/3271447383 wait complete. 2024-09-21T03:20:51.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.780+0000 7f65afe00640 1 Processor -- start 2024-09-21T03:20:51.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.780+0000 7f65afe00640 1 -- start start 2024-09-21T03:20:51.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.786+0000 7f65afe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6594003c30 0x7f65a80f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.786+0000 7f65afe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65a80f0f40 0x7f65a80eee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.786+0000 7f65afe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65a80ef340 0x7f65a8195120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.786+0000 7f65afe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f65a804afd0 con 0x7f65a80f0f40 2024-09-21T03:20:51.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.786+0000 7f65afe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f65a8046450 con 0x7f65a80ef340 2024-09-21T03:20:51.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.786+0000 7f65afe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f65a804b150 con 0x7f6594003c30 2024-09-21T03:20:51.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.786+0000 7f65aea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6594003c30 0x7f65a80f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.786+0000 7f65af400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65a80ef340 0x7f65a8195120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.787+0000 7f65af400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65a80ef340 0x7f65a8195120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:37588/0 (socket says 172.21.15.90:37588) 2024-09-21T03:20:51.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.787+0000 7f65af400640 1 -- 172.21.15.90:0/3358996694 learned_addr learned my addr 172.21.15.90:0/3358996694 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:20:51.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.787+0000 7f65ae000640 1 --2- 172.21.15.90:0/3358996694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65a80f0f40 0x7f65a80eee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.787+0000 7f65af400640 1 -- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6594003c30 msgr2=0x7f65a80f6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.787+0000 7f65af400640 1 --2- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6594003c30 0x7f65a80f6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.787+0000 7f65af400640 1 -- 172.21.15.90:0/3358996694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65a80f0f40 msgr2=0x7f65a80eee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.789+0000 7f65af400640 1 --2- 172.21.15.90:0/3358996694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65a80f0f40 0x7f65a80eee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.789+0000 7f65af400640 1 -- 172.21.15.90:0/3358996694 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a80fe790 con 0x7f65a80ef340 2024-09-21T03:20:51.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.789+0000 7f65ae000640 1 --2- 172.21.15.90:0/3358996694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65a80f0f40 0x7f65a80eee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:20:51.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.790+0000 7f65af400640 1 --2- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65a80ef340 0x7f65a8195120 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f65b0075fd0 tx=0x7f65b0051660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:51.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.793+0000 7f65a6a00640 1 -- 172.21.15.90:0/3358996694 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b00735a0 con 0x7f65a80ef340 2024-09-21T03:20:51.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.793+0000 7f65afe00640 1 -- 172.21.15.90:0/3358996694 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a8041ab0 con 0x7f65a80ef340 2024-09-21T03:20:51.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.793+0000 7f65a6a00640 1 -- 172.21.15.90:0/3358996694 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65b0073740 con 0x7f65a80ef340 2024-09-21T03:20:51.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.795+0000 7f65a6a00640 1 -- 172.21.15.90:0/3358996694 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b0073b50 con 0x7f65a80ef340 2024-09-21T03:20:51.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.795+0000 7f65afe00640 1 -- 172.21.15.90:0/3358996694 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a802fc80 con 0x7f65a80ef340 2024-09-21T03:20:51.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.803+0000 7f659be00640 1 --2- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65a80f7130 0x7f65a80f7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.803+0000 7f659be00640 1 -- 172.21.15.90:0/3358996694 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f65a80fe540 con 0x7f65a80f7130 2024-09-21T03:20:51.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.803+0000 7f65a6a00640 1 -- 172.21.15.90:0/3358996694 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f65b0073cf0 con 0x7f65a80ef340 2024-09-21T03:20:51.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.803+0000 7f65aea00640 1 --2- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65a80f7130 0x7f65a80f7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.807+0000 7f65a6a00640 1 --2- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6590078bc0 0x7f659007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.807+0000 7f65a6a00640 1 -- 172.21.15.90:0/3358996694 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f65b0106680 con 0x7f65a80ef340 2024-09-21T03:20:51.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.807+0000 7f65aea00640 1 -- 172.21.15.90:0/3358996694 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f65a804a560 con 0x7f65a80f7130 2024-09-21T03:20:51.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.807+0000 7f65ae000640 1 --2- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6590078bc0 0x7f659007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.809+0000 7f65aea00640 1 --2- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65a80f7130 0x7f65a80f7540 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f659c030000 tx=0x7f659c001700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:51.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.810+0000 7f65ae000640 1 --2- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6590078bc0 0x7f659007b0d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f65a8196290 tx=0x7f65a0006b90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:51.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.810+0000 7f65a6a00640 1 -- 172.21.15.90:0/3358996694 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c03b030 con 0x7f65a80f7130 2024-09-21T03:20:51.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.811+0000 7f65a6a00640 1 -- 172.21.15.90:0/3358996694 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f659c003800 con 0x7f65a80f7130 2024-09-21T03:20:51.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.811+0000 7f65a6a00640 1 -- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65a80f7130 msgr2=0x7f65a80f7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.811+0000 7f65a6a00640 1 --2- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65a80f7130 0x7f65a80f7540 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f659c030000 tx=0x7f659c001700 comp rx=0 tx=0).stop 2024-09-21T03:20:51.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.811+0000 7f65a6a00640 1 -- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65a80f7130 msgr2=0x7f65a80f7540 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:20:51.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.811+0000 7f65a6a00640 1 --2- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65a80f7130 0x7f65a80f7540 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.854+0000 7f659be00640 1 --2- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65a80f7a80 0x7f65a8002900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.854+0000 7f659be00640 1 -- 172.21.15.90:0/3358996694 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f65a802d050 con 0x7f65a80f7a80 2024-09-21T03:20:51.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.855+0000 7f65aea00640 1 --2- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65a80f7a80 0x7f65a8002900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.860+0000 7f65aea00640 1 -- 172.21.15.90:0/3358996694 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f65a802fa30 con 0x7f65a80f7a80 2024-09-21T03:20:51.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.869+0000 7f65aea00640 1 --2- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65a80f7a80 0x7f65a8002900 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f65a80fe6c0 tx=0x7f659c006ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:51.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.874+0000 7f65a6a00640 1 -- 172.21.15.90:0/3358996694 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c03b030 con 0x7f65a80f7a80 2024-09-21T03:20:51.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.874+0000 7f65a6a00640 1 -- 172.21.15.90:0/3358996694 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4549 (secure 0 0 0) 0x7f659c037420 con 0x7f65a80f7a80 2024-09-21T03:20:51.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.874+0000 7f65a6a00640 1 -- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65a80f7a80 msgr2=0x7f65a8002900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.874+0000 7f65a6a00640 1 --2- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65a80f7a80 0x7f65a8002900 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f65a80fe6c0 tx=0x7f659c006ca0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.874+0000 7f65a6a00640 1 -- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65a80f7a80 msgr2=0x7f65a8002900 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:20:51.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.874+0000 7f65a6a00640 1 --2- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65a80f7a80 0x7f65a8002900 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f65a80fe6c0 tx=0x7f659c006ca0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.877 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:20:51.877 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:20:51.877 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:20:51.877 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:20:51.877 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 46, 2024-09-21T03:20:51.877 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 26194, 2024-09-21T03:20:51.877 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:20:51.877 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:20:51.877 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:20:51.878 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:20:51.878 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:51.878 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 17, 2024-09-21T03:20:51.878 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:20:51.878 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:20:51.878 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:20:51.878 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:51.878 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:51.878 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:51.878 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:51.878 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:51.878 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:51.878 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:51.879 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:51.879 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:51.879 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:51.879 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:51.879 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:51.879 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:20:51.879 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:20:51.879 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:51.879 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:51.879 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:51.879 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:51.879 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:51.879 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:51.879 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:51.880 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:51.880 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:51.880 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:51.880 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:51.880 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:51.880 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.880 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:20:51.880 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:20:51.880 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:20:51.880 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:20:51.880 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:20:51.880 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:20:51.880 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:20:51.880 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:20:51.881 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:20:51.881 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:20:51.881 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:20:51.881 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:20:51.881 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:20:51.881 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:20:51.881 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:20:51.881 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:20:51.881 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:20:51.881 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:20:51.881 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:20:51.881 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:20:51.881 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:20:51.881 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:20:51.882 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:20:51.882 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:20:51.882 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:20:51.882 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:20:51.882 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:20:51.882 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:20:51.882 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:51.882 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:20:51.882 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.882 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:20:51.882 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.882 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:20:51.882 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:20:51.882 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:51.883 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:51.883 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.883 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:51.883 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:20:51.883 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:51.883 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.883 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.883 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:51.883 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:20:51.883 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:51.883 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:51.883 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:51.883 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.883 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:20:51.884 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:20:51.884 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:51.884 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:51.884 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:51.884 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.884 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.884 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:20:51.884 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:20:51.884 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:51.884 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:51.884 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.884 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:51.884 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:20:51.884 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:51.884 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.885 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.885 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:51.885 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:20:51.885 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:51.885 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:51.885 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:51.885 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.885 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:20:51.885 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:20:51.885 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:51.885 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:51.885 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:51.885 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.885 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.886 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:20:51.886 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:20:51.886 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:20:51.886 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:20:51.886 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.886 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:20:51.886 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:20:51.886 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:51.886 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.886 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.886 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:20:51.886 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:20:51.886 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:20:51.886 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:51.886 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:51.887 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.887 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:20:51.887 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:20:51.887 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:20:51.887 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:20:51.887 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:20:51.887 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:51.887 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:51.887 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.887 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:20:51.887 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:20:51.887 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.887 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:51.887 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:51.887 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:20:51.888 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:51.888 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:20:51.888 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:20:51.888 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:20:51.888 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:20:51.888 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:20:51.888 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:20:51.888 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:20:51.888 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:20:51.888 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:20:51.888 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:20:51.888 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:20:51.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.876+0000 7f65afe00640 1 -- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6590078bc0 msgr2=0x7f659007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.876+0000 7f65afe00640 1 --2- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6590078bc0 0x7f659007b0d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f65a8196290 tx=0x7f65a0006b90 comp rx=0 tx=0).stop 2024-09-21T03:20:51.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.876+0000 7f65afe00640 1 -- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65a80ef340 msgr2=0x7f65a8195120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.876+0000 7f65afe00640 1 --2- 172.21.15.90:0/3358996694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65a80ef340 0x7f65a8195120 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f65b0075fd0 tx=0x7f65b0051660 comp rx=0 tx=0).stop 2024-09-21T03:20:51.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.880+0000 7f65af400640 1 -- 172.21.15.90:0/3358996694 reap_dead start 2024-09-21T03:20:51.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.880+0000 7f65af400640 1 -- 172.21.15.90:0/3358996694 reap_dead start 2024-09-21T03:20:51.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.880+0000 7f65afe00640 1 -- 172.21.15.90:0/3358996694 shutdown_connections 2024-09-21T03:20:51.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.880+0000 7f65afe00640 1 -- 172.21.15.90:0/3358996694 >> 172.21.15.90:0/3358996694 conn(0x7f65a8048490 msgr2=0x7f65a800a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:51.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.880+0000 7f65afe00640 1 -- 172.21.15.90:0/3358996694 shutdown_connections 2024-09-21T03:20:51.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:51.880+0000 7f65afe00640 1 -- 172.21.15.90:0/3358996694 wait complete. 2024-09-21T03:20:51.953 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:20:51.953 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-21T03:20:51.954 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-21T03:20:51.954 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-21T03:20:51.954 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-21T03:20:51.954 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-21T03:20:51.954 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:20:52.005 INFO:tasks.ceph.mon.c:Stopped 2024-09-21T03:20:52.005 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-21T03:20:52.005 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:20:52.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.495+0000 7ff1cca00640 1 -- 172.21.15.90:0/2431863935 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8036070 con 0x7ff1d0153a10 2024-09-21T03:20:52.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.496+0000 7ff1d5200640 1 -- 172.21.15.90:0/2431863935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1d0153a10 msgr2=0x7ff1d0156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:52.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.496+0000 7ff1d5200640 1 --2- 172.21.15.90:0/2431863935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1d0153a10 0x7ff1d0156270 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009f60 tx=0x7ff1c802a7c0 comp rx=0 tx=0).stop 2024-09-21T03:20:52.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.497+0000 7ff1d5200640 1 -- 172.21.15.90:0/2431863935 shutdown_connections 2024-09-21T03:20:52.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.497+0000 7ff1d5200640 1 --2- 172.21.15.90:0/2431863935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1d0153a10 0x7ff1d0156270 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:52.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.497+0000 7ff1d5200640 1 -- 172.21.15.90:0/2431863935 >> 172.21.15.90:0/2431863935 conn(0x7ff1d006ecb0 msgr2=0x7ff1d006f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:52.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.498+0000 7ff1d5200640 1 -- 172.21.15.90:0/2431863935 shutdown_connections 2024-09-21T03:20:52.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.498+0000 7ff1d5200640 1 -- 172.21.15.90:0/2431863935 wait complete. 2024-09-21T03:20:52.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.504+0000 7ff1d5200640 1 Processor -- start 2024-09-21T03:20:52.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.505+0000 7ff1d5200640 1 -- start start 2024-09-21T03:20:52.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.508+0000 7ff1d5200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1d0153600 0x7ff1d01ec190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.508+0000 7ff1cde00640 1 -- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1d0153600 msgr2=0x7ff1d01ec190 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:20:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.508+0000 7ff1cde00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1d0153600 0x7ff1d01ec190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:20:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.509+0000 7ff1d5200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1d0153a10 0x7ff1d014f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:52.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.509+0000 7ff1d5200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1d01ec6d0 0x7ff1d014af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:52.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.509+0000 7ff1cd400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1d0153a10 0x7ff1d014f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:52.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.510+0000 7ff1cd400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1d0153a10 0x7ff1d014f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:37594/0 (socket says 172.21.15.90:37594) 2024-09-21T03:20:52.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.510+0000 7ff1d5200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d00c8f70 con 0x7ff1d01ec6d0 2024-09-21T03:20:52.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.510+0000 7ff1d5200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d00c8df0 con 0x7ff1d0153a10 2024-09-21T03:20:52.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.510+0000 7ff1cd400640 1 -- 172.21.15.90:0/1350650608 learned_addr learned my addr 172.21.15.90:0/1350650608 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:20:52.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.510+0000 7ff1d5200640 1 -- 172.21.15.90:0/1350650608 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d00ab8c0 con 0x7ff1d0153600 2024-09-21T03:20:52.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.511+0000 7ff1cf200640 1 --2- 172.21.15.90:0/1350650608 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1d01ec6d0 0x7ff1d014af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:52.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.512+0000 7ff1cd400640 1 -- 172.21.15.90:0/1350650608 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1d0153600 msgr2=0x7ff1d01ec190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:20:52.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.513+0000 7ff1cd400640 1 --2- 172.21.15.90:0/1350650608 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1d0153600 0x7ff1d01ec190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:52.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.515+0000 7ff1cd400640 1 -- 172.21.15.90:0/1350650608 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1d01ec6d0 msgr2=0x7ff1d014af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:52.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.515+0000 7ff1cd400640 1 --2- 172.21.15.90:0/1350650608 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1d01ec6d0 0x7ff1d014af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:52.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.515+0000 7ff1cd400640 1 -- 172.21.15.90:0/1350650608 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d014bcb0 con 0x7ff1d0153a10 2024-09-21T03:20:52.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.519+0000 7ff1cd400640 1 --2- 172.21.15.90:0/1350650608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1d0153a10 0x7ff1d014f470 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00b410 tx=0x7ff1bc00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:52.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.520+0000 7ff1c6000640 1 -- 172.21.15.90:0/1350650608 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc00f8a0 con 0x7ff1d0153a10 2024-09-21T03:20:52.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.520+0000 7ff1d5200640 1 -- 172.21.15.90:0/1350650608 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d01ecbd0 con 0x7ff1d0153a10 2024-09-21T03:20:52.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.520+0000 7ff1d5200640 1 -- 172.21.15.90:0/1350650608 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d00c3a50 con 0x7ff1d0153a10 2024-09-21T03:20:52.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.523+0000 7ff1c6000640 1 -- 172.21.15.90:0/1350650608 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1bc00fb30 con 0x7ff1d0153a10 2024-09-21T03:20:52.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.523+0000 7ff1c6000640 1 -- 172.21.15.90:0/1350650608 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc00f8a0 con 0x7ff1d0153a10 2024-09-21T03:20:52.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.525+0000 7ff1d5200640 1 -- 172.21.15.90:0/1350650608 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a8005290 con 0x7ff1d0153a10 2024-09-21T03:20:52.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.529+0000 7ff1c6000640 1 -- 172.21.15.90:0/1350650608 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff1bc00fce0 con 0x7ff1d0153a10 2024-09-21T03:20:52.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.532+0000 7ff1c6000640 1 --2- 172.21.15.90:0/1350650608 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff1b0078f70 0x7ff1b007b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:52.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.533+0000 7ff1c6000640 1 -- 172.21.15.90:0/1350650608 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7ff1bc00f6a0 con 0x7ff1d0153a10 2024-09-21T03:20:52.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.533+0000 7ff1cde00640 1 --2- 172.21.15.90:0/1350650608 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff1b0078f70 0x7ff1b007b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:52.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.534+0000 7ff1cde00640 1 --2- 172.21.15.90:0/1350650608 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff1b0078f70 0x7ff1b007b480 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00037b0 tx=0x7ff1c0007af0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:52.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:52.544+0000 7ff1c6000640 1 -- 172.21.15.90:0/1350650608 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff1bc015030 con 0x7ff1d0153a10 2024-09-21T03:20:53.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:53.215+0000 7ff1d5200640 1 -- 172.21.15.90:0/1350650608 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff1a8005580 con 0x7ff1d0153a10 2024-09-21T03:20:53.218 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:20:53.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:53.216+0000 7ff1c6000640 1 -- 172.21.15.90:0/1350650608 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7ff1bc0647f0 con 0x7ff1d0153a10 2024-09-21T03:20:53.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:53.226+0000 7ff1d5200640 1 -- 172.21.15.90:0/1350650608 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff1b0078f70 msgr2=0x7ff1b007b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:53.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:53.227+0000 7ff1d5200640 1 --2- 172.21.15.90:0/1350650608 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff1b0078f70 0x7ff1b007b480 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00037b0 tx=0x7ff1c0007af0 comp rx=0 tx=0).stop 2024-09-21T03:20:53.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:53.227+0000 7ff1d5200640 1 -- 172.21.15.90:0/1350650608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1d0153a10 msgr2=0x7ff1d014f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:53.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:53.227+0000 7ff1d5200640 1 --2- 172.21.15.90:0/1350650608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1d0153a10 0x7ff1d014f470 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00b410 tx=0x7ff1bc00b8d0 comp rx=0 tx=0).stop 2024-09-21T03:20:53.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:53.228+0000 7ff1d5200640 1 -- 172.21.15.90:0/1350650608 shutdown_connections 2024-09-21T03:20:53.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:53.228+0000 7ff1d5200640 1 --2- 172.21.15.90:0/1350650608 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff1b0078f70 0x7ff1b007b480 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:53.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:53.228+0000 7ff1d5200640 1 --2- 172.21.15.90:0/1350650608 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1d01ec6d0 0x7ff1d014af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:53.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:53.228+0000 7ff1d5200640 1 --2- 172.21.15.90:0/1350650608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1d0153a10 0x7ff1d014f470 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:53.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:53.228+0000 7ff1d5200640 1 --2- 172.21.15.90:0/1350650608 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1d0153600 0x7ff1d01ec190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:53.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:53.228+0000 7ff1d5200640 1 -- 172.21.15.90:0/1350650608 >> 172.21.15.90:0/1350650608 conn(0x7ff1d006ecb0 msgr2=0x7ff1d00c6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:53.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:53.228+0000 7ff1d5200640 1 -- 172.21.15.90:0/1350650608 shutdown_connections 2024-09-21T03:20:53.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:53.228+0000 7ff1d5200640 1 -- 172.21.15.90:0/1350650608 wait complete. 2024-09-21T03:20:56.284 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:20:56.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.825+0000 7f968b200640 1 -- 172.21.15.90:0/3293961986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96841494a0 msgr2=0x7f96841560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:56.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.825+0000 7f968b200640 1 --2- 172.21.15.90:0/3293961986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96841494a0 0x7f96841560d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9680005fd0 tx=0x7f968002aa30 comp rx=0 tx=0).stop 2024-09-21T03:20:56.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.825+0000 7f968b200640 1 -- 172.21.15.90:0/3293961986 shutdown_connections 2024-09-21T03:20:56.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.825+0000 7f968b200640 1 --2- 172.21.15.90:0/3293961986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96841494a0 0x7f96841560d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.825+0000 7f968b200640 1 --2- 172.21.15.90:0/3293961986 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96840c4720 0x7f968406ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.825+0000 7f968b200640 1 -- 172.21.15.90:0/3293961986 >> 172.21.15.90:0/3293961986 conn(0x7f96840c80a0 msgr2=0x7f96840c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:56.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.826+0000 7f968b200640 1 -- 172.21.15.90:0/3293961986 shutdown_connections 2024-09-21T03:20:56.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.826+0000 7f968b200640 1 -- 172.21.15.90:0/3293961986 wait complete. 2024-09-21T03:20:56.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.832+0000 7f968b200640 1 Processor -- start 2024-09-21T03:20:56.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.832+0000 7f968b200640 1 -- start start 2024-09-21T03:20:56.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.834+0000 7f968b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96840ab780 0x7f9684141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.834+0000 7f968b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96840c4720 0x7f96841557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.834+0000 7f968b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96841494a0 0x7f96841f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.835+0000 7f968b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9684074f30 con 0x7f96840c4720 2024-09-21T03:20:56.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.835+0000 7f968a800640 1 -- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96841494a0 msgr2=0x7f96841f4500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:20:56.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.835+0000 7f968a800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96841494a0 0x7f96841f4500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:20:56.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.835+0000 7f9689400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96840c4720 0x7f96841557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.835+0000 7f968b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f96840ad660 con 0x7f96840ab780 2024-09-21T03:20:56.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.835+0000 7f968b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f96840c5700 con 0x7f96841494a0 2024-09-21T03:20:56.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.835+0000 7f9689400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96840c4720 0x7f96841557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52642/0 (socket says 172.21.15.90:52642) 2024-09-21T03:20:56.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.835+0000 7f9689400640 1 -- 172.21.15.90:0/3093416432 learned_addr learned my addr 172.21.15.90:0/3093416432 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:20:56.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.836+0000 7f9689400640 1 -- 172.21.15.90:0/3093416432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96841494a0 msgr2=0x7f96841f4500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:20:56.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.836+0000 7f9689400640 1 --2- 172.21.15.90:0/3093416432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96841494a0 0x7f96841f4500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.836+0000 7f9689400640 1 -- 172.21.15.90:0/3093416432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96840ab780 msgr2=0x7f9684141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:56.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.836+0000 7f9689400640 1 --2- 172.21.15.90:0/3093416432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96840ab780 0x7f9684141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.836+0000 7f9689400640 1 -- 172.21.15.90:0/3093416432 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96841429d0 con 0x7f96840c4720 2024-09-21T03:20:56.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.839+0000 7f9689400640 1 --2- 172.21.15.90:0/3093416432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96840c4720 0x7f96841557a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f967800c730 tx=0x7f967800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:56.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.839+0000 7f967e000640 1 -- 172.21.15.90:0/3093416432 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96780050d0 con 0x7f96840c4720 2024-09-21T03:20:56.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.840+0000 7f968b200640 1 -- 172.21.15.90:0/3093416432 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96841459c0 con 0x7f96840c4720 2024-09-21T03:20:56.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.840+0000 7f968b200640 1 -- 172.21.15.90:0/3093416432 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96841424e0 con 0x7f96840c4720 2024-09-21T03:20:56.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.840+0000 7f967e000640 1 -- 172.21.15.90:0/3093416432 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9678005270 con 0x7f96840c4720 2024-09-21T03:20:56.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.840+0000 7f967e000640 1 -- 172.21.15.90:0/3093416432 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967800a8a0 con 0x7f96840c4720 2024-09-21T03:20:56.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.844+0000 7f968b200640 1 -- 172.21.15.90:0/3093416432 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9660005290 con 0x7f96840c4720 2024-09-21T03:20:56.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.846+0000 7f967e000640 1 -- 172.21.15.90:0/3093416432 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f967800aa40 con 0x7f96840c4720 2024-09-21T03:20:56.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.848+0000 7f967e000640 1 --2- 172.21.15.90:0/3093416432 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9668078b70 0x7f966807b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.848+0000 7f967e000640 1 -- 172.21.15.90:0/3093416432 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f967809a970 con 0x7f96840c4720 2024-09-21T03:20:56.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.849+0000 7f9689e00640 1 --2- 172.21.15.90:0/3093416432 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9668078b70 0x7f966807b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.852+0000 7f9689e00640 1 --2- 172.21.15.90:0/3093416432 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9668078b70 0x7f966807b080 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9674001050 tx=0x7f9674006cf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:56.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:56.856+0000 7f967e000640 1 -- 172.21.15.90:0/3093416432 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9678062b30 con 0x7f96840c4720 2024-09-21T03:20:57.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:57.473+0000 7f968b200640 1 -- 172.21.15.90:0/3093416432 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9660005580 con 0x7f96840c4720 2024-09-21T03:20:57.479 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:20:57.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:57.474+0000 7f967e000640 1 -- 172.21.15.90:0/3093416432 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f9678062430 con 0x7f96840c4720 2024-09-21T03:20:57.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:57.478+0000 7f968b200640 1 -- 172.21.15.90:0/3093416432 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9668078b70 msgr2=0x7f966807b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:57.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:57.478+0000 7f968b200640 1 --2- 172.21.15.90:0/3093416432 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9668078b70 0x7f966807b080 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9674001050 tx=0x7f9674006cf0 comp rx=0 tx=0).stop 2024-09-21T03:20:57.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:57.478+0000 7f968b200640 1 -- 172.21.15.90:0/3093416432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96840c4720 msgr2=0x7f96841557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:57.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:57.478+0000 7f968b200640 1 --2- 172.21.15.90:0/3093416432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96840c4720 0x7f96841557a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f967800c730 tx=0x7f967800cbf0 comp rx=0 tx=0).stop 2024-09-21T03:20:57.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:57.479+0000 7f968b200640 1 -- 172.21.15.90:0/3093416432 shutdown_connections 2024-09-21T03:20:57.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:57.479+0000 7f968b200640 1 --2- 172.21.15.90:0/3093416432 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9668078b70 0x7f966807b080 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:57.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:57.479+0000 7f968b200640 1 --2- 172.21.15.90:0/3093416432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96841494a0 0x7f96841f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:57.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:57.479+0000 7f968b200640 1 --2- 172.21.15.90:0/3093416432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96840c4720 0x7f96841557a0 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f967800c730 tx=0x7f967800cbf0 comp rx=0 tx=0).stop 2024-09-21T03:20:57.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:57.479+0000 7f968b200640 1 --2- 172.21.15.90:0/3093416432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96840ab780 0x7f9684141fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:57.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:57.479+0000 7f968b200640 1 -- 172.21.15.90:0/3093416432 >> 172.21.15.90:0/3093416432 conn(0x7f96840c80a0 msgr2=0x7f968415fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:57.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:57.479+0000 7f968b200640 1 -- 172.21.15.90:0/3093416432 shutdown_connections 2024-09-21T03:20:57.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:20:57.479+0000 7f968b200640 1 -- 172.21.15.90:0/3093416432 wait complete. 2024-09-21T03:21:00.195 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:21:00.204 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:21:00.554 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:21:01.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.031+0000 7f2c5a800640 1 -- 172.21.15.90:0/332283388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c4c0da1b0 msgr2=0x7f2c4c0d7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:01.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.032+0000 7f2c5a800640 1 --2- 172.21.15.90:0/332283388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c4c0da1b0 0x7f2c4c0d7820 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2c48009830 tx=0x7f2c4802a530 comp rx=0 tx=0).stop 2024-09-21T03:21:01.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.032+0000 7f2c5a800640 1 -- 172.21.15.90:0/332283388 shutdown_connections 2024-09-21T03:21:01.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.032+0000 7f2c5a800640 1 --2- 172.21.15.90:0/332283388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c4c0da1b0 0x7f2c4c0d7820 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.032+0000 7f2c5a800640 1 -- 172.21.15.90:0/332283388 >> 172.21.15.90:0/332283388 conn(0x7f2c4c048480 msgr2=0x7f2c4c048890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:01.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.033+0000 7f2c5a800640 1 -- 172.21.15.90:0/332283388 shutdown_connections 2024-09-21T03:21:01.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.033+0000 7f2c5a800640 1 -- 172.21.15.90:0/332283388 wait complete. 2024-09-21T03:21:01.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.056+0000 7f2c5a800640 1 Processor -- start 2024-09-21T03:21:01.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.057+0000 7f2c5a800640 1 -- start start 2024-09-21T03:21:01.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.078+0000 7f2c5a800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c4c046820 0x7f2c4c02bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:01.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.078+0000 7f2c5a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c4c0da1b0 0x7f2c4c043f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:01.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.078+0000 7f2c5a800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c4c0db6a0 0x7f2c4c0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:01.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.078+0000 7f2c5a800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c0478b0 con 0x7f2c4c0db6a0 2024-09-21T03:21:01.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.078+0000 7f2c5a800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c007640 con 0x7f2c4c0da1b0 2024-09-21T03:21:01.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.078+0000 7f2c5a800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2c4c00b140 con 0x7f2c4c046820 2024-09-21T03:21:01.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.086+0000 7f2c53400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c4c0db6a0 0x7f2c4c0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:01.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.086+0000 7f2c53400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c4c0db6a0 0x7f2c4c0d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52658/0 (socket says 172.21.15.90:52658) 2024-09-21T03:21:01.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.086+0000 7f2c53400640 1 -- 172.21.15.90:0/4066784319 learned_addr learned my addr 172.21.15.90:0/4066784319 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:21:01.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.086+0000 7f2c59200640 1 -- 172.21.15.90:0/4066784319 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c4c046820 msgr2=0x7f2c4c02bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:21:01.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.087+0000 7f2c59200640 1 --2- 172.21.15.90:0/4066784319 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c4c046820 0x7f2c4c02bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:21:01.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.088+0000 7f2c53400640 1 -- 172.21.15.90:0/4066784319 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c4c046820 msgr2=0x7f2c4c02bb30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:21:01.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.088+0000 7f2c53400640 1 --2- 172.21.15.90:0/4066784319 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c4c046820 0x7f2c4c02bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.088+0000 7f2c53400640 1 -- 172.21.15.90:0/4066784319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c4c0da1b0 msgr2=0x7f2c4c043f50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:21:01.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.088+0000 7f2c52a00640 1 --2- 172.21.15.90:0/4066784319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c4c0da1b0 0x7f2c4c043f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:01.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.088+0000 7f2c53400640 1 --2- 172.21.15.90:0/4066784319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c4c0da1b0 0x7f2c4c043f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.088+0000 7f2c53400640 1 -- 172.21.15.90:0/4066784319 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4c174a00 con 0x7f2c4c0db6a0 2024-09-21T03:21:01.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.089+0000 7f2c53400640 1 --2- 172.21.15.90:0/4066784319 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c4c0db6a0 0x7f2c4c0d0880 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000b440 tx=0x7f2c4000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:01.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.095+0000 7f2c47400640 1 -- 172.21.15.90:0/4066784319 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40015030 con 0x7f2c4c0db6a0 2024-09-21T03:21:01.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.096+0000 7f2c47400640 1 -- 172.21.15.90:0/4066784319 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c40004110 con 0x7f2c4c0db6a0 2024-09-21T03:21:01.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.096+0000 7f2c47400640 1 -- 172.21.15.90:0/4066784319 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40011630 con 0x7f2c4c0db6a0 2024-09-21T03:21:01.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.097+0000 7f2c5a800640 1 -- 172.21.15.90:0/4066784319 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c4c044fa0 con 0x7f2c4c0db6a0 2024-09-21T03:21:01.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.101+0000 7f2c5a800640 1 -- 172.21.15.90:0/4066784319 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c4c044490 con 0x7f2c4c0db6a0 2024-09-21T03:21:01.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.116+0000 7f2c5a800640 1 -- 172.21.15.90:0/4066784319 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c4c0dc270 con 0x7f2c4c0db6a0 2024-09-21T03:21:01.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.117+0000 7f2c47400640 1 -- 172.21.15.90:0/4066784319 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2c40018070 con 0x7f2c4c0db6a0 2024-09-21T03:21:01.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.118+0000 7f2c47400640 1 --2- 172.21.15.90:0/4066784319 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2c34078bc0 0x7f2c3407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:01.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.119+0000 7f2c47400640 1 -- 172.21.15.90:0/4066784319 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f2c4009ab40 con 0x7f2c4c0db6a0 2024-09-21T03:21:01.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.119+0000 7f2c59200640 1 --2- 172.21.15.90:0/4066784319 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2c34078bc0 0x7f2c3407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:01.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.122+0000 7f2c59200640 1 --2- 172.21.15.90:0/4066784319 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2c34078bc0 0x7f2c3407b0d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2c5402ebd0 tx=0x7f2c5406b640 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:01.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.138+0000 7f2c47400640 1 -- 172.21.15.90:0/4066784319 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2c40062cc0 con 0x7f2c4c0db6a0 2024-09-21T03:21:01.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.852+0000 7f2c5a800640 1 -- 172.21.15.90:0/4066784319 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2c4c042710 con 0x7f2c4c0db6a0 2024-09-21T03:21:01.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.853+0000 7f2c47400640 1 -- 172.21.15.90:0/4066784319 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f2c400625c0 con 0x7f2c4c0db6a0 2024-09-21T03:21:01.859 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":27,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:21:01.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.858+0000 7f2c5a800640 1 -- 172.21.15.90:0/4066784319 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2c34078bc0 msgr2=0x7f2c3407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:01.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.858+0000 7f2c5a800640 1 --2- 172.21.15.90:0/4066784319 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2c34078bc0 0x7f2c3407b0d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2c5402ebd0 tx=0x7f2c5406b640 comp rx=0 tx=0).stop 2024-09-21T03:21:01.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.858+0000 7f2c5a800640 1 -- 172.21.15.90:0/4066784319 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c4c0db6a0 msgr2=0x7f2c4c0d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:01.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.858+0000 7f2c5a800640 1 --2- 172.21.15.90:0/4066784319 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c4c0db6a0 0x7f2c4c0d0880 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000b440 tx=0x7f2c4000b900 comp rx=0 tx=0).stop 2024-09-21T03:21:01.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.859+0000 7f2c5a800640 1 -- 172.21.15.90:0/4066784319 shutdown_connections 2024-09-21T03:21:01.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.859+0000 7f2c5a800640 1 --2- 172.21.15.90:0/4066784319 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2c34078bc0 0x7f2c3407b0d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.859+0000 7f2c5a800640 1 --2- 172.21.15.90:0/4066784319 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c4c0db6a0 0x7f2c4c0d0880 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.859+0000 7f2c5a800640 1 --2- 172.21.15.90:0/4066784319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c4c0da1b0 0x7f2c4c043f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.859+0000 7f2c5a800640 1 --2- 172.21.15.90:0/4066784319 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c4c046820 0x7f2c4c02bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.859+0000 7f2c5a800640 1 -- 172.21.15.90:0/4066784319 >> 172.21.15.90:0/4066784319 conn(0x7f2c4c048480 msgr2=0x7f2c4c0d8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:01.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.860+0000 7f2c5a800640 1 -- 172.21.15.90:0/4066784319 shutdown_connections 2024-09-21T03:21:01.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:01.861+0000 7f2c5a800640 1 -- 172.21.15.90:0/4066784319 wait complete. 2024-09-21T03:21:04.921 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:21:06.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:06.994+0000 7ff533e00640 1 -- 172.21.15.90:0/3119531055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff518005350 msgr2=0x7ff51800ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:06.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:06.994+0000 7ff533e00640 1 --2- 172.21.15.90:0/3119531055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff518005350 0x7ff51800ba00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff534156be0 tx=0x7ff518005830 comp rx=0 tx=0).stop 2024-09-21T03:21:07.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:06.995+0000 7ff533e00640 1 -- 172.21.15.90:0/3119531055 shutdown_connections 2024-09-21T03:21:07.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:06.995+0000 7ff533e00640 1 --2- 172.21.15.90:0/3119531055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff518005350 0x7ff51800ba00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:06.995+0000 7ff533e00640 1 -- 172.21.15.90:0/3119531055 >> 172.21.15.90:0/3119531055 conn(0x7ff5340c84c0 msgr2=0x7ff5340c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:07.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:06.995+0000 7ff533e00640 1 -- 172.21.15.90:0/3119531055 shutdown_connections 2024-09-21T03:21:07.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:06.995+0000 7ff533e00640 1 -- 172.21.15.90:0/3119531055 wait complete. 2024-09-21T03:21:07.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.006+0000 7ff533e00640 1 Processor -- start 2024-09-21T03:21:07.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.006+0000 7ff533e00640 1 -- start start 2024-09-21T03:21:07.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.012+0000 7ff533e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff518005350 0x7ff5341f5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:07.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.012+0000 7ff533e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5341f1150 0x7ff534152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:07.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.012+0000 7ff533e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff53414c1a0 0x7ff53414c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:07.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.013+0000 7ff533e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff5340c48e0 con 0x7ff53414c1a0 2024-09-21T03:21:07.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.013+0000 7ff533e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff53406fa30 con 0x7ff5341f1150 2024-09-21T03:21:07.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.013+0000 7ff533e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff5340c51a0 con 0x7ff518005350 2024-09-21T03:21:07.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.016+0000 7ff532a00640 1 -- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff518005350 msgr2=0x7ff5341f5190 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:21:07.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.016+0000 7ff532a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff518005350 0x7ff5341f5190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:21:07.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.017+0000 7ff532000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5341f1150 0x7ff534152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:07.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.017+0000 7ff532000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5341f1150 0x7ff534152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:57818/0 (socket says 172.21.15.90:57818) 2024-09-21T03:21:07.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.017+0000 7ff532000640 1 -- 172.21.15.90:0/4055019578 learned_addr learned my addr 172.21.15.90:0/4055019578 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:21:07.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.018+0000 7ff532000640 1 -- 172.21.15.90:0/4055019578 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff518005350 msgr2=0x7ff5341f5190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:21:07.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.018+0000 7ff532000640 1 --2- 172.21.15.90:0/4055019578 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff518005350 0x7ff5341f5190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.018+0000 7ff532000640 1 -- 172.21.15.90:0/4055019578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff53414c1a0 msgr2=0x7ff53414c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:07.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.018+0000 7ff532000640 1 --2- 172.21.15.90:0/4055019578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff53414c1a0 0x7ff53414c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.018+0000 7ff532000640 1 -- 172.21.15.90:0/4055019578 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff534074680 con 0x7ff5341f1150 2024-09-21T03:21:07.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.020+0000 7ff532000640 1 --2- 172.21.15.90:0/4055019578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5341f1150 0x7ff534152cd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00c9c0 tx=0x7ff52c00ce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:07.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.028+0000 7ff52aa00640 1 -- 172.21.15.90:0/4055019578 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c003d80 con 0x7ff5341f1150 2024-09-21T03:21:07.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.029+0000 7ff52aa00640 1 -- 172.21.15.90:0/4055019578 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff52c005070 con 0x7ff5341f1150 2024-09-21T03:21:07.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.029+0000 7ff52aa00640 1 -- 172.21.15.90:0/4055019578 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c0054c0 con 0x7ff5341f1150 2024-09-21T03:21:07.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.029+0000 7ff533e00640 1 -- 172.21.15.90:0/4055019578 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff53414caf0 con 0x7ff5341f1150 2024-09-21T03:21:07.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.029+0000 7ff533e00640 1 -- 172.21.15.90:0/4055019578 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5340730e0 con 0x7ff5341f1150 2024-09-21T03:21:07.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.032+0000 7ff533e00640 1 -- 172.21.15.90:0/4055019578 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff50c005290 con 0x7ff5341f1150 2024-09-21T03:21:07.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.046+0000 7ff52aa00640 1 -- 172.21.15.90:0/4055019578 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff52c005660 con 0x7ff5341f1150 2024-09-21T03:21:07.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.047+0000 7ff52aa00640 1 --2- 172.21.15.90:0/4055019578 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff514078b90 0x7ff51407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:07.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.048+0000 7ff52aa00640 1 -- 172.21.15.90:0/4055019578 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7ff52c09b620 con 0x7ff5341f1150 2024-09-21T03:21:07.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.050+0000 7ff532a00640 1 --2- 172.21.15.90:0/4055019578 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff514078b90 0x7ff51407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:07.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.052+0000 7ff532a00640 1 --2- 172.21.15.90:0/4055019578 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff514078b90 0x7ff51407b0a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff5200036a0 tx=0x7ff520007ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:07.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.061+0000 7ff52aa00640 1 -- 172.21.15.90:0/4055019578 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff52c020060 con 0x7ff5341f1150 2024-09-21T03:21:07.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.704+0000 7ff533e00640 1 -- 172.21.15.90:0/4055019578 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff50c005580 con 0x7ff5341f1150 2024-09-21T03:21:07.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.706+0000 7ff52aa00640 1 -- 172.21.15.90:0/4055019578 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7ff53414caf0 con 0x7ff5341f1150 2024-09-21T03:21:07.708 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":50,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:21:07.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.715+0000 7ff533e00640 1 -- 172.21.15.90:0/4055019578 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff514078b90 msgr2=0x7ff51407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:07.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.715+0000 7ff533e00640 1 --2- 172.21.15.90:0/4055019578 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff514078b90 0x7ff51407b0a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff5200036a0 tx=0x7ff520007ab0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.715+0000 7ff533e00640 1 -- 172.21.15.90:0/4055019578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5341f1150 msgr2=0x7ff534152cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:07.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.715+0000 7ff533e00640 1 --2- 172.21.15.90:0/4055019578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5341f1150 0x7ff534152cd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00c9c0 tx=0x7ff52c00ce80 comp rx=0 tx=0).stop 2024-09-21T03:21:07.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.716+0000 7ff533e00640 1 -- 172.21.15.90:0/4055019578 shutdown_connections 2024-09-21T03:21:07.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.716+0000 7ff533e00640 1 --2- 172.21.15.90:0/4055019578 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff514078b90 0x7ff51407b0a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.716+0000 7ff533e00640 1 --2- 172.21.15.90:0/4055019578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff53414c1a0 0x7ff53414c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.716+0000 7ff533e00640 1 --2- 172.21.15.90:0/4055019578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5341f1150 0x7ff534152cd0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.716+0000 7ff533e00640 1 --2- 172.21.15.90:0/4055019578 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff518005350 0x7ff5341f5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.716+0000 7ff533e00640 1 -- 172.21.15.90:0/4055019578 >> 172.21.15.90:0/4055019578 conn(0x7ff5340c84c0 msgr2=0x7ff53414fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:07.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.716+0000 7ff533e00640 1 -- 172.21.15.90:0/4055019578 shutdown_connections 2024-09-21T03:21:07.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:07.716+0000 7ff533e00640 1 -- 172.21.15.90:0/4055019578 wait complete. 2024-09-21T03:21:07.765 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-21T03:21:07.765 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-21T03:21:07.765 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:21:08.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.274+0000 7fc6fec00640 1 -- 172.21.15.90:0/3856151232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f80c29a0 msgr2=0x7fc6f80c2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:08.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.274+0000 7fc6f7e00640 1 -- 172.21.15.90:0/3856151232 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec035020 con 0x7fc6f80c29a0 2024-09-21T03:21:08.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.274+0000 7fc6fec00640 1 --2- 172.21.15.90:0/3856151232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f80c29a0 0x7fc6f80c2db0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec005fd0 tx=0x7fc6ec02a4d0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.277+0000 7fc6fec00640 1 -- 172.21.15.90:0/3856151232 shutdown_connections 2024-09-21T03:21:08.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.277+0000 7fc6fec00640 1 --2- 172.21.15.90:0/3856151232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f80c29a0 0x7fc6f80c2db0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.277+0000 7fc6fec00640 1 --2- 172.21.15.90:0/3856151232 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6f80748b0 0x7fc6f8070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.277+0000 7fc6fec00640 1 -- 172.21.15.90:0/3856151232 >> 172.21.15.90:0/3856151232 conn(0x7fc6f80c4aa0 msgr2=0x7fc6f80c4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:08.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.277+0000 7fc6fec00640 1 -- 172.21.15.90:0/3856151232 shutdown_connections 2024-09-21T03:21:08.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.278+0000 7fc6fec00640 1 -- 172.21.15.90:0/3856151232 wait complete. 2024-09-21T03:21:08.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.283+0000 7fc6fec00640 1 Processor -- start 2024-09-21T03:21:08.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.284+0000 7fc6fec00640 1 -- start start 2024-09-21T03:21:08.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.287+0000 7fc6fec00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6f80748b0 0x7fc6f80ab500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:08.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.287+0000 7fc6fec00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f80c29a0 0x7fc6f8159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:08.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.288+0000 7fc6fd800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6f80748b0 0x7fc6f80ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:08.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.288+0000 7fc6fd800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6f80748b0 0x7fc6f80ab500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:57822/0 (socket says 172.21.15.90:57822) 2024-09-21T03:21:08.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.288+0000 7fc6fce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f80c29a0 0x7fc6f8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:08.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.288+0000 7fc6fce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f80c29a0 0x7fc6f8159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55612/0 (socket says 172.21.15.90:55612) 2024-09-21T03:21:08.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.288+0000 7fc6fd800640 1 -- 172.21.15.90:0/1715618392 learned_addr learned my addr 172.21.15.90:0/1715618392 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:21:08.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.288+0000 7fc6fec00640 1 --2- 172.21.15.90:0/1715618392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6f81503f0 0x7fc6f81535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:08.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.288+0000 7fc6fec00640 1 -- 172.21.15.90:0/1715618392 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f8074300 con 0x7fc6f80c29a0 2024-09-21T03:21:08.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.288+0000 7fc6fec00640 1 -- 172.21.15.90:0/1715618392 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f8071050 con 0x7fc6f80748b0 2024-09-21T03:21:08.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.288+0000 7fc6fec00640 1 -- 172.21.15.90:0/1715618392 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f8074480 con 0x7fc6f81503f0 2024-09-21T03:21:08.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.290+0000 7fc6fce00640 1 -- 172.21.15.90:0/1715618392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6f81503f0 msgr2=0x7fc6f81535f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:21:08.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.290+0000 7fc6fce00640 1 --2- 172.21.15.90:0/1715618392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6f81503f0 0x7fc6f81535f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.290+0000 7fc6fce00640 1 -- 172.21.15.90:0/1715618392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6f80748b0 msgr2=0x7fc6f80ab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:08.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.290+0000 7fc6fce00640 1 --2- 172.21.15.90:0/1715618392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6f80748b0 0x7fc6f80ab500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.290+0000 7fc6fce00640 1 -- 172.21.15.90:0/1715618392 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f8150ff0 con 0x7fc6f80c29a0 2024-09-21T03:21:08.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.290+0000 7fc6fce00640 1 --2- 172.21.15.90:0/1715618392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f80c29a0 0x7fc6f8159900 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec031000 tx=0x7fc6ec004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:08.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.293+0000 7fc6f5600640 1 -- 172.21.15.90:0/1715618392 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec03e030 con 0x7fc6f80c29a0 2024-09-21T03:21:08.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.293+0000 7fc6f5600640 1 -- 172.21.15.90:0/1715618392 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6ec004480 con 0x7fc6f80c29a0 2024-09-21T03:21:08.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.293+0000 7fc6f5600640 1 -- 172.21.15.90:0/1715618392 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec03e030 con 0x7fc6f80c29a0 2024-09-21T03:21:08.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.293+0000 7fc6fec00640 1 -- 172.21.15.90:0/1715618392 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f81f1160 con 0x7fc6f80c29a0 2024-09-21T03:21:08.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.295+0000 7fc6fec00640 1 -- 172.21.15.90:0/1715618392 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f81f1420 con 0x7fc6f80c29a0 2024-09-21T03:21:08.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.298+0000 7fc6fec00640 1 --2- 172.21.15.90:0/1715618392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f81f15f0 0x7fc6f813e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:08.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.298+0000 7fc6fec00640 1 -- 172.21.15.90:0/1715618392 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f80abe70 con 0x7fc6f81f15f0 2024-09-21T03:21:08.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.299+0000 7fc6fd800640 1 --2- 172.21.15.90:0/1715618392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f81f15f0 0x7fc6f813e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:08.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.301+0000 7fc6fd800640 1 -- 172.21.15.90:0/1715618392 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc6f8072cd0 con 0x7fc6f81f15f0 2024-09-21T03:21:08.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.302+0000 7fc6f5600640 1 -- 172.21.15.90:0/1715618392 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc6ec041030 con 0x7fc6f80c29a0 2024-09-21T03:21:08.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.302+0000 7fc6fd800640 1 --2- 172.21.15.90:0/1715618392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f81f15f0 0x7fc6f813e6b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400d730 tx=0x7fc6e400dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:08.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.305+0000 7fc6f5600640 1 --2- 172.21.15.90:0/1715618392 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc6d8078fc0 0x7fc6d807b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:08.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.306+0000 7fc6f5600640 1 -- 172.21.15.90:0/1715618392 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fc6ec03f070 con 0x7fc6f80c29a0 2024-09-21T03:21:08.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.307+0000 7fc6f5600640 1 -- 172.21.15.90:0/1715618392 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e400b730 con 0x7fc6f81f15f0 2024-09-21T03:21:08.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.307+0000 7fc6fe200640 1 --2- 172.21.15.90:0/1715618392 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc6d8078fc0 0x7fc6d807b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:08.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.307+0000 7fc6f5600640 1 -- 172.21.15.90:0/1715618392 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc6e4019070 con 0x7fc6f81f15f0 2024-09-21T03:21:08.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.308+0000 7fc6f5600640 1 -- 172.21.15.90:0/1715618392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f81f15f0 msgr2=0x7fc6f813e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:08.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.308+0000 7fc6f5600640 1 --2- 172.21.15.90:0/1715618392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f81f15f0 0x7fc6f813e6b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400d730 tx=0x7fc6e400dbf0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.308+0000 7fc6f5600640 1 -- 172.21.15.90:0/1715618392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f81f15f0 msgr2=0x7fc6f813e6b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:21:08.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.308+0000 7fc6f5600640 1 --2- 172.21.15.90:0/1715618392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f81f15f0 0x7fc6f813e6b0 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400d730 tx=0x7fc6e400dbf0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.309+0000 7fc6fe200640 1 --2- 172.21.15.90:0/1715618392 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc6d8078fc0 0x7fc6d807b4d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00012e0 tx=0x7fc6f0007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:08.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.327+0000 7fc6fec00640 1 --2- 172.21.15.90:0/1715618392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f813ebf0 0x7fc6f81f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:08.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.327+0000 7fc6fec00640 1 -- 172.21.15.90:0/1715618392 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f813f000 con 0x7fc6f813ebf0 2024-09-21T03:21:08.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.329+0000 7fc6fd800640 1 --2- 172.21.15.90:0/1715618392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f813ebf0 0x7fc6f81f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:08.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.330+0000 7fc6fd800640 1 -- 172.21.15.90:0/1715618392 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc6f815b150 con 0x7fc6f813ebf0 2024-09-21T03:21:08.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.331+0000 7fc6fd800640 1 --2- 172.21.15.90:0/1715618392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f813ebf0 0x7fc6f81f46d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400d730 tx=0x7fc6e40047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:08.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.331+0000 7fc6f5600640 1 -- 172.21.15.90:0/1715618392 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e400b730 con 0x7fc6f813ebf0 2024-09-21T03:21:08.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.333+0000 7fc6f5600640 1 -- 172.21.15.90:0/1715618392 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4707 (secure 0 0 0) 0x7fc6e400b730 con 0x7fc6f813ebf0 2024-09-21T03:21:08.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.333+0000 7fc6f5600640 1 -- 172.21.15.90:0/1715618392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f813ebf0 msgr2=0x7fc6f81f46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:08.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.333+0000 7fc6f5600640 1 --2- 172.21.15.90:0/1715618392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f813ebf0 0x7fc6f81f46d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400d730 tx=0x7fc6e40047f0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.333+0000 7fc6f5600640 1 -- 172.21.15.90:0/1715618392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f813ebf0 msgr2=0x7fc6f81f46d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:21:08.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.333+0000 7fc6f5600640 1 --2- 172.21.15.90:0/1715618392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f813ebf0 0x7fc6f81f46d0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400d730 tx=0x7fc6e40047f0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.336 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:21:08.336 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:21:08.336 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:21:08.336 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:21:08.336 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 50, 2024-09-21T03:21:08.336 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 112107, 2024-09-21T03:21:08.336 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:21:08.336 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:21:08.336 INFO:teuthology.orchestra.run.smithi090.stdout: 1 2024-09-21T03:21:08.336 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:08.336 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 1, 2024-09-21T03:21:08.336 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:21:08.336 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:21:08.337 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:21:08.337 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:08.337 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:08.337 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:08.337 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:08.337 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:08.337 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:08.337 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:08.337 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:08.337 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:08.337 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:08.337 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:08.337 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:08.337 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:21:08.337 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:21:08.337 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:08.338 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:08.338 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:08.338 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:08.338 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:08.338 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:08.338 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:08.338 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:08.338 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:08.338 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:08.338 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:08.338 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:08.338 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:08.338 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:21:08.339 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:21:08.339 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:21:08.339 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:21:08.339 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:21:08.339 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:21:08.339 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:21:08.339 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:21:08.339 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:21:08.339 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:21:08.339 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:21:08.339 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:21:08.339 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:21:08.339 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:21:08.339 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:21:08.339 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:21:08.339 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:21:08.340 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:08.340 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:08.340 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:08.340 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:08.340 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:08.340 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:08.340 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:08.340 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:08.340 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:08.340 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:08.340 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:08.340 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:08.340 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:21:08.340 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:08.340 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:21:08.340 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:08.341 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:21:08.341 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:21:08.341 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:08.341 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:08.341 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:08.341 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:08.341 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:21:08.341 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:08.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:08.341 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:08.341 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:08.341 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:21:08.341 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:08.341 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:08.341 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:08.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:08.342 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:21:08.342 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:21:08.342 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:08.342 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:08.342 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:08.342 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:08.342 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:08.342 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:21:08.342 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:21:08.342 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:08.342 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:08.342 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:08.342 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:08.342 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:21:08.342 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:08.343 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:08.343 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:08.343 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:08.343 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:21:08.343 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:08.343 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:08.343 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:08.343 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:08.343 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:21:08.343 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:21:08.343 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:08.343 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:08.343 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:08.343 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:08.343 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:08.343 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:21:08.344 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:21:08.344 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:08.344 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:08.344 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:08.344 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:08.344 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:21:08.344 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:08.344 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:08.344 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:08.344 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:08.344 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:21:08.344 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:08.344 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:08.344 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:08.344 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:08.345 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:21:08.345 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:21:08.345 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:08.345 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:08.345 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:08.345 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:08.345 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:08.345 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:08.345 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:21:08.345 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:21:08.345 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:08.345 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:08.345 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:08.345 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:21:08.345 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:08.346 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:08.346 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:21:08.346 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:08.346 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:08.346 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:08.346 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:21:08.346 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:08.346 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:08.346 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:21:08.346 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:08.346 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:08.346 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:08.346 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 3 2024-09-21T03:21:08.346 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:08.346 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:08.347 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:08.347 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:21:08.347 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:21:08.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.336+0000 7fc6fec00640 1 -- 172.21.15.90:0/1715618392 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc6d8078fc0 msgr2=0x7fc6d807b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:08.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.336+0000 7fc6fec00640 1 --2- 172.21.15.90:0/1715618392 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc6d8078fc0 0x7fc6d807b4d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00012e0 tx=0x7fc6f0007d30 comp rx=0 tx=0).stop 2024-09-21T03:21:08.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.336+0000 7fc6fec00640 1 -- 172.21.15.90:0/1715618392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f80c29a0 msgr2=0x7fc6f8159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:08.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.336+0000 7fc6fec00640 1 --2- 172.21.15.90:0/1715618392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6f80c29a0 0x7fc6f8159900 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec031000 tx=0x7fc6ec004a50 comp rx=0 tx=0).stop 2024-09-21T03:21:08.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.336+0000 7fc6fe200640 1 -- 172.21.15.90:0/1715618392 reap_dead start 2024-09-21T03:21:08.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.336+0000 7fc6fe200640 1 -- 172.21.15.90:0/1715618392 reap_dead start 2024-09-21T03:21:08.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.336+0000 7fc6fec00640 1 -- 172.21.15.90:0/1715618392 shutdown_connections 2024-09-21T03:21:08.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.336+0000 7fc6fec00640 1 -- 172.21.15.90:0/1715618392 >> 172.21.15.90:0/1715618392 conn(0x7fc6f80c4aa0 msgr2=0x7fc6f80c5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:08.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.336+0000 7fc6fec00640 1 -- 172.21.15.90:0/1715618392 shutdown_connections 2024-09-21T03:21:08.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.336+0000 7fc6fec00640 1 -- 172.21.15.90:0/1715618392 wait complete. 2024-09-21T03:21:08.388 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-21T03:21:08.388 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-21T03:21:08.388 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:21:08.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.936+0000 7f443f200640 1 -- 172.21.15.90:0/3604330854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f443800b8e0 msgr2=0x7f4438046940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:08.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.936+0000 7f443f200640 1 --2- 172.21.15.90:0/3604330854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f443800b8e0 0x7f4438046940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4438048e90 tx=0x7f442c02a460 comp rx=0 tx=0).stop 2024-09-21T03:21:08.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.937+0000 7f443f200640 1 -- 172.21.15.90:0/3604330854 shutdown_connections 2024-09-21T03:21:08.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.937+0000 7f443f200640 1 --2- 172.21.15.90:0/3604330854 >> v2:172.21.15.149:3300/0 conn(0x7f443802d5e0 0x7f443802d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.937+0000 7f443f200640 1 --2- 172.21.15.90:0/3604330854 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4438049740 0x7f44380d37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.937+0000 7f443f200640 1 --2- 172.21.15.90:0/3604330854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f443800b8e0 0x7f4438046940 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.937+0000 7f443f200640 1 -- 172.21.15.90:0/3604330854 >> 172.21.15.90:0/3604330854 conn(0x7f4438048650 msgr2=0x7f443802ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:08.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.937+0000 7f443f200640 1 -- 172.21.15.90:0/3604330854 shutdown_connections 2024-09-21T03:21:08.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.937+0000 7f443f200640 1 -- 172.21.15.90:0/3604330854 wait complete. 2024-09-21T03:21:08.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.941+0000 7f443f200640 1 Processor -- start 2024-09-21T03:21:08.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.942+0000 7f443f200640 1 -- start start 2024-09-21T03:21:08.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.944+0000 7f443f200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f443800b8e0 0x7f44380d5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:08.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.945+0000 7f443f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f443802d5e0 0x7f44380d4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:08.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.945+0000 7f443d400640 1 -- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f443802d5e0 msgr2=0x7f44380d4470 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:21:08.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.945+0000 7f443d400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f443802d5e0 0x7f44380d4470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:21:08.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.945+0000 7f443f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4438049740 0x7f443802aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:08.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.945+0000 7f443f200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f44380d9b40 con 0x7f443800b8e0 2024-09-21T03:21:08.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.945+0000 7f443f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f44380d99c0 con 0x7f4438049740 2024-09-21T03:21:08.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.945+0000 7f443f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f44380d9cc0 con 0x7f443802d5e0 2024-09-21T03:21:08.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.945+0000 7f443de00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f443800b8e0 0x7f44380d5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:08.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.945+0000 7f443de00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f443800b8e0 0x7f44380d5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55646/0 (socket says 172.21.15.90:55646) 2024-09-21T03:21:08.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.945+0000 7f443de00640 1 -- 172.21.15.90:0/4224859043 learned_addr learned my addr 172.21.15.90:0/4224859043 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:21:08.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.946+0000 7f443e800640 1 --2- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4438049740 0x7f443802aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:08.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.946+0000 7f443de00640 1 -- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f443802d5e0 msgr2=0x7f44380d4470 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:21:08.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.946+0000 7f443de00640 1 --2- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f443802d5e0 0x7f44380d4470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.946+0000 7f443de00640 1 -- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4438049740 msgr2=0x7f443802aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:08.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.946+0000 7f443de00640 1 --2- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4438049740 0x7f443802aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.946+0000 7f443de00640 1 -- 172.21.15.90:0/4224859043 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44380cf170 con 0x7f443800b8e0 2024-09-21T03:21:08.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.947+0000 7f443de00640 1 --2- 172.21.15.90:0/4224859043 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f443800b8e0 0x7f44380d5910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f442c000c00 tx=0x7f442c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:08.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.948+0000 7f4436000640 1 -- 172.21.15.90:0/4224859043 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c03e030 con 0x7f443800b8e0 2024-09-21T03:21:08.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.948+0000 7f4436000640 1 -- 172.21.15.90:0/4224859043 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f442c003d10 con 0x7f443800b8e0 2024-09-21T03:21:08.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.948+0000 7f4436000640 1 -- 172.21.15.90:0/4224859043 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c035040 con 0x7f443800b8e0 2024-09-21T03:21:08.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.948+0000 7f443f200640 1 -- 172.21.15.90:0/4224859043 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44380d8120 con 0x7f443800b8e0 2024-09-21T03:21:08.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.949+0000 7f443f200640 1 -- 172.21.15.90:0/4224859043 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44380cf3f0 con 0x7f443800b8e0 2024-09-21T03:21:08.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.951+0000 7f443f200640 1 --2- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44380d49b0 0x7f44380cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:08.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.951+0000 7f443f200640 1 -- 172.21.15.90:0/4224859043 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f44380d5e50 con 0x7f44380d49b0 2024-09-21T03:21:08.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.952+0000 7f443d400640 1 --2- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44380d49b0 0x7f44380cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:08.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.955+0000 7f4436000640 1 -- 172.21.15.90:0/4224859043 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f442c041030 con 0x7f443800b8e0 2024-09-21T03:21:08.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.956+0000 7f4436000640 1 --2- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4420078bc0 0x7f442007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:08.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.956+0000 7f4436000640 1 -- 172.21.15.90:0/4224859043 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f442c0bb830 con 0x7f443800b8e0 2024-09-21T03:21:08.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.958+0000 7f443e800640 1 --2- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4420078bc0 0x7f442007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:08.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.960+0000 7f443e800640 1 --2- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4420078bc0 0x7f442007b0d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4438165d40 tx=0x7f4430005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:08.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.962+0000 7f443d400640 1 -- 172.21.15.90:0/4224859043 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44380ddd50 con 0x7f44380d49b0 2024-09-21T03:21:08.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.962+0000 7f443d400640 1 --2- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44380d49b0 0x7f44380cd260 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f444006a520 tx=0x7f444006ab20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:08.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.962+0000 7f4436000640 1 -- 172.21.15.90:0/4224859043 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4440090020 con 0x7f44380d49b0 2024-09-21T03:21:08.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.965+0000 7f4436000640 1 -- 172.21.15.90:0/4224859043 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f44400768a0 con 0x7f44380d49b0 2024-09-21T03:21:08.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.966+0000 7f4436000640 1 -- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44380d49b0 msgr2=0x7f44380cd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:08.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.966+0000 7f4436000640 1 --2- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44380d49b0 0x7f44380cd260 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f444006a520 tx=0x7f444006ab20 comp rx=0 tx=0).stop 2024-09-21T03:21:08.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.966+0000 7f4436000640 1 -- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44380d49b0 msgr2=0x7f44380cd260 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:21:08.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.966+0000 7f4436000640 1 --2- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44380d49b0 0x7f44380cd260 secure :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f444006a520 tx=0x7f444006ab20 comp rx=0 tx=0).stop 2024-09-21T03:21:08.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.986+0000 7f443f200640 1 --2- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44380cd7a0 0x7f443802b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:08.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.986+0000 7f443f200640 1 -- 172.21.15.90:0/4224859043 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4438046940 con 0x7f44380cd7a0 2024-09-21T03:21:08.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.987+0000 7f443d400640 1 --2- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44380cd7a0 0x7f443802b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:08.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.988+0000 7f443d400640 1 -- 172.21.15.90:0/4224859043 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4438045710 con 0x7f44380cd7a0 2024-09-21T03:21:08.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.990+0000 7f443d400640 1 --2- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44380cd7a0 0x7f443802b430 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4440075fd0 tx=0x7f44400760a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:08.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.990+0000 7f4436000640 1 -- 172.21.15.90:0/4224859043 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4440097020 con 0x7f44380cd7a0 2024-09-21T03:21:08.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.990+0000 7f4436000640 1 -- 172.21.15.90:0/4224859043 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5182 (secure 0 0 0) 0x7f44400971c0 con 0x7f44380cd7a0 2024-09-21T03:21:08.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.991+0000 7f4436000640 1 -- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44380cd7a0 msgr2=0x7f443802b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:08.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.991+0000 7f4436000640 1 --2- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44380cd7a0 0x7f443802b430 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4440075fd0 tx=0x7f44400760a0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.991+0000 7f4436000640 1 -- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44380cd7a0 msgr2=0x7f443802b430 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:21:08.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.991+0000 7f4436000640 1 --2- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44380cd7a0 0x7f443802b430 secure :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4440075fd0 tx=0x7f44400760a0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.993 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:21:08.993 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:21:08.993 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:21:08.993 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:21:08.994 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 50, 2024-09-21T03:21:08.994 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 419779, 2024-09-21T03:21:08.994 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:21:08.994 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:21:08.994 INFO:teuthology.orchestra.run.smithi090.stdout: 1 2024-09-21T03:21:08.994 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:08.994 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 2, 2024-09-21T03:21:08.994 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:21:08.994 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:21:08.994 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:21:08.994 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:08.994 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:08.994 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:08.994 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:08.995 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:08.995 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:08.995 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:08.995 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:08.995 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:08.995 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:08.995 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:08.995 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:08.995 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:21:08.995 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:21:08.995 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:08.995 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:08.995 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:08.995 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:08.996 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:08.996 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:08.996 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:08.996 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:08.996 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:08.996 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:08.996 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:08.996 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:08.996 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:08.996 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:21:08.996 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:21:08.996 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:21:08.996 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:21:08.997 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:21:08.997 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:21:08.997 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:21:08.997 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:21:08.997 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:21:08.997 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:21:08.997 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:21:08.997 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:21:08.997 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:21:08.997 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:21:08.997 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:21:08.997 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:21:08.997 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:21:08.997 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:08.997 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:08.998 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:08.998 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:08.998 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:08.998 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:08.998 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:08.998 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:08.998 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:08.998 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:08.998 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:08.998 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:08.998 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:21:08.998 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:08.998 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:21:08.998 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:08.998 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:21:08.999 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:21:08.999 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:08.999 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:08.999 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:08.999 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:08.999 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:21:08.999 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:08.999 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:08.999 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:08.999 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:08.999 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:21:08.999 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:08.999 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:08.999 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:09.000 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:09.000 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:21:09.000 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:21:09.000 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:09.000 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:09.000 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:09.000 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:09.000 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:09.000 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:21:09.000 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:21:09.000 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:09.000 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:09.000 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:09.000 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:09.000 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:21:09.001 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:09.001 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:09.001 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:09.001 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:09.001 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:21:09.001 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:09.001 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:09.001 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:09.001 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:09.001 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:21:09.001 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:21:09.001 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:21:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:21:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:21:09.003 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:09.003 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:09.003 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:09.003 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:09.003 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:21:09.003 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:09.003 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:09.003 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:09.003 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:09.003 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:21:09.003 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:21:09.003 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:09.003 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:09.004 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:09.004 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:09.004 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:09.004 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:09.004 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:21:09.004 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:21:09.004 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:09.004 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:09.004 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:09.004 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:21:09.004 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:09.004 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:09.004 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:21:09.004 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:09.004 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:09.005 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:09.005 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:21:09.005 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:09.005 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:09.005 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:21:09.005 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:09.005 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:09.005 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:09.005 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6 2024-09-21T03:21:09.005 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:09.005 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:09.005 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:21:09.005 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:09.006 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:21:09.006 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:21:09.006 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:21:09.006 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:09.006 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:09.006 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:09.006 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:09.006 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:21:09.006 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:09.006 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:09.006 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:21:09.006 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:09.006 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:09.006 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:09.007 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:21:09.007 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:09.007 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:09.007 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:09.007 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:21:09.007 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:21:09.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.993+0000 7f443f200640 1 -- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4420078bc0 msgr2=0x7f442007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:09.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.993+0000 7f443f200640 1 --2- 172.21.15.90:0/4224859043 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4420078bc0 0x7f442007b0d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4438165d40 tx=0x7f4430005f90 comp rx=0 tx=0).stop 2024-09-21T03:21:09.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.993+0000 7f443f200640 1 -- 172.21.15.90:0/4224859043 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f443800b8e0 msgr2=0x7f44380d5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:09.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.993+0000 7f443f200640 1 --2- 172.21.15.90:0/4224859043 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f443800b8e0 0x7f44380d5910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f442c000c00 tx=0x7f442c003820 comp rx=0 tx=0).stop 2024-09-21T03:21:09.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.993+0000 7f443e800640 1 -- 172.21.15.90:0/4224859043 reap_dead start 2024-09-21T03:21:09.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.993+0000 7f443e800640 1 -- 172.21.15.90:0/4224859043 reap_dead start 2024-09-21T03:21:09.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.994+0000 7f443f200640 1 -- 172.21.15.90:0/4224859043 shutdown_connections 2024-09-21T03:21:09.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.994+0000 7f443f200640 1 -- 172.21.15.90:0/4224859043 >> 172.21.15.90:0/4224859043 conn(0x7f4438048650 msgr2=0x7f44380d7520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:09.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.995+0000 7f443f200640 1 -- 172.21.15.90:0/4224859043 shutdown_connections 2024-09-21T03:21:09.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:08.995+0000 7f443f200640 1 -- 172.21.15.90:0/4224859043 wait complete. 2024-09-21T03:21:09.094 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-21T03:21:09.095 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-21T03:21:29.095 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-21T03:21:29.096 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-21T03:21:29.096 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-21T03:21:29.103 INFO:tasks.ceph.mon.c:Started 2024-09-21T03:21:29.103 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-21T03:21:29.103 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:21:29.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.652+0000 7f99cd600640 1 -- 172.21.15.90:0/4090147211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99c8072a70 msgr2=0x7f99c813de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:29.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.652+0000 7f99cd600640 1 --2- 172.21.15.90:0/4090147211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99c8072a70 0x7f99c813de40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009830 tx=0x7f99b4032d70 comp rx=0 tx=0).stop 2024-09-21T03:21:29.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.653+0000 7f99cd600640 1 -- 172.21.15.90:0/4090147211 shutdown_connections 2024-09-21T03:21:29.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.653+0000 7f99cd600640 1 --2- 172.21.15.90:0/4090147211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99c8072a70 0x7f99c813de40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:29.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.653+0000 7f99cd600640 1 -- 172.21.15.90:0/4090147211 >> 172.21.15.90:0/4090147211 conn(0x7f99c80c8740 msgr2=0x7f99c806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:29.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.653+0000 7f99cd600640 1 -- 172.21.15.90:0/4090147211 shutdown_connections 2024-09-21T03:21:29.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.654+0000 7f99cd600640 1 -- 172.21.15.90:0/4090147211 wait complete. 2024-09-21T03:21:29.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.664+0000 7f99cd600640 1 Processor -- start 2024-09-21T03:21:29.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.664+0000 7f99cd600640 1 -- start start 2024-09-21T03:21:29.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.673+0000 7f99cd600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99c806d950 0x7f99c8150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:29.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.673+0000 7f99cd600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99c8072a70 0x7f99c813a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:29.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.673+0000 7f99cd600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99c80ac1e0 0x7f99c813bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:29.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.673+0000 7f99cd600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f99c8074b20 con 0x7f99c8072a70 2024-09-21T03:21:29.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.673+0000 7f99cd600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f99c80749a0 con 0x7f99c806d950 2024-09-21T03:21:29.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.673+0000 7f99cd600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f99c80acd00 con 0x7f99c80ac1e0 2024-09-21T03:21:29.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.674+0000 7f99c6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99c806d950 0x7f99c8150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:29.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.674+0000 7f99c6000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99c8072a70 0x7f99c813a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:29.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.674+0000 7f99c6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99c806d950 0x7f99c8150580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:60716/0 (socket says 172.21.15.90:60716) 2024-09-21T03:21:29.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.674+0000 7f99c6a00640 1 -- 172.21.15.90:0/3187269752 learned_addr learned my addr 172.21.15.90:0/3187269752 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:21:29.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.674+0000 7f99c6000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99c8072a70 0x7f99c813a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33936/0 (socket says 172.21.15.90:33936) 2024-09-21T03:21:29.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.675+0000 7f99c6000640 1 -- 172.21.15.90:0/3187269752 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99c80ac1e0 msgr2=0x7f99c813bab0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:21:29.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.675+0000 7f99c6000640 1 --2- 172.21.15.90:0/3187269752 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99c80ac1e0 0x7f99c813bab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:29.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.676+0000 7f99c6000640 1 -- 172.21.15.90:0/3187269752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99c806d950 msgr2=0x7f99c8150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:29.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.676+0000 7f99c6000640 1 --2- 172.21.15.90:0/3187269752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99c806d950 0x7f99c8150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:29.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.676+0000 7f99c6000640 1 -- 172.21.15.90:0/3187269752 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c80c4990 con 0x7f99c8072a70 2024-09-21T03:21:29.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.676+0000 7f99c6a00640 1 --2- 172.21.15.90:0/3187269752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99c806d950 0x7f99c8150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:21:29.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.676+0000 7f99c6000640 1 --2- 172.21.15.90:0/3187269752 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99c8072a70 0x7f99c813a3d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f99b403a000 tx=0x7f99b40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:29.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.678+0000 7f99bea00640 1 -- 172.21.15.90:0/3187269752 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b4040040 con 0x7f99c8072a70 2024-09-21T03:21:29.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.678+0000 7f99cd600640 1 -- 172.21.15.90:0/3187269752 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c81e99e0 con 0x7f99c8072a70 2024-09-21T03:21:29.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.679+0000 7f99cd600640 1 -- 172.21.15.90:0/3187269752 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c813cbd0 con 0x7f99c8072a70 2024-09-21T03:21:29.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.681+0000 7f99bea00640 1 -- 172.21.15.90:0/3187269752 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99b4049070 con 0x7f99c8072a70 2024-09-21T03:21:29.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.681+0000 7f99bea00640 1 -- 172.21.15.90:0/3187269752 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b4040040 con 0x7f99c8072a70 2024-09-21T03:21:29.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.684+0000 7f99bea00640 1 -- 172.21.15.90:0/3187269752 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f99b4033830 con 0x7f99c8072a70 2024-09-21T03:21:29.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.685+0000 7f99bea00640 1 --2- 172.21.15.90:0/3187269752 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f99a8078f90 0x7f99a807b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:29.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.686+0000 7f99c6a00640 1 --2- 172.21.15.90:0/3187269752 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f99a8078f90 0x7f99a807b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:29.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.686+0000 7f99bea00640 1 -- 172.21.15.90:0/3187269752 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f99b40035f0 con 0x7f99c8072a70 2024-09-21T03:21:29.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.687+0000 7f99cd600640 1 -- 172.21.15.90:0/3187269752 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99a0005290 con 0x7f99c8072a70 2024-09-21T03:21:29.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.688+0000 7f99c6a00640 1 --2- 172.21.15.90:0/3187269752 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f99a8078f90 0x7f99a807b4a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f99b8001c70 tx=0x7f99b8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:29.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:29.700+0000 7f99bea00640 1 -- 172.21.15.90:0/3187269752 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f99b408b690 con 0x7f99c8072a70 2024-09-21T03:21:30.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:30.363+0000 7f99cd600640 1 -- 172.21.15.90:0/3187269752 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f99a0005580 con 0x7f99c8072a70 2024-09-21T03:21:30.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:30.364+0000 7f99bea00640 1 -- 172.21.15.90:0/3187269752 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7f99b408af90 con 0x7f99c8072a70 2024-09-21T03:21:30.368 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":50,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:21:30.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:30.369+0000 7f99cd600640 1 -- 172.21.15.90:0/3187269752 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f99a8078f90 msgr2=0x7f99a807b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:30.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:30.369+0000 7f99cd600640 1 --2- 172.21.15.90:0/3187269752 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f99a8078f90 0x7f99a807b4a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f99b8001c70 tx=0x7f99b8009040 comp rx=0 tx=0).stop 2024-09-21T03:21:30.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:30.369+0000 7f99cd600640 1 -- 172.21.15.90:0/3187269752 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99c8072a70 msgr2=0x7f99c813a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:30.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:30.369+0000 7f99cd600640 1 --2- 172.21.15.90:0/3187269752 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99c8072a70 0x7f99c813a3d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f99b403a000 tx=0x7f99b40045e0 comp rx=0 tx=0).stop 2024-09-21T03:21:30.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:30.370+0000 7f99cd600640 1 -- 172.21.15.90:0/3187269752 shutdown_connections 2024-09-21T03:21:30.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:30.370+0000 7f99cd600640 1 --2- 172.21.15.90:0/3187269752 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f99a8078f90 0x7f99a807b4a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:30.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:30.370+0000 7f99cd600640 1 --2- 172.21.15.90:0/3187269752 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99c80ac1e0 0x7f99c813bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:30.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:30.370+0000 7f99cd600640 1 --2- 172.21.15.90:0/3187269752 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99c8072a70 0x7f99c813a3d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:30.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:30.370+0000 7f99cd600640 1 --2- 172.21.15.90:0/3187269752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99c806d950 0x7f99c8150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:30.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:30.370+0000 7f99cd600640 1 -- 172.21.15.90:0/3187269752 >> 172.21.15.90:0/3187269752 conn(0x7f99c80c8740 msgr2=0x7f99c80c6500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:30.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:30.370+0000 7f99cd600640 1 -- 172.21.15.90:0/3187269752 shutdown_connections 2024-09-21T03:21:30.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:30.371+0000 7f99cd600640 1 -- 172.21.15.90:0/3187269752 wait complete. 2024-09-21T03:21:30.545 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:21:30.556 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:21:33.426 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:21:33.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.935+0000 7f83d8800640 1 -- 172.21.15.90:0/3891557783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83d015a6d0 msgr2=0x7f83d015aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:33.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.937+0000 7f83d8800640 1 --2- 172.21.15.90:0/3891557783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83d015a6d0 0x7f83d015aae0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f83c0005fd0 tx=0x7f83c002a560 comp rx=0 tx=0).stop 2024-09-21T03:21:33.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.938+0000 7f83d8800640 1 -- 172.21.15.90:0/3891557783 shutdown_connections 2024-09-21T03:21:33.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.938+0000 7f83d8800640 1 --2- 172.21.15.90:0/3891557783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d015b020 0x7f83d014fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:33.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.938+0000 7f83d8800640 1 --2- 172.21.15.90:0/3891557783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83d015a6d0 0x7f83d015aae0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:33.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.938+0000 7f83d8800640 1 -- 172.21.15.90:0/3891557783 >> 172.21.15.90:0/3891557783 conn(0x7f83d0074b40 msgr2=0x7f83d006e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:33.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.938+0000 7f83d8800640 1 -- 172.21.15.90:0/3891557783 shutdown_connections 2024-09-21T03:21:33.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.939+0000 7f83d8800640 1 -- 172.21.15.90:0/3891557783 wait complete. 2024-09-21T03:21:33.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.945+0000 7f83d8800640 1 Processor -- start 2024-09-21T03:21:33.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.945+0000 7f83d8800640 1 -- start start 2024-09-21T03:21:33.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.957+0000 7f83d8800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d015a6d0 0x7f83d0149250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:33.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.957+0000 7f83d8800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83d015b020 0x7f83d00c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:33.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.959+0000 7f83d8800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83d014ad80 0x7f83d014b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:33.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.960+0000 7f83d8800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f83d00c74a0 con 0x7f83d015b020 2024-09-21T03:21:33.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.960+0000 7f83d5e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d015a6d0 0x7f83d0149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:33.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.960+0000 7f83d5e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d015a6d0 0x7f83d0149250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:57398/0 (socket says 172.21.15.90:57398) 2024-09-21T03:21:33.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.960+0000 7f83d5e00640 1 -- 172.21.15.90:0/3045768112 learned_addr learned my addr 172.21.15.90:0/3045768112 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:21:33.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.961+0000 7f83d8800640 1 -- 172.21.15.90:0/3045768112 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f83d00cbc60 con 0x7f83d014ad80 2024-09-21T03:21:33.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.962+0000 7f83d8800640 1 -- 172.21.15.90:0/3045768112 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f83d00c7620 con 0x7f83d015a6d0 2024-09-21T03:21:33.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.962+0000 7f83d5400640 1 --2- 172.21.15.90:0/3045768112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83d015b020 0x7f83d00c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:33.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.963+0000 7f83d6800640 1 --2- 172.21.15.90:0/3045768112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83d014ad80 0x7f83d014b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:33.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.964+0000 7f83d5e00640 1 -- 172.21.15.90:0/3045768112 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d015a6d0 msgr2=0x7f83d0149250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-21T03:21:33.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.964+0000 7f83d5e00640 1 -- 172.21.15.90:0/3045768112 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d015a6d0 msgr2=0x7f83d0149250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T03:21:33.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.965+0000 7f83d5400640 1 -- 172.21.15.90:0/3045768112 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d015a6d0 msgr2=0x7f83d0149250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:33.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.966+0000 7f83d5e00640 1 --2- 172.21.15.90:0/3045768112 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d015a6d0 0x7f83d0149250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T03:21:33.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.966+0000 7f83d5e00640 1 --2- 172.21.15.90:0/3045768112 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d015a6d0 0x7f83d0149250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:21:33.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.966+0000 7f83d5400640 1 --2- 172.21.15.90:0/3045768112 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d015a6d0 0x7f83d0149250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:33.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.967+0000 7f83d5400640 1 -- 172.21.15.90:0/3045768112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83d014ad80 msgr2=0x7f83d014b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:33.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.967+0000 7f83d5400640 1 --2- 172.21.15.90:0/3045768112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83d014ad80 0x7f83d014b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:33.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.968+0000 7f83d5400640 1 -- 172.21.15.90:0/3045768112 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d00acfe0 con 0x7f83d015b020 2024-09-21T03:21:33.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.969+0000 7f83d6800640 1 --2- 172.21.15.90:0/3045768112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83d014ad80 0x7f83d014b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:21:33.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.969+0000 7f83d5400640 1 --2- 172.21.15.90:0/3045768112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83d015b020 0x7f83d00c57b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f83d006f870 tx=0x7f83c0003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:33.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.975+0000 7f83ca000640 1 -- 172.21.15.90:0/3045768112 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c003e030 con 0x7f83d015b020 2024-09-21T03:21:33.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.976+0000 7f83d8800640 1 -- 172.21.15.90:0/3045768112 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d0149bb0 con 0x7f83d015b020 2024-09-21T03:21:33.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.977+0000 7f83ca000640 1 -- 172.21.15.90:0/3045768112 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83c0003e20 con 0x7f83d015b020 2024-09-21T03:21:33.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.977+0000 7f83d8800640 1 -- 172.21.15.90:0/3045768112 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d00ae880 con 0x7f83d015b020 2024-09-21T03:21:33.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.979+0000 7f83d8800640 1 -- 172.21.15.90:0/3045768112 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83d0155630 con 0x7f83d015b020 2024-09-21T03:21:33.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.982+0000 7f83ca000640 1 -- 172.21.15.90:0/3045768112 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c0035040 con 0x7f83d015b020 2024-09-21T03:21:34.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:33.998+0000 7f83ca000640 1 -- 172.21.15.90:0/3045768112 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f83c0041030 con 0x7f83d015b020 2024-09-21T03:21:34.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:34.000+0000 7f83ca000640 1 --2- 172.21.15.90:0/3045768112 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f83b4078c60 0x7f83b407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:34.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:34.000+0000 7f83ca000640 1 -- 172.21.15.90:0/3045768112 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f83c00bbf80 con 0x7f83d015b020 2024-09-21T03:21:34.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:34.004+0000 7f83d5e00640 1 --2- 172.21.15.90:0/3045768112 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f83b4078c60 0x7f83b407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:34.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:34.011+0000 7f83ca000640 1 -- 172.21.15.90:0/3045768112 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f83d0155630 con 0x7f83d015b020 2024-09-21T03:21:34.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:34.012+0000 7f83d5e00640 1 --2- 172.21.15.90:0/3045768112 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f83b4078c60 0x7f83b407b170 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0095b0 tx=0x7f83cc009630 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:34.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:34.721+0000 7f83d8800640 1 -- 172.21.15.90:0/3045768112 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f83d01578e0 con 0x7f83d015b020 2024-09-21T03:21:34.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:34.723+0000 7f83ca000640 1 -- 172.21.15.90:0/3045768112 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f83c00840d0 con 0x7f83d015b020 2024-09-21T03:21:34.727 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:21:34.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:34.735+0000 7f83d8800640 1 -- 172.21.15.90:0/3045768112 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f83b4078c60 msgr2=0x7f83b407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:34.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:34.735+0000 7f83d8800640 1 --2- 172.21.15.90:0/3045768112 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f83b4078c60 0x7f83b407b170 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0095b0 tx=0x7f83cc009630 comp rx=0 tx=0).stop 2024-09-21T03:21:34.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:34.735+0000 7f83d8800640 1 -- 172.21.15.90:0/3045768112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83d015b020 msgr2=0x7f83d00c57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:34.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:34.735+0000 7f83d8800640 1 --2- 172.21.15.90:0/3045768112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83d015b020 0x7f83d00c57b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f83d006f870 tx=0x7f83c0003910 comp rx=0 tx=0).stop 2024-09-21T03:21:34.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:34.738+0000 7f83d8800640 1 -- 172.21.15.90:0/3045768112 shutdown_connections 2024-09-21T03:21:34.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:34.738+0000 7f83d8800640 1 --2- 172.21.15.90:0/3045768112 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f83b4078c60 0x7f83b407b170 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:34.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:34.738+0000 7f83d8800640 1 --2- 172.21.15.90:0/3045768112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83d014ad80 0x7f83d014b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:34.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:34.738+0000 7f83d8800640 1 --2- 172.21.15.90:0/3045768112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83d015b020 0x7f83d00c57b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:34.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:34.738+0000 7f83d8800640 1 --2- 172.21.15.90:0/3045768112 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d015a6d0 0x7f83d0149250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:34.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:34.738+0000 7f83d8800640 1 -- 172.21.15.90:0/3045768112 >> 172.21.15.90:0/3045768112 conn(0x7f83d0074b40 msgr2=0x7f83d00763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:34.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:34.743+0000 7f83d8800640 1 -- 172.21.15.90:0/3045768112 shutdown_connections 2024-09-21T03:21:34.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:34.743+0000 7f83d8800640 1 -- 172.21.15.90:0/3045768112 wait complete. 2024-09-21T03:21:34.815 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-21T03:21:34.815 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-21T03:21:34.815 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:21:35.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.372+0000 7fb69c400640 1 -- 172.21.15.90:0/2867349293 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb68c0ddf00 msgr2=0x7fb68c0e5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:35.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.372+0000 7fb69c400640 1 --2- 172.21.15.90:0/2867349293 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb68c0ddf00 0x7fb68c0e5ab0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb69406ca30 tx=0x7fb6940a7720 comp rx=0 tx=0).stop 2024-09-21T03:21:35.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.373+0000 7fb69c400640 1 -- 172.21.15.90:0/2867349293 shutdown_connections 2024-09-21T03:21:35.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.373+0000 7fb69c400640 1 --2- 172.21.15.90:0/2867349293 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb68c0ddf00 0x7fb68c0e5ab0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:35.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.373+0000 7fb69c400640 1 -- 172.21.15.90:0/2867349293 >> 172.21.15.90:0/2867349293 conn(0x7fb68c031310 msgr2=0x7fb68c031720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:35.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.374+0000 7fb69c400640 1 -- 172.21.15.90:0/2867349293 shutdown_connections 2024-09-21T03:21:35.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.374+0000 7fb69c400640 1 -- 172.21.15.90:0/2867349293 wait complete. 2024-09-21T03:21:35.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.380+0000 7fb69c400640 1 Processor -- start 2024-09-21T03:21:35.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.381+0000 7fb69c400640 1 -- start start 2024-09-21T03:21:35.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.386+0000 7fb69c400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb68c04abb0 0x7fb68c0cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:35.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.387+0000 7fb69c400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb68c0d7ab0 0x7fb68c0d22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:35.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.387+0000 7fb69c400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb68c0ddf00 0x7fb68c0cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:35.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.388+0000 7fb69c400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c007800 con 0x7fb68c0d7ab0 2024-09-21T03:21:35.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.388+0000 7fb69c400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c007680 con 0x7fb68c0ddf00 2024-09-21T03:21:35.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.388+0000 7fb69c400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb68c04a770 con 0x7fb68c04abb0 2024-09-21T03:21:35.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.389+0000 7fb69a400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb68c0ddf00 0x7fb68c0cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:35.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.389+0000 7fb69a400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb68c0ddf00 0x7fb68c0cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:52596/0 (socket says 172.21.15.90:52596) 2024-09-21T03:21:35.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.389+0000 7fb69a400640 1 -- 172.21.15.90:0/2873597594 learned_addr learned my addr 172.21.15.90:0/2873597594 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:21:35.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.391+0000 7fb699a00640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb68c04abb0 0x7fb68c0cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:35.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.391+0000 7fb699000640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb68c0d7ab0 0x7fb68c0d22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:35.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.392+0000 7fb699000640 1 -- 172.21.15.90:0/2873597594 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb68c04abb0 msgr2=0x7fb68c0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:35.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.392+0000 7fb699000640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb68c04abb0 0x7fb68c0cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:35.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.392+0000 7fb699000640 1 -- 172.21.15.90:0/2873597594 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb68c0ddf00 msgr2=0x7fb68c0cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:35.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.392+0000 7fb699000640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb68c0ddf00 0x7fb68c0cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:35.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.394+0000 7fb699000640 1 -- 172.21.15.90:0/2873597594 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb68c0d3d20 con 0x7fb68c0d7ab0 2024-09-21T03:21:35.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.394+0000 7fb699000640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb68c0d7ab0 0x7fb68c0d22a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb68000c3f0 tx=0x7fb68000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:35.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.396+0000 7fb691600640 1 -- 172.21.15.90:0/2873597594 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680017070 con 0x7fb68c0d7ab0 2024-09-21T03:21:35.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.396+0000 7fb69c400640 1 -- 172.21.15.90:0/2873597594 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb68c0d02e0 con 0x7fb68c0d7ab0 2024-09-21T03:21:35.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.397+0000 7fb69c400640 1 -- 172.21.15.90:0/2873597594 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb68c174a60 con 0x7fb68c0d7ab0 2024-09-21T03:21:35.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.399+0000 7fb691600640 1 -- 172.21.15.90:0/2873597594 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6800053c0 con 0x7fb68c0d7ab0 2024-09-21T03:21:35.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.399+0000 7fb691600640 1 -- 172.21.15.90:0/2873597594 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680017070 con 0x7fb68c0d7ab0 2024-09-21T03:21:35.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.400+0000 7fb69c400640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb670002a70 0x7fb670004f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:35.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.400+0000 7fb69c400640 1 -- 172.21.15.90:0/2873597594 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb670007f10 con 0x7fb670002a70 2024-09-21T03:21:35.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.405+0000 7fb699a00640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb670002a70 0x7fb670004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:35.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.409+0000 7fb691600640 1 -- 172.21.15.90:0/2873597594 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb68001a070 con 0x7fb68c0d7ab0 2024-09-21T03:21:35.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.409+0000 7fb699a00640 1 -- 172.21.15.90:0/2873597594 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb670008110 con 0x7fb670002a70 2024-09-21T03:21:35.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.413+0000 7fb699a00640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb670002a70 0x7fb670004f80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb68800d380 tx=0x7fb68800d840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:35.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.414+0000 7fb691600640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb674078d90 0x7fb67407b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:35.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.414+0000 7fb691600640 1 -- 172.21.15.90:0/2873597594 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fb680099f50 con 0x7fb68c0d7ab0 2024-09-21T03:21:35.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.415+0000 7fb69a400640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb674078d90 0x7fb67407b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:35.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.416+0000 7fb691600640 1 -- 172.21.15.90:0/2873597594 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688018070 con 0x7fb670002a70 2024-09-21T03:21:35.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.416+0000 7fb691600640 1 -- 172.21.15.90:0/2873597594 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb688003610 con 0x7fb670002a70 2024-09-21T03:21:35.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.417+0000 7fb691600640 1 -- 172.21.15.90:0/2873597594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb670002a70 msgr2=0x7fb670004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:35.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.417+0000 7fb691600640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb670002a70 0x7fb670004f80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb68800d380 tx=0x7fb68800d840 comp rx=0 tx=0).stop 2024-09-21T03:21:35.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.417+0000 7fb691600640 1 -- 172.21.15.90:0/2873597594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb670002a70 msgr2=0x7fb670004f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:21:35.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.417+0000 7fb691600640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb670002a70 0x7fb670004f80 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb68800d380 tx=0x7fb68800d840 comp rx=0 tx=0).stop 2024-09-21T03:21:35.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.417+0000 7fb69a400640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb674078d90 0x7fb67407b2a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb69406b1f0 tx=0x7fb69406acb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:35.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.440+0000 7fb69c400640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb670006f80 0x7fb670007440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:35.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.440+0000 7fb69c400640 1 -- 172.21.15.90:0/2873597594 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb67000a4f0 con 0x7fb670006f80 2024-09-21T03:21:35.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.441+0000 7fb699a00640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb670006f80 0x7fb670007440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:35.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.442+0000 7fb699a00640 1 -- 172.21.15.90:0/2873597594 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb670007980 con 0x7fb670006f80 2024-09-21T03:21:35.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.444+0000 7fb699a00640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb670006f80 0x7fb670007440 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb68800dfd0 tx=0x7fb688001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:35.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.445+0000 7fb691600640 1 -- 172.21.15.90:0/2873597594 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688018040 con 0x7fb670006f80 2024-09-21T03:21:35.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.448+0000 7fb691600640 1 -- 172.21.15.90:0/2873597594 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4718 (secure 0 0 0) 0x7fb688013470 con 0x7fb670006f80 2024-09-21T03:21:35.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.448+0000 7fb691600640 1 -- 172.21.15.90:0/2873597594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb670006f80 msgr2=0x7fb670007440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:35.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.448+0000 7fb691600640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb670006f80 0x7fb670007440 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb68800dfd0 tx=0x7fb688001080 comp rx=0 tx=0).stop 2024-09-21T03:21:35.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.448+0000 7fb691600640 1 -- 172.21.15.90:0/2873597594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb670006f80 msgr2=0x7fb670007440 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:21:35.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.448+0000 7fb691600640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb670006f80 0x7fb670007440 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb68800dfd0 tx=0x7fb688001080 comp rx=0 tx=0).stop 2024-09-21T03:21:35.451 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:21:35.451 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:21:35.451 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:21:35.451 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:21:35.451 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 52, 2024-09-21T03:21:35.452 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 139218, 2024-09-21T03:21:35.452 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:21:35.452 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:21:35.452 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:21:35.452 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:21:35.452 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:35.452 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 3, 2024-09-21T03:21:35.452 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:21:35.452 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:21:35.452 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:21:35.452 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:35.452 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:35.452 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:35.452 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:35.453 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:35.453 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:35.453 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:35.453 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:35.453 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:35.453 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:35.453 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:35.453 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:35.453 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:21:35.453 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:21:35.453 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:35.453 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:35.454 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:35.454 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:35.454 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:35.454 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:35.454 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:35.454 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:35.454 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:35.454 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:35.454 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:35.454 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:35.455 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:35.455 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:21:35.455 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:21:35.455 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:21:35.455 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:21:35.455 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:21:35.455 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:21:35.455 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:21:35.455 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:21:35.455 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:21:35.455 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:21:35.455 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:21:35.455 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:21:35.455 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:21:35.456 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:21:35.456 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:21:35.456 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:21:35.456 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:21:35.456 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:35.456 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:35.456 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:35.456 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:35.456 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:35.456 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:35.456 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:35.456 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:35.456 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:35.456 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:35.456 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:35.457 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:35.457 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:21:35.457 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:35.457 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:21:35.457 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:35.457 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:21:35.457 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:21:35.457 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:35.457 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:35.457 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:35.457 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:35.457 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:21:35.457 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:35.457 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:35.457 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:35.457 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:35.458 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:21:35.458 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:35.458 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:35.458 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:35.458 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:35.458 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:21:35.458 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:21:35.458 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:35.458 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:35.458 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:35.458 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:35.458 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:35.459 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:21:35.459 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:21:35.459 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:35.459 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:35.459 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:35.459 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:35.459 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:21:35.459 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:35.459 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:35.459 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:35.459 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:35.459 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:21:35.460 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:35.460 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:35.460 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:35.460 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:35.460 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:21:35.460 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:21:35.460 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:35.460 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:35.460 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:35.460 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:35.460 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:35.460 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:21:35.461 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:21:35.461 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:35.461 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:35.461 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:35.461 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:35.461 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:21:35.461 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:35.461 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:35.461 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:35.461 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:35.461 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:21:35.462 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:35.462 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:35.462 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:35.462 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:35.462 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:21:35.462 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:21:35.462 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:35.462 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:35.462 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:35.462 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:35.462 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:35.462 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:35.462 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:21:35.463 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:21:35.463 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:35.463 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:35.463 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:35.463 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:21:35.463 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:35.463 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:35.463 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:21:35.463 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:35.463 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:35.463 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:35.463 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:21:35.463 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:35.464 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:35.464 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:21:35.464 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:35.464 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:35.464 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:35.464 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 3 2024-09-21T03:21:35.465 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:35.465 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:35.465 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:35.465 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:21:35.465 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:21:35.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.452+0000 7fb69c400640 1 -- 172.21.15.90:0/2873597594 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb674078d90 msgr2=0x7fb67407b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:35.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.452+0000 7fb69c400640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb674078d90 0x7fb67407b2a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb69406b1f0 tx=0x7fb69406acb0 comp rx=0 tx=0).stop 2024-09-21T03:21:35.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.453+0000 7fb69a400640 1 -- 172.21.15.90:0/2873597594 reap_dead start 2024-09-21T03:21:35.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.453+0000 7fb69c400640 1 -- 172.21.15.90:0/2873597594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb68c0d7ab0 msgr2=0x7fb68c0d22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:35.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.453+0000 7fb69c400640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb68c0d7ab0 0x7fb68c0d22a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb68000c3f0 tx=0x7fb68000c8b0 comp rx=0 tx=0).stop 2024-09-21T03:21:35.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.454+0000 7fb69c400640 1 -- 172.21.15.90:0/2873597594 shutdown_connections 2024-09-21T03:21:35.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.454+0000 7fb69c400640 1 --2- 172.21.15.90:0/2873597594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb68c0d7ab0 0x7fb68c0d22a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:35.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.454+0000 7fb69c400640 1 -- 172.21.15.90:0/2873597594 >> 172.21.15.90:0/2873597594 conn(0x7fb68c031310 msgr2=0x7fb68c166180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:35.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.454+0000 7fb69c400640 1 -- 172.21.15.90:0/2873597594 shutdown_connections 2024-09-21T03:21:35.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:35.454+0000 7fb69c400640 1 -- 172.21.15.90:0/2873597594 wait complete. 2024-09-21T03:21:35.518 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:21:35.518 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-21T03:21:35.519 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:21:36.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.008+0000 7fc887e00640 1 -- 172.21.15.90:0/2513185871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8880ad310 msgr2=0x7fc8880aa9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.008+0000 7fc887e00640 1 --2- 172.21.15.90:0/2513185871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8880ad310 0x7fc8880aa9e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc8880ad720 tx=0x7fc87802a480 comp rx=0 tx=0).stop 2024-09-21T03:21:36.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.010+0000 7fc887e00640 1 -- 172.21.15.90:0/2513185871 shutdown_connections 2024-09-21T03:21:36.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.010+0000 7fc887e00640 1 --2- 172.21.15.90:0/2513185871 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8880aaf20 0x7fc88806f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.010+0000 7fc887e00640 1 --2- 172.21.15.90:0/2513185871 >> v2:172.21.15.149:3300/0 conn(0x7fc88814b5a0 0x7fc8880c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.010+0000 7fc887e00640 1 --2- 172.21.15.90:0/2513185871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8880ad310 0x7fc8880aa9e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.010+0000 7fc887e00640 1 -- 172.21.15.90:0/2513185871 >> 172.21.15.90:0/2513185871 conn(0x7fc88806d200 msgr2=0x7fc88806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:36.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.012+0000 7fc887e00640 1 -- 172.21.15.90:0/2513185871 shutdown_connections 2024-09-21T03:21:36.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.012+0000 7fc887e00640 1 -- 172.21.15.90:0/2513185871 wait complete. 2024-09-21T03:21:36.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.025+0000 7fc887e00640 1 Processor -- start 2024-09-21T03:21:36.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.026+0000 7fc887e00640 1 -- start start 2024-09-21T03:21:36.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.030+0000 7fc887e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8880aaf20 0x7fc8881ee340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:36.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.030+0000 7fc887e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8880ad310 0x7fc8880c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:36.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.031+0000 7fc887e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc88814b5a0 0x7fc888145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:36.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.031+0000 7fc887e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc8880c55e0 con 0x7fc8880ad310 2024-09-21T03:21:36.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.031+0000 7fc887e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc8880c5460 con 0x7fc88814b5a0 2024-09-21T03:21:36.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.031+0000 7fc887e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc8880c5760 con 0x7fc8880aaf20 2024-09-21T03:21:36.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.031+0000 7fc887400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc88814b5a0 0x7fc888145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:36.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.031+0000 7fc887400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc88814b5a0 0x7fc888145890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:52600/0 (socket says 172.21.15.90:52600) 2024-09-21T03:21:36.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.031+0000 7fc887400640 1 -- 172.21.15.90:0/294688373 learned_addr learned my addr 172.21.15.90:0/294688373 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:21:36.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.031+0000 7fc886a00640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8880aaf20 0x7fc8881ee340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:36.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.032+0000 7fc87fe00640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8880ad310 0x7fc8880c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:36.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.033+0000 7fc887400640 1 -- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8880aaf20 msgr2=0x7fc8881ee340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.033+0000 7fc887400640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8880aaf20 0x7fc8881ee340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.033+0000 7fc887400640 1 -- 172.21.15.90:0/294688373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8880ad310 msgr2=0x7fc8880c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.035+0000 7fc887400640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8880ad310 0x7fc8880c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.035+0000 7fc887400640 1 -- 172.21.15.90:0/294688373 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8881eeff0 con 0x7fc88814b5a0 2024-09-21T03:21:36.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.035+0000 7fc87fe00640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8880ad310 0x7fc8880c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:36.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.040+0000 7fc887400640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc88814b5a0 0x7fc888145890 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc88000b570 tx=0x7fc880009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:36.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.045+0000 7fc87ea00640 1 -- 172.21.15.90:0/294688373 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc880013030 con 0x7fc88814b5a0 2024-09-21T03:21:36.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.045+0000 7fc87ea00640 1 -- 172.21.15.90:0/294688373 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc880004b20 con 0x7fc88814b5a0 2024-09-21T03:21:36.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.045+0000 7fc87ea00640 1 -- 172.21.15.90:0/294688373 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc880014270 con 0x7fc88814b5a0 2024-09-21T03:21:36.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.046+0000 7fc887e00640 1 -- 172.21.15.90:0/294688373 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8880c8780 con 0x7fc88814b5a0 2024-09-21T03:21:36.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.046+0000 7fc887e00640 1 -- 172.21.15.90:0/294688373 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8881eed10 con 0x7fc88814b5a0 2024-09-21T03:21:36.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.048+0000 7fc877e00640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc860002a70 0x7fc860004f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:36.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.048+0000 7fc877e00640 1 -- 172.21.15.90:0/294688373 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc860007f10 con 0x7fc860002a70 2024-09-21T03:21:36.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.059+0000 7fc886a00640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc860002a70 0x7fc860004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:36.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.065+0000 7fc886a00640 1 -- 172.21.15.90:0/294688373 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc860008110 con 0x7fc860002a70 2024-09-21T03:21:36.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.067+0000 7fc87ea00640 1 -- 172.21.15.90:0/294688373 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc880014410 con 0x7fc88814b5a0 2024-09-21T03:21:36.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.069+0000 7fc87ea00640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc864078c60 0x7fc86407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:36.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.070+0000 7fc87ea00640 1 -- 172.21.15.90:0/294688373 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fc88009b280 con 0x7fc88814b5a0 2024-09-21T03:21:36.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.071+0000 7fc87fe00640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc864078c60 0x7fc86407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:36.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.071+0000 7fc886a00640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc860002a70 0x7fc860004f80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc88806dd40 tx=0x7fc878004260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:36.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.074+0000 7fc87ea00640 1 -- 172.21.15.90:0/294688373 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc878041070 con 0x7fc860002a70 2024-09-21T03:21:36.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.075+0000 7fc87ea00640 1 -- 172.21.15.90:0/294688373 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc878031650 con 0x7fc860002a70 2024-09-21T03:21:36.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.075+0000 7fc87ea00640 1 -- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc860002a70 msgr2=0x7fc860004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.075+0000 7fc87ea00640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc860002a70 0x7fc860004f80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc88806dd40 tx=0x7fc878004260 comp rx=0 tx=0).stop 2024-09-21T03:21:36.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.078+0000 7fc87fe00640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc864078c60 0x7fc86407b170 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc88806e1c0 tx=0x7fc870006ed0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:36.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.079+0000 7fc87ea00640 1 -- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc860002a70 msgr2=0x7fc860004f80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:21:36.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.079+0000 7fc87ea00640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc860002a70 0x7fc860004f80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.107+0000 7fc877e00640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc860006f80 0x7fc860007460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:36.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.107+0000 7fc877e00640 1 -- 172.21.15.90:0/294688373 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc86000a4f0 con 0x7fc860006f80 2024-09-21T03:21:36.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.107+0000 7fc886a00640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc860006f80 0x7fc860007460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:36.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.123+0000 7fc886a00640 1 -- 172.21.15.90:0/294688373 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc8600079a0 con 0x7fc860006f80 2024-09-21T03:21:36.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.123+0000 7fc886a00640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc860006f80 0x7fc860007460 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc8600080e0 tx=0x7fc878004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:36.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.124+0000 7fc87ea00640 1 -- 172.21.15.90:0/294688373 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8780470d0 con 0x7fc860006f80 2024-09-21T03:21:36.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.125+0000 7fc87ea00640 1 -- 172.21.15.90:0/294688373 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5193 (secure 0 0 0) 0x7fc8780470d0 con 0x7fc860006f80 2024-09-21T03:21:36.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.125+0000 7fc87ea00640 1 -- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc860006f80 msgr2=0x7fc860007460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.125+0000 7fc87ea00640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc860006f80 0x7fc860007460 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc8600080e0 tx=0x7fc878004730 comp rx=0 tx=0).stop 2024-09-21T03:21:36.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.125+0000 7fc87ea00640 1 -- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc860006f80 msgr2=0x7fc860007460 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:21:36.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.125+0000 7fc87ea00640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc860006f80 0x7fc860007460 secure :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc8600080e0 tx=0x7fc878004730 comp rx=0 tx=0).stop 2024-09-21T03:21:36.129 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:21:36.129 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:21:36.129 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:21:36.129 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:21:36.129 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 52, 2024-09-21T03:21:36.129 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 446913, 2024-09-21T03:21:36.129 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:21:36.129 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:21:36.129 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:21:36.129 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:21:36.129 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:36.129 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 3, 2024-09-21T03:21:36.130 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:21:36.130 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:21:36.130 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:21:36.130 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:36.130 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:36.130 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:36.130 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:36.130 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:36.130 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:36.130 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:36.130 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:36.130 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:36.130 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:36.130 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:36.131 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:36.131 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:21:36.131 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:21:36.131 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:36.131 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:36.131 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:36.131 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:36.131 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:36.131 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:36.131 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:36.131 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:36.131 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:36.131 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:36.131 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:36.132 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:36.132 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.132 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:21:36.132 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:21:36.132 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:21:36.132 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:21:36.132 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:21:36.132 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:21:36.132 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:21:36.132 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:21:36.132 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:21:36.132 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:21:36.132 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:21:36.132 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:21:36.132 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:21:36.133 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:21:36.133 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:21:36.133 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:21:36.133 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:21:36.133 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:36.133 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:36.133 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:36.133 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:36.133 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:36.133 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:36.133 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:36.133 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:36.133 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:36.133 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:36.134 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:36.134 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:36.134 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:21:36.134 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.134 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:21:36.134 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.134 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:21:36.134 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:21:36.134 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:36.134 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:36.134 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.134 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:36.134 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:21:36.134 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:36.135 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.135 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.135 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:36.135 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:21:36.135 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:36.135 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:36.135 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:36.135 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.135 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:21:36.135 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:21:36.135 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:36.135 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:36.135 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:36.135 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.135 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.136 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:21:36.136 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:21:36.136 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:36.136 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:36.136 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.136 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:36.136 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:21:36.136 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:36.136 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.136 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.136 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:36.136 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:21:36.136 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:36.136 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:36.137 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:36.137 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.137 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:21:36.137 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:21:36.137 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:36.137 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:36.137 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:36.137 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.137 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.137 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:21:36.137 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:21:36.137 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:36.137 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:36.137 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.138 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:36.138 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:21:36.138 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:36.138 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.138 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.138 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:36.138 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:21:36.138 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:36.138 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:36.138 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:36.138 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.138 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:21:36.138 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:21:36.138 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:36.138 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:36.139 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:36.139 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:36.139 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:36.139 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.139 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:21:36.139 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:21:36.139 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.139 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:36.139 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:36.139 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:21:36.139 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:36.139 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:36.139 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:21:36.139 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.140 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:36.140 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:36.140 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:21:36.140 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:36.140 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:36.140 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:21:36.140 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.140 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:36.140 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:36.140 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6 2024-09-21T03:21:36.140 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:36.140 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:36.140 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:21:36.140 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.140 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:21:36.141 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:21:36.141 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:21:36.141 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.141 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.141 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:36.141 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:36.141 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5 2024-09-21T03:21:36.141 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:36.141 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:36.141 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:21:36.141 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.141 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:36.141 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:36.141 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:21:36.141 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:36.141 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:36.142 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.142 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:21:36.142 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:21:36.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.130+0000 7fc877e00640 1 -- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc864078c60 msgr2=0x7fc86407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.130+0000 7fc877e00640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc864078c60 0x7fc86407b170 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc88806e1c0 tx=0x7fc870006ed0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.130+0000 7fc877e00640 1 -- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc88814b5a0 msgr2=0x7fc888145890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.130+0000 7fc877e00640 1 --2- 172.21.15.90:0/294688373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc88814b5a0 0x7fc888145890 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc88000b570 tx=0x7fc880009f90 comp rx=0 tx=0).stop 2024-09-21T03:21:36.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.140+0000 7fc887400640 1 -- 172.21.15.90:0/294688373 reap_dead start 2024-09-21T03:21:36.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.140+0000 7fc887400640 1 -- 172.21.15.90:0/294688373 reap_dead start 2024-09-21T03:21:36.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.141+0000 7fc877e00640 1 -- 172.21.15.90:0/294688373 shutdown_connections 2024-09-21T03:21:36.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.141+0000 7fc877e00640 1 -- 172.21.15.90:0/294688373 >> 172.21.15.90:0/294688373 conn(0x7fc88806d200 msgr2=0x7fc8880763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:36.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.141+0000 7fc877e00640 1 -- 172.21.15.90:0/294688373 shutdown_connections 2024-09-21T03:21:36.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.141+0000 7fc877e00640 1 -- 172.21.15.90:0/294688373 wait complete. 2024-09-21T03:21:36.203 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:21:36.203 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-21T03:21:36.203 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:21:36.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.707+0000 7f5e33200640 1 -- 172.21.15.90:0/3492343954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e2c02dbd0 msgr2=0x7f5e2c0d99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.707+0000 7f5e33200640 1 --2- 172.21.15.90:0/3492343954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e2c02dbd0 0x7f5e2c0d99c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5e3406ca30 tx=0x7f5e340a75c0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.710+0000 7f5e33200640 1 -- 172.21.15.90:0/3492343954 shutdown_connections 2024-09-21T03:21:36.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.710+0000 7f5e33200640 1 --2- 172.21.15.90:0/3492343954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e2c02dbd0 0x7f5e2c0d99c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.710+0000 7f5e33200640 1 --2- 172.21.15.90:0/3492343954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c049740 0x7f5e2c046940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.710+0000 7f5e33200640 1 -- 172.21.15.90:0/3492343954 >> 172.21.15.90:0/3492343954 conn(0x7f5e2c048650 msgr2=0x7f5e2c02ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:36.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.712+0000 7f5e33200640 1 -- 172.21.15.90:0/3492343954 shutdown_connections 2024-09-21T03:21:36.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.712+0000 7f5e33200640 1 -- 172.21.15.90:0/3492343954 wait complete. 2024-09-21T03:21:36.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.722+0000 7f5e33200640 1 Processor -- start 2024-09-21T03:21:36.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.724+0000 7f5e33200640 1 -- start start 2024-09-21T03:21:36.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.730+0000 7f5e33200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c02d7c0 0x7f5e2c042420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:36.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.730+0000 7f5e33200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e2c02dbd0 0x7f5e2c03df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:36.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.731+0000 7f5e33200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e2c049740 0x7f5e2c03e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:36.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.731+0000 7f5e31e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c02d7c0 0x7f5e2c042420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:36.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.732+0000 7f5e31e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c02d7c0 0x7f5e2c042420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:54640/0 (socket says 172.21.15.90:54640) 2024-09-21T03:21:36.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.732+0000 7f5e31e00640 1 -- 172.21.15.90:0/1147754478 learned_addr learned my addr 172.21.15.90:0/1147754478 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:21:36.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.732+0000 7f5e31400640 1 --2- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e2c02dbd0 0x7f5e2c03df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:36.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.732+0000 7f5e33200640 1 -- 172.21.15.90:0/1147754478 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c00ba60 con 0x7f5e2c049740 2024-09-21T03:21:36.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.732+0000 7f5e33200640 1 -- 172.21.15.90:0/1147754478 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c00b8e0 con 0x7f5e2c02dbd0 2024-09-21T03:21:36.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.732+0000 7f5e33200640 1 -- 172.21.15.90:0/1147754478 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5e2c0d9f00 con 0x7f5e2c02d7c0 2024-09-21T03:21:36.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.734+0000 7f5e32800640 1 --2- 172.21.15.90:0/1147754478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e2c049740 0x7f5e2c03e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:36.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.735+0000 7f5e31e00640 1 -- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e2c02dbd0 msgr2=0x7f5e2c03df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.735+0000 7f5e31e00640 1 --2- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e2c02dbd0 0x7f5e2c03df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.735+0000 7f5e31e00640 1 -- 172.21.15.90:0/1147754478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e2c049740 msgr2=0x7f5e2c03e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.735+0000 7f5e31e00640 1 --2- 172.21.15.90:0/1147754478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e2c049740 0x7f5e2c03e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.737+0000 7f5e31e00640 1 -- 172.21.15.90:0/1147754478 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2c03f0f0 con 0x7f5e2c02d7c0 2024-09-21T03:21:36.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.741+0000 7f5e31e00640 1 --2- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c02d7c0 0x7f5e2c042420 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400d790 tx=0x7f5e2400dc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:36.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.742+0000 7f5e2a000640 1 -- 172.21.15.90:0/1147754478 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24004020 con 0x7f5e2c02d7c0 2024-09-21T03:21:36.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.742+0000 7f5e2a000640 1 -- 172.21.15.90:0/1147754478 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e240041c0 con 0x7f5e2c02d7c0 2024-09-21T03:21:36.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.742+0000 7f5e2a000640 1 -- 172.21.15.90:0/1147754478 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24005020 con 0x7f5e2c02d7c0 2024-09-21T03:21:36.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.743+0000 7f5e33200640 1 -- 172.21.15.90:0/1147754478 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e2c043dc0 con 0x7f5e2c02d7c0 2024-09-21T03:21:36.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.743+0000 7f5e33200640 1 -- 172.21.15.90:0/1147754478 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e2c0444d0 con 0x7f5e2c02d7c0 2024-09-21T03:21:36.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.750+0000 7f5e33200640 1 --2- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c03f2c0 0x7f5e2c0d2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:36.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.750+0000 7f5e33200640 1 -- 172.21.15.90:0/1147754478 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5e2c045780 con 0x7f5e2c03f2c0 2024-09-21T03:21:36.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.751+0000 7f5e2a000640 1 -- 172.21.15.90:0/1147754478 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5e2401c030 con 0x7f5e2c02d7c0 2024-09-21T03:21:36.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.753+0000 7f5e31400640 1 --2- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c03f2c0 0x7f5e2c0d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:36.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.758+0000 7f5e2a000640 1 --2- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5e1407d020 0x7f5e1407f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:36.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.758+0000 7f5e2a000640 1 -- 172.21.15.90:0/1147754478 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f5e2409aaa0 con 0x7f5e2c02d7c0 2024-09-21T03:21:36.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.762+0000 7f5e32800640 1 --2- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5e1407d020 0x7f5e1407f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:36.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.766+0000 7f5e31400640 1 -- 172.21.15.90:0/1147754478 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e2c0d99c0 con 0x7f5e2c03f2c0 2024-09-21T03:21:36.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.767+0000 7f5e31400640 1 --2- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c03f2c0 0x7f5e2c0d2660 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5e20000f60 tx=0x7f5e2000e820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:36.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.767+0000 7f5e32800640 1 --2- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5e1407d020 0x7f5e1407f530 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c007610 tx=0x7f5e3406acb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:36.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.768+0000 7f5e2a000640 1 -- 172.21.15.90:0/1147754478 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20019070 con 0x7f5e2c03f2c0 2024-09-21T03:21:36.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.770+0000 7f5e2a000640 1 -- 172.21.15.90:0/1147754478 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5e200052e0 con 0x7f5e2c03f2c0 2024-09-21T03:21:36.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.770+0000 7f5e2a000640 1 -- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c03f2c0 msgr2=0x7f5e2c0d2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.770+0000 7f5e2a000640 1 --2- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c03f2c0 0x7f5e2c0d2660 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5e20000f60 tx=0x7f5e2000e820 comp rx=0 tx=0).stop 2024-09-21T03:21:36.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.770+0000 7f5e2a000640 1 -- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c03f2c0 msgr2=0x7f5e2c0d2660 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:21:36.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.770+0000 7f5e2a000640 1 --2- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c03f2c0 0x7f5e2c0d2660 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5e20000f60 tx=0x7f5e2000e820 comp rx=0 tx=0).stop 2024-09-21T03:21:36.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.796+0000 7f5e33200640 1 --2- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c0d3570 0x7f5e2c0d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:36.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.796+0000 7f5e33200640 1 -- 172.21.15.90:0/1147754478 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5e2c041be0 con 0x7f5e2c0d3570 2024-09-21T03:21:36.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.796+0000 7f5e31400640 1 --2- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c0d3570 0x7f5e2c0d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:36.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.798+0000 7f5e31400640 1 -- 172.21.15.90:0/1147754478 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5e2c0d3b00 con 0x7f5e2c0d3570 2024-09-21T03:21:36.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.801+0000 7f5e31400640 1 --2- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c0d3570 0x7f5e2c0d2ba0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c0419e0 tx=0x7f5e20001080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:36.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.802+0000 7f5e2a000640 1 -- 172.21.15.90:0/1147754478 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20019070 con 0x7f5e2c0d3570 2024-09-21T03:21:36.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.803+0000 7f5e2a000640 1 -- 172.21.15.90:0/1147754478 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4547 (secure 0 0 0) 0x7f5e200035f0 con 0x7f5e2c0d3570 2024-09-21T03:21:36.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.803+0000 7f5e2a000640 1 -- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c0d3570 msgr2=0x7f5e2c0d2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.808 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:21:36.808 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:21:36.808 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:21:36.808 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:21:36.808 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 52, 2024-09-21T03:21:36.808 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 7123, 2024-09-21T03:21:36.808 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:21:36.809 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:21:36.809 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:21:36.809 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:21:36.809 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:36.809 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 4, 2024-09-21T03:21:36.809 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:21:36.809 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:21:36.809 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:21:36.809 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:36.809 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:36.809 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:36.809 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:36.809 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:36.809 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:36.810 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:36.810 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:36.810 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:36.810 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:36.810 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:36.810 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:36.810 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:21:36.810 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:21:36.810 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:36.810 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:36.810 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:36.810 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:36.810 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:36.810 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:36.811 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:36.811 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:36.811 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:36.811 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:36.811 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:36.811 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:36.811 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.811 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:21:36.811 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:21:36.811 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:21:36.811 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:21:36.811 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:21:36.811 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:21:36.811 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:21:36.812 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:21:36.812 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:21:36.812 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:21:36.812 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:21:36.812 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:21:36.812 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:21:36.812 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:21:36.812 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:21:36.812 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:21:36.812 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:21:36.812 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:36.812 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:36.812 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:36.812 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:36.812 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:36.813 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:36.813 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:36.813 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:36.813 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:36.813 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:36.813 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:36.813 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:36.813 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:21:36.813 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.813 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:21:36.813 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.813 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:21:36.813 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:21:36.813 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:36.813 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:36.814 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.814 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:36.814 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:21:36.814 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:36.814 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.814 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.814 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:36.814 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:21:36.814 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:36.814 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:36.814 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:36.814 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.814 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:21:36.815 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:21:36.815 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:36.815 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:36.815 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:36.815 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.815 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.815 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:21:36.815 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:21:36.815 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:36.815 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:36.815 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.815 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:36.815 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:21:36.815 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:36.816 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.816 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.816 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:36.816 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:21:36.816 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:36.816 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:36.816 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:36.816 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.816 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:21:36.816 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:21:36.816 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:36.816 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:36.816 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:36.816 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.817 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.817 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:21:36.817 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:21:36.817 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:36.817 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:36.817 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.817 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:36.817 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:21:36.817 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:36.817 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.817 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.817 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:36.817 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:21:36.817 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:36.818 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:36.818 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:36.818 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.818 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:21:36.818 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:21:36.818 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:36.818 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:36.818 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:36.818 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:36.818 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:36.818 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.818 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:21:36.818 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:21:36.818 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.819 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:36.819 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:36.819 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:21:36.819 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:36.819 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:36.819 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:21:36.819 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:36.819 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:36.819 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:36.819 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:21:36.819 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:36.819 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:36.819 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:36.819 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:21:36.820 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:21:36.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.804+0000 7f5e2a000640 1 --2- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c0d3570 0x7f5e2c0d2ba0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c0419e0 tx=0x7f5e20001080 comp rx=0 tx=0).stop 2024-09-21T03:21:36.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.804+0000 7f5e2a000640 1 -- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c0d3570 msgr2=0x7f5e2c0d2ba0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:21:36.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.804+0000 7f5e2a000640 1 --2- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c0d3570 0x7f5e2c0d2ba0 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c0419e0 tx=0x7f5e20001080 comp rx=0 tx=0).stop 2024-09-21T03:21:36.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.807+0000 7f5e33200640 1 -- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5e1407d020 msgr2=0x7f5e1407f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.807+0000 7f5e33200640 1 --2- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5e1407d020 0x7f5e1407f530 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c007610 tx=0x7f5e3406acb0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.807+0000 7f5e33200640 1 -- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c02d7c0 msgr2=0x7f5e2c042420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.807+0000 7f5e33200640 1 --2- 172.21.15.90:0/1147754478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c02d7c0 0x7f5e2c042420 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400d790 tx=0x7f5e2400dc50 comp rx=0 tx=0).stop 2024-09-21T03:21:36.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.807+0000 7f5e32800640 1 -- 172.21.15.90:0/1147754478 reap_dead start 2024-09-21T03:21:36.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.807+0000 7f5e32800640 1 -- 172.21.15.90:0/1147754478 reap_dead start 2024-09-21T03:21:36.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.808+0000 7f5e33200640 1 -- 172.21.15.90:0/1147754478 shutdown_connections 2024-09-21T03:21:36.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.808+0000 7f5e33200640 1 -- 172.21.15.90:0/1147754478 >> 172.21.15.90:0/1147754478 conn(0x7f5e2c048650 msgr2=0x7f5e2c00ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:36.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.808+0000 7f5e33200640 1 -- 172.21.15.90:0/1147754478 shutdown_connections 2024-09-21T03:21:36.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:36.808+0000 7f5e33200640 1 -- 172.21.15.90:0/1147754478 wait complete. 2024-09-21T03:21:36.882 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:21:36.882 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-21T03:21:36.883 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-21T03:21:37.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.361+0000 7f3acfc00640 1 -- 172.21.15.90:0/131865696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac8153600 msgr2=0x7f3ac80c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:37.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.361+0000 7f3acfc00640 1 --2- 172.21.15.90:0/131865696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac8153600 0x7f3ac80c86e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80722b0 tx=0x7f3ab402c350 comp rx=0 tx=0).stop 2024-09-21T03:21:37.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.361+0000 7f3acfc00640 1 -- 172.21.15.90:0/131865696 shutdown_connections 2024-09-21T03:21:37.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.361+0000 7f3acfc00640 1 --2- 172.21.15.90:0/131865696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac8153600 0x7f3ac80c86e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.361+0000 7f3acfc00640 1 --2- 172.21.15.90:0/131865696 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ac8153a10 0x7f3ac8156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.361+0000 7f3acfc00640 1 --2- 172.21.15.90:0/131865696 >> v2:172.21.15.149:3300/0 conn(0x7f3ac80ad4e0 0x7f3ac814cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.361+0000 7f3acfc00640 1 -- 172.21.15.90:0/131865696 >> 172.21.15.90:0/131865696 conn(0x7f3ac806ecb0 msgr2=0x7f3ac806f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:37.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.362+0000 7f3acfc00640 1 -- 172.21.15.90:0/131865696 shutdown_connections 2024-09-21T03:21:37.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.362+0000 7f3acfc00640 1 -- 172.21.15.90:0/131865696 wait complete. 2024-09-21T03:21:37.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.367+0000 7f3acfc00640 1 Processor -- start 2024-09-21T03:21:37.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.368+0000 7f3acfc00640 1 -- start start 2024-09-21T03:21:37.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.372+0000 7f3acfc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ac8153600 0x7f3ac814d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:37.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.372+0000 7f3acfc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ac8153a10 0x7f3ac81f1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:37.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.373+0000 7f3acd200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ac8153600 0x7f3ac814d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:37.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.373+0000 7f3acd200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ac8153600 0x7f3ac814d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:54668/0 (socket says 172.21.15.90:54668) 2024-09-21T03:21:37.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.373+0000 7f3acfc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac8156420 0x7f3ac80be7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:37.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.373+0000 7f3acfc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac8070770 con 0x7f3ac8156420 2024-09-21T03:21:37.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.373+0000 7f3acfc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac80705f0 con 0x7f3ac8153a10 2024-09-21T03:21:37.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.373+0000 7f3acd200640 1 -- 172.21.15.90:0/4106212952 learned_addr learned my addr 172.21.15.90:0/4106212952 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:21:37.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.373+0000 7f3acfc00640 1 -- 172.21.15.90:0/4106212952 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3ac80ab8c0 con 0x7f3ac8153600 2024-09-21T03:21:37.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.374+0000 7f3ac7e00640 1 --2- 172.21.15.90:0/4106212952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ac8153a10 0x7f3ac81f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:37.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.374+0000 7f3ace600640 1 --2- 172.21.15.90:0/4106212952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac8156420 0x7f3ac80be7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:37.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.376+0000 7f3acd200640 1 -- 172.21.15.90:0/4106212952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ac8153a10 msgr2=0x7f3ac81f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:37.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.376+0000 7f3acd200640 1 --2- 172.21.15.90:0/4106212952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ac8153a10 0x7f3ac81f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.376+0000 7f3acd200640 1 -- 172.21.15.90:0/4106212952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac8156420 msgr2=0x7f3ac80be7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:37.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.376+0000 7f3acd200640 1 --2- 172.21.15.90:0/4106212952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac8156420 0x7f3ac80be7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.377+0000 7f3acd200640 1 -- 172.21.15.90:0/4106212952 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac80c1bd0 con 0x7f3ac8153600 2024-09-21T03:21:37.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.377+0000 7f3ace600640 1 --2- 172.21.15.90:0/4106212952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac8156420 0x7f3ac80be7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:21:37.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.377+0000 7f3ac7e00640 1 --2- 172.21.15.90:0/4106212952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ac8153a10 0x7f3ac81f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:37.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.379+0000 7f3acd200640 1 --2- 172.21.15.90:0/4106212952 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ac8153600 0x7f3ac814d340 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00d6b0 tx=0x7f3abc00db70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:37.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.380+0000 7f3ac4c00640 1 -- 172.21.15.90:0/4106212952 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc017070 con 0x7f3ac8153600 2024-09-21T03:21:37.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.382+0000 7f3ac4c00640 1 -- 172.21.15.90:0/4106212952 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3abc004310 con 0x7f3ac8153600 2024-09-21T03:21:37.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.382+0000 7f3acfc00640 1 -- 172.21.15.90:0/4106212952 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac80bdb20 con 0x7f3ac8153600 2024-09-21T03:21:37.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.382+0000 7f3acfc00640 1 -- 172.21.15.90:0/4106212952 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac81505a0 con 0x7f3ac8153600 2024-09-21T03:21:37.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.384+0000 7f3acfc00640 1 -- 172.21.15.90:0/4106212952 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ac81f1d50 con 0x7f3ac8153600 2024-09-21T03:21:37.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.385+0000 7f3ac4c00640 1 -- 172.21.15.90:0/4106212952 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc009a80 con 0x7f3ac8153600 2024-09-21T03:21:37.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.402+0000 7f3ac4c00640 1 -- 172.21.15.90:0/4106212952 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3abc009c20 con 0x7f3ac8153600 2024-09-21T03:21:37.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.408+0000 7f3ac4c00640 1 --2- 172.21.15.90:0/4106212952 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3aa8078b90 0x7f3aa807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:37.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.410+0000 7f3ac7e00640 1 --2- 172.21.15.90:0/4106212952 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3aa8078b90 0x7f3aa807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:37.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.412+0000 7f3ac4c00640 1 -- 172.21.15.90:0/4106212952 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f3abc09b3c0 con 0x7f3ac8153600 2024-09-21T03:21:37.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.412+0000 7f3ac4c00640 1 -- 172.21.15.90:0/4106212952 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3ac81f1d50 con 0x7f3ac8153600 2024-09-21T03:21:37.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:37.416+0000 7f3ac7e00640 1 --2- 172.21.15.90:0/4106212952 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3aa8078b90 0x7f3aa807b0a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4036000 tx=0x7f3ab402df90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:38.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:38.025+0000 7f3acfc00640 1 -- 172.21.15.90:0/4106212952 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f3ac8070fb0 con 0x7f3ac8153600 2024-09-21T03:21:38.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:38.029+0000 7f3ac4c00640 1 -- 172.21.15.90:0/4106212952 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f3abc062f60 con 0x7f3ac8153600 2024-09-21T03:21:38.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:38.035+0000 7f3acfc00640 1 -- 172.21.15.90:0/4106212952 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3aa8078b90 msgr2=0x7f3aa807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:38.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:38.035+0000 7f3acfc00640 1 --2- 172.21.15.90:0/4106212952 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3aa8078b90 0x7f3aa807b0a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4036000 tx=0x7f3ab402df90 comp rx=0 tx=0).stop 2024-09-21T03:21:38.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:38.035+0000 7f3acfc00640 1 -- 172.21.15.90:0/4106212952 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ac8153600 msgr2=0x7f3ac814d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:38.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:38.035+0000 7f3acfc00640 1 --2- 172.21.15.90:0/4106212952 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ac8153600 0x7f3ac814d340 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00d6b0 tx=0x7f3abc00db70 comp rx=0 tx=0).stop 2024-09-21T03:21:38.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:38.035+0000 7f3acfc00640 1 -- 172.21.15.90:0/4106212952 shutdown_connections 2024-09-21T03:21:38.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:38.035+0000 7f3acfc00640 1 --2- 172.21.15.90:0/4106212952 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3aa8078b90 0x7f3aa807b0a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:38.035+0000 7f3acfc00640 1 --2- 172.21.15.90:0/4106212952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac8156420 0x7f3ac80be7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:38.035+0000 7f3acfc00640 1 --2- 172.21.15.90:0/4106212952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ac8153a10 0x7f3ac81f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:38.035+0000 7f3acfc00640 1 --2- 172.21.15.90:0/4106212952 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ac8153600 0x7f3ac814d340 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00d6b0 tx=0x7f3abc00db70 comp rx=0 tx=0).stop 2024-09-21T03:21:38.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:38.035+0000 7f3acfc00640 1 -- 172.21.15.90:0/4106212952 >> 172.21.15.90:0/4106212952 conn(0x7f3ac806ecb0 msgr2=0x7f3ac806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:38.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:38.036+0000 7f3acfc00640 1 -- 172.21.15.90:0/4106212952 shutdown_connections 2024-09-21T03:21:38.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:38.036+0000 7f3acfc00640 1 -- 172.21.15.90:0/4106212952 wait complete. 2024-09-21T03:21:38.103 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-21T03:21:48.104 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-21T03:21:48.104 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:21:48.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.539+0000 7f30f7200640 1 -- 172.21.15.90:0/2741494401 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0032070 con 0x7f30f80c4ee0 2024-09-21T03:21:48.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.539+0000 7f30fd200640 1 -- 172.21.15.90:0/2741494401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30f80c4ee0 msgr2=0x7f30f8160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:48.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.539+0000 7f30fd200640 1 --2- 172.21.15.90:0/2741494401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30f80c4ee0 0x7f30f8160510 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f30f000ac20 tx=0x7f30f002aa50 comp rx=0 tx=0).stop 2024-09-21T03:21:48.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.539+0000 7f30fd200640 1 -- 172.21.15.90:0/2741494401 shutdown_connections 2024-09-21T03:21:48.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.539+0000 7f30fd200640 1 --2- 172.21.15.90:0/2741494401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30f80c4ee0 0x7f30f8160510 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.539+0000 7f30fd200640 1 --2- 172.21.15.90:0/2741494401 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30f808c9c0 0x7f30f80c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.539+0000 7f30fd200640 1 -- 172.21.15.90:0/2741494401 >> 172.21.15.90:0/2741494401 conn(0x7f30f806ead0 msgr2=0x7f30f806eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:48.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.540+0000 7f30fd200640 1 -- 172.21.15.90:0/2741494401 shutdown_connections 2024-09-21T03:21:48.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.540+0000 7f30fd200640 1 -- 172.21.15.90:0/2741494401 wait complete. 2024-09-21T03:21:48.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.548+0000 7f30fd200640 1 Processor -- start 2024-09-21T03:21:48.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.548+0000 7f30fd200640 1 -- start start 2024-09-21T03:21:48.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.553+0000 7f30fd200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30f80701d0 0x7f30f815c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:48.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.553+0000 7f30fd200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30f808c9c0 0x7f30f8074370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:48.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.553+0000 7f30fd200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30f80c4ee0 0x7f30f81fcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:48.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.554+0000 7f30fd200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f30f80acf20 con 0x7f30f80701d0 2024-09-21T03:21:48.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.554+0000 7f30fd200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f30f80ad290 con 0x7f30f808c9c0 2024-09-21T03:21:48.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.554+0000 7f30fd200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f30f8161330 con 0x7f30f80c4ee0 2024-09-21T03:21:48.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.554+0000 7f30f5e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30f80c4ee0 0x7f30f81fcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:48.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.554+0000 7f30f5e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30f80c4ee0 0x7f30f81fcfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:49446/0 (socket says 172.21.15.90:49446) 2024-09-21T03:21:48.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.554+0000 7f30f5e00640 1 -- 172.21.15.90:0/1256299662 learned_addr learned my addr 172.21.15.90:0/1256299662 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:21:48.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.555+0000 7f30f5400640 1 --2- 172.21.15.90:0/1256299662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30f80701d0 0x7f30f815c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:48.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.556+0000 7f30f5400640 1 -- 172.21.15.90:0/1256299662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30f80c4ee0 msgr2=0x7f30f81fcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:48.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.556+0000 7f30f5400640 1 --2- 172.21.15.90:0/1256299662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30f80c4ee0 0x7f30f81fcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.556+0000 7f30f5400640 1 -- 172.21.15.90:0/1256299662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30f808c9c0 msgr2=0x7f30f8074370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:21:48.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.556+0000 7f30f5400640 1 --2- 172.21.15.90:0/1256299662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30f808c9c0 0x7f30f8074370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.556+0000 7f30f5400640 1 -- 172.21.15.90:0/1256299662 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f8158f70 con 0x7f30f80701d0 2024-09-21T03:21:48.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.557+0000 7f30f5400640 1 --2- 172.21.15.90:0/1256299662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30f80701d0 0x7f30f815c320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f30e800c760 tx=0x7f30e800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:48.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.558+0000 7f30ee000640 1 -- 172.21.15.90:0/1256299662 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8016020 con 0x7f30f80701d0 2024-09-21T03:21:48.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.558+0000 7f30ee000640 1 -- 172.21.15.90:0/1256299662 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30e800a730 con 0x7f30f80701d0 2024-09-21T03:21:48.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.558+0000 7f30fd200640 1 -- 172.21.15.90:0/1256299662 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f8158d00 con 0x7f30f80701d0 2024-09-21T03:21:48.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.558+0000 7f30fd200640 1 -- 172.21.15.90:0/1256299662 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f815a750 con 0x7f30f80701d0 2024-09-21T03:21:48.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.560+0000 7f30ee000640 1 -- 172.21.15.90:0/1256299662 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8016020 con 0x7f30f80701d0 2024-09-21T03:21:48.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.563+0000 7f30ee000640 1 -- 172.21.15.90:0/1256299662 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f30e8019020 con 0x7f30f80701d0 2024-09-21T03:21:48.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.565+0000 7f30ee000640 1 --2- 172.21.15.90:0/1256299662 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f30d8078d90 0x7f30d807b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:48.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.566+0000 7f30ee000640 1 -- 172.21.15.90:0/1256299662 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f30e809a930 con 0x7f30f80701d0 2024-09-21T03:21:48.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.566+0000 7f30fd200640 1 -- 172.21.15.90:0/1256299662 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30d0005290 con 0x7f30f80701d0 2024-09-21T03:21:48.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.567+0000 7f30f4a00640 1 --2- 172.21.15.90:0/1256299662 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f30d8078d90 0x7f30d807b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:48.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.572+0000 7f30f4a00640 1 --2- 172.21.15.90:0/1256299662 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f30d8078d90 0x7f30d807b2a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f30f8166320 tx=0x7f30e4005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:48.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:48.581+0000 7f30ee000640 1 -- 172.21.15.90:0/1256299662 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f30e8020030 con 0x7f30f80701d0 2024-09-21T03:21:49.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.202+0000 7f30fd200640 1 -- 172.21.15.90:0/1256299662 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f30d0005580 con 0x7f30f80701d0 2024-09-21T03:21:49.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.203+0000 7f30ee000640 1 -- 172.21.15.90:0/1256299662 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f30e8098e20 con 0x7f30f80701d0 2024-09-21T03:21:49.208 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:21:49.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.210+0000 7f30fd200640 1 -- 172.21.15.90:0/1256299662 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f30d8078d90 msgr2=0x7f30d807b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:49.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.210+0000 7f30fd200640 1 --2- 172.21.15.90:0/1256299662 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f30d8078d90 0x7f30d807b2a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f30f8166320 tx=0x7f30e4005f90 comp rx=0 tx=0).stop 2024-09-21T03:21:49.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.210+0000 7f30fd200640 1 -- 172.21.15.90:0/1256299662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30f80701d0 msgr2=0x7f30f815c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:49.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.210+0000 7f30fd200640 1 --2- 172.21.15.90:0/1256299662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30f80701d0 0x7f30f815c320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f30e800c760 tx=0x7f30e800cc20 comp rx=0 tx=0).stop 2024-09-21T03:21:49.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.211+0000 7f30fd200640 1 -- 172.21.15.90:0/1256299662 shutdown_connections 2024-09-21T03:21:49.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.211+0000 7f30fd200640 1 --2- 172.21.15.90:0/1256299662 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f30d8078d90 0x7f30d807b2a0 secure :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f30f8166320 tx=0x7f30e4005f90 comp rx=0 tx=0).stop 2024-09-21T03:21:49.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.211+0000 7f30fd200640 1 --2- 172.21.15.90:0/1256299662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30f80c4ee0 0x7f30f81fcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:49.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.211+0000 7f30fd200640 1 --2- 172.21.15.90:0/1256299662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30f808c9c0 0x7f30f8074370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:49.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.211+0000 7f30fd200640 1 --2- 172.21.15.90:0/1256299662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30f80701d0 0x7f30f815c320 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:49.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.211+0000 7f30fd200640 1 -- 172.21.15.90:0/1256299662 >> 172.21.15.90:0/1256299662 conn(0x7f30f806ead0 msgr2=0x7f30f806eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:49.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.211+0000 7f30fd200640 1 -- 172.21.15.90:0/1256299662 shutdown_connections 2024-09-21T03:21:49.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.212+0000 7f30fd200640 1 -- 172.21.15.90:0/1256299662 wait complete. 2024-09-21T03:21:49.261 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-21T03:21:49.261 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-21T03:21:49.261 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-21T03:21:49.261 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:21:49.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.786+0000 7fede7e00640 1 -- 172.21.15.90:0/1224989532 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fede8156c30 msgr2=0x7fede81576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:49.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.786+0000 7fede7e00640 1 --2- 172.21.15.90:0/1224989532 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fede8156c30 0x7fede81576b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fede81512a0 tx=0x7fedd802a560 comp rx=0 tx=0).stop 2024-09-21T03:21:49.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.788+0000 7fede7e00640 1 -- 172.21.15.90:0/1224989532 shutdown_connections 2024-09-21T03:21:49.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.788+0000 7fede7e00640 1 --2- 172.21.15.90:0/1224989532 >> v2:172.21.15.90:3300/0 conn(0x7fede806fad0 0x7fede806fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:49.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.788+0000 7fede7e00640 1 --2- 172.21.15.90:0/1224989532 >> v2:172.21.15.149:3300/0 conn(0x7fede80c13d0 0x7fede80c17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:49.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.788+0000 7fede7e00640 1 --2- 172.21.15.90:0/1224989532 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fede8156c30 0x7fede81576b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:49.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.788+0000 7fede7e00640 1 -- 172.21.15.90:0/1224989532 >> 172.21.15.90:0/1224989532 conn(0x7fede806d570 msgr2=0x7fede80c7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:49.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.799+0000 7fede7e00640 1 -- 172.21.15.90:0/1224989532 shutdown_connections 2024-09-21T03:21:49.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.799+0000 7fede7e00640 1 -- 172.21.15.90:0/1224989532 wait complete. 2024-09-21T03:21:49.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.805+0000 7fede7e00640 1 Processor -- start 2024-09-21T03:21:49.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.806+0000 7fede7e00640 1 -- start start 2024-09-21T03:21:49.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.809+0000 7fede7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fede806fad0 0x7fede813b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:49.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.809+0000 7fede7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fede80c13d0 0x7fede80aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:49.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.810+0000 7fede6a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fede806fad0 0x7fede813b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:49.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.810+0000 7fede6a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fede806fad0 0x7fede813b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:49464/0 (socket says 172.21.15.90:49464) 2024-09-21T03:21:49.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.810+0000 7fede7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fede8156c30 0x7fede80ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:49.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.810+0000 7fede7e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fede8074470 con 0x7fede80c13d0 2024-09-21T03:21:49.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.810+0000 7fede7e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fede8074190 con 0x7fede8156c30 2024-09-21T03:21:49.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.810+0000 7fede7e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fede8073860 con 0x7fede806fad0 2024-09-21T03:21:49.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.810+0000 7fede6a00640 1 -- 172.21.15.90:0/931854271 learned_addr learned my addr 172.21.15.90:0/931854271 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:21:49.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.811+0000 7fede7400640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fede8156c30 0x7fede80ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:49.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.812+0000 7fede6a00640 1 -- 172.21.15.90:0/931854271 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fede8156c30 msgr2=0x7fede80ac0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:49.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.812+0000 7fede6a00640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fede8156c30 0x7fede80ac0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:49.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.812+0000 7fede6a00640 1 -- 172.21.15.90:0/931854271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fede80c13d0 msgr2=0x7fede80aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:49.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.812+0000 7fede6000640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fede80c13d0 0x7fede80aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:49.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.813+0000 7fede6a00640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fede80c13d0 0x7fede80aadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:49.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.813+0000 7fede6a00640 1 -- 172.21.15.90:0/931854271 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede81edcd0 con 0x7fede806fad0 2024-09-21T03:21:49.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.813+0000 7fede6000640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fede80c13d0 0x7fede80aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:21:49.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.815+0000 7fede6a00640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fede806fad0 0x7fede813b2c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fedd8034040 tx=0x7fedd8003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:49.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.817+0000 7feddea00640 1 -- 172.21.15.90:0/931854271 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd803e070 con 0x7fede806fad0 2024-09-21T03:21:49.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.818+0000 7feddea00640 1 -- 172.21.15.90:0/931854271 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedd8004a90 con 0x7fede806fad0 2024-09-21T03:21:49.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.818+0000 7feddea00640 1 -- 172.21.15.90:0/931854271 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd8035040 con 0x7fede806fad0 2024-09-21T03:21:49.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.820+0000 7fede7e00640 1 -- 172.21.15.90:0/931854271 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede81ed9f0 con 0x7fede806fad0 2024-09-21T03:21:49.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.821+0000 7fede7e00640 1 -- 172.21.15.90:0/931854271 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fede813e6d0 con 0x7fede806fad0 2024-09-21T03:21:49.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.824+0000 7fede7e00640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fede80ab310 0x7fede80ac5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:49.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.824+0000 7fede7e00640 1 -- 172.21.15.90:0/931854271 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fede813bc50 con 0x7fede80ab310 2024-09-21T03:21:49.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.826+0000 7feddea00640 1 -- 172.21.15.90:0/931854271 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fedd8041070 con 0x7fede806fad0 2024-09-21T03:21:49.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.828+0000 7feddea00640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fedc8078c60 0x7fedc807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:49.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.828+0000 7feddea00640 1 -- 172.21.15.90:0/931854271 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fedd80bbb30 con 0x7fede806fad0 2024-09-21T03:21:49.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.829+0000 7fede6000640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fede80ab310 0x7fede80ac5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:49.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.830+0000 7fede6000640 1 -- 172.21.15.90:0/931854271 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fede80c2350 con 0x7fede80ab310 2024-09-21T03:21:49.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.831+0000 7fede6000640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fede80ab310 0x7fede80ac5f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fede80ad520 tx=0x7fedd400deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:49.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.832+0000 7feddea00640 1 -- 172.21.15.90:0/931854271 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd4008d20 con 0x7fede80ab310 2024-09-21T03:21:49.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.832+0000 7feddea00640 1 -- 172.21.15.90:0/931854271 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fedd4004030 con 0x7fede80ab310 2024-09-21T03:21:49.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.832+0000 7feddea00640 1 -- 172.21.15.90:0/931854271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fede80ab310 msgr2=0x7fede80ac5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:49.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.833+0000 7feddea00640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fede80ab310 0x7fede80ac5f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fede80ad520 tx=0x7fedd400deb0 comp rx=0 tx=0).stop 2024-09-21T03:21:49.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.833+0000 7feddea00640 1 -- 172.21.15.90:0/931854271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fede80ab310 msgr2=0x7fede80ac5f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:21:49.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.833+0000 7feddea00640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fede80ab310 0x7fede80ac5f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:49.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.835+0000 7fede7400640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fedc8078c60 0x7fedc807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:49.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.836+0000 7fede7400640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fedc8078c60 0x7fedc807b170 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fede81eabd0 tx=0x7fede0009500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:49.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.856+0000 7fede7e00640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fede80acb30 0x7fede81f0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:49.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.857+0000 7fede7e00640 1 -- 172.21.15.90:0/931854271 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fede813f6a0 con 0x7fede80acb30 2024-09-21T03:21:49.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.857+0000 7fede6000640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fede80acb30 0x7fede81f0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:49.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.858+0000 7fede6000640 1 -- 172.21.15.90:0/931854271 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fede80710f0 con 0x7fede80acb30 2024-09-21T03:21:49.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.858+0000 7fede6000640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fede80acb30 0x7fede81f0300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fedd4017000 tx=0x7fedd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:49.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.860+0000 7feddea00640 1 -- 172.21.15.90:0/931854271 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd401dda0 con 0x7fede80acb30 2024-09-21T03:21:49.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.860+0000 7feddea00640 1 -- 172.21.15.90:0/931854271 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4719 (secure 0 0 0) 0x7fedd40035f0 con 0x7fede80acb30 2024-09-21T03:21:49.863 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:21:49.863 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:21:49.863 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:21:49.863 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:21:49.863 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 52, 2024-09-21T03:21:49.864 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 153633, 2024-09-21T03:21:49.864 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:21:49.864 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:21:49.864 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:21:49.864 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:21:49.864 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:49.864 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 17, 2024-09-21T03:21:49.864 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:21:49.864 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:21:49.864 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:21:49.864 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:49.864 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:49.864 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:49.864 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:49.865 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:49.865 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:49.865 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:49.865 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:49.865 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:49.865 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:49.865 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:49.865 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:49.865 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:21:49.865 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:21:49.865 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:49.865 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:49.865 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:49.865 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:49.865 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:49.866 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:49.866 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:49.866 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:49.866 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:49.866 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:49.866 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:49.866 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:49.866 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:49.866 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:21:49.866 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:21:49.866 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:21:49.866 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:21:49.866 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:21:49.866 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:21:49.867 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:21:49.867 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:21:49.867 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:21:49.867 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:21:49.867 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:21:49.867 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:21:49.867 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:21:49.867 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:21:49.867 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:21:49.867 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:21:49.867 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:21:49.867 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:49.867 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:49.867 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:49.867 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:49.868 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:49.868 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:49.868 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:49.868 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:49.868 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:49.868 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:49.868 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:49.868 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:49.868 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:21:49.868 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:49.868 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:21:49.868 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:49.868 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:21:49.868 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:21:49.869 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:49.869 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:49.869 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:49.869 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:49.869 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:21:49.869 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:49.869 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:49.869 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:49.869 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:49.869 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:21:49.869 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:49.869 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:49.869 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:49.869 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:49.869 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:49.871 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:49.871 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:49.871 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:21:49.871 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:49.871 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:49.871 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:49.871 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:49.871 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:21:49.871 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:21:49.871 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:49.871 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:49.871 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:49.871 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:49.871 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:49.872 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:21:49.872 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:21:49.872 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:49.872 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:49.872 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:49.872 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:49.872 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:21:49.872 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:49.872 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:49.872 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:49.872 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:49.872 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:21:49.872 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:49.872 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:49.872 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:49.873 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:49.873 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:21:49.873 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:21:49.873 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:49.873 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:49.873 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:49.873 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:49.873 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:49.873 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:49.873 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:21:49.873 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:21:49.873 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:49.873 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:49.873 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:49.874 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:21:49.874 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:49.874 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:49.874 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:21:49.874 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:49.874 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:49.874 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:49.874 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 3 2024-09-21T03:21:49.874 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:49.874 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:49.874 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:21:49.874 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:49.874 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:49.874 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:49.874 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:21:49.875 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:49.875 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:49.875 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:49.875 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:21:49.875 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:21:49.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.861+0000 7feddea00640 1 -- 172.21.15.90:0/931854271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fede80acb30 msgr2=0x7fede81f0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:49.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.861+0000 7feddea00640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fede80acb30 0x7fede81f0300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fedd4017000 tx=0x7fedd40046c0 comp rx=0 tx=0).stop 2024-09-21T03:21:49.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.862+0000 7feddea00640 1 -- 172.21.15.90:0/931854271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fede80acb30 msgr2=0x7fede81f0300 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:21:49.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.862+0000 7feddea00640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fede80acb30 0x7fede81f0300 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fedd4017000 tx=0x7fedd40046c0 comp rx=0 tx=0).stop 2024-09-21T03:21:49.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.863+0000 7fede7e00640 1 -- 172.21.15.90:0/931854271 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fedc8078c60 msgr2=0x7fedc807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:49.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.863+0000 7fede7e00640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fedc8078c60 0x7fedc807b170 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fede81eabd0 tx=0x7fede0009500 comp rx=0 tx=0).stop 2024-09-21T03:21:49.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.863+0000 7fede7e00640 1 -- 172.21.15.90:0/931854271 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fede806fad0 msgr2=0x7fede813b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:49.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.863+0000 7fede7e00640 1 --2- 172.21.15.90:0/931854271 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fede806fad0 0x7fede813b2c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fedd8034040 tx=0x7fedd8003b90 comp rx=0 tx=0).stop 2024-09-21T03:21:49.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.863+0000 7fede7400640 1 -- 172.21.15.90:0/931854271 reap_dead start 2024-09-21T03:21:49.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.863+0000 7fede7400640 1 -- 172.21.15.90:0/931854271 reap_dead start 2024-09-21T03:21:49.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.863+0000 7fede7e00640 1 -- 172.21.15.90:0/931854271 shutdown_connections 2024-09-21T03:21:49.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.863+0000 7fede7e00640 1 -- 172.21.15.90:0/931854271 >> 172.21.15.90:0/931854271 conn(0x7fede806d570 msgr2=0x7fede813ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:49.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.864+0000 7fede7e00640 1 -- 172.21.15.90:0/931854271 shutdown_connections 2024-09-21T03:21:49.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:49.864+0000 7fede7e00640 1 -- 172.21.15.90:0/931854271 wait complete. 2024-09-21T03:21:49.911 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:21:49.911 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-21T03:21:49.912 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:21:50.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.391+0000 7f7dca600640 1 -- 172.21.15.90:0/256009505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc415a3f0 msgr2=0x7f7dc415a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:50.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.391+0000 7f7dca600640 1 --2- 172.21.15.90:0/256009505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc415a3f0 0x7f7dc415a800 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40c3f80 tx=0x7f7dbc02a7e0 comp rx=0 tx=0).stop 2024-09-21T03:21:50.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.392+0000 7f7dca600640 1 -- 172.21.15.90:0/256009505 shutdown_connections 2024-09-21T03:21:50.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.392+0000 7f7dca600640 1 --2- 172.21.15.90:0/256009505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc415a3f0 0x7f7dc415a800 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:50.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.392+0000 7f7dca600640 1 --2- 172.21.15.90:0/256009505 >> v2:172.21.15.90:3300/0 conn(0x7f7dc4153cb0 0x7f7dc41540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:50.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.392+0000 7f7dca600640 1 -- 172.21.15.90:0/256009505 >> 172.21.15.90:0/256009505 conn(0x7f7dc40c81b0 msgr2=0x7f7dc40c85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:50.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.393+0000 7f7dca600640 1 -- 172.21.15.90:0/256009505 shutdown_connections 2024-09-21T03:21:50.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.393+0000 7f7dca600640 1 -- 172.21.15.90:0/256009505 wait complete. 2024-09-21T03:21:50.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.398+0000 7f7dca600640 1 Processor -- start 2024-09-21T03:21:50.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.400+0000 7f7dca600640 1 -- start start 2024-09-21T03:21:50.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.412+0000 7f7dca600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dc4073cb0 0x7f7dc40ab810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:50.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.414+0000 7f7dca600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7dc4153cb0 0x7f7dc41f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:50.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.414+0000 7f7dca600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc415a3f0 0x7f7dc41477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:50.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.415+0000 7f7dc2a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7dc4153cb0 0x7f7dc41f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:50.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.415+0000 7f7dc2a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7dc4153cb0 0x7f7dc41f1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:49480/0 (socket says 172.21.15.90:49480) 2024-09-21T03:21:50.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.414+0000 7f7dc3400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dc4073cb0 0x7f7dc40ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:50.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.417+0000 7f7dc3400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dc4073cb0 0x7f7dc40ab810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52918/0 (socket says 172.21.15.90:52918) 2024-09-21T03:21:50.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.417+0000 7f7dc2a00640 1 -- 172.21.15.90:0/4293475496 learned_addr learned my addr 172.21.15.90:0/4293475496 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:21:50.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.417+0000 7f7dca600640 1 -- 172.21.15.90:0/4293475496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc40c3c20 con 0x7f7dc4073cb0 2024-09-21T03:21:50.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.417+0000 7f7dca600640 1 -- 172.21.15.90:0/4293475496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc40c3aa0 con 0x7f7dc415a3f0 2024-09-21T03:21:50.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.417+0000 7f7dca600640 1 -- 172.21.15.90:0/4293475496 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7dc406e760 con 0x7f7dc4153cb0 2024-09-21T03:21:50.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.418+0000 7f7dc3e00640 1 --2- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc415a3f0 0x7f7dc41477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:50.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.423+0000 7f7dc3400640 1 -- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7dc4153cb0 msgr2=0x7f7dc41f1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:50.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.423+0000 7f7dc3400640 1 --2- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7dc4153cb0 0x7f7dc41f1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:50.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.423+0000 7f7dc3400640 1 -- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc415a3f0 msgr2=0x7f7dc41477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:50.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.423+0000 7f7dc3400640 1 --2- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc415a3f0 0x7f7dc41477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:50.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.423+0000 7f7dc3400640 1 -- 172.21.15.90:0/4293475496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc41483a0 con 0x7f7dc4073cb0 2024-09-21T03:21:50.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.424+0000 7f7dc3400640 1 --2- 172.21.15.90:0/4293475496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dc4073cb0 0x7f7dc40ab810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7db400e6b0 tx=0x7f7db400eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:50.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.425+0000 7f7dbb400640 1 -- 172.21.15.90:0/4293475496 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db400ca50 con 0x7f7dc4073cb0 2024-09-21T03:21:50.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.426+0000 7f7dca600640 1 -- 172.21.15.90:0/4293475496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc41f52a0 con 0x7f7dc4073cb0 2024-09-21T03:21:50.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.426+0000 7f7dca600640 1 -- 172.21.15.90:0/4293475496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc40ac140 con 0x7f7dc4073cb0 2024-09-21T03:21:50.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.428+0000 7f7dca600640 1 --2- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc4151ab0 0x7f7dc4151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:50.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.428+0000 7f7dca600640 1 -- 172.21.15.90:0/4293475496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc4148150 con 0x7f7dc4151ab0 2024-09-21T03:21:50.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.429+0000 7f7dbb400640 1 -- 172.21.15.90:0/4293475496 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7db400cce0 con 0x7f7dc4073cb0 2024-09-21T03:21:50.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.429+0000 7f7dbb400640 1 -- 172.21.15.90:0/4293475496 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db400ca50 con 0x7f7dc4073cb0 2024-09-21T03:21:50.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.433+0000 7f7dc2a00640 1 --2- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc4151ab0 0x7f7dc4151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:50.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.434+0000 7f7dc2a00640 1 -- 172.21.15.90:0/4293475496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7dc41540c0 con 0x7f7dc4151ab0 2024-09-21T03:21:50.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.438+0000 7f7dbb400640 1 -- 172.21.15.90:0/4293475496 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7db4011470 con 0x7f7dc4073cb0 2024-09-21T03:21:50.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.439+0000 7f7dbb400640 1 --2- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7da4078d90 0x7f7da407b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:50.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.439+0000 7f7dbb400640 1 -- 172.21.15.90:0/4293475496 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f7db409b480 con 0x7f7dc4073cb0 2024-09-21T03:21:50.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.446+0000 7f7dc2a00640 1 --2- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc4151ab0 0x7f7dc4151ec0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7db000f770 tx=0x7f7db000fc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:50.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.448+0000 7f7dbb400640 1 -- 172.21.15.90:0/4293475496 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db000fe80 con 0x7f7dc4151ab0 2024-09-21T03:21:50.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.448+0000 7f7dbb400640 1 -- 172.21.15.90:0/4293475496 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7db00052e0 con 0x7f7dc4151ab0 2024-09-21T03:21:50.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.448+0000 7f7dbb400640 1 -- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc4151ab0 msgr2=0x7f7dc4151ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:50.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.448+0000 7f7dbb400640 1 --2- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc4151ab0 0x7f7dc4151ec0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7db000f770 tx=0x7f7db000fc30 comp rx=0 tx=0).stop 2024-09-21T03:21:50.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.448+0000 7f7dbb400640 1 -- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc4151ab0 msgr2=0x7f7dc4151ec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:21:50.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.448+0000 7f7dbb400640 1 --2- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc4151ab0 0x7f7dc4151ec0 secure :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7db000f770 tx=0x7f7db000fc30 comp rx=0 tx=0).stop 2024-09-21T03:21:50.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.451+0000 7f7dc3e00640 1 --2- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7da4078d90 0x7f7da407b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:50.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.458+0000 7f7dc3e00640 1 --2- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7da4078d90 0x7f7da407b2a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc033000 tx=0x7f7dbc004ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:50.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.505+0000 7f7dca600640 1 --2- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc4155ae0 0x7f7dc4155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:50.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.505+0000 7f7dca600640 1 -- 172.21.15.90:0/4293475496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc40c4280 con 0x7f7dc4155ae0 2024-09-21T03:21:50.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.506+0000 7f7dc2a00640 1 --2- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc4155ae0 0x7f7dc4155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:50.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.508+0000 7f7dc2a00640 1 -- 172.21.15.90:0/4293475496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7dc4076f00 con 0x7f7dc4155ae0 2024-09-21T03:21:50.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.509+0000 7f7dc2a00640 1 --2- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc4155ae0 0x7f7dc4155ef0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7db000f770 tx=0x7f7db0000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:50.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.509+0000 7f7dbb400640 1 -- 172.21.15.90:0/4293475496 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db000fe80 con 0x7f7dc4155ae0 2024-09-21T03:21:50.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.510+0000 7f7dbb400640 1 -- 172.21.15.90:0/4293475496 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5194 (secure 0 0 0) 0x7f7db000fe80 con 0x7f7dc4155ae0 2024-09-21T03:21:50.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.510+0000 7f7dbb400640 1 -- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc4155ae0 msgr2=0x7f7dc4155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:50.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.510+0000 7f7dbb400640 1 --2- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc4155ae0 0x7f7dc4155ef0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7db000f770 tx=0x7f7db0000ed0 comp rx=0 tx=0).stop 2024-09-21T03:21:50.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.510+0000 7f7dbb400640 1 -- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc4155ae0 msgr2=0x7f7dc4155ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:21:50.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.510+0000 7f7dbb400640 1 --2- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dc4155ae0 0x7f7dc4155ef0 secure :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7db000f770 tx=0x7f7db0000ed0 comp rx=0 tx=0).stop 2024-09-21T03:21:50.513 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:21:50.513 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:21:50.513 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:21:50.514 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:21:50.514 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 52, 2024-09-21T03:21:50.514 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 461299, 2024-09-21T03:21:50.514 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:21:50.514 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:21:50.514 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:21:50.514 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:21:50.514 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:50.514 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 18, 2024-09-21T03:21:50.514 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:21:50.514 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:21:50.514 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:21:50.514 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:50.515 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:50.515 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:50.515 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:50.515 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:50.515 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:50.515 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:50.515 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:50.515 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:50.515 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:50.515 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:50.515 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:50.515 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:21:50.515 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:21:50.515 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:50.515 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:50.516 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:50.516 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:50.516 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:50.516 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:50.516 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:50.516 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:50.516 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:50.516 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:50.516 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:50.516 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:50.516 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:50.516 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:21:50.516 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:21:50.516 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:21:50.516 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:21:50.517 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:21:50.517 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:21:50.517 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:21:50.517 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:21:50.517 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:21:50.517 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:21:50.517 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:21:50.517 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:21:50.517 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:21:50.517 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:21:50.517 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:21:50.517 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:21:50.517 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:21:50.517 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:50.517 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:50.518 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:50.518 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:50.518 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:50.518 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:50.518 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:50.518 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:50.518 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:50.518 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:50.518 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:50.518 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:50.518 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:21:50.518 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:50.518 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:21:50.518 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:50.518 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:21:50.519 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:21:50.519 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:50.519 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:50.519 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:50.519 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:50.519 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:21:50.519 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:50.519 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:50.519 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:50.519 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:50.519 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:21:50.519 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:50.519 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:50.520 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:50.520 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:50.520 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:21:50.520 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:21:50.520 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:50.520 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:50.520 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:50.520 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:50.520 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:50.520 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:21:50.520 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:21:50.520 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:50.520 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:50.520 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:50.521 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:50.521 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:21:50.521 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:50.521 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:50.521 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:50.521 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:50.521 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:21:50.521 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:50.521 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:50.521 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:50.521 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:50.521 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:21:50.521 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:21:50.521 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:50.521 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:50.522 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:50.522 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:50.522 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:50.522 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:21:50.522 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:21:50.522 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:50.522 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:50.522 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:50.522 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:50.522 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:21:50.522 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:50.522 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:50.522 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:50.522 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:50.523 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:21:50.523 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:50.523 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:50.523 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:50.523 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:50.523 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:21:50.523 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:21:50.523 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:50.523 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:50.523 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:50.523 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:50.523 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:50.523 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:50.523 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:21:50.524 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:21:50.524 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:50.524 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:50.524 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:50.524 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:21:50.524 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:50.524 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:50.524 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:21:50.524 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:50.524 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:50.524 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:50.524 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:21:50.524 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:50.524 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:50.524 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:21:50.525 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:50.525 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:50.525 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:50.525 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5 2024-09-21T03:21:50.525 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:50.525 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:50.525 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:21:50.525 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:50.525 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:21:50.525 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:21:50.525 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:21:50.525 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:50.525 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:50.525 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:50.525 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:50.525 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:21:50.526 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:50.526 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:50.526 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:21:50.526 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:50.526 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:50.526 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:50.526 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:21:50.526 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:50.526 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:50.526 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:50.526 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:21:50.526 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:21:50.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.511+0000 7f7dca600640 1 -- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7da4078d90 msgr2=0x7f7da407b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:50.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.511+0000 7f7dca600640 1 --2- 172.21.15.90:0/4293475496 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7da4078d90 0x7f7da407b2a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc033000 tx=0x7f7dbc004ab0 comp rx=0 tx=0).stop 2024-09-21T03:21:50.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.511+0000 7f7dca600640 1 -- 172.21.15.90:0/4293475496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dc4073cb0 msgr2=0x7f7dc40ab810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:50.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.511+0000 7f7dca600640 1 --2- 172.21.15.90:0/4293475496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dc4073cb0 0x7f7dc40ab810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7db400e6b0 tx=0x7f7db400eb70 comp rx=0 tx=0).stop 2024-09-21T03:21:50.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.512+0000 7f7dc3e00640 1 -- 172.21.15.90:0/4293475496 reap_dead start 2024-09-21T03:21:50.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.512+0000 7f7dc3e00640 1 -- 172.21.15.90:0/4293475496 reap_dead start 2024-09-21T03:21:50.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.512+0000 7f7dca600640 1 -- 172.21.15.90:0/4293475496 shutdown_connections 2024-09-21T03:21:50.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.512+0000 7f7dca600640 1 -- 172.21.15.90:0/4293475496 >> 172.21.15.90:0/4293475496 conn(0x7f7dc40c81b0 msgr2=0x7f7dc40767f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:50.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.516+0000 7f7dca600640 1 -- 172.21.15.90:0/4293475496 shutdown_connections 2024-09-21T03:21:50.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:50.516+0000 7f7dca600640 1 -- 172.21.15.90:0/4293475496 wait complete. 2024-09-21T03:21:50.596 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:21:50.596 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-21T03:21:50.596 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:21:51.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.084+0000 7fd53a000640 1 -- 172.21.15.90:0/1815385458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd53415abf0 msgr2=0x7fd534161630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:51.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.084+0000 7fd53a000640 1 --2- 172.21.15.90:0/1815385458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd53415abf0 0x7fd534161630 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd520005fd0 tx=0x7fd52002a4b0 comp rx=0 tx=0).stop 2024-09-21T03:21:51.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.084+0000 7fd53a000640 1 -- 172.21.15.90:0/1815385458 shutdown_connections 2024-09-21T03:21:51.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.084+0000 7fd53a000640 1 --2- 172.21.15.90:0/1815385458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd53415abf0 0x7fd534161630 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:51.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.084+0000 7fd53a000640 1 --2- 172.21.15.90:0/1815385458 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd534154700 0x7fd5340ade10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:51.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.084+0000 7fd53a000640 1 -- 172.21.15.90:0/1815385458 >> 172.21.15.90:0/1815385458 conn(0x7fd5340ccc30 msgr2=0x7fd5340c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:51.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.086+0000 7fd53a000640 1 -- 172.21.15.90:0/1815385458 shutdown_connections 2024-09-21T03:21:51.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.086+0000 7fd53a000640 1 -- 172.21.15.90:0/1815385458 wait complete. 2024-09-21T03:21:51.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.093+0000 7fd53a000640 1 Processor -- start 2024-09-21T03:21:51.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.094+0000 7fd53a000640 1 -- start start 2024-09-21T03:21:51.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.097+0000 7fd53a000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5340ae350 0x7fd53414b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:51.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.097+0000 7fd53a000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd53415abf0 0x7fd53414fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:51.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.097+0000 7fd53a000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5341f2260 0x7fd534149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:51.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.098+0000 7fd53a000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd5340cb340 con 0x7fd5340ae350 2024-09-21T03:21:51.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.098+0000 7fd53a000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd5340c7990 con 0x7fd53415abf0 2024-09-21T03:21:51.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.098+0000 7fd53a000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd5340c7300 con 0x7fd5341f2260 2024-09-21T03:21:51.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.098+0000 7fd533e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5341f2260 0x7fd534149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:51.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.098+0000 7fd533e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5341f2260 0x7fd534149ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:49510/0 (socket says 172.21.15.90:49510) 2024-09-21T03:21:51.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.098+0000 7fd533e00640 1 -- 172.21.15.90:0/1264029106 learned_addr learned my addr 172.21.15.90:0/1264029106 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:21:51.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.099+0000 7fd532a00640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd53415abf0 0x7fd53414fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:51.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.099+0000 7fd533400640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5340ae350 0x7fd53414b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:51.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.099+0000 7fd533e00640 1 -- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd53415abf0 msgr2=0x7fd53414fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:51.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.099+0000 7fd533e00640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd53415abf0 0x7fd53414fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:51.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.099+0000 7fd533e00640 1 -- 172.21.15.90:0/1264029106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5340ae350 msgr2=0x7fd53414b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:51.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.099+0000 7fd533e00640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5340ae350 0x7fd53414b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:51.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.100+0000 7fd533e00640 1 -- 172.21.15.90:0/1264029106 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5340adc80 con 0x7fd5341f2260 2024-09-21T03:21:51.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.100+0000 7fd533400640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5340ae350 0x7fd53414b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:51.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.100+0000 7fd533e00640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5341f2260 0x7fd534149ae0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd520006010 tx=0x7fd520003890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:51.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.102+0000 7fd52b400640 1 -- 172.21.15.90:0/1264029106 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52003e030 con 0x7fd5341f2260 2024-09-21T03:21:51.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.103+0000 7fd52b400640 1 -- 172.21.15.90:0/1264029106 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd520003d80 con 0x7fd5341f2260 2024-09-21T03:21:51.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.103+0000 7fd52b400640 1 -- 172.21.15.90:0/1264029106 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520035040 con 0x7fd5341f2260 2024-09-21T03:21:51.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.103+0000 7fd53a000640 1 -- 172.21.15.90:0/1264029106 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5340ad4c0 con 0x7fd5341f2260 2024-09-21T03:21:51.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.107+0000 7fd52b400640 1 -- 172.21.15.90:0/1264029106 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd520041030 con 0x7fd5341f2260 2024-09-21T03:21:51.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.108+0000 7fd53a000640 1 -- 172.21.15.90:0/1264029106 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd534150620 con 0x7fd5341f2260 2024-09-21T03:21:51.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.110+0000 7fd52b400640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd514078c10 0x7fd51407b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:51.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.111+0000 7fd533400640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd514078c10 0x7fd51407b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:51.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.111+0000 7fd52b400640 1 -- 172.21.15.90:0/1264029106 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fd52007ed30 con 0x7fd5341f2260 2024-09-21T03:21:51.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.113+0000 7fd53a000640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd53414a020 0x7fd53414a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:51.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.113+0000 7fd53a000640 1 -- 172.21.15.90:0/1264029106 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd5340ad690 con 0x7fd53414a020 2024-09-21T03:21:51.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.114+0000 7fd532a00640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd53414a020 0x7fd53414a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:51.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.114+0000 7fd533400640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd514078c10 0x7fd51407b120 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd524005fd0 tx=0x7fd52400f360 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:51.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.115+0000 7fd532a00640 1 -- 172.21.15.90:0/1264029106 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5340cc030 con 0x7fd53414a020 2024-09-21T03:21:51.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.118+0000 7fd532a00640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd53414a020 0x7fd53414a430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd5341f5c60 tx=0x7fd52c007680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:51.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.119+0000 7fd52b400640 1 -- 172.21.15.90:0/1264029106 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52c01a070 con 0x7fd53414a020 2024-09-21T03:21:51.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.119+0000 7fd52b400640 1 -- 172.21.15.90:0/1264029106 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd52c007e10 con 0x7fd53414a020 2024-09-21T03:21:51.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.119+0000 7fd52b400640 1 -- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd53414a020 msgr2=0x7fd53414a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:51.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.119+0000 7fd52b400640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd53414a020 0x7fd53414a430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd5341f5c60 tx=0x7fd52c007680 comp rx=0 tx=0).stop 2024-09-21T03:21:51.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.119+0000 7fd52b400640 1 -- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd53414a020 msgr2=0x7fd53414a430 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:21:51.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.119+0000 7fd52b400640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd53414a020 0x7fd53414a430 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd5341f5c60 tx=0x7fd52c007680 comp rx=0 tx=0).stop 2024-09-21T03:21:51.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.140+0000 7fd53a000640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5341f4b50 0x7fd5341f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:51.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.142+0000 7fd532a00640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5341f4b50 0x7fd5341f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:51.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.142+0000 7fd53a000640 1 -- 172.21.15.90:0/1264029106 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd5341e06a0 con 0x7fd5341f4b50 2024-09-21T03:21:51.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.144+0000 7fd532a00640 1 -- 172.21.15.90:0/1264029106 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd534155370 con 0x7fd5341f4b50 2024-09-21T03:21:51.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.145+0000 7fd532a00640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5341f4b50 0x7fd5341f4f60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd52c017000 tx=0x7fd52c004a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:51.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.146+0000 7fd52b400640 1 -- 172.21.15.90:0/1264029106 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52c01a040 con 0x7fd5341f4b50 2024-09-21T03:21:51.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.146+0000 7fd52b400640 1 -- 172.21.15.90:0/1264029106 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4549 (secure 0 0 0) 0x7fd52c0156d0 con 0x7fd5341f4b50 2024-09-21T03:21:51.149 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:21:51.149 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:21:51.149 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:21:51.149 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:21:51.149 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 52, 2024-09-21T03:21:51.149 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 21467, 2024-09-21T03:21:51.149 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:21:51.149 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:21:51.149 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:21:51.149 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:21:51.149 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:51.150 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 18, 2024-09-21T03:21:51.150 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:21:51.150 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:21:51.150 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:21:51.150 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:51.150 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:51.150 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:51.150 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:51.150 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:51.150 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:51.150 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:51.150 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:51.150 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:51.150 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:51.151 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:51.151 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:51.151 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:21:51.151 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:21:51.151 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:51.151 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:51.151 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:51.151 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:51.151 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:51.151 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:51.151 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:51.151 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:51.151 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:51.151 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:51.151 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:51.152 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:51.152 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:51.152 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:21:51.152 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:21:51.152 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:21:51.152 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:21:51.152 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:21:51.152 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:21:51.152 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:21:51.152 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:21:51.152 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:21:51.152 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:21:51.152 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:21:51.152 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:21:51.152 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:21:51.153 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:21:51.153 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:21:51.153 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:21:51.153 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:21:51.153 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:21:51.153 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:21:51.153 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:21:51.153 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:21:51.153 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:21:51.153 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:21:51.153 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:21:51.153 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:21:51.153 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:21:51.153 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:21:51.153 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:21:51.154 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:51.154 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:21:51.154 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:51.154 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:21:51.154 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:51.154 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:21:51.154 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:21:51.154 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:51.154 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:51.154 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:51.154 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:51.154 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:21:51.154 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:51.154 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:51.155 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:51.155 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:51.155 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:21:51.155 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:51.155 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:51.155 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:51.155 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:51.155 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:21:51.155 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:21:51.155 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:51.155 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:51.155 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:51.155 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:51.155 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:51.155 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:21:51.156 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:21:51.156 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:51.156 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:51.156 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:51.156 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:51.156 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:21:51.156 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:51.156 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:51.156 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:51.156 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:51.156 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:21:51.156 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:51.156 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:51.156 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:51.157 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:51.157 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:21:51.157 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:21:51.157 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:51.157 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:51.157 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:51.157 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:51.157 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:51.157 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:21:51.157 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:21:51.157 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:21:51.157 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:21:51.157 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:51.157 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:21:51.158 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:21:51.158 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:51.158 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:51.158 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:51.158 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:21:51.158 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:21:51.158 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:21:51.158 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:51.158 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:51.158 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:51.158 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:21:51.158 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:21:51.158 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:21:51.158 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:21:51.159 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:21:51.159 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:51.159 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:51.159 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:51.159 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:21:51.159 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:21:51.159 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:51.159 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:51.159 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:51.159 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:21:51.159 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:51.159 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:21:51.159 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:21:51.160 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:21:51.160 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:21:51.160 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:21:51.160 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:21:51.160 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:21:51.160 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:21:51.160 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:21:51.160 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:21:51.160 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:21:51.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.147+0000 7fd52b400640 1 -- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5341f4b50 msgr2=0x7fd5341f4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:51.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.147+0000 7fd52b400640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5341f4b50 0x7fd5341f4f60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd52c017000 tx=0x7fd52c004a30 comp rx=0 tx=0).stop 2024-09-21T03:21:51.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.147+0000 7fd52b400640 1 -- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5341f4b50 msgr2=0x7fd5341f4f60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:21:51.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.147+0000 7fd52b400640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5341f4b50 0x7fd5341f4f60 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd52c017000 tx=0x7fd52c004a30 comp rx=0 tx=0).stop 2024-09-21T03:21:51.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.149+0000 7fd53a000640 1 -- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd514078c10 msgr2=0x7fd51407b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:51.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.149+0000 7fd53a000640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd514078c10 0x7fd51407b120 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd524005fd0 tx=0x7fd52400f360 comp rx=0 tx=0).stop 2024-09-21T03:21:51.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.149+0000 7fd53a000640 1 -- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5341f2260 msgr2=0x7fd534149ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:51.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.149+0000 7fd53a000640 1 --2- 172.21.15.90:0/1264029106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5341f2260 0x7fd534149ae0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd520006010 tx=0x7fd520003890 comp rx=0 tx=0).stop 2024-09-21T03:21:51.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.149+0000 7fd533e00640 1 -- 172.21.15.90:0/1264029106 reap_dead start 2024-09-21T03:21:51.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.150+0000 7fd533e00640 1 -- 172.21.15.90:0/1264029106 reap_dead start 2024-09-21T03:21:51.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.150+0000 7fd53a000640 1 -- 172.21.15.90:0/1264029106 shutdown_connections 2024-09-21T03:21:51.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.150+0000 7fd53a000640 1 -- 172.21.15.90:0/1264029106 >> 172.21.15.90:0/1264029106 conn(0x7fd5340ccc30 msgr2=0x7fd534151fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:51.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.150+0000 7fd53a000640 1 -- 172.21.15.90:0/1264029106 shutdown_connections 2024-09-21T03:21:51.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.151+0000 7fd53a000640 1 -- 172.21.15.90:0/1264029106 wait complete. 2024-09-21T03:21:51.212 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:21:51.212 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-21T03:21:51.213 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-21T03:21:51.213 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-21T03:21:51.213 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-21T03:21:51.213 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-21T03:21:51.213 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:21:51.280 INFO:tasks.ceph.mon.b:Stopped 2024-09-21T03:21:51.280 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-21T03:21:51.280 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:21:51.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.807+0000 7f85c4600640 1 -- 172.21.15.90:0/1067860328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85b4006720 msgr2=0x7f85b40d2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:51.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.807+0000 7f85c4600640 1 --2- 172.21.15.90:0/1067860328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85b4006720 0x7f85b40d2cf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f85b400c640 tx=0x7f85b002a560 comp rx=0 tx=0).stop 2024-09-21T03:21:51.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.808+0000 7f85c4600640 1 -- 172.21.15.90:0/1067860328 shutdown_connections 2024-09-21T03:21:51.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.808+0000 7f85c4600640 1 --2- 172.21.15.90:0/1067860328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85b4006720 0x7f85b40d2cf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:51.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.808+0000 7f85c4600640 1 --2- 172.21.15.90:0/1067860328 >> v2:172.21.15.149:3300/0 conn(0x7f85b4005dd0 0x7f85b40061e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:51.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.808+0000 7f85c4600640 1 -- 172.21.15.90:0/1067860328 >> 172.21.15.90:0/1067860328 conn(0x7f85b4048450 msgr2=0x7f85b4048860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:51.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.808+0000 7f85c4600640 1 -- 172.21.15.90:0/1067860328 shutdown_connections 2024-09-21T03:21:51.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.809+0000 7f85c4600640 1 -- 172.21.15.90:0/1067860328 wait complete. 2024-09-21T03:21:51.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.813+0000 7f85c4600640 1 Processor -- start 2024-09-21T03:21:51.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.813+0000 7f85c4600640 1 -- start start 2024-09-21T03:21:51.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.816+0000 7f85c4600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85b4005dd0 0x7f85b41754f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:51.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.816+0000 7f85c4600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85b4006720 0x7f85b40d6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:51.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.816+0000 7f85c4600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85b404ad60 0x7f85b40300d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:51.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.816+0000 7f85c4600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85b400b650 con 0x7f85b4005dd0 2024-09-21T03:21:51.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.816+0000 7f85c4600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f85b40d7d50 con 0x7f85b404ad60 2024-09-21T03:21:51.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.816+0000 7f85c4600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f85b40469d0 con 0x7f85b4006720 2024-09-21T03:21:51.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.818+0000 7f85c1200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85b4006720 0x7f85b40d6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:51.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.818+0000 7f85c1c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85b4005dd0 0x7f85b41754f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:51.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.818+0000 7f85c3000640 1 -- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85b404ad60 msgr2=0x7f85b40300d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3300/0 2024-09-21T03:21:51.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.818+0000 7f85c3000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85b404ad60 0x7f85b40300d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:21:51.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.818+0000 7f85c1c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85b4005dd0 0x7f85b41754f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53014/0 (socket says 172.21.15.90:53014) 2024-09-21T03:21:51.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.818+0000 7f85c1c00640 1 -- 172.21.15.90:0/3573631683 learned_addr learned my addr 172.21.15.90:0/3573631683 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:21:51.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.820+0000 7f85c1c00640 1 -- 172.21.15.90:0/3573631683 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85b4006720 msgr2=0x7f85b40d6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:51.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.820+0000 7f85c1c00640 1 --2- 172.21.15.90:0/3573631683 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85b4006720 0x7f85b40d6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:51.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.820+0000 7f85c1c00640 1 -- 172.21.15.90:0/3573631683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85b404ad60 msgr2=0x7f85b40300d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:21:51.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.820+0000 7f85c1c00640 1 --2- 172.21.15.90:0/3573631683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85b404ad60 0x7f85b40300d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:51.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.820+0000 7f85c1c00640 1 -- 172.21.15.90:0/3573631683 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b403ec50 con 0x7f85b4005dd0 2024-09-21T03:21:51.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.821+0000 7f85c1200640 1 --2- 172.21.15.90:0/3573631683 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85b4006720 0x7f85b40d6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:51.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.821+0000 7f85c1c00640 1 --2- 172.21.15.90:0/3573631683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85b4005dd0 0x7f85b41754f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f85bc075920 tx=0x7f85bc0767a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:51.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.822+0000 7f85b9600640 1 -- 172.21.15.90:0/3573631683 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc090070 con 0x7f85b4005dd0 2024-09-21T03:21:51.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.822+0000 7f85b9600640 1 -- 172.21.15.90:0/3573631683 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85bc0751c0 con 0x7f85b4005dd0 2024-09-21T03:21:51.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.822+0000 7f85b9600640 1 -- 172.21.15.90:0/3573631683 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc090070 con 0x7f85b4005dd0 2024-09-21T03:21:51.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.824+0000 7f85c4600640 1 -- 172.21.15.90:0/3573631683 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b40d3d90 con 0x7f85b4005dd0 2024-09-21T03:21:51.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.824+0000 7f85c4600640 1 -- 172.21.15.90:0/3573631683 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b4174a10 con 0x7f85b4005dd0 2024-09-21T03:21:51.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.830+0000 7f85aea00640 1 -- 172.21.15.90:0/3573631683 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85b40d5ea0 con 0x7f85b4005dd0 2024-09-21T03:21:51.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.830+0000 7f85b9600640 1 -- 172.21.15.90:0/3573631683 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f85bc095450 con 0x7f85b4005dd0 2024-09-21T03:21:51.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.832+0000 7f85b9600640 1 --2- 172.21.15.90:0/3573631683 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f859c078d70 0x7f859c07b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:51.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.832+0000 7f85b9600640 1 -- 172.21.15.90:0/3573631683 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f85bc116ae0 con 0x7f85b4005dd0 2024-09-21T03:21:51.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.837+0000 7f85c1200640 1 --2- 172.21.15.90:0/3573631683 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f859c078d70 0x7f859c07b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:51.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.839+0000 7f85c1200640 1 --2- 172.21.15.90:0/3573631683 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f859c078d70 0x7f859c07b280 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f85b40d9d30 tx=0x7f85a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:51.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:51.845+0000 7f85b9600640 1 -- 172.21.15.90:0/3573631683 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f85bc09a020 con 0x7f85b4005dd0 2024-09-21T03:21:52.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:52.447+0000 7f85aea00640 1 -- 172.21.15.90:0/3573631683 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f85b40d1020 con 0x7f85b4005dd0 2024-09-21T03:21:52.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:52.448+0000 7f85b9600640 1 -- 172.21.15.90:0/3573631683 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f85bc091260 con 0x7f85b4005dd0 2024-09-21T03:21:52.450 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:21:52.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:52.453+0000 7f85aea00640 1 -- 172.21.15.90:0/3573631683 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f859c078d70 msgr2=0x7f859c07b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:52.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:52.453+0000 7f85aea00640 1 --2- 172.21.15.90:0/3573631683 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f859c078d70 0x7f859c07b280 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f85b40d9d30 tx=0x7f85a8008040 comp rx=0 tx=0).stop 2024-09-21T03:21:52.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:52.453+0000 7f85aea00640 1 -- 172.21.15.90:0/3573631683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85b4005dd0 msgr2=0x7f85b41754f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:52.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:52.453+0000 7f85aea00640 1 --2- 172.21.15.90:0/3573631683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85b4005dd0 0x7f85b41754f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f85bc075920 tx=0x7f85bc0767a0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:52.453+0000 7f85aea00640 1 -- 172.21.15.90:0/3573631683 shutdown_connections 2024-09-21T03:21:52.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:52.453+0000 7f85aea00640 1 --2- 172.21.15.90:0/3573631683 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f859c078d70 0x7f859c07b280 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:52.453+0000 7f85aea00640 1 --2- 172.21.15.90:0/3573631683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85b404ad60 0x7f85b40300d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:52.453+0000 7f85aea00640 1 --2- 172.21.15.90:0/3573631683 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85b4006720 0x7f85b40d6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:52.453+0000 7f85aea00640 1 --2- 172.21.15.90:0/3573631683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85b4005dd0 0x7f85b41754f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:52.453+0000 7f85aea00640 1 -- 172.21.15.90:0/3573631683 >> 172.21.15.90:0/3573631683 conn(0x7f85b4048450 msgr2=0x7f85b40ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:52.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:52.454+0000 7f85aea00640 1 -- 172.21.15.90:0/3573631683 shutdown_connections 2024-09-21T03:21:52.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:52.454+0000 7f85aea00640 1 -- 172.21.15.90:0/3573631683 wait complete. 2024-09-21T03:21:55.509 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:21:56.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.011+0000 7f24f2800640 1 -- 172.21.15.90:0/629744121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24e4049740 msgr2=0x7f24e4046940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:56.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.011+0000 7f24f2800640 1 --2- 172.21.15.90:0/629744121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24e4049740 0x7f24e4046940 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f24e4007680 tx=0x7f24d802b620 comp rx=0 tx=0).stop 2024-09-21T03:21:56.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.012+0000 7f24f2800640 1 -- 172.21.15.90:0/629744121 shutdown_connections 2024-09-21T03:21:56.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.013+0000 7f24f2800640 1 --2- 172.21.15.90:0/629744121 >> v2:172.21.15.149:3300/0 conn(0x7f24e402dbd0 0x7f24e40d99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.013+0000 7f24f2800640 1 --2- 172.21.15.90:0/629744121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24e4049740 0x7f24e4046940 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.013+0000 7f24f2800640 1 -- 172.21.15.90:0/629744121 >> 172.21.15.90:0/629744121 conn(0x7f24e4048650 msgr2=0x7f24e402ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:56.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.014+0000 7f24f2800640 1 -- 172.21.15.90:0/629744121 shutdown_connections 2024-09-21T03:21:56.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.014+0000 7f24f2800640 1 -- 172.21.15.90:0/629744121 wait complete. 2024-09-21T03:21:56.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.021+0000 7f24f2800640 1 Processor -- start 2024-09-21T03:21:56.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.021+0000 7f24f2800640 1 -- start start 2024-09-21T03:21:56.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.026+0000 7f24f2800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24e402d7c0 0x7f24e40cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:56.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.026+0000 7f24f2800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24e402dbd0 0x7f24e40c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:56.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.027+0000 7f24f2800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e4049740 0x7f24e4170970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:56.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.027+0000 7f24f2800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f24e400ba60 con 0x7f24e402dbd0 2024-09-21T03:21:56.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.027+0000 7f24f2800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f24e400b8e0 con 0x7f24e4049740 2024-09-21T03:21:56.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.027+0000 7f24f2800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f24e40d9f00 con 0x7f24e402d7c0 2024-09-21T03:21:56.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.029+0000 7f24f1e00640 1 -- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e4049740 msgr2=0x7f24e4170970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3300/0 2024-09-21T03:21:56.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.030+0000 7f24f1e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e4049740 0x7f24e4170970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:21:56.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.029+0000 7f24f0a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24e402dbd0 0x7f24e40c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:56.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.030+0000 7f24f0a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24e402dbd0 0x7f24e40c9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34042/0 (socket says 172.21.15.90:34042) 2024-09-21T03:21:56.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.030+0000 7f24f0a00640 1 -- 172.21.15.90:0/1868651107 learned_addr learned my addr 172.21.15.90:0/1868651107 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:21:56.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.031+0000 7f24f0a00640 1 -- 172.21.15.90:0/1868651107 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24e402d7c0 msgr2=0x7f24e40cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:56.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.031+0000 7f24f0a00640 1 --2- 172.21.15.90:0/1868651107 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24e402d7c0 0x7f24e40cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.031+0000 7f24f0a00640 1 -- 172.21.15.90:0/1868651107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e4049740 msgr2=0x7f24e4170970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:21:56.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.031+0000 7f24f0a00640 1 --2- 172.21.15.90:0/1868651107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e4049740 0x7f24e4170970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.031+0000 7f24f0a00640 1 -- 172.21.15.90:0/1868651107 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e40ca830 con 0x7f24e402dbd0 2024-09-21T03:21:56.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.032+0000 7f24f0a00640 1 --2- 172.21.15.90:0/1868651107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24e402dbd0 0x7f24e40c9320 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f24e000c760 tx=0x7f24e000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:56.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.033+0000 7f24e9600640 1 -- 172.21.15.90:0/1868651107 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e00050d0 con 0x7f24e402dbd0 2024-09-21T03:21:56.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.033+0000 7f24e9600640 1 -- 172.21.15.90:0/1868651107 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24e0005270 con 0x7f24e402dbd0 2024-09-21T03:21:56.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.033+0000 7f24e9600640 1 -- 172.21.15.90:0/1868651107 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e000a640 con 0x7f24e402dbd0 2024-09-21T03:21:56.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.034+0000 7f24f2800640 1 -- 172.21.15.90:0/1868651107 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e40ca550 con 0x7f24e402dbd0 2024-09-21T03:21:56.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.039+0000 7f24f2800640 1 -- 172.21.15.90:0/1868651107 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e40c8e00 con 0x7f24e402dbd0 2024-09-21T03:21:56.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.044+0000 7f24e9600640 1 -- 172.21.15.90:0/1868651107 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f24e000a7e0 con 0x7f24e402dbd0 2024-09-21T03:21:56.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.045+0000 7f24f2800640 1 -- 172.21.15.90:0/1868651107 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e40da410 con 0x7f24e402dbd0 2024-09-21T03:21:56.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.046+0000 7f24e9600640 1 --2- 172.21.15.90:0/1868651107 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f24cc078b90 0x7f24cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:56.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.049+0000 7f24e9600640 1 -- 172.21.15.90:0/1868651107 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f24e0098560 con 0x7f24e402dbd0 2024-09-21T03:21:56.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.049+0000 7f24f1400640 1 --2- 172.21.15.90:0/1868651107 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f24cc078b90 0x7f24cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:56.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.051+0000 7f24f1400640 1 --2- 172.21.15.90:0/1868651107 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f24cc078b90 0x7f24cc07b0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f24d8034000 tx=0x7f24d80046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:56.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.065+0000 7f24e9600640 1 -- 172.21.15.90:0/1868651107 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f24e00623f0 con 0x7f24e402dbd0 2024-09-21T03:21:56.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.662+0000 7f24f2800640 1 -- 172.21.15.90:0/1868651107 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f24e40d6ea0 con 0x7f24e402dbd0 2024-09-21T03:21:56.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.666+0000 7f24e9600640 1 -- 172.21.15.90:0/1868651107 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f24e0061cf0 con 0x7f24e402dbd0 2024-09-21T03:21:56.669 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:21:56.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.671+0000 7f24f2800640 1 -- 172.21.15.90:0/1868651107 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f24cc078b90 msgr2=0x7f24cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:56.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.671+0000 7f24f2800640 1 --2- 172.21.15.90:0/1868651107 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f24cc078b90 0x7f24cc07b0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f24d8034000 tx=0x7f24d80046c0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.671+0000 7f24f2800640 1 -- 172.21.15.90:0/1868651107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24e402dbd0 msgr2=0x7f24e40c9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:56.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.671+0000 7f24f2800640 1 --2- 172.21.15.90:0/1868651107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24e402dbd0 0x7f24e40c9320 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f24e000c760 tx=0x7f24e000cc20 comp rx=0 tx=0).stop 2024-09-21T03:21:56.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.671+0000 7f24f2800640 1 -- 172.21.15.90:0/1868651107 shutdown_connections 2024-09-21T03:21:56.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.671+0000 7f24f2800640 1 --2- 172.21.15.90:0/1868651107 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f24cc078b90 0x7f24cc07b0a0 secure :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f24d8034000 tx=0x7f24d80046c0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.671+0000 7f24f2800640 1 --2- 172.21.15.90:0/1868651107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e4049740 0x7f24e4170970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.671+0000 7f24f2800640 1 --2- 172.21.15.90:0/1868651107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24e402dbd0 0x7f24e40c9320 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.671+0000 7f24f2800640 1 --2- 172.21.15.90:0/1868651107 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24e402d7c0 0x7f24e40cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.671+0000 7f24f2800640 1 -- 172.21.15.90:0/1868651107 >> 172.21.15.90:0/1868651107 conn(0x7f24e4048650 msgr2=0x7f24e402c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:56.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.673+0000 7f24f2800640 1 -- 172.21.15.90:0/1868651107 shutdown_connections 2024-09-21T03:21:56.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:21:56.673+0000 7f24f2800640 1 -- 172.21.15.90:0/1868651107 wait complete. 2024-09-21T03:21:59.733 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:22:00.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.217+0000 7f4277800640 1 -- 172.21.15.90:0/3292913905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42700c1440 msgr2=0x7f42700c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:00.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.217+0000 7f4277800640 1 --2- 172.21.15.90:0/3292913905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42700c1440 0x7f42700c1850 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4268005fd0 tx=0x7f426802a820 comp rx=0 tx=0).stop 2024-09-21T03:22:00.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.217+0000 7f4277800640 1 -- 172.21.15.90:0/3292913905 shutdown_connections 2024-09-21T03:22:00.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.217+0000 7f4277800640 1 --2- 172.21.15.90:0/3292913905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42700c1440 0x7f42700c1850 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:00.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.217+0000 7f4277800640 1 --2- 172.21.15.90:0/3292913905 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700c41b0 0x7f42700703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:00.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.217+0000 7f4277800640 1 -- 172.21.15.90:0/3292913905 >> 172.21.15.90:0/3292913905 conn(0x7f42700c8010 msgr2=0x7f42700c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:00.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.217+0000 7f4277800640 1 -- 172.21.15.90:0/3292913905 shutdown_connections 2024-09-21T03:22:00.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.218+0000 7f4277800640 1 -- 172.21.15.90:0/3292913905 wait complete. 2024-09-21T03:22:00.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.224+0000 7f4277800640 1 Processor -- start 2024-09-21T03:22:00.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.224+0000 7f4277800640 1 -- start start 2024-09-21T03:22:00.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.228+0000 7f4277800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4270073c90 0x7f4270158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:00.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.229+0000 7f4274e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4270073c90 0x7f4270158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:00.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.230+0000 7f4274e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4270073c90 0x7f4270158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34062/0 (socket says 172.21.15.90:34062) 2024-09-21T03:22:00.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.230+0000 7f4274e00640 1 -- 172.21.15.90:0/1223111190 learned_addr learned my addr 172.21.15.90:0/1223111190 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:22:00.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.230+0000 7f4277800640 1 --2- 172.21.15.90:0/1223111190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42700c1440 0x7f42700aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:00.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.230+0000 7f4277800640 1 --2- 172.21.15.90:0/1223111190 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700c41b0 0x7f42701f04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:00.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.230+0000 7f4277800640 1 -- 172.21.15.90:0/1223111190 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4270070910 con 0x7f4270073c90 2024-09-21T03:22:00.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.230+0000 7f4277800640 1 -- 172.21.15.90:0/1223111190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f42700c3350 con 0x7f42700c1440 2024-09-21T03:22:00.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.231+0000 7f4277800640 1 -- 172.21.15.90:0/1223111190 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f42700c3e30 con 0x7f42700c41b0 2024-09-21T03:22:00.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.231+0000 7f426fe00640 1 -- 172.21.15.90:0/1223111190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42700c1440 msgr2=0x7f42700aca20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3300/0 2024-09-21T03:22:00.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.231+0000 7f426fe00640 1 --2- 172.21.15.90:0/1223111190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42700c1440 0x7f42700aca20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:22:00.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.231+0000 7f4275800640 1 --2- 172.21.15.90:0/1223111190 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700c41b0 0x7f42701f04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:00.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.233+0000 7f4275800640 1 -- 172.21.15.90:0/1223111190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42700c1440 msgr2=0x7f42700aca20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:22:00.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.233+0000 7f4275800640 1 --2- 172.21.15.90:0/1223111190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42700c1440 0x7f42700aca20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:00.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.233+0000 7f4275800640 1 -- 172.21.15.90:0/1223111190 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4270073c90 msgr2=0x7f4270158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:00.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.233+0000 7f4275800640 1 --2- 172.21.15.90:0/1223111190 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4270073c90 0x7f4270158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:00.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.234+0000 7f4275800640 1 -- 172.21.15.90:0/1223111190 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42701596f0 con 0x7f42700c41b0 2024-09-21T03:22:00.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.234+0000 7f4275800640 1 --2- 172.21.15.90:0/1223111190 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700c41b0 0x7f42701f04f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f426000b3e0 tx=0x7f426000b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:00.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.236+0000 7f426cc00640 1 -- 172.21.15.90:0/1223111190 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4260015020 con 0x7f42700c41b0 2024-09-21T03:22:00.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.236+0000 7f4277800640 1 -- 172.21.15.90:0/1223111190 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4270150840 con 0x7f42700c41b0 2024-09-21T03:22:00.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.236+0000 7f4277800640 1 -- 172.21.15.90:0/1223111190 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f42701f0e30 con 0x7f42700c41b0 2024-09-21T03:22:00.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.238+0000 7f426cc00640 1 -- 172.21.15.90:0/1223111190 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4260011920 con 0x7f42700c41b0 2024-09-21T03:22:00.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.238+0000 7f426cc00640 1 -- 172.21.15.90:0/1223111190 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4260015020 con 0x7f42700c41b0 2024-09-21T03:22:00.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.239+0000 7f4277800640 1 -- 172.21.15.90:0/1223111190 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4248005290 con 0x7f42700c41b0 2024-09-21T03:22:00.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.253+0000 7f426cc00640 1 -- 172.21.15.90:0/1223111190 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4260018020 con 0x7f42700c41b0 2024-09-21T03:22:00.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.255+0000 7f426cc00640 1 --2- 172.21.15.90:0/1223111190 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4250078d40 0x7f425007b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:00.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.256+0000 7f426cc00640 1 -- 172.21.15.90:0/1223111190 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f426009aa80 con 0x7f42700c41b0 2024-09-21T03:22:00.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.258+0000 7f4274e00640 1 --2- 172.21.15.90:0/1223111190 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4250078d40 0x7f425007b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:00.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.264+0000 7f4274e00640 1 --2- 172.21.15.90:0/1223111190 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4250078d40 0x7f425007b250 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f425c009ba0 tx=0x7f425c009260 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:00.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.275+0000 7f426cc00640 1 -- 172.21.15.90:0/1223111190 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f426009ce20 con 0x7f42700c41b0 2024-09-21T03:22:00.839 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:22:00.849 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:22:00.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:00.945+0000 7f4277800640 1 -- 172.21.15.90:0/1223111190 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4248005580 con 0x7f42700c41b0 2024-09-21T03:22:05.779 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":56,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:22:05.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:05.774+0000 7f426cc00640 1 -- 172.21.15.90:0/1223111190 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f426001f020 con 0x7f42700c41b0 2024-09-21T03:22:05.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:05.784+0000 7f4277800640 1 -- 172.21.15.90:0/1223111190 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4250078d40 msgr2=0x7f425007b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:05.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:05.784+0000 7f4277800640 1 --2- 172.21.15.90:0/1223111190 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4250078d40 0x7f425007b250 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f425c009ba0 tx=0x7f425c009260 comp rx=0 tx=0).stop 2024-09-21T03:22:05.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:05.784+0000 7f4277800640 1 -- 172.21.15.90:0/1223111190 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700c41b0 msgr2=0x7f42701f04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:05.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:05.784+0000 7f4277800640 1 --2- 172.21.15.90:0/1223111190 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700c41b0 0x7f42701f04f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f426000b3e0 tx=0x7f426000b8a0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:05.784+0000 7f4277800640 1 -- 172.21.15.90:0/1223111190 shutdown_connections 2024-09-21T03:22:05.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:05.784+0000 7f4277800640 1 --2- 172.21.15.90:0/1223111190 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f4250078d40 0x7f425007b250 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:05.784+0000 7f4277800640 1 --2- 172.21.15.90:0/1223111190 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42700c41b0 0x7f42701f04f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:05.784+0000 7f4277800640 1 --2- 172.21.15.90:0/1223111190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42700c1440 0x7f42700aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:05.784+0000 7f4277800640 1 --2- 172.21.15.90:0/1223111190 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4270073c90 0x7f4270158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:05.784+0000 7f4277800640 1 -- 172.21.15.90:0/1223111190 >> 172.21.15.90:0/1223111190 conn(0x7f42700c8010 msgr2=0x7f4270157230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:05.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:05.786+0000 7f4277800640 1 -- 172.21.15.90:0/1223111190 shutdown_connections 2024-09-21T03:22:05.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:05.786+0000 7f4277800640 1 -- 172.21.15.90:0/1223111190 wait complete. 2024-09-21T03:22:05.877 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-21T03:22:05.877 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-21T03:22:05.877 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:22:06.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.393+0000 7f7df6a00640 1 -- 172.21.15.90:0/1225682913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dd8004800 msgr2=0x7f7dd8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:06.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.393+0000 7f7df6a00640 1 --2- 172.21.15.90:0/1225682913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dd8004800 0x7f7dd8004c10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7de8009f80 tx=0x7f7dd8005830 comp rx=0 tx=0).stop 2024-09-21T03:22:06.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.393+0000 7f7df6a00640 1 -- 172.21.15.90:0/1225682913 shutdown_connections 2024-09-21T03:22:06.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.393+0000 7f7df6a00640 1 --2- 172.21.15.90:0/1225682913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dd8004800 0x7f7dd8004c10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.393+0000 7f7df6a00640 1 -- 172.21.15.90:0/1225682913 >> 172.21.15.90:0/1225682913 conn(0x7f7df006d570 msgr2=0x7f7df00c7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:06.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.396+0000 7f7df6a00640 1 -- 172.21.15.90:0/1225682913 shutdown_connections 2024-09-21T03:22:06.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.396+0000 7f7df6a00640 1 -- 172.21.15.90:0/1225682913 wait complete. 2024-09-21T03:22:06.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.403+0000 7f7df6a00640 1 Processor -- start 2024-09-21T03:22:06.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.403+0000 7f7df6a00640 1 -- start start 2024-09-21T03:22:06.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.406+0000 7f7df6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dd8004800 0x7f7df01fcd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:06.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.406+0000 7f7df6a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7df00be8f0 0x7f7df00bed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:06.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.406+0000 7f7df6a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df014ff20 0x7f7df0150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:06.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.407+0000 7f7df5600640 1 -- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dd8004800 msgr2=0x7f7df01fcd80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3300/0 2024-09-21T03:22:06.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.407+0000 7f7df5600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dd8004800 0x7f7df01fcd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:22:06.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.407+0000 7f7df6a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7df0151480 con 0x7f7df014ff20 2024-09-21T03:22:06.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.407+0000 7f7df6000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df014ff20 0x7f7df0150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:06.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.407+0000 7f7df6000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df014ff20 0x7f7df0150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35200/0 (socket says 172.21.15.90:35200) 2024-09-21T03:22:06.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.407+0000 7f7df6000640 1 -- 172.21.15.90:0/375031786 learned_addr learned my addr 172.21.15.90:0/375031786 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:22:06.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.408+0000 7f7df4c00640 1 --2- 172.21.15.90:0/375031786 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7df00be8f0 0x7f7df00bed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:06.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.408+0000 7f7df6a00640 1 -- 172.21.15.90:0/375031786 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7df0072d40 con 0x7f7dd8004800 2024-09-21T03:22:06.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.408+0000 7f7df6a00640 1 -- 172.21.15.90:0/375031786 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7df00c88f0 con 0x7f7df00be8f0 2024-09-21T03:22:06.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.409+0000 7f7df6000640 1 -- 172.21.15.90:0/375031786 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7df00be8f0 msgr2=0x7f7df00bed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:06.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.410+0000 7f7df6000640 1 --2- 172.21.15.90:0/375031786 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7df00be8f0 0x7f7df00bed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.410+0000 7f7df6000640 1 -- 172.21.15.90:0/375031786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dd8004800 msgr2=0x7f7df01fcd80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:22:06.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.410+0000 7f7df6000640 1 --2- 172.21.15.90:0/375031786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7dd8004800 0x7f7df01fcd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.410+0000 7f7df6000640 1 -- 172.21.15.90:0/375031786 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df01fd650 con 0x7f7df014ff20 2024-09-21T03:22:06.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.410+0000 7f7df4c00640 1 --2- 172.21.15.90:0/375031786 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7df00be8f0 0x7f7df00bed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:22:06.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.411+0000 7f7df6000640 1 --2- 172.21.15.90:0/375031786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df014ff20 0x7f7df0150330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7df0075010 tx=0x7f7de400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:06.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.412+0000 7f7ded600640 1 -- 172.21.15.90:0/375031786 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de4015020 con 0x7f7df014ff20 2024-09-21T03:22:06.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.412+0000 7f7ded600640 1 -- 172.21.15.90:0/375031786 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7de4011940 con 0x7f7df014ff20 2024-09-21T03:22:06.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.412+0000 7f7ded600640 1 -- 172.21.15.90:0/375031786 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de4011d90 con 0x7f7df014ff20 2024-09-21T03:22:06.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.414+0000 7f7df6a00640 1 -- 172.21.15.90:0/375031786 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7df01fd930 con 0x7f7df014ff20 2024-09-21T03:22:06.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.415+0000 7f7df6a00640 1 -- 172.21.15.90:0/375031786 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7df00bdd90 con 0x7f7df014ff20 2024-09-21T03:22:06.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.419+0000 7f7df6a00640 1 --2- 172.21.15.90:0/375031786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df00bf240 0x7f7df01562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:06.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.419+0000 7f7df6a00640 1 -- 172.21.15.90:0/375031786 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7df01493c0 con 0x7f7df00bf240 2024-09-21T03:22:06.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.424+0000 7f7df5600640 1 --2- 172.21.15.90:0/375031786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df00bf240 0x7f7df01562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:06.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.430+0000 7f7ded600640 1 -- 172.21.15.90:0/375031786 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7de4018020 con 0x7f7df014ff20 2024-09-21T03:22:06.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.431+0000 7f7df5600640 1 -- 172.21.15.90:0/375031786 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7df0074880 con 0x7f7df00bf240 2024-09-21T03:22:06.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.433+0000 7f7ded600640 1 --2- 172.21.15.90:0/375031786 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7dd0078b70 0x7f7dd007b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:06.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.434+0000 7f7ded600640 1 -- 172.21.15.90:0/375031786 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f7de409a5d0 con 0x7f7df014ff20 2024-09-21T03:22:06.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.434+0000 7f7df4c00640 1 --2- 172.21.15.90:0/375031786 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7dd0078b70 0x7f7dd007b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:06.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.438+0000 7f7df4c00640 1 --2- 172.21.15.90:0/375031786 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7dd0078b70 0x7f7dd007b080 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7de8034000 tx=0x7f7de8033040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:06.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.438+0000 7f7df5600640 1 --2- 172.21.15.90:0/375031786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df00bf240 0x7f7df01562b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc003610 tx=0x7f7ddc00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:06.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.440+0000 7f7ded600640 1 -- 172.21.15.90:0/375031786 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc017070 con 0x7f7df00bf240 2024-09-21T03:22:06.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.440+0000 7f7ded600640 1 -- 172.21.15.90:0/375031786 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7ddc0072d0 con 0x7f7df00bf240 2024-09-21T03:22:06.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.440+0000 7f7ded600640 1 -- 172.21.15.90:0/375031786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df00bf240 msgr2=0x7f7df01562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:06.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.440+0000 7f7ded600640 1 --2- 172.21.15.90:0/375031786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df00bf240 0x7f7df01562b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc003610 tx=0x7f7ddc00cb10 comp rx=0 tx=0).stop 2024-09-21T03:22:06.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.440+0000 7f7ded600640 1 -- 172.21.15.90:0/375031786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df00bf240 msgr2=0x7f7df01562b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:22:06.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.440+0000 7f7ded600640 1 --2- 172.21.15.90:0/375031786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df00bf240 0x7f7df01562b0 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc003610 tx=0x7f7ddc00cb10 comp rx=0 tx=0).stop 2024-09-21T03:22:06.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.464+0000 7f7df6a00640 1 --2- 172.21.15.90:0/375031786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df01567f0 0x7f7df0156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:06.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.465+0000 7f7df6a00640 1 -- 172.21.15.90:0/375031786 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7df0157140 con 0x7f7df01567f0 2024-09-21T03:22:06.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.465+0000 7f7df5600640 1 --2- 172.21.15.90:0/375031786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df01567f0 0x7f7df0156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:06.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.466+0000 7f7df5600640 1 -- 172.21.15.90:0/375031786 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7df00c3720 con 0x7f7df01567f0 2024-09-21T03:22:06.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.468+0000 7f7df5600640 1 --2- 172.21.15.90:0/375031786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df01567f0 0x7f7df0156c00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc014000 tx=0x7f7df00c8e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:06.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.469+0000 7f7ded600640 1 -- 172.21.15.90:0/375031786 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc017070 con 0x7f7df01567f0 2024-09-21T03:22:06.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.471+0000 7f7ded600640 1 -- 172.21.15.90:0/375031786 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5184 (secure 0 0 0) 0x7f7ddc018040 con 0x7f7df01567f0 2024-09-21T03:22:06.474 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:22:06.474 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:22:06.474 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:22:06.474 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:22:06.474 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 56, 2024-09-21T03:22:06.474 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 170244, 2024-09-21T03:22:06.474 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:22:06.474 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:22:06.474 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:22:06.474 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:06.474 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 0, 2024-09-21T03:22:06.475 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:22:06.475 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:22:06.475 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:22:06.475 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:06.475 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:06.475 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:06.475 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:06.475 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:06.475 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:06.475 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:06.475 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:06.475 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:06.475 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:06.475 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:06.475 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:06.476 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:22:06.476 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:22:06.476 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:06.476 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:06.476 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:06.476 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:06.476 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:06.476 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:06.476 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:06.476 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:06.476 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:06.476 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:06.476 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:06.476 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:06.476 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:06.477 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:22:06.477 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:22:06.477 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:22:06.477 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:22:06.477 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:22:06.477 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:22:06.477 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:22:06.477 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:22:06.477 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:22:06.477 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:22:06.477 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:22:06.477 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:22:06.477 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:22:06.477 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:22:06.478 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:22:06.478 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:22:06.478 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:22:06.478 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:06.478 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:06.478 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:06.478 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:06.478 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:06.478 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:06.478 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:06.478 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:06.478 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:06.478 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:06.478 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:06.479 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:06.479 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:22:06.479 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:06.479 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:22:06.479 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:06.479 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:22:06.479 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:22:06.479 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:06.479 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:06.479 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:06.479 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:06.479 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:22:06.479 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:06.479 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:06.480 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:06.480 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:06.480 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:22:06.480 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:06.480 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:06.480 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:06.480 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:06.480 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:22:06.480 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:22:06.480 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:06.480 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:06.480 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:06.480 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:06.480 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:06.480 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:22:06.481 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:22:06.481 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:06.481 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:06.481 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:06.481 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:06.481 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:22:06.481 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:06.481 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:06.481 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:06.481 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:06.481 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:22:06.481 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:06.481 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:06.481 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:06.482 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:06.482 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:22:06.482 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:22:06.482 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:06.482 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:06.482 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:06.482 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:06.482 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:06.482 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:22:06.482 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:22:06.482 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:06.482 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:06.482 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:06.482 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:06.484 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:06.484 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:06.484 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:06.484 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:22:06.484 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:22:06.484 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:06.484 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:06.484 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:06.484 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:22:06.484 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:06.484 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:06.484 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:22:06.484 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:06.484 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:06.485 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:06.485 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:22:06.485 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:06.485 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:06.485 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:22:06.485 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:06.485 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:06.485 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:06.485 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5 2024-09-21T03:22:06.485 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:06.485 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:06.485 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:22:06.485 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:06.485 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:22:06.485 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:22:06.486 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:22:06.486 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:06.486 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:06.486 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:06.486 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:06.486 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5 2024-09-21T03:22:06.486 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:06.486 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:06.486 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:22:06.486 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:06.486 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:06.486 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:06.486 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:22:06.486 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:06.487 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:06.487 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:06.487 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:22:06.487 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:22:06.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.472+0000 7f7ded600640 1 -- 172.21.15.90:0/375031786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df01567f0 msgr2=0x7f7df0156c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:06.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.472+0000 7f7ded600640 1 --2- 172.21.15.90:0/375031786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df01567f0 0x7f7df0156c00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc014000 tx=0x7f7df00c8e80 comp rx=0 tx=0).stop 2024-09-21T03:22:06.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.472+0000 7f7ded600640 1 -- 172.21.15.90:0/375031786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df01567f0 msgr2=0x7f7df0156c00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:22:06.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.473+0000 7f7ded600640 1 --2- 172.21.15.90:0/375031786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df01567f0 0x7f7df0156c00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.474+0000 7f7df6a00640 1 -- 172.21.15.90:0/375031786 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7dd0078b70 msgr2=0x7f7dd007b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:06.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.474+0000 7f7df6a00640 1 --2- 172.21.15.90:0/375031786 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7dd0078b70 0x7f7dd007b080 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7de8034000 tx=0x7f7de8033040 comp rx=0 tx=0).stop 2024-09-21T03:22:06.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.474+0000 7f7df6a00640 1 -- 172.21.15.90:0/375031786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df014ff20 msgr2=0x7f7df0150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:06.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.474+0000 7f7df6a00640 1 --2- 172.21.15.90:0/375031786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df014ff20 0x7f7df0150330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7df0075010 tx=0x7f7de400b8a0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.475+0000 7f7df6000640 1 -- 172.21.15.90:0/375031786 reap_dead start 2024-09-21T03:22:06.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.475+0000 7f7df6000640 1 -- 172.21.15.90:0/375031786 reap_dead start 2024-09-21T03:22:06.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.475+0000 7f7df6a00640 1 -- 172.21.15.90:0/375031786 shutdown_connections 2024-09-21T03:22:06.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.475+0000 7f7df6a00640 1 -- 172.21.15.90:0/375031786 >> 172.21.15.90:0/375031786 conn(0x7f7df006d570 msgr2=0x7f7df00701b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:06.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.476+0000 7f7df6a00640 1 -- 172.21.15.90:0/375031786 shutdown_connections 2024-09-21T03:22:06.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.476+0000 7f7df6a00640 1 -- 172.21.15.90:0/375031786 wait complete. 2024-09-21T03:22:06.548 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-21T03:22:06.548 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-21T03:22:06.548 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:22:06.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.991+0000 7f001a400640 1 -- 172.21.15.90:0/2410535879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f000c0d9840 msgr2=0x7f000c0d9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:06.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.991+0000 7f0012000640 1 -- 172.21.15.90:0/2410535879 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0000035020 con 0x7f000c0d9840 2024-09-21T03:22:06.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.992+0000 7f001a400640 1 --2- 172.21.15.90:0/2410535879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f000c0d9840 0x7f000c0d9c50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f000c00d1c0 tx=0x7f000002a530 comp rx=0 tx=0).stop 2024-09-21T03:22:06.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.992+0000 7f001a400640 1 -- 172.21.15.90:0/2410535879 shutdown_connections 2024-09-21T03:22:06.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.992+0000 7f001a400640 1 --2- 172.21.15.90:0/2410535879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f000c0d9840 0x7f000c0d9c50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.992+0000 7f001a400640 1 --2- 172.21.15.90:0/2410535879 >> v2:172.21.15.149:3300/0 conn(0x7f000c00ae80 0x7f000c00b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.992+0000 7f001a400640 1 -- 172.21.15.90:0/2410535879 >> 172.21.15.90:0/2410535879 conn(0x7f000c048480 msgr2=0x7f000c048890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:06.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.992+0000 7f001a400640 1 -- 172.21.15.90:0/2410535879 shutdown_connections 2024-09-21T03:22:06.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.993+0000 7f001a400640 1 -- 172.21.15.90:0/2410535879 wait complete. 2024-09-21T03:22:06.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.997+0000 7f001a400640 1 Processor -- start 2024-09-21T03:22:07.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:06.998+0000 7f001a400640 1 -- start start 2024-09-21T03:22:07.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.001+0000 7f001a400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f000c005dd0 0x7f000c0429d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:07.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.001+0000 7f001a400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f000c00ae80 0x7f000c166340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:07.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.001+0000 7f0012a00640 1 -- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f000c005dd0 msgr2=0x7f000c0429d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3300/0 2024-09-21T03:22:07.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.001+0000 7f0012a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f000c005dd0 0x7f000c0429d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:22:07.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.002+0000 7f001a400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f000c0d9840 0x7f000c0d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:07.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.002+0000 7f0018e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f000c00ae80 0x7f000c166340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:07.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.002+0000 7f0018e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f000c00ae80 0x7f000c166340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:48538/0 (socket says 172.21.15.90:48538) 2024-09-21T03:22:07.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.003+0000 7f0018e00640 1 -- 172.21.15.90:0/435561409 learned_addr learned my addr 172.21.15.90:0/435561409 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:22:07.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.003+0000 7f001a400640 1 -- 172.21.15.90:0/435561409 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f000c046da0 con 0x7f000c0d9840 2024-09-21T03:22:07.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.003+0000 7f001a400640 1 -- 172.21.15.90:0/435561409 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f000c0da190 con 0x7f000c005dd0 2024-09-21T03:22:07.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.003+0000 7f001a400640 1 -- 172.21.15.90:0/435561409 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f000c04a730 con 0x7f000c00ae80 2024-09-21T03:22:07.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.004+0000 7f0013400640 1 --2- 172.21.15.90:0/435561409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f000c0d9840 0x7f000c0d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:07.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.004+0000 7f0018e00640 1 -- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f000c005dd0 msgr2=0x7f000c0429d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:22:07.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.004+0000 7f0018e00640 1 --2- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f000c005dd0 0x7f000c0429d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:07.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.005+0000 7f0018e00640 1 -- 172.21.15.90:0/435561409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f000c0d9840 msgr2=0x7f000c0d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:07.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.005+0000 7f0018e00640 1 --2- 172.21.15.90:0/435561409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f000c0d9840 0x7f000c0d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:07.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.005+0000 7f0018e00640 1 -- 172.21.15.90:0/435561409 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c042f10 con 0x7f000c00ae80 2024-09-21T03:22:07.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.006+0000 7f0018e00640 1 --2- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f000c00ae80 0x7f000c166340 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0000034040 tx=0x7f0000004dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:07.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.006+0000 7f0007400640 1 -- 172.21.15.90:0/435561409 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000003e070 con 0x7f000c00ae80 2024-09-21T03:22:07.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.007+0000 7f001a400640 1 -- 172.21.15.90:0/435561409 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000c0434c0 con 0x7f000c00ae80 2024-09-21T03:22:07.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.007+0000 7f001a400640 1 -- 172.21.15.90:0/435561409 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f000c167250 con 0x7f000c00ae80 2024-09-21T03:22:07.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.007+0000 7f0007400640 1 -- 172.21.15.90:0/435561409 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0000003800 con 0x7f000c00ae80 2024-09-21T03:22:07.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.007+0000 7f0007400640 1 -- 172.21.15.90:0/435561409 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000003e070 con 0x7f000c00ae80 2024-09-21T03:22:07.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.016+0000 7f0004c00640 1 --2- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f000c02d6f0 0x7f000c0d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:07.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.016+0000 7f0004c00640 1 -- 172.21.15.90:0/435561409 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f000c0d8d10 con 0x7f000c02d6f0 2024-09-21T03:22:07.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.017+0000 7f0012a00640 1 --2- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f000c02d6f0 0x7f000c0d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:07.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.018+0000 7f0007400640 1 -- 172.21.15.90:0/435561409 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0000041070 con 0x7f000c00ae80 2024-09-21T03:22:07.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.019+0000 7f0012a00640 1 -- 172.21.15.90:0/435561409 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f000c043250 con 0x7f000c02d6f0 2024-09-21T03:22:07.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.021+0000 7f0007400640 1 --2- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efff4078d70 0x7efff407b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:07.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.028+0000 7f0007400640 1 -- 172.21.15.90:0/435561409 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f00000bbd00 con 0x7f000c00ae80 2024-09-21T03:22:07.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.030+0000 7f0013400640 1 --2- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efff4078d70 0x7efff407b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:07.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.030+0000 7f0012a00640 1 --2- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f000c02d6f0 0x7f000c0d0ef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f000800b450 tx=0x7f000800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:07.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.032+0000 7f0013400640 1 --2- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efff4078d70 0x7efff407b280 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f001406bd50 tx=0x7f0014070040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:07.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.032+0000 7f0007400640 1 -- 172.21.15.90:0/435561409 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008003d60 con 0x7f000c02d6f0 2024-09-21T03:22:07.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.032+0000 7f0007400640 1 -- 172.21.15.90:0/435561409 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0008015070 con 0x7f000c02d6f0 2024-09-21T03:22:07.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.032+0000 7f0007400640 1 -- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f000c02d6f0 msgr2=0x7f000c0d0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:07.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.032+0000 7f0007400640 1 --2- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f000c02d6f0 0x7f000c0d0ef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f000800b450 tx=0x7f000800b910 comp rx=0 tx=0).stop 2024-09-21T03:22:07.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.032+0000 7f0007400640 1 -- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f000c02d6f0 msgr2=0x7f000c0d0ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:22:07.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.032+0000 7f0007400640 1 --2- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f000c02d6f0 0x7f000c0d0ef0 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f000800b450 tx=0x7f000800b910 comp rx=0 tx=0).stop 2024-09-21T03:22:07.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.058+0000 7f0004c00640 1 --2- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f000c02dc40 0x7f000c173fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:07.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.058+0000 7f0004c00640 1 -- 172.21.15.90:0/435561409 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f000c0467b0 con 0x7f000c02dc40 2024-09-21T03:22:07.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.058+0000 7f0012a00640 1 --2- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f000c02dc40 0x7f000c173fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:07.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.060+0000 7f0012a00640 1 -- 172.21.15.90:0/435561409 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f000c167490 con 0x7f000c02dc40 2024-09-21T03:22:07.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.061+0000 7f0012a00640 1 --2- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f000c02dc40 0x7f000c173fd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f000800b450 tx=0x7f00080059b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:07.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.064+0000 7f0007400640 1 -- 172.21.15.90:0/435561409 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008005500 con 0x7f000c02dc40 2024-09-21T03:22:07.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.067+0000 7f0007400640 1 -- 172.21.15.90:0/435561409 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5038 (secure 0 0 0) 0x7f00080056a0 con 0x7f000c02dc40 2024-09-21T03:22:07.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.067+0000 7f0007400640 1 -- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f000c02dc40 msgr2=0x7f000c173fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:07.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.067+0000 7f0007400640 1 --2- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f000c02dc40 0x7f000c173fd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f000800b450 tx=0x7f00080059b0 comp rx=0 tx=0).stop 2024-09-21T03:22:07.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.067+0000 7f0007400640 1 -- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f000c02dc40 msgr2=0x7f000c173fd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:22:07.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.067+0000 7f0007400640 1 --2- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f000c02dc40 0x7f000c173fd0 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f000800b450 tx=0x7f00080059b0 comp rx=0 tx=0).stop 2024-09-21T03:22:07.070 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:22:07.070 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:22:07.070 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:22:07.070 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:22:07.070 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 56, 2024-09-21T03:22:07.070 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 37385, 2024-09-21T03:22:07.070 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:22:07.070 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:22:07.071 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:22:07.071 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:07.071 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 1, 2024-09-21T03:22:07.071 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:22:07.071 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:22:07.071 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:22:07.071 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:07.071 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:07.071 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:07.071 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:07.071 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:07.071 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:07.072 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:07.072 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:07.072 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:07.072 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:07.072 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:07.072 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:07.072 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:22:07.072 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:22:07.072 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:07.072 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:07.072 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:07.072 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:07.072 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:07.073 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:07.073 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:07.073 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:07.073 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:07.073 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:07.073 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:07.073 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:07.073 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:07.073 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:22:07.073 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:22:07.073 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:22:07.073 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:22:07.074 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:22:07.074 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:22:07.074 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:22:07.074 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:22:07.074 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:22:07.074 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:22:07.074 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:22:07.074 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:22:07.074 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:22:07.074 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:22:07.074 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:22:07.074 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:22:07.075 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:22:07.075 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:07.075 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:07.075 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:07.075 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:07.075 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:07.075 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:07.075 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:07.075 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:07.075 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:07.075 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:07.075 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:07.075 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:07.076 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:22:07.076 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:07.076 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:22:07.076 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:07.076 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:22:07.076 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:22:07.076 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:07.076 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:07.076 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:07.076 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:07.076 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:22:07.076 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:07.077 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:07.077 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:07.077 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:07.077 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:22:07.077 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:07.077 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:07.077 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:07.077 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:07.077 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:22:07.077 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:22:07.077 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:07.077 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:07.078 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:07.078 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:07.078 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:07.078 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:22:07.078 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:22:07.078 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:07.078 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:07.078 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:07.078 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:07.078 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:22:07.078 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:07.079 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:07.079 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:07.079 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:07.079 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:22:07.080 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:07.080 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:07.080 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:07.080 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:07.080 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:22:07.080 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:22:07.080 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:07.080 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:07.080 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:07.080 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:07.080 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:07.081 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:22:07.081 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:22:07.081 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:07.081 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:07.081 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:07.081 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:07.081 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:22:07.081 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:07.081 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:07.081 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:07.081 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:07.081 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:22:07.081 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:07.082 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:07.082 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:07.082 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:07.082 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:22:07.082 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:22:07.082 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:07.082 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:07.082 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:07.082 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:07.082 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:07.082 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:07.082 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:22:07.082 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:22:07.082 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:07.083 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:07.083 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:07.083 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:22:07.083 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:07.083 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:07.083 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:22:07.083 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:07.083 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:07.083 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:07.083 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:22:07.083 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:07.083 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:07.083 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:22:07.084 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:07.084 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:07.084 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:07.084 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 3 2024-09-21T03:22:07.084 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:07.084 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:07.084 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:22:07.084 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:07.084 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:07.084 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:07.084 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 3 2024-09-21T03:22:07.084 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:07.085 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:07.085 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:22:07.085 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:07.085 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:07.085 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:07.085 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:22:07.085 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:07.085 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:07.085 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:07.085 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:22:07.085 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:22:07.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.073+0000 7f0004c00640 1 -- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efff4078d70 msgr2=0x7efff407b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:07.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.073+0000 7f0004c00640 1 --2- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efff4078d70 0x7efff407b280 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f001406bd50 tx=0x7f0014070040 comp rx=0 tx=0).stop 2024-09-21T03:22:07.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.073+0000 7f0004c00640 1 -- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f000c00ae80 msgr2=0x7f000c166340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:07.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.073+0000 7f0004c00640 1 --2- 172.21.15.90:0/435561409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f000c00ae80 0x7f000c166340 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0000034040 tx=0x7f0000004dc0 comp rx=0 tx=0).stop 2024-09-21T03:22:07.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.073+0000 7f0013400640 1 -- 172.21.15.90:0/435561409 reap_dead start 2024-09-21T03:22:07.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.073+0000 7f0013400640 1 -- 172.21.15.90:0/435561409 reap_dead start 2024-09-21T03:22:07.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.073+0000 7f0004c00640 1 -- 172.21.15.90:0/435561409 shutdown_connections 2024-09-21T03:22:07.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.073+0000 7f0004c00640 1 -- 172.21.15.90:0/435561409 >> 172.21.15.90:0/435561409 conn(0x7f000c048480 msgr2=0x7f000c0d5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:07.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.075+0000 7f0004c00640 1 -- 172.21.15.90:0/435561409 shutdown_connections 2024-09-21T03:22:07.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:07.075+0000 7f0004c00640 1 -- 172.21.15.90:0/435561409 wait complete. 2024-09-21T03:22:07.155 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-21T03:22:07.155 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-21T03:22:27.157 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-21T03:22:27.157 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-21T03:22:27.157 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-21T03:22:27.167 INFO:tasks.ceph.mon.b:Started 2024-09-21T03:22:27.167 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-21T03:22:27.167 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:22:27.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.706+0000 7f950dc00640 1 -- 172.21.15.90:0/2964705933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9508074220 msgr2=0x7f9508074630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:27.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.706+0000 7f950dc00640 1 --2- 172.21.15.90:0/2964705933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9508074220 0x7f9508074630 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9500005fd0 tx=0x7f950002a850 comp rx=0 tx=0).stop 2024-09-21T03:22:27.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.707+0000 7f950dc00640 1 -- 172.21.15.90:0/2964705933 shutdown_connections 2024-09-21T03:22:27.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.707+0000 7f950dc00640 1 --2- 172.21.15.90:0/2964705933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9508074220 0x7f9508074630 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:27.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.707+0000 7f950dc00640 1 --2- 172.21.15.90:0/2964705933 >> v2:172.21.15.149:3300/0 conn(0x7f950806d960 0x7f950813dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:27.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.707+0000 7f950dc00640 1 -- 172.21.15.90:0/2964705933 >> 172.21.15.90:0/2964705933 conn(0x7f95080c8ba0 msgr2=0x7f950806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:27.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.708+0000 7f950dc00640 1 -- 172.21.15.90:0/2964705933 shutdown_connections 2024-09-21T03:22:27.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.708+0000 7f950dc00640 1 -- 172.21.15.90:0/2964705933 wait complete. 2024-09-21T03:22:27.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.710+0000 7f950dc00640 1 Processor -- start 2024-09-21T03:22:27.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.710+0000 7f950dc00640 1 -- start start 2024-09-21T03:22:27.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.713+0000 7f950dc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f950806d960 0x7f950813c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:27.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.713+0000 7f950dc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9508074220 0x7f95080c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:27.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.713+0000 7f950dc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95080ac350 0x7f95081e9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:27.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.714+0000 7f9506a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f950806d960 0x7f950813c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:27.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.714+0000 7f9506a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f950806d960 0x7f950813c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56226/0 (socket says 172.21.15.90:56226) 2024-09-21T03:22:27.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.714+0000 7f9506a00640 1 -- 172.21.15.90:0/3593060157 learned_addr learned my addr 172.21.15.90:0/3593060157 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:22:27.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.714+0000 7f950dc00640 1 -- 172.21.15.90:0/3593060157 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f95080ab640 con 0x7f950806d960 2024-09-21T03:22:27.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.714+0000 7f950dc00640 1 -- 172.21.15.90:0/3593060157 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f95080ab360 con 0x7f9508074220 2024-09-21T03:22:27.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.714+0000 7f950dc00640 1 -- 172.21.15.90:0/3593060157 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f95080ace70 con 0x7f95080ac350 2024-09-21T03:22:27.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.715+0000 7f9506a00640 1 -- 172.21.15.90:0/3593060157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95080ac350 msgr2=0x7f95081e9740 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:22:27.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.715+0000 7f9506a00640 1 --2- 172.21.15.90:0/3593060157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95080ac350 0x7f95081e9740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:27.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.715+0000 7f9506a00640 1 -- 172.21.15.90:0/3593060157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9508074220 msgr2=0x7f95080c5d00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:22:27.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.715+0000 7f9506a00640 1 --2- 172.21.15.90:0/3593060157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9508074220 0x7f95080c5d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:27.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.715+0000 7f9506a00640 1 -- 172.21.15.90:0/3593060157 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f950806f670 con 0x7f950806d960 2024-09-21T03:22:27.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.716+0000 7f9506a00640 1 --2- 172.21.15.90:0/3593060157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f950806d960 0x7f950813c930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f94f800b550 tx=0x7f94f800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:27.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.716+0000 7f94fea00640 1 -- 172.21.15.90:0/3593060157 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f8014070 con 0x7f950806d960 2024-09-21T03:22:27.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.716+0000 7f94fea00640 1 -- 172.21.15.90:0/3593060157 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94f8010610 con 0x7f950806d960 2024-09-21T03:22:27.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.716+0000 7f94fea00640 1 -- 172.21.15.90:0/3593060157 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f8010a80 con 0x7f950806d960 2024-09-21T03:22:27.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.716+0000 7f950dc00640 1 -- 172.21.15.90:0/3593060157 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95081589d0 con 0x7f950806d960 2024-09-21T03:22:27.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.717+0000 7f950dc00640 1 -- 172.21.15.90:0/3593060157 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95080702e0 con 0x7f950806d960 2024-09-21T03:22:27.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.718+0000 7f950dc00640 1 -- 172.21.15.90:0/3593060157 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f950813dd40 con 0x7f950806d960 2024-09-21T03:22:27.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.723+0000 7f94fea00640 1 -- 172.21.15.90:0/3593060157 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f94f8017070 con 0x7f950806d960 2024-09-21T03:22:27.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.727+0000 7f94fea00640 1 --2- 172.21.15.90:0/3593060157 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f94e8078bc0 0x7f94e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:27.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.727+0000 7f94fea00640 1 -- 172.21.15.90:0/3593060157 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f94f809aff0 con 0x7f950806d960 2024-09-21T03:22:27.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.730+0000 7f9506000640 1 --2- 172.21.15.90:0/3593060157 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f94e8078bc0 0x7f94e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:27.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.731+0000 7f94fea00640 1 -- 172.21.15.90:0/3593060157 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f94f80630e0 con 0x7f950806d960 2024-09-21T03:22:27.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:27.733+0000 7f9506000640 1 --2- 172.21.15.90:0/3593060157 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f94e8078bc0 0x7f94e807b0d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f95080c4650 tx=0x7f94f4007a10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:28.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:28.430+0000 7f950dc00640 1 -- 172.21.15.90:0/3593060157 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f95081523a0 con 0x7f950806d960 2024-09-21T03:22:28.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:28.431+0000 7f94fea00640 1 -- 172.21.15.90:0/3593060157 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7f94f80629e0 con 0x7f950806d960 2024-09-21T03:22:28.433 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":56,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:22:28.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:28.438+0000 7f950dc00640 1 -- 172.21.15.90:0/3593060157 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f94e8078bc0 msgr2=0x7f94e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:28.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:28.438+0000 7f950dc00640 1 --2- 172.21.15.90:0/3593060157 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f94e8078bc0 0x7f94e807b0d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f95080c4650 tx=0x7f94f4007a10 comp rx=0 tx=0).stop 2024-09-21T03:22:28.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:28.438+0000 7f950dc00640 1 -- 172.21.15.90:0/3593060157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f950806d960 msgr2=0x7f950813c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:28.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:28.438+0000 7f950dc00640 1 --2- 172.21.15.90:0/3593060157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f950806d960 0x7f950813c930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f94f800b550 tx=0x7f94f800ba10 comp rx=0 tx=0).stop 2024-09-21T03:22:28.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:28.439+0000 7f950dc00640 1 -- 172.21.15.90:0/3593060157 shutdown_connections 2024-09-21T03:22:28.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:28.439+0000 7f950dc00640 1 --2- 172.21.15.90:0/3593060157 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f94e8078bc0 0x7f94e807b0d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:28.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:28.439+0000 7f950dc00640 1 --2- 172.21.15.90:0/3593060157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95080ac350 0x7f95081e9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:28.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:28.439+0000 7f950dc00640 1 --2- 172.21.15.90:0/3593060157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9508074220 0x7f95080c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:28.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:28.439+0000 7f950dc00640 1 --2- 172.21.15.90:0/3593060157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f950806d960 0x7f950813c930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:28.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:28.439+0000 7f950dc00640 1 -- 172.21.15.90:0/3593060157 >> 172.21.15.90:0/3593060157 conn(0x7f95080c8ba0 msgr2=0x7f95080ac760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:28.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:28.440+0000 7f950dc00640 1 -- 172.21.15.90:0/3593060157 shutdown_connections 2024-09-21T03:22:28.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:28.441+0000 7f950dc00640 1 -- 172.21.15.90:0/3593060157 wait complete. 2024-09-21T03:22:31.165 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:22:31.174 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:22:31.496 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:22:32.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.048+0000 7fd1f6200640 1 -- 172.21.15.90:0/2695870167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f0070db0 msgr2=0x7fd1f00ab3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:32.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.048+0000 7fd1f6200640 1 --2- 172.21.15.90:0/2695870167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f0070db0 0x7fd1f00ab3e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd1f014d190 tx=0x7fd1dc02e630 comp rx=0 tx=0).stop 2024-09-21T03:22:32.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.049+0000 7fd1f6200640 1 -- 172.21.15.90:0/2695870167 shutdown_connections 2024-09-21T03:22:32.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.049+0000 7fd1f6200640 1 --2- 172.21.15.90:0/2695870167 >> v2:172.21.15.149:3300/0 conn(0x7fd1f00c50f0 0x7fd1f00c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:32.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.049+0000 7fd1f6200640 1 --2- 172.21.15.90:0/2695870167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f0070db0 0x7fd1f00ab3e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:32.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.049+0000 7fd1f6200640 1 -- 172.21.15.90:0/2695870167 >> 172.21.15.90:0/2695870167 conn(0x7fd1f00c84c0 msgr2=0x7fd1f00c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:32.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.050+0000 7fd1f6200640 1 -- 172.21.15.90:0/2695870167 shutdown_connections 2024-09-21T03:22:32.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.050+0000 7fd1f6200640 1 -- 172.21.15.90:0/2695870167 wait complete. 2024-09-21T03:22:32.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.055+0000 7fd1f6200640 1 Processor -- start 2024-09-21T03:22:32.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.055+0000 7fd1f6200640 1 -- start start 2024-09-21T03:22:32.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.058+0000 7fd1f6200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1f0070db0 0x7fd1f0148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:32.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.058+0000 7fd1f6200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1f00c4720 0x7fd1f014b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:32.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.058+0000 7fd1f6200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f00c50f0 0x7fd1f01f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:32.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.058+0000 7fd1f6200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f0074e10 con 0x7fd1f00c50f0 2024-09-21T03:22:32.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.058+0000 7fd1f6200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f0156110 con 0x7fd1f00c4720 2024-09-21T03:22:32.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.058+0000 7fd1f6200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd1f014f6e0 con 0x7fd1f0070db0 2024-09-21T03:22:32.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.060+0000 7fd1f5800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f00c50f0 0x7fd1f01f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:32.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.060+0000 7fd1f5800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f00c50f0 0x7fd1f01f41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56252/0 (socket says 172.21.15.90:56252) 2024-09-21T03:22:32.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.060+0000 7fd1f5800640 1 -- 172.21.15.90:0/1333162987 learned_addr learned my addr 172.21.15.90:0/1333162987 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:22:32.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.062+0000 7fd1f5800640 1 -- 172.21.15.90:0/1333162987 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1f0070db0 msgr2=0x7fd1f0148e00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:22:32.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.062+0000 7fd1f5800640 1 --2- 172.21.15.90:0/1333162987 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1f0070db0 0x7fd1f0148e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:32.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.062+0000 7fd1f5800640 1 -- 172.21.15.90:0/1333162987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1f00c4720 msgr2=0x7fd1f014b420 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:22:32.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.062+0000 7fd1f5800640 1 --2- 172.21.15.90:0/1333162987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1f00c4720 0x7fd1f014b420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:32.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.062+0000 7fd1f5800640 1 -- 172.21.15.90:0/1333162987 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f0149340 con 0x7fd1f00c50f0 2024-09-21T03:22:32.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.064+0000 7fd1f5800640 1 --2- 172.21.15.90:0/1333162987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f00c50f0 0x7fd1f01f41b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800bd90 tx=0x7fd1e800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:32.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.066+0000 7fd1ecc00640 1 -- 172.21.15.90:0/1333162987 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8019070 con 0x7fd1f00c50f0 2024-09-21T03:22:32.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.066+0000 7fd1ecc00640 1 -- 172.21.15.90:0/1333162987 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1e800ccd0 con 0x7fd1f00c50f0 2024-09-21T03:22:32.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.066+0000 7fd1ecc00640 1 -- 172.21.15.90:0/1333162987 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8019070 con 0x7fd1f00c50f0 2024-09-21T03:22:32.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.069+0000 7fd1f6200640 1 -- 172.21.15.90:0/1333162987 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1f014d1e0 con 0x7fd1f00c50f0 2024-09-21T03:22:32.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.069+0000 7fd1f6200640 1 -- 172.21.15.90:0/1333162987 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1f01f4d60 con 0x7fd1f00c50f0 2024-09-21T03:22:32.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.073+0000 7fd1e6000640 1 -- 172.21.15.90:0/1333162987 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1c4005290 con 0x7fd1f00c50f0 2024-09-21T03:22:32.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.076+0000 7fd1ecc00640 1 -- 172.21.15.90:0/1333162987 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd1e801c070 con 0x7fd1f00c50f0 2024-09-21T03:22:32.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.079+0000 7fd1ecc00640 1 --2- 172.21.15.90:0/1333162987 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd1d0078d90 0x7fd1d007b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:32.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.079+0000 7fd1ecc00640 1 -- 172.21.15.90:0/1333162987 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fd1e809ab20 con 0x7fd1f00c50f0 2024-09-21T03:22:32.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.088+0000 7fd1ecc00640 1 -- 172.21.15.90:0/1333162987 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd1e8062c30 con 0x7fd1f00c50f0 2024-09-21T03:22:32.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.087+0000 7fd1f4e00640 1 --2- 172.21.15.90:0/1333162987 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd1d0078d90 0x7fd1d007b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:32.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.093+0000 7fd1f4e00640 1 --2- 172.21.15.90:0/1333162987 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd1d0078d90 0x7fd1d007b2a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00095d0 tx=0x7fd1e0006b30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:32.747 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:22:32.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.744+0000 7fd1e6000640 1 -- 172.21.15.90:0/1333162987 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd1c4005850 con 0x7fd1f00c50f0 2024-09-21T03:22:32.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.745+0000 7fd1ecc00640 1 -- 172.21.15.90:0/1333162987 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7fd1e8062530 con 0x7fd1f00c50f0 2024-09-21T03:22:32.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.753+0000 7fd1e6000640 1 -- 172.21.15.90:0/1333162987 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd1d0078d90 msgr2=0x7fd1d007b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:32.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.753+0000 7fd1e6000640 1 --2- 172.21.15.90:0/1333162987 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd1d0078d90 0x7fd1d007b2a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00095d0 tx=0x7fd1e0006b30 comp rx=0 tx=0).stop 2024-09-21T03:22:32.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.753+0000 7fd1e6000640 1 -- 172.21.15.90:0/1333162987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f00c50f0 msgr2=0x7fd1f01f41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:32.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.753+0000 7fd1e6000640 1 --2- 172.21.15.90:0/1333162987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f00c50f0 0x7fd1f01f41b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800bd90 tx=0x7fd1e800be80 comp rx=0 tx=0).stop 2024-09-21T03:22:32.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.754+0000 7fd1e6000640 1 -- 172.21.15.90:0/1333162987 shutdown_connections 2024-09-21T03:22:32.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.754+0000 7fd1e6000640 1 --2- 172.21.15.90:0/1333162987 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd1d0078d90 0x7fd1d007b2a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:32.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.754+0000 7fd1e6000640 1 --2- 172.21.15.90:0/1333162987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f00c50f0 0x7fd1f01f41b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:32.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.754+0000 7fd1e6000640 1 --2- 172.21.15.90:0/1333162987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1f00c4720 0x7fd1f014b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:32.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.754+0000 7fd1e6000640 1 --2- 172.21.15.90:0/1333162987 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1f0070db0 0x7fd1f0148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:32.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.754+0000 7fd1e6000640 1 -- 172.21.15.90:0/1333162987 >> 172.21.15.90:0/1333162987 conn(0x7fd1f00c84c0 msgr2=0x7fd1f0073630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:32.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.755+0000 7fd1e6000640 1 -- 172.21.15.90:0/1333162987 shutdown_connections 2024-09-21T03:22:32.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:32.755+0000 7fd1e6000640 1 -- 172.21.15.90:0/1333162987 wait complete. 2024-09-21T03:22:32.808 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-21T03:22:32.808 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-21T03:22:32.808 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:22:33.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.300+0000 7fee63000640 1 -- 172.21.15.90:0/1422371553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee40004c40 msgr2=0x7fee40005070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:33.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.300+0000 7fee63000640 1 --2- 172.21.15.90:0/1422371553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee40004c40 0x7fee40005070 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fee48001bf0 tx=0x7fee40005830 comp rx=0 tx=0).stop 2024-09-21T03:22:33.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.300+0000 7fee61000640 1 -- 172.21.15.90:0/1422371553 reap_dead start 2024-09-21T03:22:33.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.301+0000 7fee63000640 1 -- 172.21.15.90:0/1422371553 shutdown_connections 2024-09-21T03:22:33.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.301+0000 7fee63000640 1 -- 172.21.15.90:0/1422371553 >> 172.21.15.90:0/1422371553 conn(0x7fee5c0c81b0 msgr2=0x7fee5c0c85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:33.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.301+0000 7fee63000640 1 -- 172.21.15.90:0/1422371553 shutdown_connections 2024-09-21T03:22:33.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.301+0000 7fee63000640 1 -- 172.21.15.90:0/1422371553 wait complete. 2024-09-21T03:22:33.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.318+0000 7fee63000640 1 Processor -- start 2024-09-21T03:22:33.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.318+0000 7fee63000640 1 -- start start 2024-09-21T03:22:33.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.322+0000 7fee63000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee40004c40 0x7fee5c154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:33.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.324+0000 7fee63000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee5c155d30 0x7fee5c156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:33.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.325+0000 7fee63000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee5c134700 0x7fee5c134b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:33.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.325+0000 7fee63000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c0c3c20 con 0x7fee5c134700 2024-09-21T03:22:33.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.325+0000 7fee63000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c0c3aa0 con 0x7fee40004c40 2024-09-21T03:22:33.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.325+0000 7fee63000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fee5c06e760 con 0x7fee5c155d30 2024-09-21T03:22:33.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.325+0000 7fee5be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee40004c40 0x7fee5c154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:33.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.325+0000 7fee5be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee40004c40 0x7fee5c154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:43734/0 (socket says 172.21.15.90:43734) 2024-09-21T03:22:33.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.325+0000 7fee5be00640 1 -- 172.21.15.90:0/2162817269 learned_addr learned my addr 172.21.15.90:0/2162817269 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:22:33.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.326+0000 7fee5b400640 1 --2- 172.21.15.90:0/2162817269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee5c155d30 0x7fee5c156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:33.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.327+0000 7fee61000640 1 --2- 172.21.15.90:0/2162817269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee5c134700 0x7fee5c134b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:33.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.327+0000 7fee5be00640 1 -- 172.21.15.90:0/2162817269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee5c155d30 msgr2=0x7fee5c156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:33.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.327+0000 7fee5be00640 1 --2- 172.21.15.90:0/2162817269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee5c155d30 0x7fee5c156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:33.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.328+0000 7fee5be00640 1 -- 172.21.15.90:0/2162817269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee5c134700 msgr2=0x7fee5c134b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:33.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.328+0000 7fee5be00640 1 --2- 172.21.15.90:0/2162817269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee5c134700 0x7fee5c134b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:33.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.328+0000 7fee5be00640 1 -- 172.21.15.90:0/2162817269 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee5c1f1f10 con 0x7fee40004c40 2024-09-21T03:22:33.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.329+0000 7fee5be00640 1 --2- 172.21.15.90:0/2162817269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee40004c40 0x7fee5c154f10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fee4802b930 tx=0x7fee48003c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:33.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.330+0000 7fee53e00640 1 -- 172.21.15.90:0/2162817269 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48001950 con 0x7fee40004c40 2024-09-21T03:22:33.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.330+0000 7fee53e00640 1 -- 172.21.15.90:0/2162817269 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee48001af0 con 0x7fee40004c40 2024-09-21T03:22:33.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.330+0000 7fee53e00640 1 -- 172.21.15.90:0/2162817269 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48003850 con 0x7fee40004c40 2024-09-21T03:22:33.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.331+0000 7fee63000640 1 -- 172.21.15.90:0/2162817269 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee5c1353e0 con 0x7fee40004c40 2024-09-21T03:22:33.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.332+0000 7fee63000640 1 -- 172.21.15.90:0/2162817269 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee5c1576a0 con 0x7fee40004c40 2024-09-21T03:22:33.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.335+0000 7fee63000640 1 --2- 172.21.15.90:0/2162817269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee5c156680 0x7fee5c1f4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:33.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.335+0000 7fee63000640 1 -- 172.21.15.90:0/2162817269 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c157520 con 0x7fee5c156680 2024-09-21T03:22:33.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.336+0000 7fee5b400640 1 --2- 172.21.15.90:0/2162817269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee5c156680 0x7fee5c1f4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:33.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.338+0000 7fee5b400640 1 -- 172.21.15.90:0/2162817269 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fee5c1540c0 con 0x7fee5c156680 2024-09-21T03:22:33.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.339+0000 7fee53e00640 1 -- 172.21.15.90:0/2162817269 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fee48007030 con 0x7fee40004c40 2024-09-21T03:22:33.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.339+0000 7fee5b400640 1 --2- 172.21.15.90:0/2162817269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee5c156680 0x7fee5c1f4ac0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fee5c06f530 tx=0x7fee4c011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:33.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.341+0000 7fee53e00640 1 --2- 172.21.15.90:0/2162817269 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fee3c078b90 0x7fee3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:33.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.342+0000 7fee53e00640 1 -- 172.21.15.90:0/2162817269 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fee480bb000 con 0x7fee40004c40 2024-09-21T03:22:33.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.342+0000 7fee53e00640 1 -- 172.21.15.90:0/2162817269 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c01e070 con 0x7fee5c156680 2024-09-21T03:22:33.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.342+0000 7fee53e00640 1 -- 172.21.15.90:0/2162817269 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fee4c00fce0 con 0x7fee5c156680 2024-09-21T03:22:33.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.342+0000 7fee53e00640 1 -- 172.21.15.90:0/2162817269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee5c156680 msgr2=0x7fee5c1f4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:33.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.342+0000 7fee53e00640 1 --2- 172.21.15.90:0/2162817269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee5c156680 0x7fee5c1f4ac0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fee5c06f530 tx=0x7fee4c011f00 comp rx=0 tx=0).stop 2024-09-21T03:22:33.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.342+0000 7fee53e00640 1 -- 172.21.15.90:0/2162817269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee5c156680 msgr2=0x7fee5c1f4ac0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:22:33.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.342+0000 7fee53e00640 1 --2- 172.21.15.90:0/2162817269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee5c156680 0x7fee5c1f4ac0 secure :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fee5c06f530 tx=0x7fee4c011f00 comp rx=0 tx=0).stop 2024-09-21T03:22:33.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.354+0000 7fee63000640 1 --2- 172.21.15.90:0/2162817269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee5c1f5000 0x7fee5c1f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:33.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.354+0000 7fee63000640 1 -- 172.21.15.90:0/2162817269 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c1f5950 con 0x7fee5c1f5000 2024-09-21T03:22:33.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.354+0000 7fee61000640 1 --2- 172.21.15.90:0/2162817269 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fee3c078b90 0x7fee3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:33.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.355+0000 7fee5b400640 1 --2- 172.21.15.90:0/2162817269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee5c1f5000 0x7fee5c1f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:33.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.356+0000 7fee61000640 1 --2- 172.21.15.90:0/2162817269 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fee3c078b90 0x7fee3c07b0a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fee5c1404f0 tx=0x7fee54001670 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:33.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.356+0000 7fee5b400640 1 -- 172.21.15.90:0/2162817269 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fee5c0c4280 con 0x7fee5c1f5000 2024-09-21T03:22:33.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.361+0000 7fee5b400640 1 --2- 172.21.15.90:0/2162817269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee5c1f5000 0x7fee5c1f5410 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fee4c004000 tx=0x7fee4c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:33.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.362+0000 7fee53e00640 1 -- 172.21.15.90:0/2162817269 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c01e040 con 0x7fee5c1f5000 2024-09-21T03:22:33.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.363+0000 7fee53e00640 1 -- 172.21.15.90:0/2162817269 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5195 (secure 0 0 0) 0x7fee4c0212d0 con 0x7fee5c1f5000 2024-09-21T03:22:33.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.363+0000 7fee53e00640 1 -- 172.21.15.90:0/2162817269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee5c1f5000 msgr2=0x7fee5c1f5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:33.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.363+0000 7fee53e00640 1 --2- 172.21.15.90:0/2162817269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee5c1f5000 0x7fee5c1f5410 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fee4c004000 tx=0x7fee4c005f90 comp rx=0 tx=0).stop 2024-09-21T03:22:33.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.363+0000 7fee53e00640 1 -- 172.21.15.90:0/2162817269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee5c1f5000 msgr2=0x7fee5c1f5410 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:22:33.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.363+0000 7fee53e00640 1 --2- 172.21.15.90:0/2162817269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee5c1f5000 0x7fee5c1f5410 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fee4c004000 tx=0x7fee4c005f90 comp rx=0 tx=0).stop 2024-09-21T03:22:33.366 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:22:33.366 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:22:33.366 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:22:33.366 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:22:33.366 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 58, 2024-09-21T03:22:33.366 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 197136, 2024-09-21T03:22:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:22:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:22:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:22:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:22:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 1, 2024-09-21T03:22:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:22:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:22:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:22:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:22:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:22:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:22:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:22:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:22:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:22:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:22:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:22:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:22:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:22:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:22:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:22:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:22:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:22:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:22:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:22:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:22:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:22:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:22:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:22:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:22:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:22:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:22:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:22:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:22:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:22:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:22:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:22:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:22:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:22:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:22:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:22:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:22:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:22:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:22:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:22:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:33.376 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:33.376 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:33.376 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:33.376 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:22:33.376 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:33.376 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:33.376 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:33.376 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:33.376 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:22:33.376 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:22:33.376 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:33.376 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:33.376 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:33.377 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:33.377 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:33.377 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:33.377 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:22:33.377 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:22:33.377 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:33.377 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:33.377 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:33.377 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:22:33.377 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:33.377 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:33.377 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:22:33.377 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:33.377 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:33.378 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:33.378 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:22:33.378 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:33.378 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:33.378 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:22:33.378 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:33.378 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:33.378 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:33.378 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:22:33.378 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:33.378 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:33.378 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:22:33.378 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:33.378 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:22:33.379 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:22:33.379 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:22:33.379 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:33.379 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:33.379 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:33.379 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:33.379 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:22:33.379 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:33.379 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:33.379 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:22:33.379 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:33.379 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:33.379 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:33.379 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:22:33.380 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:33.380 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:33.380 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:33.380 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:22:33.380 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:22:33.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.369+0000 7fee51600640 1 -- 172.21.15.90:0/2162817269 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fee3c078b90 msgr2=0x7fee3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:33.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.369+0000 7fee51600640 1 --2- 172.21.15.90:0/2162817269 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fee3c078b90 0x7fee3c07b0a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fee5c1404f0 tx=0x7fee54001670 comp rx=0 tx=0).stop 2024-09-21T03:22:33.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.369+0000 7fee51600640 1 -- 172.21.15.90:0/2162817269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee40004c40 msgr2=0x7fee5c154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:33.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.369+0000 7fee51600640 1 --2- 172.21.15.90:0/2162817269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee40004c40 0x7fee5c154f10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fee4802b930 tx=0x7fee48003c60 comp rx=0 tx=0).stop 2024-09-21T03:22:33.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.369+0000 7fee61000640 1 -- 172.21.15.90:0/2162817269 reap_dead start 2024-09-21T03:22:33.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.369+0000 7fee61000640 1 -- 172.21.15.90:0/2162817269 reap_dead start 2024-09-21T03:22:33.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.369+0000 7fee51600640 1 -- 172.21.15.90:0/2162817269 shutdown_connections 2024-09-21T03:22:33.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.369+0000 7fee51600640 1 -- 172.21.15.90:0/2162817269 >> 172.21.15.90:0/2162817269 conn(0x7fee5c0c81b0 msgr2=0x7fee5c0c6400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:33.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.369+0000 7fee51600640 1 -- 172.21.15.90:0/2162817269 shutdown_connections 2024-09-21T03:22:33.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.369+0000 7fee51600640 1 -- 172.21.15.90:0/2162817269 wait complete. 2024-09-21T03:22:33.449 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:22:33.449 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-21T03:22:33.449 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:22:33.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.980+0000 7f9ab9400640 1 -- 172.21.15.90:0/1760217034 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac02c910 con 0x7f9aa0003a00 2024-09-21T03:22:33.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.982+0000 7f9abb200640 1 -- 172.21.15.90:0/1760217034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9aa0003a00 msgr2=0x7f9aa0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:33.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.983+0000 7f9abb200640 1 --2- 172.21.15.90:0/1760217034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9aa0003a00 0x7f9aa0003e30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0042f0 tx=0x7f9aa0005830 comp rx=0 tx=0).stop 2024-09-21T03:22:33.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.986+0000 7f9abb200640 1 -- 172.21.15.90:0/1760217034 shutdown_connections 2024-09-21T03:22:33.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.986+0000 7f9abb200640 1 --2- 172.21.15.90:0/1760217034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9aa0003a00 0x7f9aa0003e30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:33.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.986+0000 7f9abb200640 1 -- 172.21.15.90:0/1760217034 >> 172.21.15.90:0/1760217034 conn(0x7f9abc06d570 msgr2=0x7f9abc0c7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:33.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.987+0000 7f9abb200640 1 -- 172.21.15.90:0/1760217034 shutdown_connections 2024-09-21T03:22:33.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.987+0000 7f9abb200640 1 -- 172.21.15.90:0/1760217034 wait complete. 2024-09-21T03:22:33.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:33.993+0000 7f9abb200640 1 Processor -- start 2024-09-21T03:22:34.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.007+0000 7f9abb200640 1 -- start start 2024-09-21T03:22:34.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.012+0000 7f9abb200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aa0003a00 0x7f9abc154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:34.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.013+0000 7f9abb200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9abc14f690 0x7f9abc0abc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:34.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.013+0000 7f9abb200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9abc0ac170 0x7f9abc14e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:34.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.013+0000 7f9ab9e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aa0003a00 0x7f9abc154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:34.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.013+0000 7f9ab9e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aa0003a00 0x7f9abc154070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:42876/0 (socket says 172.21.15.90:42876) 2024-09-21T03:22:34.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.014+0000 7f9ab1400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9abc14f690 0x7f9abc0abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:34.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.016+0000 7f9abb200640 1 -- 172.21.15.90:0/1663603893 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc0c8830 con 0x7f9abc0ac170 2024-09-21T03:22:34.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.016+0000 7f9abb200640 1 -- 172.21.15.90:0/1663603893 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc0c86b0 con 0x7f9abc14f690 2024-09-21T03:22:34.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.016+0000 7f9abb200640 1 -- 172.21.15.90:0/1663603893 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9abc149580 con 0x7f9aa0003a00 2024-09-21T03:22:34.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.014+0000 7f9ab9e00640 1 -- 172.21.15.90:0/1663603893 learned_addr learned my addr 172.21.15.90:0/1663603893 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:22:34.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.017+0000 7f9aba800640 1 --2- 172.21.15.90:0/1663603893 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9abc0ac170 0x7f9abc14e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:34.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.017+0000 7f9ab9e00640 1 -- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9abc14f690 msgr2=0x7f9abc0abc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:34.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.017+0000 7f9ab9e00640 1 --2- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9abc14f690 0x7f9abc0abc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.017+0000 7f9ab9e00640 1 -- 172.21.15.90:0/1663603893 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9abc0ac170 msgr2=0x7f9abc14e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:34.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.017+0000 7f9ab9e00640 1 --2- 172.21.15.90:0/1663603893 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9abc0ac170 0x7f9abc14e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.017+0000 7f9ab9e00640 1 -- 172.21.15.90:0/1663603893 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9abc1545b0 con 0x7f9aa0003a00 2024-09-21T03:22:34.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.018+0000 7f9aba800640 1 --2- 172.21.15.90:0/1663603893 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9abc0ac170 0x7f9abc14e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:22:34.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.018+0000 7f9ab9e00640 1 --2- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aa0003a00 0x7f9abc154070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0047a0 tx=0x7f9aac002090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.019+0000 7f9ab2a00640 1 -- 172.21.15.90:0/1663603893 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac004330 con 0x7f9aa0003a00 2024-09-21T03:22:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.019+0000 7f9abb200640 1 -- 172.21.15.90:0/1663603893 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9abc152a30 con 0x7f9aa0003a00 2024-09-21T03:22:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.019+0000 7f9ab2a00640 1 -- 172.21.15.90:0/1663603893 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9aac001b60 con 0x7f9aa0003a00 2024-09-21T03:22:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.020+0000 7f9ab2a00640 1 -- 172.21.15.90:0/1663603893 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac007c60 con 0x7f9aa0003a00 2024-09-21T03:22:34.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.020+0000 7f9abb200640 1 -- 172.21.15.90:0/1663603893 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9abc1ecdf0 con 0x7f9aa0003a00 2024-09-21T03:22:34.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.023+0000 7f9abb200640 1 --2- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9abc1547d0 0x7f9abc14faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:34.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.024+0000 7f9abb200640 1 -- 172.21.15.90:0/1663603893 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc0acfc0 con 0x7f9abc1547d0 2024-09-21T03:22:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.024+0000 7f9ab1400640 1 --2- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9abc1547d0 0x7f9abc14faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:34.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.027+0000 7f9ab1400640 1 -- 172.21.15.90:0/1663603893 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9abc14ad00 con 0x7f9abc1547d0 2024-09-21T03:22:34.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.031+0000 7f9ab1400640 1 --2- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9abc1547d0 0x7f9abc14faa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9abc148990 tx=0x7f9aa400d8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:34.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.031+0000 7f9ab2a00640 1 -- 172.21.15.90:0/1663603893 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9aac02cb30 con 0x7f9aa0003a00 2024-09-21T03:22:34.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.033+0000 7f9ab2a00640 1 --2- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9a98078b90 0x7f9a9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:34.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.033+0000 7f9ab2a00640 1 -- 172.21.15.90:0/1663603893 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f9aac0bba20 con 0x7f9aa0003a00 2024-09-21T03:22:34.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.034+0000 7f9ab2a00640 1 -- 172.21.15.90:0/1663603893 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa40125f0 con 0x7f9abc1547d0 2024-09-21T03:22:34.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.034+0000 7f9aba800640 1 --2- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9a98078b90 0x7f9a9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:34.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.035+0000 7f9ab2a00640 1 -- 172.21.15.90:0/1663603893 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9aa4019070 con 0x7f9abc1547d0 2024-09-21T03:22:34.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.035+0000 7f9ab2a00640 1 -- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9abc1547d0 msgr2=0x7f9abc14faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:34.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.035+0000 7f9ab2a00640 1 --2- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9abc1547d0 0x7f9abc14faa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9abc148990 tx=0x7f9aa400d8f0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.035+0000 7f9ab2a00640 1 -- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9abc1547d0 msgr2=0x7f9abc14faa0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:22:34.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.035+0000 7f9ab2a00640 1 --2- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9abc1547d0 0x7f9abc14faa0 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9abc148990 tx=0x7f9aa400d8f0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.037+0000 7f9aba800640 1 --2- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9a98078b90 0x7f9a9807b0a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0aa8d0 tx=0x7f9ab4006ac0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:34.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.049+0000 7f9abb200640 1 --2- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9abc1ecff0 0x7f9abc14e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:34.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.050+0000 7f9abb200640 1 -- 172.21.15.90:0/1663603893 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc1499b0 con 0x7f9abc1ecff0 2024-09-21T03:22:34.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.050+0000 7f9ab1400640 1 --2- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9abc1ecff0 0x7f9abc14e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:34.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.051+0000 7f9ab1400640 1 -- 172.21.15.90:0/1663603893 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9abc0c7fa0 con 0x7f9abc1ecff0 2024-09-21T03:22:34.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.052+0000 7f9ab1400640 1 --2- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9abc1ecff0 0x7f9abc14e6e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4018000 tx=0x7f9aa4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:34.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.053+0000 7f9ab2a00640 1 -- 172.21.15.90:0/1663603893 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4024070 con 0x7f9abc1ecff0 2024-09-21T03:22:34.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.053+0000 7f9ab2a00640 1 -- 172.21.15.90:0/1663603893 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4547 (secure 0 0 0) 0x7f9aa4014430 con 0x7f9abc1ecff0 2024-09-21T03:22:34.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.053+0000 7f9ab2a00640 1 -- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9abc1ecff0 msgr2=0x7f9abc14e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:34.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.053+0000 7f9ab2a00640 1 --2- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9abc1ecff0 0x7f9abc14e6e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4018000 tx=0x7f9aa4004770 comp rx=0 tx=0).stop 2024-09-21T03:22:34.055 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:22:34.055 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:22:34.055 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:22:34.056 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:22:34.056 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 58, 2024-09-21T03:22:34.056 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 6261, 2024-09-21T03:22:34.056 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:22:34.056 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:22:34.056 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:22:34.056 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:22:34.056 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:34.056 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 1, 2024-09-21T03:22:34.056 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:22:34.056 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:22:34.056 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:22:34.056 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:34.056 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:34.057 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:34.057 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:34.057 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:34.057 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:34.057 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:34.057 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:34.057 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:34.057 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:34.057 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:34.057 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:34.057 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:22:34.057 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:22:34.057 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:34.057 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:34.057 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:34.058 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:34.058 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:34.058 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:34.058 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:34.058 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:34.058 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:34.058 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:34.058 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:34.058 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:34.058 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.058 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:22:34.058 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:22:34.058 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:22:34.058 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:22:34.059 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:22:34.059 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:22:34.059 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:22:34.059 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:22:34.059 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:22:34.059 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:22:34.059 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:22:34.059 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:22:34.059 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:22:34.059 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:22:34.059 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:22:34.059 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:22:34.059 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:22:34.059 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:34.059 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:34.060 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:34.060 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:34.060 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:34.060 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:34.060 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:34.060 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:34.060 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:34.060 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:34.060 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:34.060 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:34.060 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:22:34.060 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.060 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:22:34.060 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.060 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:22:34.061 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:22:34.061 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:34.061 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:34.061 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.061 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:34.061 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:22:34.061 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:34.061 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.061 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.061 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:34.061 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:22:34.061 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:34.061 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:34.061 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:34.062 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.062 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:22:34.062 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:22:34.062 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:34.062 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:34.062 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:34.062 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.062 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.062 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:22:34.062 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:22:34.062 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:34.062 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:34.062 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.062 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:34.063 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:22:34.063 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:34.063 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.063 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.063 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:34.063 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:22:34.063 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:34.063 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:34.063 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:34.063 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.063 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:22:34.063 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:22:34.063 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:34.063 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:34.063 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:34.064 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.064 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.064 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:22:34.064 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:22:34.064 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:34.064 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:34.064 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.064 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:34.064 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:22:34.064 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:34.064 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.064 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.064 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:34.064 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:22:34.064 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:34.064 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:34.065 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:34.065 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.065 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:22:34.065 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:22:34.065 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:34.065 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:34.065 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:34.065 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:34.065 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:34.065 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.065 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:22:34.065 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:22:34.065 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.065 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:34.065 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:34.066 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:22:34.066 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:34.066 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:34.066 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:22:34.066 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.066 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:34.066 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:34.066 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:22:34.066 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:34.066 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:34.066 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.066 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:22:34.066 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:22:34.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.053+0000 7f9ab2a00640 1 -- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9abc1ecff0 msgr2=0x7f9abc14e6e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:22:34.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.054+0000 7f9ab2a00640 1 --2- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9abc1ecff0 0x7f9abc14e6e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.056+0000 7f9abb200640 1 -- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9a98078b90 msgr2=0x7f9a9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:34.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.056+0000 7f9abb200640 1 --2- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9a98078b90 0x7f9a9807b0a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0aa8d0 tx=0x7f9ab4006ac0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.056+0000 7f9abb200640 1 -- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aa0003a00 msgr2=0x7f9abc154070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:34.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.056+0000 7f9abb200640 1 --2- 172.21.15.90:0/1663603893 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aa0003a00 0x7f9abc154070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0047a0 tx=0x7f9aac002090 comp rx=0 tx=0).stop 2024-09-21T03:22:34.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.056+0000 7f9aba800640 1 -- 172.21.15.90:0/1663603893 reap_dead start 2024-09-21T03:22:34.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.056+0000 7f9aba800640 1 -- 172.21.15.90:0/1663603893 reap_dead start 2024-09-21T03:22:34.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.056+0000 7f9abb200640 1 -- 172.21.15.90:0/1663603893 shutdown_connections 2024-09-21T03:22:34.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.056+0000 7f9abb200640 1 -- 172.21.15.90:0/1663603893 >> 172.21.15.90:0/1663603893 conn(0x7f9abc06d570 msgr2=0x7f9abc0c6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:34.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.061+0000 7f9abb200640 1 -- 172.21.15.90:0/1663603893 shutdown_connections 2024-09-21T03:22:34.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.061+0000 7f9abb200640 1 -- 172.21.15.90:0/1663603893 wait complete. 2024-09-21T03:22:34.114 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:22:34.115 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-21T03:22:34.115 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:22:34.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.601+0000 7fd197c00640 1 -- 172.21.15.90:0/2282700317 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd190070e60 msgr2=0x7fd19006fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:34.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.601+0000 7fd197c00640 1 --2- 172.21.15.90:0/2282700317 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd190070e60 0x7fd19006fa00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd188009bb0 tx=0x7fd18802a8d0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.603+0000 7fd197c00640 1 -- 172.21.15.90:0/2282700317 shutdown_connections 2024-09-21T03:22:34.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.603+0000 7fd197c00640 1 --2- 172.21.15.90:0/2282700317 >> v2:172.21.15.149:3300/0 conn(0x7fd1900731e0 0x7fd1900c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.603+0000 7fd197c00640 1 --2- 172.21.15.90:0/2282700317 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd190070e60 0x7fd19006fa00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.603+0000 7fd197c00640 1 -- 172.21.15.90:0/2282700317 >> 172.21.15.90:0/2282700317 conn(0x7fd1900c85a0 msgr2=0x7fd1900c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:34.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.605+0000 7fd197c00640 1 -- 172.21.15.90:0/2282700317 shutdown_connections 2024-09-21T03:22:34.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.605+0000 7fd197c00640 1 -- 172.21.15.90:0/2282700317 wait complete. 2024-09-21T03:22:34.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.609+0000 7fd197c00640 1 Processor -- start 2024-09-21T03:22:34.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.610+0000 7fd197c00640 1 -- start start 2024-09-21T03:22:34.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.611+0000 7fd197c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd190070e60 0x7fd1900c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:34.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.611+0000 7fd197c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1900731e0 0x7fd1900ac020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:34.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.611+0000 7fd197c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1900c3500 0x7fd1900acab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:34.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.611+0000 7fd197c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd190150840 con 0x7fd190070e60 2024-09-21T03:22:34.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.611+0000 7fd197c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd190153b20 con 0x7fd1900c3500 2024-09-21T03:22:34.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.611+0000 7fd197c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd190073e20 con 0x7fd1900731e0 2024-09-21T03:22:34.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.613+0000 7fd195200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd190070e60 0x7fd1900c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:34.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.613+0000 7fd195c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1900c3500 0x7fd1900acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:34.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.613+0000 7fd195200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd190070e60 0x7fd1900c7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56312/0 (socket says 172.21.15.90:56312) 2024-09-21T03:22:34.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.613+0000 7fd195200640 1 -- 172.21.15.90:0/4129643222 learned_addr learned my addr 172.21.15.90:0/4129643222 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:22:34.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.615+0000 7fd195200640 1 -- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1900731e0 msgr2=0x7fd1900ac020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:34.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.615+0000 7fd195200640 1 --2- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1900731e0 0x7fd1900ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.615+0000 7fd195200640 1 -- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1900c3500 msgr2=0x7fd1900acab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:34.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.615+0000 7fd195200640 1 --2- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1900c3500 0x7fd1900acab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.615+0000 7fd195200640 1 -- 172.21.15.90:0/4129643222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1900c6be0 con 0x7fd190070e60 2024-09-21T03:22:34.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.617+0000 7fd195200640 1 --2- 172.21.15.90:0/4129643222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd190070e60 0x7fd1900c7b00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd188033040 tx=0x7fd188031b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:34.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.619+0000 7fd18cc00640 1 -- 172.21.15.90:0/4129643222 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18803fa10 con 0x7fd190070e60 2024-09-21T03:22:34.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.619+0000 7fd18cc00640 1 -- 172.21.15.90:0/4129643222 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd18803fca0 con 0x7fd190070e60 2024-09-21T03:22:34.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.619+0000 7fd18cc00640 1 -- 172.21.15.90:0/4129643222 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18803fa10 con 0x7fd190070e60 2024-09-21T03:22:34.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.619+0000 7fd197c00640 1 -- 172.21.15.90:0/4129643222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1900c6ec0 con 0x7fd190070e60 2024-09-21T03:22:34.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.619+0000 7fd197c00640 1 -- 172.21.15.90:0/4129643222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd19014dec0 con 0x7fd190070e60 2024-09-21T03:22:34.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.621+0000 7fd197c00640 1 --2- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1900acff0 0x7fd1901df710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:34.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.621+0000 7fd197c00640 1 -- 172.21.15.90:0/4129643222 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd1900ad4a0 con 0x7fd1900acff0 2024-09-21T03:22:34.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.622+0000 7fd18fe00640 1 --2- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1900acff0 0x7fd1901df710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:34.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.623+0000 7fd18cc00640 1 -- 172.21.15.90:0/4129643222 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd188003fa0 con 0x7fd190070e60 2024-09-21T03:22:34.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.626+0000 7fd18cc00640 1 --2- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd170078d90 0x7fd17007b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:34.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.626+0000 7fd18cc00640 1 -- 172.21.15.90:0/4129643222 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fd1880c0a10 con 0x7fd190070e60 2024-09-21T03:22:34.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.628+0000 7fd195c00640 1 --2- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd170078d90 0x7fd17007b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:34.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.629+0000 7fd195c00640 1 --2- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd170078d90 0x7fd17007b2a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd190150f00 tx=0x7fd180009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:34.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.630+0000 7fd18fe00640 1 -- 172.21.15.90:0/4129643222 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd1900c6990 con 0x7fd1900acff0 2024-09-21T03:22:34.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.631+0000 7fd18fe00640 1 --2- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1900acff0 0x7fd1901df710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd1900ab940 tx=0x7fd17c00eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:34.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.631+0000 7fd18cc00640 1 -- 172.21.15.90:0/4129643222 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd17c00ca70 con 0x7fd1900acff0 2024-09-21T03:22:34.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.632+0000 7fd18cc00640 1 -- 172.21.15.90:0/4129643222 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd17c00cc10 con 0x7fd1900acff0 2024-09-21T03:22:34.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.632+0000 7fd18cc00640 1 -- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1900acff0 msgr2=0x7fd1901df710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:34.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.632+0000 7fd18cc00640 1 --2- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1900acff0 0x7fd1901df710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd1900ab940 tx=0x7fd17c00eb50 comp rx=0 tx=0).stop 2024-09-21T03:22:34.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.632+0000 7fd18cc00640 1 -- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1900acff0 msgr2=0x7fd1901df710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:22:34.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.632+0000 7fd18cc00640 1 --2- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1900acff0 0x7fd1901df710 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd1900ab940 tx=0x7fd17c00eb50 comp rx=0 tx=0).stop 2024-09-21T03:22:34.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.662+0000 7fd197c00640 1 --2- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd190156b60 0x7fd1901dfc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:34.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.662+0000 7fd197c00640 1 -- 172.21.15.90:0/4129643222 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd190156850 con 0x7fd190156b60 2024-09-21T03:22:34.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.664+0000 7fd18fe00640 1 --2- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd190156b60 0x7fd1901dfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:34.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.665+0000 7fd18fe00640 1 -- 172.21.15.90:0/4129643222 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd190152020 con 0x7fd190156b60 2024-09-21T03:22:34.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.667+0000 7fd18fe00640 1 --2- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd190156b60 0x7fd1901dfc50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd1900c6940 tx=0x7fd17c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:34.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.672+0000 7fd18cc00640 1 -- 172.21.15.90:0/4129643222 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd17c00ca70 con 0x7fd190156b60 2024-09-21T03:22:34.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.672+0000 7fd18cc00640 1 -- 172.21.15.90:0/4129643222 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5049 (secure 0 0 0) 0x7fd17c004a00 con 0x7fd190156b60 2024-09-21T03:22:34.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.672+0000 7fd18cc00640 1 -- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd190156b60 msgr2=0x7fd1901dfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:34.675 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:22:34.675 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:22:34.675 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:22:34.675 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:22:34.675 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 58, 2024-09-21T03:22:34.675 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 64990, 2024-09-21T03:22:34.675 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:22:34.675 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:22:34.675 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:22:34.675 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:22:34.675 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:34.675 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 2, 2024-09-21T03:22:34.676 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:22:34.676 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:22:34.676 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:22:34.676 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:34.676 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:34.676 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:34.676 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:34.676 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:34.676 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:34.676 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:34.676 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:34.676 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:34.676 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:34.676 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:34.677 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:34.677 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:22:34.677 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:22:34.677 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:34.677 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:34.677 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:34.677 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:34.677 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:34.677 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:34.677 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:34.677 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:34.678 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:34.678 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:34.678 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:34.678 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:34.678 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.678 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:22:34.678 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:22:34.678 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:22:34.678 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:22:34.678 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:22:34.678 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:22:34.678 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:22:34.678 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:22:34.678 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:22:34.679 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:22:34.679 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:22:34.679 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:22:34.679 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:22:34.679 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:22:34.679 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:22:34.679 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:22:34.679 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:22:34.679 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:34.679 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:34.679 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:34.679 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:34.679 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:34.680 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:34.680 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:34.680 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:34.680 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:34.680 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:34.680 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:34.680 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:34.680 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:22:34.680 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.680 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:22:34.680 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.680 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:22:34.680 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:22:34.681 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:34.681 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:34.681 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.681 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:34.681 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:22:34.681 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:34.681 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.681 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.681 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:34.681 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:22:34.681 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:34.681 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:34.681 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:34.681 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.681 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:22:34.682 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:22:34.682 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:34.682 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:34.682 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:34.682 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.682 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.682 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:22:34.682 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:22:34.682 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:34.682 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:34.682 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.682 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:34.682 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:22:34.682 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:34.682 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.683 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.683 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:34.683 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:22:34.683 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:34.683 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:34.683 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:34.683 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.683 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:22:34.683 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:22:34.684 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:34.684 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:34.684 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:34.684 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.684 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.684 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:22:34.684 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:22:34.684 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:34.684 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:34.684 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.684 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:34.684 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:22:34.684 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:34.685 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.685 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.685 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:34.685 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:22:34.685 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:34.685 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:34.685 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:34.685 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.685 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:22:34.685 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:22:34.685 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:34.685 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:34.686 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:34.686 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:34.686 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:34.686 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.686 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:22:34.686 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:22:34.686 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.686 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:34.686 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:34.686 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:22:34.686 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:34.686 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:34.686 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:22:34.686 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.687 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:34.687 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:34.687 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:22:34.687 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:34.687 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:34.687 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:22:34.687 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.687 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:34.687 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:34.687 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:22:34.687 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:34.687 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:34.687 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:22:34.687 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.688 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:34.688 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:34.688 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:22:34.688 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:34.688 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:34.688 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:22:34.688 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:34.688 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:34.688 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:34.688 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:22:34.688 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:34.688 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:34.688 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:34.689 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:22:34.689 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:22:34.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.673+0000 7fd18cc00640 1 --2- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd190156b60 0x7fd1901dfc50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd1900c6940 tx=0x7fd17c0046c0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.673+0000 7fd18cc00640 1 -- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd190156b60 msgr2=0x7fd1901dfc50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:22:34.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.673+0000 7fd18cc00640 1 --2- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd190156b60 0x7fd1901dfc50 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd1900c6940 tx=0x7fd17c0046c0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.674+0000 7fd197c00640 1 -- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd170078d90 msgr2=0x7fd17007b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:34.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.674+0000 7fd197c00640 1 --2- 172.21.15.90:0/4129643222 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd170078d90 0x7fd17007b2a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd190150f00 tx=0x7fd180009040 comp rx=0 tx=0).stop 2024-09-21T03:22:34.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.674+0000 7fd197c00640 1 -- 172.21.15.90:0/4129643222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd190070e60 msgr2=0x7fd1900c7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:34.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.674+0000 7fd197c00640 1 --2- 172.21.15.90:0/4129643222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd190070e60 0x7fd1900c7b00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd188033040 tx=0x7fd188031b00 comp rx=0 tx=0).stop 2024-09-21T03:22:34.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.676+0000 7fd195c00640 1 -- 172.21.15.90:0/4129643222 reap_dead start 2024-09-21T03:22:34.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.676+0000 7fd195c00640 1 -- 172.21.15.90:0/4129643222 reap_dead start 2024-09-21T03:22:34.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.677+0000 7fd197c00640 1 -- 172.21.15.90:0/4129643222 shutdown_connections 2024-09-21T03:22:34.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.677+0000 7fd197c00640 1 -- 172.21.15.90:0/4129643222 >> 172.21.15.90:0/4129643222 conn(0x7fd1900c85a0 msgr2=0x7fd19006f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:34.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.677+0000 7fd197c00640 1 -- 172.21.15.90:0/4129643222 shutdown_connections 2024-09-21T03:22:34.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:34.678+0000 7fd197c00640 1 -- 172.21.15.90:0/4129643222 wait complete. 2024-09-21T03:22:34.727 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:22:34.728 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-21T03:22:34.728 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-21T03:22:35.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.238+0000 7fe68be00640 1 -- 172.21.15.90:0/2155603965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe68c0c4720 msgr2=0x7fe68c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:35.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.238+0000 7fe68be00640 1 --2- 172.21.15.90:0/2155603965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe68c0c4720 0x7fe68c06ec80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe67c00d930 tx=0x7fe67c02a200 comp rx=0 tx=0).stop 2024-09-21T03:22:35.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.239+0000 7fe68be00640 1 -- 172.21.15.90:0/2155603965 shutdown_connections 2024-09-21T03:22:35.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.239+0000 7fe68be00640 1 --2- 172.21.15.90:0/2155603965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe68c0c4720 0x7fe68c06ec80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:35.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.239+0000 7fe68be00640 1 -- 172.21.15.90:0/2155603965 >> 172.21.15.90:0/2155603965 conn(0x7fe68c0c80a0 msgr2=0x7fe68c0c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:35.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.239+0000 7fe68be00640 1 -- 172.21.15.90:0/2155603965 shutdown_connections 2024-09-21T03:22:35.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.239+0000 7fe68be00640 1 -- 172.21.15.90:0/2155603965 wait complete. 2024-09-21T03:22:35.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.248+0000 7fe68be00640 1 Processor -- start 2024-09-21T03:22:35.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.249+0000 7fe68be00640 1 -- start start 2024-09-21T03:22:35.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.260+0000 7fe68be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe68c0ab780 0x7fe68c14dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:35.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.260+0000 7fe68be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe68c0c4720 0x7fe68c14f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:35.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.266+0000 7fe68be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe68c1494a0 0x7fe68c14fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:35.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.266+0000 7fe68aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe68c0ab780 0x7fe68c14dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:35.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.266+0000 7fe68aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe68c0ab780 0x7fe68c14dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:41378/0 (socket says 172.21.15.90:41378) 2024-09-21T03:22:35.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.266+0000 7fe68aa00640 1 -- 172.21.15.90:0/401703104 learned_addr learned my addr 172.21.15.90:0/401703104 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:22:35.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.266+0000 7fe68be00640 1 -- 172.21.15.90:0/401703104 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c074f30 con 0x7fe68c0c4720 2024-09-21T03:22:35.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.266+0000 7fe68be00640 1 -- 172.21.15.90:0/401703104 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c1498b0 con 0x7fe68c0ab780 2024-09-21T03:22:35.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.266+0000 7fe68be00640 1 -- 172.21.15.90:0/401703104 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe68c0c5700 con 0x7fe68c1494a0 2024-09-21T03:22:35.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.267+0000 7fe68b400640 1 --2- 172.21.15.90:0/401703104 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe68c1494a0 0x7fe68c14fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:35.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.268+0000 7fe68b400640 1 -- 172.21.15.90:0/401703104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe68c0ab780 msgr2=0x7fe68c14dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:35.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.268+0000 7fe68b400640 1 --2- 172.21.15.90:0/401703104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe68c0ab780 0x7fe68c14dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:35.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.268+0000 7fe68b400640 1 -- 172.21.15.90:0/401703104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe68c0c4720 msgr2=0x7fe68c14f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:35.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.268+0000 7fe68b400640 1 --2- 172.21.15.90:0/401703104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe68c0c4720 0x7fe68c14f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:35.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.268+0000 7fe68b400640 1 -- 172.21.15.90:0/401703104 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68c0c22c0 con 0x7fe68c1494a0 2024-09-21T03:22:35.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.269+0000 7fe68b400640 1 --2- 172.21.15.90:0/401703104 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe68c1494a0 0x7fe68c14fb00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe68400c730 tx=0x7fe68400cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:35.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.269+0000 7fe682a00640 1 -- 172.21.15.90:0/401703104 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe684003b70 con 0x7fe68c1494a0 2024-09-21T03:22:35.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.270+0000 7fe682a00640 1 -- 172.21.15.90:0/401703104 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe684003d10 con 0x7fe68c1494a0 2024-09-21T03:22:35.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.270+0000 7fe682a00640 1 -- 172.21.15.90:0/401703104 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6840052d0 con 0x7fe68c1494a0 2024-09-21T03:22:35.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.276+0000 7fe68be00640 1 -- 172.21.15.90:0/401703104 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe68c1f13e0 con 0x7fe68c1494a0 2024-09-21T03:22:35.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.276+0000 7fe68be00640 1 -- 172.21.15.90:0/401703104 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe68c14d490 con 0x7fe68c1494a0 2024-09-21T03:22:35.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.286+0000 7fe68be00640 1 -- 172.21.15.90:0/401703104 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe68c0ae440 con 0x7fe68c1494a0 2024-09-21T03:22:35.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.290+0000 7fe682a00640 1 -- 172.21.15.90:0/401703104 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe684005470 con 0x7fe68c1494a0 2024-09-21T03:22:35.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.291+0000 7fe682a00640 1 --2- 172.21.15.90:0/401703104 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe66c078b90 0x7fe66c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:35.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.291+0000 7fe682a00640 1 -- 172.21.15.90:0/401703104 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fe68409a960 con 0x7fe68c1494a0 2024-09-21T03:22:35.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.298+0000 7fe68aa00640 1 --2- 172.21.15.90:0/401703104 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe66c078b90 0x7fe66c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:35.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.302+0000 7fe682a00640 1 -- 172.21.15.90:0/401703104 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe68c0ae440 con 0x7fe68c1494a0 2024-09-21T03:22:35.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.302+0000 7fe68aa00640 1 --2- 172.21.15.90:0/401703104 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe66c078b90 0x7fe66c07b0a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe67c035040 tx=0x7fe67c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:35.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.955+0000 7fe68be00640 1 -- 172.21.15.90:0/401703104 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fe68c0c24c0 con 0x7fe68c1494a0 2024-09-21T03:22:35.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.970+0000 7fe682a00640 1 -- 172.21.15.90:0/401703104 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fe684020060 con 0x7fe68c1494a0 2024-09-21T03:22:35.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.985+0000 7fe68be00640 1 -- 172.21.15.90:0/401703104 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe66c078b90 msgr2=0x7fe66c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:35.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.985+0000 7fe68be00640 1 --2- 172.21.15.90:0/401703104 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe66c078b90 0x7fe66c07b0a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe67c035040 tx=0x7fe67c004730 comp rx=0 tx=0).stop 2024-09-21T03:22:35.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.985+0000 7fe68be00640 1 -- 172.21.15.90:0/401703104 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe68c1494a0 msgr2=0x7fe68c14fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:35.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.985+0000 7fe68be00640 1 --2- 172.21.15.90:0/401703104 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe68c1494a0 0x7fe68c14fb00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe68400c730 tx=0x7fe68400cbf0 comp rx=0 tx=0).stop 2024-09-21T03:22:35.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.989+0000 7fe68be00640 1 -- 172.21.15.90:0/401703104 shutdown_connections 2024-09-21T03:22:35.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.989+0000 7fe68be00640 1 --2- 172.21.15.90:0/401703104 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe66c078b90 0x7fe66c07b0a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:35.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.989+0000 7fe68be00640 1 --2- 172.21.15.90:0/401703104 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe68c1494a0 0x7fe68c14fb00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:35.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.989+0000 7fe68be00640 1 --2- 172.21.15.90:0/401703104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe68c0c4720 0x7fe68c14f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:35.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.989+0000 7fe68be00640 1 --2- 172.21.15.90:0/401703104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe68c0ab780 0x7fe68c14dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:35.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.989+0000 7fe68be00640 1 -- 172.21.15.90:0/401703104 >> 172.21.15.90:0/401703104 conn(0x7fe68c0c80a0 msgr2=0x7fe68c0733f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:35.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.990+0000 7fe68be00640 1 -- 172.21.15.90:0/401703104 shutdown_connections 2024-09-21T03:22:35.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:35.990+0000 7fe68be00640 1 -- 172.21.15.90:0/401703104 wait complete. 2024-09-21T03:22:36.084 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-21T03:22:46.084 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-21T03:22:46.085 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:22:46.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.568+0000 7fe16ce00640 1 -- 172.21.15.90:0/2652281567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe14c004800 msgr2=0x7fe14c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:46.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.568+0000 7fe16ce00640 1 --2- 172.21.15.90:0/2652281567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe14c004800 0x7fe14c004c10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe160006e80 tx=0x7fe14c005830 comp rx=0 tx=0).stop 2024-09-21T03:22:46.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.570+0000 7fe16ce00640 1 -- 172.21.15.90:0/2652281567 shutdown_connections 2024-09-21T03:22:46.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.570+0000 7fe16ce00640 1 --2- 172.21.15.90:0/2652281567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe14c004800 0x7fe14c004c10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:46.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.570+0000 7fe16ce00640 1 -- 172.21.15.90:0/2652281567 >> 172.21.15.90:0/2652281567 conn(0x7fe16806ead0 msgr2=0x7fe16806eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:46.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.570+0000 7fe16ce00640 1 -- 172.21.15.90:0/2652281567 shutdown_connections 2024-09-21T03:22:46.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.571+0000 7fe16ce00640 1 -- 172.21.15.90:0/2652281567 wait complete. 2024-09-21T03:22:46.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.577+0000 7fe16ce00640 1 Processor -- start 2024-09-21T03:22:46.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.579+0000 7fe16ce00640 1 -- start start 2024-09-21T03:22:46.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.582+0000 7fe16ce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe14c004800 0x7fe168148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:46.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.583+0000 7fe16ce00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe16814fcf0 0x7fe1681ebe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:46.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.583+0000 7fe16ce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1681ec3a0 0x7fe168141b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:46.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.583+0000 7fe16ce00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe1680c2d40 con 0x7fe14c004800 2024-09-21T03:22:46.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.583+0000 7fe16ce00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe1680acf00 con 0x7fe16814fcf0 2024-09-21T03:22:46.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.583+0000 7fe16ce00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe1680c2ec0 con 0x7fe1681ec3a0 2024-09-21T03:22:46.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.583+0000 7fe165400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe14c004800 0x7fe168148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:46.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.584+0000 7fe164a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe16814fcf0 0x7fe1681ebe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:46.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.584+0000 7fe164a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe16814fcf0 0x7fe1681ebe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:43934/0 (socket says 172.21.15.90:43934) 2024-09-21T03:22:46.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.584+0000 7fe165e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1681ec3a0 0x7fe168141b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:46.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.584+0000 7fe164a00640 1 -- 172.21.15.90:0/3641585428 learned_addr learned my addr 172.21.15.90:0/3641585428 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:22:46.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.586+0000 7fe164a00640 1 -- 172.21.15.90:0/3641585428 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1681ec3a0 msgr2=0x7fe168141b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:46.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.586+0000 7fe164a00640 1 --2- 172.21.15.90:0/3641585428 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1681ec3a0 0x7fe168141b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:46.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.586+0000 7fe164a00640 1 -- 172.21.15.90:0/3641585428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe14c004800 msgr2=0x7fe168148350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:46.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.586+0000 7fe164a00640 1 --2- 172.21.15.90:0/3641585428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe14c004800 0x7fe168148350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:46.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.586+0000 7fe164a00640 1 -- 172.21.15.90:0/3641585428 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe168074d70 con 0x7fe16814fcf0 2024-09-21T03:22:46.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.586+0000 7fe165400640 1 --2- 172.21.15.90:0/3641585428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe14c004800 0x7fe168148350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:22:46.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.587+0000 7fe164a00640 1 --2- 172.21.15.90:0/3641585428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe16814fcf0 0x7fe1681ebe60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe160006f70 tx=0x7fe160001710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:46.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.589+0000 7fe15e000640 1 -- 172.21.15.90:0/3641585428 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160043070 con 0x7fe16814fcf0 2024-09-21T03:22:46.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.589+0000 7fe15e000640 1 -- 172.21.15.90:0/3641585428 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe160003b20 con 0x7fe16814fcf0 2024-09-21T03:22:46.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.589+0000 7fe15e000640 1 -- 172.21.15.90:0/3641585428 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160036070 con 0x7fe16814fcf0 2024-09-21T03:22:46.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.590+0000 7fe16ce00640 1 -- 172.21.15.90:0/3641585428 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1680c24e0 con 0x7fe16814fcf0 2024-09-21T03:22:46.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.590+0000 7fe16ce00640 1 -- 172.21.15.90:0/3641585428 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe168074a90 con 0x7fe16814fcf0 2024-09-21T03:22:46.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.592+0000 7fe16ce00640 1 -- 172.21.15.90:0/3641585428 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1680c4270 con 0x7fe16814fcf0 2024-09-21T03:22:46.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.596+0000 7fe15e000640 1 -- 172.21.15.90:0/3641585428 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe16003d430 con 0x7fe16814fcf0 2024-09-21T03:22:46.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.597+0000 7fe15e000640 1 --2- 172.21.15.90:0/3641585428 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe148078c60 0x7fe14807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:46.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.597+0000 7fe15e000640 1 -- 172.21.15.90:0/3641585428 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fe1600bb0c0 con 0x7fe16814fcf0 2024-09-21T03:22:46.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.602+0000 7fe165400640 1 --2- 172.21.15.90:0/3641585428 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe148078c60 0x7fe14807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:46.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.607+0000 7fe15e000640 1 -- 172.21.15.90:0/3641585428 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe1680c4270 con 0x7fe16814fcf0 2024-09-21T03:22:46.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:46.607+0000 7fe165400640 1 --2- 172.21.15.90:0/3641585428 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe148078c60 0x7fe14807b170 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe154001b40 tx=0x7fe154009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:47.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.309+0000 7fe16ce00640 1 -- 172.21.15.90:0/3641585428 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe168074880 con 0x7fe16814fcf0 2024-09-21T03:22:47.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.316+0000 7fe15e000640 1 -- 172.21.15.90:0/3641585428 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7fe160082bf0 con 0x7fe16814fcf0 2024-09-21T03:22:47.321 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:22:47.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.323+0000 7fe16ce00640 1 -- 172.21.15.90:0/3641585428 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe148078c60 msgr2=0x7fe14807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:47.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.323+0000 7fe16ce00640 1 --2- 172.21.15.90:0/3641585428 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe148078c60 0x7fe14807b170 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe154001b40 tx=0x7fe154009040 comp rx=0 tx=0).stop 2024-09-21T03:22:47.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.323+0000 7fe16ce00640 1 -- 172.21.15.90:0/3641585428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe16814fcf0 msgr2=0x7fe1681ebe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:47.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.323+0000 7fe16ce00640 1 --2- 172.21.15.90:0/3641585428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe16814fcf0 0x7fe1681ebe60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe160006f70 tx=0x7fe160001710 comp rx=0 tx=0).stop 2024-09-21T03:22:47.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.324+0000 7fe16ce00640 1 -- 172.21.15.90:0/3641585428 shutdown_connections 2024-09-21T03:22:47.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.324+0000 7fe16ce00640 1 --2- 172.21.15.90:0/3641585428 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe148078c60 0x7fe14807b170 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:47.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.324+0000 7fe16ce00640 1 --2- 172.21.15.90:0/3641585428 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1681ec3a0 0x7fe168141b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:47.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.324+0000 7fe16ce00640 1 --2- 172.21.15.90:0/3641585428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe16814fcf0 0x7fe1681ebe60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:47.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.324+0000 7fe16ce00640 1 --2- 172.21.15.90:0/3641585428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe14c004800 0x7fe168148350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:47.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.324+0000 7fe16ce00640 1 -- 172.21.15.90:0/3641585428 >> 172.21.15.90:0/3641585428 conn(0x7fe16806ead0 msgr2=0x7fe16806eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:47.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.326+0000 7fe16ce00640 1 -- 172.21.15.90:0/3641585428 shutdown_connections 2024-09-21T03:22:47.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.327+0000 7fe16ce00640 1 -- 172.21.15.90:0/3641585428 wait complete. 2024-09-21T03:22:47.387 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-21T03:22:47.387 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-21T03:22:47.387 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-21T03:22:47.387 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:22:47.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.947+0000 7f3c62400640 1 -- 172.21.15.90:0/2280821048 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c5c0c4670 msgr2=0x7f3c5c150cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:47.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.948+0000 7f3c62400640 1 --2- 172.21.15.90:0/2280821048 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c5c0c4670 0x7f3c5c150cb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009830 tx=0x7f3c4802a4b0 comp rx=0 tx=0).stop 2024-09-21T03:22:47.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.952+0000 7f3c62400640 1 -- 172.21.15.90:0/2280821048 shutdown_connections 2024-09-21T03:22:47.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.952+0000 7f3c62400640 1 --2- 172.21.15.90:0/2280821048 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c5c1511f0 0x7f3c5c0c2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:47.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.952+0000 7f3c62400640 1 --2- 172.21.15.90:0/2280821048 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c5c0c4670 0x7f3c5c150cb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:47.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.952+0000 7f3c62400640 1 -- 172.21.15.90:0/2280821048 >> 172.21.15.90:0/2280821048 conn(0x7f3c5c06d200 msgr2=0x7f3c5c06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:47.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.954+0000 7f3c62400640 1 -- 172.21.15.90:0/2280821048 shutdown_connections 2024-09-21T03:22:47.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.954+0000 7f3c62400640 1 -- 172.21.15.90:0/2280821048 wait complete. 2024-09-21T03:22:47.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.962+0000 7f3c62400640 1 Processor -- start 2024-09-21T03:22:47.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.963+0000 7f3c62400640 1 -- start start 2024-09-21T03:22:47.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.975+0000 7f3c62400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c5c0c4260 0x7f3c5c1f7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:47.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.976+0000 7f3c62400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c5c0c4670 0x7f3c5c14b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:47.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.976+0000 7f3c62400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c5c1511f0 0x7f3c5c1fa080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:47.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.977+0000 7f3c62400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5c153910 con 0x7f3c5c0c4260 2024-09-21T03:22:47.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.977+0000 7f3c62400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5c154870 con 0x7f3c5c1511f0 2024-09-21T03:22:47.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.977+0000 7f3c62400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3c5c153a90 con 0x7f3c5c0c4670 2024-09-21T03:22:47.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.978+0000 7f3c61000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c5c0c4260 0x7f3c5c1f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:47.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.978+0000 7f3c61000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c5c0c4260 0x7f3c5c1f7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39576/0 (socket says 172.21.15.90:39576) 2024-09-21T03:22:47.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.978+0000 7f3c61000640 1 -- 172.21.15.90:0/3107014221 learned_addr learned my addr 172.21.15.90:0/3107014221 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:22:47.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.979+0000 7f3c61000640 1 -- 172.21.15.90:0/3107014221 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c5c0c4670 msgr2=0x7f3c5c14b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:47.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.980+0000 7f3c61000640 1 --2- 172.21.15.90:0/3107014221 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c5c0c4670 0x7f3c5c14b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:47.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.980+0000 7f3c61000640 1 -- 172.21.15.90:0/3107014221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c5c1511f0 msgr2=0x7f3c5c1fa080 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:22:47.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.980+0000 7f3c61000640 1 --2- 172.21.15.90:0/3107014221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c5c1511f0 0x7f3c5c1fa080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:47.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.980+0000 7f3c61000640 1 -- 172.21.15.90:0/3107014221 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5c0c6980 con 0x7f3c5c0c4260 2024-09-21T03:22:47.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.981+0000 7f3c61000640 1 --2- 172.21.15.90:0/3107014221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c5c0c4260 0x7f3c5c1f7520 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000c400 tx=0x7f3c5000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:47.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.981+0000 7f3c58c00640 1 -- 172.21.15.90:0/3107014221 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c50017070 con 0x7f3c5c0c4260 2024-09-21T03:22:47.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.982+0000 7f3c58c00640 1 -- 172.21.15.90:0/3107014221 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c500053c0 con 0x7f3c5c0c4260 2024-09-21T03:22:47.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.982+0000 7f3c62400640 1 -- 172.21.15.90:0/3107014221 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c5c157610 con 0x7f3c5c0c4260 2024-09-21T03:22:47.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.982+0000 7f3c62400640 1 -- 172.21.15.90:0/3107014221 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c5c1fdd90 con 0x7f3c5c0c4260 2024-09-21T03:22:47.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.983+0000 7f3c58c00640 1 -- 172.21.15.90:0/3107014221 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c50003850 con 0x7f3c5c0c4260 2024-09-21T03:22:47.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.989+0000 7f3c58c00640 1 -- 172.21.15.90:0/3107014221 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3c5001a070 con 0x7f3c5c0c4260 2024-09-21T03:22:47.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.991+0000 7f3c62400640 1 --2- 172.21.15.90:0/3107014221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c38002a70 0x7f3c38004f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:47.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.991+0000 7f3c62400640 1 -- 172.21.15.90:0/3107014221 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3c38007f10 con 0x7f3c38002a70 2024-09-21T03:22:47.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.991+0000 7f3c58c00640 1 --2- 172.21.15.90:0/3107014221 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3c3c078c60 0x7f3c3c07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:47.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.992+0000 7f3c58c00640 1 -- 172.21.15.90:0/3107014221 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f3c5009a520 con 0x7f3c5c0c4260 2024-09-21T03:22:47.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.993+0000 7f3c5be00640 1 --2- 172.21.15.90:0/3107014221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c38002a70 0x7f3c38004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:47.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.993+0000 7f3c61a00640 1 --2- 172.21.15.90:0/3107014221 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3c3c078c60 0x7f3c3c07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:47.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.995+0000 7f3c5be00640 1 -- 172.21.15.90:0/3107014221 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c38008110 con 0x7f3c38002a70 2024-09-21T03:22:47.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.996+0000 7f3c5be00640 1 --2- 172.21.15.90:0/3107014221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c38002a70 0x7f3c38004f80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c072390 tx=0x7f3c48003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:47.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.997+0000 7f3c58c00640 1 -- 172.21.15.90:0/3107014221 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48005020 con 0x7f3c38002a70 2024-09-21T03:22:48.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.998+0000 7f3c58c00640 1 -- 172.21.15.90:0/3107014221 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3c48005020 con 0x7f3c38002a70 2024-09-21T03:22:48.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.998+0000 7f3c58c00640 1 -- 172.21.15.90:0/3107014221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c38002a70 msgr2=0x7f3c38004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:48.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.998+0000 7f3c58c00640 1 --2- 172.21.15.90:0/3107014221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c38002a70 0x7f3c38004f80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c072390 tx=0x7f3c48003b90 comp rx=0 tx=0).stop 2024-09-21T03:22:48.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.998+0000 7f3c61a00640 1 --2- 172.21.15.90:0/3107014221 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3c3c078c60 0x7f3c3c07b170 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3c54005c40 tx=0x7f3c54005bd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:48.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.998+0000 7f3c58c00640 1 -- 172.21.15.90:0/3107014221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c38002a70 msgr2=0x7f3c38004f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:22:48.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:47.998+0000 7f3c58c00640 1 --2- 172.21.15.90:0/3107014221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c38002a70 0x7f3c38004f80 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c072390 tx=0x7f3c48003b90 comp rx=0 tx=0).stop 2024-09-21T03:22:48.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.013+0000 7f3c62400640 1 --2- 172.21.15.90:0/3107014221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c38006f40 0x7f3c38007420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:48.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.014+0000 7f3c5be00640 1 --2- 172.21.15.90:0/3107014221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c38006f40 0x7f3c38007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:48.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.014+0000 7f3c62400640 1 -- 172.21.15.90:0/3107014221 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3800a4f0 con 0x7f3c38006f40 2024-09-21T03:22:48.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.015+0000 7f3c5be00640 1 -- 172.21.15.90:0/3107014221 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3c38007960 con 0x7f3c38006f40 2024-09-21T03:22:48.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.017+0000 7f3c5be00640 1 --2- 172.21.15.90:0/3107014221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c38006f40 0x7f3c38007420 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009830 tx=0x7f3c48005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:48.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.018+0000 7f3c58c00640 1 -- 172.21.15.90:0/3107014221 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4803b820 con 0x7f3c38006f40 2024-09-21T03:22:48.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.018+0000 7f3c58c00640 1 -- 172.21.15.90:0/3107014221 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5196 (secure 0 0 0) 0x7f3c4803b820 con 0x7f3c38006f40 2024-09-21T03:22:48.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.019+0000 7f3c58c00640 1 -- 172.21.15.90:0/3107014221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c38006f40 msgr2=0x7f3c38007420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:48.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.019+0000 7f3c58c00640 1 --2- 172.21.15.90:0/3107014221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c38006f40 0x7f3c38007420 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009830 tx=0x7f3c48005f90 comp rx=0 tx=0).stop 2024-09-21T03:22:48.021 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:22:48.021 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:22:48.021 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:22:48.021 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:22:48.021 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 58, 2024-09-21T03:22:48.021 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 211791, 2024-09-21T03:22:48.022 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:22:48.022 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:22:48.022 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:22:48.022 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:22:48.022 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:48.022 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 15, 2024-09-21T03:22:48.022 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:22:48.022 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:22:48.022 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:22:48.022 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:48.022 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:48.022 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:48.022 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:48.023 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:48.023 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:48.023 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:48.023 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:48.023 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:48.023 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:48.023 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:48.023 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:48.023 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:22:48.023 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:22:48.023 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:48.023 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:48.023 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:48.023 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:48.024 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:48.024 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:48.024 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:48.024 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:48.024 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:48.024 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:48.024 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:48.024 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:48.024 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.024 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:22:48.024 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:22:48.024 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:22:48.024 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:22:48.024 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:22:48.025 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:22:48.025 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:22:48.025 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:22:48.025 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:22:48.025 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:22:48.025 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:22:48.025 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:22:48.025 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:22:48.025 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:22:48.025 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:22:48.025 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:22:48.025 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:22:48.025 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:48.025 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:48.026 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:48.026 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:48.026 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:48.026 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:48.026 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:48.026 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:48.026 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:48.026 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:48.026 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:48.026 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:48.026 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:22:48.026 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.026 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:22:48.026 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.027 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:22:48.027 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:22:48.027 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:48.027 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:48.027 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.027 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:48.027 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:22:48.027 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:48.027 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.027 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.027 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:48.027 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:22:48.027 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:48.027 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:48.028 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:48.028 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.028 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:22:48.028 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:22:48.028 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:48.028 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:48.028 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:48.028 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.028 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.028 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:22:48.028 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:22:48.028 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:48.028 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:48.028 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.029 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:48.029 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:22:48.029 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:48.029 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.029 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.029 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:48.029 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:22:48.029 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:48.029 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:48.029 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:48.029 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.029 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:22:48.029 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:22:48.029 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:48.030 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:48.030 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:48.030 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.030 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.030 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:22:48.030 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:22:48.030 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:48.030 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:48.030 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.030 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:48.030 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:22:48.030 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:48.030 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.031 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.031 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:48.031 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:22:48.031 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:48.031 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:48.031 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:48.031 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.031 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:22:48.031 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:22:48.031 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:48.031 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:48.031 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:48.031 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:48.031 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:48.032 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.032 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:22:48.032 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:22:48.032 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.032 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:48.032 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:48.032 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:22:48.032 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:48.032 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:48.032 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:22:48.032 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.032 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:48.032 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:48.032 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:22:48.032 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:48.033 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:48.033 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:22:48.033 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.033 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:48.033 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:48.033 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:22:48.033 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:48.033 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:48.033 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:22:48.033 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.033 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:22:48.033 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:22:48.033 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:22:48.033 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.033 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.034 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:48.034 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:48.034 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5 2024-09-21T03:22:48.034 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:48.034 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:48.034 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:22:48.034 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.034 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:48.034 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:48.034 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:22:48.034 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:48.034 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:48.034 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.034 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:22:48.035 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:22:48.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.019+0000 7f3c58c00640 1 -- 172.21.15.90:0/3107014221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c38006f40 msgr2=0x7f3c38007420 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:22:48.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.019+0000 7f3c58c00640 1 --2- 172.21.15.90:0/3107014221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c38006f40 0x7f3c38007420 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:48.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.025+0000 7f3c62400640 1 -- 172.21.15.90:0/3107014221 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3c3c078c60 msgr2=0x7f3c3c07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:48.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.025+0000 7f3c62400640 1 --2- 172.21.15.90:0/3107014221 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3c3c078c60 0x7f3c3c07b170 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3c54005c40 tx=0x7f3c54005bd0 comp rx=0 tx=0).stop 2024-09-21T03:22:48.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.025+0000 7f3c62400640 1 -- 172.21.15.90:0/3107014221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c5c0c4260 msgr2=0x7f3c5c1f7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:48.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.025+0000 7f3c62400640 1 --2- 172.21.15.90:0/3107014221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c5c0c4260 0x7f3c5c1f7520 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000c400 tx=0x7f3c5000c8c0 comp rx=0 tx=0).stop 2024-09-21T03:22:48.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.025+0000 7f3c61a00640 1 -- 172.21.15.90:0/3107014221 reap_dead start 2024-09-21T03:22:48.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.025+0000 7f3c61a00640 1 -- 172.21.15.90:0/3107014221 reap_dead start 2024-09-21T03:22:48.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.025+0000 7f3c62400640 1 -- 172.21.15.90:0/3107014221 shutdown_connections 2024-09-21T03:22:48.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.025+0000 7f3c62400640 1 -- 172.21.15.90:0/3107014221 >> 172.21.15.90:0/3107014221 conn(0x7f3c5c06d200 msgr2=0x7f3c5c0c4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:48.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.027+0000 7f3c62400640 1 -- 172.21.15.90:0/3107014221 shutdown_connections 2024-09-21T03:22:48.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.027+0000 7f3c62400640 1 -- 172.21.15.90:0/3107014221 wait complete. 2024-09-21T03:22:48.077 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:22:48.077 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-21T03:22:48.078 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:22:48.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.587+0000 7ff0e2a00640 1 -- 172.21.15.90:0/1123777945 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc031600 con 0x7ff0e4073a00 2024-09-21T03:22:48.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.587+0000 7ff0ea400640 1 -- 172.21.15.90:0/1123777945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e4073a00 msgr2=0x7ff0e4165b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:48.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.587+0000 7ff0ea400640 1 --2- 172.21.15.90:0/1123777945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e4073a00 0x7ff0e4165b10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009830 tx=0x7ff0dc02a520 comp rx=0 tx=0).stop 2024-09-21T03:22:48.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.596+0000 7ff0ea400640 1 -- 172.21.15.90:0/1123777945 shutdown_connections 2024-09-21T03:22:48.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.596+0000 7ff0ea400640 1 --2- 172.21.15.90:0/1123777945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e4073a00 0x7ff0e4165b10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:48.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.596+0000 7ff0ea400640 1 --2- 172.21.15.90:0/1123777945 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0e40ccdc0 0x7ff0e406f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:48.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.596+0000 7ff0ea400640 1 -- 172.21.15.90:0/1123777945 >> 172.21.15.90:0/1123777945 conn(0x7ff0e406d770 msgr2=0x7ff0e40cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:48.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.596+0000 7ff0ea400640 1 -- 172.21.15.90:0/1123777945 shutdown_connections 2024-09-21T03:22:48.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.601+0000 7ff0ea400640 1 -- 172.21.15.90:0/1123777945 wait complete. 2024-09-21T03:22:48.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.608+0000 7ff0ea400640 1 Processor -- start 2024-09-21T03:22:48.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.608+0000 7ff0ea400640 1 -- start start 2024-09-21T03:22:48.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.616+0000 7ff0ea400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0e40735f0 0x7ff0e4158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:48.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.616+0000 7ff0ea400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e4073a00 0x7ff0e415b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:48.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.616+0000 7ff0ea400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0e4157c30 0x7ff0e414d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:48.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.616+0000 7ff0e3400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0e40735f0 0x7ff0e4158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:48.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.616+0000 7ff0e3400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0e40735f0 0x7ff0e4158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:58654/0 (socket says 172.21.15.90:58654) 2024-09-21T03:22:48.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.617+0000 7ff0e3400640 1 -- 172.21.15.90:0/1971733759 learned_addr learned my addr 172.21.15.90:0/1971733759 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:22:48.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.617+0000 7ff0ea400640 1 -- 172.21.15.90:0/1971733759 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e415ee90 con 0x7ff0e4073a00 2024-09-21T03:22:48.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.617+0000 7ff0ea400640 1 -- 172.21.15.90:0/1971733759 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e4158d40 con 0x7ff0e4157c30 2024-09-21T03:22:48.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.617+0000 7ff0ea400640 1 -- 172.21.15.90:0/1971733759 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff0e415f010 con 0x7ff0e40735f0 2024-09-21T03:22:48.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.617+0000 7ff0daa00640 1 --2- 172.21.15.90:0/1971733759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e4073a00 0x7ff0e415b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:48.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.618+0000 7ff0daa00640 1 -- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0e40735f0 msgr2=0x7ff0e4158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:48.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.618+0000 7ff0daa00640 1 --2- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0e40735f0 0x7ff0e4158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:48.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.618+0000 7ff0daa00640 1 -- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0e4157c30 msgr2=0x7ff0e414d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:48.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.618+0000 7ff0daa00640 1 --2- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0e4157c30 0x7ff0e414d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:48.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.618+0000 7ff0daa00640 1 -- 172.21.15.90:0/1971733759 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e40d13c0 con 0x7ff0e4073a00 2024-09-21T03:22:48.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.619+0000 7ff0daa00640 1 --2- 172.21.15.90:0/1971733759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e4073a00 0x7ff0e415b3b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00c3f0 tx=0x7ff0cc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:48.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.620+0000 7ff0dbe00640 1 -- 172.21.15.90:0/1971733759 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc011790 con 0x7ff0e4073a00 2024-09-21T03:22:48.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.620+0000 7ff0dbe00640 1 -- 172.21.15.90:0/1971733759 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0cc017070 con 0x7ff0e4073a00 2024-09-21T03:22:48.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.621+0000 7ff0dbe00640 1 -- 172.21.15.90:0/1971733759 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc011c60 con 0x7ff0e4073a00 2024-09-21T03:22:48.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.621+0000 7ff0ea400640 1 -- 172.21.15.90:0/1971733759 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e40d0f70 con 0x7ff0e4073a00 2024-09-21T03:22:48.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.622+0000 7ff0ea400640 1 -- 172.21.15.90:0/1971733759 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e41f4f30 con 0x7ff0e4073a00 2024-09-21T03:22:48.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.630+0000 7ff0ea400640 1 --2- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0e414d6c0 0x7ff0e4155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:48.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.630+0000 7ff0ea400640 1 -- 172.21.15.90:0/1971733759 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e4158bc0 con 0x7ff0e414d6c0 2024-09-21T03:22:48.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.631+0000 7ff0e3400640 1 --2- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0e414d6c0 0x7ff0e4155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:48.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.631+0000 7ff0e3400640 1 -- 172.21.15.90:0/1971733759 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0e4154b40 con 0x7ff0e414d6c0 2024-09-21T03:22:48.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.632+0000 7ff0e3400640 1 --2- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0e414d6c0 0x7ff0e4155a80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4005fd0 tx=0x7ff0d400d6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:48.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.635+0000 7ff0dbe00640 1 -- 172.21.15.90:0/1971733759 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff0cc01c460 con 0x7ff0e4073a00 2024-09-21T03:22:48.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.637+0000 7ff0dbe00640 1 --2- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff0c0078be0 0x7ff0c007b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:48.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.637+0000 7ff0dbe00640 1 -- 172.21.15.90:0/1971733759 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4011640 con 0x7ff0e414d6c0 2024-09-21T03:22:48.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.637+0000 7ff0dbe00640 1 -- 172.21.15.90:0/1971733759 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7ff0cc09ade0 con 0x7ff0e4073a00 2024-09-21T03:22:48.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.637+0000 7ff0dbe00640 1 -- 172.21.15.90:0/1971733759 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff0d40117e0 con 0x7ff0e414d6c0 2024-09-21T03:22:48.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.637+0000 7ff0dbe00640 1 -- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0e414d6c0 msgr2=0x7ff0e4155a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:48.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.637+0000 7ff0dbe00640 1 --2- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0e414d6c0 0x7ff0e4155a80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4005fd0 tx=0x7ff0d400d6b0 comp rx=0 tx=0).stop 2024-09-21T03:22:48.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.637+0000 7ff0dbe00640 1 -- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0e414d6c0 msgr2=0x7ff0e4155a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:22:48.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.637+0000 7ff0dbe00640 1 --2- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0e414d6c0 0x7ff0e4155a80 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4005fd0 tx=0x7ff0d400d6b0 comp rx=0 tx=0).stop 2024-09-21T03:22:48.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.640+0000 7ff0e3e00640 1 --2- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff0c0078be0 0x7ff0c007b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:48.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.644+0000 7ff0e3e00640 1 --2- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff0c0078be0 0x7ff0c007b0f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc034000 tx=0x7ff0dc00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:48.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.662+0000 7ff0ea400640 1 --2- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0e4155fc0 0x7ff0e41563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:48.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.663+0000 7ff0ea400640 1 -- 172.21.15.90:0/1971733759 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e4156910 con 0x7ff0e4155fc0 2024-09-21T03:22:48.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.663+0000 7ff0e3400640 1 --2- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0e4155fc0 0x7ff0e41563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:48.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.664+0000 7ff0e3400640 1 -- 172.21.15.90:0/1971733759 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff0e41548a0 con 0x7ff0e4155fc0 2024-09-21T03:22:48.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.665+0000 7ff0e3400640 1 --2- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0e4155fc0 0x7ff0e41563d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4005fd0 tx=0x7ff0d4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:48.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.666+0000 7ff0dbe00640 1 -- 172.21.15.90:0/1971733759 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4011640 con 0x7ff0e4155fc0 2024-09-21T03:22:48.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.669+0000 7ff0dbe00640 1 -- 172.21.15.90:0/1971733759 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4549 (secure 0 0 0) 0x7ff0d4019420 con 0x7ff0e4155fc0 2024-09-21T03:22:48.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.669+0000 7ff0dbe00640 1 -- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0e4155fc0 msgr2=0x7ff0e41563d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:48.672 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:22:48.672 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:22:48.672 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:22:48.672 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:22:48.672 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 58, 2024-09-21T03:22:48.672 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 20875, 2024-09-21T03:22:48.672 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:22:48.672 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:22:48.672 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:22:48.672 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:22:48.672 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:48.672 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 16, 2024-09-21T03:22:48.673 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:22:48.673 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:22:48.673 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:22:48.673 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:48.673 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:48.673 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:48.673 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:48.673 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:48.673 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:48.673 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:48.673 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:48.673 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:48.673 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:48.673 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:48.674 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:48.674 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:22:48.674 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:22:48.674 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:48.674 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:48.674 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:48.674 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:48.674 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:48.674 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:48.674 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:48.674 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:48.674 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:48.674 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:48.675 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:48.675 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:48.675 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.675 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:22:48.675 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:22:48.675 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:22:48.675 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:22:48.675 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:22:48.675 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:22:48.675 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:22:48.675 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:22:48.675 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:22:48.675 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:22:48.675 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:22:48.676 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:22:48.676 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:22:48.676 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:22:48.676 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:22:48.676 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:22:48.676 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:22:48.676 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:48.676 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:48.676 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:48.676 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:48.676 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:48.676 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:48.676 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:48.676 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:48.676 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:48.677 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:48.677 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:48.677 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:48.677 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:22:48.677 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.677 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:22:48.677 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.677 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:22:48.677 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:22:48.677 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:48.677 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:48.677 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.677 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:48.677 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:22:48.677 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:48.678 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.678 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.678 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:48.678 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:22:48.678 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:48.678 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:48.678 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:48.678 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.678 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:22:48.678 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:22:48.678 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:48.678 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:48.678 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:48.679 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.679 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.679 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:22:48.679 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:22:48.679 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:48.679 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:48.679 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.679 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:48.679 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:22:48.679 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:48.679 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.679 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.679 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:48.679 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:22:48.679 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:48.680 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:48.680 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:48.680 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.680 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:22:48.680 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:22:48.680 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:48.680 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:48.680 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:48.680 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.680 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.680 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:22:48.680 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:22:48.680 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:48.680 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:48.681 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.681 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:48.681 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:22:48.681 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:48.681 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.681 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.681 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:48.681 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:22:48.681 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:48.681 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:48.681 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:48.681 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.681 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:22:48.681 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:22:48.681 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:48.682 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:48.682 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:48.682 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:48.682 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:48.682 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.682 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:22:48.682 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:22:48.682 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.682 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:48.682 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:48.682 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:22:48.682 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:48.682 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:48.682 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:22:48.683 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:48.683 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:48.683 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:48.683 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:22:48.683 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:48.683 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:48.683 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:48.683 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:22:48.683 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:22:48.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.670+0000 7ff0dbe00640 1 --2- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0e4155fc0 0x7ff0e41563d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4005fd0 tx=0x7ff0d4004a40 comp rx=0 tx=0).stop 2024-09-21T03:22:48.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.671+0000 7ff0dbe00640 1 -- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0e4155fc0 msgr2=0x7ff0e41563d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:22:48.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.671+0000 7ff0dbe00640 1 --2- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0e4155fc0 0x7ff0e41563d0 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4005fd0 tx=0x7ff0d4004a40 comp rx=0 tx=0).stop 2024-09-21T03:22:48.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.672+0000 7ff0ea400640 1 -- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff0c0078be0 msgr2=0x7ff0c007b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:48.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.672+0000 7ff0ea400640 1 --2- 172.21.15.90:0/1971733759 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff0c0078be0 0x7ff0c007b0f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc034000 tx=0x7ff0dc00b040 comp rx=0 tx=0).stop 2024-09-21T03:22:48.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.673+0000 7ff0e3e00640 1 -- 172.21.15.90:0/1971733759 reap_dead start 2024-09-21T03:22:48.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.673+0000 7ff0ea400640 1 -- 172.21.15.90:0/1971733759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e4073a00 msgr2=0x7ff0e415b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:48.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.673+0000 7ff0ea400640 1 --2- 172.21.15.90:0/1971733759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e4073a00 0x7ff0e415b3b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00c3f0 tx=0x7ff0cc00c8b0 comp rx=0 tx=0).stop 2024-09-21T03:22:48.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.673+0000 7ff0ea400640 1 -- 172.21.15.90:0/1971733759 shutdown_connections 2024-09-21T03:22:48.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.673+0000 7ff0ea400640 1 --2- 172.21.15.90:0/1971733759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e4073a00 0x7ff0e415b3b0 secure :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00c3f0 tx=0x7ff0cc00c8b0 comp rx=0 tx=0).stop 2024-09-21T03:22:48.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.674+0000 7ff0ea400640 1 -- 172.21.15.90:0/1971733759 >> 172.21.15.90:0/1971733759 conn(0x7ff0e406d770 msgr2=0x7ff0e40763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:48.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.675+0000 7ff0ea400640 1 -- 172.21.15.90:0/1971733759 shutdown_connections 2024-09-21T03:22:48.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:48.675+0000 7ff0ea400640 1 -- 172.21.15.90:0/1971733759 wait complete. 2024-09-21T03:22:48.737 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:22:48.737 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-21T03:22:48.737 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:22:49.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.279+0000 7fac31c00640 1 -- 172.21.15.90:0/1144615886 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac2400b8e0 msgr2=0x7fac24046940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:49.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.280+0000 7fac31c00640 1 --2- 172.21.15.90:0/1144615886 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac2400b8e0 0x7fac24046940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fac20009900 tx=0x7fac2002a560 comp rx=0 tx=0).stop 2024-09-21T03:22:49.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.282+0000 7fac31c00640 1 -- 172.21.15.90:0/1144615886 shutdown_connections 2024-09-21T03:22:49.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.282+0000 7fac31c00640 1 --2- 172.21.15.90:0/1144615886 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac2400b8e0 0x7fac24046940 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:49.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.282+0000 7fac31c00640 1 -- 172.21.15.90:0/1144615886 >> 172.21.15.90:0/1144615886 conn(0x7fac24048650 msgr2=0x7fac2402ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:49.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.284+0000 7fac31c00640 1 -- 172.21.15.90:0/1144615886 shutdown_connections 2024-09-21T03:22:49.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.284+0000 7fac31c00640 1 -- 172.21.15.90:0/1144615886 wait complete. 2024-09-21T03:22:49.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.297+0000 7fac31c00640 1 Processor -- start 2024-09-21T03:22:49.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.297+0000 7fac31c00640 1 -- start start 2024-09-21T03:22:49.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.303+0000 7fac31c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac2400b8e0 0x7fac240d5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:49.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.305+0000 7fac31c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac2402d5e0 0x7fac2402cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:49.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.306+0000 7fac31c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac24049740 0x7fac240cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:49.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.306+0000 7fac31c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac2402dd80 con 0x7fac2402d5e0 2024-09-21T03:22:49.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.306+0000 7fac31c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fac2402dc00 con 0x7fac24049740 2024-09-21T03:22:49.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.306+0000 7fac31c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fac2402e2c0 con 0x7fac2400b8e0 2024-09-21T03:22:49.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.307+0000 7fac31200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac24049740 0x7fac240cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:49.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.307+0000 7fac31200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac24049740 0x7fac240cdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:43992/0 (socket says 172.21.15.90:43992) 2024-09-21T03:22:49.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.307+0000 7fac31200640 1 -- 172.21.15.90:0/3237791664 learned_addr learned my addr 172.21.15.90:0/3237791664 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:22:49.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.307+0000 7fac2be00640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac2400b8e0 0x7fac240d5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:49.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.312+0000 7fac2b400640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac2402d5e0 0x7fac2402cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:49.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.312+0000 7fac31200640 1 -- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac2400b8e0 msgr2=0x7fac240d5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:49.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.312+0000 7fac31200640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac2400b8e0 0x7fac240d5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:49.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.312+0000 7fac31200640 1 -- 172.21.15.90:0/3237791664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac2402d5e0 msgr2=0x7fac2402cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:49.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.312+0000 7fac31200640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac2402d5e0 0x7fac2402cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:49.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.312+0000 7fac31200640 1 -- 172.21.15.90:0/3237791664 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2402ed40 con 0x7fac24049740 2024-09-21T03:22:49.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.312+0000 7fac31200640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac24049740 0x7fac240cdb60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fac2c000b60 tx=0x7fac2c06a1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:49.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.312+0000 7fac2b400640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac2402d5e0 0x7fac2402cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:22:49.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.314+0000 7fac1fe00640 1 -- 172.21.15.90:0/3237791664 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c076920 con 0x7fac24049740 2024-09-21T03:22:49.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.314+0000 7fac31c00640 1 -- 172.21.15.90:0/3237791664 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac2402be60 con 0x7fac24049740 2024-09-21T03:22:49.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.314+0000 7fac31c00640 1 -- 172.21.15.90:0/3237791664 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac2402c420 con 0x7fac24049740 2024-09-21T03:22:49.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.314+0000 7fac1fe00640 1 -- 172.21.15.90:0/3237791664 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac2c076bb0 con 0x7fac24049740 2024-09-21T03:22:49.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.314+0000 7fac1fe00640 1 -- 172.21.15.90:0/3237791664 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c094400 con 0x7fac24049740 2024-09-21T03:22:49.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.317+0000 7fac31c00640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac08002a70 0x7fac08004f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:49.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.318+0000 7fac2be00640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac08002a70 0x7fac08004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:49.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.321+0000 7fac31c00640 1 -- 172.21.15.90:0/3237791664 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fac08007f10 con 0x7fac08002a70 2024-09-21T03:22:49.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.322+0000 7fac1fe00640 1 -- 172.21.15.90:0/3237791664 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fac2c0945a0 con 0x7fac24049740 2024-09-21T03:22:49.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.324+0000 7fac1fe00640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fac0c078c90 0x7fac0c07b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:49.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.324+0000 7fac1fe00640 1 -- 172.21.15.90:0/3237791664 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fac2c117090 con 0x7fac24049740 2024-09-21T03:22:49.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.325+0000 7fac2b400640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fac0c078c90 0x7fac0c07b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:49.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.326+0000 7fac2be00640 1 -- 172.21.15.90:0/3237791664 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac08008110 con 0x7fac08002a70 2024-09-21T03:22:49.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.326+0000 7fac2be00640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac08002a70 0x7fac08004f80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fac24048e90 tx=0x7fac200045c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:49.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.327+0000 7fac1fe00640 1 -- 172.21.15.90:0/3237791664 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac20040070 con 0x7fac08002a70 2024-09-21T03:22:49.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.328+0000 7fac2b400640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fac0c078c90 0x7fac0c07b1a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fac240d2a70 tx=0x7fac18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:49.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.328+0000 7fac1fe00640 1 -- 172.21.15.90:0/3237791664 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fac20003a00 con 0x7fac08002a70 2024-09-21T03:22:49.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.328+0000 7fac1fe00640 1 -- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac08002a70 msgr2=0x7fac08004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:49.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.328+0000 7fac1fe00640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac08002a70 0x7fac08004f80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fac24048e90 tx=0x7fac200045c0 comp rx=0 tx=0).stop 2024-09-21T03:22:49.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.328+0000 7fac1fe00640 1 -- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac08002a70 msgr2=0x7fac08004f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:22:49.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.328+0000 7fac1fe00640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac08002a70 0x7fac08004f80 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fac24048e90 tx=0x7fac200045c0 comp rx=0 tx=0).stop 2024-09-21T03:22:49.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.351+0000 7fac31c00640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac08006f80 0x7fac08007440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:49.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.351+0000 7fac31c00640 1 -- 172.21.15.90:0/3237791664 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fac0800a4f0 con 0x7fac08006f80 2024-09-21T03:22:49.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.356+0000 7fac2be00640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac08006f80 0x7fac08007440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:49.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.357+0000 7fac2be00640 1 -- 172.21.15.90:0/3237791664 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fac08007980 con 0x7fac08006f80 2024-09-21T03:22:49.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.358+0000 7fac2be00640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac08006f80 0x7fac08007440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac20009850 tx=0x7fac2002a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:49.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.358+0000 7fac1fe00640 1 -- 172.21.15.90:0/3237791664 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac20035040 con 0x7fac08006f80 2024-09-21T03:22:49.362 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:22:49.363 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:22:49.363 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:22:49.363 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:22:49.363 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 58, 2024-09-21T03:22:49.363 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 79680, 2024-09-21T03:22:49.363 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:22:49.363 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:22:49.363 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:22:49.363 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:22:49.363 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:49.363 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 17, 2024-09-21T03:22:49.363 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:22:49.363 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:22:49.363 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:22:49.364 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:49.364 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:49.364 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:49.364 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:49.364 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:49.364 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:49.364 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:49.364 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:49.364 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:49.364 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:49.364 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:49.364 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:49.364 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:22:49.364 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:22:49.364 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:49.365 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:49.365 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:49.365 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:49.365 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:49.365 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:49.365 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:49.365 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:49.365 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:49.365 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:49.365 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:49.365 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:49.366 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:49.366 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:22:49.366 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:22:49.366 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:22:49.366 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:22:49.366 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:22:49.366 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:22:49.366 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:22:49.366 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:22:49.366 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:22:49.366 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:22:49.366 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:22:49.366 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:22:49.366 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:22:49.367 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:22:49.367 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:22:49.367 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:22:49.367 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:22:49.367 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:22:49.367 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:22:49.367 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:22:49.367 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:22:49.367 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:22:49.367 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:22:49.367 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:22:49.367 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:22:49.367 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:22:49.368 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:22:49.368 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:22:49.368 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:49.368 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:22:49.368 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:49.368 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:22:49.368 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:49.368 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:22:49.368 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:22:49.368 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:49.369 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:49.369 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:49.369 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:49.369 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:22:49.369 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:49.369 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:49.369 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:49.369 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:49.369 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:22:49.369 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:49.369 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:49.369 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:49.369 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:49.370 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:22:49.370 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:22:49.370 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:49.370 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:49.370 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:49.370 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:49.370 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:49.370 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:22:49.370 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:22:49.370 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:49.370 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:49.371 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:49.371 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:49.371 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:22:49.371 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:49.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:49.371 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:49.371 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:49.371 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:22:49.371 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:49.371 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:49.371 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:49.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:49.372 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:22:49.372 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:22:49.372 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:49.372 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:49.372 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:49.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:49.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:49.372 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:22:49.372 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:22:49.372 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:22:49.372 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:22:49.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:49.372 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:22:49.372 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:22:49.373 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:49.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:49.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:49.373 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:22:49.373 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:22:49.373 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:22:49.373 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:49.373 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:49.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:49.373 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:22:49.373 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:22:49.373 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:22:49.373 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:22:49.373 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:22:49.373 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:49.374 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:49.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:49.374 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:22:49.374 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:22:49.374 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:49.374 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:49.374 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:49.374 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:22:49.374 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:49.374 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:49.374 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:22:49.374 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:49.374 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:49.374 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:49.375 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:22:49.375 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:49.375 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:49.375 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:22:49.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:49.375 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:49.375 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:49.375 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:22:49.375 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:49.375 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:49.375 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:22:49.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:49.375 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:49.375 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:49.376 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:22:49.376 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:49.376 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:22:49.376 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:22:49.376 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:22:49.376 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:22:49.376 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:22:49.376 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:22:49.376 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:22:49.376 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:22:49.376 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:22:49.376 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:22:49.376 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:22:49.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.359+0000 7fac1fe00640 1 -- 172.21.15.90:0/3237791664 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5050 (secure 0 0 0) 0x7fac20005030 con 0x7fac08006f80 2024-09-21T03:22:49.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.359+0000 7fac1fe00640 1 -- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac08006f80 msgr2=0x7fac08007440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:49.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.359+0000 7fac1fe00640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac08006f80 0x7fac08007440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac20009850 tx=0x7fac2002a560 comp rx=0 tx=0).stop 2024-09-21T03:22:49.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.359+0000 7fac1fe00640 1 -- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac08006f80 msgr2=0x7fac08007440 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:22:49.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.359+0000 7fac1fe00640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac08006f80 0x7fac08007440 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac20009850 tx=0x7fac2002a560 comp rx=0 tx=0).stop 2024-09-21T03:22:49.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.361+0000 7fac31c00640 1 -- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fac0c078c90 msgr2=0x7fac0c07b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:49.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.361+0000 7fac31c00640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fac0c078c90 0x7fac0c07b1a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fac240d2a70 tx=0x7fac18009040 comp rx=0 tx=0).stop 2024-09-21T03:22:49.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.361+0000 7fac31c00640 1 -- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac24049740 msgr2=0x7fac240cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:49.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.361+0000 7fac31c00640 1 --2- 172.21.15.90:0/3237791664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac24049740 0x7fac240cdb60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fac2c000b60 tx=0x7fac2c06a1d0 comp rx=0 tx=0).stop 2024-09-21T03:22:49.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.362+0000 7fac31200640 1 -- 172.21.15.90:0/3237791664 reap_dead start 2024-09-21T03:22:49.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.362+0000 7fac31200640 1 -- 172.21.15.90:0/3237791664 reap_dead start 2024-09-21T03:22:49.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.362+0000 7fac31c00640 1 -- 172.21.15.90:0/3237791664 shutdown_connections 2024-09-21T03:22:49.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.362+0000 7fac31c00640 1 -- 172.21.15.90:0/3237791664 >> 172.21.15.90:0/3237791664 conn(0x7fac24048650 msgr2=0x7fac240d8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:49.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.362+0000 7fac31c00640 1 -- 172.21.15.90:0/3237791664 shutdown_connections 2024-09-21T03:22:49.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:49.363+0000 7fac31c00640 1 -- 172.21.15.90:0/3237791664 wait complete. 2024-09-21T03:22:49.443 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:22:49.443 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-21T03:22:49.443 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-21T03:22:49.443 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-21T03:22:49.443 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-21T03:22:49.444 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-21T03:22:49.444 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:22:49.523 INFO:tasks.ceph.mon.c:Stopped 2024-09-21T03:22:49.524 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-21T03:22:49.524 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:22:50.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.029+0000 7f7799800640 1 -- 172.21.15.90:0/1414092223 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f778c006f40 msgr2=0x7f778c007350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:50.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.031+0000 7f7799800640 1 --2- 172.21.15.90:0/1414092223 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f778c006f40 0x7f778c007350 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7788005fd0 tx=0x7f778802a580 comp rx=0 tx=0).stop 2024-09-21T03:22:50.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.032+0000 7f7799800640 1 -- 172.21.15.90:0/1414092223 shutdown_connections 2024-09-21T03:22:50.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.032+0000 7f7799800640 1 --2- 172.21.15.90:0/1414092223 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f778c006f40 0x7f778c007350 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:50.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.032+0000 7f7799800640 1 --2- 172.21.15.90:0/1414092223 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f778c0d7a80 0x7f778c04ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:50.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.032+0000 7f7799800640 1 -- 172.21.15.90:0/1414092223 >> 172.21.15.90:0/1414092223 conn(0x7f778c0312e0 msgr2=0x7f778c0316f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:50.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.034+0000 7f7799800640 1 -- 172.21.15.90:0/1414092223 shutdown_connections 2024-09-21T03:22:50.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.035+0000 7f7799800640 1 -- 172.21.15.90:0/1414092223 wait complete. 2024-09-21T03:22:50.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.039+0000 7f7799800640 1 Processor -- start 2024-09-21T03:22:50.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.040+0000 7f7799800640 1 -- start start 2024-09-21T03:22:50.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.043+0000 7f7799800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f778c006f40 0x7f778c175210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:50.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.044+0000 7f7799800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f778c0d7a80 0x7f778c0d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:50.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.044+0000 7f7793400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f778c0d7a80 0x7f778c0d32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:50.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.045+0000 7f7793e00640 1 -- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f778c006f40 msgr2=0x7f778c175210 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:22:50.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.045+0000 7f7793e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f778c006f40 0x7f778c175210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:22:50.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.046+0000 7f7799800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f778c0dd7c0 0x7f778c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:50.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.046+0000 7f7799800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f778c0de460 con 0x7f778c0d7a80 2024-09-21T03:22:50.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.048+0000 7f7793400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f778c0d7a80 0x7f778c0d32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39650/0 (socket says 172.21.15.90:39650) 2024-09-21T03:22:50.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.048+0000 7f7793400640 1 -- 172.21.15.90:0/2089411143 learned_addr learned my addr 172.21.15.90:0/2089411143 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:22:50.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.048+0000 7f7798e00640 1 --2- 172.21.15.90:0/2089411143 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f778c0dd7c0 0x7f778c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:50.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.048+0000 7f7799800640 1 -- 172.21.15.90:0/2089411143 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f778c0de2e0 con 0x7f778c0dd7c0 2024-09-21T03:22:50.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.048+0000 7f7799800640 1 -- 172.21.15.90:0/2089411143 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f778c04e300 con 0x7f778c006f40 2024-09-21T03:22:50.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.049+0000 7f7798e00640 1 -- 172.21.15.90:0/2089411143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f778c006f40 msgr2=0x7f778c175210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:22:50.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.049+0000 7f7798e00640 1 --2- 172.21.15.90:0/2089411143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f778c006f40 0x7f778c175210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:50.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.049+0000 7f7798e00640 1 -- 172.21.15.90:0/2089411143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f778c0d7a80 msgr2=0x7f778c0d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:50.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.049+0000 7f7798e00640 1 --2- 172.21.15.90:0/2089411143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f778c0d7a80 0x7f778c0d32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:50.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.049+0000 7f7798e00640 1 -- 172.21.15.90:0/2089411143 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f778c174790 con 0x7f778c0dd7c0 2024-09-21T03:22:50.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.049+0000 7f7798e00640 1 --2- 172.21.15.90:0/2089411143 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f778c0dd7c0 0x7f778c032940 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7794052910 tx=0x7f779406a3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:50.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.050+0000 7f7787e00640 1 -- 172.21.15.90:0/2089411143 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77940753c0 con 0x7f778c0dd7c0 2024-09-21T03:22:50.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.050+0000 7f7787e00640 1 -- 172.21.15.90:0/2089411143 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7794094400 con 0x7f778c0dd7c0 2024-09-21T03:22:50.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.050+0000 7f7787e00640 1 -- 172.21.15.90:0/2089411143 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7794094850 con 0x7f778c0dd7c0 2024-09-21T03:22:50.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.050+0000 7f7799800640 1 -- 172.21.15.90:0/2089411143 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f778c0dc820 con 0x7f778c0dd7c0 2024-09-21T03:22:50.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.051+0000 7f7799800640 1 -- 172.21.15.90:0/2089411143 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f778c174a10 con 0x7f778c0dd7c0 2024-09-21T03:22:50.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.055+0000 7f7799800640 1 -- 172.21.15.90:0/2089411143 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f778c007350 con 0x7f778c0dd7c0 2024-09-21T03:22:50.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.063+0000 7f7787e00640 1 -- 172.21.15.90:0/2089411143 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f77940b7d10 con 0x7f778c0dd7c0 2024-09-21T03:22:50.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.067+0000 7f7787e00640 1 --2- 172.21.15.90:0/2089411143 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7774078b90 0x7f777407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:50.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.068+0000 7f7787e00640 1 -- 172.21.15.90:0/2089411143 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f7794117a10 con 0x7f778c0dd7c0 2024-09-21T03:22:50.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.068+0000 7f7793e00640 1 --2- 172.21.15.90:0/2089411143 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7774078b90 0x7f777407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:50.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.068+0000 7f7787e00640 1 -- 172.21.15.90:0/2089411143 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f778c174790 con 0x7f778c0dd7c0 2024-09-21T03:22:50.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.074+0000 7f7793e00640 1 --2- 172.21.15.90:0/2089411143 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7774078b90 0x7f777407b0a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7780006fd0 tx=0x7f7780006d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:50.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.715+0000 7f7799800640 1 -- 172.21.15.90:0/2089411143 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f778c004ef0 con 0x7f778c0dd7c0 2024-09-21T03:22:50.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.717+0000 7f7787e00640 1 -- 172.21.15.90:0/2089411143 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f7794090030 con 0x7f778c0dd7c0 2024-09-21T03:22:50.720 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:22:50.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.723+0000 7f7799800640 1 -- 172.21.15.90:0/2089411143 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7774078b90 msgr2=0x7f777407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:50.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.724+0000 7f7799800640 1 --2- 172.21.15.90:0/2089411143 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7774078b90 0x7f777407b0a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7780006fd0 tx=0x7f7780006d60 comp rx=0 tx=0).stop 2024-09-21T03:22:50.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.724+0000 7f7799800640 1 -- 172.21.15.90:0/2089411143 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f778c0dd7c0 msgr2=0x7f778c032940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:50.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.724+0000 7f7799800640 1 --2- 172.21.15.90:0/2089411143 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f778c0dd7c0 0x7f778c032940 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7794052910 tx=0x7f779406a3a0 comp rx=0 tx=0).stop 2024-09-21T03:22:50.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.724+0000 7f7799800640 1 -- 172.21.15.90:0/2089411143 shutdown_connections 2024-09-21T03:22:50.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.724+0000 7f7799800640 1 --2- 172.21.15.90:0/2089411143 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7774078b90 0x7f777407b0a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:50.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.724+0000 7f7799800640 1 --2- 172.21.15.90:0/2089411143 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f778c0dd7c0 0x7f778c032940 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:50.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.724+0000 7f7799800640 1 --2- 172.21.15.90:0/2089411143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f778c0d7a80 0x7f778c0d32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:50.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.724+0000 7f7799800640 1 --2- 172.21.15.90:0/2089411143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f778c006f40 0x7f778c175210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:50.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.724+0000 7f7799800640 1 -- 172.21.15.90:0/2089411143 >> 172.21.15.90:0/2089411143 conn(0x7f778c0312e0 msgr2=0x7f778c0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:50.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.725+0000 7f7799800640 1 -- 172.21.15.90:0/2089411143 shutdown_connections 2024-09-21T03:22:50.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:50.725+0000 7f7799800640 1 -- 172.21.15.90:0/2089411143 wait complete. 2024-09-21T03:22:53.785 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:22:54.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.281+0000 7f0538000640 1 -- 172.21.15.90:0/361314952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05300c7480 msgr2=0x7f05301577c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:54.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.281+0000 7f0538000640 1 --2- 172.21.15.90:0/361314952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05300c7480 0x7f05301577c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f053015b000 tx=0x7f052402a560 comp rx=0 tx=0).stop 2024-09-21T03:22:54.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.282+0000 7f0538000640 1 -- 172.21.15.90:0/361314952 shutdown_connections 2024-09-21T03:22:54.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.282+0000 7f0538000640 1 --2- 172.21.15.90:0/361314952 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05300ae380 0x7f05300ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:54.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.282+0000 7f0538000640 1 --2- 172.21.15.90:0/361314952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05300c7480 0x7f05301577c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:54.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.282+0000 7f0538000640 1 -- 172.21.15.90:0/361314952 >> 172.21.15.90:0/361314952 conn(0x7f05300cc310 msgr2=0x7f05300cc720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:54.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.282+0000 7f0538000640 1 -- 172.21.15.90:0/361314952 shutdown_connections 2024-09-21T03:22:54.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.282+0000 7f0538000640 1 -- 172.21.15.90:0/361314952 wait complete. 2024-09-21T03:22:54.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.293+0000 7f0538000640 1 Processor -- start 2024-09-21T03:22:54.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.293+0000 7f0538000640 1 -- start start 2024-09-21T03:22:54.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.297+0000 7f0538000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05300adf70 0x7f05300c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:54.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.297+0000 7f0538000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05300c7480 0x7f05301560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:54.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.298+0000 7f0538000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05300c2ec0 0x7f0530152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:54.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.298+0000 7f0538000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f05300c7db0 con 0x7f05300adf70 2024-09-21T03:22:54.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.298+0000 7f0538000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f05300c7c30 con 0x7f05300c2ec0 2024-09-21T03:22:54.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.299+0000 7f0538000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0530154860 con 0x7f05300c7480 2024-09-21T03:22:54.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.298+0000 7f0535600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05300adf70 0x7f05300c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:54.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.299+0000 7f0535600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05300adf70 0x7f05300c4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39668/0 (socket says 172.21.15.90:39668) 2024-09-21T03:22:54.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.299+0000 7f0535600640 1 -- 172.21.15.90:0/1974385871 learned_addr learned my addr 172.21.15.90:0/1974385871 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:22:54.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.299+0000 7f0536000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05300c2ec0 0x7f0530152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:54.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.299+0000 7f0534c00640 1 -- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05300c7480 msgr2=0x7f05301560d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:22:54.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.299+0000 7f0534c00640 1 --2- 172.21.15.90:0/1974385871 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05300c7480 0x7f05301560d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:22:54.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.301+0000 7f0536000640 1 -- 172.21.15.90:0/1974385871 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05300c7480 msgr2=0x7f05301560d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:22:54.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.301+0000 7f0536000640 1 --2- 172.21.15.90:0/1974385871 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05300c7480 0x7f05301560d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:54.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.301+0000 7f0536000640 1 -- 172.21.15.90:0/1974385871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05300adf70 msgr2=0x7f05300c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:54.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.301+0000 7f0536000640 1 --2- 172.21.15.90:0/1974385871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05300adf70 0x7f05300c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:54.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.301+0000 7f0536000640 1 -- 172.21.15.90:0/1974385871 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0530153d80 con 0x7f05300c2ec0 2024-09-21T03:22:54.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.301+0000 7f0535600640 1 --2- 172.21.15.90:0/1974385871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05300adf70 0x7f05300c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:22:54.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.303+0000 7f0536000640 1 --2- 172.21.15.90:0/1974385871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05300c2ec0 0x7f0530152ad0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f052800bdc0 tx=0x7f0528009f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:54.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.307+0000 7f052d600640 1 -- 172.21.15.90:0/1974385871 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0528019070 con 0x7f05300c2ec0 2024-09-21T03:22:54.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.308+0000 7f052d600640 1 -- 172.21.15.90:0/1974385871 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0528014440 con 0x7f05300c2ec0 2024-09-21T03:22:54.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.308+0000 7f052d600640 1 -- 172.21.15.90:0/1974385871 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0528014890 con 0x7f05300c2ec0 2024-09-21T03:22:54.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.308+0000 7f0538000640 1 -- 172.21.15.90:0/1974385871 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05300c5a40 con 0x7f05300c2ec0 2024-09-21T03:22:54.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.308+0000 7f0538000640 1 -- 172.21.15.90:0/1974385871 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0530156c20 con 0x7f05300c2ec0 2024-09-21T03:22:54.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.318+0000 7f052d600640 1 -- 172.21.15.90:0/1974385871 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f052801c070 con 0x7f05300c2ec0 2024-09-21T03:22:54.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.318+0000 7f0538000640 1 -- 172.21.15.90:0/1974385871 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05300c49c0 con 0x7f05300c2ec0 2024-09-21T03:22:54.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.322+0000 7f052d600640 1 --2- 172.21.15.90:0/1974385871 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0510078b90 0x7f051007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:54.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.322+0000 7f052d600640 1 -- 172.21.15.90:0/1974385871 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f052809afb0 con 0x7f05300c2ec0 2024-09-21T03:22:54.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.323+0000 7f0535600640 1 --2- 172.21.15.90:0/1974385871 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0510078b90 0x7f051007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:54.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.328+0000 7f0535600640 1 --2- 172.21.15.90:0/1974385871 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0510078b90 0x7f051007b0a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0524009230 tx=0x7f0524004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:54.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.330+0000 7f052d600640 1 -- 172.21.15.90:0/1974385871 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0528062a60 con 0x7f05300c2ec0 2024-09-21T03:22:54.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.915+0000 7f0538000640 1 -- 172.21.15.90:0/1974385871 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f05300ae380 con 0x7f05300c2ec0 2024-09-21T03:22:54.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.919+0000 7f052d600640 1 -- 172.21.15.90:0/1974385871 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f0528067490 con 0x7f05300c2ec0 2024-09-21T03:22:54.923 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:22:54.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.927+0000 7f0538000640 1 -- 172.21.15.90:0/1974385871 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0510078b90 msgr2=0x7f051007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:54.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.927+0000 7f0538000640 1 --2- 172.21.15.90:0/1974385871 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0510078b90 0x7f051007b0a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0524009230 tx=0x7f0524004730 comp rx=0 tx=0).stop 2024-09-21T03:22:54.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.927+0000 7f0538000640 1 -- 172.21.15.90:0/1974385871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05300c2ec0 msgr2=0x7f0530152ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:54.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.927+0000 7f0538000640 1 --2- 172.21.15.90:0/1974385871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05300c2ec0 0x7f0530152ad0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f052800bdc0 tx=0x7f0528009f10 comp rx=0 tx=0).stop 2024-09-21T03:22:54.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.928+0000 7f0538000640 1 -- 172.21.15.90:0/1974385871 shutdown_connections 2024-09-21T03:22:54.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.928+0000 7f0538000640 1 --2- 172.21.15.90:0/1974385871 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0510078b90 0x7f051007b0a0 secure :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0524009230 tx=0x7f0524004730 comp rx=0 tx=0).stop 2024-09-21T03:22:54.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.928+0000 7f0538000640 1 --2- 172.21.15.90:0/1974385871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05300c2ec0 0x7f0530152ad0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:54.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.928+0000 7f0538000640 1 --2- 172.21.15.90:0/1974385871 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05300c7480 0x7f05301560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:54.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.928+0000 7f0538000640 1 --2- 172.21.15.90:0/1974385871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05300adf70 0x7f05300c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:54.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.928+0000 7f0538000640 1 -- 172.21.15.90:0/1974385871 >> 172.21.15.90:0/1974385871 conn(0x7f05300cc310 msgr2=0x7f05300ca7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:54.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.930+0000 7f0538000640 1 -- 172.21.15.90:0/1974385871 shutdown_connections 2024-09-21T03:22:54.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:54.930+0000 7f0538000640 1 -- 172.21.15.90:0/1974385871 wait complete. 2024-09-21T03:22:57.984 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:22:58.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.503+0000 7f07dd800640 1 -- 172.21.15.90:0/3914319804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07d00d7a80 msgr2=0x7f07d004ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:58.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.503+0000 7f07dd800640 1 --2- 172.21.15.90:0/3914319804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07d00d7a80 0x7f07d004ab80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f07d806ca30 tx=0x7f07d80a7790 comp rx=0 tx=0).stop 2024-09-21T03:22:58.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.504+0000 7f07dd800640 1 -- 172.21.15.90:0/3914319804 shutdown_connections 2024-09-21T03:22:58.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.504+0000 7f07dd800640 1 --2- 172.21.15.90:0/3914319804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07d00d7a80 0x7f07d004ab80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:58.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.504+0000 7f07dd800640 1 -- 172.21.15.90:0/3914319804 >> 172.21.15.90:0/3914319804 conn(0x7f07d00312e0 msgr2=0x7f07d00316f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:58.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.505+0000 7f07dd800640 1 -- 172.21.15.90:0/3914319804 shutdown_connections 2024-09-21T03:22:58.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.509+0000 7f07dd800640 1 -- 172.21.15.90:0/3914319804 wait complete. 2024-09-21T03:22:58.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.516+0000 7f07dd800640 1 Processor -- start 2024-09-21T03:22:58.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.516+0000 7f07dd800640 1 -- start start 2024-09-21T03:22:58.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.518+0000 7f07dd800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07d0006f40 0x7f07d00d9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:58.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.519+0000 7f07dd800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07d0007350 0x7f07d00dc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:58.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.519+0000 7f07dd800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07d00d7a80 0x7f07d00d0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:58.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.519+0000 7f07dd800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f07d004a8c0 con 0x7f07d0006f40 2024-09-21T03:22:58.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.519+0000 7f07dd800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f07d004a740 con 0x7f07d0007350 2024-09-21T03:22:58.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.519+0000 7f07dd800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f07d004e300 con 0x7f07d00d7a80 2024-09-21T03:22:58.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.519+0000 7f07d7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07d0006f40 0x7f07d00d9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:58.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.519+0000 7f07d7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07d0006f40 0x7f07d00d9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59556/0 (socket says 172.21.15.90:59556) 2024-09-21T03:22:58.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.519+0000 7f07d7e00640 1 -- 172.21.15.90:0/2881363597 learned_addr learned my addr 172.21.15.90:0/2881363597 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:22:58.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.523+0000 7f07d7e00640 1 -- 172.21.15.90:0/2881363597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07d00d7a80 msgr2=0x7f07d00d0200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:22:58.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.523+0000 7f07d7e00640 1 --2- 172.21.15.90:0/2881363597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07d00d7a80 0x7f07d00d0200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:58.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.523+0000 7f07d7e00640 1 -- 172.21.15.90:0/2881363597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07d0007350 msgr2=0x7f07d00dc500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:22:58.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.523+0000 7f07d7e00640 1 --2- 172.21.15.90:0/2881363597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07d0007350 0x7f07d00dc500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:58.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.523+0000 7f07d7e00640 1 -- 172.21.15.90:0/2881363597 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d00d9e80 con 0x7f07d0006f40 2024-09-21T03:22:58.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.523+0000 7f07d7e00640 1 --2- 172.21.15.90:0/2881363597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07d0006f40 0x7f07d00d9940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f07d8052860 tx=0x7f07d80af520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:58.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.524+0000 7f07c7e00640 1 -- 172.21.15.90:0/2881363597 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d80be020 con 0x7f07d0006f40 2024-09-21T03:22:58.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.524+0000 7f07c7e00640 1 -- 172.21.15.90:0/2881363597 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07d80ba820 con 0x7f07d0006f40 2024-09-21T03:22:58.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.524+0000 7f07c7e00640 1 -- 172.21.15.90:0/2881363597 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d80b4040 con 0x7f07d0006f40 2024-09-21T03:22:58.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.524+0000 7f07dd800640 1 -- 172.21.15.90:0/2881363597 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07d0046590 con 0x7f07d0006f40 2024-09-21T03:22:58.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.525+0000 7f07dd800640 1 -- 172.21.15.90:0/2881363597 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07d0035650 con 0x7f07d0006f40 2024-09-21T03:22:58.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.531+0000 7f07dd800640 1 -- 172.21.15.90:0/2881363597 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07d0035370 con 0x7f07d0006f40 2024-09-21T03:22:58.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.532+0000 7f07c7e00640 1 -- 172.21.15.90:0/2881363597 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f07d80c1020 con 0x7f07d0006f40 2024-09-21T03:22:58.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.536+0000 7f07c7e00640 1 --2- 172.21.15.90:0/2881363597 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f07bc078c60 0x7f07bc07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:58.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.536+0000 7f07c7e00640 1 -- 172.21.15.90:0/2881363597 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f07d8138ae0 con 0x7f07d0006f40 2024-09-21T03:22:58.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.537+0000 7f07d7400640 1 --2- 172.21.15.90:0/2881363597 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f07bc078c60 0x7f07bc07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:58.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.545+0000 7f07c7e00640 1 -- 172.21.15.90:0/2881363597 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f07d80c8030 con 0x7f07d0006f40 2024-09-21T03:22:58.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:58.548+0000 7f07d7400640 1 --2- 172.21.15.90:0/2881363597 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f07bc078c60 0x7f07bc07b170 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f07d0049a60 tx=0x7f07c8007970 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:59.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:22:59.211+0000 7f07dd800640 1 -- 172.21.15.90:0/2881363597 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f07d0031a50 con 0x7f07d0006f40 2024-09-21T03:23:01.519 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:23:01.529 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:23:04.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.134+0000 7f07c7e00640 1 -- 172.21.15.90:0/2881363597 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f07d8100bd0 con 0x7f07d0006f40 2024-09-21T03:23:04.136 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":62,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:23:04.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.139+0000 7f07dd800640 1 -- 172.21.15.90:0/2881363597 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f07bc078c60 msgr2=0x7f07bc07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:04.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.139+0000 7f07dd800640 1 --2- 172.21.15.90:0/2881363597 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f07bc078c60 0x7f07bc07b170 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f07d0049a60 tx=0x7f07c8007970 comp rx=0 tx=0).stop 2024-09-21T03:23:04.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.139+0000 7f07dd800640 1 -- 172.21.15.90:0/2881363597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07d0006f40 msgr2=0x7f07d00d9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:04.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.139+0000 7f07dd800640 1 --2- 172.21.15.90:0/2881363597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07d0006f40 0x7f07d00d9940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f07d8052860 tx=0x7f07d80af520 comp rx=0 tx=0).stop 2024-09-21T03:23:04.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.139+0000 7f07dd800640 1 -- 172.21.15.90:0/2881363597 shutdown_connections 2024-09-21T03:23:04.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.139+0000 7f07dd800640 1 --2- 172.21.15.90:0/2881363597 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f07bc078c60 0x7f07bc07b170 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:04.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.139+0000 7f07dd800640 1 --2- 172.21.15.90:0/2881363597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07d00d7a80 0x7f07d00d0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:04.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.139+0000 7f07dd800640 1 --2- 172.21.15.90:0/2881363597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07d0007350 0x7f07d00dc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:04.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.139+0000 7f07dd800640 1 --2- 172.21.15.90:0/2881363597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07d0006f40 0x7f07d00d9940 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f07d8052860 tx=0x7f07d80af520 comp rx=0 tx=0).stop 2024-09-21T03:23:04.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.139+0000 7f07dd800640 1 -- 172.21.15.90:0/2881363597 >> 172.21.15.90:0/2881363597 conn(0x7f07d00312e0 msgr2=0x7f07d00d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:04.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.140+0000 7f07dd800640 1 -- 172.21.15.90:0/2881363597 shutdown_connections 2024-09-21T03:23:04.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.143+0000 7f07dd800640 1 -- 172.21.15.90:0/2881363597 wait complete. 2024-09-21T03:23:04.199 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-21T03:23:04.199 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-21T03:23:04.199 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:23:04.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.740+0000 7f9371400640 1 -- 172.21.15.90:0/3958970598 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c031ad0 con 0x7f9358004d40 2024-09-21T03:23:04.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.740+0000 7f9378a00640 1 -- 172.21.15.90:0/3958970598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9358004d40 msgr2=0x7f93580051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:04.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.740+0000 7f9378a00640 1 --2- 172.21.15.90:0/3958970598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9358004d40 0x7f93580051d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f936c009f80 tx=0x7f9358005830 comp rx=0 tx=0).stop 2024-09-21T03:23:04.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.740+0000 7f9373200640 1 -- 172.21.15.90:0/3958970598 reap_dead start 2024-09-21T03:23:04.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.740+0000 7f9378a00640 1 -- 172.21.15.90:0/3958970598 shutdown_connections 2024-09-21T03:23:04.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.740+0000 7f9378a00640 1 -- 172.21.15.90:0/3958970598 >> 172.21.15.90:0/3958970598 conn(0x7f93740cc1e0 msgr2=0x7f93740cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:04.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.741+0000 7f9378a00640 1 -- 172.21.15.90:0/3958970598 shutdown_connections 2024-09-21T03:23:04.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.741+0000 7f9378a00640 1 -- 172.21.15.90:0/3958970598 wait complete. 2024-09-21T03:23:04.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.745+0000 7f9378a00640 1 Processor -- start 2024-09-21T03:23:04.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.746+0000 7f9378a00640 1 -- start start 2024-09-21T03:23:04.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.749+0000 7f9378a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9358004d40 0x7f93741f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:04.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.749+0000 7f9378a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f937414f830 0x7f93740b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:04.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.749+0000 7f9378a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f937414fc40 0x7f9374157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:04.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.749+0000 7f9378a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9374156bf0 con 0x7f937414fc40 2024-09-21T03:23:04.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.749+0000 7f9378a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f93740ca7d0 con 0x7f9358004d40 2024-09-21T03:23:04.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.749+0000 7f9378a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9374156d70 con 0x7f937414f830 2024-09-21T03:23:04.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.750+0000 7f9373200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f937414fc40 0x7f9374157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:04.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.751+0000 7f9373200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f937414fc40 0x7f9374157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35190/0 (socket says 172.21.15.90:35190) 2024-09-21T03:23:04.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.751+0000 7f9373200640 1 -- 172.21.15.90:0/1993666999 learned_addr learned my addr 172.21.15.90:0/1993666999 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:23:04.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.751+0000 7f9371e00640 1 -- 172.21.15.90:0/1993666999 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f937414f830 msgr2=0x7f93740b08d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:23:04.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.751+0000 7f9371e00640 1 --2- 172.21.15.90:0/1993666999 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f937414f830 0x7f93740b08d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:23:04.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.752+0000 7f9373200640 1 -- 172.21.15.90:0/1993666999 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f937414f830 msgr2=0x7f93740b08d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:23:04.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.752+0000 7f9373200640 1 --2- 172.21.15.90:0/1993666999 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f937414f830 0x7f93740b08d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:04.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.752+0000 7f9373200640 1 -- 172.21.15.90:0/1993666999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9358004d40 msgr2=0x7f93741f47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:04.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.752+0000 7f9373200640 1 --2- 172.21.15.90:0/1993666999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9358004d40 0x7f93741f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:04.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.752+0000 7f9373200640 1 -- 172.21.15.90:0/1993666999 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f937415aad0 con 0x7f937414fc40 2024-09-21T03:23:04.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.753+0000 7f9373200640 1 --2- 172.21.15.90:0/1993666999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f937414fc40 0x7f9374157d50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f936c00b140 tx=0x7f936c0305d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:04.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.754+0000 7f936aa00640 1 -- 172.21.15.90:0/1993666999 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c041030 con 0x7f937414fc40 2024-09-21T03:23:04.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.754+0000 7f9378a00640 1 -- 172.21.15.90:0/1993666999 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f937415adb0 con 0x7f937414fc40 2024-09-21T03:23:04.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.754+0000 7f936aa00640 1 -- 172.21.15.90:0/1993666999 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f936c031400 con 0x7f937414fc40 2024-09-21T03:23:04.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.754+0000 7f936aa00640 1 -- 172.21.15.90:0/1993666999 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c009c00 con 0x7f937414fc40 2024-09-21T03:23:04.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.754+0000 7f9378a00640 1 -- 172.21.15.90:0/1993666999 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93741f4cf0 con 0x7f937414fc40 2024-09-21T03:23:04.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.756+0000 7f9378a00640 1 --2- 172.21.15.90:0/1993666999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c002a70 0x7f934c004f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:04.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.756+0000 7f9378a00640 1 -- 172.21.15.90:0/1993666999 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f934c007f10 con 0x7f934c002a70 2024-09-21T03:23:04.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.758+0000 7f9372800640 1 --2- 172.21.15.90:0/1993666999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c002a70 0x7f934c004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:04.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.758+0000 7f9372800640 1 -- 172.21.15.90:0/1993666999 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f934c008110 con 0x7f934c002a70 2024-09-21T03:23:04.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.758+0000 7f936aa00640 1 -- 172.21.15.90:0/1993666999 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f936c044030 con 0x7f937414fc40 2024-09-21T03:23:04.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.760+0000 7f936aa00640 1 --2- 172.21.15.90:0/1993666999 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9354078b40 0x7f935407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:04.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.760+0000 7f936aa00640 1 -- 172.21.15.90:0/1993666999 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f936c0bbcb0 con 0x7f937414fc40 2024-09-21T03:23:04.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.761+0000 7f9372800640 1 --2- 172.21.15.90:0/1993666999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c002a70 0x7f934c004f80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9364001a10 tx=0x7f936400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:04.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.762+0000 7f936aa00640 1 -- 172.21.15.90:0/1993666999 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364017070 con 0x7f934c002a70 2024-09-21T03:23:04.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.762+0000 7f936aa00640 1 -- 172.21.15.90:0/1993666999 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f93640035f0 con 0x7f934c002a70 2024-09-21T03:23:04.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.762+0000 7f936aa00640 1 -- 172.21.15.90:0/1993666999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c002a70 msgr2=0x7f934c004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:04.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.763+0000 7f936aa00640 1 --2- 172.21.15.90:0/1993666999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c002a70 0x7f934c004f80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9364001a10 tx=0x7f936400ca60 comp rx=0 tx=0).stop 2024-09-21T03:23:04.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.763+0000 7f936aa00640 1 -- 172.21.15.90:0/1993666999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c002a70 msgr2=0x7f934c004f80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:23:04.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.763+0000 7f936aa00640 1 --2- 172.21.15.90:0/1993666999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c002a70 0x7f934c004f80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:04.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.765+0000 7f9371e00640 1 --2- 172.21.15.90:0/1993666999 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9354078b40 0x7f935407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:04.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.771+0000 7f9371e00640 1 --2- 172.21.15.90:0/1993666999 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9354078b40 0x7f935407b050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9374156660 tx=0x7f9360005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:04.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.775+0000 7f9378a00640 1 --2- 172.21.15.90:0/1993666999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c006f80 0x7f934c007460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:04.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.777+0000 7f9378a00640 1 -- 172.21.15.90:0/1993666999 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f934c00a4f0 con 0x7f934c006f80 2024-09-21T03:23:04.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.777+0000 7f9372800640 1 --2- 172.21.15.90:0/1993666999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c006f80 0x7f934c007460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:04.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.778+0000 7f9372800640 1 -- 172.21.15.90:0/1993666999 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f934c0079a0 con 0x7f934c006f80 2024-09-21T03:23:04.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.778+0000 7f9372800640 1 --2- 172.21.15.90:0/1993666999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c006f80 0x7f934c007460 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9364014000 tx=0x7f9364000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:04.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.779+0000 7f936aa00640 1 -- 172.21.15.90:0/1993666999 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364017030 con 0x7f934c006f80 2024-09-21T03:23:04.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.780+0000 7f936aa00640 1 -- 172.21.15.90:0/1993666999 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5184 (secure 0 0 0) 0x7f936401a280 con 0x7f934c006f80 2024-09-21T03:23:04.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.780+0000 7f936aa00640 1 -- 172.21.15.90:0/1993666999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c006f80 msgr2=0x7f934c007460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:04.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.780+0000 7f936aa00640 1 --2- 172.21.15.90:0/1993666999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c006f80 0x7f934c007460 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9364014000 tx=0x7f9364000ed0 comp rx=0 tx=0).stop 2024-09-21T03:23:04.783 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:23:04.783 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:23:04.783 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:23:04.783 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:23:04.783 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 62, 2024-09-21T03:23:04.783 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 228555, 2024-09-21T03:23:04.783 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:23:04.783 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:23:04.784 INFO:teuthology.orchestra.run.smithi090.stdout: 1 2024-09-21T03:23:04.784 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:04.784 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 0, 2024-09-21T03:23:04.784 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:23:04.784 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:23:04.784 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:23:04.784 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:04.784 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:04.784 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:04.784 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:04.784 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:04.784 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:04.784 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:04.784 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:04.784 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:04.785 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:04.785 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:04.785 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:04.785 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:23:04.785 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:23:04.785 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:04.785 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:04.785 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:04.785 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:04.785 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:04.785 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:04.785 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:04.785 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:04.785 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:04.785 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:04.786 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:04.786 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:04.786 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:04.786 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:23:04.786 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:23:04.786 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:23:04.786 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:23:04.786 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:23:04.786 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:23:04.786 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:23:04.786 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:23:04.786 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:23:04.786 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:23:04.786 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:23:04.787 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:23:04.787 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:23:04.787 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:23:04.787 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:23:04.787 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:23:04.787 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:23:04.787 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:04.787 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:04.787 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:04.787 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:04.787 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:04.787 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:04.787 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:04.787 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:04.788 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:04.788 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:04.788 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:04.788 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:04.788 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:23:04.788 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:04.788 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:23:04.788 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:04.788 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:23:04.788 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:23:04.788 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:04.788 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:04.788 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:04.788 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:04.788 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:23:04.789 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:04.789 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:04.789 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:04.789 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:04.789 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:23:04.789 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:04.789 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:04.789 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:04.789 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:04.789 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:23:04.789 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:23:04.789 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:04.789 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:04.789 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:04.789 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:04.790 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:04.790 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:23:04.790 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:23:04.790 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:04.790 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:04.790 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:04.790 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:04.790 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:23:04.790 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:04.790 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:04.790 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:04.790 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:04.790 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:23:04.790 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:04.791 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:04.791 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:04.791 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:04.791 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:23:04.791 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:23:04.791 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:04.791 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:04.791 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:04.791 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:04.791 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:04.791 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:23:04.791 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:23:04.791 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:04.791 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:04.792 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:04.792 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:04.792 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:23:04.792 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:04.792 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:04.792 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:04.792 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:04.792 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:23:04.792 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:04.792 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:04.792 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:04.792 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:04.792 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:23:04.792 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:23:04.793 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:04.793 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:04.793 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:04.793 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:04.793 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:04.793 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:04.793 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:23:04.793 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:23:04.793 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:04.793 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:04.793 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:04.793 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:23:04.793 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:04.794 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:04.794 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:23:04.794 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:04.794 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:04.794 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:04.794 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:23:04.794 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:04.794 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:04.794 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:23:04.794 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:04.794 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:04.794 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:04.794 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 7 2024-09-21T03:23:04.794 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:04.794 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:04.795 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:23:04.795 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:04.795 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:23:04.795 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:23:04.795 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:23:04.795 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:04.795 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:04.795 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:04.795 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:04.795 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6 2024-09-21T03:23:04.795 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:04.795 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:04.795 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:23:04.795 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:04.796 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:04.796 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:04.796 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:23:04.796 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:04.796 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:04.796 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:04.796 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:23:04.796 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:23:04.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.781+0000 7f936aa00640 1 -- 172.21.15.90:0/1993666999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c006f80 msgr2=0x7f934c007460 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:23:04.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.781+0000 7f936aa00640 1 --2- 172.21.15.90:0/1993666999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c006f80 0x7f934c007460 secure :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9364014000 tx=0x7f9364000ed0 comp rx=0 tx=0).stop 2024-09-21T03:23:04.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.784+0000 7f9378a00640 1 -- 172.21.15.90:0/1993666999 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9354078b40 msgr2=0x7f935407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:04.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.784+0000 7f9378a00640 1 --2- 172.21.15.90:0/1993666999 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9354078b40 0x7f935407b050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9374156660 tx=0x7f9360005f90 comp rx=0 tx=0).stop 2024-09-21T03:23:04.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.784+0000 7f9378a00640 1 -- 172.21.15.90:0/1993666999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f937414fc40 msgr2=0x7f9374157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:04.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.784+0000 7f9378a00640 1 --2- 172.21.15.90:0/1993666999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f937414fc40 0x7f9374157d50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f936c00b140 tx=0x7f936c0305d0 comp rx=0 tx=0).stop 2024-09-21T03:23:04.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.784+0000 7f9373200640 1 -- 172.21.15.90:0/1993666999 reap_dead start 2024-09-21T03:23:04.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.784+0000 7f9373200640 1 -- 172.21.15.90:0/1993666999 reap_dead start 2024-09-21T03:23:04.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.785+0000 7f9378a00640 1 -- 172.21.15.90:0/1993666999 shutdown_connections 2024-09-21T03:23:04.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.785+0000 7f9378a00640 1 -- 172.21.15.90:0/1993666999 >> 172.21.15.90:0/1993666999 conn(0x7f93740cc1e0 msgr2=0x7f937406e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:04.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.787+0000 7f9378a00640 1 -- 172.21.15.90:0/1993666999 shutdown_connections 2024-09-21T03:23:04.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:04.788+0000 7f9378a00640 1 -- 172.21.15.90:0/1993666999 wait complete. 2024-09-21T03:23:04.855 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-21T03:23:04.855 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-21T03:23:04.855 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:23:05.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.541+0000 7f6afe000640 1 -- 172.21.15.90:0/2935531565 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af80066e0 con 0x7f6ae4005260 2024-09-21T03:23:05.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.541+0000 7f6b06800640 1 -- 172.21.15.90:0/2935531565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ae4005260 msgr2=0x7f6ae4005760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:05.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.541+0000 7f6b06800640 1 --2- 172.21.15.90:0/2935531565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ae4005260 0x7f6ae4005760 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6af8001f00 tx=0x7f6ae4003810 comp rx=0 tx=0).stop 2024-09-21T03:23:05.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.542+0000 7f6b06800640 1 -- 172.21.15.90:0/2935531565 shutdown_connections 2024-09-21T03:23:05.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.542+0000 7f6b06800640 1 --2- 172.21.15.90:0/2935531565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ae4005260 0x7f6ae4005760 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:05.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.542+0000 7f6b06800640 1 -- 172.21.15.90:0/2935531565 >> 172.21.15.90:0/2935531565 conn(0x7f6b000c85a0 msgr2=0x7f6b000c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:05.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.543+0000 7f6b06800640 1 -- 172.21.15.90:0/2935531565 shutdown_connections 2024-09-21T03:23:05.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.543+0000 7f6b06800640 1 -- 172.21.15.90:0/2935531565 wait complete. 2024-09-21T03:23:05.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.551+0000 7f6b06800640 1 Processor -- start 2024-09-21T03:23:05.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.552+0000 7f6b06800640 1 -- start start 2024-09-21T03:23:05.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.555+0000 7f6b06800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ae4005260 0x7f6b001ec1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:05.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.555+0000 7f6b06800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b000c66f0 0x7f6b001e83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:05.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.556+0000 7f6aff400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ae4005260 0x7f6b001ec1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:05.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.556+0000 7f6b06800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b000c6b00 0x7f6b00149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:05.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.556+0000 7f6afea00640 1 -- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b000c66f0 msgr2=0x7f6b001e83d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3301/0 2024-09-21T03:23:05.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.556+0000 7f6aff400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ae4005260 0x7f6b001ec1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35248/0 (socket says 172.21.15.90:35248) 2024-09-21T03:23:05.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.556+0000 7f6aff400640 1 -- 172.21.15.90:0/3166044764 learned_addr learned my addr 172.21.15.90:0/3166044764 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:23:05.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.556+0000 7f6afea00640 1 --2- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b000c66f0 0x7f6b001e83d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:23:05.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.557+0000 7f6b06800640 1 -- 172.21.15.90:0/3166044764 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6b00150840 con 0x7f6ae4005260 2024-09-21T03:23:05.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.557+0000 7f6affe00640 1 --2- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b000c6b00 0x7f6b00149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:05.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.557+0000 7f6b06800640 1 -- 172.21.15.90:0/3166044764 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6b00153b20 con 0x7f6b000c6b00 2024-09-21T03:23:05.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.558+0000 7f6b06800640 1 -- 172.21.15.90:0/3166044764 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6b00070a40 con 0x7f6b000c66f0 2024-09-21T03:23:05.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.559+0000 7f6aff400640 1 -- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b000c66f0 msgr2=0x7f6b001e83d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:23:05.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.559+0000 7f6aff400640 1 --2- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b000c66f0 0x7f6b001e83d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:05.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.559+0000 7f6aff400640 1 -- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b000c6b00 msgr2=0x7f6b00149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:05.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.559+0000 7f6aff400640 1 --2- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b000c6b00 0x7f6b00149a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:05.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.559+0000 7f6aff400640 1 -- 172.21.15.90:0/3166044764 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b00156900 con 0x7f6ae4005260 2024-09-21T03:23:05.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.560+0000 7f6aff400640 1 --2- 172.21.15.90:0/3166044764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ae4005260 0x7f6b001ec1d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6af000d6e0 tx=0x7f6af000dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:05.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.562+0000 7f6af7400640 1 -- 172.21.15.90:0/3166044764 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af0017070 con 0x7f6ae4005260 2024-09-21T03:23:05.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.563+0000 7f6af7400640 1 -- 172.21.15.90:0/3166044764 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6af0009b30 con 0x7f6ae4005260 2024-09-21T03:23:05.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.563+0000 7f6b06800640 1 -- 172.21.15.90:0/3166044764 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b00156be0 con 0x7f6ae4005260 2024-09-21T03:23:05.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.563+0000 7f6af7400640 1 -- 172.21.15.90:0/3166044764 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af0010460 con 0x7f6ae4005260 2024-09-21T03:23:05.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.563+0000 7f6b06800640 1 -- 172.21.15.90:0/3166044764 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b0014ef50 con 0x7f6ae4005260 2024-09-21T03:23:05.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.569+0000 7f6b06800640 1 --2- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad8002a70 0x7f6ad8004f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:05.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.569+0000 7f6b06800640 1 -- 172.21.15.90:0/3166044764 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad8007f10 con 0x7f6ad8002a70 2024-09-21T03:23:05.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.572+0000 7f6afea00640 1 --2- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad8002a70 0x7f6ad8004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:05.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.572+0000 7f6af7400640 1 -- 172.21.15.90:0/3166044764 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6af001a070 con 0x7f6ae4005260 2024-09-21T03:23:05.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.572+0000 7f6afea00640 1 -- 172.21.15.90:0/3166044764 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ad8008110 con 0x7f6ad8002a70 2024-09-21T03:23:05.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.573+0000 7f6afea00640 1 --2- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad8002a70 0x7f6ad8004f80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0013f0 tx=0x7f6aec00dd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:05.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.576+0000 7f6af7400640 1 --2- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6ae0078b90 0x7f6ae007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:05.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.578+0000 7f6af7400640 1 -- 172.21.15.90:0/3166044764 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f6af009f060 con 0x7f6ae4005260 2024-09-21T03:23:05.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.579+0000 7f6affe00640 1 --2- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6ae0078b90 0x7f6ae007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:05.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.579+0000 7f6af7400640 1 -- 172.21.15.90:0/3166044764 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec014020 con 0x7f6ad8002a70 2024-09-21T03:23:05.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.579+0000 7f6af7400640 1 -- 172.21.15.90:0/3166044764 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6aec00b870 con 0x7f6ad8002a70 2024-09-21T03:23:05.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.580+0000 7f6af7400640 1 -- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad8002a70 msgr2=0x7f6ad8004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:05.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.580+0000 7f6af7400640 1 --2- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad8002a70 0x7f6ad8004f80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0013f0 tx=0x7f6aec00dd70 comp rx=0 tx=0).stop 2024-09-21T03:23:05.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.580+0000 7f6af7400640 1 -- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad8002a70 msgr2=0x7f6ad8004f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:23:05.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.580+0000 7f6af7400640 1 --2- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad8002a70 0x7f6ad8004f80 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0013f0 tx=0x7f6aec00dd70 comp rx=0 tx=0).stop 2024-09-21T03:23:05.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.587+0000 7f6affe00640 1 --2- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6ae0078b90 0x7f6ae007b0a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400e470 tx=0x7f6af8001670 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:05.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.612+0000 7f6b06800640 1 --2- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad8006f80 0x7f6ad8007460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:05.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.612+0000 7f6b06800640 1 -- 172.21.15.90:0/3166044764 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad800a4f0 con 0x7f6ad8006f80 2024-09-21T03:23:05.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.613+0000 7f6afea00640 1 --2- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad8006f80 0x7f6ad8007460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:05.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.614+0000 7f6afea00640 1 -- 172.21.15.90:0/3166044764 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6ad80079a0 con 0x7f6ad8006f80 2024-09-21T03:23:05.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.615+0000 7f6afea00640 1 --2- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad8006f80 0x7f6ad8007460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80080e0 tx=0x7f6aec001b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:05.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.616+0000 7f6af7400640 1 -- 172.21.15.90:0/3166044764 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec014070 con 0x7f6ad8006f80 2024-09-21T03:23:05.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.619+0000 7f6af7400640 1 -- 172.21.15.90:0/3166044764 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4704 (secure 0 0 0) 0x7f6aec010450 con 0x7f6ad8006f80 2024-09-21T03:23:05.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.619+0000 7f6af7400640 1 -- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad8006f80 msgr2=0x7f6ad8007460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:05.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.619+0000 7f6af7400640 1 --2- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad8006f80 0x7f6ad8007460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80080e0 tx=0x7f6aec001b00 comp rx=0 tx=0).stop 2024-09-21T03:23:05.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.619+0000 7f6af7400640 1 -- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad8006f80 msgr2=0x7f6ad8007460 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:23:05.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.619+0000 7f6af7400640 1 --2- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad8006f80 0x7f6ad8007460 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80080e0 tx=0x7f6aec001b00 comp rx=0 tx=0).stop 2024-09-21T03:23:05.623 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:23:05.623 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:23:05.623 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:23:05.623 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:23:05.623 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 62, 2024-09-21T03:23:05.624 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 37825, 2024-09-21T03:23:05.624 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:23:05.624 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:23:05.624 INFO:teuthology.orchestra.run.smithi090.stdout: 1 2024-09-21T03:23:05.624 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:05.624 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 1, 2024-09-21T03:23:05.624 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:23:05.624 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:23:05.624 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:23:05.624 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:05.624 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:05.625 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:05.625 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:05.625 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:05.625 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:05.625 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:05.625 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:05.625 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:05.625 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:05.625 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:05.626 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:05.626 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:23:05.626 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:23:05.626 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:05.626 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:05.626 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:05.626 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:05.626 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:05.626 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:05.626 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:05.626 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:05.626 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:05.626 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:05.626 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:05.627 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:05.627 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:05.627 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:23:05.627 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:23:05.627 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:23:05.627 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:23:05.627 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:23:05.627 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:23:05.627 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:23:05.627 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:23:05.627 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:23:05.627 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:23:05.627 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:23:05.627 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:23:05.628 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:23:05.628 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:23:05.628 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:23:05.628 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:23:05.628 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:23:05.628 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:05.628 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:05.628 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:05.628 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:05.628 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:05.628 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:05.628 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:05.628 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:05.629 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:05.629 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:05.629 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:05.629 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:05.629 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:23:05.629 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:05.629 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:23:05.629 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:05.629 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:23:05.629 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:23:05.629 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:05.629 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:05.629 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:05.630 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:05.630 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:23:05.630 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:05.630 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:05.630 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:05.630 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:05.630 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:23:05.630 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:05.630 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:05.630 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:05.630 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:05.630 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:23:05.630 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:23:05.630 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:05.631 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:05.631 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:05.631 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:05.631 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:05.631 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:23:05.631 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:23:05.631 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:05.631 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:05.631 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:05.631 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:05.631 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:23:05.631 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:05.631 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:05.631 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:05.632 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:05.632 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:23:05.632 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:05.632 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:05.632 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:05.632 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:05.632 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:23:05.632 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:23:05.632 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:05.632 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:05.632 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:05.632 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:05.632 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:05.632 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:23:05.633 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:23:05.633 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:05.633 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:05.633 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:05.633 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:05.633 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:23:05.633 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:05.633 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:05.633 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:05.633 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:05.633 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:23:05.633 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:05.633 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:05.633 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:05.634 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:05.634 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:23:05.634 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:23:05.634 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:05.634 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:05.634 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:05.634 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:05.634 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:05.634 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:05.634 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:23:05.634 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:23:05.634 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:05.634 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:05.634 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:05.635 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:23:05.635 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:05.635 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:05.635 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:23:05.635 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:05.635 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:05.635 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:05.635 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:23:05.635 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:05.635 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:05.635 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:23:05.635 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:05.635 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:05.635 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:05.636 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:23:05.636 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:05.636 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:05.636 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:05.636 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:23:05.636 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:23:05.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.622+0000 7f6b06800640 1 -- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6ae0078b90 msgr2=0x7f6ae007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:05.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.622+0000 7f6b06800640 1 --2- 172.21.15.90:0/3166044764 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6ae0078b90 0x7f6ae007b0a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400e470 tx=0x7f6af8001670 comp rx=0 tx=0).stop 2024-09-21T03:23:05.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.622+0000 7f6b06800640 1 -- 172.21.15.90:0/3166044764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ae4005260 msgr2=0x7f6b001ec1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:05.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.622+0000 7f6b06800640 1 --2- 172.21.15.90:0/3166044764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ae4005260 0x7f6b001ec1d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6af000d6e0 tx=0x7f6af000dba0 comp rx=0 tx=0).stop 2024-09-21T03:23:05.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.622+0000 7f6affe00640 1 -- 172.21.15.90:0/3166044764 reap_dead start 2024-09-21T03:23:05.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.622+0000 7f6affe00640 1 -- 172.21.15.90:0/3166044764 reap_dead start 2024-09-21T03:23:05.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.627+0000 7f6b06800640 1 -- 172.21.15.90:0/3166044764 shutdown_connections 2024-09-21T03:23:05.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.627+0000 7f6b06800640 1 -- 172.21.15.90:0/3166044764 >> 172.21.15.90:0/3166044764 conn(0x7f6b000c85a0 msgr2=0x7f6b000c2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:05.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.627+0000 7f6b06800640 1 -- 172.21.15.90:0/3166044764 shutdown_connections 2024-09-21T03:23:05.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:05.627+0000 7f6b06800640 1 -- 172.21.15.90:0/3166044764 wait complete. 2024-09-21T03:23:05.682 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-21T03:23:05.682 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-21T03:23:25.683 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-21T03:23:25.683 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-21T03:23:25.683 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-21T03:23:25.690 INFO:tasks.ceph.mon.c:Started 2024-09-21T03:23:25.690 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-21T03:23:25.691 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:23:26.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.717+0000 7f5f75200640 1 -- 172.21.15.90:0/1298101805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f6800ae40 msgr2=0x7f5f680e1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:26.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.717+0000 7f5f75200640 1 --2- 172.21.15.90:0/1298101805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f6800ae40 0x7f5f680e1850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5f680d8010 tx=0x7f5f5c02a4d0 comp rx=0 tx=0).stop 2024-09-21T03:23:26.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.721+0000 7f5f75200640 1 -- 172.21.15.90:0/1298101805 shutdown_connections 2024-09-21T03:23:26.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.721+0000 7f5f75200640 1 --2- 172.21.15.90:0/1298101805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f6800ae40 0x7f5f680e1850 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:26.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.721+0000 7f5f75200640 1 --2- 172.21.15.90:0/1298101805 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f680cd950 0x7f5f680d7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:26.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.721+0000 7f5f75200640 1 -- 172.21.15.90:0/1298101805 >> 172.21.15.90:0/1298101805 conn(0x7f5f68048450 msgr2=0x7f5f68048860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:26.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.724+0000 7f5f75200640 1 -- 172.21.15.90:0/1298101805 shutdown_connections 2024-09-21T03:23:26.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.724+0000 7f5f75200640 1 -- 172.21.15.90:0/1298101805 wait complete. 2024-09-21T03:23:26.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.728+0000 7f5f75200640 1 Processor -- start 2024-09-21T03:23:26.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.729+0000 7f5f75200640 1 -- start start 2024-09-21T03:23:26.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.732+0000 7f5f75200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f6800aa30 0x7f5f6803d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:26.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.732+0000 7f5f75200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f6800ae40 0x7f5f680d3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:26.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.732+0000 7f5f75200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f680cd950 0x7f5f6817cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:26.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.733+0000 7f5f6de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f6800aa30 0x7f5f6803d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:26.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.733+0000 7f5f6de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f6800aa30 0x7f5f6803d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:40418/0 (socket says 172.21.15.90:40418) 2024-09-21T03:23:26.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.733+0000 7f5f6de00640 1 -- 172.21.15.90:0/734789946 learned_addr learned my addr 172.21.15.90:0/734789946 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:23:26.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.733+0000 7f5f6d400640 1 --2- 172.21.15.90:0/734789946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f6800ae40 0x7f5f680d3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:26.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.735+0000 7f5f75200640 1 -- 172.21.15.90:0/734789946 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5f680461d0 con 0x7f5f680cd950 2024-09-21T03:23:26.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.735+0000 7f5f75200640 1 -- 172.21.15.90:0/734789946 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5f680479c0 con 0x7f5f6800aa30 2024-09-21T03:23:26.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.735+0000 7f5f75200640 1 -- 172.21.15.90:0/734789946 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5f680cdd60 con 0x7f5f6800ae40 2024-09-21T03:23:26.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.736+0000 7f5f6f200640 1 --2- 172.21.15.90:0/734789946 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f680cd950 0x7f5f6817cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:26.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.736+0000 7f5f6d400640 1 -- 172.21.15.90:0/734789946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f6800ae40 msgr2=0x7f5f680d3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-21T03:23:26.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.737+0000 7f5f6d400640 1 -- 172.21.15.90:0/734789946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f6800ae40 msgr2=0x7f5f680d3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-21T03:23:26.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.737+0000 7f5f6d400640 1 --2- 172.21.15.90:0/734789946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f6800ae40 0x7f5f680d3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-21T03:23:26.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.737+0000 7f5f6d400640 1 --2- 172.21.15.90:0/734789946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f6800ae40 0x7f5f680d3570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:23:26.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.738+0000 7f5f6f200640 1 -- 172.21.15.90:0/734789946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f6800ae40 msgr2=0x7f5f680d3570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:23:26.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.739+0000 7f5f6f200640 1 --2- 172.21.15.90:0/734789946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f6800ae40 0x7f5f680d3570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:26.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.739+0000 7f5f6f200640 1 -- 172.21.15.90:0/734789946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f6800aa30 msgr2=0x7f5f6803d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:26.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.739+0000 7f5f6f200640 1 --2- 172.21.15.90:0/734789946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f6800aa30 0x7f5f6803d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:26.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.739+0000 7f5f6f200640 1 -- 172.21.15.90:0/734789946 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f680d3090 con 0x7f5f680cd950 2024-09-21T03:23:26.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.739+0000 7f5f6de00640 1 --2- 172.21.15.90:0/734789946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f6800aa30 0x7f5f6803d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:23:26.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.740+0000 7f5f6f200640 1 --2- 172.21.15.90:0/734789946 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f680cd950 0x7f5f6817cf00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c031000 tx=0x7f5f5c032f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:26.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.741+0000 7f5f66000640 1 -- 172.21.15.90:0/734789946 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c040070 con 0x7f5f680cd950 2024-09-21T03:23:26.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.742+0000 7f5f66000640 1 -- 172.21.15.90:0/734789946 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f5c005220 con 0x7f5f680cd950 2024-09-21T03:23:26.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.742+0000 7f5f75200640 1 -- 172.21.15.90:0/734789946 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f6803e020 con 0x7f5f680cd950 2024-09-21T03:23:26.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.742+0000 7f5f75200640 1 -- 172.21.15.90:0/734789946 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f6817dd90 con 0x7f5f680cd950 2024-09-21T03:23:26.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.743+0000 7f5f66000640 1 -- 172.21.15.90:0/734789946 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c0047a0 con 0x7f5f680cd950 2024-09-21T03:23:26.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.747+0000 7f5f66000640 1 -- 172.21.15.90:0/734789946 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5f5c039040 con 0x7f5f680cd950 2024-09-21T03:23:26.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.749+0000 7f5f66000640 1 --2- 172.21.15.90:0/734789946 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5f50078b90 0x7f5f5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:26.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.750+0000 7f5f66000640 1 -- 172.21.15.90:0/734789946 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f5f5c0ba180 con 0x7f5f680cd950 2024-09-21T03:23:26.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.752+0000 7f5f6de00640 1 --2- 172.21.15.90:0/734789946 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5f50078b90 0x7f5f5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:26.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.753+0000 7f5f75200640 1 -- 172.21.15.90:0/734789946 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f48005290 con 0x7f5f680cd950 2024-09-21T03:23:26.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.758+0000 7f5f6de00640 1 --2- 172.21.15.90:0/734789946 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5f50078b90 0x7f5f5007b0a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5f700521d0 tx=0x7f5f70070040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:26.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:26.773+0000 7f5f66000640 1 -- 172.21.15.90:0/734789946 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5f5c049060 con 0x7f5f680cd950 2024-09-21T03:23:27.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:27.419+0000 7f5f75200640 1 -- 172.21.15.90:0/734789946 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5f48005580 con 0x7f5f680cd950 2024-09-21T03:23:27.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:27.420+0000 7f5f66000640 1 -- 172.21.15.90:0/734789946 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7f5f5c084280 con 0x7f5f680cd950 2024-09-21T03:23:27.422 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":62,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:23:27.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:27.424+0000 7f5f75200640 1 -- 172.21.15.90:0/734789946 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5f50078b90 msgr2=0x7f5f5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:27.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:27.424+0000 7f5f75200640 1 --2- 172.21.15.90:0/734789946 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5f50078b90 0x7f5f5007b0a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5f700521d0 tx=0x7f5f70070040 comp rx=0 tx=0).stop 2024-09-21T03:23:27.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:27.424+0000 7f5f75200640 1 -- 172.21.15.90:0/734789946 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f680cd950 msgr2=0x7f5f6817cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:27.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:27.424+0000 7f5f75200640 1 --2- 172.21.15.90:0/734789946 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f680cd950 0x7f5f6817cf00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c031000 tx=0x7f5f5c032f00 comp rx=0 tx=0).stop 2024-09-21T03:23:27.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:27.425+0000 7f5f75200640 1 -- 172.21.15.90:0/734789946 shutdown_connections 2024-09-21T03:23:27.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:27.425+0000 7f5f75200640 1 --2- 172.21.15.90:0/734789946 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5f50078b90 0x7f5f5007b0a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:27.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:27.425+0000 7f5f75200640 1 --2- 172.21.15.90:0/734789946 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f680cd950 0x7f5f6817cf00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:27.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:27.425+0000 7f5f75200640 1 --2- 172.21.15.90:0/734789946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f6800ae40 0x7f5f680d3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:27.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:27.425+0000 7f5f75200640 1 --2- 172.21.15.90:0/734789946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f6800aa30 0x7f5f6803d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:27.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:27.425+0000 7f5f75200640 1 -- 172.21.15.90:0/734789946 >> 172.21.15.90:0/734789946 conn(0x7f5f68048450 msgr2=0x7f5f68004be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:27.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:27.426+0000 7f5f75200640 1 -- 172.21.15.90:0/734789946 shutdown_connections 2024-09-21T03:23:27.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:27.426+0000 7f5f75200640 1 -- 172.21.15.90:0/734789946 wait complete. 2024-09-21T03:23:30.517 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:23:31.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.213+0000 7efebd400640 1 -- 172.21.15.90:0/923438575 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeac0016f0 con 0x7efec006e980 2024-09-21T03:23:31.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.213+0000 7efec5400640 1 -- 172.21.15.90:0/923438575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efec006e980 msgr2=0x7efec00c2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:31.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.213+0000 7efec5400640 1 --2- 172.21.15.90:0/923438575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efec006e980 0x7efec00c2ac0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009830 tx=0x7efeb002b5e0 comp rx=0 tx=0).stop 2024-09-21T03:23:31.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.214+0000 7efec5400640 1 -- 172.21.15.90:0/923438575 shutdown_connections 2024-09-21T03:23:31.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.214+0000 7efec5400640 1 --2- 172.21.15.90:0/923438575 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efec00739a0 0x7efec006f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:31.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.214+0000 7efec5400640 1 --2- 172.21.15.90:0/923438575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efec006e980 0x7efec00c2ac0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:31.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.214+0000 7efec5400640 1 -- 172.21.15.90:0/923438575 >> 172.21.15.90:0/923438575 conn(0x7efec00c81f0 msgr2=0x7efec00c8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:31.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.214+0000 7efec5400640 1 -- 172.21.15.90:0/923438575 shutdown_connections 2024-09-21T03:23:31.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.214+0000 7efec5400640 1 -- 172.21.15.90:0/923438575 wait complete. 2024-09-21T03:23:31.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.221+0000 7efec5400640 1 Processor -- start 2024-09-21T03:23:31.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.221+0000 7efec5400640 1 -- start start 2024-09-21T03:23:31.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.226+0000 7efec5400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efec006e980 0x7efec0141390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:31.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.227+0000 7efec5400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efec00739a0 0x7efec014ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:31.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.227+0000 7efec5400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efec0152ad0 0x7efec014f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:31.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.227+0000 7efebe800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efec006e980 0x7efec0141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:31.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.227+0000 7efebe800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efec006e980 0x7efec0141390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53520/0 (socket says 172.21.15.90:53520) 2024-09-21T03:23:31.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.227+0000 7efec5400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efec0073200 con 0x7efec006e980 2024-09-21T03:23:31.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.227+0000 7efec5400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efec0074f90 con 0x7efec0152ad0 2024-09-21T03:23:31.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.227+0000 7efec5400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efec0070c60 con 0x7efec00739a0 2024-09-21T03:23:31.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.227+0000 7efebe800640 1 -- 172.21.15.90:0/3176099784 learned_addr learned my addr 172.21.15.90:0/3176099784 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:23:31.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.228+0000 7efebe800640 1 -- 172.21.15.90:0/3176099784 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efec00739a0 msgr2=0x7efec014ab10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:23:31.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.228+0000 7efebe800640 1 --2- 172.21.15.90:0/3176099784 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efec00739a0 0x7efec014ab10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:31.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.228+0000 7efebe800640 1 -- 172.21.15.90:0/3176099784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efec0152ad0 msgr2=0x7efec014f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:31.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.228+0000 7efebe800640 1 --2- 172.21.15.90:0/3176099784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efec0152ad0 0x7efec014f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:31.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.229+0000 7efebe800640 1 -- 172.21.15.90:0/3176099784 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec0141d20 con 0x7efec006e980 2024-09-21T03:23:31.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.229+0000 7efebe800640 1 --2- 172.21.15.90:0/3176099784 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efec006e980 0x7efec0141390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efeb002bbd0 tx=0x7efeb0003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:31.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.230+0000 7efeb6a00640 1 -- 172.21.15.90:0/3176099784 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0040030 con 0x7efec006e980 2024-09-21T03:23:31.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.230+0000 7efeb6a00640 1 -- 172.21.15.90:0/3176099784 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efeb0004510 con 0x7efec006e980 2024-09-21T03:23:31.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.230+0000 7efeb6a00640 1 -- 172.21.15.90:0/3176099784 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb00329c0 con 0x7efec006e980 2024-09-21T03:23:31.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.230+0000 7efec5400640 1 -- 172.21.15.90:0/3176099784 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec01ed110 con 0x7efec006e980 2024-09-21T03:23:31.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.230+0000 7efec5400640 1 -- 172.21.15.90:0/3176099784 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec014a5f0 con 0x7efec006e980 2024-09-21T03:23:31.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.234+0000 7efeb6a00640 1 -- 172.21.15.90:0/3176099784 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efeb0043030 con 0x7efec006e980 2024-09-21T03:23:31.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.235+0000 7efec5400640 1 -- 172.21.15.90:0/3176099784 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec00ac8a0 con 0x7efec006e980 2024-09-21T03:23:31.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.236+0000 7efeb6a00640 1 --2- 172.21.15.90:0/3176099784 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efea0078b90 0x7efea007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:31.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.236+0000 7efeb6a00640 1 -- 172.21.15.90:0/3176099784 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7efeb00bbac0 con 0x7efec006e980 2024-09-21T03:23:31.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.242+0000 7efebde00640 1 --2- 172.21.15.90:0/3176099784 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efea0078b90 0x7efea007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:31.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.248+0000 7efebde00640 1 --2- 172.21.15.90:0/3176099784 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efea0078b90 0x7efea007b0a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efeac001400 tx=0x7efeac001040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:31.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.250+0000 7efeb6a00640 1 -- 172.21.15.90:0/3176099784 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efeb004a030 con 0x7efec006e980 2024-09-21T03:23:31.761 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:23:31.770 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:23:31.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.787+0000 7efec5400640 1 -- 172.21.15.90:0/3176099784 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7efec00704f0 con 0x7efec006e980 2024-09-21T03:23:31.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.788+0000 7efeb6a00640 1 -- 172.21.15.90:0/3176099784 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7efeb0083570 con 0x7efec006e980 2024-09-21T03:23:31.793 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":64,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:23:31.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.793+0000 7efec5400640 1 -- 172.21.15.90:0/3176099784 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efea0078b90 msgr2=0x7efea007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:31.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.793+0000 7efec5400640 1 --2- 172.21.15.90:0/3176099784 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efea0078b90 0x7efea007b0a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efeac001400 tx=0x7efeac001040 comp rx=0 tx=0).stop 2024-09-21T03:23:31.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.793+0000 7efec5400640 1 -- 172.21.15.90:0/3176099784 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efec006e980 msgr2=0x7efec0141390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:31.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.793+0000 7efec5400640 1 --2- 172.21.15.90:0/3176099784 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efec006e980 0x7efec0141390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efeb002bbd0 tx=0x7efeb0003f80 comp rx=0 tx=0).stop 2024-09-21T03:23:31.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.794+0000 7efec5400640 1 -- 172.21.15.90:0/3176099784 shutdown_connections 2024-09-21T03:23:31.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.794+0000 7efec5400640 1 --2- 172.21.15.90:0/3176099784 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7efea0078b90 0x7efea007b0a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:31.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.794+0000 7efec5400640 1 --2- 172.21.15.90:0/3176099784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efec0152ad0 0x7efec014f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:31.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.794+0000 7efec5400640 1 --2- 172.21.15.90:0/3176099784 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efec00739a0 0x7efec014ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:31.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.794+0000 7efec5400640 1 --2- 172.21.15.90:0/3176099784 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efec006e980 0x7efec0141390 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:31.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.794+0000 7efec5400640 1 -- 172.21.15.90:0/3176099784 >> 172.21.15.90:0/3176099784 conn(0x7efec00c81f0 msgr2=0x7efec0148020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:31.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.795+0000 7efec5400640 1 -- 172.21.15.90:0/3176099784 shutdown_connections 2024-09-21T03:23:31.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:31.795+0000 7efec5400640 1 -- 172.21.15.90:0/3176099784 wait complete. 2024-09-21T03:23:31.854 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-21T03:23:31.854 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-21T03:23:31.854 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:23:32.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.630+0000 7f3f90800640 1 -- 172.21.15.90:0/1938301824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f88150170 msgr2=0x7f3f8806f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:32.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.630+0000 7f3f90800640 1 --2- 172.21.15.90:0/1938301824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f88150170 0x7f3f8806f7f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3f78005fd0 tx=0x7f3f7802a4a0 comp rx=0 tx=0).stop 2024-09-21T03:23:32.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.631+0000 7f3f90800640 1 -- 172.21.15.90:0/1938301824 shutdown_connections 2024-09-21T03:23:32.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.631+0000 7f3f90800640 1 --2- 172.21.15.90:0/1938301824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f88150170 0x7f3f8806f7f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:32.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.631+0000 7f3f90800640 1 -- 172.21.15.90:0/1938301824 >> 172.21.15.90:0/1938301824 conn(0x7f3f880c81b0 msgr2=0x7f3f880c85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:32.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.631+0000 7f3f90800640 1 -- 172.21.15.90:0/1938301824 shutdown_connections 2024-09-21T03:23:32.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.631+0000 7f3f90800640 1 -- 172.21.15.90:0/1938301824 wait complete. 2024-09-21T03:23:32.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.638+0000 7f3f90800640 1 Processor -- start 2024-09-21T03:23:32.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.638+0000 7f3f90800640 1 -- start start 2024-09-21T03:23:32.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.646+0000 7f3f90800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f880735a0 0x7f3f88142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:32.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.646+0000 7f3f90800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f88150170 0x7f3f881ecad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:32.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.646+0000 7f3f90800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f8814e330 0x7f3f8814e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:32.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.646+0000 7f3f90800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3f88073350 con 0x7f3f8814e330 2024-09-21T03:23:32.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.646+0000 7f3f90800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3f88150580 con 0x7f3f88150170 2024-09-21T03:23:32.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.646+0000 7f3f90800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3f88070710 con 0x7f3f880735a0 2024-09-21T03:23:32.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.646+0000 7f3f8d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f88150170 0x7f3f881ecad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:32.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.646+0000 7f3f8de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f880735a0 0x7f3f88142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:32.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.647+0000 7f3f8e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f8814e330 0x7f3f8814e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:32.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.648+0000 7f3f8e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f8814e330 0x7f3f8814e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53536/0 (socket says 172.21.15.90:53536) 2024-09-21T03:23:32.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.648+0000 7f3f8e800640 1 -- 172.21.15.90:0/3556804330 learned_addr learned my addr 172.21.15.90:0/3556804330 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:23:32.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.649+0000 7f3f8e800640 1 -- 172.21.15.90:0/3556804330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f880735a0 msgr2=0x7f3f88142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:32.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.649+0000 7f3f8e800640 1 --2- 172.21.15.90:0/3556804330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f880735a0 0x7f3f88142120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:32.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.649+0000 7f3f8e800640 1 -- 172.21.15.90:0/3556804330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f88150170 msgr2=0x7f3f881ecad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:32.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.649+0000 7f3f8e800640 1 --2- 172.21.15.90:0/3556804330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f88150170 0x7f3f881ecad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:32.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.649+0000 7f3f8e800640 1 -- 172.21.15.90:0/3556804330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8814a820 con 0x7f3f8814e330 2024-09-21T03:23:32.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.651+0000 7f3f8e800640 1 --2- 172.21.15.90:0/3556804330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f8814e330 0x7f3f8814e740 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400b9e0 tx=0x7f3f8400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:32.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.651+0000 7f3f82000640 1 -- 172.21.15.90:0/3556804330 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84003b70 con 0x7f3f8814e330 2024-09-21T03:23:32.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.651+0000 7f3f82000640 1 -- 172.21.15.90:0/3556804330 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f84003e00 con 0x7f3f8814e330 2024-09-21T03:23:32.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.651+0000 7f3f82000640 1 -- 172.21.15.90:0/3556804330 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400cb80 con 0x7f3f8814e330 2024-09-21T03:23:32.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.651+0000 7f3f90800640 1 -- 172.21.15.90:0/3556804330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f88142970 con 0x7f3f8814e330 2024-09-21T03:23:32.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.652+0000 7f3f90800640 1 -- 172.21.15.90:0/3556804330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f881ed370 con 0x7f3f8814e330 2024-09-21T03:23:32.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.658+0000 7f3f82000640 1 -- 172.21.15.90:0/3556804330 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3f84004000 con 0x7f3f8814e330 2024-09-21T03:23:32.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.659+0000 7f3f90800640 1 --2- 172.21.15.90:0/3556804330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f8814efd0 0x7f3f8814f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:32.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.659+0000 7f3f90800640 1 -- 172.21.15.90:0/3556804330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3f881ed610 con 0x7f3f8814efd0 2024-09-21T03:23:32.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.662+0000 7f3f8de00640 1 --2- 172.21.15.90:0/3556804330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f8814efd0 0x7f3f8814f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:32.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.664+0000 7f3f8de00640 1 -- 172.21.15.90:0/3556804330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f88142d20 con 0x7f3f8814efd0 2024-09-21T03:23:32.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.664+0000 7f3f82000640 1 --2- 172.21.15.90:0/3556804330 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3f6c078c90 0x7f3f6c07b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:32.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.665+0000 7f3f8de00640 1 --2- 172.21.15.90:0/3556804330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f8814efd0 0x7f3f8814f3e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00c380 tx=0x7f3f7c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:32.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.665+0000 7f3f82000640 1 -- 172.21.15.90:0/3556804330 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f3f8409aeb0 con 0x7f3f8814e330 2024-09-21T03:23:32.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.667+0000 7f3f8d400640 1 --2- 172.21.15.90:0/3556804330 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3f6c078c90 0x7f3f6c07b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:32.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.667+0000 7f3f82000640 1 -- 172.21.15.90:0/3556804330 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c015070 con 0x7f3f8814efd0 2024-09-21T03:23:32.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.668+0000 7f3f82000640 1 -- 172.21.15.90:0/3556804330 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3f7c011800 con 0x7f3f8814efd0 2024-09-21T03:23:32.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.668+0000 7f3f82000640 1 -- 172.21.15.90:0/3556804330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f8814efd0 msgr2=0x7f3f8814f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:32.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.668+0000 7f3f82000640 1 --2- 172.21.15.90:0/3556804330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f8814efd0 0x7f3f8814f3e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00c380 tx=0x7f3f7c00c840 comp rx=0 tx=0).stop 2024-09-21T03:23:32.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.668+0000 7f3f82000640 1 -- 172.21.15.90:0/3556804330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f8814efd0 msgr2=0x7f3f8814f3e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:23:32.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.668+0000 7f3f82000640 1 --2- 172.21.15.90:0/3556804330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f8814efd0 0x7f3f8814f3e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:32.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.681+0000 7f3f90800640 1 --2- 172.21.15.90:0/3556804330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f881df5a0 0x7f3f881df9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:32.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.681+0000 7f3f90800640 1 -- 172.21.15.90:0/3556804330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8806eb70 con 0x7f3f881df5a0 2024-09-21T03:23:32.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.682+0000 7f3f8de00640 1 --2- 172.21.15.90:0/3556804330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f881df5a0 0x7f3f881df9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:32.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.685+0000 7f3f8d400640 1 --2- 172.21.15.90:0/3556804330 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3f6c078c90 0x7f3f6c07b1a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3f78033000 tx=0x7f3f780046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:32.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.685+0000 7f3f8de00640 1 -- 172.21.15.90:0/3556804330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3f8806a2e0 con 0x7f3f881df5a0 2024-09-21T03:23:32.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.686+0000 7f3f8de00640 1 --2- 172.21.15.90:0/3556804330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f881df5a0 0x7f3f881df9b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00afd0 tx=0x7f3f7c004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:32.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.687+0000 7f3f82000640 1 -- 172.21.15.90:0/3556804330 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c004220 con 0x7f3f881df5a0 2024-09-21T03:23:32.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.687+0000 7f3f82000640 1 -- 172.21.15.90:0/3556804330 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5195 (secure 0 0 0) 0x7f3f7c0043c0 con 0x7f3f881df5a0 2024-09-21T03:23:32.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.687+0000 7f3f82000640 1 -- 172.21.15.90:0/3556804330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f881df5a0 msgr2=0x7f3f881df9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:32.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.687+0000 7f3f82000640 1 --2- 172.21.15.90:0/3556804330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f881df5a0 0x7f3f881df9b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00afd0 tx=0x7f3f7c004640 comp rx=0 tx=0).stop 2024-09-21T03:23:32.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.687+0000 7f3f82000640 1 -- 172.21.15.90:0/3556804330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f881df5a0 msgr2=0x7f3f881df9b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:23:32.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.687+0000 7f3f82000640 1 --2- 172.21.15.90:0/3556804330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f881df5a0 0x7f3f881df9b0 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00afd0 tx=0x7f3f7c004640 comp rx=0 tx=0).stop 2024-09-21T03:23:32.690 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:23:32.690 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:23:32.690 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:23:32.690 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:23:32.690 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 64, 2024-09-21T03:23:32.690 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 256461, 2024-09-21T03:23:32.691 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:23:32.691 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:23:32.691 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:23:32.691 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:23:32.691 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:32.691 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 3, 2024-09-21T03:23:32.691 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:23:32.691 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:23:32.691 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:23:32.691 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:32.691 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:32.691 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:32.691 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:32.691 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:32.692 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:32.692 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:32.692 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:32.692 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:32.692 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:32.692 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:32.692 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:32.692 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:23:32.692 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:23:32.692 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:32.692 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:32.692 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:32.692 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:32.692 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:32.693 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:32.693 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:32.693 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:32.693 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:32.693 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:32.693 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:32.693 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:32.693 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:32.693 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:23:32.693 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:23:32.693 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:23:32.693 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:23:32.693 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:23:32.693 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:23:32.693 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:23:32.694 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:23:32.694 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:23:32.694 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:23:32.694 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:23:32.694 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:23:32.694 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:23:32.694 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:23:32.694 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:23:32.694 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:23:32.694 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:23:32.694 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:32.694 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:32.694 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:32.694 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:32.695 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:32.695 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:32.695 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:32.695 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:32.695 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:32.695 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:32.695 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:32.695 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:32.695 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:23:32.695 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:32.695 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:23:32.695 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:32.695 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:23:32.695 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:23:32.695 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:32.696 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:32.696 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:32.696 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:32.696 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:23:32.696 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:32.696 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:32.696 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:32.696 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:32.696 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:23:32.696 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:32.696 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:32.696 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:32.696 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:32.697 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:23:32.697 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:23:32.697 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:32.697 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:32.697 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:32.697 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:32.697 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:32.697 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:23:32.697 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:23:32.697 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:32.697 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:32.697 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:32.698 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:32.698 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:23:32.698 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:32.698 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:32.698 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:32.698 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:32.698 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:23:32.698 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:32.698 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:32.698 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:32.698 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:32.699 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:23:32.699 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:23:32.699 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:32.699 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:32.699 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:32.699 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:32.699 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:32.699 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:23:32.699 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:23:32.699 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:32.699 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:32.700 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:32.700 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:32.700 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:23:32.700 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:32.700 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:32.700 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:32.700 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:32.700 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:23:32.700 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:32.700 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:32.700 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:32.700 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:32.700 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:23:32.700 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:23:32.701 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:32.701 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:32.701 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:32.701 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:32.701 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:32.701 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:32.701 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:23:32.701 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:23:32.701 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:32.701 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:32.701 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:32.701 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:23:32.701 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:32.701 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:32.701 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:23:32.702 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:32.702 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:32.702 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:32.702 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:23:32.702 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:32.702 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:32.702 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:23:32.702 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:32.702 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:32.702 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:32.702 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 7 2024-09-21T03:23:32.702 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:32.702 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:32.702 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:23:32.703 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:32.703 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:23:32.703 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:23:32.703 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:23:32.703 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:32.703 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:32.703 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:32.703 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:32.703 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6 2024-09-21T03:23:32.703 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:32.703 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:32.703 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:23:32.703 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:32.703 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:32.703 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:32.704 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:23:32.704 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:32.704 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:32.704 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:32.704 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:23:32.704 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:23:32.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.689+0000 7f3f90800640 1 -- 172.21.15.90:0/3556804330 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3f6c078c90 msgr2=0x7f3f6c07b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:32.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.689+0000 7f3f90800640 1 --2- 172.21.15.90:0/3556804330 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3f6c078c90 0x7f3f6c07b1a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3f78033000 tx=0x7f3f780046c0 comp rx=0 tx=0).stop 2024-09-21T03:23:32.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.689+0000 7f3f90800640 1 -- 172.21.15.90:0/3556804330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f8814e330 msgr2=0x7f3f8814e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:32.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.689+0000 7f3f90800640 1 --2- 172.21.15.90:0/3556804330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f8814e330 0x7f3f8814e740 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400b9e0 tx=0x7f3f8400bea0 comp rx=0 tx=0).stop 2024-09-21T03:23:32.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.689+0000 7f3f8e800640 1 -- 172.21.15.90:0/3556804330 reap_dead start 2024-09-21T03:23:32.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.689+0000 7f3f8e800640 1 -- 172.21.15.90:0/3556804330 reap_dead start 2024-09-21T03:23:32.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.690+0000 7f3f90800640 1 -- 172.21.15.90:0/3556804330 shutdown_connections 2024-09-21T03:23:32.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.690+0000 7f3f90800640 1 -- 172.21.15.90:0/3556804330 >> 172.21.15.90:0/3556804330 conn(0x7f3f880c81b0 msgr2=0x7f3f8814c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:32.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.690+0000 7f3f90800640 1 -- 172.21.15.90:0/3556804330 shutdown_connections 2024-09-21T03:23:32.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:32.691+0000 7f3f90800640 1 -- 172.21.15.90:0/3556804330 wait complete. 2024-09-21T03:23:32.742 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:23:32.743 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-21T03:23:32.743 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:23:33.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.260+0000 7fafdea00640 1 -- 172.21.15.90:0/3614449911 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd0031600 con 0x7fafe00ca2c0 2024-09-21T03:23:33.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.260+0000 7fafe6a00640 1 -- 172.21.15.90:0/3614449911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafe00ca2c0 msgr2=0x7fafe006e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:33.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.260+0000 7fafe6a00640 1 --2- 172.21.15.90:0/3614449911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafe00ca2c0 0x7fafe006e290 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fafd0009810 tx=0x7fafd002a420 comp rx=0 tx=0).stop 2024-09-21T03:23:33.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.261+0000 7fafe6a00640 1 -- 172.21.15.90:0/3614449911 shutdown_connections 2024-09-21T03:23:33.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.261+0000 7fafe6a00640 1 --2- 172.21.15.90:0/3614449911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafe00ca2c0 0x7fafe006e290 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fafd0009810 tx=0x7fafd002a420 comp rx=0 tx=0).stop 2024-09-21T03:23:33.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.261+0000 7fafe6a00640 1 -- 172.21.15.90:0/3614449911 >> 172.21.15.90:0/3614449911 conn(0x7fafe00c8e40 msgr2=0x7fafe00c9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:33.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.261+0000 7fafe6a00640 1 -- 172.21.15.90:0/3614449911 shutdown_connections 2024-09-21T03:23:33.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.261+0000 7fafe6a00640 1 -- 172.21.15.90:0/3614449911 wait complete. 2024-09-21T03:23:33.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.266+0000 7fafe6a00640 1 Processor -- start 2024-09-21T03:23:33.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.267+0000 7fafe6a00640 1 -- start start 2024-09-21T03:23:33.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.276+0000 7fafe6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafe00c7420 0x7fafe01ed200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:33.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.279+0000 7fafe6a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fafe00c81b0 0x7fafe01e1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:33.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.279+0000 7fafe6a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafe014b7f0 0x7fafe014bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:33.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.279+0000 7fafdfe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafe00c7420 0x7fafe01ed200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:33.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.279+0000 7fafe6a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fafe00ca6d0 con 0x7fafe014b7f0 2024-09-21T03:23:33.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.279+0000 7fafe6a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fafe00ca850 con 0x7fafe00c7420 2024-09-21T03:23:33.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.279+0000 7fafe6a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fafe00c88f0 con 0x7fafe00c81b0 2024-09-21T03:23:33.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.280+0000 7fafe4a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafe014b7f0 0x7fafe014bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:33.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.280+0000 7fafe4a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafe014b7f0 0x7fafe014bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53560/0 (socket says 172.21.15.90:53560) 2024-09-21T03:23:33.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.280+0000 7fafe4a00640 1 -- 172.21.15.90:0/3203402029 learned_addr learned my addr 172.21.15.90:0/3203402029 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:23:33.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.281+0000 7fafdf400640 1 --2- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fafe00c81b0 0x7fafe01e1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:33.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.282+0000 7fafe4a00640 1 -- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fafe00c81b0 msgr2=0x7fafe01e1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:33.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.282+0000 7fafe4a00640 1 --2- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fafe00c81b0 0x7fafe01e1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:33.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.282+0000 7fafe4a00640 1 -- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafe00c7420 msgr2=0x7fafe01ed200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:33.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.283+0000 7fafe4a00640 1 --2- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafe00c7420 0x7fafe01ed200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:33.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.283+0000 7fafe4a00640 1 -- 172.21.15.90:0/3203402029 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe00c5ad0 con 0x7fafe014b7f0 2024-09-21T03:23:33.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.285+0000 7fafdfe00640 1 --2- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafe00c7420 0x7fafe01ed200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:23:33.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.286+0000 7fafe4a00640 1 --2- 172.21.15.90:0/3203402029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafe014b7f0 0x7fafe014bc00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fafd800c780 tx=0x7fafd800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:33.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.287+0000 7fafd7e00640 1 -- 172.21.15.90:0/3203402029 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd8017070 con 0x7fafe014b7f0 2024-09-21T03:23:33.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.287+0000 7fafd7e00640 1 -- 172.21.15.90:0/3203402029 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafd8005070 con 0x7fafe014b7f0 2024-09-21T03:23:33.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.287+0000 7fafe6a00640 1 -- 172.21.15.90:0/3203402029 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafe00c4100 con 0x7fafe014b7f0 2024-09-21T03:23:33.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.287+0000 7fafe6a00640 1 -- 172.21.15.90:0/3203402029 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafe00c5d90 con 0x7fafe014b7f0 2024-09-21T03:23:33.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.289+0000 7fafd7e00640 1 -- 172.21.15.90:0/3203402029 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd80054c0 con 0x7fafe014b7f0 2024-09-21T03:23:33.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.290+0000 7fafe6a00640 1 --2- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafb8002a70 0x7fafb8004f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:33.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.290+0000 7fafe6a00640 1 -- 172.21.15.90:0/3203402029 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fafb8007f10 con 0x7fafb8002a70 2024-09-21T03:23:33.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.293+0000 7fafdfe00640 1 --2- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafb8002a70 0x7fafb8004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:33.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.294+0000 7fafd7e00640 1 -- 172.21.15.90:0/3203402029 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fafd801a070 con 0x7fafe014b7f0 2024-09-21T03:23:33.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.300+0000 7fafd7e00640 1 --2- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fafbc078bc0 0x7fafbc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:33.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.303+0000 7fafd7e00640 1 -- 172.21.15.90:0/3203402029 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fafd809a760 con 0x7fafe014b7f0 2024-09-21T03:23:33.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.303+0000 7fafdf400640 1 --2- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fafbc078bc0 0x7fafbc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:33.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.307+0000 7fafdfe00640 1 -- 172.21.15.90:0/3203402029 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fafb8008110 con 0x7fafb8002a70 2024-09-21T03:23:33.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.307+0000 7fafdf400640 1 --2- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fafbc078bc0 0x7fafbc07b0d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fafd0034000 tx=0x7fafd0004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:33.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.308+0000 7fafdfe00640 1 --2- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafb8002a70 0x7fafb8004f80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fafc800d440 tx=0x7fafc800d900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:33.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.309+0000 7fafd7e00640 1 -- 172.21.15.90:0/3203402029 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc8017070 con 0x7fafb8002a70 2024-09-21T03:23:33.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.312+0000 7fafd7e00640 1 -- 172.21.15.90:0/3203402029 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fafc8007030 con 0x7fafb8002a70 2024-09-21T03:23:33.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.312+0000 7fafd7e00640 1 -- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafb8002a70 msgr2=0x7fafb8004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:33.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.312+0000 7fafd7e00640 1 --2- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafb8002a70 0x7fafb8004f80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fafc800d440 tx=0x7fafc800d900 comp rx=0 tx=0).stop 2024-09-21T03:23:33.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.312+0000 7fafd7e00640 1 -- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafb8002a70 msgr2=0x7fafb8004f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:23:33.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.312+0000 7fafd7e00640 1 --2- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafb8002a70 0x7fafb8004f80 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fafc800d440 tx=0x7fafc800d900 comp rx=0 tx=0).stop 2024-09-21T03:23:33.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.355+0000 7fafe6a00640 1 --2- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafb8006f80 0x7fafb8007440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:33.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.356+0000 7fafe6a00640 1 -- 172.21.15.90:0/3203402029 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fafb800a4f0 con 0x7fafb8006f80 2024-09-21T03:23:33.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.358+0000 7fafdfe00640 1 --2- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafb8006f80 0x7fafb8007440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:33.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.359+0000 7fafdfe00640 1 -- 172.21.15.90:0/3203402029 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fafb8007980 con 0x7fafb8006f80 2024-09-21T03:23:33.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.359+0000 7fafdfe00640 1 --2- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafb8006f80 0x7fafb8007440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fafc800d440 tx=0x7fafc8001110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:33.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.360+0000 7fafd7e00640 1 -- 172.21.15.90:0/3203402029 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc8017040 con 0x7fafb8006f80 2024-09-21T03:23:33.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.360+0000 7fafd7e00640 1 -- 172.21.15.90:0/3203402029 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4715 (secure 0 0 0) 0x7fafc8006b10 con 0x7fafb8006f80 2024-09-21T03:23:33.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.360+0000 7fafd7e00640 1 -- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafb8006f80 msgr2=0x7fafb8007440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:33.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.360+0000 7fafd7e00640 1 --2- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafb8006f80 0x7fafb8007440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fafc800d440 tx=0x7fafc8001110 comp rx=0 tx=0).stop 2024-09-21T03:23:33.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.360+0000 7fafd7e00640 1 -- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafb8006f80 msgr2=0x7fafb8007440 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:23:33.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.360+0000 7fafd7e00640 1 --2- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafb8006f80 0x7fafb8007440 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fafc800d440 tx=0x7fafc8001110 comp rx=0 tx=0).stop 2024-09-21T03:23:33.364 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:23:33.364 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:23:33.364 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:23:33.364 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:23:33.364 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 64, 2024-09-21T03:23:33.364 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 65568, 2024-09-21T03:23:33.364 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:23:33.364 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:23:33.364 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:23:33.364 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:23:33.364 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:33.364 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 3, 2024-09-21T03:23:33.365 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:23:33.365 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:23:33.365 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:23:33.365 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:33.365 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:33.365 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:33.365 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:33.365 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:33.365 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:33.365 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:33.365 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:33.365 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:33.365 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:33.365 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:33.366 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:33.366 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:23:33.366 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:23:33.366 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:33.366 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:33.366 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:33.366 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:33.366 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:33.366 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:33.366 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:33.366 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:33.366 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:33.366 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:33.366 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:23:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:23:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:23:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:23:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:23:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:23:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:23:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:23:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:23:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:23:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:23:33.367 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:23:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:23:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:23:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:23:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:23:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:23:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:33.368 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:23:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:23:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:23:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:23:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:23:33.369 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:23:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:23:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:23:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:33.370 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:23:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:23:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:23:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:23:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:33.371 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:23:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:23:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:23:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:23:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:33.372 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:23:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:23:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:23:33.373 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:23:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:23:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:23:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:23:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:33.374 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:23:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:23:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:23:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:23:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:33.375 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:33.376 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.376 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:23:33.376 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:23:33.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.365+0000 7fafe6a00640 1 -- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fafbc078bc0 msgr2=0x7fafbc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:33.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.365+0000 7fafe6a00640 1 --2- 172.21.15.90:0/3203402029 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fafbc078bc0 0x7fafbc07b0d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fafd0034000 tx=0x7fafd0004730 comp rx=0 tx=0).stop 2024-09-21T03:23:33.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.365+0000 7fafe6a00640 1 -- 172.21.15.90:0/3203402029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafe014b7f0 msgr2=0x7fafe014bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:33.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.365+0000 7fafe6a00640 1 --2- 172.21.15.90:0/3203402029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafe014b7f0 0x7fafe014bc00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fafd800c780 tx=0x7fafd800cc40 comp rx=0 tx=0).stop 2024-09-21T03:23:33.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.365+0000 7fafe4a00640 1 -- 172.21.15.90:0/3203402029 reap_dead start 2024-09-21T03:23:33.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.365+0000 7fafe4a00640 1 -- 172.21.15.90:0/3203402029 reap_dead start 2024-09-21T03:23:33.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.365+0000 7fafe6a00640 1 -- 172.21.15.90:0/3203402029 shutdown_connections 2024-09-21T03:23:33.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.365+0000 7fafe6a00640 1 -- 172.21.15.90:0/3203402029 >> 172.21.15.90:0/3203402029 conn(0x7fafe00c8e40 msgr2=0x7fafe00c7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:33.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.368+0000 7fafe6a00640 1 -- 172.21.15.90:0/3203402029 shutdown_connections 2024-09-21T03:23:33.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.371+0000 7fafe6a00640 1 -- 172.21.15.90:0/3203402029 wait complete. 2024-09-21T03:23:33.454 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:23:33.454 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-21T03:23:33.455 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:23:33.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.912+0000 7f3d63e00640 1 -- 172.21.15.90:0/2173328471 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d54035020 con 0x7f3d641542b0 2024-09-21T03:23:33.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.913+0000 7f3d6a800640 1 -- 172.21.15.90:0/2173328471 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d641542b0 msgr2=0x7f3d640cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:33.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.913+0000 7f3d6a800640 1 --2- 172.21.15.90:0/2173328471 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d641542b0 0x7f3d640cb290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3d54005fd0 tx=0x7f3d5402a4f0 comp rx=0 tx=0).stop 2024-09-21T03:23:33.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.917+0000 7f3d6a800640 1 -- 172.21.15.90:0/2173328471 shutdown_connections 2024-09-21T03:23:33.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.917+0000 7f3d6a800640 1 --2- 172.21.15.90:0/2173328471 >> v2:172.21.15.90:3300/0 conn(0x7f3d640cb7d0 0x7f3d64161480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:33.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.917+0000 7f3d6a800640 1 --2- 172.21.15.90:0/2173328471 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d641542b0 0x7f3d640cb290 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:33.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.917+0000 7f3d6a800640 1 -- 172.21.15.90:0/2173328471 >> 172.21.15.90:0/2173328471 conn(0x7f3d640cc240 msgr2=0x7f3d640cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:33.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.919+0000 7f3d6a800640 1 -- 172.21.15.90:0/2173328471 shutdown_connections 2024-09-21T03:23:33.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.920+0000 7f3d6a800640 1 -- 172.21.15.90:0/2173328471 wait complete. 2024-09-21T03:23:33.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.930+0000 7f3d6a800640 1 Processor -- start 2024-09-21T03:23:33.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.930+0000 7f3d6a800640 1 -- start start 2024-09-21T03:23:33.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.937+0000 7f3d6a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d640cb7d0 0x7f3d640c06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:33.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.938+0000 7f3d6a800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d641542b0 0x7f3d641e19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:33.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.940+0000 7f3d6a800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d64157730 0x7f3d641584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:33.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.940+0000 7f3d69400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d640cb7d0 0x7f3d640c06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:33.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.941+0000 7f3d6a800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3d640c7190 con 0x7f3d641542b0 2024-09-21T03:23:33.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.941+0000 7f3d6a800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3d64156f90 con 0x7f3d640cb7d0 2024-09-21T03:23:33.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.941+0000 7f3d6a800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3d641546c0 con 0x7f3d64157730 2024-09-21T03:23:33.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.941+0000 7f3d69400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d640cb7d0 0x7f3d640c06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:40522/0 (socket says 172.21.15.90:40522) 2024-09-21T03:23:33.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.941+0000 7f3d69400640 1 -- 172.21.15.90:0/3393924726 learned_addr learned my addr 172.21.15.90:0/3393924726 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:23:33.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.942+0000 7f3d68a00640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d641542b0 0x7f3d641e19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:33.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.942+0000 7f3d69e00640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d64157730 0x7f3d641584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:33.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.945+0000 7f3d68a00640 1 -- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d64157730 msgr2=0x7f3d641584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:33.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.945+0000 7f3d68a00640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d64157730 0x7f3d641584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:33.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.945+0000 7f3d68a00640 1 -- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d640cb7d0 msgr2=0x7f3d640c06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:33.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.945+0000 7f3d68a00640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d640cb7d0 0x7f3d640c06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:33.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.945+0000 7f3d68a00640 1 -- 172.21.15.90:0/3393924726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d64159680 con 0x7f3d641542b0 2024-09-21T03:23:33.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.945+0000 7f3d69e00640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d64157730 0x7f3d641584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:23:33.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.946+0000 7f3d68a00640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d641542b0 0x7f3d641e19c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3d54031000 tx=0x7f3d54003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:33.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.946+0000 7f3d61600640 1 -- 172.21.15.90:0/3393924726 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5403e030 con 0x7f3d641542b0 2024-09-21T03:23:33.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.946+0000 7f3d61600640 1 -- 172.21.15.90:0/3393924726 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d54003e00 con 0x7f3d641542b0 2024-09-21T03:23:33.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.946+0000 7f3d61600640 1 -- 172.21.15.90:0/3393924726 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d54035040 con 0x7f3d641542b0 2024-09-21T03:23:33.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.946+0000 7f3d6a800640 1 -- 172.21.15.90:0/3393924726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d641e29c0 con 0x7f3d641542b0 2024-09-21T03:23:33.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.946+0000 7f3d6a800640 1 -- 172.21.15.90:0/3393924726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d64157f90 con 0x7f3d641542b0 2024-09-21T03:23:33.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.950+0000 7f3d6a800640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d641589f0 0x7f3d64151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:33.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.950+0000 7f3d6a800640 1 -- 172.21.15.90:0/3393924726 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3d6406f660 con 0x7f3d641589f0 2024-09-21T03:23:33.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.951+0000 7f3d69400640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d641589f0 0x7f3d64151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:33.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.954+0000 7f3d61600640 1 -- 172.21.15.90:0/3393924726 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3d54041030 con 0x7f3d641542b0 2024-09-21T03:23:33.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.955+0000 7f3d69400640 1 -- 172.21.15.90:0/3393924726 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d6408d3e0 con 0x7f3d641589f0 2024-09-21T03:23:33.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.956+0000 7f3d69400640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d641589f0 0x7f3d64151050 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c00f900 tx=0x7f3d5c00fdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:33.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.957+0000 7f3d61600640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3d48078c60 0x7f3d4807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:33.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.958+0000 7f3d61600640 1 -- 172.21.15.90:0/3393924726 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f3d540bb9f0 con 0x7f3d641542b0 2024-09-21T03:23:33.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.958+0000 7f3d69e00640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3d48078c60 0x7f3d4807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:33.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.959+0000 7f3d61600640 1 -- 172.21.15.90:0/3393924726 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c003b80 con 0x7f3d641589f0 2024-09-21T03:23:33.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.960+0000 7f3d61600640 1 -- 172.21.15.90:0/3393924726 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3d5c018070 con 0x7f3d641589f0 2024-09-21T03:23:33.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.960+0000 7f3d61600640 1 -- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d641589f0 msgr2=0x7f3d64151050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:33.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.960+0000 7f3d61600640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d641589f0 0x7f3d64151050 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c00f900 tx=0x7f3d5c00fdc0 comp rx=0 tx=0).stop 2024-09-21T03:23:33.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.960+0000 7f3d61600640 1 -- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d641589f0 msgr2=0x7f3d64151050 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:23:33.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.960+0000 7f3d61600640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d641589f0 0x7f3d64151050 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:33.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.961+0000 7f3d69e00640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3d48078c60 0x7f3d4807b170 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3d58005fd0 tx=0x7f3d5800b530 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:33.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.974+0000 7f3d6a800640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d64151590 0x7f3d641f03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:33.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.974+0000 7f3d6a800640 1 -- 172.21.15.90:0/3393924726 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3d64158160 con 0x7f3d64151590 2024-09-21T03:23:33.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.975+0000 7f3d69400640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d64151590 0x7f3d641f03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:33.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.979+0000 7f3d69400640 1 -- 172.21.15.90:0/3393924726 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3d64151b30 con 0x7f3d64151590 2024-09-21T03:23:33.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.980+0000 7f3d69400640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d64151590 0x7f3d641f03c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c017000 tx=0x7f3d5c001360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:33.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.984+0000 7f3d61600640 1 -- 172.21.15.90:0/3393924726 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c01ecb0 con 0x7f3d64151590 2024-09-21T03:23:33.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.984+0000 7f3d61600640 1 -- 172.21.15.90:0/3393924726 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4547 (secure 0 0 0) 0x7f3d5c0050d0 con 0x7f3d64151590 2024-09-21T03:23:33.986 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:23:33.987 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:23:33.987 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:23:33.987 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:23:33.987 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 64, 2024-09-21T03:23:33.987 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 7540, 2024-09-21T03:23:33.987 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:23:33.987 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:23:33.987 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:23:33.987 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:23:33.987 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:33.987 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 4, 2024-09-21T03:23:33.987 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:23:33.987 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:23:33.988 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:23:33.988 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:33.988 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:33.988 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:33.988 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:33.988 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:33.988 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:33.988 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:33.988 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:33.988 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:33.988 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:33.988 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:33.988 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:33.988 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:23:33.988 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:23:33.989 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:33.989 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:33.989 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:33.989 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:33.989 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:33.989 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:33.989 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:33.989 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:33.989 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:33.989 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:33.989 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:33.989 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:33.989 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.989 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:23:33.989 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:23:33.990 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:23:33.990 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:23:33.990 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:23:33.990 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:23:33.990 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:23:33.990 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:23:33.990 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:23:33.990 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:23:33.990 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:23:33.990 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:23:33.990 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:23:33.990 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:23:33.990 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:23:33.990 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:23:33.991 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:23:33.991 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:33.991 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:33.991 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:33.991 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:33.992 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:33.992 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:33.992 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:33.992 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:33.992 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:33.992 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:33.992 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:33.992 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:33.992 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:23:33.992 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.992 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:23:33.992 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.993 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:23:33.993 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:23:33.993 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:33.993 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:33.993 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.993 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:33.993 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:23:33.993 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:33.993 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.993 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.993 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:33.993 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:23:33.993 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:33.993 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:33.994 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:33.994 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.994 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:23:33.994 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:23:33.994 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:33.994 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:33.994 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:33.994 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.994 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.994 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:23:33.994 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:23:33.994 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:33.994 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:33.994 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.995 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:33.995 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:23:33.995 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:33.995 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.995 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.995 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:33.995 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:23:33.995 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:33.995 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:33.995 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:33.995 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.995 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:23:33.995 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:23:33.996 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:33.996 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:33.996 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:33.996 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.996 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.996 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:23:33.996 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:23:33.996 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:33.996 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:33.996 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.996 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:33.996 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:23:33.996 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:33.997 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.997 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.997 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:33.997 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:23:33.997 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:33.997 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:33.997 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:33.997 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.997 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:23:33.997 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:23:33.997 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:33.997 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:33.998 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:33.998 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:33.998 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:33.998 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.998 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:23:33.998 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:23:33.998 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.998 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:33.998 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:33.998 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:23:33.998 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:33.998 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:33.998 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:23:33.998 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:33.999 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:33.999 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:33.999 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:23:33.999 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:33.999 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:33.999 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:33.999 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:23:33.999 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:23:34.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.984+0000 7f3d61600640 1 -- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d64151590 msgr2=0x7f3d641f03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:34.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.984+0000 7f3d61600640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d64151590 0x7f3d641f03c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c017000 tx=0x7f3d5c001360 comp rx=0 tx=0).stop 2024-09-21T03:23:34.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.984+0000 7f3d61600640 1 -- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d64151590 msgr2=0x7f3d641f03c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:23:34.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.984+0000 7f3d61600640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d64151590 0x7f3d641f03c0 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c017000 tx=0x7f3d5c001360 comp rx=0 tx=0).stop 2024-09-21T03:23:34.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.986+0000 7f3d6a800640 1 -- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3d48078c60 msgr2=0x7f3d4807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:34.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.986+0000 7f3d6a800640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f3d48078c60 0x7f3d4807b170 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3d58005fd0 tx=0x7f3d5800b530 comp rx=0 tx=0).stop 2024-09-21T03:23:34.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.986+0000 7f3d6a800640 1 -- 172.21.15.90:0/3393924726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d641542b0 msgr2=0x7f3d641e19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:34.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.986+0000 7f3d6a800640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d641542b0 0x7f3d641e19c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3d54031000 tx=0x7f3d54003c10 comp rx=0 tx=0).stop 2024-09-21T03:23:34.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.986+0000 7f3d69e00640 1 -- 172.21.15.90:0/3393924726 reap_dead start 2024-09-21T03:23:34.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.986+0000 7f3d6a800640 1 -- 172.21.15.90:0/3393924726 shutdown_connections 2024-09-21T03:23:34.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.986+0000 7f3d6a800640 1 --2- 172.21.15.90:0/3393924726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d641542b0 0x7f3d641e19c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:34.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.986+0000 7f3d6a800640 1 -- 172.21.15.90:0/3393924726 >> 172.21.15.90:0/3393924726 conn(0x7f3d640cc240 msgr2=0x7f3d64155670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:34.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.987+0000 7f3d6a800640 1 -- 172.21.15.90:0/3393924726 shutdown_connections 2024-09-21T03:23:34.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:33.987+0000 7f3d6a800640 1 -- 172.21.15.90:0/3393924726 wait complete. 2024-09-21T03:23:34.047 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:23:34.047 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-21T03:23:34.047 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-21T03:23:34.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.499+0000 7f7edd000640 1 -- 172.21.15.90:0/3501018938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ebc003a00 msgr2=0x7f7ebc003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:34.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.499+0000 7f7edd000640 1 --2- 172.21.15.90:0/3501018938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ebc003a00 0x7f7ebc003e50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8072240 tx=0x7f7ebc005830 comp rx=0 tx=0).stop 2024-09-21T03:23:34.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.499+0000 7f7ed6800640 1 -- 172.21.15.90:0/3501018938 reap_dead start 2024-09-21T03:23:34.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.502+0000 7f7edd000640 1 -- 172.21.15.90:0/3501018938 shutdown_connections 2024-09-21T03:23:34.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.502+0000 7f7edd000640 1 -- 172.21.15.90:0/3501018938 >> 172.21.15.90:0/3501018938 conn(0x7f7ed80c8740 msgr2=0x7f7ed806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:34.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.502+0000 7f7edd000640 1 -- 172.21.15.90:0/3501018938 shutdown_connections 2024-09-21T03:23:34.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.502+0000 7f7edd000640 1 -- 172.21.15.90:0/3501018938 wait complete. 2024-09-21T03:23:34.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.506+0000 7f7edd000640 1 Processor -- start 2024-09-21T03:23:34.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.507+0000 7f7edd000640 1 -- start start 2024-09-21T03:23:34.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.511+0000 7f7edd000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ebc003a00 0x7f7ed8152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:34.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.511+0000 7f7edd000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ed80bd410 0x7f7ed81f9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:34.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.512+0000 7f7edd000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ed80c1120 0x7f7ed80c1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:34.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.512+0000 7f7edd000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed8156b90 con 0x7f7ebc003a00 2024-09-21T03:23:34.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.513+0000 7f7edd000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed8156a10 con 0x7f7ed80c1120 2024-09-21T03:23:34.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.513+0000 7f7edd000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7ed806ff00 con 0x7f7ed80bd410 2024-09-21T03:23:34.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.513+0000 7f7ed6800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ed80c1120 0x7f7ed80c1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:34.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.513+0000 7f7ed6800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ed80c1120 0x7f7ed80c1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:40536/0 (socket says 172.21.15.90:40536) 2024-09-21T03:23:34.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.513+0000 7f7ed6800640 1 -- 172.21.15.90:0/2940261177 learned_addr learned my addr 172.21.15.90:0/2940261177 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:23:34.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.514+0000 7f7ed5400640 1 --2- 172.21.15.90:0/2940261177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ed80bd410 0x7f7ed81f9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:34.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.514+0000 7f7ed5e00640 1 --2- 172.21.15.90:0/2940261177 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ebc003a00 0x7f7ed8152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:34.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.514+0000 7f7ed6800640 1 -- 172.21.15.90:0/2940261177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ed80bd410 msgr2=0x7f7ed81f9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:34.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.514+0000 7f7ed6800640 1 --2- 172.21.15.90:0/2940261177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ed80bd410 0x7f7ed81f9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:34.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.514+0000 7f7ed6800640 1 -- 172.21.15.90:0/2940261177 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ebc003a00 msgr2=0x7f7ed8152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:34.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.515+0000 7f7ed6800640 1 --2- 172.21.15.90:0/2940261177 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ebc003a00 0x7f7ed8152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:34.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.515+0000 7f7ed6800640 1 -- 172.21.15.90:0/2940261177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed80c1a70 con 0x7f7ed80c1120 2024-09-21T03:23:34.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.517+0000 7f7ed5e00640 1 --2- 172.21.15.90:0/2940261177 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ebc003a00 0x7f7ed8152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:23:34.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.517+0000 7f7ed6800640 1 --2- 172.21.15.90:0/2940261177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ed80c1120 0x7f7ed80c1530 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80c46c0 tx=0x7f7ed000d9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:34.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.518+0000 7f7ece000640 1 -- 172.21.15.90:0/2940261177 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed000f880 con 0x7f7ed80c1120 2024-09-21T03:23:34.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.519+0000 7f7ece000640 1 -- 172.21.15.90:0/2940261177 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ed0017070 con 0x7f7ed80c1120 2024-09-21T03:23:34.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.519+0000 7f7edd000640 1 -- 172.21.15.90:0/2940261177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed81585b0 con 0x7f7ed80c1120 2024-09-21T03:23:34.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.519+0000 7f7ece000640 1 -- 172.21.15.90:0/2940261177 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed000fdb0 con 0x7f7ed80c1120 2024-09-21T03:23:34.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.521+0000 7f7edd000640 1 -- 172.21.15.90:0/2940261177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed8153ad0 con 0x7f7ed80c1120 2024-09-21T03:23:34.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.527+0000 7f7ece000640 1 -- 172.21.15.90:0/2940261177 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7ed0010450 con 0x7f7ed80c1120 2024-09-21T03:23:34.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.529+0000 7f7ece000640 1 --2- 172.21.15.90:0/2940261177 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7eb8078bc0 0x7f7eb807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:34.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.529+0000 7f7ece000640 1 -- 172.21.15.90:0/2940261177 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f7ed009ad60 con 0x7f7ed80c1120 2024-09-21T03:23:34.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.530+0000 7f7ed5e00640 1 --2- 172.21.15.90:0/2940261177 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7eb8078bc0 0x7f7eb807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:34.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.532+0000 7f7ed5e00640 1 --2- 172.21.15.90:0/2940261177 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7eb8078bc0 0x7f7eb807b0d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8072520 tx=0x7f7ec80046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:34.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.535+0000 7f7edd000640 1 -- 172.21.15.90:0/2940261177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ed8157140 con 0x7f7ed80c1120 2024-09-21T03:23:34.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:34.562+0000 7f7ece000640 1 -- 172.21.15.90:0/2940261177 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7ed0020020 con 0x7f7ed80c1120 2024-09-21T03:23:35.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:35.123+0000 7f7edd000640 1 -- 172.21.15.90:0/2940261177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f7ed8156650 con 0x7f7ed80c1120 2024-09-21T03:23:35.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:35.127+0000 7f7ece000640 1 -- 172.21.15.90:0/2940261177 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f7ed0062e80 con 0x7f7ed80c1120 2024-09-21T03:23:35.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:35.133+0000 7f7edd000640 1 -- 172.21.15.90:0/2940261177 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7eb8078bc0 msgr2=0x7f7eb807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:35.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:35.133+0000 7f7edd000640 1 --2- 172.21.15.90:0/2940261177 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7eb8078bc0 0x7f7eb807b0d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8072520 tx=0x7f7ec80046c0 comp rx=0 tx=0).stop 2024-09-21T03:23:35.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:35.133+0000 7f7edd000640 1 -- 172.21.15.90:0/2940261177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ed80c1120 msgr2=0x7f7ed80c1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:35.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:35.133+0000 7f7edd000640 1 --2- 172.21.15.90:0/2940261177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ed80c1120 0x7f7ed80c1530 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80c46c0 tx=0x7f7ed000d9f0 comp rx=0 tx=0).stop 2024-09-21T03:23:35.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:35.134+0000 7f7edd000640 1 -- 172.21.15.90:0/2940261177 shutdown_connections 2024-09-21T03:23:35.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:35.134+0000 7f7edd000640 1 --2- 172.21.15.90:0/2940261177 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7eb8078bc0 0x7f7eb807b0d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:35.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:35.134+0000 7f7edd000640 1 --2- 172.21.15.90:0/2940261177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ed80c1120 0x7f7ed80c1530 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:35.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:35.134+0000 7f7edd000640 1 --2- 172.21.15.90:0/2940261177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ed80bd410 0x7f7ed81f9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:35.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:35.134+0000 7f7edd000640 1 --2- 172.21.15.90:0/2940261177 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ebc003a00 0x7f7ed8152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:35.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:35.134+0000 7f7edd000640 1 -- 172.21.15.90:0/2940261177 >> 172.21.15.90:0/2940261177 conn(0x7f7ed80c8740 msgr2=0x7f7ed8073430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:35.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:35.134+0000 7f7edd000640 1 -- 172.21.15.90:0/2940261177 shutdown_connections 2024-09-21T03:23:35.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:35.134+0000 7f7edd000640 1 -- 172.21.15.90:0/2940261177 wait complete. 2024-09-21T03:23:35.187 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-21T03:23:45.188 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-21T03:23:45.188 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:23:45.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.683+0000 7f8726600640 1 -- 172.21.15.90:0/1708112816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f871804a190 msgr2=0x7f871804e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:45.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.683+0000 7f8726600640 1 --2- 172.21.15.90:0/1708112816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f871804a190 0x7f871804e0c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8714005fd0 tx=0x7f871402a4b0 comp rx=0 tx=0).stop 2024-09-21T03:23:45.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.684+0000 7f8726600640 1 -- 172.21.15.90:0/1708112816 shutdown_connections 2024-09-21T03:23:45.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.684+0000 7f8726600640 1 --2- 172.21.15.90:0/1708112816 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f871800da90 0x7f871804ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:45.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.684+0000 7f8726600640 1 --2- 172.21.15.90:0/1708112816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f871804a190 0x7f871804e0c0 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8714005fd0 tx=0x7f871402a4b0 comp rx=0 tx=0).stop 2024-09-21T03:23:45.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.684+0000 7f8726600640 1 -- 172.21.15.90:0/1708112816 >> 172.21.15.90:0/1708112816 conn(0x7f8718031300 msgr2=0x7f8718031710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:45.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.689+0000 7f8726600640 1 -- 172.21.15.90:0/1708112816 shutdown_connections 2024-09-21T03:23:45.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.689+0000 7f8726600640 1 -- 172.21.15.90:0/1708112816 wait complete. 2024-09-21T03:23:45.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.702+0000 7f8726600640 1 Processor -- start 2024-09-21T03:23:45.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.706+0000 7f8726600640 1 -- start start 2024-09-21T03:23:45.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.709+0000 7f8726600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f871800da90 0x7f8718047a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:45.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.709+0000 7f8726600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f871804f180 0x7f87180457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:45.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.709+0000 7f8726600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f871800af30 0x7f87180e07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:45.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.709+0000 7f8726600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f871804e600 con 0x7f871800da90 2024-09-21T03:23:45.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.709+0000 7f8726600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f871804b6c0 con 0x7f871800af30 2024-09-21T03:23:45.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.709+0000 7f8726600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f871804e780 con 0x7f871804f180 2024-09-21T03:23:45.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.710+0000 7f871ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f871804f180 0x7f87180457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:45.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.710+0000 7f871ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f871804f180 0x7f87180457e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:59156/0 (socket says 172.21.15.90:59156) 2024-09-21T03:23:45.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.710+0000 7f871ea00640 1 -- 172.21.15.90:0/312488021 learned_addr learned my addr 172.21.15.90:0/312488021 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:23:45.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.711+0000 7f871fe00640 1 --2- 172.21.15.90:0/312488021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f871800af30 0x7f87180e07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:45.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.713+0000 7f871f400640 1 --2- 172.21.15.90:0/312488021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f871800da90 0x7f8718047a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:45.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.714+0000 7f871ea00640 1 -- 172.21.15.90:0/312488021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f871800af30 msgr2=0x7f87180e07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:45.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.715+0000 7f871ea00640 1 --2- 172.21.15.90:0/312488021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f871800af30 0x7f87180e07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:45.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.715+0000 7f871ea00640 1 -- 172.21.15.90:0/312488021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f871800da90 msgr2=0x7f8718047a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:45.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.716+0000 7f871ea00640 1 --2- 172.21.15.90:0/312488021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f871800da90 0x7f8718047a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:45.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.716+0000 7f871ea00640 1 -- 172.21.15.90:0/312488021 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87180e1430 con 0x7f871804f180 2024-09-21T03:23:45.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.717+0000 7f871fe00640 1 --2- 172.21.15.90:0/312488021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f871800af30 0x7f87180e07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:23:45.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.718+0000 7f871f400640 1 --2- 172.21.15.90:0/312488021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f871800da90 0x7f8718047a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:23:45.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.719+0000 7f871ea00640 1 --2- 172.21.15.90:0/312488021 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f871804f180 0x7f87180457e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f870c00c970 tx=0x7f870c00cd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:45.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.727+0000 7f8713400640 1 -- 172.21.15.90:0/312488021 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c007bb0 con 0x7f871804f180 2024-09-21T03:23:45.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.727+0000 7f8713400640 1 -- 172.21.15.90:0/312488021 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f870c007d50 con 0x7f871804f180 2024-09-21T03:23:45.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.727+0000 7f8713400640 1 -- 172.21.15.90:0/312488021 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c005280 con 0x7f871804f180 2024-09-21T03:23:45.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.728+0000 7f8726600640 1 -- 172.21.15.90:0/312488021 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8718009cb0 con 0x7f871804f180 2024-09-21T03:23:45.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.729+0000 7f8726600640 1 -- 172.21.15.90:0/312488021 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8718175520 con 0x7f871804f180 2024-09-21T03:23:45.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.733+0000 7f8726600640 1 -- 172.21.15.90:0/312488021 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8718175720 con 0x7f871804f180 2024-09-21T03:23:45.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.737+0000 7f8713400640 1 -- 172.21.15.90:0/312488021 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f870c005420 con 0x7f871804f180 2024-09-21T03:23:45.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.739+0000 7f8713400640 1 --2- 172.21.15.90:0/312488021 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8700078c90 0x7f870007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:45.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.739+0000 7f8713400640 1 -- 172.21.15.90:0/312488021 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f870c09b300 con 0x7f871804f180 2024-09-21T03:23:45.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.740+0000 7f871f400640 1 --2- 172.21.15.90:0/312488021 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8700078c90 0x7f870007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:45.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.745+0000 7f871f400640 1 --2- 172.21.15.90:0/312488021 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8700078c90 0x7f870007b1a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8714033000 tx=0x7f8714004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:45.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:45.758+0000 7f8713400640 1 -- 172.21.15.90:0/312488021 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f870c014030 con 0x7f871804f180 2024-09-21T03:23:46.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.338+0000 7f8726600640 1 -- 172.21.15.90:0/312488021 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f871804e0c0 con 0x7f871804f180 2024-09-21T03:23:46.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.342+0000 7f8713400640 1 -- 172.21.15.90:0/312488021 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f870c063480 con 0x7f871804f180 2024-09-21T03:23:46.344 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":64,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:23:46.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.346+0000 7f8726600640 1 -- 172.21.15.90:0/312488021 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8700078c90 msgr2=0x7f870007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:46.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.346+0000 7f8726600640 1 --2- 172.21.15.90:0/312488021 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8700078c90 0x7f870007b1a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8714033000 tx=0x7f8714004730 comp rx=0 tx=0).stop 2024-09-21T03:23:46.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.346+0000 7f8726600640 1 -- 172.21.15.90:0/312488021 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f871804f180 msgr2=0x7f87180457e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:46.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.346+0000 7f8726600640 1 --2- 172.21.15.90:0/312488021 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f871804f180 0x7f87180457e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f870c00c970 tx=0x7f870c00cd70 comp rx=0 tx=0).stop 2024-09-21T03:23:46.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.346+0000 7f8726600640 1 -- 172.21.15.90:0/312488021 shutdown_connections 2024-09-21T03:23:46.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.346+0000 7f8726600640 1 --2- 172.21.15.90:0/312488021 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8700078c90 0x7f870007b1a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:46.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.346+0000 7f8726600640 1 --2- 172.21.15.90:0/312488021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f871800af30 0x7f87180e07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:46.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.346+0000 7f8726600640 1 --2- 172.21.15.90:0/312488021 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f871804f180 0x7f87180457e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:46.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.346+0000 7f8726600640 1 --2- 172.21.15.90:0/312488021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f871800da90 0x7f8718047a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:46.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.346+0000 7f8726600640 1 -- 172.21.15.90:0/312488021 >> 172.21.15.90:0/312488021 conn(0x7f8718031300 msgr2=0x7f871802fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:46.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.347+0000 7f8726600640 1 -- 172.21.15.90:0/312488021 shutdown_connections 2024-09-21T03:23:46.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.347+0000 7f8726600640 1 -- 172.21.15.90:0/312488021 wait complete. 2024-09-21T03:23:46.398 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-21T03:23:46.398 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-21T03:23:46.398 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-21T03:23:46.398 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:23:46.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.888+0000 7f45d7e00640 1 -- 172.21.15.90:0/1197992498 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c8034070 con 0x7f45bc0051a0 2024-09-21T03:23:46.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.890+0000 7f45dd800640 1 -- 172.21.15.90:0/1197992498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45bc0051a0 msgr2=0x7f45bc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:46.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.890+0000 7f45dd800640 1 --2- 172.21.15.90:0/1197992498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45bc0051a0 0x7f45bc00b9c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f45c8006db0 tx=0x7f45bc005830 comp rx=0 tx=0).stop 2024-09-21T03:23:46.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.891+0000 7f45dd800640 1 -- 172.21.15.90:0/1197992498 shutdown_connections 2024-09-21T03:23:46.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.891+0000 7f45dd800640 1 --2- 172.21.15.90:0/1197992498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45bc0051a0 0x7f45bc00b9c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:46.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.891+0000 7f45dd800640 1 -- 172.21.15.90:0/1197992498 >> 172.21.15.90:0/1197992498 conn(0x7f45d806ead0 msgr2=0x7f45d806eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:46.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.892+0000 7f45dd800640 1 -- 172.21.15.90:0/1197992498 shutdown_connections 2024-09-21T03:23:46.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.892+0000 7f45dd800640 1 -- 172.21.15.90:0/1197992498 wait complete. 2024-09-21T03:23:46.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.896+0000 7f45dd800640 1 Processor -- start 2024-09-21T03:23:46.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.897+0000 7f45dd800640 1 -- start start 2024-09-21T03:23:46.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.901+0000 7f45dd800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45bc0051a0 0x7f45d8150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:46.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.901+0000 7f45dd800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45d814b1f0 0x7f45d80bdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:46.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.901+0000 7f45dd800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45d81fc710 0x7f45d80c1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:46.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.901+0000 7f45dd800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f45d80c2d40 con 0x7f45d814b1f0 2024-09-21T03:23:46.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.901+0000 7f45dd800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f45d80acf00 con 0x7f45d81fc710 2024-09-21T03:23:46.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.901+0000 7f45dd800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f45d80c2ec0 con 0x7f45bc0051a0 2024-09-21T03:23:46.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.904+0000 7f45d6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45d81fc710 0x7f45d80c1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:46.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.904+0000 7f45d6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45d81fc710 0x7f45d80c1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:44772/0 (socket says 172.21.15.90:44772) 2024-09-21T03:23:46.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.904+0000 7f45d6a00640 1 -- 172.21.15.90:0/3994423079 learned_addr learned my addr 172.21.15.90:0/3994423079 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:23:46.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.904+0000 7f45d5600640 1 --2- 172.21.15.90:0/3994423079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45d814b1f0 0x7f45d80bdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:46.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.905+0000 7f45d6a00640 1 -- 172.21.15.90:0/3994423079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45bc0051a0 msgr2=0x7f45d8150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:46.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.905+0000 7f45d6a00640 1 --2- 172.21.15.90:0/3994423079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45bc0051a0 0x7f45d8150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:46.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.905+0000 7f45d6a00640 1 -- 172.21.15.90:0/3994423079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45d814b1f0 msgr2=0x7f45d80bdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:46.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.905+0000 7f45d6a00640 1 --2- 172.21.15.90:0/3994423079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45d814b1f0 0x7f45d80bdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:46.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.905+0000 7f45d6a00640 1 -- 172.21.15.90:0/3994423079 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d81fd0c0 con 0x7f45d81fc710 2024-09-21T03:23:46.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.907+0000 7f45d6a00640 1 --2- 172.21.15.90:0/3994423079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45d81fc710 0x7f45d80c1c00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f45c8000f80 tx=0x7f45c8003ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:46.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.907+0000 7f45cea00640 1 -- 172.21.15.90:0/3994423079 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c803e070 con 0x7f45d81fc710 2024-09-21T03:23:46.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.908+0000 7f45dd800640 1 -- 172.21.15.90:0/3994423079 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d814fc10 con 0x7f45d81fc710 2024-09-21T03:23:46.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.908+0000 7f45dd800640 1 -- 172.21.15.90:0/3994423079 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d81f6b40 con 0x7f45d81fc710 2024-09-21T03:23:46.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.909+0000 7f45cea00640 1 -- 172.21.15.90:0/3994423079 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45c8006480 con 0x7f45d81fc710 2024-09-21T03:23:46.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.910+0000 7f45cea00640 1 -- 172.21.15.90:0/3994423079 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c803e070 con 0x7f45d81fc710 2024-09-21T03:23:46.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.913+0000 7f45dd800640 1 --2- 172.21.15.90:0/3994423079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b0002a70 0x7f45b0004f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:46.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.913+0000 7f45dd800640 1 -- 172.21.15.90:0/3994423079 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f45b0007f10 con 0x7f45b0002a70 2024-09-21T03:23:46.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.916+0000 7f45d6000640 1 --2- 172.21.15.90:0/3994423079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b0002a70 0x7f45b0004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:46.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.916+0000 7f45cea00640 1 -- 172.21.15.90:0/3994423079 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f45c8037070 con 0x7f45d81fc710 2024-09-21T03:23:46.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.918+0000 7f45d6000640 1 -- 172.21.15.90:0/3994423079 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45b0008110 con 0x7f45b0002a70 2024-09-21T03:23:46.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.919+0000 7f45d6000640 1 --2- 172.21.15.90:0/3994423079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b0002a70 0x7f45b0004f80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f45c4011980 tx=0x7f45c4011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:46.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.923+0000 7f45cea00640 1 --2- 172.21.15.90:0/3994423079 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f45b8078dc0 0x7f45b807b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:46.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.923+0000 7f45d5600640 1 --2- 172.21.15.90:0/3994423079 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f45b8078dc0 0x7f45b807b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:46.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.924+0000 7f45cea00640 1 -- 172.21.15.90:0/3994423079 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f45c80b9b40 con 0x7f45d81fc710 2024-09-21T03:23:46.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.924+0000 7f45cea00640 1 -- 172.21.15.90:0/3994423079 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c4004440 con 0x7f45b0002a70 2024-09-21T03:23:46.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.925+0000 7f45cea00640 1 -- 172.21.15.90:0/3994423079 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f45c4004440 con 0x7f45b0002a70 2024-09-21T03:23:46.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.925+0000 7f45cea00640 1 -- 172.21.15.90:0/3994423079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b0002a70 msgr2=0x7f45b0004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:46.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.925+0000 7f45cea00640 1 --2- 172.21.15.90:0/3994423079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b0002a70 0x7f45b0004f80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f45c4011980 tx=0x7f45c4011e40 comp rx=0 tx=0).stop 2024-09-21T03:23:46.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.925+0000 7f45cea00640 1 -- 172.21.15.90:0/3994423079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b0002a70 msgr2=0x7f45b0004f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:23:46.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.925+0000 7f45cea00640 1 --2- 172.21.15.90:0/3994423079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b0002a70 0x7f45b0004f80 secure :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f45c4011980 tx=0x7f45c4011e40 comp rx=0 tx=0).stop 2024-09-21T03:23:46.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.926+0000 7f45d5600640 1 --2- 172.21.15.90:0/3994423079 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f45b8078dc0 0x7f45b807b2d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f45d0000b60 tx=0x7f45d0005880 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:46.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.942+0000 7f45dd800640 1 --2- 172.21.15.90:0/3994423079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b0006f80 0x7f45b0007440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:46.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.944+0000 7f45d6000640 1 --2- 172.21.15.90:0/3994423079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b0006f80 0x7f45b0007440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:46.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.944+0000 7f45dd800640 1 -- 172.21.15.90:0/3994423079 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f45b000a4f0 con 0x7f45b0006f80 2024-09-21T03:23:46.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.946+0000 7f45d6000640 1 -- 172.21.15.90:0/3994423079 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f45b0007980 con 0x7f45b0006f80 2024-09-21T03:23:46.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.946+0000 7f45d6000640 1 --2- 172.21.15.90:0/3994423079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b0006f80 0x7f45b0007440 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f45c4011980 tx=0x7f45c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:46.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.947+0000 7f45cea00640 1 -- 172.21.15.90:0/3994423079 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c4003cb0 con 0x7f45b0006f80 2024-09-21T03:23:46.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.950+0000 7f45cea00640 1 -- 172.21.15.90:0/3994423079 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5196 (secure 0 0 0) 0x7f45c4003e50 con 0x7f45b0006f80 2024-09-21T03:23:46.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.950+0000 7f45cea00640 1 -- 172.21.15.90:0/3994423079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b0006f80 msgr2=0x7f45b0007440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:46.952 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:23:46.952 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:23:46.952 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:23:46.952 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:23:46.952 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 64, 2024-09-21T03:23:46.952 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 270722, 2024-09-21T03:23:46.952 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:23:46.952 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:23:46.953 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:23:46.953 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:23:46.953 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:46.953 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 17, 2024-09-21T03:23:46.953 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:23:46.953 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:23:46.953 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:23:46.953 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:46.953 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:46.953 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:46.953 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:46.953 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:46.953 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:46.953 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:46.953 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:46.954 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:46.954 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:46.954 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:46.954 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:46.954 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:23:46.954 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:23:46.954 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:46.954 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:46.954 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:46.954 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:46.954 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:46.954 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:46.954 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:46.954 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:46.955 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:46.955 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:46.955 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:46.955 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:46.955 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:46.955 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:23:46.955 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:23:46.955 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:23:46.955 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:23:46.955 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:23:46.956 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:23:46.956 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:23:46.956 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:23:46.956 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:23:46.956 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:23:46.956 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:23:46.956 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:23:46.956 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:23:46.956 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:23:46.957 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:23:46.957 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:23:46.957 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:23:46.957 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:46.957 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:46.957 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:46.957 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:46.957 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:46.957 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:46.957 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:46.958 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:46.958 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:46.958 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:46.958 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:46.958 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:46.958 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:23:46.958 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:46.958 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:23:46.959 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:46.959 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:23:46.959 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:23:46.959 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:46.959 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:46.959 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:46.959 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:46.959 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:23:46.960 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:46.960 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:46.960 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:46.960 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:46.960 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:23:46.960 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:46.960 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:46.960 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:46.960 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:46.960 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:23:46.961 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:23:46.961 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:46.961 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:46.961 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:46.961 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:46.961 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:46.961 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:23:46.961 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:23:46.962 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:46.962 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:46.962 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:46.962 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:46.962 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:23:46.962 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:46.962 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:46.962 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:46.963 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:46.963 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:23:46.963 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:46.963 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:46.963 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:46.963 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:46.963 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:23:46.963 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:23:46.963 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:46.964 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:46.964 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:46.964 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:46.964 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:46.964 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:23:46.964 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:23:46.964 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:46.964 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:46.964 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:46.965 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:46.965 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:23:46.965 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:46.965 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:46.965 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:46.965 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:46.965 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:23:46.965 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:46.966 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:46.966 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:46.966 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:46.966 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:23:46.966 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:23:46.966 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:46.966 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:46.966 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:46.966 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:46.967 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:46.967 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:46.967 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:23:46.967 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:23:46.967 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:46.967 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:46.967 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:46.967 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:23:46.967 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:46.968 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:46.968 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:23:46.968 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:46.968 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:46.968 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:46.968 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:23:46.968 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:46.968 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:46.969 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:23:46.969 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:46.969 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:46.969 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:46.969 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 7 2024-09-21T03:23:46.969 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:46.969 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:46.969 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:23:46.969 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:46.969 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:23:46.969 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:23:46.969 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:23:46.969 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:46.969 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:46.969 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:46.970 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:46.970 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5 2024-09-21T03:23:46.970 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:46.970 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:46.970 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:23:46.970 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:46.970 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:46.970 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:46.970 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:23:46.970 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:46.970 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:46.970 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:46.970 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:23:46.970 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:23:46.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.950+0000 7f45cea00640 1 --2- 172.21.15.90:0/3994423079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b0006f80 0x7f45b0007440 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f45c4011980 tx=0x7f45c4004730 comp rx=0 tx=0).stop 2024-09-21T03:23:46.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.951+0000 7f45cea00640 1 -- 172.21.15.90:0/3994423079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b0006f80 msgr2=0x7f45b0007440 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:23:46.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.951+0000 7f45cea00640 1 --2- 172.21.15.90:0/3994423079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b0006f80 0x7f45b0007440 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:46.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.951+0000 7f45dd800640 1 -- 172.21.15.90:0/3994423079 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f45b8078dc0 msgr2=0x7f45b807b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:46.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.951+0000 7f45dd800640 1 --2- 172.21.15.90:0/3994423079 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f45b8078dc0 0x7f45b807b2d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f45d0000b60 tx=0x7f45d0005880 comp rx=0 tx=0).stop 2024-09-21T03:23:46.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.952+0000 7f45dd800640 1 -- 172.21.15.90:0/3994423079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45d81fc710 msgr2=0x7f45d80c1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:46.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.952+0000 7f45dd800640 1 --2- 172.21.15.90:0/3994423079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45d81fc710 0x7f45d80c1c00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f45c8000f80 tx=0x7f45c8003ee0 comp rx=0 tx=0).stop 2024-09-21T03:23:46.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.952+0000 7f45d6a00640 1 -- 172.21.15.90:0/3994423079 reap_dead start 2024-09-21T03:23:46.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.952+0000 7f45d6a00640 1 -- 172.21.15.90:0/3994423079 reap_dead start 2024-09-21T03:23:46.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.953+0000 7f45dd800640 1 -- 172.21.15.90:0/3994423079 shutdown_connections 2024-09-21T03:23:46.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.953+0000 7f45dd800640 1 -- 172.21.15.90:0/3994423079 >> 172.21.15.90:0/3994423079 conn(0x7f45d806ead0 msgr2=0x7f45d80c31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:46.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.953+0000 7f45dd800640 1 -- 172.21.15.90:0/3994423079 shutdown_connections 2024-09-21T03:23:46.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:46.953+0000 7f45dd800640 1 -- 172.21.15.90:0/3994423079 wait complete. 2024-09-21T03:23:47.010 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:23:47.010 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-21T03:23:47.010 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:23:47.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.532+0000 7fbe37000640 1 -- 172.21.15.90:0/365868234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe30073080 msgr2=0x7fbe30073490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:47.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.532+0000 7fbe2f400640 1 -- 172.21.15.90:0/365868234 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18004230 con 0x7fbe30073080 2024-09-21T03:23:47.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.532+0000 7fbe37000640 1 --2- 172.21.15.90:0/365868234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe30073080 0x7fbe30073490 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe300754f0 tx=0x7fbe1802a5c0 comp rx=0 tx=0).stop 2024-09-21T03:23:47.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.532+0000 7fbe37000640 1 -- 172.21.15.90:0/365868234 shutdown_connections 2024-09-21T03:23:47.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.532+0000 7fbe37000640 1 --2- 172.21.15.90:0/365868234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe30073080 0x7fbe30073490 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:47.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.532+0000 7fbe37000640 1 --2- 172.21.15.90:0/365868234 >> v2:172.21.15.90:3300/0 conn(0x7fbe300ae0a0 0x7fbe301521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:47.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.532+0000 7fbe37000640 1 -- 172.21.15.90:0/365868234 >> 172.21.15.90:0/365868234 conn(0x7fbe300c85a0 msgr2=0x7fbe300c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:47.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.532+0000 7fbe37000640 1 -- 172.21.15.90:0/365868234 shutdown_connections 2024-09-21T03:23:47.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.532+0000 7fbe37000640 1 -- 172.21.15.90:0/365868234 wait complete. 2024-09-21T03:23:47.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.536+0000 7fbe37000640 1 Processor -- start 2024-09-21T03:23:47.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.536+0000 7fbe37000640 1 -- start start 2024-09-21T03:23:47.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.537+0000 7fbe37000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe30073080 0x7fbe300bd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:47.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.538+0000 7fbe37000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe300ae0a0 0x7fbe301fdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:47.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.538+0000 7fbe37000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe30154aa0 0x7fbe30160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:47.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.538+0000 7fbe37000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbe301555c0 con 0x7fbe30154aa0 2024-09-21T03:23:47.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.538+0000 7fbe37000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbe300acf00 con 0x7fbe300ae0a0 2024-09-21T03:23:47.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.538+0000 7fbe37000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbe300abd90 con 0x7fbe30073080 2024-09-21T03:23:47.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.538+0000 7fbe2fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe30073080 0x7fbe300bd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:47.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.538+0000 7fbe27400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe300ae0a0 0x7fbe301fdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:47.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.538+0000 7fbe27400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe300ae0a0 0x7fbe301fdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:44794/0 (socket says 172.21.15.90:44794) 2024-09-21T03:23:47.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.538+0000 7fbe27400640 1 -- 172.21.15.90:0/689958948 learned_addr learned my addr 172.21.15.90:0/689958948 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:23:47.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.538+0000 7fbe35000640 1 --2- 172.21.15.90:0/689958948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe30154aa0 0x7fbe30160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:47.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.539+0000 7fbe35000640 1 -- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe30073080 msgr2=0x7fbe300bd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:47.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.539+0000 7fbe35000640 1 --2- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe30073080 0x7fbe300bd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:47.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.539+0000 7fbe35000640 1 -- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe300ae0a0 msgr2=0x7fbe301fdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:47.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.539+0000 7fbe35000640 1 --2- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe300ae0a0 0x7fbe301fdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:47.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.539+0000 7fbe35000640 1 -- 172.21.15.90:0/689958948 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe301fd2f0 con 0x7fbe30154aa0 2024-09-21T03:23:47.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.540+0000 7fbe35000640 1 --2- 172.21.15.90:0/689958948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe30154aa0 0x7fbe30160050 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800c700 tx=0x7fbe2800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:47.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.541+0000 7fbe2cc00640 1 -- 172.21.15.90:0/689958948 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe28016020 con 0x7fbe30154aa0 2024-09-21T03:23:47.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.541+0000 7fbe2cc00640 1 -- 172.21.15.90:0/689958948 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe28003990 con 0x7fbe30154aa0 2024-09-21T03:23:47.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.541+0000 7fbe2cc00640 1 -- 172.21.15.90:0/689958948 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe28006e60 con 0x7fbe30154aa0 2024-09-21T03:23:47.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.541+0000 7fbe37000640 1 -- 172.21.15.90:0/689958948 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe301f9de0 con 0x7fbe30154aa0 2024-09-21T03:23:47.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.541+0000 7fbe37000640 1 -- 172.21.15.90:0/689958948 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe301f77a0 con 0x7fbe30154aa0 2024-09-21T03:23:47.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.546+0000 7fbe25600640 1 --2- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe301fa8c0 0x7fbe3015e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:47.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.546+0000 7fbe25600640 1 -- 172.21.15.90:0/689958948 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbe301fe0d0 con 0x7fbe301fa8c0 2024-09-21T03:23:47.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.547+0000 7fbe2cc00640 1 -- 172.21.15.90:0/689958948 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbe280050d0 con 0x7fbe30154aa0 2024-09-21T03:23:47.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.549+0000 7fbe2cc00640 1 --2- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbe0c078bc0 0x7fbe0c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:47.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.549+0000 7fbe2cc00640 1 -- 172.21.15.90:0/689958948 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fbe2809aa80 con 0x7fbe30154aa0 2024-09-21T03:23:47.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.550+0000 7fbe27400640 1 --2- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbe0c078bc0 0x7fbe0c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:47.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.553+0000 7fbe2fe00640 1 --2- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe301fa8c0 0x7fbe3015e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:47.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.556+0000 7fbe27400640 1 --2- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbe0c078bc0 0x7fbe0c07b0d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbe30150e50 tx=0x7fbe180046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:47.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.557+0000 7fbe2fe00640 1 -- 172.21.15.90:0/689958948 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe301557d0 con 0x7fbe301fa8c0 2024-09-21T03:23:47.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.562+0000 7fbe2fe00640 1 --2- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe301fa8c0 0x7fbe3015e650 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbe20011a10 tx=0x7fbe20011ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:47.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.563+0000 7fbe2cc00640 1 -- 172.21.15.90:0/689958948 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2000fc20 con 0x7fbe301fa8c0 2024-09-21T03:23:47.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.565+0000 7fbe2cc00640 1 -- 172.21.15.90:0/689958948 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbe2000fc20 con 0x7fbe301fa8c0 2024-09-21T03:23:47.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.565+0000 7fbe2cc00640 1 -- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe301fa8c0 msgr2=0x7fbe3015e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:47.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.565+0000 7fbe2cc00640 1 --2- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe301fa8c0 0x7fbe3015e650 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbe20011a10 tx=0x7fbe20011ed0 comp rx=0 tx=0).stop 2024-09-21T03:23:47.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.565+0000 7fbe2cc00640 1 -- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe301fa8c0 msgr2=0x7fbe3015e650 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:23:47.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.565+0000 7fbe2cc00640 1 --2- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe301fa8c0 0x7fbe3015e650 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbe20011a10 tx=0x7fbe20011ed0 comp rx=0 tx=0).stop 2024-09-21T03:23:47.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.610+0000 7fbe25600640 1 --2- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe300c2040 0x7fbe3015eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:47.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.610+0000 7fbe25600640 1 -- 172.21.15.90:0/689958948 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbe301f9bf0 con 0x7fbe300c2040 2024-09-21T03:23:47.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.612+0000 7fbe2fe00640 1 --2- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe300c2040 0x7fbe3015eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:47.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.614+0000 7fbe2fe00640 1 -- 172.21.15.90:0/689958948 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbe30073a90 con 0x7fbe300c2040 2024-09-21T03:23:47.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.615+0000 7fbe2fe00640 1 --2- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe300c2040 0x7fbe3015eb90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbe20011a10 tx=0x7fbe200046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:47.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.615+0000 7fbe2cc00640 1 -- 172.21.15.90:0/689958948 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe20005560 con 0x7fbe300c2040 2024-09-21T03:23:47.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.618+0000 7fbe2cc00640 1 -- 172.21.15.90:0/689958948 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4716 (secure 0 0 0) 0x7fbe20005560 con 0x7fbe300c2040 2024-09-21T03:23:47.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.619+0000 7fbe2cc00640 1 -- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe300c2040 msgr2=0x7fbe3015eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:47.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.619+0000 7fbe2cc00640 1 --2- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe300c2040 0x7fbe3015eb90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbe20011a10 tx=0x7fbe200046c0 comp rx=0 tx=0).stop 2024-09-21T03:23:47.622 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:23:47.622 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:23:47.622 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:23:47.622 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:23:47.623 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 64, 2024-09-21T03:23:47.623 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 79825, 2024-09-21T03:23:47.623 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:23:47.623 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:23:47.623 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:23:47.623 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:23:47.623 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:47.624 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 18, 2024-09-21T03:23:47.624 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:23:47.624 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:23:47.624 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:23:47.624 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:47.624 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:47.624 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:47.625 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:47.625 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:47.625 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:47.625 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:47.625 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:47.625 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:47.625 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:47.625 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:47.626 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:47.626 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:23:47.626 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:23:47.626 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:47.626 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:47.626 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:47.626 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:47.626 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:47.626 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:47.627 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:47.627 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:47.627 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:47.627 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:47.627 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:47.627 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:47.627 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:47.628 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:23:47.628 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:23:47.628 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:23:47.628 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:23:47.628 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:23:47.628 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:23:47.628 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:23:47.629 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:23:47.629 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:23:47.629 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:23:47.629 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:23:47.629 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:23:47.629 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:23:47.629 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:23:47.630 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:23:47.630 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:23:47.630 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:23:47.630 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:47.630 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:47.630 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:47.630 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:47.631 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:47.631 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:47.631 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:47.631 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:47.631 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:47.631 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:47.631 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:47.632 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:47.632 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:23:47.632 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:47.632 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:23:47.632 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:47.632 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:23:47.632 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:23:47.632 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:47.633 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:47.633 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:47.633 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:47.633 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:23:47.633 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:47.633 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:47.633 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:47.634 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:47.634 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:23:47.634 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:47.634 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:47.634 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:47.634 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:47.634 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:23:47.635 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:23:47.635 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:47.635 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:47.635 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:47.635 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:47.635 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:47.635 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:23:47.636 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:23:47.636 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:47.636 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:47.636 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:47.636 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:47.636 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:23:47.636 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:47.636 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:47.637 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:47.637 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:47.637 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:23:47.637 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:47.637 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:47.637 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:47.637 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:47.638 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:23:47.638 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:23:47.638 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:47.638 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:47.638 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:47.638 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:47.638 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:47.638 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:23:47.639 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:23:47.639 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:47.639 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:47.639 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:47.639 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:47.639 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:23:47.639 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:47.639 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:47.640 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:47.640 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:47.640 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:23:47.640 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:47.640 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:47.640 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:47.640 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:47.641 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:23:47.641 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:23:47.641 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:47.641 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:47.641 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:47.641 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:47.641 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:47.642 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:47.642 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:23:47.642 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:23:47.642 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:47.642 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:47.642 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:47.642 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:23:47.643 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:47.643 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:47.643 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:23:47.643 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:47.643 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:47.643 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:47.643 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:23:47.644 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:47.644 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:47.644 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:23:47.644 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:47.644 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:47.644 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:47.644 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:23:47.644 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:47.645 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:47.645 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:47.645 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:23:47.645 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:23:47.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.619+0000 7fbe2cc00640 1 -- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe300c2040 msgr2=0x7fbe3015eb90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:23:47.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.619+0000 7fbe2cc00640 1 --2- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe300c2040 0x7fbe3015eb90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:47.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.627+0000 7fbe25600640 1 -- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbe0c078bc0 msgr2=0x7fbe0c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:47.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.627+0000 7fbe25600640 1 --2- 172.21.15.90:0/689958948 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbe0c078bc0 0x7fbe0c07b0d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbe30150e50 tx=0x7fbe180046c0 comp rx=0 tx=0).stop 2024-09-21T03:23:47.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.627+0000 7fbe25600640 1 -- 172.21.15.90:0/689958948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe30154aa0 msgr2=0x7fbe30160050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:47.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.627+0000 7fbe25600640 1 --2- 172.21.15.90:0/689958948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe30154aa0 0x7fbe30160050 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800c700 tx=0x7fbe2800cbc0 comp rx=0 tx=0).stop 2024-09-21T03:23:47.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.628+0000 7fbe35000640 1 -- 172.21.15.90:0/689958948 reap_dead start 2024-09-21T03:23:47.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.628+0000 7fbe35000640 1 -- 172.21.15.90:0/689958948 reap_dead start 2024-09-21T03:23:47.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.628+0000 7fbe25600640 1 -- 172.21.15.90:0/689958948 shutdown_connections 2024-09-21T03:23:47.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.628+0000 7fbe25600640 1 -- 172.21.15.90:0/689958948 >> 172.21.15.90:0/689958948 conn(0x7fbe300c85a0 msgr2=0x7fbe30153cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:47.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.629+0000 7fbe25600640 1 -- 172.21.15.90:0/689958948 shutdown_connections 2024-09-21T03:23:47.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:47.629+0000 7fbe25600640 1 -- 172.21.15.90:0/689958948 wait complete. 2024-09-21T03:23:47.678 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:23:47.678 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-21T03:23:47.678 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:23:48.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.190+0000 7f07f1200640 1 -- 172.21.15.90:0/3072285208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07ec0cb3c0 msgr2=0x7f07ec0cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:48.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.190+0000 7f07f1200640 1 --2- 172.21.15.90:0/3072285208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07ec0cb3c0 0x7f07ec0cb7d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f07ec08d520 tx=0x7f07e402a930 comp rx=0 tx=0).stop 2024-09-21T03:23:48.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.191+0000 7f07f1200640 1 -- 172.21.15.90:0/3072285208 shutdown_connections 2024-09-21T03:23:48.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.191+0000 7f07f1200640 1 --2- 172.21.15.90:0/3072285208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07ec0cb3c0 0x7f07ec0cb7d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:48.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.191+0000 7f07f1200640 1 --2- 172.21.15.90:0/3072285208 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07ec06da00 0x7f07ec06de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:48.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.191+0000 7f07f1200640 1 --2- 172.21.15.90:0/3072285208 >> v2:172.21.15.149:3300/0 conn(0x7f07ec0c7570 0x7f07ec154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:48.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.191+0000 7f07f1200640 1 -- 172.21.15.90:0/3072285208 >> 172.21.15.90:0/3072285208 conn(0x7f07ec0cc1e0 msgr2=0x7f07ec0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:48.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.195+0000 7f07f1200640 1 -- 172.21.15.90:0/3072285208 shutdown_connections 2024-09-21T03:23:48.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.195+0000 7f07f1200640 1 -- 172.21.15.90:0/3072285208 wait complete. 2024-09-21T03:23:48.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.201+0000 7f07f1200640 1 Processor -- start 2024-09-21T03:23:48.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.202+0000 7f07f1200640 1 -- start start 2024-09-21T03:23:48.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.207+0000 7f07f1200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07ec06da00 0x7f07ec0c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:48.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.209+0000 7f07f1200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07ec0c7570 0x7f07ec0b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:48.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.209+0000 7f07f1200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07ec0cb3c0 0x7f07ec0c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:48.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.209+0000 7f07f1200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec156bf0 con 0x7f07ec0c7570 2024-09-21T03:23:48.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.209+0000 7f07f1200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec0ca7d0 con 0x7f07ec0cb3c0 2024-09-21T03:23:48.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.209+0000 7f07f1200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f07ec156d70 con 0x7f07ec06da00 2024-09-21T03:23:48.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.209+0000 7f07eaa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07ec0c7570 0x7f07ec0b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:48.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.209+0000 7f07ebe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07ec0cb3c0 0x7f07ec0c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:48.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.209+0000 7f07ebe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07ec0cb3c0 0x7f07ec0c1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:44830/0 (socket says 172.21.15.90:44830) 2024-09-21T03:23:48.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.210+0000 7f07ebe00640 1 -- 172.21.15.90:0/610220143 learned_addr learned my addr 172.21.15.90:0/610220143 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:23:48.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.210+0000 7f07eb400640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07ec06da00 0x7f07ec0c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:48.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.214+0000 7f07eaa00640 1 -- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07ec06da00 msgr2=0x7f07ec0c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:48.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.214+0000 7f07eaa00640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07ec06da00 0x7f07ec0c55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:48.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.214+0000 7f07eaa00640 1 -- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07ec0cb3c0 msgr2=0x7f07ec0c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:48.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.214+0000 7f07eaa00640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07ec0cb3c0 0x7f07ec0c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:48.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.214+0000 7f07eaa00640 1 -- 172.21.15.90:0/610220143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07ec153c40 con 0x7f07ec0c7570 2024-09-21T03:23:48.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.214+0000 7f07ebe00640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07ec0cb3c0 0x7f07ec0c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:23:48.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.214+0000 7f07eb400640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07ec06da00 0x7f07ec0c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:23:48.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.215+0000 7f07eaa00640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07ec0c7570 0x7f07ec0b05a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00b3e0 tx=0x7f07dc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:48.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.216+0000 7f07e3400640 1 -- 172.21.15.90:0/610220143 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc015020 con 0x7f07ec0c7570 2024-09-21T03:23:48.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.216+0000 7f07e3400640 1 -- 172.21.15.90:0/610220143 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07dc011920 con 0x7f07ec0c7570 2024-09-21T03:23:48.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.216+0000 7f07e3400640 1 -- 172.21.15.90:0/610220143 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc011d70 con 0x7f07ec0c7570 2024-09-21T03:23:48.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.217+0000 7f07f1200640 1 -- 172.21.15.90:0/610220143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07ec1f5630 con 0x7f07ec0c7570 2024-09-21T03:23:48.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.217+0000 7f07f1200640 1 -- 172.21.15.90:0/610220143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07ec1f5910 con 0x7f07ec0c7570 2024-09-21T03:23:48.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.222+0000 7f07f1200640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07c4002a70 0x7f07c4004f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:48.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.223+0000 7f07f1200640 1 -- 172.21.15.90:0/610220143 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f07c4007f10 con 0x7f07c4002a70 2024-09-21T03:23:48.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.224+0000 7f07eb400640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07c4002a70 0x7f07c4004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:48.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.228+0000 7f07e3400640 1 -- 172.21.15.90:0/610220143 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f07dc018020 con 0x7f07ec0c7570 2024-09-21T03:23:48.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.229+0000 7f07e3400640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f07cc078c60 0x7f07cc07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:48.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.230+0000 7f07eb400640 1 -- 172.21.15.90:0/610220143 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f07c4008110 con 0x7f07c4002a70 2024-09-21T03:23:48.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.230+0000 7f07e3400640 1 -- 172.21.15.90:0/610220143 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f07dc09aa60 con 0x7f07ec0c7570 2024-09-21T03:23:48.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.230+0000 7f07eb400640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07c4002a70 0x7f07c4004f80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f07d800d520 tx=0x7f07d800d9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:48.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.231+0000 7f07e3400640 1 -- 172.21.15.90:0/610220143 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8018020 con 0x7f07c4002a70 2024-09-21T03:23:48.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.231+0000 7f07e3400640 1 -- 172.21.15.90:0/610220143 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f07d8014620 con 0x7f07c4002a70 2024-09-21T03:23:48.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.231+0000 7f07e3400640 1 -- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07c4002a70 msgr2=0x7f07c4004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:48.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.231+0000 7f07e3400640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07c4002a70 0x7f07c4004f80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f07d800d520 tx=0x7f07d800d9e0 comp rx=0 tx=0).stop 2024-09-21T03:23:48.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.235+0000 7f07ebe00640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f07cc078c60 0x7f07cc07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:48.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.235+0000 7f07e3400640 1 -- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07c4002a70 msgr2=0x7f07c4004f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:23:48.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.235+0000 7f07e3400640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07c4002a70 0x7f07c4004f80 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f07d800d520 tx=0x7f07d800d9e0 comp rx=0 tx=0).stop 2024-09-21T03:23:48.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.237+0000 7f07ebe00640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f07cc078c60 0x7f07cc07b170 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f07e4009a60 tx=0x7f07e4004ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:48.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.252+0000 7f07f1200640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07c4006f30 0x7f07c40073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:48.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.252+0000 7f07f1200640 1 -- 172.21.15.90:0/610220143 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f07c400a4f0 con 0x7f07c4006f30 2024-09-21T03:23:48.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.253+0000 7f07eb400640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07c4006f30 0x7f07c40073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:48.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.258+0000 7f07eb400640 1 -- 172.21.15.90:0/610220143 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f07c4007930 con 0x7f07c4006f30 2024-09-21T03:23:48.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.259+0000 7f07eb400640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07c4006f30 0x7f07c40073f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f07d8019000 tx=0x7f07d8004640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:48.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.260+0000 7f07e3400640 1 -- 172.21.15.90:0/610220143 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8018030 con 0x7f07c4006f30 2024-09-21T03:23:48.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.261+0000 7f07e3400640 1 -- 172.21.15.90:0/610220143 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4549 (secure 0 0 0) 0x7f07d8004020 con 0x7f07c4006f30 2024-09-21T03:23:48.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.261+0000 7f07e3400640 1 -- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07c4006f30 msgr2=0x7f07c40073f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:48.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.261+0000 7f07e3400640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07c4006f30 0x7f07c40073f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f07d8019000 tx=0x7f07d8004640 comp rx=0 tx=0).stop 2024-09-21T03:23:48.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.261+0000 7f07e3400640 1 -- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07c4006f30 msgr2=0x7f07c40073f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:23:48.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.261+0000 7f07e3400640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07c4006f30 0x7f07c40073f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:48.263 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:23:48.264 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:23:48.264 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:23:48.264 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:23:48.264 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 64, 2024-09-21T03:23:48.264 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 21816, 2024-09-21T03:23:48.264 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:23:48.264 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:23:48.264 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:23:48.264 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:23:48.264 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:48.264 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 18, 2024-09-21T03:23:48.264 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:23:48.264 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:23:48.264 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:23:48.265 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:48.265 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:48.265 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:48.265 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:48.265 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:48.265 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:48.265 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:48.265 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:48.265 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:48.265 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:48.265 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:48.265 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:48.265 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:23:48.265 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:23:48.265 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:48.266 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:48.266 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:48.266 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:48.266 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:48.266 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:48.266 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:48.266 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:48.266 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:48.266 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:48.266 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:48.266 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:48.266 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:48.266 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:23:48.266 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:23:48.267 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:23:48.267 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:23:48.267 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:23:48.267 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:23:48.267 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:23:48.267 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:23:48.267 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:23:48.267 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:23:48.267 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:23:48.267 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:23:48.267 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:23:48.267 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:23:48.267 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:23:48.267 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:23:48.267 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:23:48.268 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:23:48.268 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:23:48.268 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:23:48.268 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:23:48.268 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:23:48.268 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:23:48.268 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:23:48.268 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:23:48.268 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:23:48.268 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:23:48.268 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:23:48.268 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:48.268 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:23:48.268 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:48.268 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:23:48.269 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:48.269 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:23:48.269 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:23:48.269 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:48.269 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:48.269 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:48.269 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:48.269 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:23:48.269 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:48.269 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:48.269 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:48.269 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:48.270 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:23:48.270 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:48.270 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:48.270 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:48.270 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:48.270 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:23:48.270 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:23:48.270 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:48.270 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:48.270 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:48.270 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:48.270 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:48.270 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:23:48.270 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:23:48.270 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:48.271 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:48.271 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:48.271 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:48.271 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:23:48.271 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:48.271 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:48.271 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:48.271 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:48.271 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:23:48.271 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:48.271 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:48.271 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:48.271 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:48.271 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:23:48.271 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:23:48.272 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:48.272 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:48.272 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:48.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:48.272 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:48.272 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:23:48.272 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:23:48.272 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:23:48.272 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:23:48.272 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:48.272 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:23:48.272 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:23:48.272 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:48.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:48.272 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:48.273 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:23:48.273 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:23:48.273 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:23:48.273 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:48.273 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:48.273 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:48.273 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:23:48.273 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:23:48.273 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:23:48.273 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:23:48.273 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:23:48.273 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:48.273 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:48.273 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:48.273 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:23:48.274 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:23:48.274 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:48.274 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:48.274 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:48.274 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:23:48.274 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:48.274 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:23:48.274 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:23:48.274 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:23:48.274 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:23:48.274 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:23:48.274 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:23:48.274 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:23:48.274 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:23:48.275 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:23:48.275 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:23:48.275 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:23:48.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.262+0000 7f07f1200640 1 -- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f07cc078c60 msgr2=0x7f07cc07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:48.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.262+0000 7f07f1200640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f07cc078c60 0x7f07cc07b170 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f07e4009a60 tx=0x7f07e4004ab0 comp rx=0 tx=0).stop 2024-09-21T03:23:48.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.262+0000 7f07f1200640 1 -- 172.21.15.90:0/610220143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07ec0c7570 msgr2=0x7f07ec0b05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:48.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.262+0000 7f07f1200640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07ec0c7570 0x7f07ec0b05a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00b3e0 tx=0x7f07dc00b8a0 comp rx=0 tx=0).stop 2024-09-21T03:23:48.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.262+0000 7f07ebe00640 1 -- 172.21.15.90:0/610220143 reap_dead start 2024-09-21T03:23:48.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.265+0000 7f07f1200640 1 -- 172.21.15.90:0/610220143 shutdown_connections 2024-09-21T03:23:48.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.265+0000 7f07f1200640 1 --2- 172.21.15.90:0/610220143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07ec0c7570 0x7f07ec0b05a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:48.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.265+0000 7f07f1200640 1 -- 172.21.15.90:0/610220143 >> 172.21.15.90:0/610220143 conn(0x7f07ec0cc1e0 msgr2=0x7f07ec157110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:48.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.266+0000 7f07f1200640 1 -- 172.21.15.90:0/610220143 shutdown_connections 2024-09-21T03:23:48.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.266+0000 7f07f1200640 1 -- 172.21.15.90:0/610220143 wait complete. 2024-09-21T03:23:48.339 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:23:48.339 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-21T03:23:48.339 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-21T03:23:48.339 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-21T03:23:48.339 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-21T03:23:48.340 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-21T03:23:48.340 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:23:48.422 INFO:tasks.ceph.mon.b:Stopped 2024-09-21T03:23:48.422 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-21T03:23:48.422 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:23:48.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.978+0000 7f5156400640 1 -- 172.21.15.90:0/4025029253 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51501574e0 msgr2=0x7f5150161650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:48.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.978+0000 7f5156400640 1 --2- 172.21.15.90:0/4025029253 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51501574e0 0x7f5150161650 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5140005fd0 tx=0x7f514002a440 comp rx=0 tx=0).stop 2024-09-21T03:23:48.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.979+0000 7f5156400640 1 -- 172.21.15.90:0/4025029253 shutdown_connections 2024-09-21T03:23:48.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.979+0000 7f5156400640 1 --2- 172.21.15.90:0/4025029253 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51501574e0 0x7f5150161650 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:48.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.979+0000 7f5156400640 1 --2- 172.21.15.90:0/4025029253 >> v2:172.21.15.90:3300/0 conn(0x7f51500ad490 0x7f51500c1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:48.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.979+0000 7f5156400640 1 -- 172.21.15.90:0/4025029253 >> 172.21.15.90:0/4025029253 conn(0x7f51500c8740 msgr2=0x7f515006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:48.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.979+0000 7f5156400640 1 -- 172.21.15.90:0/4025029253 shutdown_connections 2024-09-21T03:23:48.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.979+0000 7f5156400640 1 -- 172.21.15.90:0/4025029253 wait complete. 2024-09-21T03:23:48.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.985+0000 7f5156400640 1 Processor -- start 2024-09-21T03:23:48.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.986+0000 7f5156400640 1 -- start start 2024-09-21T03:23:48.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.989+0000 7f5156400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51500ad490 0x7f515014aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:48.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.989+0000 7f5156400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51500c1a80 0x7f515014bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:48.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.990+0000 7f5156400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51501574e0 0x7f5150144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:48.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.990+0000 7f514ea00640 1 -- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51500c1a80 msgr2=0x7f515014bde0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3300/0 2024-09-21T03:23:48.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.990+0000 7f514ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51500c1a80 0x7f515014bde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:23:48.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.994+0000 7f514f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51500ad490 0x7f515014aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:48.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.994+0000 7f514f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51500ad490 0x7f515014aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57920/0 (socket says 172.21.15.90:57920) 2024-09-21T03:23:48.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.994+0000 7f514f400640 1 -- 172.21.15.90:0/1149070453 learned_addr learned my addr 172.21.15.90:0/1149070453 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:23:48.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.995+0000 7f5156400640 1 -- 172.21.15.90:0/1149070453 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f51500ab1c0 con 0x7f51500ad490 2024-09-21T03:23:48.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.995+0000 7f5156400640 1 -- 172.21.15.90:0/1149070453 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f515015b0a0 con 0x7f51500c1a80 2024-09-21T03:23:48.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.995+0000 7f514fe00640 1 --2- 172.21.15.90:0/1149070453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51501574e0 0x7f5150144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:48.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.995+0000 7f5156400640 1 -- 172.21.15.90:0/1149070453 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5150072b80 con 0x7f51501574e0 2024-09-21T03:23:48.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.997+0000 7f514fe00640 1 -- 172.21.15.90:0/1149070453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51500c1a80 msgr2=0x7f515014bde0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:23:48.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.997+0000 7f514fe00640 1 --2- 172.21.15.90:0/1149070453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51500c1a80 0x7f515014bde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:48.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.997+0000 7f514fe00640 1 -- 172.21.15.90:0/1149070453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51500ad490 msgr2=0x7f515014aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:48.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.997+0000 7f514fe00640 1 --2- 172.21.15.90:0/1149070453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51500ad490 0x7f515014aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:49.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.998+0000 7f514fe00640 1 -- 172.21.15.90:0/1149070453 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5150072970 con 0x7f51501574e0 2024-09-21T03:23:49.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.998+0000 7f514f400640 1 --2- 172.21.15.90:0/1149070453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51500ad490 0x7f515014aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:23:49.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:48.999+0000 7f514fe00640 1 --2- 172.21.15.90:0/1149070453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51501574e0 0x7f5150144a10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5140004000 tx=0x7f5140004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:49.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.001+0000 7f5147400640 1 -- 172.21.15.90:0/1149070453 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5140041070 con 0x7f51501574e0 2024-09-21T03:23:49.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.003+0000 7f5147400640 1 -- 172.21.15.90:0/1149070453 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5140005310 con 0x7f51501574e0 2024-09-21T03:23:49.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.006+0000 7f5156400640 1 -- 172.21.15.90:0/1149070453 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5150158c50 con 0x7f51501574e0 2024-09-21T03:23:49.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.006+0000 7f5156400640 1 -- 172.21.15.90:0/1149070453 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5150158540 con 0x7f51501574e0 2024-09-21T03:23:49.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.006+0000 7f5147400640 1 -- 172.21.15.90:0/1149070453 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51400047a0 con 0x7f51501574e0 2024-09-21T03:23:49.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.010+0000 7f5156400640 1 -- 172.21.15.90:0/1149070453 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51501e2b60 con 0x7f51501574e0 2024-09-21T03:23:49.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.024+0000 7f5147400640 1 -- 172.21.15.90:0/1149070453 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5140004940 con 0x7f51501574e0 2024-09-21T03:23:49.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.026+0000 7f5147400640 1 --2- 172.21.15.90:0/1149070453 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5130078bc0 0x7f513007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:49.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.026+0000 7f5147400640 1 -- 172.21.15.90:0/1149070453 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f51400bbdf0 con 0x7f51501574e0 2024-09-21T03:23:49.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.032+0000 7f514f400640 1 --2- 172.21.15.90:0/1149070453 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5130078bc0 0x7f513007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:49.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.034+0000 7f5147400640 1 -- 172.21.15.90:0/1149070453 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5140083890 con 0x7f51501574e0 2024-09-21T03:23:49.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.044+0000 7f514f400640 1 --2- 172.21.15.90:0/1149070453 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5130078bc0 0x7f513007b0d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f514800f670 tx=0x7f51480075d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:49.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.634+0000 7f5156400640 1 -- 172.21.15.90:0/1149070453 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f51501578f0 con 0x7f51501574e0 2024-09-21T03:23:49.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.639+0000 7f5147400640 1 -- 172.21.15.90:0/1149070453 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f51400882c0 con 0x7f51501574e0 2024-09-21T03:23:49.643 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":64,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:23:49.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.646+0000 7f5156400640 1 -- 172.21.15.90:0/1149070453 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5130078bc0 msgr2=0x7f513007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:49.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.646+0000 7f5156400640 1 --2- 172.21.15.90:0/1149070453 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5130078bc0 0x7f513007b0d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f514800f670 tx=0x7f51480075d0 comp rx=0 tx=0).stop 2024-09-21T03:23:49.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.646+0000 7f5156400640 1 -- 172.21.15.90:0/1149070453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51501574e0 msgr2=0x7f5150144a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:49.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.646+0000 7f5156400640 1 --2- 172.21.15.90:0/1149070453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51501574e0 0x7f5150144a10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5140004000 tx=0x7f5140004340 comp rx=0 tx=0).stop 2024-09-21T03:23:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.647+0000 7f5156400640 1 -- 172.21.15.90:0/1149070453 shutdown_connections 2024-09-21T03:23:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.647+0000 7f5156400640 1 --2- 172.21.15.90:0/1149070453 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5130078bc0 0x7f513007b0d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.647+0000 7f5156400640 1 --2- 172.21.15.90:0/1149070453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51501574e0 0x7f5150144a10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.647+0000 7f5156400640 1 --2- 172.21.15.90:0/1149070453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51500c1a80 0x7f515014bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.647+0000 7f5156400640 1 --2- 172.21.15.90:0/1149070453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51500ad490 0x7f515014aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.647+0000 7f5156400640 1 -- 172.21.15.90:0/1149070453 >> 172.21.15.90:0/1149070453 conn(0x7f51500c8740 msgr2=0x7f5150155950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.647+0000 7f5156400640 1 -- 172.21.15.90:0/1149070453 shutdown_connections 2024-09-21T03:23:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:49.647+0000 7f5156400640 1 -- 172.21.15.90:0/1149070453 wait complete. 2024-09-21T03:23:52.713 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:23:53.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.217+0000 7fc449800640 1 -- 172.21.15.90:0/3609095267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc43c00da70 msgr2=0x7fc43c04ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:53.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.217+0000 7fc449800640 1 --2- 172.21.15.90:0/3609095267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc43c00da70 0x7fc43c04ec20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc430009860 tx=0x7fc43002a460 comp rx=0 tx=0).stop 2024-09-21T03:23:53.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.218+0000 7fc449800640 1 -- 172.21.15.90:0/3609095267 shutdown_connections 2024-09-21T03:23:53.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.218+0000 7fc449800640 1 --2- 172.21.15.90:0/3609095267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc43c00da70 0x7fc43c04ec20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:53.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.218+0000 7fc449800640 1 -- 172.21.15.90:0/3609095267 >> 172.21.15.90:0/3609095267 conn(0x7fc43c0312e0 msgr2=0x7fc43c0316f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:53.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.219+0000 7fc449800640 1 -- 172.21.15.90:0/3609095267 shutdown_connections 2024-09-21T03:23:53.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.219+0000 7fc449800640 1 -- 172.21.15.90:0/3609095267 wait complete. 2024-09-21T03:23:53.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.224+0000 7fc449800640 1 Processor -- start 2024-09-21T03:23:53.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.225+0000 7fc449800640 1 -- start start 2024-09-21T03:23:53.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.230+0000 7fc449800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc43c00da70 0x7fc43c043f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:53.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.230+0000 7fc449800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc43c04a170 0x7fc43c00a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:53.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.231+0000 7fc449800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc43c04f160 0x7fc43c0dee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:53.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.231+0000 7fc449800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c04b6a0 con 0x7fc43c04a170 2024-09-21T03:23:53.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.232+0000 7fc449800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c0326b0 con 0x7fc43c00da70 2024-09-21T03:23:53.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.232+0000 7fc449800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc43c033190 con 0x7fc43c04f160 2024-09-21T03:23:53.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.232+0000 7fc448e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc43c04f160 0x7fc43c0dee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:53.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.232+0000 7fc443e00640 1 -- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc43c00da70 msgr2=0x7fc43c043f90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3300/0 2024-09-21T03:23:53.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.233+0000 7fc443400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc43c04a170 0x7fc43c00a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:53.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.233+0000 7fc443400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc43c04a170 0x7fc43c00a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57934/0 (socket says 172.21.15.90:57934) 2024-09-21T03:23:53.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.233+0000 7fc443400640 1 -- 172.21.15.90:0/2917621859 learned_addr learned my addr 172.21.15.90:0/2917621859 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:23:53.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.234+0000 7fc443e00640 1 --2- 172.21.15.90:0/2917621859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc43c00da70 0x7fc43c043f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:23:53.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.235+0000 7fc443400640 1 -- 172.21.15.90:0/2917621859 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc43c04f160 msgr2=0x7fc43c0dee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:53.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.235+0000 7fc443400640 1 --2- 172.21.15.90:0/2917621859 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc43c04f160 0x7fc43c0dee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:53.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.235+0000 7fc443400640 1 -- 172.21.15.90:0/2917621859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc43c00da70 msgr2=0x7fc43c043f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:23:53.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.235+0000 7fc443400640 1 --2- 172.21.15.90:0/2917621859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc43c00da70 0x7fc43c043f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:53.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.235+0000 7fc443400640 1 -- 172.21.15.90:0/2917621859 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43c009580 con 0x7fc43c04a170 2024-09-21T03:23:53.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.236+0000 7fc443400640 1 --2- 172.21.15.90:0/2917621859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc43c04a170 0x7fc43c00a3e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc43002aa50 tx=0x7fc430033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:53.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.237+0000 7fc437e00640 1 -- 172.21.15.90:0/2917621859 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc430031d60 con 0x7fc43c04a170 2024-09-21T03:23:53.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.237+0000 7fc449800640 1 -- 172.21.15.90:0/2917621859 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc43c1789c0 con 0x7fc43c04a170 2024-09-21T03:23:53.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.237+0000 7fc449800640 1 -- 172.21.15.90:0/2917621859 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc43c0444d0 con 0x7fc43c04a170 2024-09-21T03:23:53.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.240+0000 7fc437e00640 1 -- 172.21.15.90:0/2917621859 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4300317a0 con 0x7fc43c04a170 2024-09-21T03:23:53.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.240+0000 7fc437e00640 1 -- 172.21.15.90:0/2917621859 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc430031d60 con 0x7fc43c04a170 2024-09-21T03:23:53.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.249+0000 7fc449800640 1 -- 172.21.15.90:0/2917621859 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc420005290 con 0x7fc43c04a170 2024-09-21T03:23:53.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.249+0000 7fc437e00640 1 -- 172.21.15.90:0/2917621859 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc4300330d0 con 0x7fc43c04a170 2024-09-21T03:23:53.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.255+0000 7fc437e00640 1 --2- 172.21.15.90:0/2917621859 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc424078d70 0x7fc42407b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:53.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.255+0000 7fc437e00640 1 -- 172.21.15.90:0/2917621859 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fc4300bb7f0 con 0x7fc43c04a170 2024-09-21T03:23:53.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.259+0000 7fc443e00640 1 --2- 172.21.15.90:0/2917621859 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc424078d70 0x7fc42407b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:53.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.262+0000 7fc443e00640 1 --2- 172.21.15.90:0/2917621859 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc424078d70 0x7fc42407b280 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc438006fd0 tx=0x7fc438006d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:53.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.263+0000 7fc437e00640 1 -- 172.21.15.90:0/2917621859 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc43003f030 con 0x7fc43c04a170 2024-09-21T03:23:53.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.909+0000 7fc449800640 1 -- 172.21.15.90:0/2917621859 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc420005850 con 0x7fc43c04a170 2024-09-21T03:23:53.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.910+0000 7fc437e00640 1 -- 172.21.15.90:0/2917621859 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7fc430083990 con 0x7fc43c04a170 2024-09-21T03:23:53.912 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":64,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:23:53.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.914+0000 7fc449800640 1 -- 172.21.15.90:0/2917621859 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc424078d70 msgr2=0x7fc42407b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:53.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.914+0000 7fc449800640 1 --2- 172.21.15.90:0/2917621859 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc424078d70 0x7fc42407b280 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc438006fd0 tx=0x7fc438006d60 comp rx=0 tx=0).stop 2024-09-21T03:23:53.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.914+0000 7fc449800640 1 -- 172.21.15.90:0/2917621859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc43c04a170 msgr2=0x7fc43c00a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:53.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.914+0000 7fc449800640 1 --2- 172.21.15.90:0/2917621859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc43c04a170 0x7fc43c00a3e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc43002aa50 tx=0x7fc430033c90 comp rx=0 tx=0).stop 2024-09-21T03:23:53.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.915+0000 7fc449800640 1 -- 172.21.15.90:0/2917621859 shutdown_connections 2024-09-21T03:23:53.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.915+0000 7fc449800640 1 --2- 172.21.15.90:0/2917621859 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc424078d70 0x7fc42407b280 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:53.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.915+0000 7fc449800640 1 --2- 172.21.15.90:0/2917621859 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc43c04f160 0x7fc43c0dee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:53.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.915+0000 7fc449800640 1 --2- 172.21.15.90:0/2917621859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc43c04a170 0x7fc43c00a3e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:53.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.915+0000 7fc449800640 1 --2- 172.21.15.90:0/2917621859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc43c00da70 0x7fc43c043f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:53.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.915+0000 7fc449800640 1 -- 172.21.15.90:0/2917621859 >> 172.21.15.90:0/2917621859 conn(0x7fc43c0312e0 msgr2=0x7fc43c00ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:53.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.915+0000 7fc449800640 1 -- 172.21.15.90:0/2917621859 shutdown_connections 2024-09-21T03:23:53.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:23:53.915+0000 7fc449800640 1 -- 172.21.15.90:0/2917621859 wait complete. 2024-09-21T03:23:56.983 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:24:02.706 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:24:02.718 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:24:03.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.443+0000 7f867ca00640 1 -- 172.21.15.90:0/3046596807 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f865c0039b0 msgr2=0x7f865c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:03.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.443+0000 7f8674a00640 1 -- 172.21.15.90:0/3046596807 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8664009760 con 0x7f865c0039b0 2024-09-21T03:24:03.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.443+0000 7f867ca00640 1 --2- 172.21.15.90:0/3046596807 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f865c0039b0 0x7f865c003e40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8664009b60 tx=0x7f865c005830 comp rx=0 tx=0).stop 2024-09-21T03:24:03.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.443+0000 7f867ca00640 1 -- 172.21.15.90:0/3046596807 shutdown_connections 2024-09-21T03:24:03.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.443+0000 7f867ca00640 1 --2- 172.21.15.90:0/3046596807 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f865c0039b0 0x7f865c003e40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:03.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.443+0000 7f867ca00640 1 -- 172.21.15.90:0/3046596807 >> 172.21.15.90:0/3046596807 conn(0x7f867806ead0 msgr2=0x7f867806eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:03.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.444+0000 7f867ca00640 1 -- 172.21.15.90:0/3046596807 shutdown_connections 2024-09-21T03:24:03.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.444+0000 7f867ca00640 1 -- 172.21.15.90:0/3046596807 wait complete. 2024-09-21T03:24:03.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.452+0000 7f867ca00640 1 Processor -- start 2024-09-21T03:24:03.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.452+0000 7f867ca00640 1 -- start start 2024-09-21T03:24:03.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.457+0000 7f867ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f865c0039b0 0x7f86780c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:03.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.457+0000 7f867ca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86781549f0 0x7f8678149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:03.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.457+0000 7f867ca00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86780c7b90 0x7f8678147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:03.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.457+0000 7f867ca00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f867815afe0 con 0x7f86780c7b90 2024-09-21T03:24:03.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.457+0000 7f867ca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f867815a200 con 0x7f865c0039b0 2024-09-21T03:24:03.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.457+0000 7f867ca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8678154730 con 0x7f86781549f0 2024-09-21T03:24:03.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.458+0000 7f8677200640 1 -- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f865c0039b0 msgr2=0x7f86780c6770 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3300/0 2024-09-21T03:24:03.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.458+0000 7f8677200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f865c0039b0 0x7f86780c6770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:24:03.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.458+0000 7f8675400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86781549f0 0x7f8678149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:03.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.459+0000 7f8675400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86781549f0 0x7f8678149330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:53550/0 (socket says 172.21.15.90:53550) 2024-09-21T03:24:03.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.459+0000 7f8675400640 1 -- 172.21.15.90:0/4046569141 learned_addr learned my addr 172.21.15.90:0/4046569141 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:03.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.459+0000 7f8675e00640 1 --2- 172.21.15.90:0/4046569141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86780c7b90 0x7f8678147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:03.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.461+0000 7f8675400640 1 -- 172.21.15.90:0/4046569141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f865c0039b0 msgr2=0x7f86780c6770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:24:03.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.461+0000 7f8675400640 1 --2- 172.21.15.90:0/4046569141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f865c0039b0 0x7f86780c6770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:03.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.461+0000 7f8675400640 1 -- 172.21.15.90:0/4046569141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86780c7b90 msgr2=0x7f8678147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:03.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.461+0000 7f8675400640 1 --2- 172.21.15.90:0/4046569141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86780c7b90 0x7f8678147000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:03.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.461+0000 7f8675400640 1 -- 172.21.15.90:0/4046569141 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86780c5fb0 con 0x7f86781549f0 2024-09-21T03:24:03.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.462+0000 7f8675400640 1 --2- 172.21.15.90:0/4046569141 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86781549f0 0x7f8678149330 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8668001050 tx=0x7f8668013e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:03.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.462+0000 7f866e000640 1 -- 172.21.15.90:0/4046569141 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8668011cf0 con 0x7f86781549f0 2024-09-21T03:24:03.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.463+0000 7f866e000640 1 -- 172.21.15.90:0/4046569141 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f866801d400 con 0x7f86781549f0 2024-09-21T03:24:03.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.464+0000 7f866e000640 1 -- 172.21.15.90:0/4046569141 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8668011cf0 con 0x7f86781549f0 2024-09-21T03:24:03.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.466+0000 7f867ca00640 1 -- 172.21.15.90:0/4046569141 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86780c6fd0 con 0x7f86781549f0 2024-09-21T03:24:03.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.466+0000 7f867ca00640 1 -- 172.21.15.90:0/4046569141 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f86780c6250 con 0x7f86781549f0 2024-09-21T03:24:03.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.469+0000 7f8663400640 1 -- 172.21.15.90:0/4046569141 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86780c92a0 con 0x7f86781549f0 2024-09-21T03:24:03.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.471+0000 7f866e000640 1 -- 172.21.15.90:0/4046569141 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f86680253f0 con 0x7f86781549f0 2024-09-21T03:24:03.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.472+0000 7f866e000640 1 --2- 172.21.15.90:0/4046569141 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8658079b70 0x7f865807c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:03.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.473+0000 7f866e000640 1 -- 172.21.15.90:0/4046569141 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f866809c010 con 0x7f86781549f0 2024-09-21T03:24:03.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.473+0000 7f8677200640 1 --2- 172.21.15.90:0/4046569141 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8658079b70 0x7f865807c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:03.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.478+0000 7f8677200640 1 --2- 172.21.15.90:0/4046569141 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8658079b70 0x7f865807c080 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8664001050 tx=0x7f866402d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:03.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:03.478+0000 7f866e000640 1 -- 172.21.15.90:0/4046569141 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8668018070 con 0x7f86781549f0 2024-09-21T03:24:04.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.076+0000 7f8663400640 1 -- 172.21.15.90:0/4046569141 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8678070430 con 0x7f86781549f0 2024-09-21T03:24:04.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.081+0000 7f866e000640 1 -- 172.21.15.90:0/4046569141 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f8668064090 con 0x7f86781549f0 2024-09-21T03:24:04.087 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":68,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:24:04.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.085+0000 7f8663400640 1 -- 172.21.15.90:0/4046569141 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8658079b70 msgr2=0x7f865807c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:04.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.085+0000 7f8663400640 1 --2- 172.21.15.90:0/4046569141 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8658079b70 0x7f865807c080 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8664001050 tx=0x7f866402d040 comp rx=0 tx=0).stop 2024-09-21T03:24:04.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.085+0000 7f8663400640 1 -- 172.21.15.90:0/4046569141 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86781549f0 msgr2=0x7f8678149330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:04.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.085+0000 7f8663400640 1 --2- 172.21.15.90:0/4046569141 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86781549f0 0x7f8678149330 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8668001050 tx=0x7f8668013e80 comp rx=0 tx=0).stop 2024-09-21T03:24:04.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.085+0000 7f8663400640 1 -- 172.21.15.90:0/4046569141 shutdown_connections 2024-09-21T03:24:04.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.085+0000 7f8663400640 1 --2- 172.21.15.90:0/4046569141 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8658079b70 0x7f865807c080 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:04.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.085+0000 7f8663400640 1 --2- 172.21.15.90:0/4046569141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86780c7b90 0x7f8678147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:04.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.085+0000 7f8663400640 1 --2- 172.21.15.90:0/4046569141 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86781549f0 0x7f8678149330 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:04.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.085+0000 7f8663400640 1 --2- 172.21.15.90:0/4046569141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f865c0039b0 0x7f86780c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:04.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.085+0000 7f8663400640 1 -- 172.21.15.90:0/4046569141 >> 172.21.15.90:0/4046569141 conn(0x7f867806ead0 msgr2=0x7f867806eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:04.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.086+0000 7f8663400640 1 -- 172.21.15.90:0/4046569141 shutdown_connections 2024-09-21T03:24:04.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.086+0000 7f8663400640 1 -- 172.21.15.90:0/4046569141 wait complete. 2024-09-21T03:24:04.127 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-21T03:24:04.127 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-21T03:24:04.128 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:24:04.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.587+0000 7f0fcb200640 1 -- 172.21.15.90:0/2526463422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fcc0728e0 msgr2=0x7f0fcc156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:04.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.587+0000 7f0fcb200640 1 --2- 172.21.15.90:0/2526463422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fcc0728e0 0x7f0fcc156bc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8009830 tx=0x7f0fb802a420 comp rx=0 tx=0).stop 2024-09-21T03:24:04.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.587+0000 7f0fcb200640 1 -- 172.21.15.90:0/2526463422 shutdown_connections 2024-09-21T03:24:04.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.587+0000 7f0fcb200640 1 --2- 172.21.15.90:0/2526463422 >> v2:172.21.15.149:3300/0 conn(0x7f0fcc149580 0x7f0fcc15d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:04.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.587+0000 7f0fcb200640 1 --2- 172.21.15.90:0/2526463422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fcc0728e0 0x7f0fcc156bc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:04.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.587+0000 7f0fcb200640 1 -- 172.21.15.90:0/2526463422 >> 172.21.15.90:0/2526463422 conn(0x7f0fcc06d200 msgr2=0x7f0fcc06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:04.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.587+0000 7f0fcb200640 1 -- 172.21.15.90:0/2526463422 shutdown_connections 2024-09-21T03:24:04.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.587+0000 7f0fcb200640 1 -- 172.21.15.90:0/2526463422 wait complete. 2024-09-21T03:24:04.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.595+0000 7f0fcb200640 1 Processor -- start 2024-09-21T03:24:04.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.595+0000 7f0fcb200640 1 -- start start 2024-09-21T03:24:04.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.597+0000 7f0fcb200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fcc070bc0 0x7f0fcc13cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:04.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.597+0000 7f0fcb200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fcc149580 0x7f0fcc140d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:04.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.597+0000 7f0fcb200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc13fb10 0x7f0fcc13ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:04.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.597+0000 7f0fcb200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0fcc0c3b00 con 0x7f0fcc13fb10 2024-09-21T03:24:04.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.597+0000 7f0fcb200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0fcc0aa690 con 0x7f0fcc070bc0 2024-09-21T03:24:04.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.597+0000 7f0fcb200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0fcc150770 con 0x7f0fcc149580 2024-09-21T03:24:04.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.597+0000 7f0fc9400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fcc149580 0x7f0fcc140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:04.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.597+0000 7f0fc9400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fcc149580 0x7f0fcc140d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:53564/0 (socket says 172.21.15.90:53564) 2024-09-21T03:24:04.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.597+0000 7f0fc9400640 1 -- 172.21.15.90:0/3040410976 learned_addr learned my addr 172.21.15.90:0/3040410976 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:04.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.598+0000 7f0fc9e00640 1 -- 172.21.15.90:0/3040410976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fcc070bc0 msgr2=0x7f0fcc13cf30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3300/0 2024-09-21T03:24:04.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.598+0000 7f0fc9e00640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fcc070bc0 0x7f0fcc13cf30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-21T03:24:04.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.598+0000 7f0fca800640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc13fb10 0x7f0fcc13ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:04.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.598+0000 7f0fc9400640 1 -- 172.21.15.90:0/3040410976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fcc070bc0 msgr2=0x7f0fcc13cf30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:24:04.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.598+0000 7f0fc9400640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fcc070bc0 0x7f0fcc13cf30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:04.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.598+0000 7f0fc9400640 1 -- 172.21.15.90:0/3040410976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc13fb10 msgr2=0x7f0fcc13ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:04.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.598+0000 7f0fc9400640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc13fb10 0x7f0fcc13ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:04.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.598+0000 7f0fc9400640 1 -- 172.21.15.90:0/3040410976 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fcc13e370 con 0x7f0fcc149580 2024-09-21T03:24:04.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.598+0000 7f0fca800640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc13fb10 0x7f0fcc13ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:04.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.599+0000 7f0fc9400640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fcc149580 0x7f0fcc140d30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0fb802aa10 tx=0x7f0fb8032cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:04.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.600+0000 7f0fc2000640 1 -- 172.21.15.90:0/3040410976 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8040070 con 0x7f0fcc149580 2024-09-21T03:24:04.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.601+0000 7f0fc2000640 1 -- 172.21.15.90:0/3040410976 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fb8005310 con 0x7f0fcc149580 2024-09-21T03:24:04.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.605+0000 7f0fc2000640 1 -- 172.21.15.90:0/3040410976 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8003800 con 0x7f0fcc149580 2024-09-21T03:24:04.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.605+0000 7f0fcb200640 1 -- 172.21.15.90:0/3040410976 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fcc13ed80 con 0x7f0fcc149580 2024-09-21T03:24:04.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.605+0000 7f0fcb200640 1 -- 172.21.15.90:0/3040410976 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fcc13d470 con 0x7f0fcc149580 2024-09-21T03:24:04.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.608+0000 7f0fcb200640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc141270 0x7f0fcc1f4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:04.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.608+0000 7f0fcb200640 1 -- 172.21.15.90:0/3040410976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0fcc13d9f0 con 0x7f0fcc141270 2024-09-21T03:24:04.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.610+0000 7f0fc9e00640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc141270 0x7f0fcc1f4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:04.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.610+0000 7f0fc9e00640 1 -- 172.21.15.90:0/3040410976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0fcc13f460 con 0x7f0fcc141270 2024-09-21T03:24:04.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.611+0000 7f0fc9e00640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc141270 0x7f0fcc1f4fe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0036a0 tx=0x7f0fbc00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:04.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.613+0000 7f0fc2000640 1 -- 172.21.15.90:0/3040410976 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0fb8039040 con 0x7f0fcc149580 2024-09-21T03:24:04.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.617+0000 7f0fc2000640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0fac078b90 0x7f0fac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:04.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.618+0000 7f0fc2000640 1 -- 172.21.15.90:0/3040410976 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc0074e0 con 0x7f0fcc141270 2024-09-21T03:24:04.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.619+0000 7f0fca800640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0fac078b90 0x7f0fac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:04.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.622+0000 7f0fc2000640 1 -- 172.21.15.90:0/3040410976 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f0fb80bc330 con 0x7f0fcc149580 2024-09-21T03:24:04.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.622+0000 7f0fc2000640 1 -- 172.21.15.90:0/3040410976 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0fbc007680 con 0x7f0fcc141270 2024-09-21T03:24:04.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.623+0000 7f0fc2000640 1 -- 172.21.15.90:0/3040410976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc141270 msgr2=0x7f0fcc1f4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:04.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.623+0000 7f0fc2000640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc141270 0x7f0fcc1f4fe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0036a0 tx=0x7f0fbc00c7a0 comp rx=0 tx=0).stop 2024-09-21T03:24:04.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.623+0000 7f0fc2000640 1 -- 172.21.15.90:0/3040410976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc141270 msgr2=0x7f0fcc1f4fe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:24:04.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.623+0000 7f0fc2000640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc141270 0x7f0fcc1f4fe0 secure :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0036a0 tx=0x7f0fbc00c7a0 comp rx=0 tx=0).stop 2024-09-21T03:24:04.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.623+0000 7f0fca800640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0fac078b90 0x7f0fac07b0a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc152c00 tx=0x7f0fc4009510 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:04.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.654+0000 7f0fcb200640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc1f5520 0x7f0fcc1f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:04.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.654+0000 7f0fcb200640 1 -- 172.21.15.90:0/3040410976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0fcc1f5e70 con 0x7f0fcc1f5520 2024-09-21T03:24:04.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.655+0000 7f0fc9e00640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc1f5520 0x7f0fcc1f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:04.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.656+0000 7f0fc9e00640 1 -- 172.21.15.90:0/3040410976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0fcc13b700 con 0x7f0fcc1f5520 2024-09-21T03:24:04.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.656+0000 7f0fc9e00640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc1f5520 0x7f0fcc1f5930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc000c00 tx=0x7f0fbc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:04.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.659+0000 7f0fc2000640 1 -- 172.21.15.90:0/3040410976 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc018040 con 0x7f0fcc1f5520 2024-09-21T03:24:04.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.659+0000 7f0fc2000640 1 -- 172.21.15.90:0/3040410976 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5184 (secure 0 0 0) 0x7f0fbc01aab0 con 0x7f0fcc1f5520 2024-09-21T03:24:04.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.659+0000 7f0fc2000640 1 -- 172.21.15.90:0/3040410976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc1f5520 msgr2=0x7f0fcc1f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:04.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.659+0000 7f0fc2000640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc1f5520 0x7f0fcc1f5930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc000c00 tx=0x7f0fbc000ed0 comp rx=0 tx=0).stop 2024-09-21T03:24:04.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.660+0000 7f0fc2000640 1 -- 172.21.15.90:0/3040410976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc1f5520 msgr2=0x7f0fcc1f5930 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:24:04.663 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:24:04.663 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:24:04.663 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:24:04.663 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:24:04.663 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 68, 2024-09-21T03:24:04.663 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 288432, 2024-09-21T03:24:04.663 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:24:04.664 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:24:04.664 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:24:04.664 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:04.664 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 1, 2024-09-21T03:24:04.664 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:24:04.664 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:24:04.664 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:24:04.664 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:24:04.664 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:24:04.664 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:24:04.664 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:24:04.664 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:24:04.664 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:24:04.664 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:24:04.665 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:24:04.665 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:24:04.665 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:24:04.665 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:24:04.665 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:04.665 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:24:04.665 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:24:04.665 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:24:04.665 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:24:04.665 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:24:04.665 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:24:04.665 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:24:04.665 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:24:04.665 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:24:04.665 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:24:04.665 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:24:04.666 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:24:04.666 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:24:04.666 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:04.666 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:04.666 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:24:04.666 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:24:04.666 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:24:04.666 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:24:04.666 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:24:04.666 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:24:04.666 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:24:04.666 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:24:04.666 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:24:04.666 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:24:04.666 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:24:04.667 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:24:04.667 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:24:04.667 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:24:04.667 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:24:04.667 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:24:04.667 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:24:04.667 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:24:04.667 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:24:04.667 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:24:04.667 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:24:04.667 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:24:04.667 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:24:04.667 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:24:04.667 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:24:04.668 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:24:04.668 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:24:04.668 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:24:04.668 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:04.668 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:24:04.668 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:04.668 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:24:04.668 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:04.668 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:24:04.668 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:24:04.668 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:24:04.668 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:24:04.668 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:04.668 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:24:04.668 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:24:04.669 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:04.669 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:04.669 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:04.669 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:24:04.669 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:24:04.669 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:04.669 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:04.669 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:04.669 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:04.669 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:24:04.669 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:24:04.669 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:24:04.669 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:24:04.669 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:24:04.669 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:04.670 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:04.670 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:24:04.670 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:24:04.670 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:24:04.670 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:24:04.670 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:04.670 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:24:04.670 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:24:04.670 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:04.670 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:04.670 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:04.670 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:24:04.670 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:24:04.670 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:04.670 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:04.671 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:04.671 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:04.671 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:24:04.671 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:24:04.671 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:24:04.671 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:24:04.671 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:24:04.671 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:04.671 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:04.671 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:24:04.671 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:24:04.671 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:24:04.671 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:24:04.671 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:04.671 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:24:04.672 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:24:04.672 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:04.672 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:04.672 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:04.672 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:24:04.672 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:24:04.672 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:04.672 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:04.672 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:04.672 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:04.672 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:24:04.672 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:24:04.672 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:24:04.672 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:24:04.672 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:24:04.672 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:04.673 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:04.673 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:04.673 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:24:04.673 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:24:04.673 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:04.673 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:24:04.673 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:24:04.673 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:24:04.673 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:04.673 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:04.673 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:24:04.673 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:04.673 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:24:04.673 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:24:04.673 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:24:04.674 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:04.674 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:04.674 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:24:04.674 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:04.674 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:24:04.674 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:24:04.674 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 8 2024-09-21T03:24:04.674 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:04.674 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:04.674 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:24:04.674 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:04.674 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:24:04.674 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:24:04.674 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:24:04.675 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:04.675 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:04.675 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:24:04.675 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:24:04.675 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5 2024-09-21T03:24:04.675 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:04.675 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:04.675 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:24:04.675 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:04.675 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:24:04.675 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:24:04.675 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:24:04.675 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:04.675 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:04.676 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:04.676 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:24:04.676 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:24:04.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.660+0000 7f0fc2000640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc1f5520 0x7f0fcc1f5930 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:04.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.662+0000 7f0fcb200640 1 -- 172.21.15.90:0/3040410976 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0fac078b90 msgr2=0x7f0fac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:04.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.662+0000 7f0fcb200640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0fac078b90 0x7f0fac07b0a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc152c00 tx=0x7f0fc4009510 comp rx=0 tx=0).stop 2024-09-21T03:24:04.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.662+0000 7f0fcb200640 1 -- 172.21.15.90:0/3040410976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fcc149580 msgr2=0x7f0fcc140d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:04.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.662+0000 7f0fcb200640 1 --2- 172.21.15.90:0/3040410976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fcc149580 0x7f0fcc140d30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0fb802aa10 tx=0x7f0fb8032cd0 comp rx=0 tx=0).stop 2024-09-21T03:24:04.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.662+0000 7f0fca800640 1 -- 172.21.15.90:0/3040410976 reap_dead start 2024-09-21T03:24:04.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.662+0000 7f0fca800640 1 -- 172.21.15.90:0/3040410976 reap_dead start 2024-09-21T03:24:04.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.662+0000 7f0fcb200640 1 -- 172.21.15.90:0/3040410976 shutdown_connections 2024-09-21T03:24:04.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.662+0000 7f0fcb200640 1 -- 172.21.15.90:0/3040410976 >> 172.21.15.90:0/3040410976 conn(0x7f0fcc06d200 msgr2=0x7f0fcc1516b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:04.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.664+0000 7f0fcb200640 1 -- 172.21.15.90:0/3040410976 shutdown_connections 2024-09-21T03:24:04.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:04.664+0000 7f0fcb200640 1 -- 172.21.15.90:0/3040410976 wait complete. 2024-09-21T03:24:04.723 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-21T03:24:04.723 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-21T03:24:04.723 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:24:05.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.186+0000 7f2862600640 1 -- 172.21.15.90:0/3367147713 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f285c06e080 msgr2=0x7f285c06e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:05.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.187+0000 7f2862600640 1 --2- 172.21.15.90:0/3367147713 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f285c06e080 0x7f285c06e490 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2854005fd0 tx=0x7f285402aa10 comp rx=0 tx=0).stop 2024-09-21T03:24:05.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.187+0000 7f2862600640 1 -- 172.21.15.90:0/3367147713 shutdown_connections 2024-09-21T03:24:05.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.187+0000 7f2862600640 1 --2- 172.21.15.90:0/3367147713 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f285c06e080 0x7f285c06e490 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:05.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.187+0000 7f2862600640 1 --2- 172.21.15.90:0/3367147713 >> v2:172.21.15.149:3300/0 conn(0x7f285c0b1750 0x7f285c06db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:05.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.187+0000 7f2862600640 1 -- 172.21.15.90:0/3367147713 >> 172.21.15.90:0/3367147713 conn(0x7f285c0add50 msgr2=0x7f285c0ae160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:05.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.187+0000 7f2862600640 1 -- 172.21.15.90:0/3367147713 shutdown_connections 2024-09-21T03:24:05.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.188+0000 7f2862600640 1 -- 172.21.15.90:0/3367147713 wait complete. 2024-09-21T03:24:05.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.191+0000 7f2862600640 1 Processor -- start 2024-09-21T03:24:05.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.191+0000 7f2862600640 1 -- start start 2024-09-21T03:24:05.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.193+0000 7f2862600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f285c06e080 0x7f285c14e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:05.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.193+0000 7f2862600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f285c0b1750 0x7f285c0c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:05.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.193+0000 7f2862600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f285c0c85e0 0x7f285c14f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:05.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.193+0000 7f2862600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f285c0cad90 con 0x7f285c0c85e0 2024-09-21T03:24:05.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.193+0000 7f2862600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f285c0cb070 con 0x7f285c0b1750 2024-09-21T03:24:05.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.193+0000 7f2862600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f285c153090 con 0x7f285c06e080 2024-09-21T03:24:05.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.194+0000 7f2861200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f285c06e080 0x7f285c14e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:05.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.194+0000 7f2861200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f285c06e080 0x7f285c14e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:49090/0 (socket says 172.21.15.90:49090) 2024-09-21T03:24:05.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.194+0000 7f2861c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f285c0c85e0 0x7f285c14f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:05.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.194+0000 7f2861200640 1 -- 172.21.15.90:0/532523832 learned_addr learned my addr 172.21.15.90:0/532523832 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:05.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.195+0000 7f2861200640 1 -- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f285c0b1750 msgr2=0x7f285c0c5fc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:24:05.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.195+0000 7f2861200640 1 --2- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f285c0b1750 0x7f285c0c5fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:05.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.195+0000 7f2861200640 1 -- 172.21.15.90:0/532523832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f285c0c85e0 msgr2=0x7f285c14f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:05.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.195+0000 7f2861200640 1 --2- 172.21.15.90:0/532523832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f285c0c85e0 0x7f285c14f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:05.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.195+0000 7f2861200640 1 -- 172.21.15.90:0/532523832 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f285c1570c0 con 0x7f285c06e080 2024-09-21T03:24:05.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.195+0000 7f2861c00640 1 --2- 172.21.15.90:0/532523832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f285c0c85e0 0x7f285c14f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:05.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.196+0000 7f2861200640 1 --2- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f285c06e080 0x7f285c14e190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f285000b4a0 tx=0x7f285000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:05.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.197+0000 7f2858c00640 1 -- 172.21.15.90:0/532523832 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2850014070 con 0x7f285c06e080 2024-09-21T03:24:05.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.197+0000 7f2858c00640 1 -- 172.21.15.90:0/532523832 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2850010610 con 0x7f285c06e080 2024-09-21T03:24:05.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.197+0000 7f2858c00640 1 -- 172.21.15.90:0/532523832 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2850010a60 con 0x7f285c06e080 2024-09-21T03:24:05.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.198+0000 7f2862600640 1 -- 172.21.15.90:0/532523832 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f285c14e7b0 con 0x7f285c06e080 2024-09-21T03:24:05.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.198+0000 7f2862600640 1 -- 172.21.15.90:0/532523832 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f285c1581c0 con 0x7f285c06e080 2024-09-21T03:24:05.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.205+0000 7f2862600640 1 --2- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2838002a70 0x7f2838004f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:05.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.205+0000 7f2862600640 1 -- 172.21.15.90:0/532523832 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2838007f10 con 0x7f2838002a70 2024-09-21T03:24:05.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.209+0000 7f2858c00640 1 -- 172.21.15.90:0/532523832 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2850017070 con 0x7f285c06e080 2024-09-21T03:24:05.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.209+0000 7f285be00640 1 --2- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2838002a70 0x7f2838004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:05.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.210+0000 7f285be00640 1 -- 172.21.15.90:0/532523832 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2838008110 con 0x7f2838002a70 2024-09-21T03:24:05.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.211+0000 7f2858c00640 1 --2- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2840078c60 0x7f284007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:05.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.211+0000 7f2858c00640 1 -- 172.21.15.90:0/532523832 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f285009ad70 con 0x7f285c06e080 2024-09-21T03:24:05.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.211+0000 7f285be00640 1 --2- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2838002a70 0x7f2838004f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f284c001050 tx=0x7f284c00b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:05.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.212+0000 7f2858c00640 1 -- 172.21.15.90:0/532523832 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c015020 con 0x7f2838002a70 2024-09-21T03:24:05.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.213+0000 7f2861c00640 1 --2- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2840078c60 0x7f284007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:05.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.213+0000 7f2858c00640 1 -- 172.21.15.90:0/532523832 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f284c011830 con 0x7f2838002a70 2024-09-21T03:24:05.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.213+0000 7f2858c00640 1 -- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2838002a70 msgr2=0x7f2838004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:05.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.213+0000 7f2858c00640 1 --2- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2838002a70 0x7f2838004f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f284c001050 tx=0x7f284c00b7a0 comp rx=0 tx=0).stop 2024-09-21T03:24:05.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.213+0000 7f2858c00640 1 -- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2838002a70 msgr2=0x7f2838004f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:24:05.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.213+0000 7f2858c00640 1 --2- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2838002a70 0x7f2838004f80 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f284c001050 tx=0x7f284c00b7a0 comp rx=0 tx=0).stop 2024-09-21T03:24:05.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.219+0000 7f2861c00640 1 --2- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2840078c60 0x7f284007b170 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2854035000 tx=0x7f2854004ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:05.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.252+0000 7f2862600640 1 --2- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2838006f30 0x7f28380073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:05.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.252+0000 7f2862600640 1 -- 172.21.15.90:0/532523832 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f283800a4f0 con 0x7f2838006f30 2024-09-21T03:24:05.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.260+0000 7f285be00640 1 --2- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2838006f30 0x7f28380073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:05.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.261+0000 7f285be00640 1 -- 172.21.15.90:0/532523832 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2838007930 con 0x7f2838006f30 2024-09-21T03:24:05.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.263+0000 7f285be00640 1 --2- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2838006f30 0x7f28380073f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f284c001050 tx=0x7f284c004800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:05.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.264+0000 7f2858c00640 1 -- 172.21.15.90:0/532523832 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c015040 con 0x7f2838006f30 2024-09-21T03:24:05.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.264+0000 7f2858c00640 1 -- 172.21.15.90:0/532523832 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4537 (secure 0 0 0) 0x7f284c024450 con 0x7f2838006f30 2024-09-21T03:24:05.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.265+0000 7f2858c00640 1 -- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2838006f30 msgr2=0x7f28380073f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:05.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.265+0000 7f2858c00640 1 --2- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2838006f30 0x7f28380073f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f284c001050 tx=0x7f284c004800 comp rx=0 tx=0).stop 2024-09-21T03:24:05.267 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:24:05.267 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:24:05.267 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:24:05.267 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:24:05.267 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 68, 2024-09-21T03:24:05.267 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 38821, 2024-09-21T03:24:05.267 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:24:05.267 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:24:05.267 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:24:05.267 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:05.268 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 2, 2024-09-21T03:24:05.268 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:24:05.268 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:24:05.268 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:24:05.268 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:24:05.268 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:24:05.268 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:24:05.268 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:24:05.268 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:24:05.268 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:24:05.268 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:24:05.268 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:24:05.268 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:24:05.268 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:24:05.268 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:24:05.269 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:05.269 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:24:05.269 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:24:05.269 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:24:05.269 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:24:05.269 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:24:05.269 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:24:05.269 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:24:05.269 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:24:05.269 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:24:05.269 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:24:05.269 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:24:05.269 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:24:05.269 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:24:05.269 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:05.269 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:05.270 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:24:05.270 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:24:05.270 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:24:05.270 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:24:05.270 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:24:05.270 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:24:05.270 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:24:05.270 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:24:05.270 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:24:05.270 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:24:05.270 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:24:05.270 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:24:05.270 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:24:05.270 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:24:05.271 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:24:05.271 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:24:05.271 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:24:05.271 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:24:05.271 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:24:05.271 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:24:05.271 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:24:05.271 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:24:05.271 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:24:05.271 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:24:05.271 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:24:05.271 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:24:05.271 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:24:05.271 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:24:05.271 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:05.272 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:24:05.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:05.272 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:24:05.272 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:05.272 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:24:05.272 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:24:05.272 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:24:05.272 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:24:05.272 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:05.272 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:24:05.272 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:24:05.272 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:05.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:05.272 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:05.272 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:24:05.272 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:24:05.273 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:05.273 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:05.273 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:05.273 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:05.273 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:24:05.273 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:24:05.273 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:24:05.273 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:24:05.273 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:24:05.273 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:05.273 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:05.273 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:24:05.273 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:24:05.273 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:24:05.273 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:24:05.273 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:05.274 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:24:05.274 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:24:05.274 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:05.274 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:05.274 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:05.274 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:24:05.274 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:24:05.274 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:05.274 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:05.274 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:05.274 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:05.274 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:24:05.274 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:24:05.274 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:24:05.275 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:24:05.275 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:24:05.275 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:05.275 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:05.275 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:24:05.275 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:24:05.275 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:24:05.275 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:24:05.275 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:05.275 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:24:05.275 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:24:05.275 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:05.275 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:05.275 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:05.275 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:24:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:24:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:24:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:24:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:24:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:24:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:24:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:24:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:24:05.276 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:24:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:24:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:24:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:24:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:24:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:24:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:24:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:05.277 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:24:05.278 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:24:05.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.265+0000 7f2858c00640 1 -- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2838006f30 msgr2=0x7f28380073f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:24:05.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.265+0000 7f2858c00640 1 --2- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2838006f30 0x7f28380073f0 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f284c001050 tx=0x7f284c004800 comp rx=0 tx=0).stop 2024-09-21T03:24:05.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.271+0000 7f2862600640 1 -- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2840078c60 msgr2=0x7f284007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:05.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.271+0000 7f2862600640 1 --2- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2840078c60 0x7f284007b170 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2854035000 tx=0x7f2854004ab0 comp rx=0 tx=0).stop 2024-09-21T03:24:05.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.271+0000 7f2862600640 1 -- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f285c06e080 msgr2=0x7f285c14e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:05.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.271+0000 7f2862600640 1 --2- 172.21.15.90:0/532523832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f285c06e080 0x7f285c14e190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f285000b4a0 tx=0x7f285000b960 comp rx=0 tx=0).stop 2024-09-21T03:24:05.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.271+0000 7f2861c00640 1 -- 172.21.15.90:0/532523832 reap_dead start 2024-09-21T03:24:05.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.271+0000 7f2861c00640 1 -- 172.21.15.90:0/532523832 reap_dead start 2024-09-21T03:24:05.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.272+0000 7f2862600640 1 -- 172.21.15.90:0/532523832 shutdown_connections 2024-09-21T03:24:05.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.272+0000 7f2862600640 1 -- 172.21.15.90:0/532523832 >> 172.21.15.90:0/532523832 conn(0x7f285c0add50 msgr2=0x7f285c0c73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:05.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.276+0000 7f2862600640 1 -- 172.21.15.90:0/532523832 shutdown_connections 2024-09-21T03:24:05.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:05.277+0000 7f2862600640 1 -- 172.21.15.90:0/532523832 wait complete. 2024-09-21T03:24:05.326 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-21T03:24:05.327 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-21T03:24:17.207 INFO:tasks.workunit.client.1.smithi149.stdout:Syncing()...45 sec 2024-09-21T03:24:17.207 INFO:tasks.workunit.client.1.smithi149.stdout:FFSB benchmark finished at: Sat Sep 21 03:24:17 2024 2024-09-21T03:24:17.207 INFO:tasks.workunit.client.1.smithi149.stdout: 2024-09-21T03:24:17.207 INFO:tasks.workunit.client.1.smithi149.stdout:Results: 2024-09-21T03:24:17.207 INFO:tasks.workunit.client.1.smithi149.stdout:Benchmark took 359.82 sec 2024-09-21T03:24:17.207 INFO:tasks.workunit.client.1.smithi149.stdout: 2024-09-21T03:24:17.208 INFO:tasks.workunit.client.1.smithi149.stdout:Total Results 2024-09-21T03:24:17.208 INFO:tasks.workunit.client.1.smithi149.stdout:=============== 2024-09-21T03:24:17.208 INFO:tasks.workunit.client.1.smithi149.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-09-21T03:24:17.208 INFO:tasks.workunit.client.1.smithi149.stdout: ======= ============ ========= ======= =========== ========== 2024-09-21T03:24:17.208 INFO:tasks.workunit.client.1.smithi149.stdout: write : 4622080 12845.40 100.000% 100.000% 50.2MB/sec 2024-09-21T03:24:17.208 INFO:tasks.workunit.client.1.smithi149.stdout:- 2024-09-21T03:24:17.208 INFO:tasks.workunit.client.1.smithi149.stdout:12845.40 Transactions per Second 2024-09-21T03:24:17.208 INFO:tasks.workunit.client.1.smithi149.stdout: 2024-09-21T03:24:17.208 INFO:tasks.workunit.client.1.smithi149.stdout:Throughput Results 2024-09-21T03:24:17.208 INFO:tasks.workunit.client.1.smithi149.stdout:=================== 2024-09-21T03:24:17.208 INFO:tasks.workunit.client.1.smithi149.stdout:Write Throughput: 50.2MB/sec 2024-09-21T03:24:17.254 INFO:tasks.workunit.client.1.smithi149.stdout: 2024-09-21T03:24:17.254 INFO:tasks.workunit.client.1.smithi149.stdout:System Call Latency statistics in millisecs 2024-09-21T03:24:17.254 INFO:tasks.workunit.client.1.smithi149.stdout:===== 2024-09-21T03:24:17.254 INFO:tasks.workunit.client.1.smithi149.stdout: Min Avg Max Total Calls 2024-09-21T03:24:17.254 INFO:tasks.workunit.client.1.smithi149.stdout: ======== ======== ======== ============ 2024-09-21T03:24:17.254 INFO:tasks.workunit.client.1.smithi149.stdout:[ open] 0.019000 0.125831 36.519001 3611 2024-09-21T03:24:17.255 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-21T03:24:17.255 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-21T03:24:17.255 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-21T03:24:17.255 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-21T03:24:17.255 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-21T03:24:17.255 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-21T03:24:17.255 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-21T03:24:17.255 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[7] 20.000000 - 50.000000 : 2 2024-09-21T03:24:17.255 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[8] 10.000000 - 20.000000 : 2 2024-09-21T03:24:17.255 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[9] 5.000000 - 10.000000 : 7 2024-09-21T03:24:17.255 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[10] 2.000000 - 5.000000 : 30 2024-09-21T03:24:17.255 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[11] 1.000000 - 2.000000 : 22 2024-09-21T03:24:17.255 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[12] 0.500000 - 1.000000 : 21 2024-09-21T03:24:17.255 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[13] 0.200000 - 0.500000 : 25 2024-09-21T03:24:17.256 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[14] 0.100000 - 0.200000 : 135 2024-09-21T03:24:17.256 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[15] 0.050000 - 0.100000 : 738 2024-09-21T03:24:17.256 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[16] 0.020000 - 0.050000 : 2628 2024-09-21T03:24:17.256 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[17] 0.010000 - 0.020000 : 1 2024-09-21T03:24:17.256 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-21T03:24:17.256 INFO:tasks.workunit.client.1.smithi149.stdout: 2024-09-21T03:24:17.256 INFO:tasks.workunit.client.1.smithi149.stdout:[ write] 0.003000 2.099687 43586.960938 4622080 2024-09-21T03:24:17.256 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[0] 5000.000000 - 10000.000000 : 223 2024-09-21T03:24:17.256 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[1] 2000.000000 - 5000.000000 : 452 2024-09-21T03:24:17.256 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[2] 1000.000000 - 2000.000000 : 290 2024-09-21T03:24:17.256 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[3] 500.000000 - 1000.000000 : 513 2024-09-21T03:24:17.256 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[4] 200.000000 - 500.000000 : 21851 2024-09-21T03:24:17.256 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[5] 100.000000 - 200.000000 : 757 2024-09-21T03:24:17.256 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[6] 50.000000 - 100.000000 : 325 2024-09-21T03:24:17.257 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[7] 20.000000 - 50.000000 : 624 2024-09-21T03:24:17.257 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[8] 10.000000 - 20.000000 : 1569 2024-09-21T03:24:17.257 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[9] 5.000000 - 10.000000 : 2473 2024-09-21T03:24:17.257 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[10] 2.000000 - 5.000000 : 3972 2024-09-21T03:24:17.257 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[11] 1.000000 - 2.000000 : 2837 2024-09-21T03:24:17.257 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[12] 0.500000 - 1.000000 : 2878 2024-09-21T03:24:17.257 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[13] 0.200000 - 0.500000 : 5113 2024-09-21T03:24:17.257 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[14] 0.100000 - 0.200000 : 6365 2024-09-21T03:24:17.257 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[15] 0.050000 - 0.100000 : 15838 2024-09-21T03:24:17.257 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[16] 0.020000 - 0.050000 : 144867 2024-09-21T03:24:17.257 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[17] 0.010000 - 0.020000 : 1774798 2024-09-21T03:24:17.257 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[18] 0.000000 - 0.010000 : 2636281 2024-09-21T03:24:17.257 INFO:tasks.workunit.client.1.smithi149.stdout: 2024-09-21T03:24:17.257 INFO:tasks.workunit.client.1.smithi149.stdout:[ lseek] 0.000000 0.002203 93.594002 4622080 2024-09-21T03:24:17.258 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-21T03:24:17.258 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-21T03:24:17.258 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-21T03:24:17.258 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-21T03:24:17.258 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-21T03:24:17.258 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-21T03:24:17.258 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[6] 50.000000 - 100.000000 : 12 2024-09-21T03:24:17.258 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[7] 20.000000 - 50.000000 : 32 2024-09-21T03:24:17.258 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[8] 10.000000 - 20.000000 : 65 2024-09-21T03:24:17.258 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[9] 5.000000 - 10.000000 : 134 2024-09-21T03:24:17.258 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[10] 2.000000 - 5.000000 : 316 2024-09-21T03:24:17.258 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[11] 1.000000 - 2.000000 : 210 2024-09-21T03:24:17.258 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[12] 0.500000 - 1.000000 : 221 2024-09-21T03:24:17.258 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[13] 0.200000 - 0.500000 : 354 2024-09-21T03:24:17.258 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[14] 0.100000 - 0.200000 : 347 2024-09-21T03:24:17.259 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[15] 0.050000 - 0.100000 : 705 2024-09-21T03:24:17.259 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[16] 0.020000 - 0.050000 : 2429 2024-09-21T03:24:17.259 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[17] 0.010000 - 0.020000 : 3256 2024-09-21T03:24:17.259 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[18] 0.000000 - 0.010000 : 4613999 2024-09-21T03:24:17.259 INFO:tasks.workunit.client.1.smithi149.stdout: 2024-09-21T03:24:17.259 INFO:tasks.workunit.client.1.smithi149.stdout:[ close] 0.004000 0.017417 12.021000 3611 2024-09-21T03:24:17.259 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-21T03:24:17.259 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-21T03:24:17.259 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-21T03:24:17.259 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-21T03:24:17.259 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-21T03:24:17.259 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-21T03:24:17.259 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-21T03:24:17.259 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-09-21T03:24:17.259 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[8] 10.000000 - 20.000000 : 1 2024-09-21T03:24:17.260 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[9] 5.000000 - 10.000000 : 1 2024-09-21T03:24:17.260 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[10] 2.000000 - 5.000000 : 2 2024-09-21T03:24:17.260 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[11] 1.000000 - 2.000000 : 1 2024-09-21T03:24:17.260 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[12] 0.500000 - 1.000000 : 3 2024-09-21T03:24:17.260 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[13] 0.200000 - 0.500000 : 2 2024-09-21T03:24:17.260 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[14] 0.100000 - 0.200000 : 6 2024-09-21T03:24:17.260 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[15] 0.050000 - 0.100000 : 4 2024-09-21T03:24:17.260 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[16] 0.020000 - 0.050000 : 29 2024-09-21T03:24:17.260 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[17] 0.010000 - 0.020000 : 1805 2024-09-21T03:24:17.260 INFO:tasks.workunit.client.1.smithi149.stdout: msec_range[18] 0.000000 - 0.010000 : 1757 2024-09-21T03:24:17.260 INFO:tasks.workunit.client.1.smithi149.stdout: 2024-09-21T03:24:17.260 INFO:tasks.workunit.client.1.smithi149.stdout: 2024-09-21T03:24:17.260 INFO:tasks.workunit.client.1.smithi149.stdout: 2024-09-21T03:24:17.260 INFO:tasks.workunit.client.1.smithi149.stdout: 2024-09-21T03:24:17.260 INFO:tasks.workunit.client.1.smithi149.stdout:0.8% User Time 2024-09-21T03:24:17.261 INFO:tasks.workunit.client.1.smithi149.stdout:15.2% System Time 2024-09-21T03:24:17.261 INFO:tasks.workunit.client.1.smithi149.stdout:16.1% CPU Utilization 2024-09-21T03:24:17.266 INFO:tasks.workunit.client.1.smithi149.stderr:+ cd .. 2024-09-21T03:24:17.268 INFO:tasks.workunit.client.1.smithi149.stderr:+ rm -r tmp ffsb 2024-09-21T03:24:18.363 INFO:tasks.workunit.client.0.smithi090.stdout:Syncing()...53 sec 2024-09-21T03:24:18.363 INFO:tasks.workunit.client.0.smithi090.stdout:FFSB benchmark finished at: Sat Sep 21 03:24:18 2024 2024-09-21T03:24:18.363 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-09-21T03:24:18.363 INFO:tasks.workunit.client.0.smithi090.stdout:Results: 2024-09-21T03:24:18.363 INFO:tasks.workunit.client.0.smithi090.stdout:Benchmark took 361.70 sec 2024-09-21T03:24:18.363 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-09-21T03:24:18.364 INFO:tasks.workunit.client.0.smithi090.stdout:Total Results 2024-09-21T03:24:18.364 INFO:tasks.workunit.client.0.smithi090.stdout:=============== 2024-09-21T03:24:18.364 INFO:tasks.workunit.client.0.smithi090.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-09-21T03:24:18.364 INFO:tasks.workunit.client.0.smithi090.stdout: ======= ============ ========= ======= =========== ========== 2024-09-21T03:24:18.364 INFO:tasks.workunit.client.0.smithi090.stdout: write : 9303040 25720.40 100.000% 100.000% 100MB/sec 2024-09-21T03:24:18.364 INFO:tasks.workunit.client.0.smithi090.stdout:- 2024-09-21T03:24:18.364 INFO:tasks.workunit.client.0.smithi090.stdout:25720.40 Transactions per Second 2024-09-21T03:24:18.364 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-09-21T03:24:18.364 INFO:tasks.workunit.client.0.smithi090.stdout:Throughput Results 2024-09-21T03:24:18.364 INFO:tasks.workunit.client.0.smithi090.stdout:=================== 2024-09-21T03:24:18.364 INFO:tasks.workunit.client.0.smithi090.stdout:Write Throughput: 100MB/sec 2024-09-21T03:24:18.446 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-09-21T03:24:18.447 INFO:tasks.workunit.client.0.smithi090.stdout:System Call Latency statistics in millisecs 2024-09-21T03:24:18.447 INFO:tasks.workunit.client.0.smithi090.stdout:===== 2024-09-21T03:24:18.447 INFO:tasks.workunit.client.0.smithi090.stdout: Min Avg Max Total Calls 2024-09-21T03:24:18.447 INFO:tasks.workunit.client.0.smithi090.stdout: ======== ======== ======== ============ 2024-09-21T03:24:18.447 INFO:tasks.workunit.client.0.smithi090.stdout:[ open] 0.016000 0.120155 111.083000 7268 2024-09-21T03:24:18.447 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-21T03:24:18.447 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-21T03:24:18.447 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-21T03:24:18.447 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-21T03:24:18.447 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-21T03:24:18.447 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[5] 100.000000 - 200.000000 : 1 2024-09-21T03:24:18.448 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-21T03:24:18.448 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[7] 20.000000 - 50.000000 : 3 2024-09-21T03:24:18.448 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[8] 10.000000 - 20.000000 : 4 2024-09-21T03:24:18.448 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[9] 5.000000 - 10.000000 : 16 2024-09-21T03:24:18.448 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[10] 2.000000 - 5.000000 : 34 2024-09-21T03:24:18.448 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[11] 1.000000 - 2.000000 : 28 2024-09-21T03:24:18.448 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[12] 0.500000 - 1.000000 : 41 2024-09-21T03:24:18.448 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[13] 0.200000 - 0.500000 : 44 2024-09-21T03:24:18.448 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[14] 0.100000 - 0.200000 : 166 2024-09-21T03:24:18.448 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[15] 0.050000 - 0.100000 : 570 2024-09-21T03:24:18.448 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[16] 0.020000 - 0.050000 : 6358 2024-09-21T03:24:18.448 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[17] 0.010000 - 0.020000 : 3 2024-09-21T03:24:18.448 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-21T03:24:18.448 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-09-21T03:24:18.448 INFO:tasks.workunit.client.0.smithi090.stdout:[ write] 0.003000 1.038412 48167.687500 9303040 2024-09-21T03:24:18.449 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[0] 5000.000000 - 10000.000000 : 155 2024-09-21T03:24:18.449 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[1] 2000.000000 - 5000.000000 : 555 2024-09-21T03:24:18.449 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[2] 1000.000000 - 2000.000000 : 387 2024-09-21T03:24:18.449 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[3] 500.000000 - 1000.000000 : 333 2024-09-21T03:24:18.449 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[4] 200.000000 - 500.000000 : 2587 2024-09-21T03:24:18.449 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[5] 100.000000 - 200.000000 : 5974 2024-09-21T03:24:18.449 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[6] 50.000000 - 100.000000 : 38916 2024-09-21T03:24:18.449 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[7] 20.000000 - 50.000000 : 7095 2024-09-21T03:24:18.449 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[8] 10.000000 - 20.000000 : 1640 2024-09-21T03:24:18.449 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[9] 5.000000 - 10.000000 : 2277 2024-09-21T03:24:18.449 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[10] 2.000000 - 5.000000 : 5678 2024-09-21T03:24:18.449 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[11] 1.000000 - 2.000000 : 4720 2024-09-21T03:24:18.449 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[12] 0.500000 - 1.000000 : 4627 2024-09-21T03:24:18.449 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[13] 0.200000 - 0.500000 : 6567 2024-09-21T03:24:18.450 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[14] 0.100000 - 0.200000 : 7998 2024-09-21T03:24:18.450 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[15] 0.050000 - 0.100000 : 18849 2024-09-21T03:24:18.450 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[16] 0.020000 - 0.050000 : 73010 2024-09-21T03:24:18.450 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[17] 0.010000 - 0.020000 : 682343 2024-09-21T03:24:18.450 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[18] 0.000000 - 0.010000 : 8439275 2024-09-21T03:24:18.450 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-09-21T03:24:18.450 INFO:tasks.workunit.client.0.smithi090.stdout:[ lseek] 0.000000 0.002101 113.844002 9303040 2024-09-21T03:24:18.450 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-21T03:24:18.450 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-21T03:24:18.450 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-21T03:24:18.450 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-21T03:24:18.450 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-21T03:24:18.450 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[5] 100.000000 - 200.000000 : 1 2024-09-21T03:24:18.450 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[6] 50.000000 - 100.000000 : 21 2024-09-21T03:24:18.451 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[7] 20.000000 - 50.000000 : 74 2024-09-21T03:24:18.451 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[8] 10.000000 - 20.000000 : 105 2024-09-21T03:24:18.451 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[9] 5.000000 - 10.000000 : 193 2024-09-21T03:24:18.451 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[10] 2.000000 - 5.000000 : 533 2024-09-21T03:24:18.451 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[11] 1.000000 - 2.000000 : 458 2024-09-21T03:24:18.451 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[12] 0.500000 - 1.000000 : 437 2024-09-21T03:24:18.451 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[13] 0.200000 - 0.500000 : 595 2024-09-21T03:24:18.451 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[14] 0.100000 - 0.200000 : 720 2024-09-21T03:24:18.451 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[15] 0.050000 - 0.100000 : 1558 2024-09-21T03:24:18.451 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[16] 0.020000 - 0.050000 : 4714 2024-09-21T03:24:18.451 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[17] 0.010000 - 0.020000 : 5501 2024-09-21T03:24:18.451 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[18] 0.000000 - 0.010000 : 9288130 2024-09-21T03:24:18.451 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-09-21T03:24:18.451 INFO:tasks.workunit.client.0.smithi090.stdout:[ close] 0.003000 0.026495 52.019001 7268 2024-09-21T03:24:18.452 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-21T03:24:18.452 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-21T03:24:18.452 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-21T03:24:18.452 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-21T03:24:18.452 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-21T03:24:18.452 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-21T03:24:18.452 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[6] 50.000000 - 100.000000 : 1 2024-09-21T03:24:18.452 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[7] 20.000000 - 50.000000 : 1 2024-09-21T03:24:18.452 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[8] 10.000000 - 20.000000 : 1 2024-09-21T03:24:18.452 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[9] 5.000000 - 10.000000 : 2 2024-09-21T03:24:18.452 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[10] 2.000000 - 5.000000 : 4 2024-09-21T03:24:18.452 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[11] 1.000000 - 2.000000 : 3 2024-09-21T03:24:18.452 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[12] 0.500000 - 1.000000 : 2 2024-09-21T03:24:18.452 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[13] 0.200000 - 0.500000 : 1 2024-09-21T03:24:18.453 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[14] 0.100000 - 0.200000 : 5 2024-09-21T03:24:18.453 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[15] 0.050000 - 0.100000 : 10 2024-09-21T03:24:18.453 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[16] 0.020000 - 0.050000 : 44 2024-09-21T03:24:18.453 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[17] 0.010000 - 0.020000 : 4201 2024-09-21T03:24:18.453 INFO:tasks.workunit.client.0.smithi090.stdout: msec_range[18] 0.000000 - 0.010000 : 2993 2024-09-21T03:24:18.453 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-09-21T03:24:18.453 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-09-21T03:24:18.453 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-09-21T03:24:18.453 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-09-21T03:24:18.453 INFO:tasks.workunit.client.0.smithi090.stdout:1.7% User Time 2024-09-21T03:24:18.453 INFO:tasks.workunit.client.0.smithi090.stdout:25.3% System Time 2024-09-21T03:24:18.453 INFO:tasks.workunit.client.0.smithi090.stdout:26.9% CPU Utilization 2024-09-21T03:24:18.464 INFO:tasks.workunit.client.0.smithi090.stderr:+ cd .. 2024-09-21T03:24:18.468 INFO:tasks.workunit.client.0.smithi090.stderr:+ rm -r tmp ffsb 2024-09-21T03:24:25.327 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-21T03:24:25.327 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-21T03:24:25.328 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-21T03:24:25.332 INFO:tasks.ceph.mon.b:Started 2024-09-21T03:24:25.332 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-21T03:24:25.333 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:24:25.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.698+0000 7ff59f600640 1 -- 172.21.15.90:0/170512347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59815b650 msgr2=0x7ff59815da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:25.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.698+0000 7ff59f600640 1 --2- 172.21.15.90:0/170512347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59815b650 0x7ff59815da70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff5980c4920 tx=0x7ff58802e7b0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.698+0000 7ff59f600640 1 -- 172.21.15.90:0/170512347 shutdown_connections 2024-09-21T03:24:25.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.698+0000 7ff59f600640 1 --2- 172.21.15.90:0/170512347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59815b650 0x7ff59815da70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.698+0000 7ff59f600640 1 --2- 172.21.15.90:0/170512347 >> v2:172.21.15.149:3300/0 conn(0x7ff59806ef00 0x7ff59806f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.698+0000 7ff59f600640 1 -- 172.21.15.90:0/170512347 >> 172.21.15.90:0/170512347 conn(0x7ff5980c8ba0 msgr2=0x7ff59806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:25.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.702+0000 7ff59f600640 1 -- 172.21.15.90:0/170512347 shutdown_connections 2024-09-21T03:24:25.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.702+0000 7ff59f600640 1 -- 172.21.15.90:0/170512347 wait complete. 2024-09-21T03:24:25.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.706+0000 7ff59f600640 1 Processor -- start 2024-09-21T03:24:25.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.706+0000 7ff59f600640 1 -- start start 2024-09-21T03:24:25.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.708+0000 7ff59f600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff59806ef00 0x7ff598158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:25.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.708+0000 7ff59f600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff598150320 0x7ff598156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:25.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.708+0000 7ff59f600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59815b650 0x7ff59814a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:25.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.708+0000 7ff59f600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff59806f850 con 0x7ff59815b650 2024-09-21T03:24:25.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.708+0000 7ff59f600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff5980ad720 con 0x7ff59806ef00 2024-09-21T03:24:25.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.708+0000 7ff59f600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff598153ab0 con 0x7ff598150320 2024-09-21T03:24:25.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.709+0000 7ff59d600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59815b650 0x7ff59814a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:25.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.709+0000 7ff59d600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59815b650 0x7ff59814a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35758/0 (socket says 172.21.15.90:35758) 2024-09-21T03:24:25.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.709+0000 7ff59d600640 1 -- 172.21.15.90:0/2919577843 learned_addr learned my addr 172.21.15.90:0/2919577843 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:25.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.710+0000 7ff597e00640 1 --2- 172.21.15.90:0/2919577843 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff598150320 0x7ff598156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:25.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.710+0000 7ff59d600640 1 -- 172.21.15.90:0/2919577843 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff598150320 msgr2=0x7ff598156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:25.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.710+0000 7ff59d600640 1 --2- 172.21.15.90:0/2919577843 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff598150320 0x7ff598156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.710+0000 7ff59d600640 1 -- 172.21.15.90:0/2919577843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff59806ef00 msgr2=0x7ff598158950 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:24:25.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.710+0000 7ff59d600640 1 --2- 172.21.15.90:0/2919577843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff59806ef00 0x7ff598158950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.710+0000 7ff59d600640 1 -- 172.21.15.90:0/2919577843 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff598158000 con 0x7ff59815b650 2024-09-21T03:24:25.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.711+0000 7ff59d600640 1 --2- 172.21.15.90:0/2919577843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59815b650 0x7ff59814a970 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff58802e390 tx=0x7ff588003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:25.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.713+0000 7ff594c00640 1 -- 172.21.15.90:0/2919577843 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff588044070 con 0x7ff59815b650 2024-09-21T03:24:25.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.713+0000 7ff594c00640 1 -- 172.21.15.90:0/2919577843 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff588003ba0 con 0x7ff59815b650 2024-09-21T03:24:25.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.713+0000 7ff594c00640 1 -- 172.21.15.90:0/2919577843 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff588044070 con 0x7ff59815b650 2024-09-21T03:24:25.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.713+0000 7ff59f600640 1 -- 172.21.15.90:0/2919577843 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff59814b7f0 con 0x7ff59815b650 2024-09-21T03:24:25.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.713+0000 7ff59f600640 1 -- 172.21.15.90:0/2919577843 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5981541e0 con 0x7ff59815b650 2024-09-21T03:24:25.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.719+0000 7ff59f600640 1 -- 172.21.15.90:0/2919577843 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff598157a10 con 0x7ff59815b650 2024-09-21T03:24:25.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.720+0000 7ff594c00640 1 -- 172.21.15.90:0/2919577843 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff588047070 con 0x7ff59815b650 2024-09-21T03:24:25.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.725+0000 7ff594c00640 1 --2- 172.21.15.90:0/2919577843 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff574078f90 0x7ff57407b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:25.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.725+0000 7ff594c00640 1 -- 172.21.15.90:0/2919577843 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7ff58803b040 con 0x7ff59815b650 2024-09-21T03:24:25.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.727+0000 7ff59cc00640 1 --2- 172.21.15.90:0/2919577843 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff574078f90 0x7ff57407b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:25.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.731+0000 7ff594c00640 1 -- 172.21.15.90:0/2919577843 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff588087b10 con 0x7ff59815b650 2024-09-21T03:24:25.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:25.733+0000 7ff59cc00640 1 --2- 172.21.15.90:0/2919577843 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff574078f90 0x7ff57407b4a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff59000abb0 tx=0x7ff590009250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:25.766 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T03:24:25.766 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T03:24:25.916 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T03:24:25.916 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-21T03:24:25.934 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-09-21T03:24:25.935 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T03:24:26.080 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.1... 2024-09-21T03:24:26.080 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-21T03:24:26.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:26.292+0000 7ff59f600640 1 -- 172.21.15.90:0/2919577843 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff598074fc0 con 0x7ff59815b650 2024-09-21T03:24:26.296 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":68,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:24:26.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:26.293+0000 7ff594c00640 1 -- 172.21.15.90:0/2919577843 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7ff588087410 con 0x7ff59815b650 2024-09-21T03:24:26.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:26.296+0000 7ff59f600640 1 -- 172.21.15.90:0/2919577843 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff574078f90 msgr2=0x7ff57407b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:26.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:26.296+0000 7ff59f600640 1 --2- 172.21.15.90:0/2919577843 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff574078f90 0x7ff57407b4a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff59000abb0 tx=0x7ff590009250 comp rx=0 tx=0).stop 2024-09-21T03:24:26.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:26.296+0000 7ff59f600640 1 -- 172.21.15.90:0/2919577843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59815b650 msgr2=0x7ff59814a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:26.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:26.296+0000 7ff59f600640 1 --2- 172.21.15.90:0/2919577843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59815b650 0x7ff59814a970 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff58802e390 tx=0x7ff588003820 comp rx=0 tx=0).stop 2024-09-21T03:24:26.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:26.297+0000 7ff59f600640 1 -- 172.21.15.90:0/2919577843 shutdown_connections 2024-09-21T03:24:26.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:26.297+0000 7ff59f600640 1 --2- 172.21.15.90:0/2919577843 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff574078f90 0x7ff57407b4a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:26.297+0000 7ff59f600640 1 --2- 172.21.15.90:0/2919577843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59815b650 0x7ff59814a970 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:26.297+0000 7ff59f600640 1 --2- 172.21.15.90:0/2919577843 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff598150320 0x7ff598156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:26.297+0000 7ff59f600640 1 --2- 172.21.15.90:0/2919577843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff59806ef00 0x7ff598158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:26.297+0000 7ff59f600640 1 -- 172.21.15.90:0/2919577843 >> 172.21.15.90:0/2919577843 conn(0x7ff5980c8ba0 msgr2=0x7ff59814c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:26.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:26.297+0000 7ff59f600640 1 -- 172.21.15.90:0/2919577843 shutdown_connections 2024-09-21T03:24:26.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:26.297+0000 7ff59f600640 1 -- 172.21.15.90:0/2919577843 wait complete. 2024-09-21T03:24:27.547 DEBUG:teuthology.parallel:result is None 2024-09-21T03:24:27.574 DEBUG:teuthology.parallel:result is None 2024-09-21T03:24:27.574 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T03:24:27.663 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T03:24:27.663 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-21T03:24:27.748 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-21T03:24:27.748 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-09-21T03:24:27.759 INFO:tasks.mon_thrash:joining mon_thrasher 2024-09-21T03:24:29.345 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:24:29.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.736+0000 7f9264400640 1 -- 172.21.15.90:0/3438482006 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f925c072880 msgr2=0x7f925c14b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:29.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.736+0000 7f9264400640 1 --2- 172.21.15.90:0/3438482006 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f925c072880 0x7f925c14b100 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9250005fd0 tx=0x7f925002a4b0 comp rx=0 tx=0).stop 2024-09-21T03:24:29.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.736+0000 7f9264400640 1 -- 172.21.15.90:0/3438482006 shutdown_connections 2024-09-21T03:24:29.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.736+0000 7f9264400640 1 --2- 172.21.15.90:0/3438482006 >> v2:172.21.15.149:3300/0 conn(0x7f925c0c7100 0x7f925c0c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:29.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.736+0000 7f9264400640 1 --2- 172.21.15.90:0/3438482006 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f925c072880 0x7f925c14b100 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:29.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.736+0000 7f9264400640 1 -- 172.21.15.90:0/3438482006 >> 172.21.15.90:0/3438482006 conn(0x7f925c06d410 msgr2=0x7f925c0ac020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:29.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.739+0000 7f9264400640 1 -- 172.21.15.90:0/3438482006 shutdown_connections 2024-09-21T03:24:29.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.739+0000 7f9264400640 1 -- 172.21.15.90:0/3438482006 wait complete. 2024-09-21T03:24:29.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.745+0000 7f9264400640 1 Processor -- start 2024-09-21T03:24:29.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.746+0000 7f9264400640 1 -- start start 2024-09-21T03:24:29.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.748+0000 7f9264400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f925c072880 0x7f925c0c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:29.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.748+0000 7f9264400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c0c7100 0x7f925c156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:29.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.748+0000 7f9264400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f925c14b640 0x7f925c0a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:29.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.748+0000 7f9264400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f925c072c90 con 0x7f925c0c7100 2024-09-21T03:24:29.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.748+0000 7f9264400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f925c0c7510 con 0x7f925c14b640 2024-09-21T03:24:29.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.748+0000 7f9264400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f925c0aac90 con 0x7f925c072880 2024-09-21T03:24:29.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.750+0000 7f9261000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c0c7100 0x7f925c156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:29.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.750+0000 7f9261000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c0c7100 0x7f925c156530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35762/0 (socket says 172.21.15.90:35762) 2024-09-21T03:24:29.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.750+0000 7f9261000640 1 -- 172.21.15.90:0/916931851 learned_addr learned my addr 172.21.15.90:0/916931851 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:29.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.750+0000 7f9261a00640 1 --2- 172.21.15.90:0/916931851 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f925c072880 0x7f925c0c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:29.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.750+0000 7f9261000640 1 -- 172.21.15.90:0/916931851 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f925c072880 msgr2=0x7f925c0c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:29.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.750+0000 7f9261000640 1 --2- 172.21.15.90:0/916931851 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f925c072880 0x7f925c0c3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:29.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.750+0000 7f9261000640 1 -- 172.21.15.90:0/916931851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f925c14b640 msgr2=0x7f925c0a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:29.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.750+0000 7f9262400640 1 --2- 172.21.15.90:0/916931851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f925c14b640 0x7f925c0a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:29.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.751+0000 7f9261000640 1 --2- 172.21.15.90:0/916931851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f925c14b640 0x7f925c0a9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:29.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.751+0000 7f9261000640 1 -- 172.21.15.90:0/916931851 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f925c0c02b0 con 0x7f925c0c7100 2024-09-21T03:24:29.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.751+0000 7f9262400640 1 --2- 172.21.15.90:0/916931851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f925c14b640 0x7f925c0a9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:24:29.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.751+0000 7f9261000640 1 --2- 172.21.15.90:0/916931851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c0c7100 0x7f925c156530 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f924800c3a0 tx=0x7f924800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:29.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.752+0000 7f9259600640 1 -- 172.21.15.90:0/916931851 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9248017070 con 0x7f925c0c7100 2024-09-21T03:24:29.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.752+0000 7f9259600640 1 -- 172.21.15.90:0/916931851 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92480035f0 con 0x7f925c0c7100 2024-09-21T03:24:29.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.752+0000 7f9259600640 1 -- 172.21.15.90:0/916931851 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9248003a40 con 0x7f925c0c7100 2024-09-21T03:24:29.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.754+0000 7f9264400640 1 -- 172.21.15.90:0/916931851 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f925c14a870 con 0x7f925c0c7100 2024-09-21T03:24:29.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.754+0000 7f9264400640 1 -- 172.21.15.90:0/916931851 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f925c1585e0 con 0x7f925c0c7100 2024-09-21T03:24:29.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.756+0000 7f9264400640 1 -- 172.21.15.90:0/916931851 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f925c155a30 con 0x7f925c0c7100 2024-09-21T03:24:29.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.759+0000 7f9259600640 1 -- 172.21.15.90:0/916931851 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f924801a070 con 0x7f925c0c7100 2024-09-21T03:24:29.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.761+0000 7f9259600640 1 --2- 172.21.15.90:0/916931851 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f923c078bc0 0x7f923c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:29.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.761+0000 7f9259600640 1 -- 172.21.15.90:0/916931851 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f924809a330 con 0x7f925c0c7100 2024-09-21T03:24:29.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.765+0000 7f9261a00640 1 --2- 172.21.15.90:0/916931851 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f923c078bc0 0x7f923c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:29.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.767+0000 7f9261a00640 1 --2- 172.21.15.90:0/916931851 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f923c078bc0 0x7f923c07b0d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9250033000 tx=0x7f9250004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:29.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:29.775+0000 7f9259600640 1 -- 172.21.15.90:0/916931851 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f92480624d0 con 0x7f925c0c7100 2024-09-21T03:24:30.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.250+0000 7f9264400640 1 -- 172.21.15.90:0/916931851 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f925c072e10 con 0x7f925c0c7100 2024-09-21T03:24:30.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.255+0000 7f9259600640 1 -- 172.21.15.90:0/916931851 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f9248061dd0 con 0x7f925c0c7100 2024-09-21T03:24:30.257 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:24:30.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.260+0000 7f9264400640 1 -- 172.21.15.90:0/916931851 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f923c078bc0 msgr2=0x7f923c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:30.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.260+0000 7f9264400640 1 --2- 172.21.15.90:0/916931851 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f923c078bc0 0x7f923c07b0d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9250033000 tx=0x7f9250004730 comp rx=0 tx=0).stop 2024-09-21T03:24:30.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.260+0000 7f9264400640 1 -- 172.21.15.90:0/916931851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c0c7100 msgr2=0x7f925c156530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:30.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.260+0000 7f9264400640 1 --2- 172.21.15.90:0/916931851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c0c7100 0x7f925c156530 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f924800c3a0 tx=0x7f924800c860 comp rx=0 tx=0).stop 2024-09-21T03:24:30.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.261+0000 7f9264400640 1 -- 172.21.15.90:0/916931851 shutdown_connections 2024-09-21T03:24:30.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.261+0000 7f9264400640 1 --2- 172.21.15.90:0/916931851 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f923c078bc0 0x7f923c07b0d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.261+0000 7f9264400640 1 --2- 172.21.15.90:0/916931851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f925c14b640 0x7f925c0a9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.261+0000 7f9264400640 1 --2- 172.21.15.90:0/916931851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c0c7100 0x7f925c156530 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.261+0000 7f9264400640 1 --2- 172.21.15.90:0/916931851 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f925c072880 0x7f925c0c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.261+0000 7f9264400640 1 -- 172.21.15.90:0/916931851 >> 172.21.15.90:0/916931851 conn(0x7f925c06d410 msgr2=0x7f925c0c8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:30.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.261+0000 7f9264400640 1 -- 172.21.15.90:0/916931851 shutdown_connections 2024-09-21T03:24:30.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.261+0000 7f9264400640 1 -- 172.21.15.90:0/916931851 wait complete. 2024-09-21T03:24:30.307 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-21T03:24:30.307 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-21T03:24:30.307 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-21T03:24:30.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.698+0000 7fd530800640 1 -- 172.21.15.90:0/2493843349 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd528155300 msgr2=0x7fd5280735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:30.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.698+0000 7fd530800640 1 --2- 172.21.15.90:0/2493843349 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd528155300 0x7fd5280735f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd518005fd0 tx=0x7fd51802a5d0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.699+0000 7fd530800640 1 -- 172.21.15.90:0/2493843349 shutdown_connections 2024-09-21T03:24:30.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.699+0000 7fd530800640 1 --2- 172.21.15.90:0/2493843349 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd528155300 0x7fd5280735f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.699+0000 7fd530800640 1 --2- 172.21.15.90:0/2493843349 >> v2:172.21.15.149:3300/0 conn(0x7fd52806ede0 0x7fd5280c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.699+0000 7fd530800640 1 -- 172.21.15.90:0/2493843349 >> 172.21.15.90:0/2493843349 conn(0x7fd5280c85a0 msgr2=0x7fd5280c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:30.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.700+0000 7fd530800640 1 -- 172.21.15.90:0/2493843349 shutdown_connections 2024-09-21T03:24:30.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.700+0000 7fd530800640 1 -- 172.21.15.90:0/2493843349 wait complete. 2024-09-21T03:24:30.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.706+0000 7fd530800640 1 Processor -- start 2024-09-21T03:24:30.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.713+0000 7fd530800640 1 -- start start 2024-09-21T03:24:30.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.715+0000 7fd530800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd52806ede0 0x7fd528148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:30.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.715+0000 7fd530800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd528155300 0x7fd5281f1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:30.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.715+0000 7fd530800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd52815e640 0x7fd528150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:30.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.716+0000 7fd530800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd528073cb0 con 0x7fd52806ede0 2024-09-21T03:24:30.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.716+0000 7fd530800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd528073b30 con 0x7fd528155300 2024-09-21T03:24:30.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.716+0000 7fd530800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd52806f3a0 con 0x7fd52815e640 2024-09-21T03:24:30.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.716+0000 7fd52d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd528155300 0x7fd5281f1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:30.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.716+0000 7fd52e800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd52815e640 0x7fd528150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:30.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.716+0000 7fd52e800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd52815e640 0x7fd528150a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:56180/0 (socket says 172.21.15.90:56180) 2024-09-21T03:24:30.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.716+0000 7fd52e800640 1 -- 172.21.15.90:0/2009719222 learned_addr learned my addr 172.21.15.90:0/2009719222 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:30.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.717+0000 7fd52de00640 1 --2- 172.21.15.90:0/2009719222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd52806ede0 0x7fd528148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:30.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.717+0000 7fd52e800640 1 -- 172.21.15.90:0/2009719222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd528155300 msgr2=0x7fd5281f1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:30.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.717+0000 7fd52e800640 1 --2- 172.21.15.90:0/2009719222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd528155300 0x7fd5281f1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.717+0000 7fd52e800640 1 -- 172.21.15.90:0/2009719222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd52806ede0 msgr2=0x7fd528148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:30.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.717+0000 7fd52e800640 1 --2- 172.21.15.90:0/2009719222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd52806ede0 0x7fd528148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.717+0000 7fd52e800640 1 -- 172.21.15.90:0/2009719222 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5280c7ec0 con 0x7fd52815e640 2024-09-21T03:24:30.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.720+0000 7fd52de00640 1 --2- 172.21.15.90:0/2009719222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd52806ede0 0x7fd528148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:24:30.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.721+0000 7fd52e800640 1 --2- 172.21.15.90:0/2009719222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd52815e640 0x7fd528150a20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd52400c6b0 tx=0x7fd52400cb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:30.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.721+0000 7fd522000640 1 -- 172.21.15.90:0/2009719222 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524003b70 con 0x7fd52815e640 2024-09-21T03:24:30.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.722+0000 7fd522000640 1 -- 172.21.15.90:0/2009719222 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd524003d30 con 0x7fd52815e640 2024-09-21T03:24:30.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.722+0000 7fd522000640 1 -- 172.21.15.90:0/2009719222 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524005330 con 0x7fd52815e640 2024-09-21T03:24:30.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.722+0000 7fd530800640 1 -- 172.21.15.90:0/2009719222 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5281f5570 con 0x7fd52815e640 2024-09-21T03:24:30.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.722+0000 7fd530800640 1 -- 172.21.15.90:0/2009719222 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5281f1950 con 0x7fd52815e640 2024-09-21T03:24:30.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.724+0000 7fd530800640 1 --2- 172.21.15.90:0/2009719222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5280c6e40 0x7fd5280c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:30.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.724+0000 7fd530800640 1 -- 172.21.15.90:0/2009719222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd5280ad530 con 0x7fd5280c6e40 2024-09-21T03:24:30.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.726+0000 7fd52de00640 1 --2- 172.21.15.90:0/2009719222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5280c6e40 0x7fd5280c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:30.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.728+0000 7fd52de00640 1 -- 172.21.15.90:0/2009719222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd528149130 con 0x7fd5280c6e40 2024-09-21T03:24:30.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.729+0000 7fd52de00640 1 --2- 172.21.15.90:0/2009719222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5280c6e40 0x7fd5280c5da0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd51c005df0 tx=0x7fd51c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:30.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.730+0000 7fd522000640 1 -- 172.21.15.90:0/2009719222 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c00cb80 con 0x7fd5280c6e40 2024-09-21T03:24:30.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.733+0000 7fd522000640 1 -- 172.21.15.90:0/2009719222 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd51c00cd20 con 0x7fd5280c6e40 2024-09-21T03:24:30.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.733+0000 7fd522000640 1 -- 172.21.15.90:0/2009719222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5280c6e40 msgr2=0x7fd5280c5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:30.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.733+0000 7fd522000640 1 --2- 172.21.15.90:0/2009719222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5280c6e40 0x7fd5280c5da0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd51c005df0 tx=0x7fd51c00ee60 comp rx=0 tx=0).stop 2024-09-21T03:24:30.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.733+0000 7fd522000640 1 -- 172.21.15.90:0/2009719222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5280c6e40 msgr2=0x7fd5280c5da0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:24:30.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.733+0000 7fd522000640 1 --2- 172.21.15.90:0/2009719222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5280c6e40 0x7fd5280c5da0 secure :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd51c005df0 tx=0x7fd51c00ee60 comp rx=0 tx=0).stop 2024-09-21T03:24:30.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.733+0000 7fd522000640 1 -- 172.21.15.90:0/2009719222 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd5240054d0 con 0x7fd52815e640 2024-09-21T03:24:30.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.735+0000 7fd522000640 1 --2- 172.21.15.90:0/2009719222 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd50c0787e0 0x7fd50c07acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:30.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.735+0000 7fd522000640 1 -- 172.21.15.90:0/2009719222 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fd52409ada0 con 0x7fd52815e640 2024-09-21T03:24:30.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.737+0000 7fd52de00640 1 --2- 172.21.15.90:0/2009719222 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd50c0787e0 0x7fd50c07acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:30.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.738+0000 7fd52de00640 1 --2- 172.21.15.90:0/2009719222 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd50c0787e0 0x7fd50c07acf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd51c005df0 tx=0x7fd51c013000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:30.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.749+0000 7fd530800640 1 --2- 172.21.15.90:0/2009719222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd528149840 0x7fd5280c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:30.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.749+0000 7fd530800640 1 -- 172.21.15.90:0/2009719222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd52806fc50 con 0x7fd528149840 2024-09-21T03:24:30.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.750+0000 7fd52d400640 1 --2- 172.21.15.90:0/2009719222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd528149840 0x7fd5280c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:30.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.751+0000 7fd52d400640 1 -- 172.21.15.90:0/2009719222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd5281f1bb0 con 0x7fd528149840 2024-09-21T03:24:30.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.752+0000 7fd52d400640 1 --2- 172.21.15.90:0/2009719222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd528149840 0x7fd5280c62e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd5280754d0 tx=0x7fd518003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:30.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.753+0000 7fd522000640 1 -- 172.21.15.90:0/2009719222 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd518035040 con 0x7fd528149840 2024-09-21T03:24:30.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.755+0000 7fd522000640 1 -- 172.21.15.90:0/2009719222 <== mon.0 v2:172.21.15.90:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5195 (secure 0 0 0) 0x7fd518003e30 con 0x7fd528149840 2024-09-21T03:24:30.757 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:24:30.757 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:24:30.757 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:24:30.757 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "leader", 2024-09-21T03:24:30.757 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 70, 2024-09-21T03:24:30.757 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 314529, 2024-09-21T03:24:30.757 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:24:30.757 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:24:30.757 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:24:30.758 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:24:30.758 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:30.758 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 1, 2024-09-21T03:24:30.758 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:24:30.758 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:24:30.758 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:24:30.758 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:24:30.758 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:24:30.758 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:24:30.758 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:24:30.758 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:24:30.758 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:24:30.758 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:24:30.758 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:24:30.758 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:24:30.759 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:24:30.759 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:24:30.759 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:30.759 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:24:30.759 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:24:30.759 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:24:30.759 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:24:30.759 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:24:30.759 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:24:30.759 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:24:30.759 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:24:30.759 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:24:30.759 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:24:30.759 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:24:30.760 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:24:30.760 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:24:30.760 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:30.760 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:30.760 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:24:30.760 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:24:30.760 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:24:30.760 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:24:30.760 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:24:30.760 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:24:30.760 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:24:30.760 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:24:30.760 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:24:30.760 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:24:30.760 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:24:30.761 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:24:30.761 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:24:30.761 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:24:30.761 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:24:30.761 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:24:30.761 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:24:30.761 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:24:30.761 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:24:30.761 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:24:30.761 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:24:30.761 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:24:30.761 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:24:30.761 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:24:30.761 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:24:30.761 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:24:30.761 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:24:30.761 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:24:30.762 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:30.762 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:24:30.762 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:30.762 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:24:30.762 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:30.762 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:24:30.762 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:24:30.762 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:24:30.762 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:24:30.762 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:30.762 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:24:30.762 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:24:30.762 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:30.763 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:30.763 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:30.763 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:24:30.763 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:24:30.763 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:30.763 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:30.763 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:30.763 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:30.763 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:24:30.763 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:24:30.763 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:24:30.763 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:24:30.763 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:24:30.763 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:30.763 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:30.764 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:24:30.764 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:24:30.764 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:24:30.764 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:24:30.764 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:30.764 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:24:30.764 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:24:30.764 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:30.764 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:30.764 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:30.764 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:24:30.764 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:24:30.764 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:30.764 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:30.764 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:30.764 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:30.765 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:24:30.765 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:24:30.765 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:24:30.765 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:24:30.765 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:24:30.765 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:30.765 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:30.765 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:24:30.765 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:24:30.765 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:24:30.765 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:24:30.765 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:30.765 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:24:30.765 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:24:30.765 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:30.765 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:30.765 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:30.766 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:24:30.766 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:24:30.766 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:30.766 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:30.766 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:30.766 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:30.766 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:24:30.766 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:24:30.766 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:24:30.766 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:24:30.766 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:24:30.766 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:30.766 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:30.766 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:30.766 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:24:30.767 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:24:30.767 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:30.767 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:24:30.767 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:24:30.767 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:24:30.767 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:30.767 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:30.767 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": [ 2024-09-21T03:24:30.767 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:30.767 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:24:30.767 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:24:30.767 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4 2024-09-21T03:24:30.767 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:30.767 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:30.767 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": [ 2024-09-21T03:24:30.767 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:30.768 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:24:30.768 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:24:30.768 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 8 2024-09-21T03:24:30.768 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:30.768 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:30.768 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:24:30.768 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:30.768 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-21T03:24:30.768 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "luminous", 2024-09-21T03:24:30.768 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:24:30.768 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:30.768 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:30.768 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:24:30.768 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:24:30.768 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 5 2024-09-21T03:24:30.769 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:30.769 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:30.769 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": [ 2024-09-21T03:24:30.769 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:30.769 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:24:30.769 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:24:30.769 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 2 2024-09-21T03:24:30.769 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:30.769 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:30.769 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:30.769 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:24:30.769 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:24:30.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.755+0000 7fd522000640 1 -- 172.21.15.90:0/2009719222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd528149840 msgr2=0x7fd5280c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:30.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.755+0000 7fd522000640 1 --2- 172.21.15.90:0/2009719222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd528149840 0x7fd5280c62e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd5280754d0 tx=0x7fd518003820 comp rx=0 tx=0).stop 2024-09-21T03:24:30.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.755+0000 7fd522000640 1 -- 172.21.15.90:0/2009719222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd528149840 msgr2=0x7fd5280c62e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:24:30.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.755+0000 7fd522000640 1 --2- 172.21.15.90:0/2009719222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd528149840 0x7fd5280c62e0 secure :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd5280754d0 tx=0x7fd518003820 comp rx=0 tx=0).stop 2024-09-21T03:24:30.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.757+0000 7fd530800640 1 -- 172.21.15.90:0/2009719222 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd50c0787e0 msgr2=0x7fd50c07acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:30.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.757+0000 7fd530800640 1 --2- 172.21.15.90:0/2009719222 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd50c0787e0 0x7fd50c07acf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd51c005df0 tx=0x7fd51c013000 comp rx=0 tx=0).stop 2024-09-21T03:24:30.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.757+0000 7fd530800640 1 -- 172.21.15.90:0/2009719222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd52815e640 msgr2=0x7fd528150a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:30.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.757+0000 7fd530800640 1 --2- 172.21.15.90:0/2009719222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd52815e640 0x7fd528150a20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd52400c6b0 tx=0x7fd52400cb70 comp rx=0 tx=0).stop 2024-09-21T03:24:30.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.757+0000 7fd52e800640 1 -- 172.21.15.90:0/2009719222 reap_dead start 2024-09-21T03:24:30.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.758+0000 7fd52e800640 1 -- 172.21.15.90:0/2009719222 reap_dead start 2024-09-21T03:24:30.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.758+0000 7fd530800640 1 -- 172.21.15.90:0/2009719222 shutdown_connections 2024-09-21T03:24:30.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.758+0000 7fd530800640 1 -- 172.21.15.90:0/2009719222 >> 172.21.15.90:0/2009719222 conn(0x7fd5280c85a0 msgr2=0x7fd5280c3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:30.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.758+0000 7fd530800640 1 -- 172.21.15.90:0/2009719222 shutdown_connections 2024-09-21T03:24:30.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:30.758+0000 7fd530800640 1 -- 172.21.15.90:0/2009719222 wait complete. 2024-09-21T03:24:30.806 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:24:30.806 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-21T03:24:30.806 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-21T03:24:31.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.201+0000 7f9fd2600640 1 -- 172.21.15.90:0/2027117823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc156bc0 msgr2=0x7f9fcc149580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.202+0000 7f9fd2600640 1 --2- 172.21.15.90:0/2027117823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc156bc0 0x7f9fcc149580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc14d180 tx=0x7f9fbc02c2b0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.202+0000 7f9fd2600640 1 -- 172.21.15.90:0/2027117823 shutdown_connections 2024-09-21T03:24:31.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.202+0000 7f9fd2600640 1 --2- 172.21.15.90:0/2027117823 >> v2:172.21.15.90:3300/0 conn(0x7f9fcc0c5160 0x7f9fcc0c5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.202+0000 7f9fd2600640 1 --2- 172.21.15.90:0/2027117823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc156bc0 0x7f9fcc149580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.202+0000 7f9fd2600640 1 -- 172.21.15.90:0/2027117823 >> 172.21.15.90:0/2027117823 conn(0x7f9fcc06d200 msgr2=0x7f9fcc06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:31.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.203+0000 7f9fd2600640 1 -- 172.21.15.90:0/2027117823 shutdown_connections 2024-09-21T03:24:31.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.203+0000 7f9fd2600640 1 -- 172.21.15.90:0/2027117823 wait complete. 2024-09-21T03:24:31.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.208+0000 7f9fd2600640 1 Processor -- start 2024-09-21T03:24:31.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.208+0000 7f9fd2600640 1 -- start start 2024-09-21T03:24:31.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.211+0000 7f9fd2600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fcc0728e0 0x7f9fcc1ec2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.211+0000 7f9fd2600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc0c5160 0x7f9fcc0ac170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.211+0000 7f9fd2600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fcc156bc0 0x7f9fcc1dc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.211+0000 7f9fd2600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9fcc0aa690 con 0x7f9fcc0728e0 2024-09-21T03:24:31.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.212+0000 7f9fd2600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9fcc152f40 con 0x7f9fcc0c5160 2024-09-21T03:24:31.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.212+0000 7f9fd2600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9fcc156fd0 con 0x7f9fcc156bc0 2024-09-21T03:24:31.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.212+0000 7f9fd1200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fcc0728e0 0x7f9fcc1ec2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.212+0000 7f9fd1c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fcc156bc0 0x7f9fcc1dc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.212+0000 7f9fd1c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fcc156bc0 0x7f9fcc1dc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:56190/0 (socket says 172.21.15.90:56190) 2024-09-21T03:24:31.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.212+0000 7f9fd1c00640 1 -- 172.21.15.90:0/3142951400 learned_addr learned my addr 172.21.15.90:0/3142951400 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:31.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.213+0000 7f9fcbe00640 1 --2- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc0c5160 0x7f9fcc0ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.214+0000 7f9fd1c00640 1 -- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc0c5160 msgr2=0x7f9fcc0ac170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.214+0000 7f9fd1c00640 1 --2- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc0c5160 0x7f9fcc0ac170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.214+0000 7f9fd1c00640 1 -- 172.21.15.90:0/3142951400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fcc0728e0 msgr2=0x7f9fcc1ec2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.214+0000 7f9fd1c00640 1 --2- 172.21.15.90:0/3142951400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fcc0728e0 0x7f9fcc1ec2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.215+0000 7f9fd1c00640 1 -- 172.21.15.90:0/3142951400 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fcc0c75d0 con 0x7f9fcc156bc0 2024-09-21T03:24:31.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.215+0000 7f9fd1200640 1 --2- 172.21.15.90:0/3142951400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fcc0728e0 0x7f9fcc1ec2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:24:31.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.215+0000 7f9fd1c00640 1 --2- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fcc156bc0 0x7f9fcc1dc220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400ea40 tx=0x7f9fc400ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:31.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.216+0000 7f9fc8c00640 1 -- 172.21.15.90:0/3142951400 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc400cde0 con 0x7f9fcc156bc0 2024-09-21T03:24:31.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.216+0000 7f9fc8c00640 1 -- 172.21.15.90:0/3142951400 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fc4004b20 con 0x7f9fcc156bc0 2024-09-21T03:24:31.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.216+0000 7f9fc8c00640 1 -- 172.21.15.90:0/3142951400 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc40137d0 con 0x7f9fcc156bc0 2024-09-21T03:24:31.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.216+0000 7f9fd2600640 1 -- 172.21.15.90:0/3142951400 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fcc1e9bb0 con 0x7f9fcc156bc0 2024-09-21T03:24:31.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.216+0000 7f9fd2600640 1 -- 172.21.15.90:0/3142951400 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fcc1e98d0 con 0x7f9fcc156bc0 2024-09-21T03:24:31.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.220+0000 7f9fd2600640 1 --2- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc0c83b0 0x7f9fcc1ec7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.220+0000 7f9fd2600640 1 -- 172.21.15.90:0/3142951400 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9fcc1e9730 con 0x7f9fcc0c83b0 2024-09-21T03:24:31.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.222+0000 7f9fd1200640 1 --2- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc0c83b0 0x7f9fcc1ec7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.223+0000 7f9fc8c00640 1 -- 172.21.15.90:0/3142951400 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9fc4013a40 con 0x7f9fcc156bc0 2024-09-21T03:24:31.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.223+0000 7f9fd1200640 1 -- 172.21.15.90:0/3142951400 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9fcc0c8d90 con 0x7f9fcc0c83b0 2024-09-21T03:24:31.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.225+0000 7f9fd1200640 1 --2- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc0c83b0 0x7f9fcc1ec7e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400fae0 tx=0x7f9fb4001d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:31.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.225+0000 7f9fc8c00640 1 --2- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9fa8078b90 0x7f9fa807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.226+0000 7f9fc8c00640 1 -- 172.21.15.90:0/3142951400 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f9fc409fed0 con 0x7f9fcc156bc0 2024-09-21T03:24:31.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.228+0000 7f9fcbe00640 1 --2- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9fa8078b90 0x7f9fa807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.228+0000 7f9fc8c00640 1 -- 172.21.15.90:0/3142951400 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4018020 con 0x7f9fcc0c83b0 2024-09-21T03:24:31.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.229+0000 7f9fc8c00640 1 -- 172.21.15.90:0/3142951400 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9fb400d9a0 con 0x7f9fcc0c83b0 2024-09-21T03:24:31.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.229+0000 7f9fc8c00640 1 -- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc0c83b0 msgr2=0x7f9fcc1ec7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.229+0000 7f9fc8c00640 1 --2- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc0c83b0 0x7f9fcc1ec7e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400fae0 tx=0x7f9fb4001d80 comp rx=0 tx=0).stop 2024-09-21T03:24:31.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.229+0000 7f9fc8c00640 1 -- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc0c83b0 msgr2=0x7f9fcc1ec7e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:24:31.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.229+0000 7f9fc8c00640 1 --2- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc0c83b0 0x7f9fcc1ec7e0 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400fae0 tx=0x7f9fb4001d80 comp rx=0 tx=0).stop 2024-09-21T03:24:31.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.231+0000 7f9fcbe00640 1 --2- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9fa8078b90 0x7f9fa807b0a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc035000 tx=0x7f9fbc02e040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:31.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.243+0000 7f9fd2600640 1 --2- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc144760 0x7f9fcc1dc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.243+0000 7f9fd2600640 1 -- 172.21.15.90:0/3142951400 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9fcc150770 con 0x7f9fcc144760 2024-09-21T03:24:31.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.244+0000 7f9fd1200640 1 --2- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc144760 0x7f9fcc1dc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.245+0000 7f9fd1200640 1 -- 172.21.15.90:0/3142951400 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9fcc145220 con 0x7f9fcc144760 2024-09-21T03:24:31.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.246+0000 7f9fd1200640 1 --2- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc144760 0x7f9fcc1dc760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400fae0 tx=0x7f9fb4000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:31.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.246+0000 7f9fc8c00640 1 -- 172.21.15.90:0/3142951400 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4018030 con 0x7f9fcc144760 2024-09-21T03:24:31.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.247+0000 7f9fc8c00640 1 -- 172.21.15.90:0/3142951400 <== mon.1 v2:172.21.15.149:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4547 (secure 0 0 0) 0x7f9fb4014970 con 0x7f9fcc144760 2024-09-21T03:24:31.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.247+0000 7f9fc8c00640 1 -- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc144760 msgr2=0x7f9fcc1dc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.249 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:24:31.250 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:24:31.250 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:24:31.250 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:24:31.250 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 70, 2024-09-21T03:24:31.250 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 5370, 2024-09-21T03:24:31.250 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:24:31.250 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:24:31.250 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:24:31.250 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:24:31.250 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:31.250 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 1, 2024-09-21T03:24:31.250 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:24:31.250 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:24:31.251 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:24:31.251 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:24:31.251 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:24:31.251 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:24:31.251 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:24:31.251 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:24:31.251 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:24:31.251 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:24:31.251 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:24:31.251 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:24:31.251 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:24:31.251 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:24:31.251 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:31.251 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:24:31.252 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:24:31.252 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:24:31.252 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:24:31.252 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:24:31.252 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:24:31.252 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:24:31.252 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:24:31.252 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:24:31.252 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:24:31.252 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:24:31.252 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:24:31.252 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:24:31.252 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:31.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.253 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:24:31.253 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:24:31.253 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:24:31.253 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:24:31.253 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:24:31.253 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:24:31.253 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:24:31.253 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:24:31.253 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:24:31.253 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:24:31.253 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:24:31.253 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:24:31.253 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:24:31.253 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:24:31.253 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:24:31.254 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:24:31.254 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:24:31.254 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:24:31.254 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:24:31.254 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:24:31.254 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:24:31.254 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:24:31.254 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:24:31.254 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:24:31.254 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:24:31.254 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:24:31.254 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:24:31.254 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:24:31.255 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:31.255 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:24:31.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.255 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:24:31.255 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.255 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:24:31.255 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:24:31.255 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:24:31.255 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:24:31.255 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.255 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:24:31.255 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:24:31.255 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:31.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.255 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.256 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:24:31.256 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:24:31.256 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:31.256 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:31.256 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:31.256 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.256 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:24:31.256 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:24:31.256 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:24:31.256 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:24:31.256 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:24:31.256 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.256 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.256 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:24:31.257 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:24:31.257 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:24:31.257 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:24:31.257 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.257 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:24:31.257 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:24:31.257 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:31.257 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.257 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.257 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:24:31.257 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:24:31.257 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:31.257 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:31.257 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:31.257 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.258 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:24:31.258 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:24:31.258 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:24:31.258 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:24:31.258 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:24:31.258 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.258 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.258 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:24:31.258 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:24:31.258 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:24:31.258 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:24:31.258 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.258 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:24:31.258 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:24:31.258 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:31.259 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.259 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.259 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:24:31.259 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:24:31.259 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:31.259 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:31.259 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:31.259 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.259 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:24:31.259 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:24:31.259 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:24:31.259 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:24:31.259 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:24:31.259 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:31.260 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:31.260 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.260 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:24:31.260 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:24:31.260 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.260 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:24:31.260 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:24:31.260 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:24:31.260 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:31.260 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:31.260 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:24:31.260 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.260 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:24:31.260 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:24:31.261 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:24:31.261 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:31.261 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:31.261 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.261 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:24:31.261 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:24:31.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.247+0000 7f9fc8c00640 1 --2- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc144760 0x7f9fcc1dc760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400fae0 tx=0x7f9fb4000ed0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.247+0000 7f9fc8c00640 1 -- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc144760 msgr2=0x7f9fcc1dc760 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:24:31.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.247+0000 7f9fc8c00640 1 --2- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc144760 0x7f9fcc1dc760 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400fae0 tx=0x7f9fb4000ed0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.248+0000 7f9fd2600640 1 -- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9fa8078b90 msgr2=0x7f9fa807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.248+0000 7f9fd2600640 1 --2- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9fa8078b90 0x7f9fa807b0a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc035000 tx=0x7f9fbc02e040 comp rx=0 tx=0).stop 2024-09-21T03:24:31.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.248+0000 7f9fd2600640 1 -- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fcc156bc0 msgr2=0x7f9fcc1dc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.248+0000 7f9fd2600640 1 --2- 172.21.15.90:0/3142951400 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fcc156bc0 0x7f9fcc1dc220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400ea40 tx=0x7f9fc400ef00 comp rx=0 tx=0).stop 2024-09-21T03:24:31.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.248+0000 7f9fd1c00640 1 -- 172.21.15.90:0/3142951400 reap_dead start 2024-09-21T03:24:31.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.248+0000 7f9fd1c00640 1 -- 172.21.15.90:0/3142951400 reap_dead start 2024-09-21T03:24:31.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.249+0000 7f9fd2600640 1 -- 172.21.15.90:0/3142951400 shutdown_connections 2024-09-21T03:24:31.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.249+0000 7f9fd2600640 1 -- 172.21.15.90:0/3142951400 >> 172.21.15.90:0/3142951400 conn(0x7f9fcc06d200 msgr2=0x7f9fcc1522b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:31.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.249+0000 7f9fd2600640 1 -- 172.21.15.90:0/3142951400 shutdown_connections 2024-09-21T03:24:31.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.249+0000 7f9fd2600640 1 -- 172.21.15.90:0/3142951400 wait complete. 2024-09-21T03:24:31.298 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:24:31.299 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-21T03:24:31.299 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-21T03:24:31.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.697+0000 7fc1df200640 1 -- 172.21.15.90:0/1676346439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1d815abf0 msgr2=0x7fc1d8161630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.697+0000 7fc1df200640 1 --2- 172.21.15.90:0/1676346439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1d815abf0 0x7fc1d8161630 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0005fd0 tx=0x7fc1d002aa30 comp rx=0 tx=0).stop 2024-09-21T03:24:31.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.700+0000 7fc1df200640 1 -- 172.21.15.90:0/1676346439 shutdown_connections 2024-09-21T03:24:31.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.700+0000 7fc1df200640 1 --2- 172.21.15.90:0/1676346439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1d815abf0 0x7fc1d8161630 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.700+0000 7fc1df200640 1 --2- 172.21.15.90:0/1676346439 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1d8154700 0x7fc1d80ade10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.700+0000 7fc1df200640 1 -- 172.21.15.90:0/1676346439 >> 172.21.15.90:0/1676346439 conn(0x7fc1d80ccc30 msgr2=0x7fc1d80c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:31.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.700+0000 7fc1df200640 1 -- 172.21.15.90:0/1676346439 shutdown_connections 2024-09-21T03:24:31.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.700+0000 7fc1df200640 1 -- 172.21.15.90:0/1676346439 wait complete. 2024-09-21T03:24:31.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.703+0000 7fc1df200640 1 Processor -- start 2024-09-21T03:24:31.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.703+0000 7fc1df200640 1 -- start start 2024-09-21T03:24:31.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.704+0000 7fc1df200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1d80ae350 0x7fc1d80ad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.705+0000 7fc1df200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1d815abf0 0x7fc1d814bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.705+0000 7fc1df200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1d80ad760 0x7fc1d814b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.705+0000 7fc1df200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d80c7990 con 0x7fc1d815abf0 2024-09-21T03:24:31.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.705+0000 7fc1df200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d80cb340 con 0x7fc1d80ad760 2024-09-21T03:24:31.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.705+0000 7fc1df200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc1d80c7300 con 0x7fc1d80ae350 2024-09-21T03:24:31.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.705+0000 7fc1cfe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1d815abf0 0x7fc1d814bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.705+0000 7fc1cfe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1d815abf0 0x7fc1d814bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35854/0 (socket says 172.21.15.90:35854) 2024-09-21T03:24:31.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.705+0000 7fc1cfe00640 1 -- 172.21.15.90:0/1325984568 learned_addr learned my addr 172.21.15.90:0/1325984568 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:31.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.705+0000 7fc1d7e00640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1d80ae350 0x7fc1d80ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.705+0000 7fc1dd200640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1d80ad760 0x7fc1d814b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.705+0000 7fc1dd200640 1 -- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1d80ae350 msgr2=0x7fc1d80ad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.705+0000 7fc1dd200640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1d80ae350 0x7fc1d80ad220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.705+0000 7fc1dd200640 1 -- 172.21.15.90:0/1325984568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1d815abf0 msgr2=0x7fc1d814bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.705+0000 7fc1dd200640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1d815abf0 0x7fc1d814bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.705+0000 7fc1dd200640 1 -- 172.21.15.90:0/1325984568 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d8159cf0 con 0x7fc1d80ad760 2024-09-21T03:24:31.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.705+0000 7fc1d7e00640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1d80ae350 0x7fc1d80ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:24:31.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.706+0000 7fc1dd200640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1d80ad760 0x7fc1d814b040 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc1d806f9d0 tx=0x7fc1d0003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:31.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.706+0000 7fc1d4c00640 1 -- 172.21.15.90:0/1325984568 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0033050 con 0x7fc1d80ad760 2024-09-21T03:24:31.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.706+0000 7fc1d4c00640 1 -- 172.21.15.90:0/1325984568 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1d0004450 con 0x7fc1d80ad760 2024-09-21T03:24:31.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.706+0000 7fc1d4c00640 1 -- 172.21.15.90:0/1325984568 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0038450 con 0x7fc1d80ad760 2024-09-21T03:24:31.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.706+0000 7fc1df200640 1 -- 172.21.15.90:0/1325984568 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1d81ede60 con 0x7fc1d80ad760 2024-09-21T03:24:31.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.706+0000 7fc1df200640 1 -- 172.21.15.90:0/1325984568 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1d814d3f0 con 0x7fc1d80ad760 2024-09-21T03:24:31.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.707+0000 7fc1df200640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1d814b580 0x7fc1d814c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.707+0000 7fc1df200640 1 -- 172.21.15.90:0/1325984568 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc1d80cc030 con 0x7fc1d814b580 2024-09-21T03:24:31.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.708+0000 7fc1d7e00640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1d814b580 0x7fc1d814c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.708+0000 7fc1d7e00640 1 -- 172.21.15.90:0/1325984568 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc1d80ca3f0 con 0x7fc1d814b580 2024-09-21T03:24:31.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.708+0000 7fc1d7e00640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1d814b580 0x7fc1d814c4e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8010c20 tx=0x7fc1c800e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:31.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.709+0000 7fc1d4c00640 1 -- 172.21.15.90:0/1325984568 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c801c680 con 0x7fc1d814b580 2024-09-21T03:24:31.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.709+0000 7fc1d4c00640 1 -- 172.21.15.90:0/1325984568 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc1d0036070 con 0x7fc1d80ad760 2024-09-21T03:24:31.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.710+0000 7fc1d4c00640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc1b4078ac0 0x7fc1b407afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.710+0000 7fc1d4c00640 1 -- 172.21.15.90:0/1325984568 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fc1d00bc3b0 con 0x7fc1d80ad760 2024-09-21T03:24:31.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.710+0000 7fc1d4c00640 1 -- 172.21.15.90:0/1325984568 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc1c801c820 con 0x7fc1d814b580 2024-09-21T03:24:31.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.710+0000 7fc1d4c00640 1 -- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1d814b580 msgr2=0x7fc1d814c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.710+0000 7fc1d4c00640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1d814b580 0x7fc1d814c4e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8010c20 tx=0x7fc1c800e720 comp rx=0 tx=0).stop 2024-09-21T03:24:31.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.710+0000 7fc1d4c00640 1 -- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1d814b580 msgr2=0x7fc1d814c4e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:24:31.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.710+0000 7fc1d4c00640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1d814b580 0x7fc1d814c4e0 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8010c20 tx=0x7fc1c800e720 comp rx=0 tx=0).stop 2024-09-21T03:24:31.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.710+0000 7fc1cfe00640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc1b4078ac0 0x7fc1b407afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.711+0000 7fc1cfe00640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc1b4078ac0 0x7fc1b407afd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8155130 tx=0x7fc1c0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:31.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.716+0000 7fc1df200640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1d814ca20 0x7fc1d81f0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.716+0000 7fc1df200640 1 -- 172.21.15.90:0/1325984568 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc1d8155720 con 0x7fc1d814ca20 2024-09-21T03:24:31.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.717+0000 7fc1d7e00640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1d814ca20 0x7fc1d81f0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.717+0000 7fc1d7e00640 1 -- 172.21.15.90:0/1325984568 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc1d8155440 con 0x7fc1d814ca20 2024-09-21T03:24:31.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.717+0000 7fc1d7e00640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1d814ca20 0x7fc1d81f0570 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8010c20 tx=0x7fc1c80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:31.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.718+0000 7fc1d4c00640 1 -- 172.21.15.90:0/1325984568 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8027070 con 0x7fc1d814ca20 2024-09-21T03:24:31.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.718+0000 7fc1d4c00640 1 -- 172.21.15.90:0/1325984568 <== mon.2 v2:172.21.15.149:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4548 (secure 0 0 0) 0x7fc1c802b450 con 0x7fc1d814ca20 2024-09-21T03:24:31.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.718+0000 7fc1d4c00640 1 -- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1d814ca20 msgr2=0x7fc1d81f0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.718+0000 7fc1d4c00640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1d814ca20 0x7fc1d81f0570 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8010c20 tx=0x7fc1c80046c0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.718+0000 7fc1d4c00640 1 -- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1d814ca20 msgr2=0x7fc1d81f0570 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-21T03:24:31.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.718+0000 7fc1d4c00640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1d814ca20 0x7fc1d81f0570 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8010c20 tx=0x7fc1c80046c0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.720 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:24:31.721 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:24:31.721 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:24:31.721 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "peon", 2024-09-21T03:24:31.721 INFO:teuthology.orchestra.run.smithi090.stdout: "election_epoch": 70, 2024-09-21T03:24:31.721 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 65274, 2024-09-21T03:24:31.721 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum": [ 2024-09-21T03:24:31.721 INFO:teuthology.orchestra.run.smithi090.stdout: 0, 2024-09-21T03:24:31.721 INFO:teuthology.orchestra.run.smithi090.stdout: 1, 2024-09-21T03:24:31.721 INFO:teuthology.orchestra.run.smithi090.stdout: 2 2024-09-21T03:24:31.721 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:31.721 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_age": 2, 2024-09-21T03:24:31.721 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:24:31.721 INFO:teuthology.orchestra.run.smithi090.stdout: "required_con": "2450521708007866372", 2024-09-21T03:24:31.722 INFO:teuthology.orchestra.run.smithi090.stdout: "required_mon": [ 2024-09-21T03:24:31.722 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:24:31.722 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:24:31.722 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:24:31.722 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:24:31.722 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:24:31.722 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:24:31.722 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:24:31.722 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:24:31.722 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:24:31.722 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:24:31.722 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:24:31.722 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:31.722 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_con": "4540719139924082687", 2024-09-21T03:24:31.722 INFO:teuthology.orchestra.run.smithi090.stdout: "quorum_mon": [ 2024-09-21T03:24:31.723 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:24:31.723 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:24:31.723 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:24:31.723 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:24:31.723 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:24:31.723 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:24:31.723 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:24:31.723 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:24:31.723 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:24:31.723 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:24:31.723 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:24:31.723 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:31.723 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.723 INFO:teuthology.orchestra.run.smithi090.stdout: "outside_quorum": [], 2024-09-21T03:24:31.723 INFO:teuthology.orchestra.run.smithi090.stdout: "extra_probe_peers": [], 2024-09-21T03:24:31.724 INFO:teuthology.orchestra.run.smithi090.stdout: "sync_provider": [], 2024-09-21T03:24:31.724 INFO:teuthology.orchestra.run.smithi090.stdout: "monmap": { 2024-09-21T03:24:31.724 INFO:teuthology.orchestra.run.smithi090.stdout: "epoch": 1, 2024-09-21T03:24:31.724 INFO:teuthology.orchestra.run.smithi090.stdout: "fsid": "03c7e55f-7aae-4606-9d16-02ae95467377", 2024-09-21T03:24:31.724 INFO:teuthology.orchestra.run.smithi090.stdout: "modified": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:24:31.724 INFO:teuthology.orchestra.run.smithi090.stdout: "created": "2024-09-21T03:13:29.500858Z", 2024-09-21T03:24:31.724 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release": 19, 2024-09-21T03:24:31.724 INFO:teuthology.orchestra.run.smithi090.stdout: "min_mon_release_name": "squid", 2024-09-21T03:24:31.724 INFO:teuthology.orchestra.run.smithi090.stdout: "election_strategy": 1, 2024-09-21T03:24:31.724 INFO:teuthology.orchestra.run.smithi090.stdout: "disallowed_leaders: ": "", 2024-09-21T03:24:31.724 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false, 2024-09-21T03:24:31.724 INFO:teuthology.orchestra.run.smithi090.stdout: "tiebreaker_mon": "", 2024-09-21T03:24:31.724 INFO:teuthology.orchestra.run.smithi090.stdout: "removed_ranks: ": "", 2024-09-21T03:24:31.724 INFO:teuthology.orchestra.run.smithi090.stdout: "features": { 2024-09-21T03:24:31.724 INFO:teuthology.orchestra.run.smithi090.stdout: "persistent": [ 2024-09-21T03:24:31.725 INFO:teuthology.orchestra.run.smithi090.stdout: "kraken", 2024-09-21T03:24:31.725 INFO:teuthology.orchestra.run.smithi090.stdout: "luminous", 2024-09-21T03:24:31.725 INFO:teuthology.orchestra.run.smithi090.stdout: "mimic", 2024-09-21T03:24:31.725 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap-prune", 2024-09-21T03:24:31.725 INFO:teuthology.orchestra.run.smithi090.stdout: "nautilus", 2024-09-21T03:24:31.725 INFO:teuthology.orchestra.run.smithi090.stdout: "octopus", 2024-09-21T03:24:31.725 INFO:teuthology.orchestra.run.smithi090.stdout: "pacific", 2024-09-21T03:24:31.725 INFO:teuthology.orchestra.run.smithi090.stdout: "elector-pinging", 2024-09-21T03:24:31.725 INFO:teuthology.orchestra.run.smithi090.stdout: "quincy", 2024-09-21T03:24:31.725 INFO:teuthology.orchestra.run.smithi090.stdout: "reef", 2024-09-21T03:24:31.725 INFO:teuthology.orchestra.run.smithi090.stdout: "squid" 2024-09-21T03:24:31.725 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:31.725 INFO:teuthology.orchestra.run.smithi090.stdout: "optional": [] 2024-09-21T03:24:31.725 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.726 INFO:teuthology.orchestra.run.smithi090.stdout: "mons": [ 2024-09-21T03:24:31.726 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.726 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 0, 2024-09-21T03:24:31.726 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "a", 2024-09-21T03:24:31.726 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:24:31.726 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:24:31.726 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.726 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:24:31.726 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:3300", 2024-09-21T03:24:31.726 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:31.726 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.726 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.726 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:24:31.726 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789", 2024-09-21T03:24:31.727 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:31.727 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:31.727 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:31.727 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.727 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:6789/0", 2024-09-21T03:24:31.727 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.90:6789/0", 2024-09-21T03:24:31.727 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:24:31.727 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:24:31.727 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:24:31.727 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.727 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.727 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 1, 2024-09-21T03:24:31.727 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "b", 2024-09-21T03:24:31.727 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:24:31.727 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:24:31.728 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.728 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:24:31.728 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3300", 2024-09-21T03:24:31.728 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:31.728 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.728 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.728 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:24:31.728 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789", 2024-09-21T03:24:31.728 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:31.728 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:31.728 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:31.728 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.728 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6789/0", 2024-09-21T03:24:31.728 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6789/0", 2024-09-21T03:24:31.729 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:24:31.729 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:24:31.729 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:24:31.729 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.729 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.729 INFO:teuthology.orchestra.run.smithi090.stdout: "rank": 2, 2024-09-21T03:24:31.729 INFO:teuthology.orchestra.run.smithi090.stdout: "name": "c", 2024-09-21T03:24:31.729 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addrs": { 2024-09-21T03:24:31.729 INFO:teuthology.orchestra.run.smithi090.stdout: "addrvec": [ 2024-09-21T03:24:31.729 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.729 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v2", 2024-09-21T03:24:31.729 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:3301", 2024-09-21T03:24:31.729 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:31.729 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.729 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.730 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-21T03:24:31.730 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790", 2024-09-21T03:24:31.730 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 0 2024-09-21T03:24:31.730 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:31.730 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:31.730 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.730 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.149:6790/0", 2024-09-21T03:24:31.730 INFO:teuthology.orchestra.run.smithi090.stdout: "public_addr": "172.21.15.149:6790/0", 2024-09-21T03:24:31.730 INFO:teuthology.orchestra.run.smithi090.stdout: "priority": 0, 2024-09-21T03:24:31.730 INFO:teuthology.orchestra.run.smithi090.stdout: "weight": 0, 2024-09-21T03:24:31.730 INFO:teuthology.orchestra.run.smithi090.stdout: "crush_location": "{}" 2024-09-21T03:24:31.730 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:31.730 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:31.730 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.730 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_map": { 2024-09-21T03:24:31.731 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": [ 2024-09-21T03:24:31.731 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.731 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:24:31.731 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:24:31.731 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:24:31.731 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:31.731 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-21T03:24:31.731 INFO:teuthology.orchestra.run.smithi090.stdout: "client": [ 2024-09-21T03:24:31.731 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-21T03:24:31.731 INFO:teuthology.orchestra.run.smithi090.stdout: "features": "0x3f03dffffffdffff", 2024-09-21T03:24:31.731 INFO:teuthology.orchestra.run.smithi090.stdout: "release": "squid", 2024-09-21T03:24:31.731 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 1 2024-09-21T03:24:31.731 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T03:24:31.731 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T03:24:31.731 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T03:24:31.732 INFO:teuthology.orchestra.run.smithi090.stdout: "stretch_mode": false 2024-09-21T03:24:31.732 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:24:31.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.719+0000 7fc1df200640 1 -- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc1b4078ac0 msgr2=0x7fc1b407afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.719+0000 7fc1df200640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc1b4078ac0 0x7fc1b407afd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8155130 tx=0x7fc1c0009040 comp rx=0 tx=0).stop 2024-09-21T03:24:31.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.719+0000 7fc1df200640 1 -- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1d80ad760 msgr2=0x7fc1d814b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.719+0000 7fc1df200640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1d80ad760 0x7fc1d814b040 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc1d806f9d0 tx=0x7fc1d0003f10 comp rx=0 tx=0).stop 2024-09-21T03:24:31.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.719+0000 7fc1dd200640 1 -- 172.21.15.90:0/1325984568 reap_dead start 2024-09-21T03:24:31.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.719+0000 7fc1df200640 1 -- 172.21.15.90:0/1325984568 shutdown_connections 2024-09-21T03:24:31.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.719+0000 7fc1df200640 1 --2- 172.21.15.90:0/1325984568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1d80ad760 0x7fc1d814b040 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.719+0000 7fc1df200640 1 -- 172.21.15.90:0/1325984568 >> 172.21.15.90:0/1325984568 conn(0x7fc1d80ccc30 msgr2=0x7fc1d8150220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:31.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.719+0000 7fc1df200640 1 -- 172.21.15.90:0/1325984568 shutdown_connections 2024-09-21T03:24:31.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:31.719+0000 7fc1df200640 1 -- 172.21.15.90:0/1325984568 wait complete. 2024-09-21T03:24:31.741 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-21T03:24:31.742 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-21T03:24:31.742 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-21T03:24:32.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.037+0000 7f33b2200640 1 -- 172.21.15.90:0/4284270560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33ac074220 msgr2=0x7f33ac074630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:32.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.037+0000 7f33b2200640 1 --2- 172.21.15.90:0/4284270560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33ac074220 0x7f33ac074630 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f33a4005fd0 tx=0x7f33a402a8b0 comp rx=0 tx=0).stop 2024-09-21T03:24:32.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.038+0000 7f33b2200640 1 -- 172.21.15.90:0/4284270560 shutdown_connections 2024-09-21T03:24:32.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.038+0000 7f33b2200640 1 --2- 172.21.15.90:0/4284270560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33ac074220 0x7f33ac074630 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:32.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.038+0000 7f33b2200640 1 -- 172.21.15.90:0/4284270560 >> 172.21.15.90:0/4284270560 conn(0x7f33ac0c8ba0 msgr2=0x7f33ac06cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:32.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.039+0000 7f33b2200640 1 -- 172.21.15.90:0/4284270560 shutdown_connections 2024-09-21T03:24:32.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.039+0000 7f33b2200640 1 -- 172.21.15.90:0/4284270560 wait complete. 2024-09-21T03:24:32.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.042+0000 7f33b2200640 1 Processor -- start 2024-09-21T03:24:32.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.042+0000 7f33b2200640 1 -- start start 2024-09-21T03:24:32.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.045+0000 7f33b2200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33ac06d960 0x7f33ac14a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:32.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.045+0000 7f33b2200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f33ac074220 0x7f33ac149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:32.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.045+0000 7f33b2200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33ac0ac350 0x7f33ac1f4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:32.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.045+0000 7f33b2200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f33ac0ace70 con 0x7f33ac06d960 2024-09-21T03:24:32.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.045+0000 7f33b2200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f33ac0abec0 con 0x7f33ac0ac350 2024-09-21T03:24:32.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.045+0000 7f33b2200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f33ac0acff0 con 0x7f33ac074220 2024-09-21T03:24:32.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.046+0000 7f33abe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33ac0ac350 0x7f33ac1f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:32.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.046+0000 7f33ab400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33ac06d960 0x7f33ac14a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:32.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.046+0000 7f33abe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33ac0ac350 0x7f33ac1f4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:50732/0 (socket says 172.21.15.90:50732) 2024-09-21T03:24:32.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.046+0000 7f33abe00640 1 -- 172.21.15.90:0/1539847937 learned_addr learned my addr 172.21.15.90:0/1539847937 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:32.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.046+0000 7f33ab400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33ac06d960 0x7f33ac14a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35876/0 (socket says 172.21.15.90:35876) 2024-09-21T03:24:32.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.047+0000 7f33aaa00640 1 --2- 172.21.15.90:0/1539847937 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f33ac074220 0x7f33ac149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:32.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.047+0000 7f33abe00640 1 -- 172.21.15.90:0/1539847937 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f33ac074220 msgr2=0x7f33ac149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:32.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.047+0000 7f33abe00640 1 --2- 172.21.15.90:0/1539847937 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f33ac074220 0x7f33ac149b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:32.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.048+0000 7f33abe00640 1 -- 172.21.15.90:0/1539847937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33ac06d960 msgr2=0x7f33ac14a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:32.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.048+0000 7f33abe00640 1 --2- 172.21.15.90:0/1539847937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33ac06d960 0x7f33ac14a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:32.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.048+0000 7f33abe00640 1 -- 172.21.15.90:0/1539847937 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33ac158c40 con 0x7f33ac0ac350 2024-09-21T03:24:32.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.048+0000 7f33ab400640 1 --2- 172.21.15.90:0/1539847937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33ac06d960 0x7f33ac14a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:32.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.049+0000 7f33abe00640 1 --2- 172.21.15.90:0/1539847937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33ac0ac350 0x7f33ac1f4d00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f33a402aea0 tx=0x7f33a4031700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:32.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.050+0000 7f33a3400640 1 -- 172.21.15.90:0/1539847937 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4031990 con 0x7f33ac0ac350 2024-09-21T03:24:32.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.050+0000 7f33a3400640 1 -- 172.21.15.90:0/1539847937 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33a4031c20 con 0x7f33ac0ac350 2024-09-21T03:24:32.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.050+0000 7f33a3400640 1 -- 172.21.15.90:0/1539847937 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a40330d0 con 0x7f33ac0ac350 2024-09-21T03:24:32.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.050+0000 7f33b2200640 1 -- 172.21.15.90:0/1539847937 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33ac13afd0 con 0x7f33ac0ac350 2024-09-21T03:24:32.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.050+0000 7f33b2200640 1 -- 172.21.15.90:0/1539847937 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33ac0c5610 con 0x7f33ac0ac350 2024-09-21T03:24:32.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.055+0000 7f33b2200640 1 -- 172.21.15.90:0/1539847937 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33ac0acab0 con 0x7f33ac0ac350 2024-09-21T03:24:32.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.055+0000 7f33a3400640 1 -- 172.21.15.90:0/1539847937 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f33a4033270 con 0x7f33ac0ac350 2024-09-21T03:24:32.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.057+0000 7f33a3400640 1 --2- 172.21.15.90:0/1539847937 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f338c078b90 0x7f338c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:32.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.057+0000 7f33a3400640 1 -- 172.21.15.90:0/1539847937 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f33a40bc460 con 0x7f33ac0ac350 2024-09-21T03:24:32.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.058+0000 7f33ab400640 1 --2- 172.21.15.90:0/1539847937 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f338c078b90 0x7f338c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:32.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.059+0000 7f33ab400640 1 --2- 172.21.15.90:0/1539847937 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f338c078b90 0x7f338c07b0a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f339c007a50 tx=0x7f339c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:32.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.071+0000 7f33a3400640 1 -- 172.21.15.90:0/1539847937 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f33ac0acab0 con 0x7f33ac0ac350 2024-09-21T03:24:32.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.582+0000 7f33b2200640 1 -- 172.21.15.90:0/1539847937 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f33ac074ce0 con 0x7f33ac0ac350 2024-09-21T03:24:32.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.589+0000 7f33a3400640 1 -- 172.21.15.90:0/1539847937 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f33a403f030 con 0x7f33ac0ac350 2024-09-21T03:24:32.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.599+0000 7f33b2200640 1 -- 172.21.15.90:0/1539847937 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f338c078b90 msgr2=0x7f338c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:32.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.599+0000 7f33b2200640 1 --2- 172.21.15.90:0/1539847937 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f338c078b90 0x7f338c07b0a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f339c007a50 tx=0x7f339c009040 comp rx=0 tx=0).stop 2024-09-21T03:24:32.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.599+0000 7f33b2200640 1 -- 172.21.15.90:0/1539847937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33ac0ac350 msgr2=0x7f33ac1f4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:32.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.599+0000 7f33b2200640 1 --2- 172.21.15.90:0/1539847937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33ac0ac350 0x7f33ac1f4d00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f33a402aea0 tx=0x7f33a4031700 comp rx=0 tx=0).stop 2024-09-21T03:24:32.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.600+0000 7f33b2200640 1 -- 172.21.15.90:0/1539847937 shutdown_connections 2024-09-21T03:24:32.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.600+0000 7f33b2200640 1 --2- 172.21.15.90:0/1539847937 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f338c078b90 0x7f338c07b0a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:32.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.600+0000 7f33b2200640 1 --2- 172.21.15.90:0/1539847937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33ac0ac350 0x7f33ac1f4d00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:32.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.600+0000 7f33b2200640 1 --2- 172.21.15.90:0/1539847937 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f33ac074220 0x7f33ac149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:32.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.600+0000 7f33b2200640 1 --2- 172.21.15.90:0/1539847937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33ac06d960 0x7f33ac14a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:32.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.600+0000 7f33b2200640 1 -- 172.21.15.90:0/1539847937 >> 172.21.15.90:0/1539847937 conn(0x7f33ac0c8ba0 msgr2=0x7f33ac0c4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:32.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.601+0000 7f33b2200640 1 -- 172.21.15.90:0/1539847937 shutdown_connections 2024-09-21T03:24:32.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:32.601+0000 7f33b2200640 1 -- 172.21.15.90:0/1539847937 wait complete. 2024-09-21T03:24:32.648 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-21T03:24:32.881 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:24:32.885 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:24:42.649 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:24:42.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.876+0000 7f8343200640 1 -- 172.21.15.90:0/1229767320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8344157f60 msgr2=0x7f8344158370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:42.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.876+0000 7f8343200640 1 --2- 172.21.15.90:0/1229767320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8344157f60 0x7f8344158370 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8344074330 tx=0x7f833c02a980 comp rx=0 tx=0).stop 2024-09-21T03:24:42.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.877+0000 7f8343200640 1 -- 172.21.15.90:0/1229767320 shutdown_connections 2024-09-21T03:24:42.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.877+0000 7f8343200640 1 --2- 172.21.15.90:0/1229767320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8344157f60 0x7f8344158370 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.877+0000 7f8343200640 1 --2- 172.21.15.90:0/1229767320 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83440c5460 0x7f83440c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.877+0000 7f8343200640 1 --2- 172.21.15.90:0/1229767320 >> v2:172.21.15.149:3300/0 conn(0x7f8344071530 0x7f83440af880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.877+0000 7f8343200640 1 -- 172.21.15.90:0/1229767320 >> 172.21.15.90:0/1229767320 conn(0x7f83440ca0d0 msgr2=0x7f83440ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:42.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.877+0000 7f8343200640 1 -- 172.21.15.90:0/1229767320 shutdown_connections 2024-09-21T03:24:42.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.877+0000 7f8343200640 1 -- 172.21.15.90:0/1229767320 wait complete. 2024-09-21T03:24:42.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.879+0000 7f8343200640 1 Processor -- start 2024-09-21T03:24:42.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.879+0000 7f8343200640 1 -- start start 2024-09-21T03:24:42.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.880+0000 7f8343200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8344071530 0x7f83440adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:42.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.880+0000 7f8343200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83440c5460 0x7f834406f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:42.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.880+0000 7f8343200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8344157f60 0x7f8344156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:42.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.880+0000 7f8343200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8344073540 con 0x7f8344157f60 2024-09-21T03:24:42.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.880+0000 7f8343200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f83440709f0 con 0x7f83440c5460 2024-09-21T03:24:42.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.880+0000 7f8343200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8344070c90 con 0x7f8344071530 2024-09-21T03:24:42.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.880+0000 7f8342800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8344157f60 0x7f8344156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:42.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.881+0000 7f8342800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8344157f60 0x7f8344156730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52822/0 (socket says 172.21.15.90:52822) 2024-09-21T03:24:42.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.881+0000 7f8342800640 1 -- 172.21.15.90:0/3836923140 learned_addr learned my addr 172.21.15.90:0/3836923140 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:42.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.881+0000 7f8339400640 1 --2- 172.21.15.90:0/3836923140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83440c5460 0x7f834406f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:42.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.881+0000 7f8341e00640 1 --2- 172.21.15.90:0/3836923140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8344071530 0x7f83440adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:42.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.881+0000 7f8342800640 1 -- 172.21.15.90:0/3836923140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8344071530 msgr2=0x7f83440adbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.881+0000 7f8342800640 1 --2- 172.21.15.90:0/3836923140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8344071530 0x7f83440adbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.881+0000 7f8342800640 1 -- 172.21.15.90:0/3836923140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83440c5460 msgr2=0x7f834406f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.881+0000 7f8342800640 1 --2- 172.21.15.90:0/3836923140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83440c5460 0x7f834406f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.881+0000 7f8342800640 1 -- 172.21.15.90:0/3836923140 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f834406f910 con 0x7f8344157f60 2024-09-21T03:24:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.881+0000 7f8342800640 1 --2- 172.21.15.90:0/3836923140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8344157f60 0x7f8344156730 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f833c009d60 tx=0x7f833c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.881+0000 7f833aa00640 1 -- 172.21.15.90:0/3836923140 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c034040 con 0x7f8344157f60 2024-09-21T03:24:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.882+0000 7f833aa00640 1 -- 172.21.15.90:0/3836923140 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f833c004540 con 0x7f8344157f60 2024-09-21T03:24:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.882+0000 7f833aa00640 1 -- 172.21.15.90:0/3836923140 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c045480 con 0x7f8344157f60 2024-09-21T03:24:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.882+0000 7f8343200640 1 -- 172.21.15.90:0/3836923140 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83440ae880 con 0x7f8344157f60 2024-09-21T03:24:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.882+0000 7f8343200640 1 -- 172.21.15.90:0/3836923140 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f834414c100 con 0x7f8344157f60 2024-09-21T03:24:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.883+0000 7f8343200640 1 -- 172.21.15.90:0/3836923140 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83440aeac0 con 0x7f8344157f60 2024-09-21T03:24:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.884+0000 7f833aa00640 1 -- 172.21.15.90:0/3836923140 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f833c037020 con 0x7f8344157f60 2024-09-21T03:24:42.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.885+0000 7f833aa00640 1 --2- 172.21.15.90:0/3836923140 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8320078b90 0x7f832007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:42.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.885+0000 7f833aa00640 1 -- 172.21.15.90:0/3836923140 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f833c0bc8d0 con 0x7f8344157f60 2024-09-21T03:24:42.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.885+0000 7f8341e00640 1 --2- 172.21.15.90:0/3836923140 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8320078b90 0x7f832007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:42.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.886+0000 7f8341e00640 1 --2- 172.21.15.90:0/3836923140 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8320078b90 0x7f832007b0a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8334005fd0 tx=0x7f833400b260 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:42.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:42.890+0000 7f833aa00640 1 -- 172.21.15.90:0/3836923140 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f83440aeac0 con 0x7f8344157f60 2024-09-21T03:24:43.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.114+0000 7f8343200640 1 -- 172.21.15.90:0/3836923140 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83440c7ca0 con 0x7f8344157f60 2024-09-21T03:24:43.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.115+0000 7f833aa00640 1 -- 172.21.15.90:0/3836923140 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6530 (secure 0 0 0) 0x7f83440c5db0 con 0x7f8344157f60 2024-09-21T03:24:43.117 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:24:43.117 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"btime":"2024-09-21T03:14:51:570098+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3707484056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3707484056},{"type":"v1","addr":"172.21.15.90:6835","nonce":3707484056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1650707992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1650707992},{"type":"v1","addr":"172.21.15.149:6837","nonce":1650707992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:37.954868+0000","modified":"2024-09-21T03:14:41.971257+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/2166962836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2166962836},{"type":"v1","addr":"172.21.15.149:6836","nonce":2166962836}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:47.021969+0000","modified":"2024-09-21T03:14:51.055397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4395},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4395":{"gid":4395,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6833/1105275899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1105275899},{"type":"v1","addr":"172.21.15.90:6833","nonce":1105275899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4395,"qdb_cluster":[4395]},"id":2}]} 2024-09-21T03:24:43.117 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2024-09-21T03:24:43.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.118+0000 7f8343200640 1 -- 172.21.15.90:0/3836923140 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8320078b90 msgr2=0x7f832007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.118+0000 7f8343200640 1 --2- 172.21.15.90:0/3836923140 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8320078b90 0x7f832007b0a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8334005fd0 tx=0x7f833400b260 comp rx=0 tx=0).stop 2024-09-21T03:24:43.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.118+0000 7f8343200640 1 -- 172.21.15.90:0/3836923140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8344157f60 msgr2=0x7f8344156730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.118+0000 7f8343200640 1 --2- 172.21.15.90:0/3836923140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8344157f60 0x7f8344156730 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f833c009d60 tx=0x7f833c003f10 comp rx=0 tx=0).stop 2024-09-21T03:24:43.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.118+0000 7f8343200640 1 -- 172.21.15.90:0/3836923140 shutdown_connections 2024-09-21T03:24:43.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.118+0000 7f8343200640 1 --2- 172.21.15.90:0/3836923140 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8320078b90 0x7f832007b0a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.118+0000 7f8343200640 1 --2- 172.21.15.90:0/3836923140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8344157f60 0x7f8344156730 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.118+0000 7f8343200640 1 --2- 172.21.15.90:0/3836923140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83440c5460 0x7f834406f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.118+0000 7f8343200640 1 --2- 172.21.15.90:0/3836923140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8344071530 0x7f83440adbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.118+0000 7f8343200640 1 -- 172.21.15.90:0/3836923140 >> 172.21.15.90:0/3836923140 conn(0x7f83440ca0d0 msgr2=0x7f83440c4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:43.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.118+0000 7f8343200640 1 -- 172.21.15.90:0/3836923140 shutdown_connections 2024-09-21T03:24:43.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.118+0000 7f8343200640 1 -- 172.21.15.90:0/3836923140 wait complete. 2024-09-21T03:24:43.143 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-21T03:24:43.143 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-21T03:24:43.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.359+0000 7f62e7c00640 1 -- 172.21.15.90:0/711778455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62e006ede0 msgr2=0x7f62e0074b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.359+0000 7f62e7c00640 1 --2- 172.21.15.90:0/711778455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62e006ede0 0x7f62e0074b80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f62c8009860 tx=0x7f62c802a5f0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.359+0000 7f62e7c00640 1 -- 172.21.15.90:0/711778455 shutdown_connections 2024-09-21T03:24:43.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.359+0000 7f62e7c00640 1 --2- 172.21.15.90:0/711778455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62e006ede0 0x7f62e0074b80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.359+0000 7f62e7c00640 1 -- 172.21.15.90:0/711778455 >> 172.21.15.90:0/711778455 conn(0x7f62e00c8ba0 msgr2=0x7f62e006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:43.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.359+0000 7f62e7c00640 1 -- 172.21.15.90:0/711778455 shutdown_connections 2024-09-21T03:24:43.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.360+0000 7f62e7c00640 1 -- 172.21.15.90:0/711778455 wait complete. 2024-09-21T03:24:43.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.362+0000 7f62e7c00640 1 Processor -- start 2024-09-21T03:24:43.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.362+0000 7f62e7c00640 1 -- start start 2024-09-21T03:24:43.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.363+0000 7f62e7c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62e006ede0 0x7f62e01e0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:43.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.363+0000 7f62e7c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62e00c2d30 0x7f62e014bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:43.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.363+0000 7f62e7c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62e01f0d20 0x7f62e014a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:43.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.363+0000 7f62e7c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f62e0070a60 con 0x7f62e00c2d30 2024-09-21T03:24:43.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.363+0000 7f62e7c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f62e00708e0 con 0x7f62e01f0d20 2024-09-21T03:24:43.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.363+0000 7f62e7c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f62e01577f0 con 0x7f62e006ede0 2024-09-21T03:24:43.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.363+0000 7f62d7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62e00c2d30 0x7f62e014bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:43.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.363+0000 7f62d7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62e00c2d30 0x7f62e014bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52846/0 (socket says 172.21.15.90:52846) 2024-09-21T03:24:43.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.363+0000 7f62d7e00640 1 -- 172.21.15.90:0/4292580962 learned_addr learned my addr 172.21.15.90:0/4292580962 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:43.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.364+0000 7f62e5200640 1 --2- 172.21.15.90:0/4292580962 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62e006ede0 0x7f62e01e0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:43.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.364+0000 7f62e5c00640 1 --2- 172.21.15.90:0/4292580962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62e01f0d20 0x7f62e014a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:43.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.364+0000 7f62d7e00640 1 -- 172.21.15.90:0/4292580962 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62e006ede0 msgr2=0x7f62e01e0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.364+0000 7f62d7e00640 1 --2- 172.21.15.90:0/4292580962 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62e006ede0 0x7f62e01e0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.364+0000 7f62d7e00640 1 -- 172.21.15.90:0/4292580962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62e01f0d20 msgr2=0x7f62e014a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.364+0000 7f62d7e00640 1 --2- 172.21.15.90:0/4292580962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62e01f0d20 0x7f62e014a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.364+0000 7f62d7e00640 1 -- 172.21.15.90:0/4292580962 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e0151640 con 0x7f62e00c2d30 2024-09-21T03:24:43.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.364+0000 7f62d7e00640 1 --2- 172.21.15.90:0/4292580962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62e00c2d30 0x7f62e014bfd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f62c802abe0 tx=0x7f62c8033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:43.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.364+0000 7f62dd600640 1 -- 172.21.15.90:0/4292580962 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c8031b50 con 0x7f62e00c2d30 2024-09-21T03:24:43.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.365+0000 7f62dd600640 1 -- 172.21.15.90:0/4292580962 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62c8031de0 con 0x7f62e00c2d30 2024-09-21T03:24:43.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.365+0000 7f62e7c00640 1 -- 172.21.15.90:0/4292580962 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e014b000 con 0x7f62e00c2d30 2024-09-21T03:24:43.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.365+0000 7f62dd600640 1 -- 172.21.15.90:0/4292580962 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c8005280 con 0x7f62e00c2d30 2024-09-21T03:24:43.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.365+0000 7f62e7c00640 1 -- 172.21.15.90:0/4292580962 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e0151a90 con 0x7f62e00c2d30 2024-09-21T03:24:43.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.366+0000 7f62e7c00640 1 -- 172.21.15.90:0/4292580962 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62e00ac950 con 0x7f62e00c2d30 2024-09-21T03:24:43.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.367+0000 7f62dd600640 1 -- 172.21.15.90:0/4292580962 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f62c8005420 con 0x7f62e00c2d30 2024-09-21T03:24:43.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.368+0000 7f62dd600640 1 --2- 172.21.15.90:0/4292580962 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f62bc078b90 0x7f62bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:43.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.368+0000 7f62dd600640 1 -- 172.21.15.90:0/4292580962 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f62c80bc080 con 0x7f62e00c2d30 2024-09-21T03:24:43.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.368+0000 7f62e5200640 1 --2- 172.21.15.90:0/4292580962 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f62bc078b90 0x7f62bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:43.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.369+0000 7f62e5200640 1 --2- 172.21.15.90:0/4292580962 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f62bc078b90 0x7f62bc07b0a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f62e00abda0 tx=0x7f62d0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:43.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.373+0000 7f62dd600640 1 -- 172.21.15.90:0/4292580962 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f62e0151640 con 0x7f62e00c2d30 2024-09-21T03:24:43.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.633+0000 7f62e7c00640 1 -- 172.21.15.90:0/4292580962 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f62e00c2b10 con 0x7f62e00c2d30 2024-09-21T03:24:43.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.633+0000 7f62dd600640 1 -- 172.21.15.90:0/4292580962 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f62c803f030 con 0x7f62e00c2d30 2024-09-21T03:24:43.675 INFO:teuthology.orchestra.run.smithi090.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","modified":"2024-09-21T03:13:29.500858Z","created":"2024-09-21T03:13:29.500858Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3301","nonce":0},{"type":"v1","addr":"172.21.15.149:6790","nonce":0}]},"addr":"172.21.15.149:6790/0","public_addr":"172.21.15.149:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-21T03:24:43.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.636+0000 7f62e7c00640 1 -- 172.21.15.90:0/4292580962 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f62bc078b90 msgr2=0x7f62bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.636+0000 7f62e7c00640 1 --2- 172.21.15.90:0/4292580962 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f62bc078b90 0x7f62bc07b0a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f62e00abda0 tx=0x7f62d0009040 comp rx=0 tx=0).stop 2024-09-21T03:24:43.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.636+0000 7f62e7c00640 1 -- 172.21.15.90:0/4292580962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62e00c2d30 msgr2=0x7f62e014bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.636+0000 7f62e7c00640 1 --2- 172.21.15.90:0/4292580962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62e00c2d30 0x7f62e014bfd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f62c802abe0 tx=0x7f62c8033ba0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.636+0000 7f62e7c00640 1 -- 172.21.15.90:0/4292580962 shutdown_connections 2024-09-21T03:24:43.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.636+0000 7f62e7c00640 1 --2- 172.21.15.90:0/4292580962 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f62bc078b90 0x7f62bc07b0a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.636+0000 7f62e7c00640 1 --2- 172.21.15.90:0/4292580962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62e01f0d20 0x7f62e014a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.636+0000 7f62e7c00640 1 --2- 172.21.15.90:0/4292580962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62e00c2d30 0x7f62e014bfd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.636+0000 7f62e7c00640 1 --2- 172.21.15.90:0/4292580962 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62e006ede0 0x7f62e01e0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.636+0000 7f62e7c00640 1 -- 172.21.15.90:0/4292580962 >> 172.21.15.90:0/4292580962 conn(0x7f62e00c8ba0 msgr2=0x7f62e00731f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:43.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.636+0000 7f62e7c00640 1 -- 172.21.15.90:0/4292580962 shutdown_connections 2024-09-21T03:24:43.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:43.636+0000 7f62e7c00640 1 -- 172.21.15.90:0/4292580962 wait complete. 2024-09-21T03:24:43.677 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-21T03:24:43.677 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T03:24:43.696 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T03:24:43.696 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:24:43.696 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:43.732 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T03:24:43.732 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:43.808 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:24:44.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.075+0000 7fee1ea00640 1 -- 172.21.15.90:0/1814007370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee18154070 msgr2=0x7fee18156ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:44.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.075+0000 7fee1ea00640 1 --2- 172.21.15.90:0/1814007370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee18154070 0x7fee18156ad0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fee04005fd0 tx=0x7fee0402a540 comp rx=0 tx=0).stop 2024-09-21T03:24:44.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.076+0000 7fee1ea00640 1 -- 172.21.15.90:0/1814007370 shutdown_connections 2024-09-21T03:24:44.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.076+0000 7fee1ea00640 1 --2- 172.21.15.90:0/1814007370 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee18157010 0x7fee18161450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.076+0000 7fee1ea00640 1 --2- 172.21.15.90:0/1814007370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee18154070 0x7fee18156ad0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.076+0000 7fee1ea00640 1 -- 172.21.15.90:0/1814007370 >> 172.21.15.90:0/1814007370 conn(0x7fee180cc270 msgr2=0x7fee180cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:44.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.076+0000 7fee1ea00640 1 -- 172.21.15.90:0/1814007370 shutdown_connections 2024-09-21T03:24:44.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.076+0000 7fee1ea00640 1 -- 172.21.15.90:0/1814007370 wait complete. 2024-09-21T03:24:44.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.078+0000 7fee1ea00640 1 Processor -- start 2024-09-21T03:24:44.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.078+0000 7fee1ea00640 1 -- start start 2024-09-21T03:24:44.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.079+0000 7fee1ea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee180c7120 0x7fee181e01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:44.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.079+0000 7fee1ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee18154070 0x7fee181e1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:44.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.079+0000 7fee1ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee18157010 0x7fee1814ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:44.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.079+0000 7fee1ea00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fee18154680 con 0x7fee180c7120 2024-09-21T03:24:44.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.079+0000 7fee1ea00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fee180cba00 con 0x7fee18157010 2024-09-21T03:24:44.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.079+0000 7fee1ea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fee180c8840 con 0x7fee18154070 2024-09-21T03:24:44.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.080+0000 7fee1d600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee180c7120 0x7fee181e01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:44.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.080+0000 7fee1d600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee180c7120 0x7fee181e01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52866/0 (socket says 172.21.15.90:52866) 2024-09-21T03:24:44.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.080+0000 7fee1d600640 1 -- 172.21.15.90:0/1787871018 learned_addr learned my addr 172.21.15.90:0/1787871018 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:44.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.080+0000 7fee1cc00640 1 --2- 172.21.15.90:0/1787871018 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee18154070 0x7fee181e1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:44.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.080+0000 7fee1e000640 1 --2- 172.21.15.90:0/1787871018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee18157010 0x7fee1814ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:44.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.080+0000 7fee1d600640 1 -- 172.21.15.90:0/1787871018 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee18154070 msgr2=0x7fee181e1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:44.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.080+0000 7fee1d600640 1 --2- 172.21.15.90:0/1787871018 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee18154070 0x7fee181e1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.080+0000 7fee1d600640 1 -- 172.21.15.90:0/1787871018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee18157010 msgr2=0x7fee1814ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:44.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.080+0000 7fee1d600640 1 --2- 172.21.15.90:0/1787871018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee18157010 0x7fee1814ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.080+0000 7fee1d600640 1 -- 172.21.15.90:0/1787871018 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee181ea880 con 0x7fee180c7120 2024-09-21T03:24:44.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.080+0000 7fee1d600640 1 --2- 172.21.15.90:0/1787871018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee180c7120 0x7fee181e01c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00c3f0 tx=0x7fee0c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:44.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.081+0000 7fee15600640 1 -- 172.21.15.90:0/1787871018 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c017070 con 0x7fee180c7120 2024-09-21T03:24:44.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.081+0000 7fee15600640 1 -- 172.21.15.90:0/1787871018 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee0c0035f0 con 0x7fee180c7120 2024-09-21T03:24:44.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.081+0000 7fee15600640 1 -- 172.21.15.90:0/1787871018 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c003a40 con 0x7fee180c7120 2024-09-21T03:24:44.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.081+0000 7fee1ea00640 1 -- 172.21.15.90:0/1787871018 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee1814bda0 con 0x7fee180c7120 2024-09-21T03:24:44.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.081+0000 7fee1ea00640 1 -- 172.21.15.90:0/1787871018 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee1814b8f0 con 0x7fee180c7120 2024-09-21T03:24:44.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.082+0000 7fee1ea00640 1 -- 172.21.15.90:0/1787871018 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee18157420 con 0x7fee180c7120 2024-09-21T03:24:44.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.083+0000 7fee15600640 1 -- 172.21.15.90:0/1787871018 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fee0c01a070 con 0x7fee180c7120 2024-09-21T03:24:44.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.084+0000 7fee15600640 1 --2- 172.21.15.90:0/1787871018 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fedf8078b90 0x7fedf807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:44.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.085+0000 7fee15600640 1 -- 172.21.15.90:0/1787871018 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fee0c09a450 con 0x7fee180c7120 2024-09-21T03:24:44.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.085+0000 7fee1cc00640 1 --2- 172.21.15.90:0/1787871018 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fedf8078b90 0x7fedf807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:44.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.086+0000 7fee1cc00640 1 --2- 172.21.15.90:0/1787871018 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fedf8078b90 0x7fedf807b0a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fee04033000 tx=0x7fee04004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:44.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.089+0000 7fee15600640 1 -- 172.21.15.90:0/1787871018 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fee18154480 con 0x7fee180c7120 2024-09-21T03:24:44.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.284+0000 7fee1ea00640 1 -- 172.21.15.90:0/1787871018 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fee180ca2b0 con 0x7fee180c7120 2024-09-21T03:24:44.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.284+0000 7fee15600640 1 -- 172.21.15.90:0/1787871018 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fee0c061e70 con 0x7fee180c7120 2024-09-21T03:24:44.287 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-21T03:24:44.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.287+0000 7fee1ea00640 1 -- 172.21.15.90:0/1787871018 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fedf8078b90 msgr2=0x7fedf807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:44.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.287+0000 7fee1ea00640 1 --2- 172.21.15.90:0/1787871018 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fedf8078b90 0x7fedf807b0a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fee04033000 tx=0x7fee04004730 comp rx=0 tx=0).stop 2024-09-21T03:24:44.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.287+0000 7fee1ea00640 1 -- 172.21.15.90:0/1787871018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee180c7120 msgr2=0x7fee181e01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:44.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.287+0000 7fee1ea00640 1 --2- 172.21.15.90:0/1787871018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee180c7120 0x7fee181e01c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00c3f0 tx=0x7fee0c00c8b0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.287+0000 7fee1ea00640 1 -- 172.21.15.90:0/1787871018 shutdown_connections 2024-09-21T03:24:44.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.287+0000 7fee1ea00640 1 --2- 172.21.15.90:0/1787871018 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fedf8078b90 0x7fedf807b0a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.287+0000 7fee1ea00640 1 --2- 172.21.15.90:0/1787871018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee18157010 0x7fee1814ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.287+0000 7fee1ea00640 1 --2- 172.21.15.90:0/1787871018 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee18154070 0x7fee181e1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.287+0000 7fee1ea00640 1 --2- 172.21.15.90:0/1787871018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee180c7120 0x7fee181e01c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.287+0000 7fee1ea00640 1 -- 172.21.15.90:0/1787871018 >> 172.21.15.90:0/1787871018 conn(0x7fee180cc270 msgr2=0x7fee1814d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:44.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.287+0000 7fee1ea00640 1 -- 172.21.15.90:0/1787871018 shutdown_connections 2024-09-21T03:24:44.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.287+0000 7fee1ea00640 1 -- 172.21.15.90:0/1787871018 wait complete. 2024-09-21T03:24:44.315 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T03:24:44.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:44.316 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T03:24:44.427 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T03:24:44.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:44.428 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T03:24:44.530 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:24:44.530 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:44.581 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T03:24:44.581 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:44.657 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:24:44.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.881+0000 7f6541400640 1 -- 172.21.15.90:0/3948269546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c0ad310 msgr2=0x7f653c0aa9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:44.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.881+0000 7f6541400640 1 --2- 172.21.15.90:0/3948269546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c0ad310 0x7f653c0aa9e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f652c009830 tx=0x7f652c02a3f0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.881+0000 7f6541400640 1 -- 172.21.15.90:0/3948269546 shutdown_connections 2024-09-21T03:24:44.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.881+0000 7f6541400640 1 --2- 172.21.15.90:0/3948269546 >> v2:172.21.15.90:3300/0 conn(0x7f653c0aaf20 0x7f653c06f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.881+0000 7f6541400640 1 --2- 172.21.15.90:0/3948269546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c0ad310 0x7f653c0aa9e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.881+0000 7f6541400640 1 -- 172.21.15.90:0/3948269546 >> 172.21.15.90:0/3948269546 conn(0x7f653c06d200 msgr2=0x7f653c06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:44.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.881+0000 7f6541400640 1 -- 172.21.15.90:0/3948269546 shutdown_connections 2024-09-21T03:24:44.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.881+0000 7f6541400640 1 -- 172.21.15.90:0/3948269546 wait complete. 2024-09-21T03:24:44.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.883+0000 7f6541400640 1 Processor -- start 2024-09-21T03:24:44.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.884+0000 7f6541400640 1 -- start start 2024-09-21T03:24:44.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.885+0000 7f6541400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f653c0aaf20 0x7f653c14f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:44.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.885+0000 7f6541400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f653c0ad310 0x7f653c0c15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:44.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.885+0000 7f6541400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c14b5a0 0x7f653c073c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:44.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.885+0000 7f6541400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f653c0c57b0 con 0x7f653c0aaf20 2024-09-21T03:24:44.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.885+0000 7f6541400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f653c0c5630 con 0x7f653c0ad310 2024-09-21T03:24:44.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.885+0000 7f6541400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f653c06fe60 con 0x7f653c14b5a0 2024-09-21T03:24:44.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.885+0000 7f653be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f653c0aaf20 0x7f653c14f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:44.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.885+0000 7f653be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f653c0aaf20 0x7f653c14f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35178/0 (socket says 172.21.15.90:35178) 2024-09-21T03:24:44.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.885+0000 7f653be00640 1 -- 172.21.15.90:0/2472508728 learned_addr learned my addr 172.21.15.90:0/2472508728 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:44.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.885+0000 7f6540a00640 1 --2- 172.21.15.90:0/2472508728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c14b5a0 0x7f653c073c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:44.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.885+0000 7f6533400640 1 --2- 172.21.15.90:0/2472508728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f653c0ad310 0x7f653c0c15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:44.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.886+0000 7f653be00640 1 -- 172.21.15.90:0/2472508728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c14b5a0 msgr2=0x7f653c073c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:44.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.886+0000 7f653be00640 1 --2- 172.21.15.90:0/2472508728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c14b5a0 0x7f653c073c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.886+0000 7f653be00640 1 -- 172.21.15.90:0/2472508728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f653c0ad310 msgr2=0x7f653c0c15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:44.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.886+0000 7f653be00640 1 --2- 172.21.15.90:0/2472508728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f653c0ad310 0x7f653c0c15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.886+0000 7f653be00640 1 -- 172.21.15.90:0/2472508728 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653c1defd0 con 0x7f653c0aaf20 2024-09-21T03:24:44.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.886+0000 7f653be00640 1 --2- 172.21.15.90:0/2472508728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f653c0aaf20 0x7f653c14f330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f652c009950 tx=0x7f652c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:44.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.886+0000 7f6538c00640 1 -- 172.21.15.90:0/2472508728 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c031d60 con 0x7f653c0aaf20 2024-09-21T03:24:44.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.886+0000 7f6538c00640 1 -- 172.21.15.90:0/2472508728 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f652c033e10 con 0x7f653c0aaf20 2024-09-21T03:24:44.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.886+0000 7f6538c00640 1 -- 172.21.15.90:0/2472508728 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c033310 con 0x7f653c0aaf20 2024-09-21T03:24:44.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.886+0000 7f6541400640 1 -- 172.21.15.90:0/2472508728 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f653c14e420 con 0x7f653c0aaf20 2024-09-21T03:24:44.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.887+0000 7f6541400640 1 -- 172.21.15.90:0/2472508728 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f653c1edc90 con 0x7f653c0aaf20 2024-09-21T03:24:44.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.888+0000 7f6541400640 1 -- 172.21.15.90:0/2472508728 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f653c070290 con 0x7f653c0aaf20 2024-09-21T03:24:44.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.889+0000 7f6538c00640 1 -- 172.21.15.90:0/2472508728 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f652c0334b0 con 0x7f653c0aaf20 2024-09-21T03:24:44.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.890+0000 7f6538c00640 1 --2- 172.21.15.90:0/2472508728 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6518078bc0 0x7f651807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:44.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.890+0000 7f6538c00640 1 -- 172.21.15.90:0/2472508728 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f652c0bc3d0 con 0x7f653c0aaf20 2024-09-21T03:24:44.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.890+0000 7f6533400640 1 --2- 172.21.15.90:0/2472508728 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6518078bc0 0x7f651807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:44.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.891+0000 7f6533400640 1 --2- 172.21.15.90:0/2472508728 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6518078bc0 0x7f651807b0d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f653c1564d0 tx=0x7f6524009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:44.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:44.894+0000 7f6538c00640 1 -- 172.21.15.90:0/2472508728 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f652c03f030 con 0x7f653c0aaf20 2024-09-21T03:24:45.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:45.094+0000 7f6541400640 1 -- 172.21.15.90:0/2472508728 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f653c0c4810 con 0x7f653c0aaf20 2024-09-21T03:24:45.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:45.095+0000 7f6538c00640 1 -- 172.21.15.90:0/2472508728 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f652c083e80 con 0x7f653c0aaf20 2024-09-21T03:24:45.097 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-21T03:24:45.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:45.097+0000 7f6541400640 1 -- 172.21.15.90:0/2472508728 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6518078bc0 msgr2=0x7f651807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:45.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:45.097+0000 7f6541400640 1 --2- 172.21.15.90:0/2472508728 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6518078bc0 0x7f651807b0d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f653c1564d0 tx=0x7f6524009040 comp rx=0 tx=0).stop 2024-09-21T03:24:45.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:45.097+0000 7f6541400640 1 -- 172.21.15.90:0/2472508728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f653c0aaf20 msgr2=0x7f653c14f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:45.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:45.097+0000 7f6541400640 1 --2- 172.21.15.90:0/2472508728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f653c0aaf20 0x7f653c14f330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f652c009950 tx=0x7f652c033c20 comp rx=0 tx=0).stop 2024-09-21T03:24:45.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:45.097+0000 7f6541400640 1 -- 172.21.15.90:0/2472508728 shutdown_connections 2024-09-21T03:24:45.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:45.097+0000 7f6541400640 1 --2- 172.21.15.90:0/2472508728 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6518078bc0 0x7f651807b0d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:45.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:45.097+0000 7f6541400640 1 --2- 172.21.15.90:0/2472508728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c14b5a0 0x7f653c073c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:45.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:45.097+0000 7f6541400640 1 --2- 172.21.15.90:0/2472508728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f653c0ad310 0x7f653c0c15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:45.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:45.097+0000 7f6541400640 1 --2- 172.21.15.90:0/2472508728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f653c0aaf20 0x7f653c14f330 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:45.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:45.097+0000 7f6541400640 1 -- 172.21.15.90:0/2472508728 >> 172.21.15.90:0/2472508728 conn(0x7f653c06d200 msgr2=0x7f653c14aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:45.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:45.097+0000 7f6541400640 1 -- 172.21.15.90:0/2472508728 shutdown_connections 2024-09-21T03:24:45.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:45.097+0000 7f6541400640 1 -- 172.21.15.90:0/2472508728 wait complete. 2024-09-21T03:24:45.125 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T03:24:45.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:45.125 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T03:24:45.227 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T03:24:45.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:45.227 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T03:24:45.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:45.315 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-21T03:24:45.410 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T03:24:45.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:45.411 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:24:45.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:45.469 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link delete ceph-brx 2024-09-21T03:24:45.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:45.760 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T03:24:45.849 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T03:24:45.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:45.850 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T03:24:45.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:45.914 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-09-21T03:24:46.299 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-21T03:24:46.309 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T03:24:46.309 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:24:46.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.531+0000 7f2598c00640 1 -- 172.21.15.90:0/688869252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2594074290 msgr2=0x7f25940746a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:46.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.531+0000 7f2598c00640 1 --2- 172.21.15.90:0/688869252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2594074290 0x7f25940746a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2594070cc0 tx=0x7f258002a4a0 comp rx=0 tx=0).stop 2024-09-21T03:24:46.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.531+0000 7f2598c00640 1 -- 172.21.15.90:0/688869252 shutdown_connections 2024-09-21T03:24:46.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.531+0000 7f2598c00640 1 --2- 172.21.15.90:0/688869252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2594074290 0x7f25940746a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:46.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.531+0000 7f2598c00640 1 --2- 172.21.15.90:0/688869252 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2594072a70 0x7f25940c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:46.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.531+0000 7f2598c00640 1 -- 172.21.15.90:0/688869252 >> 172.21.15.90:0/688869252 conn(0x7f25940c8ba0 msgr2=0x7f259406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:46.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.531+0000 7f2598c00640 1 -- 172.21.15.90:0/688869252 shutdown_connections 2024-09-21T03:24:46.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.531+0000 7f2598c00640 1 -- 172.21.15.90:0/688869252 wait complete. 2024-09-21T03:24:46.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.534+0000 7f2598c00640 1 Processor -- start 2024-09-21T03:24:46.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.534+0000 7f2598c00640 1 -- start start 2024-09-21T03:24:46.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.535+0000 7f2598c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2594072a70 0x7f25940bd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:46.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.535+0000 7f2598c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2594074290 0x7f25941ead20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:46.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.535+0000 7f2598c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2594074be0 0x7f259414ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:46.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.535+0000 7f2598c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f25940ac910 con 0x7f2594074290 2024-09-21T03:24:46.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.535+0000 7f2598c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2594073e80 con 0x7f2594072a70 2024-09-21T03:24:46.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.535+0000 7f2598c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f25940aca90 con 0x7f2594074be0 2024-09-21T03:24:46.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.535+0000 7f2591400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2594074290 0x7f25941ead20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:46.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.535+0000 7f2591e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2594072a70 0x7f25940bd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:46.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.535+0000 7f2591e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2594072a70 0x7f25940bd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:33062/0 (socket says 172.21.15.90:33062) 2024-09-21T03:24:46.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.535+0000 7f2591e00640 1 -- 172.21.15.90:0/1136527873 learned_addr learned my addr 172.21.15.90:0/1136527873 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:46.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.535+0000 7f2592800640 1 --2- 172.21.15.90:0/1136527873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2594074be0 0x7f259414ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:46.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.536+0000 7f2591400640 1 -- 172.21.15.90:0/1136527873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2594074be0 msgr2=0x7f259414ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:46.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.536+0000 7f2591400640 1 --2- 172.21.15.90:0/1136527873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2594074be0 0x7f259414ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:46.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.536+0000 7f2591400640 1 -- 172.21.15.90:0/1136527873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2594072a70 msgr2=0x7f25940bd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:46.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.536+0000 7f2591400640 1 --2- 172.21.15.90:0/1136527873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2594072a70 0x7f25940bd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:46.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.536+0000 7f2591400640 1 -- 172.21.15.90:0/1136527873 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25941580d0 con 0x7f2594074290 2024-09-21T03:24:46.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.536+0000 7f2591400640 1 --2- 172.21.15.90:0/1136527873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2594074290 0x7f25941ead20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f25940750f0 tx=0x7f2580005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:46.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.536+0000 7f258a000640 1 -- 172.21.15.90:0/1136527873 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258003e030 con 0x7f2594074290 2024-09-21T03:24:46.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.536+0000 7f258a000640 1 -- 172.21.15.90:0/1136527873 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2580031880 con 0x7f2594074290 2024-09-21T03:24:46.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.537+0000 7f2598c00640 1 -- 172.21.15.90:0/1136527873 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2594158600 con 0x7f2594074290 2024-09-21T03:24:46.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.537+0000 7f258a000640 1 -- 172.21.15.90:0/1136527873 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2580035040 con 0x7f2594074290 2024-09-21T03:24:46.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.537+0000 7f2598c00640 1 -- 172.21.15.90:0/1136527873 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2594158b80 con 0x7f2594074290 2024-09-21T03:24:46.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.538+0000 7f2598c00640 1 -- 172.21.15.90:0/1136527873 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2594157e40 con 0x7f2594074290 2024-09-21T03:24:46.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.539+0000 7f258a000640 1 -- 172.21.15.90:0/1136527873 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2580041030 con 0x7f2594074290 2024-09-21T03:24:46.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.540+0000 7f258a000640 1 --2- 172.21.15.90:0/1136527873 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2574078b90 0x7f257407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:46.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.540+0000 7f258a000640 1 -- 172.21.15.90:0/1136527873 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f25800bb810 con 0x7f2594074290 2024-09-21T03:24:46.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.540+0000 7f2591e00640 1 --2- 172.21.15.90:0/1136527873 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2574078b90 0x7f257407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:46.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.541+0000 7f2591e00640 1 --2- 172.21.15.90:0/1136527873 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2574078b90 0x7f257407b0a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f25840058c0 tx=0x7f258400a2d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:46.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.545+0000 7f258a000640 1 -- 172.21.15.90:0/1136527873 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2580083230 con 0x7f2594074290 2024-09-21T03:24:46.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.728+0000 7f2598c00640 1 -- 172.21.15.90:0/1136527873 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f25940c4210 con 0x7f2574078b90 2024-09-21T03:24:46.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.738+0000 7f258a000640 1 -- 172.21.15.90:0/1136527873 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+494039 (secure 0 0 0) 0x7f25940c4210 con 0x7f2574078b90 2024-09-21T03:24:46.748 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:24:46.751 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-21T03:24:46.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.744+0000 7f2598c00640 1 -- 172.21.15.90:0/1136527873 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2574078b90 msgr2=0x7f257407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:46.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.744+0000 7f2598c00640 1 --2- 172.21.15.90:0/1136527873 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2574078b90 0x7f257407b0a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f25840058c0 tx=0x7f258400a2d0 comp rx=0 tx=0).stop 2024-09-21T03:24:46.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.744+0000 7f2598c00640 1 -- 172.21.15.90:0/1136527873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2594074290 msgr2=0x7f25941ead20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:46.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.744+0000 7f2598c00640 1 --2- 172.21.15.90:0/1136527873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2594074290 0x7f25941ead20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f25940750f0 tx=0x7f2580005770 comp rx=0 tx=0).stop 2024-09-21T03:24:46.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.744+0000 7f2598c00640 1 -- 172.21.15.90:0/1136527873 shutdown_connections 2024-09-21T03:24:46.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.744+0000 7f2598c00640 1 --2- 172.21.15.90:0/1136527873 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2574078b90 0x7f257407b0a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:46.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.744+0000 7f2598c00640 1 --2- 172.21.15.90:0/1136527873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2594074be0 0x7f259414ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:46.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.744+0000 7f2598c00640 1 --2- 172.21.15.90:0/1136527873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2594074290 0x7f25941ead20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:46.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.744+0000 7f2598c00640 1 --2- 172.21.15.90:0/1136527873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2594072a70 0x7f25940bd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:46.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.744+0000 7f2598c00640 1 -- 172.21.15.90:0/1136527873 >> 172.21.15.90:0/1136527873 conn(0x7f25940c8ba0 msgr2=0x7f259414d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:46.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.744+0000 7f2598c00640 1 -- 172.21.15.90:0/1136527873 shutdown_connections 2024-09-21T03:24:46.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:46.744+0000 7f2598c00640 1 -- 172.21.15.90:0/1136527873 wait complete. 2024-09-21T03:24:46.769 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-09-21T03:24:44.747781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":263547094,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":126,"num_read_kb":267,"num_write":5735608,"num_write_kb":66239735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":395567,"ondisk_log_size":395567,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4218896,"kb_used_data":517072,"kb_used_omap":12,"kb_used_meta":3701683,"kb_avail":750755824,"statfs":{"total":773094113280,"available":768773963776,"internally_reserved":0,"allocated":529481728,"data_stored":528009700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":3790523952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6216517101,"num_objects":-1881,"num_object_clones":0,"num_object_copies":-3762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1881,"num_whiteouts":0,"num_read":2,"num_read_kb":13,"num_write":1899,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004452"},"pg_stats":[{"pgid":"5.18","version":"27'2947","reported_seq":2968,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.629291+0000","last_change":"2024-09-21T03:14:47.552762+0000","last_active":"2024-09-21T03:24:32.629291+0000","last_peered":"2024-09-21T03:24:32.629291+0000","last_clean":"2024-09-21T03:24:32.629291+0000","last_became_active":"2024-09-21T03:14:47.551883+0000","last_became_peered":"2024-09-21T03:14:47.551883+0000","last_unstale":"2024-09-21T03:24:32.629291+0000","last_undegraded":"2024-09-21T03:24:32.629291+0000","last_fullsized":"2024-09-21T03:24:32.629291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2947,"log_dups_size":0,"ondisk_log_size":2947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:51.935797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42893,"num_write_kb":435375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"27'180","reported_seq":211,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:27.833686+0000","last_change":"2024-09-21T03:14:37.471004+0000","last_active":"2024-09-21T03:24:27.833686+0000","last_peered":"2024-09-21T03:24:27.833686+0000","last_clean":"2024-09-21T03:24:27.833686+0000","last_became_active":"2024-09-21T03:14:37.470563+0000","last_became_peered":"2024-09-21T03:14:37.470563+0000","last_unstale":"2024-09-21T03:24:27.833686+0000","last_undegraded":"2024-09-21T03:24:27.833686+0000","last_fullsized":"2024-09-21T03:24:27.833686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.422826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7183897,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":7086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'3324","reported_seq":3353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.075853+0000","last_change":"2024-09-21T03:14:38.496252+0000","last_active":"2024-09-21T03:24:32.075853+0000","last_peered":"2024-09-21T03:24:32.075853+0000","last_clean":"2024-09-21T03:24:32.075853+0000","last_became_active":"2024-09-21T03:14:38.488292+0000","last_became_peered":"2024-09-21T03:14:38.488292+0000","last_unstale":"2024-09-21T03:24:32.075853+0000","last_undegraded":"2024-09-21T03:24:32.075853+0000","last_fullsized":"2024-09-21T03:24:32.075853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3324,"log_dups_size":0,"ondisk_log_size":3324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:57.409792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49408,"num_write_kb":622324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.561928+0000","last_change":"2024-09-21T03:14:46.549877+0000","last_active":"2024-09-21T03:24:32.561928+0000","last_peered":"2024-09-21T03:24:32.561928+0000","last_clean":"2024-09-21T03:24:32.561928+0000","last_became_active":"2024-09-21T03:14:46.549536+0000","last_became_peered":"2024-09-21T03:14:46.549536+0000","last_unstale":"2024-09-21T03:24:32.561928+0000","last_undegraded":"2024-09-21T03:24:32.561928+0000","last_fullsized":"2024-09-21T03:24:32.561928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:57.491042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"27'3452","reported_seq":3473,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.628689+0000","last_change":"2024-09-21T03:14:47.560303+0000","last_active":"2024-09-21T03:24:32.628689+0000","last_peered":"2024-09-21T03:24:32.628689+0000","last_clean":"2024-09-21T03:24:32.628689+0000","last_became_active":"2024-09-21T03:14:47.559659+0000","last_became_peered":"2024-09-21T03:14:47.559659+0000","last_unstale":"2024-09-21T03:24:32.628689+0000","last_undegraded":"2024-09-21T03:24:32.628689+0000","last_fullsized":"2024-09-21T03:24:32.628689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3452,"log_dups_size":0,"ondisk_log_size":3452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:49.328036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50427,"num_write_kb":517490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"27'10","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.175109+0000","last_change":"2024-09-21T03:14:37.467448+0000","last_active":"2024-09-21T03:24:32.175109+0000","last_peered":"2024-09-21T03:24:32.175109+0000","last_clean":"2024-09-21T03:24:32.175109+0000","last_became_active":"2024-09-21T03:14:37.467146+0000","last_became_peered":"2024-09-21T03:14:37.467146+0000","last_unstale":"2024-09-21T03:24:32.175109+0000","last_undegraded":"2024-09-21T03:24:32.175109+0000","last_fullsized":"2024-09-21T03:24:32.175109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:53.475083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'3686","reported_seq":3715,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.191304+0000","last_change":"2024-09-21T03:14:38.486401+0000","last_active":"2024-09-21T03:24:32.191304+0000","last_peered":"2024-09-21T03:24:32.191304+0000","last_clean":"2024-09-21T03:24:32.191304+0000","last_became_active":"2024-09-21T03:14:38.486090+0000","last_became_peered":"2024-09-21T03:14:38.486090+0000","last_unstale":"2024-09-21T03:24:32.191304+0000","last_undegraded":"2024-09-21T03:24:32.191304+0000","last_fullsized":"2024-09-21T03:24:32.191304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3686,"log_dups_size":0,"ondisk_log_size":3686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:44.085100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54471,"num_write_kb":691181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'47","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.589575+0000","last_change":"2024-09-21T03:14:46.541705+0000","last_active":"2024-09-21T03:24:32.589575+0000","last_peered":"2024-09-21T03:24:32.589575+0000","last_clean":"2024-09-21T03:24:32.589575+0000","last_became_active":"2024-09-21T03:14:46.541357+0000","last_became_peered":"2024-09-21T03:14:46.541357+0000","last_unstale":"2024-09-21T03:24:32.589575+0000","last_undegraded":"2024-09-21T03:24:32.589575+0000","last_fullsized":"2024-09-21T03:24:32.589575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:31.082059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":8225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"27'2616","reported_seq":2638,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.576773+0000","last_change":"2024-09-21T03:18:52.567667+0000","last_active":"2024-09-21T03:24:32.576773+0000","last_peered":"2024-09-21T03:24:32.576773+0000","last_clean":"2024-09-21T03:24:32.576773+0000","last_became_active":"2024-09-21T03:14:47.553312+0000","last_became_peered":"2024-09-21T03:14:47.553312+0000","last_unstale":"2024-09-21T03:24:32.576773+0000","last_undegraded":"2024-09-21T03:24:32.576773+0000","last_fullsized":"2024-09-21T03:24:32.576773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2616,"log_dups_size":0,"ondisk_log_size":2616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:07.314491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37737,"num_write_kb":383006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"27'42","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.177365+0000","last_change":"2024-09-21T03:14:37.478711+0000","last_active":"2024-09-21T03:24:32.177365+0000","last_peered":"2024-09-21T03:24:32.177365+0000","last_clean":"2024-09-21T03:24:32.177365+0000","last_became_active":"2024-09-21T03:14:37.477910+0000","last_became_peered":"2024-09-21T03:14:37.477910+0000","last_unstale":"2024-09-21T03:24:32.177365+0000","last_undegraded":"2024-09-21T03:24:32.177365+0000","last_fullsized":"2024-09-21T03:24:32.177365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:40.166966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2276","reported_seq":2305,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.257589+0000","last_change":"2024-09-21T03:14:38.472992+0000","last_active":"2024-09-21T03:24:32.257589+0000","last_peered":"2024-09-21T03:24:32.257589+0000","last_clean":"2024-09-21T03:24:32.257589+0000","last_became_active":"2024-09-21T03:14:38.472426+0000","last_became_peered":"2024-09-21T03:14:38.472426+0000","last_unstale":"2024-09-21T03:24:32.257589+0000","last_undegraded":"2024-09-21T03:24:32.257589+0000","last_fullsized":"2024-09-21T03:24:32.257589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2276,"log_dups_size":0,"ondisk_log_size":2276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:36.825612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33481,"num_write_kb":420875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1061","reported_seq":1083,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:22:20.318571+0000","last_change":"2024-09-21T03:14:46.526996+0000","last_active":"2024-09-21T03:22:20.318571+0000","last_peered":"2024-09-21T03:22:20.318571+0000","last_clean":"2024-09-21T03:22:20.318571+0000","last_became_active":"2024-09-21T03:14:46.525587+0000","last_became_peered":"2024-09-21T03:14:46.525587+0000","last_unstale":"2024-09-21T03:22:20.318571+0000","last_undegraded":"2024-09-21T03:22:20.318571+0000","last_fullsized":"2024-09-21T03:22:20.318571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1061,"log_dups_size":0,"ondisk_log_size":1061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:56.977126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1059,"num_write_kb":5042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"27'2261","reported_seq":2281,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.556511+0000","last_change":"2024-09-21T03:14:47.554143+0000","last_active":"2024-09-21T03:24:32.556511+0000","last_peered":"2024-09-21T03:24:32.556511+0000","last_clean":"2024-09-21T03:24:32.556511+0000","last_became_active":"2024-09-21T03:14:47.553802+0000","last_became_peered":"2024-09-21T03:14:47.553802+0000","last_unstale":"2024-09-21T03:24:32.556511+0000","last_undegraded":"2024-09-21T03:24:32.556511+0000","last_fullsized":"2024-09-21T03:24:32.556511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2261,"log_dups_size":0,"ondisk_log_size":2261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:37.963442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32861,"num_write_kb":341635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'13","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.222962+0000","last_change":"2024-09-21T03:14:37.479842+0000","last_active":"2024-09-21T03:24:32.222962+0000","last_peered":"2024-09-21T03:24:32.222962+0000","last_clean":"2024-09-21T03:24:32.222962+0000","last_became_active":"2024-09-21T03:14:37.478893+0000","last_became_peered":"2024-09-21T03:14:37.478893+0000","last_unstale":"2024-09-21T03:24:32.222962+0000","last_undegraded":"2024-09-21T03:24:32.222962+0000","last_fullsized":"2024-09-21T03:24:32.222962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:27.916133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'3847","reported_seq":3875,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.146830+0000","last_change":"2024-09-21T03:14:38.468756+0000","last_active":"2024-09-21T03:24:32.146830+0000","last_peered":"2024-09-21T03:24:32.146830+0000","last_clean":"2024-09-21T03:24:32.146830+0000","last_became_active":"2024-09-21T03:14:38.467570+0000","last_became_peered":"2024-09-21T03:14:38.467570+0000","last_unstale":"2024-09-21T03:24:32.146830+0000","last_undegraded":"2024-09-21T03:24:32.146830+0000","last_fullsized":"2024-09-21T03:24:32.146830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3847,"log_dups_size":0,"ondisk_log_size":3847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:24.784157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57219,"num_write_kb":702431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'50","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.574104+0000","last_change":"2024-09-21T03:14:46.529932+0000","last_active":"2024-09-21T03:24:32.574104+0000","last_peered":"2024-09-21T03:24:32.574104+0000","last_clean":"2024-09-21T03:24:32.574104+0000","last_became_active":"2024-09-21T03:14:46.529629+0000","last_became_peered":"2024-09-21T03:14:46.529629+0000","last_unstale":"2024-09-21T03:24:32.574104+0000","last_undegraded":"2024-09-21T03:24:32.574104+0000","last_fullsized":"2024-09-21T03:24:32.574104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:39.808494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":8220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"27'3143","reported_seq":3164,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.603802+0000","last_change":"2024-09-21T03:14:47.547724+0000","last_active":"2024-09-21T03:24:32.603802+0000","last_peered":"2024-09-21T03:24:32.603802+0000","last_clean":"2024-09-21T03:24:32.603802+0000","last_became_active":"2024-09-21T03:14:47.546770+0000","last_became_peered":"2024-09-21T03:14:47.546770+0000","last_unstale":"2024-09-21T03:24:32.603802+0000","last_undegraded":"2024-09-21T03:24:32.603802+0000","last_fullsized":"2024-09-21T03:24:32.603802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3143,"log_dups_size":0,"ondisk_log_size":3143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:31.476710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45697,"num_write_kb":467369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"27'2911","reported_seq":2940,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.013492+0000","last_change":"2024-09-21T03:14:38.476747+0000","last_active":"2024-09-21T03:24:32.013492+0000","last_peered":"2024-09-21T03:24:32.013492+0000","last_clean":"2024-09-21T03:24:32.013492+0000","last_became_active":"2024-09-21T03:14:38.476386+0000","last_became_peered":"2024-09-21T03:14:38.476386+0000","last_unstale":"2024-09-21T03:24:32.013492+0000","last_undegraded":"2024-09-21T03:24:32.013492+0000","last_fullsized":"2024-09-21T03:24:32.013492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:28.751991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43116,"num_write_kb":539220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'226","reported_seq":257,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.178813+0000","last_change":"2024-09-21T03:14:37.463164+0000","last_active":"2024-09-21T03:24:32.178813+0000","last_peered":"2024-09-21T03:24:32.178813+0000","last_clean":"2024-09-21T03:24:32.178813+0000","last_became_active":"2024-09-21T03:14:37.461409+0000","last_became_peered":"2024-09-21T03:14:37.461409+0000","last_unstale":"2024-09-21T03:24:32.178813+0000","last_undegraded":"2024-09-21T03:24:32.178813+0000","last_fullsized":"2024-09-21T03:24:32.178813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:51.126291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":8373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'25","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:23:51.616959+0000","last_change":"2024-09-21T03:14:46.538480+0000","last_active":"2024-09-21T03:23:51.616959+0000","last_peered":"2024-09-21T03:23:51.616959+0000","last_clean":"2024-09-21T03:23:51.616959+0000","last_became_active":"2024-09-21T03:14:46.537493+0000","last_became_peered":"2024-09-21T03:14:46.537493+0000","last_unstale":"2024-09-21T03:23:51.616959+0000","last_undegraded":"2024-09-21T03:23:51.616959+0000","last_fullsized":"2024-09-21T03:23:51.616959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:52.769190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"27'3059","reported_seq":3080,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.617887+0000","last_change":"2024-09-21T03:14:47.580512+0000","last_active":"2024-09-21T03:24:32.617887+0000","last_peered":"2024-09-21T03:24:32.617887+0000","last_clean":"2024-09-21T03:24:32.617887+0000","last_became_active":"2024-09-21T03:14:47.580210+0000","last_became_peered":"2024-09-21T03:14:47.580210+0000","last_unstale":"2024-09-21T03:24:32.617887+0000","last_undegraded":"2024-09-21T03:24:32.617887+0000","last_fullsized":"2024-09-21T03:24:32.617887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3059,"log_dups_size":0,"ondisk_log_size":3059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:20.192190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44544,"num_write_kb":453960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"27'2505","reported_seq":2534,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.178918+0000","last_change":"2024-09-21T03:14:38.494021+0000","last_active":"2024-09-21T03:24:32.178918+0000","last_peered":"2024-09-21T03:24:32.178918+0000","last_clean":"2024-09-21T03:24:32.178918+0000","last_became_active":"2024-09-21T03:14:38.486802+0000","last_became_peered":"2024-09-21T03:14:38.486802+0000","last_unstale":"2024-09-21T03:24:32.178918+0000","last_undegraded":"2024-09-21T03:24:32.178918+0000","last_fullsized":"2024-09-21T03:24:32.178918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2505,"log_dups_size":0,"ondisk_log_size":2505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:31.817505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37114,"num_write_kb":476028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'16","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.188248+0000","last_change":"2024-09-21T03:14:37.465907+0000","last_active":"2024-09-21T03:24:32.188248+0000","last_peered":"2024-09-21T03:24:32.188248+0000","last_clean":"2024-09-21T03:24:32.188248+0000","last_became_active":"2024-09-21T03:14:37.465551+0000","last_became_peered":"2024-09-21T03:14:37.465551+0000","last_unstale":"2024-09-21T03:24:32.188248+0000","last_undegraded":"2024-09-21T03:24:32.188248+0000","last_fullsized":"2024-09-21T03:24:32.188248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:10.599687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:23:48.015021+0000","last_change":"2024-09-21T03:14:46.546737+0000","last_active":"2024-09-21T03:23:48.015021+0000","last_peered":"2024-09-21T03:23:48.015021+0000","last_clean":"2024-09-21T03:23:48.015021+0000","last_became_active":"2024-09-21T03:14:46.546312+0000","last_became_peered":"2024-09-21T03:14:46.546312+0000","last_unstale":"2024-09-21T03:23:48.015021+0000","last_undegraded":"2024-09-21T03:23:48.015021+0000","last_fullsized":"2024-09-21T03:23:48.015021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:03.939168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"27'2654","reported_seq":2675,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.550798+0000","last_change":"2024-09-21T03:14:47.558742+0000","last_active":"2024-09-21T03:24:32.550798+0000","last_peered":"2024-09-21T03:24:32.550798+0000","last_clean":"2024-09-21T03:24:32.550798+0000","last_became_active":"2024-09-21T03:14:47.558431+0000","last_became_peered":"2024-09-21T03:14:47.558431+0000","last_unstale":"2024-09-21T03:24:32.550798+0000","last_undegraded":"2024-09-21T03:24:32.550798+0000","last_fullsized":"2024-09-21T03:24:32.550798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2654,"log_dups_size":0,"ondisk_log_size":2654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:32.053674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38628,"num_write_kb":413288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"27'3218","reported_seq":3247,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.073723+0000","last_change":"2024-09-21T03:14:38.479370+0000","last_active":"2024-09-21T03:24:32.073723+0000","last_peered":"2024-09-21T03:24:32.073723+0000","last_clean":"2024-09-21T03:24:32.073723+0000","last_became_active":"2024-09-21T03:14:38.476976+0000","last_became_peered":"2024-09-21T03:14:38.476976+0000","last_unstale":"2024-09-21T03:24:32.073723+0000","last_undegraded":"2024-09-21T03:24:32.073723+0000","last_fullsized":"2024-09-21T03:24:32.073723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3218,"log_dups_size":0,"ondisk_log_size":3218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:14.695819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47858,"num_write_kb":595125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'15","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.163168+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:24:32.163168+0000","last_peered":"2024-09-21T03:24:32.163168+0000","last_clean":"2024-09-21T03:24:32.163168+0000","last_became_active":"2024-09-21T03:14:37.478840+0000","last_became_peered":"2024-09-21T03:14:37.478840+0000","last_unstale":"2024-09-21T03:24:32.163168+0000","last_undegraded":"2024-09-21T03:24:32.163168+0000","last_fullsized":"2024-09-21T03:24:32.163168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:00.964354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'24","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.596135+0000","last_change":"2024-09-21T03:14:46.543085+0000","last_active":"2024-09-21T03:24:32.596135+0000","last_peered":"2024-09-21T03:24:32.596135+0000","last_clean":"2024-09-21T03:24:32.596135+0000","last_became_active":"2024-09-21T03:14:46.542721+0000","last_became_peered":"2024-09-21T03:14:46.542721+0000","last_unstale":"2024-09-21T03:24:32.596135+0000","last_undegraded":"2024-09-21T03:24:32.596135+0000","last_fullsized":"2024-09-21T03:24:32.596135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:05.590871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"27'3348","reported_seq":3369,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.570062+0000","last_change":"2024-09-21T03:14:47.566806+0000","last_active":"2024-09-21T03:24:32.570062+0000","last_peered":"2024-09-21T03:24:32.570062+0000","last_clean":"2024-09-21T03:24:32.570062+0000","last_became_active":"2024-09-21T03:14:47.566634+0000","last_became_peered":"2024-09-21T03:14:47.566634+0000","last_unstale":"2024-09-21T03:24:32.570062+0000","last_undegraded":"2024-09-21T03:24:32.570062+0000","last_fullsized":"2024-09-21T03:24:32.570062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3348,"log_dups_size":0,"ondisk_log_size":3348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:03.997294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48633,"num_write_kb":505858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'2922","reported_seq":2951,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.150348+0000","last_change":"2024-09-21T03:14:38.482658+0000","last_active":"2024-09-21T03:24:32.150348+0000","last_peered":"2024-09-21T03:24:32.150348+0000","last_clean":"2024-09-21T03:24:32.150348+0000","last_became_active":"2024-09-21T03:14:38.482369+0000","last_became_peered":"2024-09-21T03:14:38.482369+0000","last_unstale":"2024-09-21T03:24:32.150348+0000","last_undegraded":"2024-09-21T03:24:32.150348+0000","last_fullsized":"2024-09-21T03:24:32.150348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2922,"log_dups_size":0,"ondisk_log_size":2922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:36.682534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43307,"num_write_kb":537343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'15","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.146260+0000","last_change":"2024-09-21T03:14:37.472962+0000","last_active":"2024-09-21T03:24:32.146260+0000","last_peered":"2024-09-21T03:24:32.146260+0000","last_clean":"2024-09-21T03:24:32.146260+0000","last_became_active":"2024-09-21T03:14:37.472271+0000","last_became_peered":"2024-09-21T03:14:37.472271+0000","last_unstale":"2024-09-21T03:24:32.146260+0000","last_undegraded":"2024-09-21T03:24:32.146260+0000","last_fullsized":"2024-09-21T03:24:32.146260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:54.952223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'30","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.602142+0000","last_change":"2024-09-21T03:14:46.537137+0000","last_active":"2024-09-21T03:24:32.602142+0000","last_peered":"2024-09-21T03:24:32.602142+0000","last_clean":"2024-09-21T03:24:32.602142+0000","last_became_active":"2024-09-21T03:14:46.536791+0000","last_became_peered":"2024-09-21T03:14:46.536791+0000","last_unstale":"2024-09-21T03:24:32.602142+0000","last_undegraded":"2024-09-21T03:24:32.602142+0000","last_fullsized":"2024-09-21T03:24:32.602142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:43.186807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"27'2818","reported_seq":2839,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.593330+0000","last_change":"2024-09-21T03:14:47.555605+0000","last_active":"2024-09-21T03:24:32.593330+0000","last_peered":"2024-09-21T03:24:32.593330+0000","last_clean":"2024-09-21T03:24:32.593330+0000","last_became_active":"2024-09-21T03:14:47.555329+0000","last_became_peered":"2024-09-21T03:14:47.555329+0000","last_unstale":"2024-09-21T03:24:32.593330+0000","last_undegraded":"2024-09-21T03:24:32.593330+0000","last_fullsized":"2024-09-21T03:24:32.593330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2818,"log_dups_size":0,"ondisk_log_size":2818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:24.271656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40983,"num_write_kb":424268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'2668","reported_seq":2697,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.107207+0000","last_change":"2024-09-21T03:14:38.479133+0000","last_active":"2024-09-21T03:24:32.107207+0000","last_peered":"2024-09-21T03:24:32.107207+0000","last_clean":"2024-09-21T03:24:32.107207+0000","last_became_active":"2024-09-21T03:14:38.478077+0000","last_became_peered":"2024-09-21T03:14:38.478077+0000","last_unstale":"2024-09-21T03:24:32.107207+0000","last_undegraded":"2024-09-21T03:24:32.107207+0000","last_fullsized":"2024-09-21T03:24:32.107207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2668,"log_dups_size":0,"ondisk_log_size":2668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:56.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39231,"num_write_kb":490681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'10","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.193121+0000","last_change":"2024-09-21T03:14:37.480508+0000","last_active":"2024-09-21T03:24:32.193121+0000","last_peered":"2024-09-21T03:24:32.193121+0000","last_clean":"2024-09-21T03:24:32.193121+0000","last_became_active":"2024-09-21T03:14:37.480218+0000","last_became_peered":"2024-09-21T03:14:37.480218+0000","last_unstale":"2024-09-21T03:24:32.193121+0000","last_undegraded":"2024-09-21T03:24:32.193121+0000","last_fullsized":"2024-09-21T03:24:32.193121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:01.851380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'33","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:34.548248+0000","last_change":"2024-09-21T03:14:46.531615+0000","last_active":"2024-09-21T03:24:34.548248+0000","last_peered":"2024-09-21T03:24:34.548248+0000","last_clean":"2024-09-21T03:24:34.548248+0000","last_became_active":"2024-09-21T03:14:46.531289+0000","last_became_peered":"2024-09-21T03:14:46.531289+0000","last_unstale":"2024-09-21T03:24:34.548248+0000","last_undegraded":"2024-09-21T03:24:34.548248+0000","last_fullsized":"2024-09-21T03:24:34.548248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:10.145489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":107,"num_write":31,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"27'2914","reported_seq":2935,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.562112+0000","last_change":"2024-09-21T03:14:47.552705+0000","last_active":"2024-09-21T03:24:32.562112+0000","last_peered":"2024-09-21T03:24:32.562112+0000","last_clean":"2024-09-21T03:24:32.562112+0000","last_became_active":"2024-09-21T03:14:47.552367+0000","last_became_peered":"2024-09-21T03:14:47.552367+0000","last_unstale":"2024-09-21T03:24:32.562112+0000","last_undegraded":"2024-09-21T03:24:32.562112+0000","last_fullsized":"2024-09-21T03:24:32.562112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2914,"log_dups_size":0,"ondisk_log_size":2914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:45.379581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42429,"num_write_kb":431357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'3263","reported_seq":3292,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.150759+0000","last_change":"2024-09-21T03:14:38.475318+0000","last_active":"2024-09-21T03:24:32.150759+0000","last_peered":"2024-09-21T03:24:32.150759+0000","last_clean":"2024-09-21T03:24:32.150759+0000","last_became_active":"2024-09-21T03:14:38.474978+0000","last_became_peered":"2024-09-21T03:14:38.474978+0000","last_unstale":"2024-09-21T03:24:32.150759+0000","last_undegraded":"2024-09-21T03:24:32.150759+0000","last_fullsized":"2024-09-21T03:24:32.150759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3263,"log_dups_size":0,"ondisk_log_size":3263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:38.209624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48313,"num_write_kb":579677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'319","reported_seq":350,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.185601+0000","last_change":"2024-09-21T03:14:37.479651+0000","last_active":"2024-09-21T03:24:32.185601+0000","last_peered":"2024-09-21T03:24:32.185601+0000","last_clean":"2024-09-21T03:24:32.185601+0000","last_became_active":"2024-09-21T03:14:37.478833+0000","last_became_peered":"2024-09-21T03:14:37.478833+0000","last_unstale":"2024-09-21T03:24:32.185601+0000","last_undegraded":"2024-09-21T03:24:32.185601+0000","last_fullsized":"2024-09-21T03:24:32.185601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:48.578637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'48","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.593440+0000","last_change":"2024-09-21T03:14:46.536054+0000","last_active":"2024-09-21T03:24:32.593440+0000","last_peered":"2024-09-21T03:24:32.593440+0000","last_clean":"2024-09-21T03:24:32.593440+0000","last_became_active":"2024-09-21T03:14:46.535569+0000","last_became_peered":"2024-09-21T03:14:46.535569+0000","last_unstale":"2024-09-21T03:24:32.593440+0000","last_undegraded":"2024-09-21T03:24:32.593440+0000","last_fullsized":"2024-09-21T03:24:32.593440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:04.556059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":8210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"27'3102","reported_seq":3123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.505571+0000","last_change":"2024-09-21T03:14:47.571889+0000","last_active":"2024-09-21T03:24:32.505571+0000","last_peered":"2024-09-21T03:24:32.505571+0000","last_clean":"2024-09-21T03:24:32.505571+0000","last_became_active":"2024-09-21T03:14:47.571620+0000","last_became_peered":"2024-09-21T03:14:47.571620+0000","last_unstale":"2024-09-21T03:24:32.505571+0000","last_undegraded":"2024-09-21T03:24:32.505571+0000","last_fullsized":"2024-09-21T03:24:32.505571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3102,"log_dups_size":0,"ondisk_log_size":3102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:23.103973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45309,"num_write_kb":459474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"27'3313","reported_seq":3336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.493139+0000","last_change":"2024-09-21T03:14:38.493350+0000","last_active":"2024-09-21T03:24:44.493139+0000","last_peered":"2024-09-21T03:24:44.493139+0000","last_clean":"2024-09-21T03:24:44.493139+0000","last_became_active":"2024-09-21T03:14:38.492830+0000","last_became_peered":"2024-09-21T03:14:38.492830+0000","last_unstale":"2024-09-21T03:24:44.493139+0000","last_undegraded":"2024-09-21T03:24:44.493139+0000","last_fullsized":"2024-09-21T03:24:44.493139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3313,"log_dups_size":0,"ondisk_log_size":3313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:19.946319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48841,"num_write_kb":610665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'18","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.156028+0000","last_change":"2024-09-21T03:14:37.473484+0000","last_active":"2024-09-21T03:24:32.156028+0000","last_peered":"2024-09-21T03:24:32.156028+0000","last_clean":"2024-09-21T03:24:32.156028+0000","last_became_active":"2024-09-21T03:14:37.473218+0000","last_became_peered":"2024-09-21T03:14:37.473218+0000","last_unstale":"2024-09-21T03:24:32.156028+0000","last_undegraded":"2024-09-21T03:24:32.156028+0000","last_fullsized":"2024-09-21T03:24:32.156028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:49.006579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:21:06.027900+0000","last_change":"2024-09-21T03:14:46.548858+0000","last_active":"2024-09-21T03:21:06.027900+0000","last_peered":"2024-09-21T03:21:06.027900+0000","last_clean":"2024-09-21T03:21:06.027900+0000","last_became_active":"2024-09-21T03:14:46.548166+0000","last_became_peered":"2024-09-21T03:14:46.548166+0000","last_unstale":"2024-09-21T03:21:06.027900+0000","last_undegraded":"2024-09-21T03:21:06.027900+0000","last_fullsized":"2024-09-21T03:21:06.027900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:41.470072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"27'2790","reported_seq":2811,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.569277+0000","last_change":"2024-09-21T03:14:47.555787+0000","last_active":"2024-09-21T03:24:32.569277+0000","last_peered":"2024-09-21T03:24:32.569277+0000","last_clean":"2024-09-21T03:24:32.569277+0000","last_became_active":"2024-09-21T03:14:47.555420+0000","last_became_peered":"2024-09-21T03:14:47.555420+0000","last_unstale":"2024-09-21T03:24:32.569277+0000","last_undegraded":"2024-09-21T03:24:32.569277+0000","last_fullsized":"2024-09-21T03:24:32.569277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:45.769786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40658,"num_write_kb":422641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"27'2810","reported_seq":2839,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.135133+0000","last_change":"2024-09-21T03:14:38.479657+0000","last_active":"2024-09-21T03:24:32.135133+0000","last_peered":"2024-09-21T03:24:32.135133+0000","last_clean":"2024-09-21T03:24:32.135133+0000","last_became_active":"2024-09-21T03:14:38.479439+0000","last_became_peered":"2024-09-21T03:14:38.479439+0000","last_unstale":"2024-09-21T03:24:32.135133+0000","last_undegraded":"2024-09-21T03:24:32.135133+0000","last_fullsized":"2024-09-21T03:24:32.135133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2810,"log_dups_size":0,"ondisk_log_size":2810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.107215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41573,"num_write_kb":525350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.151982+0000","last_change":"2024-09-21T03:14:37.469799+0000","last_active":"2024-09-21T03:24:32.151982+0000","last_peered":"2024-09-21T03:24:32.151982+0000","last_clean":"2024-09-21T03:24:32.151982+0000","last_became_active":"2024-09-21T03:14:37.469495+0000","last_became_peered":"2024-09-21T03:14:37.469495+0000","last_unstale":"2024-09-21T03:24:32.151982+0000","last_undegraded":"2024-09-21T03:24:32.151982+0000","last_fullsized":"2024-09-21T03:24:32.151982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:50.247050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'51","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.593953+0000","last_change":"2024-09-21T03:14:46.544320+0000","last_active":"2024-09-21T03:24:32.593953+0000","last_peered":"2024-09-21T03:24:32.593953+0000","last_clean":"2024-09-21T03:24:32.593953+0000","last_became_active":"2024-09-21T03:14:46.544038+0000","last_became_peered":"2024-09-21T03:14:46.544038+0000","last_unstale":"2024-09-21T03:24:32.593953+0000","last_undegraded":"2024-09-21T03:24:32.593953+0000","last_fullsized":"2024-09-21T03:24:32.593953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:57.457687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"27'2669","reported_seq":2696,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.562242+0000","last_change":"2024-09-21T03:19:03.606923+0000","last_active":"2024-09-21T03:24:32.562242+0000","last_peered":"2024-09-21T03:24:32.562242+0000","last_clean":"2024-09-21T03:24:32.562242+0000","last_became_active":"2024-09-21T03:14:47.579324+0000","last_became_peered":"2024-09-21T03:14:47.579324+0000","last_unstale":"2024-09-21T03:24:32.562242+0000","last_undegraded":"2024-09-21T03:24:32.562242+0000","last_fullsized":"2024-09-21T03:24:32.562242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2669,"log_dups_size":0,"ondisk_log_size":2669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:37.656859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38848,"num_write_kb":393078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"27'3049","reported_seq":3078,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.151499+0000","last_change":"2024-09-21T03:14:38.476763+0000","last_active":"2024-09-21T03:24:32.151499+0000","last_peered":"2024-09-21T03:24:32.151499+0000","last_clean":"2024-09-21T03:24:32.151499+0000","last_became_active":"2024-09-21T03:14:38.474299+0000","last_became_peered":"2024-09-21T03:14:38.474299+0000","last_unstale":"2024-09-21T03:24:32.151499+0000","last_undegraded":"2024-09-21T03:24:32.151499+0000","last_fullsized":"2024-09-21T03:24:32.151499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3049,"log_dups_size":0,"ondisk_log_size":3049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:46.544930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45199,"num_write_kb":565597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'28","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.185284+0000","last_change":"2024-09-21T03:14:37.466857+0000","last_active":"2024-09-21T03:24:32.185284+0000","last_peered":"2024-09-21T03:24:32.185284+0000","last_clean":"2024-09-21T03:24:32.185284+0000","last_became_active":"2024-09-21T03:14:37.466256+0000","last_became_peered":"2024-09-21T03:14:37.466256+0000","last_unstale":"2024-09-21T03:24:32.185284+0000","last_undegraded":"2024-09-21T03:24:32.185284+0000","last_fullsized":"2024-09-21T03:24:32.185284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:02.240461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'5","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.569629+0000","last_change":"2024-09-21T03:14:46.537315+0000","last_active":"2024-09-21T03:24:32.569629+0000","last_peered":"2024-09-21T03:24:32.569629+0000","last_clean":"2024-09-21T03:24:32.569629+0000","last_became_active":"2024-09-21T03:14:46.536975+0000","last_became_peered":"2024-09-21T03:14:46.536975+0000","last_unstale":"2024-09-21T03:24:32.569629+0000","last_undegraded":"2024-09-21T03:24:32.569629+0000","last_fullsized":"2024-09-21T03:24:32.569629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:42.529591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"27'2491","reported_seq":2512,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.547078+0000","last_change":"2024-09-21T03:14:47.573009+0000","last_active":"2024-09-21T03:24:32.547078+0000","last_peered":"2024-09-21T03:24:32.547078+0000","last_clean":"2024-09-21T03:24:32.547078+0000","last_became_active":"2024-09-21T03:14:47.572395+0000","last_became_peered":"2024-09-21T03:14:47.572395+0000","last_unstale":"2024-09-21T03:24:32.547078+0000","last_undegraded":"2024-09-21T03:24:32.547078+0000","last_fullsized":"2024-09-21T03:24:32.547078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2491,"log_dups_size":0,"ondisk_log_size":2491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:41.733447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35860,"num_write_kb":370109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"27'2986","reported_seq":3015,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.187830+0000","last_change":"2024-09-21T03:14:38.481801+0000","last_active":"2024-09-21T03:24:32.187830+0000","last_peered":"2024-09-21T03:24:32.187830+0000","last_clean":"2024-09-21T03:24:32.187830+0000","last_became_active":"2024-09-21T03:14:38.481186+0000","last_became_peered":"2024-09-21T03:14:38.481186+0000","last_unstale":"2024-09-21T03:24:32.187830+0000","last_undegraded":"2024-09-21T03:24:32.187830+0000","last_fullsized":"2024-09-21T03:24:32.187830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2986,"log_dups_size":0,"ondisk_log_size":2986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:54.271470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44221,"num_write_kb":552392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'31","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:31.011851+0000","last_change":"2024-09-21T03:14:37.474798+0000","last_active":"2024-09-21T03:24:31.011851+0000","last_peered":"2024-09-21T03:24:31.011851+0000","last_clean":"2024-09-21T03:24:31.011851+0000","last_became_active":"2024-09-21T03:14:37.473829+0000","last_became_peered":"2024-09-21T03:14:37.473829+0000","last_unstale":"2024-09-21T03:24:31.011851+0000","last_undegraded":"2024-09-21T03:24:31.011851+0000","last_fullsized":"2024-09-21T03:24:31.011851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:11.571814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":105,"num_write":29,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'5","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.581221+0000","last_change":"2024-09-21T03:14:46.542495+0000","last_active":"2024-09-21T03:24:32.581221+0000","last_peered":"2024-09-21T03:24:32.581221+0000","last_clean":"2024-09-21T03:24:32.581221+0000","last_became_active":"2024-09-21T03:14:46.542181+0000","last_became_peered":"2024-09-21T03:14:46.542181+0000","last_unstale":"2024-09-21T03:24:32.581221+0000","last_undegraded":"2024-09-21T03:24:32.581221+0000","last_fullsized":"2024-09-21T03:24:32.581221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:22.481477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"27'2890","reported_seq":2911,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.568552+0000","last_change":"2024-09-21T03:14:47.569409+0000","last_active":"2024-09-21T03:24:32.568552+0000","last_peered":"2024-09-21T03:24:32.568552+0000","last_clean":"2024-09-21T03:24:32.568552+0000","last_became_active":"2024-09-21T03:14:47.569212+0000","last_became_peered":"2024-09-21T03:14:47.569212+0000","last_unstale":"2024-09-21T03:24:32.568552+0000","last_undegraded":"2024-09-21T03:24:32.568552+0000","last_fullsized":"2024-09-21T03:24:32.568552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.851943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42005,"num_write_kb":435585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"27'3096","reported_seq":3125,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.490675+0000","last_change":"2024-09-21T03:14:38.480026+0000","last_active":"2024-09-21T03:24:44.490675+0000","last_peered":"2024-09-21T03:24:44.490675+0000","last_clean":"2024-09-21T03:24:44.490675+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:24:44.490675+0000","last_undegraded":"2024-09-21T03:24:44.490675+0000","last_fullsized":"2024-09-21T03:24:44.490675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3096,"log_dups_size":0,"ondisk_log_size":3096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:20.481816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45754,"num_write_kb":580793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'48","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.181334+0000","last_change":"2024-09-21T03:14:37.464554+0000","last_active":"2024-09-21T03:24:32.181334+0000","last_peered":"2024-09-21T03:24:32.181334+0000","last_clean":"2024-09-21T03:24:32.181334+0000","last_became_active":"2024-09-21T03:14:37.464228+0000","last_became_peered":"2024-09-21T03:14:37.464228+0000","last_unstale":"2024-09-21T03:24:32.181334+0000","last_undegraded":"2024-09-21T03:24:32.181334+0000","last_fullsized":"2024-09-21T03:24:32.181334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:32.529512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'359","reported_seq":382,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:33.163291+0000","last_change":"2024-09-21T03:14:46.538538+0000","last_active":"2024-09-21T03:24:33.163291+0000","last_peered":"2024-09-21T03:24:33.163291+0000","last_clean":"2024-09-21T03:24:33.163291+0000","last_became_active":"2024-09-21T03:14:46.537815+0000","last_became_peered":"2024-09-21T03:14:46.537815+0000","last_unstale":"2024-09-21T03:24:33.163291+0000","last_undegraded":"2024-09-21T03:24:33.163291+0000","last_fullsized":"2024-09-21T03:24:33.163291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:42.264439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":802,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"27'3073","reported_seq":3094,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.583040+0000","last_change":"2024-09-21T03:14:47.558861+0000","last_active":"2024-09-21T03:24:32.583040+0000","last_peered":"2024-09-21T03:24:32.583040+0000","last_clean":"2024-09-21T03:24:32.583040+0000","last_became_active":"2024-09-21T03:14:47.557305+0000","last_became_peered":"2024-09-21T03:14:47.557305+0000","last_unstale":"2024-09-21T03:24:32.583040+0000","last_undegraded":"2024-09-21T03:24:32.583040+0000","last_fullsized":"2024-09-21T03:24:32.583040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3073,"log_dups_size":0,"ondisk_log_size":3073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:45.962367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44879,"num_write_kb":462177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'3141","reported_seq":3170,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.073579+0000","last_change":"2024-09-21T03:14:38.479181+0000","last_active":"2024-09-21T03:24:32.073579+0000","last_peered":"2024-09-21T03:24:32.073579+0000","last_clean":"2024-09-21T03:24:32.073579+0000","last_became_active":"2024-09-21T03:14:38.478842+0000","last_became_peered":"2024-09-21T03:14:38.478842+0000","last_unstale":"2024-09-21T03:24:32.073579+0000","last_undegraded":"2024-09-21T03:24:32.073579+0000","last_fullsized":"2024-09-21T03:24:32.073579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3141,"log_dups_size":0,"ondisk_log_size":3141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:08.664381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46550,"num_write_kb":599066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:22:44.179288+0000","last_change":"2024-09-21T03:14:37.463990+0000","last_active":"2024-09-21T03:22:44.179288+0000","last_peered":"2024-09-21T03:22:44.179288+0000","last_clean":"2024-09-21T03:22:44.179288+0000","last_became_active":"2024-09-21T03:14:37.463674+0000","last_became_peered":"2024-09-21T03:14:37.463674+0000","last_unstale":"2024-09-21T03:22:44.179288+0000","last_undegraded":"2024-09-21T03:22:44.179288+0000","last_fullsized":"2024-09-21T03:22:44.179288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:35.391985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":128,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:22:32.784133+0000","last_change":"2024-09-21T03:14:26.342355+0000","last_active":"2024-09-21T03:22:32.784133+0000","last_peered":"2024-09-21T03:22:32.784133+0000","last_clean":"2024-09-21T03:22:32.784133+0000","last_became_active":"2024-09-21T03:14:26.341929+0000","last_became_peered":"2024-09-21T03:14:26.341929+0000","last_unstale":"2024-09-21T03:22:32.784133+0000","last_undegraded":"2024-09-21T03:22:32.784133+0000","last_fullsized":"2024-09-21T03:22:32.784133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_clean_scrub_stamp":"2024-09-21T03:14:25.329650+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:45.390822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'5","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.576786+0000","last_change":"2024-09-21T03:14:46.538184+0000","last_active":"2024-09-21T03:24:32.576786+0000","last_peered":"2024-09-21T03:24:32.576786+0000","last_clean":"2024-09-21T03:24:32.576786+0000","last_became_active":"2024-09-21T03:14:46.536753+0000","last_became_peered":"2024-09-21T03:14:46.536753+0000","last_unstale":"2024-09-21T03:24:32.576786+0000","last_undegraded":"2024-09-21T03:24:32.576786+0000","last_fullsized":"2024-09-21T03:24:32.576786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:49.078638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"27'2384","reported_seq":2405,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.593825+0000","last_change":"2024-09-21T03:14:47.552966+0000","last_active":"2024-09-21T03:24:32.593825+0000","last_peered":"2024-09-21T03:24:32.593825+0000","last_clean":"2024-09-21T03:24:32.593825+0000","last_became_active":"2024-09-21T03:14:47.552642+0000","last_became_peered":"2024-09-21T03:14:47.552642+0000","last_unstale":"2024-09-21T03:24:32.593825+0000","last_undegraded":"2024-09-21T03:24:32.593825+0000","last_fullsized":"2024-09-21T03:24:32.593825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2384,"log_dups_size":0,"ondisk_log_size":2384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:15.928026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34629,"num_write_kb":367496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"27'3139","reported_seq":3168,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.231721+0000","last_change":"2024-09-21T03:14:38.478414+0000","last_active":"2024-09-21T03:24:32.231721+0000","last_peered":"2024-09-21T03:24:32.231721+0000","last_clean":"2024-09-21T03:24:32.231721+0000","last_became_active":"2024-09-21T03:14:38.478116+0000","last_became_peered":"2024-09-21T03:14:38.478116+0000","last_unstale":"2024-09-21T03:24:32.231721+0000","last_undegraded":"2024-09-21T03:24:32.231721+0000","last_fullsized":"2024-09-21T03:24:32.231721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3139,"log_dups_size":0,"ondisk_log_size":3139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:29.618008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46299,"num_write_kb":593160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'3","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:23:38.363866+0000","last_change":"2024-09-21T03:14:37.479578+0000","last_active":"2024-09-21T03:23:38.363866+0000","last_peered":"2024-09-21T03:23:38.363866+0000","last_clean":"2024-09-21T03:23:38.363866+0000","last_became_active":"2024-09-21T03:14:37.479284+0000","last_became_peered":"2024-09-21T03:14:37.479284+0000","last_unstale":"2024-09-21T03:23:38.363866+0000","last_undegraded":"2024-09-21T03:23:38.363866+0000","last_fullsized":"2024-09-21T03:23:38.363866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:15.732230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'32","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.602886+0000","last_change":"2024-09-21T03:14:46.531536+0000","last_active":"2024-09-21T03:24:32.602886+0000","last_peered":"2024-09-21T03:24:32.602886+0000","last_clean":"2024-09-21T03:24:32.602886+0000","last_became_active":"2024-09-21T03:14:46.531069+0000","last_became_peered":"2024-09-21T03:14:46.531069+0000","last_unstale":"2024-09-21T03:24:32.602886+0000","last_undegraded":"2024-09-21T03:24:32.602886+0000","last_fullsized":"2024-09-21T03:24:32.602886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:14.050618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"27'2635","reported_seq":2656,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.438595+0000","last_change":"2024-09-21T03:14:47.553039+0000","last_active":"2024-09-21T03:24:32.438595+0000","last_peered":"2024-09-21T03:24:32.438595+0000","last_clean":"2024-09-21T03:24:32.438595+0000","last_became_active":"2024-09-21T03:14:47.552712+0000","last_became_peered":"2024-09-21T03:14:47.552712+0000","last_unstale":"2024-09-21T03:24:32.438595+0000","last_undegraded":"2024-09-21T03:24:32.438595+0000","last_fullsized":"2024-09-21T03:24:32.438595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2635,"log_dups_size":0,"ondisk_log_size":2635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:32.630319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38453,"num_write_kb":398220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'3279","reported_seq":3308,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.216379+0000","last_change":"2024-09-21T03:14:38.488259+0000","last_active":"2024-09-21T03:24:32.216379+0000","last_peered":"2024-09-21T03:24:32.216379+0000","last_clean":"2024-09-21T03:24:32.216379+0000","last_became_active":"2024-09-21T03:14:38.487420+0000","last_became_peered":"2024-09-21T03:14:38.487420+0000","last_unstale":"2024-09-21T03:24:32.216379+0000","last_undegraded":"2024-09-21T03:24:32.216379+0000","last_fullsized":"2024-09-21T03:24:32.216379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3279,"log_dups_size":0,"ondisk_log_size":3279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:48.003893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48497,"num_write_kb":608493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'7","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:23:39.783326+0000","last_change":"2024-09-21T03:14:37.460763+0000","last_active":"2024-09-21T03:23:39.783326+0000","last_peered":"2024-09-21T03:23:39.783326+0000","last_clean":"2024-09-21T03:23:39.783326+0000","last_became_active":"2024-09-21T03:14:37.460320+0000","last_became_peered":"2024-09-21T03:14:37.460320+0000","last_unstale":"2024-09-21T03:23:39.783326+0000","last_undegraded":"2024-09-21T03:23:39.783326+0000","last_fullsized":"2024-09-21T03:23:39.783326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.907794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'466","reported_seq":489,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.617384+0000","last_change":"2024-09-21T03:14:46.540901+0000","last_active":"2024-09-21T03:24:32.617384+0000","last_peered":"2024-09-21T03:24:32.617384+0000","last_clean":"2024-09-21T03:24:32.617384+0000","last_became_active":"2024-09-21T03:14:46.540182+0000","last_became_peered":"2024-09-21T03:14:46.540182+0000","last_unstale":"2024-09-21T03:24:32.617384+0000","last_undegraded":"2024-09-21T03:24:32.617384+0000","last_fullsized":"2024-09-21T03:24:32.617384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:38.416663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8130274,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":8272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"27'2703","reported_seq":2724,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.570330+0000","last_change":"2024-09-21T03:14:47.553810+0000","last_active":"2024-09-21T03:24:32.570330+0000","last_peered":"2024-09-21T03:24:32.570330+0000","last_clean":"2024-09-21T03:24:32.570330+0000","last_became_active":"2024-09-21T03:14:47.552371+0000","last_became_peered":"2024-09-21T03:14:47.552371+0000","last_unstale":"2024-09-21T03:24:32.570330+0000","last_undegraded":"2024-09-21T03:24:32.570330+0000","last_fullsized":"2024-09-21T03:24:32.570330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2703,"log_dups_size":0,"ondisk_log_size":2703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:38.659512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39343,"num_write_kb":410859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"27'3616","reported_seq":3645,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.146151+0000","last_change":"2024-09-21T03:14:38.480629+0000","last_active":"2024-09-21T03:24:32.146151+0000","last_peered":"2024-09-21T03:24:32.146151+0000","last_clean":"2024-09-21T03:24:32.146151+0000","last_became_active":"2024-09-21T03:14:38.474135+0000","last_became_peered":"2024-09-21T03:14:38.474135+0000","last_unstale":"2024-09-21T03:24:32.146151+0000","last_undegraded":"2024-09-21T03:24:32.146151+0000","last_fullsized":"2024-09-21T03:24:32.146151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3616,"log_dups_size":0,"ondisk_log_size":3616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:36.171044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53421,"num_write_kb":673086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'13","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.193221+0000","last_change":"2024-09-21T03:14:37.472491+0000","last_active":"2024-09-21T03:24:32.193221+0000","last_peered":"2024-09-21T03:24:32.193221+0000","last_clean":"2024-09-21T03:24:32.193221+0000","last_became_active":"2024-09-21T03:14:37.472164+0000","last_became_peered":"2024-09-21T03:14:37.472164+0000","last_unstale":"2024-09-21T03:24:32.193221+0000","last_undegraded":"2024-09-21T03:24:32.193221+0000","last_fullsized":"2024-09-21T03:24:32.193221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.498178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'19","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.563185+0000","last_change":"2024-09-21T03:14:46.544828+0000","last_active":"2024-09-21T03:24:32.563185+0000","last_peered":"2024-09-21T03:24:32.563185+0000","last_clean":"2024-09-21T03:24:32.563185+0000","last_became_active":"2024-09-21T03:14:46.535901+0000","last_became_peered":"2024-09-21T03:14:46.535901+0000","last_unstale":"2024-09-21T03:24:32.563185+0000","last_undegraded":"2024-09-21T03:24:32.563185+0000","last_fullsized":"2024-09-21T03:24:32.563185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:08.608530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"27'3041","reported_seq":3062,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.505706+0000","last_change":"2024-09-21T03:14:47.556478+0000","last_active":"2024-09-21T03:24:32.505706+0000","last_peered":"2024-09-21T03:24:32.505706+0000","last_clean":"2024-09-21T03:24:32.505706+0000","last_became_active":"2024-09-21T03:14:47.556145+0000","last_became_peered":"2024-09-21T03:14:47.556145+0000","last_unstale":"2024-09-21T03:24:32.505706+0000","last_undegraded":"2024-09-21T03:24:32.505706+0000","last_fullsized":"2024-09-21T03:24:32.505706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3041,"log_dups_size":0,"ondisk_log_size":3041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:59.004648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44445,"num_write_kb":452313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"27'2812","reported_seq":2841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.124404+0000","last_change":"2024-09-21T03:14:38.469502+0000","last_active":"2024-09-21T03:24:32.124404+0000","last_peered":"2024-09-21T03:24:32.124404+0000","last_clean":"2024-09-21T03:24:32.124404+0000","last_became_active":"2024-09-21T03:14:38.468972+0000","last_became_peered":"2024-09-21T03:14:38.468972+0000","last_unstale":"2024-09-21T03:24:32.124404+0000","last_undegraded":"2024-09-21T03:24:32.124404+0000","last_fullsized":"2024-09-21T03:24:32.124404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2812,"log_dups_size":0,"ondisk_log_size":2812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41476,"num_write_kb":540924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'10","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.208426+0000","last_change":"2024-09-21T03:14:37.480905+0000","last_active":"2024-09-21T03:24:32.208426+0000","last_peered":"2024-09-21T03:24:32.208426+0000","last_clean":"2024-09-21T03:24:32.208426+0000","last_became_active":"2024-09-21T03:14:37.478227+0000","last_became_peered":"2024-09-21T03:14:37.478227+0000","last_unstale":"2024-09-21T03:24:32.208426+0000","last_undegraded":"2024-09-21T03:24:32.208426+0000","last_fullsized":"2024-09-21T03:24:32.208426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:42.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.583666+0000","last_change":"2024-09-21T03:14:46.536103+0000","last_active":"2024-09-21T03:24:32.583666+0000","last_peered":"2024-09-21T03:24:32.583666+0000","last_clean":"2024-09-21T03:24:32.583666+0000","last_became_active":"2024-09-21T03:14:46.535445+0000","last_became_peered":"2024-09-21T03:14:46.535445+0000","last_unstale":"2024-09-21T03:24:32.583666+0000","last_undegraded":"2024-09-21T03:24:32.583666+0000","last_fullsized":"2024-09-21T03:24:32.583666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:59.078000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"27'2456","reported_seq":2477,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.615818+0000","last_change":"2024-09-21T03:14:47.557503+0000","last_active":"2024-09-21T03:24:32.615818+0000","last_peered":"2024-09-21T03:24:32.615818+0000","last_clean":"2024-09-21T03:24:32.615818+0000","last_became_active":"2024-09-21T03:14:47.554366+0000","last_became_peered":"2024-09-21T03:14:47.554366+0000","last_unstale":"2024-09-21T03:24:32.615818+0000","last_undegraded":"2024-09-21T03:24:32.615818+0000","last_fullsized":"2024-09-21T03:24:32.615818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2456,"log_dups_size":0,"ondisk_log_size":2456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.994560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35585,"num_write_kb":377642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'3454","reported_seq":3483,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.213157+0000","last_change":"2024-09-21T03:14:38.479516+0000","last_active":"2024-09-21T03:24:32.213157+0000","last_peered":"2024-09-21T03:24:32.213157+0000","last_clean":"2024-09-21T03:24:32.213157+0000","last_became_active":"2024-09-21T03:14:38.474826+0000","last_became_peered":"2024-09-21T03:14:38.474826+0000","last_unstale":"2024-09-21T03:24:32.213157+0000","last_undegraded":"2024-09-21T03:24:32.213157+0000","last_fullsized":"2024-09-21T03:24:32.213157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:22.181411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51413,"num_write_kb":609416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'37","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.141749+0000","last_change":"2024-09-21T03:14:37.471063+0000","last_active":"2024-09-21T03:24:32.141749+0000","last_peered":"2024-09-21T03:24:32.141749+0000","last_clean":"2024-09-21T03:24:32.141749+0000","last_became_active":"2024-09-21T03:14:37.470720+0000","last_became_peered":"2024-09-21T03:14:37.470720+0000","last_unstale":"2024-09-21T03:24:32.141749+0000","last_undegraded":"2024-09-21T03:24:32.141749+0000","last_fullsized":"2024-09-21T03:24:32.141749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:00.054692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.582741+0000","last_change":"2024-09-21T03:14:46.538665+0000","last_active":"2024-09-21T03:24:32.582741+0000","last_peered":"2024-09-21T03:24:32.582741+0000","last_clean":"2024-09-21T03:24:32.582741+0000","last_became_active":"2024-09-21T03:14:46.537774+0000","last_became_peered":"2024-09-21T03:14:46.537774+0000","last_unstale":"2024-09-21T03:24:32.582741+0000","last_undegraded":"2024-09-21T03:24:32.582741+0000","last_fullsized":"2024-09-21T03:24:32.582741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:07.736404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"27'2977","reported_seq":2998,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.568400+0000","last_change":"2024-09-21T03:14:47.553011+0000","last_active":"2024-09-21T03:24:32.568400+0000","last_peered":"2024-09-21T03:24:32.568400+0000","last_clean":"2024-09-21T03:24:32.568400+0000","last_became_active":"2024-09-21T03:14:47.552700+0000","last_became_peered":"2024-09-21T03:14:47.552700+0000","last_unstale":"2024-09-21T03:24:32.568400+0000","last_undegraded":"2024-09-21T03:24:32.568400+0000","last_fullsized":"2024-09-21T03:24:32.568400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2977,"log_dups_size":0,"ondisk_log_size":2977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:58.780132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43190,"num_write_kb":444709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"27'3317","reported_seq":3346,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.189439+0000","last_change":"2024-09-21T03:14:38.472906+0000","last_active":"2024-09-21T03:24:32.189439+0000","last_peered":"2024-09-21T03:24:32.189439+0000","last_clean":"2024-09-21T03:24:32.189439+0000","last_became_active":"2024-09-21T03:14:38.471933+0000","last_became_peered":"2024-09-21T03:14:38.471933+0000","last_unstale":"2024-09-21T03:24:32.189439+0000","last_undegraded":"2024-09-21T03:24:32.189439+0000","last_fullsized":"2024-09-21T03:24:32.189439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3317,"log_dups_size":0,"ondisk_log_size":3317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:05.395821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49154,"num_write_kb":612364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.200953+0000","last_change":"2024-09-21T03:14:37.478714+0000","last_active":"2024-09-21T03:24:32.200953+0000","last_peered":"2024-09-21T03:24:32.200953+0000","last_clean":"2024-09-21T03:24:32.200953+0000","last_became_active":"2024-09-21T03:14:37.477951+0000","last_became_peered":"2024-09-21T03:14:37.477951+0000","last_unstale":"2024-09-21T03:24:32.200953+0000","last_undegraded":"2024-09-21T03:24:32.200953+0000","last_fullsized":"2024-09-21T03:24:32.200953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:42.529545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:26.343821+0000","last_change":"2024-09-21T03:14:46.546142+0000","last_active":"2024-09-21T03:24:26.343821+0000","last_peered":"2024-09-21T03:24:26.343821+0000","last_clean":"2024-09-21T03:24:26.343821+0000","last_became_active":"2024-09-21T03:14:46.545865+0000","last_became_peered":"2024-09-21T03:14:46.545865+0000","last_unstale":"2024-09-21T03:24:26.343821+0000","last_undegraded":"2024-09-21T03:24:26.343821+0000","last_fullsized":"2024-09-21T03:24:26.343821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:11.705309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"27'2773","reported_seq":2800,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.350773+0000","last_change":"2024-09-21T03:19:03.558620+0000","last_active":"2024-09-21T03:24:32.350773+0000","last_peered":"2024-09-21T03:24:32.350773+0000","last_clean":"2024-09-21T03:24:32.350773+0000","last_became_active":"2024-09-21T03:14:47.568656+0000","last_became_peered":"2024-09-21T03:14:47.568656+0000","last_unstale":"2024-09-21T03:24:32.350773+0000","last_undegraded":"2024-09-21T03:24:32.350773+0000","last_fullsized":"2024-09-21T03:24:32.350773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2773,"log_dups_size":0,"ondisk_log_size":2773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.041710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40461,"num_write_kb":415650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'3322","reported_seq":3351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.223296+0000","last_change":"2024-09-21T03:14:38.485454+0000","last_active":"2024-09-21T03:24:32.223296+0000","last_peered":"2024-09-21T03:24:32.223296+0000","last_clean":"2024-09-21T03:24:32.223296+0000","last_became_active":"2024-09-21T03:14:38.485235+0000","last_became_peered":"2024-09-21T03:14:38.485235+0000","last_unstale":"2024-09-21T03:24:32.223296+0000","last_undegraded":"2024-09-21T03:24:32.223296+0000","last_fullsized":"2024-09-21T03:24:32.223296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3322,"log_dups_size":0,"ondisk_log_size":3322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:11.585637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48941,"num_write_kb":642004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.241707+0000","last_change":"2024-09-21T03:14:37.466544+0000","last_active":"2024-09-21T03:24:32.241707+0000","last_peered":"2024-09-21T03:24:32.241707+0000","last_clean":"2024-09-21T03:24:32.241707+0000","last_became_active":"2024-09-21T03:14:37.465817+0000","last_became_peered":"2024-09-21T03:14:37.465817+0000","last_unstale":"2024-09-21T03:24:32.241707+0000","last_undegraded":"2024-09-21T03:24:32.241707+0000","last_fullsized":"2024-09-21T03:24:32.241707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:36.113483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'229","reported_seq":252,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.596651+0000","last_change":"2024-09-21T03:14:46.549921+0000","last_active":"2024-09-21T03:24:32.596651+0000","last_peered":"2024-09-21T03:24:32.596651+0000","last_clean":"2024-09-21T03:24:32.596651+0000","last_became_active":"2024-09-21T03:14:46.549119+0000","last_became_peered":"2024-09-21T03:14:46.549119+0000","last_unstale":"2024-09-21T03:24:32.596651+0000","last_undegraded":"2024-09-21T03:24:32.596651+0000","last_fullsized":"2024-09-21T03:24:32.596651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:09.622498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"27'3921","reported_seq":3936,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.630442+0000","last_change":"2024-09-21T03:15:15.687659+0000","last_active":"2024-09-21T03:24:32.630442+0000","last_peered":"2024-09-21T03:24:32.630442+0000","last_clean":"2024-09-21T03:24:32.630442+0000","last_became_active":"2024-09-21T03:15:15.687225+0000","last_became_peered":"2024-09-21T03:15:15.687225+0000","last_unstale":"2024-09-21T03:24:32.630442+0000","last_undegraded":"2024-09-21T03:24:32.630442+0000","last_fullsized":"2024-09-21T03:24:32.630442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3921,"log_dups_size":0,"ondisk_log_size":3921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:56.395767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57021,"num_write_kb":587488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"27'3064","reported_seq":3091,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.497573+0000","last_change":"2024-09-21T03:14:38.482528+0000","last_active":"2024-09-21T03:24:44.497573+0000","last_peered":"2024-09-21T03:24:44.497573+0000","last_clean":"2024-09-21T03:24:44.497573+0000","last_became_active":"2024-09-21T03:14:38.482241+0000","last_became_peered":"2024-09-21T03:14:38.482241+0000","last_unstale":"2024-09-21T03:24:44.497573+0000","last_undegraded":"2024-09-21T03:24:44.497573+0000","last_fullsized":"2024-09-21T03:24:44.497573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3064,"log_dups_size":0,"ondisk_log_size":3064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:23.110703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45418,"num_write_kb":562843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'19","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.197386+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:24:32.197386+0000","last_peered":"2024-09-21T03:24:32.197386+0000","last_clean":"2024-09-21T03:24:32.197386+0000","last_became_active":"2024-09-21T03:14:37.478882+0000","last_became_peered":"2024-09-21T03:14:37.478882+0000","last_unstale":"2024-09-21T03:24:32.197386+0000","last_undegraded":"2024-09-21T03:24:32.197386+0000","last_fullsized":"2024-09-21T03:24:32.197386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:11.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'22","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:33.062661+0000","last_change":"2024-09-21T03:14:46.538817+0000","last_active":"2024-09-21T03:24:33.062661+0000","last_peered":"2024-09-21T03:24:33.062661+0000","last_clean":"2024-09-21T03:24:33.062661+0000","last_became_active":"2024-09-21T03:14:46.537835+0000","last_became_peered":"2024-09-21T03:14:46.537835+0000","last_unstale":"2024-09-21T03:24:33.062661+0000","last_undegraded":"2024-09-21T03:24:33.062661+0000","last_fullsized":"2024-09-21T03:24:33.062661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:08.236663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"27'3350","reported_seq":3371,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.627645+0000","last_change":"2024-09-21T03:14:47.566534+0000","last_active":"2024-09-21T03:24:32.627645+0000","last_peered":"2024-09-21T03:24:32.627645+0000","last_clean":"2024-09-21T03:24:32.627645+0000","last_became_active":"2024-09-21T03:14:47.566157+0000","last_became_peered":"2024-09-21T03:14:47.566157+0000","last_unstale":"2024-09-21T03:24:32.627645+0000","last_undegraded":"2024-09-21T03:24:32.627645+0000","last_fullsized":"2024-09-21T03:24:32.627645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3350,"log_dups_size":0,"ondisk_log_size":3350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:35.557811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48864,"num_write_kb":499368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"27'2806","reported_seq":2835,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:31.891845+0000","last_change":"2024-09-21T03:14:38.478509+0000","last_active":"2024-09-21T03:24:31.891845+0000","last_peered":"2024-09-21T03:24:31.891845+0000","last_clean":"2024-09-21T03:24:31.891845+0000","last_became_active":"2024-09-21T03:14:38.478197+0000","last_became_peered":"2024-09-21T03:14:38.478197+0000","last_unstale":"2024-09-21T03:24:31.891845+0000","last_undegraded":"2024-09-21T03:24:31.891845+0000","last_fullsized":"2024-09-21T03:24:31.891845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2806,"log_dups_size":0,"ondisk_log_size":2806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.411134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41544,"num_write_kb":533190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'234","reported_seq":265,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.189321+0000","last_change":"2024-09-21T03:14:37.472695+0000","last_active":"2024-09-21T03:24:32.189321+0000","last_peered":"2024-09-21T03:24:32.189321+0000","last_clean":"2024-09-21T03:24:32.189321+0000","last_became_active":"2024-09-21T03:14:37.472374+0000","last_became_peered":"2024-09-21T03:14:37.472374+0000","last_unstale":"2024-09-21T03:24:32.189321+0000","last_undegraded":"2024-09-21T03:24:32.189321+0000","last_fullsized":"2024-09-21T03:24:32.189321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:11.245914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":12446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'5","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.617539+0000","last_change":"2024-09-21T03:14:46.547433+0000","last_active":"2024-09-21T03:24:32.617539+0000","last_peered":"2024-09-21T03:24:32.617539+0000","last_clean":"2024-09-21T03:24:32.617539+0000","last_became_active":"2024-09-21T03:14:46.547192+0000","last_became_peered":"2024-09-21T03:14:46.547192+0000","last_unstale":"2024-09-21T03:24:32.617539+0000","last_undegraded":"2024-09-21T03:24:32.617539+0000","last_fullsized":"2024-09-21T03:24:32.617539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:03.238245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"27'2729","reported_seq":2750,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.457661+0000","last_change":"2024-09-21T03:14:47.545827+0000","last_active":"2024-09-21T03:24:32.457661+0000","last_peered":"2024-09-21T03:24:32.457661+0000","last_clean":"2024-09-21T03:24:32.457661+0000","last_became_active":"2024-09-21T03:14:47.545440+0000","last_became_peered":"2024-09-21T03:14:47.545440+0000","last_unstale":"2024-09-21T03:24:32.457661+0000","last_undegraded":"2024-09-21T03:24:32.457661+0000","last_fullsized":"2024-09-21T03:24:32.457661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2729,"log_dups_size":0,"ondisk_log_size":2729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:20.532645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39786,"num_write_kb":413571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"27'4229","reported_seq":4258,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.135874+0000","last_change":"2024-09-21T03:14:38.476564+0000","last_active":"2024-09-21T03:24:32.135874+0000","last_peered":"2024-09-21T03:24:32.135874+0000","last_clean":"2024-09-21T03:24:32.135874+0000","last_became_active":"2024-09-21T03:14:38.476158+0000","last_became_peered":"2024-09-21T03:14:38.476158+0000","last_unstale":"2024-09-21T03:24:32.135874+0000","last_undegraded":"2024-09-21T03:24:32.135874+0000","last_fullsized":"2024-09-21T03:24:32.135874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":4229,"log_dups_size":0,"ondisk_log_size":4229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:26.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63095,"num_write_kb":776596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'34","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.259366+0000","last_change":"2024-09-21T03:14:37.473709+0000","last_active":"2024-09-21T03:24:32.259366+0000","last_peered":"2024-09-21T03:24:32.259366+0000","last_clean":"2024-09-21T03:24:32.259366+0000","last_became_active":"2024-09-21T03:14:37.472544+0000","last_became_peered":"2024-09-21T03:14:37.472544+0000","last_unstale":"2024-09-21T03:24:32.259366+0000","last_undegraded":"2024-09-21T03:24:32.259366+0000","last_fullsized":"2024-09-21T03:24:32.259366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:47.892146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'51","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.595511+0000","last_change":"2024-09-21T03:14:46.534201+0000","last_active":"2024-09-21T03:24:32.595511+0000","last_peered":"2024-09-21T03:24:32.595511+0000","last_clean":"2024-09-21T03:24:32.595511+0000","last_became_active":"2024-09-21T03:14:46.533891+0000","last_became_peered":"2024-09-21T03:14:46.533891+0000","last_unstale":"2024-09-21T03:24:32.595511+0000","last_undegraded":"2024-09-21T03:24:32.595511+0000","last_fullsized":"2024-09-21T03:24:32.595511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:06.645173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":8218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"27'3044","reported_seq":3065,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.603649+0000","last_change":"2024-09-21T03:14:47.552016+0000","last_active":"2024-09-21T03:24:32.603649+0000","last_peered":"2024-09-21T03:24:32.603649+0000","last_clean":"2024-09-21T03:24:32.603649+0000","last_became_active":"2024-09-21T03:14:47.551622+0000","last_became_peered":"2024-09-21T03:14:47.551622+0000","last_unstale":"2024-09-21T03:24:32.603649+0000","last_undegraded":"2024-09-21T03:24:32.603649+0000","last_fullsized":"2024-09-21T03:24:32.603649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3044,"log_dups_size":0,"ondisk_log_size":3044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:56:04.849535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44676,"num_write_kb":453348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'2857","reported_seq":2886,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.235888+0000","last_change":"2024-09-21T03:14:38.484757+0000","last_active":"2024-09-21T03:24:32.235888+0000","last_peered":"2024-09-21T03:24:32.235888+0000","last_clean":"2024-09-21T03:24:32.235888+0000","last_became_active":"2024-09-21T03:14:38.483348+0000","last_became_peered":"2024-09-21T03:14:38.483348+0000","last_unstale":"2024-09-21T03:24:32.235888+0000","last_undegraded":"2024-09-21T03:24:32.235888+0000","last_fullsized":"2024-09-21T03:24:32.235888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2857,"log_dups_size":0,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:57.697723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42315,"num_write_kb":514746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'14","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.191061+0000","last_change":"2024-09-21T03:14:37.479047+0000","last_active":"2024-09-21T03:24:32.191061+0000","last_peered":"2024-09-21T03:24:32.191061+0000","last_clean":"2024-09-21T03:24:32.191061+0000","last_became_active":"2024-09-21T03:14:37.478700+0000","last_became_peered":"2024-09-21T03:14:37.478700+0000","last_unstale":"2024-09-21T03:24:32.191061+0000","last_undegraded":"2024-09-21T03:24:32.191061+0000","last_fullsized":"2024-09-21T03:24:32.191061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:31.702450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'12","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.584480+0000","last_change":"2024-09-21T03:14:46.547287+0000","last_active":"2024-09-21T03:24:32.584480+0000","last_peered":"2024-09-21T03:24:32.584480+0000","last_clean":"2024-09-21T03:24:32.584480+0000","last_became_active":"2024-09-21T03:14:46.546867+0000","last_became_peered":"2024-09-21T03:14:46.546867+0000","last_unstale":"2024-09-21T03:24:32.584480+0000","last_undegraded":"2024-09-21T03:24:32.584480+0000","last_fullsized":"2024-09-21T03:24:32.584480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:54.119841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"27'3242","reported_seq":3263,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.603566+0000","last_change":"2024-09-21T03:14:47.558571+0000","last_active":"2024-09-21T03:24:32.603566+0000","last_peered":"2024-09-21T03:24:32.603566+0000","last_clean":"2024-09-21T03:24:32.603566+0000","last_became_active":"2024-09-21T03:14:47.558037+0000","last_became_peered":"2024-09-21T03:14:47.558037+0000","last_unstale":"2024-09-21T03:24:32.603566+0000","last_undegraded":"2024-09-21T03:24:32.603566+0000","last_fullsized":"2024-09-21T03:24:32.603566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3242,"log_dups_size":0,"ondisk_log_size":3242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:42.564181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47392,"num_write_kb":480920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"27'3061","reported_seq":3090,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.147447+0000","last_change":"2024-09-21T03:14:38.488227+0000","last_active":"2024-09-21T03:24:32.147447+0000","last_peered":"2024-09-21T03:24:32.147447+0000","last_clean":"2024-09-21T03:24:32.147447+0000","last_became_active":"2024-09-21T03:14:38.482370+0000","last_became_peered":"2024-09-21T03:14:38.482370+0000","last_unstale":"2024-09-21T03:24:32.147447+0000","last_undegraded":"2024-09-21T03:24:32.147447+0000","last_fullsized":"2024-09-21T03:24:32.147447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3061,"log_dups_size":0,"ondisk_log_size":3061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:52.561391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45203,"num_write_kb":570065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:20.846579+0000","last_change":"2024-09-21T03:14:37.471363+0000","last_active":"2024-09-21T03:24:20.846579+0000","last_peered":"2024-09-21T03:24:20.846579+0000","last_clean":"2024-09-21T03:24:20.846579+0000","last_became_active":"2024-09-21T03:14:37.471002+0000","last_became_peered":"2024-09-21T03:14:37.471002+0000","last_unstale":"2024-09-21T03:24:20.846579+0000","last_undegraded":"2024-09-21T03:24:20.846579+0000","last_fullsized":"2024-09-21T03:24:20.846579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:25.922368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.586441+0000","last_change":"2024-09-21T03:14:46.545186+0000","last_active":"2024-09-21T03:24:32.586441+0000","last_peered":"2024-09-21T03:24:32.586441+0000","last_clean":"2024-09-21T03:24:32.586441+0000","last_became_active":"2024-09-21T03:14:46.543647+0000","last_became_peered":"2024-09-21T03:14:46.543647+0000","last_unstale":"2024-09-21T03:24:32.586441+0000","last_undegraded":"2024-09-21T03:24:32.586441+0000","last_fullsized":"2024-09-21T03:24:32.586441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:03.097368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"27'3492","reported_seq":3513,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.595887+0000","last_change":"2024-09-21T03:14:47.554766+0000","last_active":"2024-09-21T03:24:32.595887+0000","last_peered":"2024-09-21T03:24:32.595887+0000","last_clean":"2024-09-21T03:24:32.595887+0000","last_became_active":"2024-09-21T03:14:47.551563+0000","last_became_peered":"2024-09-21T03:14:47.551563+0000","last_unstale":"2024-09-21T03:24:32.595887+0000","last_undegraded":"2024-09-21T03:24:32.595887+0000","last_fullsized":"2024-09-21T03:24:32.595887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3492,"log_dups_size":0,"ondisk_log_size":3492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:08.790725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50774,"num_write_kb":531933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"27'32","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.588919+0000","last_change":"2024-09-21T03:14:46.542659+0000","last_active":"2024-09-21T03:24:32.588919+0000","last_peered":"2024-09-21T03:24:32.588919+0000","last_clean":"2024-09-21T03:24:32.588919+0000","last_became_active":"2024-09-21T03:14:46.541771+0000","last_became_peered":"2024-09-21T03:14:46.541771+0000","last_unstale":"2024-09-21T03:24:32.588919+0000","last_undegraded":"2024-09-21T03:24:32.588919+0000","last_fullsized":"2024-09-21T03:24:32.588919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:45.543904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'3628","reported_seq":3657,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.258511+0000","last_change":"2024-09-21T03:14:38.481837+0000","last_active":"2024-09-21T03:24:32.258511+0000","last_peered":"2024-09-21T03:24:32.258511+0000","last_clean":"2024-09-21T03:24:32.258511+0000","last_became_active":"2024-09-21T03:14:38.478400+0000","last_became_peered":"2024-09-21T03:14:38.478400+0000","last_unstale":"2024-09-21T03:24:32.258511+0000","last_undegraded":"2024-09-21T03:24:32.258511+0000","last_fullsized":"2024-09-21T03:24:32.258511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.702185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53758,"num_write_kb":679942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'29","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.101066+0000","last_change":"2024-09-21T03:14:37.459351+0000","last_active":"2024-09-21T03:24:32.101066+0000","last_peered":"2024-09-21T03:24:32.101066+0000","last_clean":"2024-09-21T03:24:32.101066+0000","last_became_active":"2024-09-21T03:14:37.458676+0000","last_became_peered":"2024-09-21T03:14:37.458676+0000","last_unstale":"2024-09-21T03:24:32.101066+0000","last_undegraded":"2024-09-21T03:24:32.101066+0000","last_fullsized":"2024-09-21T03:24:32.101066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:42.671520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"27'3276","reported_seq":3297,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.497499+0000","last_change":"2024-09-21T03:14:47.561232+0000","last_active":"2024-09-21T03:24:32.497499+0000","last_peered":"2024-09-21T03:24:32.497499+0000","last_clean":"2024-09-21T03:24:32.497499+0000","last_became_active":"2024-09-21T03:14:47.557224+0000","last_became_peered":"2024-09-21T03:14:47.557224+0000","last_unstale":"2024-09-21T03:24:32.497499+0000","last_undegraded":"2024-09-21T03:24:32.497499+0000","last_fullsized":"2024-09-21T03:24:32.497499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3276,"log_dups_size":0,"ondisk_log_size":3276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:09.611235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47961,"num_write_kb":483752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"27'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:21:00.934074+0000","last_change":"2024-09-21T03:14:46.543157+0000","last_active":"2024-09-21T03:21:00.934074+0000","last_peered":"2024-09-21T03:21:00.934074+0000","last_clean":"2024-09-21T03:21:00.934074+0000","last_became_active":"2024-09-21T03:14:46.542746+0000","last_became_peered":"2024-09-21T03:14:46.542746+0000","last_unstale":"2024-09-21T03:21:00.934074+0000","last_undegraded":"2024-09-21T03:21:00.934074+0000","last_fullsized":"2024-09-21T03:21:00.934074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:30.644843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'3044","reported_seq":3073,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.266620+0000","last_change":"2024-09-21T03:14:38.480723+0000","last_active":"2024-09-21T03:24:32.266620+0000","last_peered":"2024-09-21T03:24:32.266620+0000","last_clean":"2024-09-21T03:24:32.266620+0000","last_became_active":"2024-09-21T03:14:38.472823+0000","last_became_peered":"2024-09-21T03:14:38.472823+0000","last_unstale":"2024-09-21T03:24:32.266620+0000","last_undegraded":"2024-09-21T03:24:32.266620+0000","last_fullsized":"2024-09-21T03:24:32.266620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3044,"log_dups_size":0,"ondisk_log_size":3044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:59.862592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44791,"num_write_kb":578211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'17","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:29.478596+0000","last_change":"2024-09-21T03:14:37.472209+0000","last_active":"2024-09-21T03:24:29.478596+0000","last_peered":"2024-09-21T03:24:29.478596+0000","last_clean":"2024-09-21T03:24:29.478596+0000","last_became_active":"2024-09-21T03:14:37.471771+0000","last_became_peered":"2024-09-21T03:14:37.471771+0000","last_unstale":"2024-09-21T03:24:29.478596+0000","last_undegraded":"2024-09-21T03:24:29.478596+0000","last_fullsized":"2024-09-21T03:24:29.478596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:30.648010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"27'3537","reported_seq":3557,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.565527+0000","last_change":"2024-09-21T03:14:47.570651+0000","last_active":"2024-09-21T03:24:32.565527+0000","last_peered":"2024-09-21T03:24:32.565527+0000","last_clean":"2024-09-21T03:24:32.565527+0000","last_became_active":"2024-09-21T03:14:47.568081+0000","last_became_peered":"2024-09-21T03:14:47.568081+0000","last_unstale":"2024-09-21T03:24:32.565527+0000","last_undegraded":"2024-09-21T03:24:32.565527+0000","last_fullsized":"2024-09-21T03:24:32.565527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3537,"log_dups_size":0,"ondisk_log_size":3537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:45.036938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51450,"num_write_kb":532295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"27'33","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.223186+0000","last_change":"2024-09-21T03:14:37.475076+0000","last_active":"2024-09-21T03:24:32.223186+0000","last_peered":"2024-09-21T03:24:32.223186+0000","last_clean":"2024-09-21T03:24:32.223186+0000","last_became_active":"2024-09-21T03:14:37.474595+0000","last_became_peered":"2024-09-21T03:14:37.474595+0000","last_unstale":"2024-09-21T03:24:32.223186+0000","last_undegraded":"2024-09-21T03:24:32.223186+0000","last_fullsized":"2024-09-21T03:24:32.223186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:16.880647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2508","reported_seq":2537,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.248812+0000","last_change":"2024-09-21T03:14:38.483226+0000","last_active":"2024-09-21T03:24:32.248812+0000","last_peered":"2024-09-21T03:24:32.248812+0000","last_clean":"2024-09-21T03:24:32.248812+0000","last_became_active":"2024-09-21T03:14:38.482354+0000","last_became_peered":"2024-09-21T03:14:38.482354+0000","last_unstale":"2024-09-21T03:24:32.248812+0000","last_undegraded":"2024-09-21T03:24:32.248812+0000","last_fullsized":"2024-09-21T03:24:32.248812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2508,"log_dups_size":0,"ondisk_log_size":2508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:51.488594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37096,"num_write_kb":460963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'34","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:22:20.034924+0000","last_change":"2024-09-21T03:14:46.551282+0000","last_active":"2024-09-21T03:22:20.034924+0000","last_peered":"2024-09-21T03:22:20.034924+0000","last_clean":"2024-09-21T03:22:20.034924+0000","last_became_active":"2024-09-21T03:14:46.550191+0000","last_became_peered":"2024-09-21T03:14:46.550191+0000","last_unstale":"2024-09-21T03:22:20.034924+0000","last_undegraded":"2024-09-21T03:22:20.034924+0000","last_fullsized":"2024-09-21T03:22:20.034924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:32.136739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"27'2111","reported_seq":2137,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.510599+0000","last_change":"2024-09-21T03:15:15.686522+0000","last_active":"2024-09-21T03:24:32.510599+0000","last_peered":"2024-09-21T03:24:32.510599+0000","last_clean":"2024-09-21T03:24:32.510599+0000","last_became_active":"2024-09-21T03:15:15.686063+0000","last_became_peered":"2024-09-21T03:15:15.686063+0000","last_unstale":"2024-09-21T03:24:32.510599+0000","last_undegraded":"2024-09-21T03:24:32.510599+0000","last_fullsized":"2024-09-21T03:24:32.510599+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2111,"log_dups_size":0,"ondisk_log_size":2111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:57.750372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30729,"num_write_kb":315555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1140","reported_seq":1171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.135682+0000","last_change":"2024-09-21T03:14:37.465536+0000","last_active":"2024-09-21T03:24:32.135682+0000","last_peered":"2024-09-21T03:24:32.135682+0000","last_clean":"2024-09-21T03:24:32.135682+0000","last_became_active":"2024-09-21T03:14:37.465240+0000","last_became_peered":"2024-09-21T03:14:37.465240+0000","last_unstale":"2024-09-21T03:24:32.135682+0000","last_undegraded":"2024-09-21T03:24:32.135682+0000","last_fullsized":"2024-09-21T03:24:32.135682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1140,"log_dups_size":0,"ondisk_log_size":1140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:34.780298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1138,"num_write_kb":5114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'2723","reported_seq":2752,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.234316+0000","last_change":"2024-09-21T03:14:38.474516+0000","last_active":"2024-09-21T03:24:32.234316+0000","last_peered":"2024-09-21T03:24:32.234316+0000","last_clean":"2024-09-21T03:24:32.234316+0000","last_became_active":"2024-09-21T03:14:38.472225+0000","last_became_peered":"2024-09-21T03:14:38.472225+0000","last_unstale":"2024-09-21T03:24:32.234316+0000","last_undegraded":"2024-09-21T03:24:32.234316+0000","last_fullsized":"2024-09-21T03:24:32.234316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2723,"log_dups_size":0,"ondisk_log_size":2723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:47.504910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40361,"num_write_kb":500658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'77","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.576199+0000","last_change":"2024-09-21T03:14:46.544072+0000","last_active":"2024-09-21T03:24:32.576199+0000","last_peered":"2024-09-21T03:24:32.576199+0000","last_clean":"2024-09-21T03:24:32.576199+0000","last_became_active":"2024-09-21T03:14:46.543729+0000","last_became_peered":"2024-09-21T03:14:46.543729+0000","last_unstale":"2024-09-21T03:24:32.576199+0000","last_undegraded":"2024-09-21T03:24:32.576199+0000","last_fullsized":"2024-09-21T03:24:32.576199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:18.560012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":12315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"27'2727","reported_seq":2748,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.589575+0000","last_change":"2024-09-21T03:14:47.563764+0000","last_active":"2024-09-21T03:24:32.589575+0000","last_peered":"2024-09-21T03:24:32.589575+0000","last_clean":"2024-09-21T03:24:32.589575+0000","last_became_active":"2024-09-21T03:14:47.562943+0000","last_became_peered":"2024-09-21T03:14:47.562943+0000","last_unstale":"2024-09-21T03:24:32.589575+0000","last_undegraded":"2024-09-21T03:24:32.589575+0000","last_fullsized":"2024-09-21T03:24:32.589575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2727,"log_dups_size":0,"ondisk_log_size":2727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:39.284350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39824,"num_write_kb":405293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"27'3818","reported_seq":3847,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.163517+0000","last_change":"2024-09-21T03:14:38.484311+0000","last_active":"2024-09-21T03:24:32.163517+0000","last_peered":"2024-09-21T03:24:32.163517+0000","last_clean":"2024-09-21T03:24:32.163517+0000","last_became_active":"2024-09-21T03:14:38.483975+0000","last_became_peered":"2024-09-21T03:14:38.483975+0000","last_unstale":"2024-09-21T03:24:32.163517+0000","last_undegraded":"2024-09-21T03:24:32.163517+0000","last_fullsized":"2024-09-21T03:24:32.163517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3818,"log_dups_size":0,"ondisk_log_size":3818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:31.145431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56663,"num_write_kb":721573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"27'3389","reported_seq":3410,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.607780+0000","last_change":"2024-09-21T03:14:47.566252+0000","last_active":"2024-09-21T03:24:32.607780+0000","last_peered":"2024-09-21T03:24:32.607780+0000","last_clean":"2024-09-21T03:24:32.607780+0000","last_became_active":"2024-09-21T03:14:47.560282+0000","last_became_peered":"2024-09-21T03:14:47.560282+0000","last_unstale":"2024-09-21T03:24:32.607780+0000","last_undegraded":"2024-09-21T03:24:32.607780+0000","last_fullsized":"2024-09-21T03:24:32.607780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3389,"log_dups_size":0,"ondisk_log_size":3389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:23.553847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49276,"num_write_kb":506666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"27'3185","reported_seq":3214,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.016946+0000","last_change":"2024-09-21T03:14:38.477183+0000","last_active":"2024-09-21T03:24:32.016946+0000","last_peered":"2024-09-21T03:24:32.016946+0000","last_clean":"2024-09-21T03:24:32.016946+0000","last_became_active":"2024-09-21T03:14:38.476657+0000","last_became_peered":"2024-09-21T03:14:38.476657+0000","last_unstale":"2024-09-21T03:24:32.016946+0000","last_undegraded":"2024-09-21T03:24:32.016946+0000","last_fullsized":"2024-09-21T03:24:32.016946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3185,"log_dups_size":0,"ondisk_log_size":3185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:36.801764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47236,"num_write_kb":609124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"27'2685","reported_seq":2706,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.567340+0000","last_change":"2024-09-21T03:14:47.574339+0000","last_active":"2024-09-21T03:24:32.567340+0000","last_peered":"2024-09-21T03:24:32.567340+0000","last_clean":"2024-09-21T03:24:32.567340+0000","last_became_active":"2024-09-21T03:14:47.565732+0000","last_became_peered":"2024-09-21T03:14:47.565732+0000","last_unstale":"2024-09-21T03:24:32.567340+0000","last_undegraded":"2024-09-21T03:24:32.567340+0000","last_fullsized":"2024-09-21T03:24:32.567340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2685,"log_dups_size":0,"ondisk_log_size":2685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:57.896810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39100,"num_write_kb":400538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'3532","reported_seq":3561,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.118361+0000","last_change":"2024-09-21T03:14:38.472860+0000","last_active":"2024-09-21T03:24:32.118361+0000","last_peered":"2024-09-21T03:24:32.118361+0000","last_clean":"2024-09-21T03:24:32.118361+0000","last_became_active":"2024-09-21T03:14:38.472548+0000","last_became_peered":"2024-09-21T03:14:38.472548+0000","last_unstale":"2024-09-21T03:24:32.118361+0000","last_undegraded":"2024-09-21T03:24:32.118361+0000","last_fullsized":"2024-09-21T03:24:32.118361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:16.071692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52273,"num_write_kb":690147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"27'3146","reported_seq":3167,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.503698+0000","last_change":"2024-09-21T03:14:47.557402+0000","last_active":"2024-09-21T03:24:32.503698+0000","last_peered":"2024-09-21T03:24:32.503698+0000","last_clean":"2024-09-21T03:24:32.503698+0000","last_became_active":"2024-09-21T03:14:47.557047+0000","last_became_peered":"2024-09-21T03:14:47.557047+0000","last_unstale":"2024-09-21T03:24:32.503698+0000","last_undegraded":"2024-09-21T03:24:32.503698+0000","last_fullsized":"2024-09-21T03:24:32.503698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3146,"log_dups_size":0,"ondisk_log_size":3146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:29.792514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46003,"num_write_kb":479339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'2568","reported_seq":2597,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.171016+0000","last_change":"2024-09-21T03:14:38.481039+0000","last_active":"2024-09-21T03:24:32.171016+0000","last_peered":"2024-09-21T03:24:32.171016+0000","last_clean":"2024-09-21T03:24:32.171016+0000","last_became_active":"2024-09-21T03:14:38.480686+0000","last_became_peered":"2024-09-21T03:14:38.480686+0000","last_unstale":"2024-09-21T03:24:32.171016+0000","last_undegraded":"2024-09-21T03:24:32.171016+0000","last_fullsized":"2024-09-21T03:24:32.171016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2568,"log_dups_size":0,"ondisk_log_size":2568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:18.603386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37971,"num_write_kb":494263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"27'3593","reported_seq":3614,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.536048+0000","last_change":"2024-09-21T03:14:47.565697+0000","last_active":"2024-09-21T03:24:32.536048+0000","last_peered":"2024-09-21T03:24:32.536048+0000","last_clean":"2024-09-21T03:24:32.536048+0000","last_became_active":"2024-09-21T03:14:47.565393+0000","last_became_peered":"2024-09-21T03:14:47.565393+0000","last_unstale":"2024-09-21T03:24:32.536048+0000","last_undegraded":"2024-09-21T03:24:32.536048+0000","last_fullsized":"2024-09-21T03:24:32.536048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3593,"log_dups_size":0,"ondisk_log_size":3593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:35.421803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52343,"num_write_kb":533323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'2829","reported_seq":2858,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.146488+0000","last_change":"2024-09-21T03:14:38.473900+0000","last_active":"2024-09-21T03:24:32.146488+0000","last_peered":"2024-09-21T03:24:32.146488+0000","last_clean":"2024-09-21T03:24:32.146488+0000","last_became_active":"2024-09-21T03:14:38.471325+0000","last_became_peered":"2024-09-21T03:14:38.471325+0000","last_unstale":"2024-09-21T03:24:32.146488+0000","last_undegraded":"2024-09-21T03:24:32.146488+0000","last_fullsized":"2024-09-21T03:24:32.146488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2829,"log_dups_size":0,"ondisk_log_size":2829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:47.556293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41957,"num_write_kb":531654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"27'2577","reported_seq":2604,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.589169+0000","last_change":"2024-09-21T03:15:15.685059+0000","last_active":"2024-09-21T03:24:32.589169+0000","last_peered":"2024-09-21T03:24:32.589169+0000","last_clean":"2024-09-21T03:24:32.589169+0000","last_became_active":"2024-09-21T03:15:15.684633+0000","last_became_peered":"2024-09-21T03:15:15.684633+0000","last_unstale":"2024-09-21T03:24:32.589169+0000","last_undegraded":"2024-09-21T03:24:32.589169+0000","last_fullsized":"2024-09-21T03:24:32.589169+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2577,"log_dups_size":0,"ondisk_log_size":2577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:22.251366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37382,"num_write_kb":380663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"27'3218","reported_seq":3247,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.489940+0000","last_change":"2024-09-21T03:14:38.478099+0000","last_active":"2024-09-21T03:24:44.489940+0000","last_peered":"2024-09-21T03:24:44.489940+0000","last_clean":"2024-09-21T03:24:44.489940+0000","last_became_active":"2024-09-21T03:14:38.475894+0000","last_became_peered":"2024-09-21T03:14:38.475894+0000","last_unstale":"2024-09-21T03:24:44.489940+0000","last_undegraded":"2024-09-21T03:24:44.489940+0000","last_fullsized":"2024-09-21T03:24:44.489940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3218,"log_dups_size":0,"ondisk_log_size":3218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:49.876430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47546,"num_write_kb":620007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"27'3711","reported_seq":3732,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.587650+0000","last_change":"2024-09-21T03:14:47.556933+0000","last_active":"2024-09-21T03:24:32.587650+0000","last_peered":"2024-09-21T03:24:32.587650+0000","last_clean":"2024-09-21T03:24:32.587650+0000","last_became_active":"2024-09-21T03:14:47.556615+0000","last_became_peered":"2024-09-21T03:14:47.556615+0000","last_unstale":"2024-09-21T03:24:32.587650+0000","last_undegraded":"2024-09-21T03:24:32.587650+0000","last_fullsized":"2024-09-21T03:24:32.587650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3711,"log_dups_size":0,"ondisk_log_size":3711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:27.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54133,"num_write_kb":557757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"27'2783","reported_seq":2812,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.174054+0000","last_change":"2024-09-21T03:14:38.484198+0000","last_active":"2024-09-21T03:24:32.174054+0000","last_peered":"2024-09-21T03:24:32.174054+0000","last_clean":"2024-09-21T03:24:32.174054+0000","last_became_active":"2024-09-21T03:14:38.483893+0000","last_became_peered":"2024-09-21T03:14:38.483893+0000","last_unstale":"2024-09-21T03:24:32.174054+0000","last_undegraded":"2024-09-21T03:24:32.174054+0000","last_fullsized":"2024-09-21T03:24:32.174054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2783,"log_dups_size":0,"ondisk_log_size":2783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:56.665359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41301,"num_write_kb":515809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"27'3212","reported_seq":3233,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.446636+0000","last_change":"2024-09-21T03:14:47.553479+0000","last_active":"2024-09-21T03:24:32.446636+0000","last_peered":"2024-09-21T03:24:32.446636+0000","last_clean":"2024-09-21T03:24:32.446636+0000","last_became_active":"2024-09-21T03:14:47.553144+0000","last_became_peered":"2024-09-21T03:14:47.553144+0000","last_unstale":"2024-09-21T03:24:32.446636+0000","last_undegraded":"2024-09-21T03:24:32.446636+0000","last_fullsized":"2024-09-21T03:24:32.446636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3212,"log_dups_size":0,"ondisk_log_size":3212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:26.321488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46752,"num_write_kb":476180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'3505","reported_seq":3534,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.215313+0000","last_change":"2024-09-21T03:14:38.487093+0000","last_active":"2024-09-21T03:24:32.215313+0000","last_peered":"2024-09-21T03:24:32.215313+0000","last_clean":"2024-09-21T03:24:32.215313+0000","last_became_active":"2024-09-21T03:14:38.486204+0000","last_became_peered":"2024-09-21T03:14:38.486204+0000","last_unstale":"2024-09-21T03:24:32.215313+0000","last_undegraded":"2024-09-21T03:24:32.215313+0000","last_fullsized":"2024-09-21T03:24:32.215313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:55.531046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51770,"num_write_kb":667306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"27'2344","reported_seq":2365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.614027+0000","last_change":"2024-09-21T03:14:47.573375+0000","last_active":"2024-09-21T03:24:32.614027+0000","last_peered":"2024-09-21T03:24:32.614027+0000","last_clean":"2024-09-21T03:24:32.614027+0000","last_became_active":"2024-09-21T03:14:47.572717+0000","last_became_peered":"2024-09-21T03:14:47.572717+0000","last_unstale":"2024-09-21T03:24:32.614027+0000","last_undegraded":"2024-09-21T03:24:32.614027+0000","last_fullsized":"2024-09-21T03:24:32.614027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2344,"log_dups_size":0,"ondisk_log_size":2344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:44.673283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33818,"num_write_kb":353403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"27'2605","reported_seq":2634,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.218196+0000","last_change":"2024-09-21T03:14:38.471959+0000","last_active":"2024-09-21T03:24:32.218196+0000","last_peered":"2024-09-21T03:24:32.218196+0000","last_clean":"2024-09-21T03:24:32.218196+0000","last_became_active":"2024-09-21T03:14:38.471625+0000","last_became_peered":"2024-09-21T03:14:38.471625+0000","last_unstale":"2024-09-21T03:24:32.218196+0000","last_undegraded":"2024-09-21T03:24:32.218196+0000","last_fullsized":"2024-09-21T03:24:32.218196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2605,"log_dups_size":0,"ondisk_log_size":2605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:17.761951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38420,"num_write_kb":499975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"27'3509","reported_seq":3530,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.550591+0000","last_change":"2024-09-21T03:14:47.564597+0000","last_active":"2024-09-21T03:24:32.550591+0000","last_peered":"2024-09-21T03:24:32.550591+0000","last_clean":"2024-09-21T03:24:32.550591+0000","last_became_active":"2024-09-21T03:14:47.563816+0000","last_became_peered":"2024-09-21T03:14:47.563816+0000","last_unstale":"2024-09-21T03:24:32.550591+0000","last_undegraded":"2024-09-21T03:24:32.550591+0000","last_fullsized":"2024-09-21T03:24:32.550591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3509,"log_dups_size":0,"ondisk_log_size":3509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:33.061271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50894,"num_write_kb":526303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'3035","reported_seq":3064,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.004794+0000","last_change":"2024-09-21T03:14:38.491888+0000","last_active":"2024-09-21T03:24:32.004794+0000","last_peered":"2024-09-21T03:24:32.004794+0000","last_clean":"2024-09-21T03:24:32.004794+0000","last_became_active":"2024-09-21T03:14:38.491510+0000","last_became_peered":"2024-09-21T03:14:38.491510+0000","last_unstale":"2024-09-21T03:24:32.004794+0000","last_undegraded":"2024-09-21T03:24:32.004794+0000","last_fullsized":"2024-09-21T03:24:32.004794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3035,"log_dups_size":0,"ondisk_log_size":3035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:26.740304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44704,"num_write_kb":573613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"27'2891","reported_seq":2912,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.592034+0000","last_change":"2024-09-21T03:14:47.564310+0000","last_active":"2024-09-21T03:24:32.592034+0000","last_peered":"2024-09-21T03:24:32.592034+0000","last_clean":"2024-09-21T03:24:32.592034+0000","last_became_active":"2024-09-21T03:14:47.564003+0000","last_became_peered":"2024-09-21T03:14:47.564003+0000","last_unstale":"2024-09-21T03:24:32.592034+0000","last_undegraded":"2024-09-21T03:24:32.592034+0000","last_fullsized":"2024-09-21T03:24:32.592034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2891,"log_dups_size":0,"ondisk_log_size":2891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:45.016321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42050,"num_write_kb":436747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"27'3497","reported_seq":3526,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.095492+0000","last_change":"2024-09-21T03:14:38.470991+0000","last_active":"2024-09-21T03:24:32.095492+0000","last_peered":"2024-09-21T03:24:32.095492+0000","last_clean":"2024-09-21T03:24:32.095492+0000","last_became_active":"2024-09-21T03:14:38.470666+0000","last_became_peered":"2024-09-21T03:14:38.470666+0000","last_unstale":"2024-09-21T03:24:32.095492+0000","last_undegraded":"2024-09-21T03:24:32.095492+0000","last_fullsized":"2024-09-21T03:24:32.095492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3497,"log_dups_size":0,"ondisk_log_size":3497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:25.477992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51813,"num_write_kb":639602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"27'2972","reported_seq":2993,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.605743+0000","last_change":"2024-09-21T03:14:47.575212+0000","last_active":"2024-09-21T03:24:32.605743+0000","last_peered":"2024-09-21T03:24:32.605743+0000","last_clean":"2024-09-21T03:24:32.605743+0000","last_became_active":"2024-09-21T03:14:47.574895+0000","last_became_peered":"2024-09-21T03:14:47.574895+0000","last_unstale":"2024-09-21T03:24:32.605743+0000","last_undegraded":"2024-09-21T03:24:32.605743+0000","last_fullsized":"2024-09-21T03:24:32.605743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2972,"log_dups_size":0,"ondisk_log_size":2972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:04.240949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43060,"num_write_kb":442689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"27'2913","reported_seq":2942,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.230843+0000","last_change":"2024-09-21T03:14:38.482681+0000","last_active":"2024-09-21T03:24:32.230843+0000","last_peered":"2024-09-21T03:24:32.230843+0000","last_clean":"2024-09-21T03:24:32.230843+0000","last_became_active":"2024-09-21T03:14:38.477816+0000","last_became_peered":"2024-09-21T03:14:38.477816+0000","last_unstale":"2024-09-21T03:24:32.230843+0000","last_undegraded":"2024-09-21T03:24:32.230843+0000","last_fullsized":"2024-09-21T03:24:32.230843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2913,"log_dups_size":0,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:18.675641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42673,"num_write_kb":583298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"27'3298","reported_seq":3319,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.521462+0000","last_change":"2024-09-21T03:14:47.555329+0000","last_active":"2024-09-21T03:24:32.521462+0000","last_peered":"2024-09-21T03:24:32.521462+0000","last_clean":"2024-09-21T03:24:32.521462+0000","last_became_active":"2024-09-21T03:14:47.555033+0000","last_became_peered":"2024-09-21T03:14:47.555033+0000","last_unstale":"2024-09-21T03:24:32.521462+0000","last_undegraded":"2024-09-21T03:24:32.521462+0000","last_fullsized":"2024-09-21T03:24:32.521462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3298,"log_dups_size":0,"ondisk_log_size":3298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:49.060834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48400,"num_write_kb":492898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"27'3010","reported_seq":3039,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.196891+0000","last_change":"2024-09-21T03:14:38.480638+0000","last_active":"2024-09-21T03:24:32.196891+0000","last_peered":"2024-09-21T03:24:32.196891+0000","last_clean":"2024-09-21T03:24:32.196891+0000","last_became_active":"2024-09-21T03:14:38.477739+0000","last_became_peered":"2024-09-21T03:14:38.477739+0000","last_unstale":"2024-09-21T03:24:32.196891+0000","last_undegraded":"2024-09-21T03:24:32.196891+0000","last_fullsized":"2024-09-21T03:24:32.196891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3010,"log_dups_size":0,"ondisk_log_size":3010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:35.097761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44651,"num_write_kb":569943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"27'3044","reported_seq":3065,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.602093+0000","last_change":"2024-09-21T03:14:47.573659+0000","last_active":"2024-09-21T03:24:32.602093+0000","last_peered":"2024-09-21T03:24:32.602093+0000","last_clean":"2024-09-21T03:24:32.602093+0000","last_became_active":"2024-09-21T03:14:47.572756+0000","last_became_peered":"2024-09-21T03:14:47.572756+0000","last_unstale":"2024-09-21T03:24:32.602093+0000","last_undegraded":"2024-09-21T03:24:32.602093+0000","last_fullsized":"2024-09-21T03:24:32.602093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3044,"log_dups_size":0,"ondisk_log_size":3044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:21.986681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44174,"num_write_kb":452226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'3117","reported_seq":3150,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.257690+0000","last_change":"2024-09-21T03:19:03.558825+0000","last_active":"2024-09-21T03:24:32.257690+0000","last_peered":"2024-09-21T03:24:32.257690+0000","last_clean":"2024-09-21T03:24:32.257690+0000","last_became_active":"2024-09-21T03:14:38.473843+0000","last_became_peered":"2024-09-21T03:14:38.473843+0000","last_unstale":"2024-09-21T03:24:32.257690+0000","last_undegraded":"2024-09-21T03:24:32.257690+0000","last_fullsized":"2024-09-21T03:24:32.257690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3117,"log_dups_size":0,"ondisk_log_size":3117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:27.072406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46022,"num_write_kb":573473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"27'2632","reported_seq":2653,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.607860+0000","last_change":"2024-09-21T03:14:47.555386+0000","last_active":"2024-09-21T03:24:32.607860+0000","last_peered":"2024-09-21T03:24:32.607860+0000","last_clean":"2024-09-21T03:24:32.607860+0000","last_became_active":"2024-09-21T03:14:47.554758+0000","last_became_peered":"2024-09-21T03:14:47.554758+0000","last_unstale":"2024-09-21T03:24:32.607860+0000","last_undegraded":"2024-09-21T03:24:32.607860+0000","last_fullsized":"2024-09-21T03:24:32.607860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2632,"log_dups_size":0,"ondisk_log_size":2632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:47.574672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38196,"num_write_kb":393191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"27'2520","reported_seq":2549,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.240443+0000","last_change":"2024-09-21T03:14:38.494878+0000","last_active":"2024-09-21T03:24:32.240443+0000","last_peered":"2024-09-21T03:24:32.240443+0000","last_clean":"2024-09-21T03:24:32.240443+0000","last_became_active":"2024-09-21T03:14:38.492813+0000","last_became_peered":"2024-09-21T03:14:38.492813+0000","last_unstale":"2024-09-21T03:24:32.240443+0000","last_undegraded":"2024-09-21T03:24:32.240443+0000","last_fullsized":"2024-09-21T03:24:32.240443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2520,"log_dups_size":0,"ondisk_log_size":2520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:55.064844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37062,"num_write_kb":456367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"27'2959","reported_seq":2980,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.443568+0000","last_change":"2024-09-21T03:14:47.544806+0000","last_active":"2024-09-21T03:24:32.443568+0000","last_peered":"2024-09-21T03:24:32.443568+0000","last_clean":"2024-09-21T03:24:32.443568+0000","last_became_active":"2024-09-21T03:14:47.544431+0000","last_became_peered":"2024-09-21T03:14:47.544431+0000","last_unstale":"2024-09-21T03:24:32.443568+0000","last_undegraded":"2024-09-21T03:24:32.443568+0000","last_fullsized":"2024-09-21T03:24:32.443568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2959,"log_dups_size":0,"ondisk_log_size":2959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:01.463573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43240,"num_write_kb":437209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"27'3812","reported_seq":3841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.129705+0000","last_change":"2024-09-21T03:14:38.474462+0000","last_active":"2024-09-21T03:24:32.129705+0000","last_peered":"2024-09-21T03:24:32.129705+0000","last_clean":"2024-09-21T03:24:32.129705+0000","last_became_active":"2024-09-21T03:14:38.474156+0000","last_became_peered":"2024-09-21T03:14:38.474156+0000","last_unstale":"2024-09-21T03:24:32.129705+0000","last_undegraded":"2024-09-21T03:24:32.129705+0000","last_fullsized":"2024-09-21T03:24:32.129705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3812,"log_dups_size":0,"ondisk_log_size":3812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:55.329945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56526,"num_write_kb":700246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"27'3369","reported_seq":3390,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.582700+0000","last_change":"2024-09-21T03:14:47.563297+0000","last_active":"2024-09-21T03:24:32.582700+0000","last_peered":"2024-09-21T03:24:32.582700+0000","last_clean":"2024-09-21T03:24:32.582700+0000","last_became_active":"2024-09-21T03:14:47.562519+0000","last_became_peered":"2024-09-21T03:14:47.562519+0000","last_unstale":"2024-09-21T03:24:32.582700+0000","last_undegraded":"2024-09-21T03:24:32.582700+0000","last_fullsized":"2024-09-21T03:24:32.582700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3369,"log_dups_size":0,"ondisk_log_size":3369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:47.959373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49240,"num_write_kb":516390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"27'2612","reported_seq":2641,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.135783+0000","last_change":"2024-09-21T03:14:38.474262+0000","last_active":"2024-09-21T03:24:32.135783+0000","last_peered":"2024-09-21T03:24:32.135783+0000","last_clean":"2024-09-21T03:24:32.135783+0000","last_became_active":"2024-09-21T03:14:38.473856+0000","last_became_peered":"2024-09-21T03:14:38.473856+0000","last_unstale":"2024-09-21T03:24:32.135783+0000","last_undegraded":"2024-09-21T03:24:32.135783+0000","last_fullsized":"2024-09-21T03:24:32.135783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2612,"log_dups_size":0,"ondisk_log_size":2612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38668,"num_write_kb":516995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"27'3686","reported_seq":3707,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.630902+0000","last_change":"2024-09-21T03:14:47.558732+0000","last_active":"2024-09-21T03:24:32.630902+0000","last_peered":"2024-09-21T03:24:32.630902+0000","last_clean":"2024-09-21T03:24:32.630902+0000","last_became_active":"2024-09-21T03:14:47.558403+0000","last_became_peered":"2024-09-21T03:14:47.558403+0000","last_unstale":"2024-09-21T03:24:32.630902+0000","last_undegraded":"2024-09-21T03:24:32.630902+0000","last_fullsized":"2024-09-21T03:24:32.630902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3686,"log_dups_size":0,"ondisk_log_size":3686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:46.054565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53973,"num_write_kb":552799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"27'3255","reported_seq":3284,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.199554+0000","last_change":"2024-09-21T03:14:38.469736+0000","last_active":"2024-09-21T03:24:32.199554+0000","last_peered":"2024-09-21T03:24:32.199554+0000","last_clean":"2024-09-21T03:24:32.199554+0000","last_became_active":"2024-09-21T03:14:38.469240+0000","last_became_peered":"2024-09-21T03:14:38.469240+0000","last_unstale":"2024-09-21T03:24:32.199554+0000","last_undegraded":"2024-09-21T03:24:32.199554+0000","last_fullsized":"2024-09-21T03:24:32.199554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:04.258761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48009,"num_write_kb":600153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"27'2362","reported_seq":2383,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.547869+0000","last_change":"2024-09-21T03:14:47.550684+0000","last_active":"2024-09-21T03:24:32.547869+0000","last_peered":"2024-09-21T03:24:32.547869+0000","last_clean":"2024-09-21T03:24:32.547869+0000","last_became_active":"2024-09-21T03:14:47.550375+0000","last_became_peered":"2024-09-21T03:14:47.550375+0000","last_unstale":"2024-09-21T03:24:32.547869+0000","last_undegraded":"2024-09-21T03:24:32.547869+0000","last_fullsized":"2024-09-21T03:24:32.547869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2362,"log_dups_size":0,"ondisk_log_size":2362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:05.268160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34335,"num_write_kb":360179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'3448","reported_seq":3477,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.462241+0000","last_change":"2024-09-21T03:14:38.487983+0000","last_active":"2024-09-21T03:24:44.462241+0000","last_peered":"2024-09-21T03:24:44.462241+0000","last_clean":"2024-09-21T03:24:44.462241+0000","last_became_active":"2024-09-21T03:14:38.487676+0000","last_became_peered":"2024-09-21T03:14:38.487676+0000","last_unstale":"2024-09-21T03:24:44.462241+0000","last_undegraded":"2024-09-21T03:24:44.462241+0000","last_fullsized":"2024-09-21T03:24:44.462241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3448,"log_dups_size":0,"ondisk_log_size":3448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:35.320169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50832,"num_write_kb":624952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"27'2804","reported_seq":2831,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.490480+0000","last_change":"2024-09-21T03:19:03.558582+0000","last_active":"2024-09-21T03:24:32.490480+0000","last_peered":"2024-09-21T03:24:32.490480+0000","last_clean":"2024-09-21T03:24:32.490480+0000","last_became_active":"2024-09-21T03:14:47.561229+0000","last_became_peered":"2024-09-21T03:14:47.561229+0000","last_unstale":"2024-09-21T03:24:32.490480+0000","last_undegraded":"2024-09-21T03:24:32.490480+0000","last_fullsized":"2024-09-21T03:24:32.490480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2804,"log_dups_size":0,"ondisk_log_size":2804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:07.280356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40720,"num_write_kb":419729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"27'2665","reported_seq":2689,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.480308+0000","last_change":"2024-09-21T03:14:38.478853+0000","last_active":"2024-09-21T03:24:44.480308+0000","last_peered":"2024-09-21T03:24:44.480308+0000","last_clean":"2024-09-21T03:24:44.480308+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:24:44.480308+0000","last_undegraded":"2024-09-21T03:24:44.480308+0000","last_fullsized":"2024-09-21T03:24:44.480308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2665,"log_dups_size":0,"ondisk_log_size":2665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:31.427596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39018,"num_write_kb":519966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"27'3111","reported_seq":3126,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.629652+0000","last_change":"2024-09-21T03:15:15.686915+0000","last_active":"2024-09-21T03:24:32.629652+0000","last_peered":"2024-09-21T03:24:32.629652+0000","last_clean":"2024-09-21T03:24:32.629652+0000","last_became_active":"2024-09-21T03:15:15.686514+0000","last_became_peered":"2024-09-21T03:15:15.686514+0000","last_unstale":"2024-09-21T03:24:32.629652+0000","last_undegraded":"2024-09-21T03:24:32.629652+0000","last_fullsized":"2024-09-21T03:24:32.629652+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3111,"log_dups_size":0,"ondisk_log_size":3111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:46.388388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45367,"num_write_kb":462728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'2751","reported_seq":2780,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.142874+0000","last_change":"2024-09-21T03:14:38.481308+0000","last_active":"2024-09-21T03:24:32.142874+0000","last_peered":"2024-09-21T03:24:32.142874+0000","last_clean":"2024-09-21T03:24:32.142874+0000","last_became_active":"2024-09-21T03:14:38.480923+0000","last_became_peered":"2024-09-21T03:14:38.480923+0000","last_unstale":"2024-09-21T03:24:32.142874+0000","last_undegraded":"2024-09-21T03:24:32.142874+0000","last_fullsized":"2024-09-21T03:24:32.142874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2751,"log_dups_size":0,"ondisk_log_size":2751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:40.689231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40836,"num_write_kb":498819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"27'2747","reported_seq":2768,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.606907+0000","last_change":"2024-09-21T03:14:47.561972+0000","last_active":"2024-09-21T03:24:32.606907+0000","last_peered":"2024-09-21T03:24:32.606907+0000","last_clean":"2024-09-21T03:24:32.606907+0000","last_became_active":"2024-09-21T03:14:47.561645+0000","last_became_peered":"2024-09-21T03:14:47.561645+0000","last_unstale":"2024-09-21T03:24:32.606907+0000","last_undegraded":"2024-09-21T03:24:32.606907+0000","last_fullsized":"2024-09-21T03:24:32.606907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2747,"log_dups_size":0,"ondisk_log_size":2747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:57.526787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40136,"num_write_kb":410250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"27'2785","reported_seq":2814,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.033578+0000","last_change":"2024-09-21T03:14:38.473907+0000","last_active":"2024-09-21T03:24:32.033578+0000","last_peered":"2024-09-21T03:24:32.033578+0000","last_clean":"2024-09-21T03:24:32.033578+0000","last_became_active":"2024-09-21T03:14:38.473579+0000","last_became_peered":"2024-09-21T03:14:38.473579+0000","last_unstale":"2024-09-21T03:24:32.033578+0000","last_undegraded":"2024-09-21T03:24:32.033578+0000","last_fullsized":"2024-09-21T03:24:32.033578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2785,"log_dups_size":0,"ondisk_log_size":2785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:32.273503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41232,"num_write_kb":540257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"27'2612","reported_seq":2633,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.554999+0000","last_change":"2024-09-21T03:14:47.566089+0000","last_active":"2024-09-21T03:24:32.554999+0000","last_peered":"2024-09-21T03:24:32.554999+0000","last_clean":"2024-09-21T03:24:32.554999+0000","last_became_active":"2024-09-21T03:14:47.565681+0000","last_became_peered":"2024-09-21T03:14:47.565681+0000","last_unstale":"2024-09-21T03:24:32.554999+0000","last_undegraded":"2024-09-21T03:24:32.554999+0000","last_fullsized":"2024-09-21T03:24:32.554999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2612,"log_dups_size":0,"ondisk_log_size":2612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.208933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37892,"num_write_kb":397863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'3449","reported_seq":3478,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.149584+0000","last_change":"2024-09-21T03:14:38.474326+0000","last_active":"2024-09-21T03:24:32.149584+0000","last_peered":"2024-09-21T03:24:32.149584+0000","last_clean":"2024-09-21T03:24:32.149584+0000","last_became_active":"2024-09-21T03:14:38.470430+0000","last_became_peered":"2024-09-21T03:14:38.470430+0000","last_unstale":"2024-09-21T03:24:32.149584+0000","last_undegraded":"2024-09-21T03:24:32.149584+0000","last_fullsized":"2024-09-21T03:24:32.149584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3449,"log_dups_size":0,"ondisk_log_size":3449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:09.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51200,"num_write_kb":673726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"27'2988","reported_seq":3009,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.590714+0000","last_change":"2024-09-21T03:14:47.571487+0000","last_active":"2024-09-21T03:24:32.590714+0000","last_peered":"2024-09-21T03:24:32.590714+0000","last_clean":"2024-09-21T03:24:32.590714+0000","last_became_active":"2024-09-21T03:14:47.571126+0000","last_became_peered":"2024-09-21T03:14:47.571126+0000","last_unstale":"2024-09-21T03:24:32.590714+0000","last_undegraded":"2024-09-21T03:24:32.590714+0000","last_fullsized":"2024-09-21T03:24:32.590714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2988,"log_dups_size":0,"ondisk_log_size":2988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:57.128853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43649,"num_write_kb":455041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'4004","reported_seq":4033,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.093328+0000","last_change":"2024-09-21T03:14:38.483370+0000","last_active":"2024-09-21T03:24:32.093328+0000","last_peered":"2024-09-21T03:24:32.093328+0000","last_clean":"2024-09-21T03:24:32.093328+0000","last_became_active":"2024-09-21T03:14:38.483019+0000","last_became_peered":"2024-09-21T03:14:38.483019+0000","last_unstale":"2024-09-21T03:24:32.093328+0000","last_undegraded":"2024-09-21T03:24:32.093328+0000","last_fullsized":"2024-09-21T03:24:32.093328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":4004,"log_dups_size":0,"ondisk_log_size":4004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:55.085422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59359,"num_write_kb":743455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"27'3947","reported_seq":3968,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.621007+0000","last_change":"2024-09-21T03:14:47.555777+0000","last_active":"2024-09-21T03:24:32.621007+0000","last_peered":"2024-09-21T03:24:32.621007+0000","last_clean":"2024-09-21T03:24:32.621007+0000","last_became_active":"2024-09-21T03:14:47.555465+0000","last_became_peered":"2024-09-21T03:14:47.555465+0000","last_unstale":"2024-09-21T03:24:32.621007+0000","last_undegraded":"2024-09-21T03:24:32.621007+0000","last_fullsized":"2024-09-21T03:24:32.621007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3947,"log_dups_size":0,"ondisk_log_size":3947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:27.123740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57951,"num_write_kb":584164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"27'3360","reported_seq":3389,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.110043+0000","last_change":"2024-09-21T03:14:38.465771+0000","last_active":"2024-09-21T03:24:32.110043+0000","last_peered":"2024-09-21T03:24:32.110043+0000","last_clean":"2024-09-21T03:24:32.110043+0000","last_became_active":"2024-09-21T03:14:38.465479+0000","last_became_peered":"2024-09-21T03:14:38.465479+0000","last_unstale":"2024-09-21T03:24:32.110043+0000","last_undegraded":"2024-09-21T03:24:32.110043+0000","last_fullsized":"2024-09-21T03:24:32.110043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.754315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50038,"num_write_kb":621750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"27'2517","reported_seq":2538,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.616190+0000","last_change":"2024-09-21T03:14:47.567695+0000","last_active":"2024-09-21T03:24:32.616190+0000","last_peered":"2024-09-21T03:24:32.616190+0000","last_clean":"2024-09-21T03:24:32.616190+0000","last_became_active":"2024-09-21T03:14:47.566936+0000","last_became_peered":"2024-09-21T03:14:47.566936+0000","last_unstale":"2024-09-21T03:24:32.616190+0000","last_undegraded":"2024-09-21T03:24:32.616190+0000","last_fullsized":"2024-09-21T03:24:32.616190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2517,"log_dups_size":0,"ondisk_log_size":2517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:48.182523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36538,"num_write_kb":381931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"27'2953","reported_seq":2967,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.268218+0000","last_change":"2024-09-21T03:15:15.807206+0000","last_active":"2024-09-21T03:24:32.268218+0000","last_peered":"2024-09-21T03:24:32.268218+0000","last_clean":"2024-09-21T03:24:32.268218+0000","last_became_active":"2024-09-21T03:15:15.806775+0000","last_became_peered":"2024-09-21T03:15:15.806775+0000","last_unstale":"2024-09-21T03:24:32.268218+0000","last_undegraded":"2024-09-21T03:24:32.268218+0000","last_fullsized":"2024-09-21T03:24:32.268218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2953,"log_dups_size":0,"ondisk_log_size":2953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:51.779236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43828,"num_write_kb":561683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"27'2673","reported_seq":2694,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:31.574387+0000","last_change":"2024-09-21T03:14:47.580314+0000","last_active":"2024-09-21T03:24:31.574387+0000","last_peered":"2024-09-21T03:24:31.574387+0000","last_clean":"2024-09-21T03:24:31.574387+0000","last_became_active":"2024-09-21T03:14:47.576499+0000","last_became_peered":"2024-09-21T03:14:47.576499+0000","last_unstale":"2024-09-21T03:24:31.574387+0000","last_undegraded":"2024-09-21T03:24:31.574387+0000","last_fullsized":"2024-09-21T03:24:31.574387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2673,"log_dups_size":0,"ondisk_log_size":2673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:46.154586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39028,"num_write_kb":398421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2540","reported_seq":2571,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.244977+0000","last_change":"2024-09-21T03:18:52.426898+0000","last_active":"2024-09-21T03:24:32.244977+0000","last_peered":"2024-09-21T03:24:32.244977+0000","last_clean":"2024-09-21T03:24:32.244977+0000","last_became_active":"2024-09-21T03:14:38.470708+0000","last_became_peered":"2024-09-21T03:14:38.470708+0000","last_unstale":"2024-09-21T03:24:32.244977+0000","last_undegraded":"2024-09-21T03:24:32.244977+0000","last_fullsized":"2024-09-21T03:24:32.244977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2540,"log_dups_size":0,"ondisk_log_size":2540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.122804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37433,"num_write_kb":500133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"27'3010","reported_seq":3031,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.588268+0000","last_change":"2024-09-21T03:14:47.554180+0000","last_active":"2024-09-21T03:24:32.588268+0000","last_peered":"2024-09-21T03:24:32.588268+0000","last_clean":"2024-09-21T03:24:32.588268+0000","last_became_active":"2024-09-21T03:14:47.552808+0000","last_became_peered":"2024-09-21T03:14:47.552808+0000","last_unstale":"2024-09-21T03:24:32.588268+0000","last_undegraded":"2024-09-21T03:24:32.588268+0000","last_fullsized":"2024-09-21T03:24:32.588268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3010,"log_dups_size":0,"ondisk_log_size":3010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:07.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43808,"num_write_kb":448579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"27'3588","reported_seq":3616,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.266907+0000","last_change":"2024-09-21T03:14:38.466077+0000","last_active":"2024-09-21T03:24:32.266907+0000","last_peered":"2024-09-21T03:24:32.266907+0000","last_clean":"2024-09-21T03:24:32.266907+0000","last_became_active":"2024-09-21T03:14:38.465818+0000","last_became_peered":"2024-09-21T03:14:38.465818+0000","last_unstale":"2024-09-21T03:24:32.266907+0000","last_undegraded":"2024-09-21T03:24:32.266907+0000","last_fullsized":"2024-09-21T03:24:32.266907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3588,"log_dups_size":0,"ondisk_log_size":3588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:34.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52996,"num_write_kb":671880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"27'2557","reported_seq":2577,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.462202+0000","last_change":"2024-09-21T03:14:47.577228+0000","last_active":"2024-09-21T03:24:32.462202+0000","last_peered":"2024-09-21T03:24:32.462202+0000","last_clean":"2024-09-21T03:24:32.462202+0000","last_became_active":"2024-09-21T03:14:47.576843+0000","last_became_peered":"2024-09-21T03:14:47.576843+0000","last_unstale":"2024-09-21T03:24:32.462202+0000","last_undegraded":"2024-09-21T03:24:32.462202+0000","last_fullsized":"2024-09-21T03:24:32.462202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2557,"log_dups_size":0,"ondisk_log_size":2557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:56.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37386,"num_write_kb":384305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'2852","reported_seq":2881,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:31.391497+0000","last_change":"2024-09-21T03:14:38.481389+0000","last_active":"2024-09-21T03:24:31.391497+0000","last_peered":"2024-09-21T03:24:31.391497+0000","last_clean":"2024-09-21T03:24:31.391497+0000","last_became_active":"2024-09-21T03:14:38.470907+0000","last_became_peered":"2024-09-21T03:14:38.470907+0000","last_unstale":"2024-09-21T03:24:31.391497+0000","last_undegraded":"2024-09-21T03:24:31.391497+0000","last_fullsized":"2024-09-21T03:24:31.391497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2852,"log_dups_size":0,"ondisk_log_size":2852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:30.068915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42241,"num_write_kb":536469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"27'3451","reported_seq":3471,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.628370+0000","last_change":"2024-09-21T03:14:47.551766+0000","last_active":"2024-09-21T03:24:32.628370+0000","last_peered":"2024-09-21T03:24:32.628370+0000","last_clean":"2024-09-21T03:24:32.628370+0000","last_became_active":"2024-09-21T03:14:47.551420+0000","last_became_peered":"2024-09-21T03:14:47.551420+0000","last_unstale":"2024-09-21T03:24:32.628370+0000","last_undegraded":"2024-09-21T03:24:32.628370+0000","last_fullsized":"2024-09-21T03:24:32.628370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3451,"log_dups_size":0,"ondisk_log_size":3451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:56.255472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50161,"num_write_kb":520876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'3208","reported_seq":3239,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.171060+0000","last_change":"2024-09-21T03:19:03.596591+0000","last_active":"2024-09-21T03:24:32.171060+0000","last_peered":"2024-09-21T03:24:32.171060+0000","last_clean":"2024-09-21T03:24:32.171060+0000","last_became_active":"2024-09-21T03:14:38.482306+0000","last_became_peered":"2024-09-21T03:14:38.482306+0000","last_unstale":"2024-09-21T03:24:32.171060+0000","last_undegraded":"2024-09-21T03:24:32.171060+0000","last_fullsized":"2024-09-21T03:24:32.171060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3208,"log_dups_size":0,"ondisk_log_size":3208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:40.482635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47543,"num_write_kb":599147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"27'3001","reported_seq":3021,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.449354+0000","last_change":"2024-09-21T03:14:47.555070+0000","last_active":"2024-09-21T03:24:32.449354+0000","last_peered":"2024-09-21T03:24:32.449354+0000","last_clean":"2024-09-21T03:24:32.449354+0000","last_became_active":"2024-09-21T03:14:47.554363+0000","last_became_peered":"2024-09-21T03:14:47.554363+0000","last_unstale":"2024-09-21T03:24:32.449354+0000","last_undegraded":"2024-09-21T03:24:32.449354+0000","last_fullsized":"2024-09-21T03:24:32.449354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3001,"log_dups_size":0,"ondisk_log_size":3001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:40.027266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43824,"num_write_kb":461158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"27'3732","reported_seq":3761,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.259442+0000","last_change":"2024-09-21T03:14:38.496218+0000","last_active":"2024-09-21T03:24:32.259442+0000","last_peered":"2024-09-21T03:24:32.259442+0000","last_clean":"2024-09-21T03:24:32.259442+0000","last_became_active":"2024-09-21T03:14:38.488537+0000","last_became_peered":"2024-09-21T03:14:38.488537+0000","last_unstale":"2024-09-21T03:24:32.259442+0000","last_undegraded":"2024-09-21T03:24:32.259442+0000","last_fullsized":"2024-09-21T03:24:32.259442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3732,"log_dups_size":0,"ondisk_log_size":3732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:59.667392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55343,"num_write_kb":720948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"27'2846","reported_seq":2866,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.624537+0000","last_change":"2024-09-21T03:14:47.564250+0000","last_active":"2024-09-21T03:24:32.624537+0000","last_peered":"2024-09-21T03:24:32.624537+0000","last_clean":"2024-09-21T03:24:32.624537+0000","last_became_active":"2024-09-21T03:14:47.563745+0000","last_became_peered":"2024-09-21T03:14:47.563745+0000","last_unstale":"2024-09-21T03:24:32.624537+0000","last_undegraded":"2024-09-21T03:24:32.624537+0000","last_fullsized":"2024-09-21T03:24:32.624537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:31.282910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41602,"num_write_kb":429183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"27'2871","reported_seq":2900,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.221485+0000","last_change":"2024-09-21T03:14:38.490309+0000","last_active":"2024-09-21T03:24:32.221485+0000","last_peered":"2024-09-21T03:24:32.221485+0000","last_clean":"2024-09-21T03:24:32.221485+0000","last_became_active":"2024-09-21T03:14:38.489167+0000","last_became_peered":"2024-09-21T03:14:38.489167+0000","last_unstale":"2024-09-21T03:24:32.221485+0000","last_undegraded":"2024-09-21T03:24:32.221485+0000","last_fullsized":"2024-09-21T03:24:32.221485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2871,"log_dups_size":0,"ondisk_log_size":2871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:07.725691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42623,"num_write_kb":515303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2771405,"num_write_kb":28539810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190268,"ondisk_log_size":190268,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":104688917,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":31,"num_read_kb":107,"num_write":3086,"num_write_kb":104325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":209436672,"data_stored":209377834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2751,"ondisk_log_size":2751,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2958225,"num_write_kb":37437445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199894,"ondisk_log_size":199894,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":158267809,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":29,"num_read_kb":105,"num_write":2791,"num_write_kb":156527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":316596224,"data_stored":316535618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2582,"ondisk_log_size":2582,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509566,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379144,"kb_used_data":41336,"kb_used_omap":1,"kb_used_meta":337790,"kb_avail":93992696,"statfs":{"total":96636764160,"available":96248520704,"internally_reserved":0,"allocated":42328064,"data_stored":42145705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":345897418},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509561,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":538640,"kb_used_data":66240,"kb_used_omap":1,"kb_used_meta":472382,"kb_avail":93833200,"statfs":{"total":96636764160,"available":96085196800,"internally_reserved":0,"allocated":67829760,"data_stored":67644091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":483719621},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509560,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":562860,"kb_used_data":84892,"kb_used_omap":1,"kb_used_meta":477950,"kb_avail":93808980,"statfs":{"total":96636764160,"available":96060395520,"internally_reserved":0,"allocated":86929408,"data_stored":86733234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":489421253},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509561,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":616200,"kb_used_data":61816,"kb_used_omap":1,"kb_used_meta":554366,"kb_avail":93755640,"statfs":{"total":96636764160,"available":96005775360,"internally_reserved":0,"allocated":63299584,"data_stored":63117886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":567671237},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509564,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468272,"kb_used_data":54112,"kb_used_omap":1,"kb_used_meta":414142,"kb_avail":93903568,"statfs":{"total":96636764160,"available":96157253632,"internally_reserved":0,"allocated":55410688,"data_stored":55230899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":424081861},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509562,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":592432,"kb_used_data":61728,"kb_used_omap":1,"kb_used_meta":530686,"kb_avail":93779408,"statfs":{"total":96636764160,"available":96030113792,"internally_reserved":0,"allocated":63209472,"data_stored":63029145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":543422917},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542267,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":477548,"kb_used_data":45340,"kb_used_omap":1,"kb_used_meta":432190,"kb_avail":93894292,"statfs":{"total":96636764160,"available":96147755008,"internally_reserved":0,"allocated":46428160,"data_stored":46252455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":442563014},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542265,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":583800,"kb_used_data":101608,"kb_used_omap":1,"kb_used_meta":482174,"kb_avail":93788040,"statfs":{"total":96636764160,"available":96038952960,"internally_reserved":0,"allocated":104046592,"data_stored":103856285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":493746631},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":62922752,"data_stored":62914616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33558528,"data_stored":33554502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65908736,"data_stored":65904153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":44949504,"data_stored":44933395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":37847040,"data_stored":37836908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25264128,"data_stored":25254028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37842944,"data_stored":37836951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37855232,"data_stored":37837693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":41697280,"data_stored":41685400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29106176,"data_stored":29102376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:24:46.777 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:24:47.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.029+0000 7fdff2000640 1 -- 172.21.15.90:0/1028345172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfec06fd00 msgr2=0x7fdfec154230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:47.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.029+0000 7fdff2000640 1 --2- 172.21.15.90:0/1028345172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfec06fd00 0x7fdfec154230 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc005fd0 tx=0x7fdfdc02a540 comp rx=0 tx=0).stop 2024-09-21T03:24:47.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.030+0000 7fdff2000640 1 -- 172.21.15.90:0/1028345172 shutdown_connections 2024-09-21T03:24:47.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.030+0000 7fdff2000640 1 --2- 172.21.15.90:0/1028345172 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfec0c51a0 0x7fdfec150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.030+0000 7fdff2000640 1 --2- 172.21.15.90:0/1028345172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfec06fd00 0x7fdfec154230 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.030+0000 7fdff2000640 1 -- 172.21.15.90:0/1028345172 >> 172.21.15.90:0/1028345172 conn(0x7fdfec0c84c0 msgr2=0x7fdfec0c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:47.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.030+0000 7fdff2000640 1 -- 172.21.15.90:0/1028345172 shutdown_connections 2024-09-21T03:24:47.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.030+0000 7fdff2000640 1 -- 172.21.15.90:0/1028345172 wait complete. 2024-09-21T03:24:47.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.032+0000 7fdff2000640 1 Processor -- start 2024-09-21T03:24:47.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.032+0000 7fdff2000640 1 -- start start 2024-09-21T03:24:47.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.033+0000 7fdff2000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfec06fd00 0x7fdfec0c16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:47.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.033+0000 7fdff2000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfec0c51a0 0x7fdfec14aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:47.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.033+0000 7fdff2000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfec14b430 0x7fdfec074350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:47.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.033+0000 7fdff2000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec1511c0 con 0x7fdfec06fd00 2024-09-21T03:24:47.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.033+0000 7fdff2000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec151040 con 0x7fdfec14b430 2024-09-21T03:24:47.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.033+0000 7fdff2000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdfec151340 con 0x7fdfec0c51a0 2024-09-21T03:24:47.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.033+0000 7fdff0c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfec06fd00 0x7fdfec0c16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:47.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.033+0000 7fdff0c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfec06fd00 0x7fdfec0c16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35234/0 (socket says 172.21.15.90:35234) 2024-09-21T03:24:47.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.033+0000 7fdff0c00640 1 -- 172.21.15.90:0/1338843134 learned_addr learned my addr 172.21.15.90:0/1338843134 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:47.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.034+0000 7fdfe3e00640 1 --2- 172.21.15.90:0/1338843134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfec0c51a0 0x7fdfec14aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:47.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.034+0000 7fdff1600640 1 --2- 172.21.15.90:0/1338843134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfec14b430 0x7fdfec074350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:47.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.034+0000 7fdff0c00640 1 -- 172.21.15.90:0/1338843134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfec0c51a0 msgr2=0x7fdfec14aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:47.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.034+0000 7fdff0c00640 1 --2- 172.21.15.90:0/1338843134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfec0c51a0 0x7fdfec14aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.034+0000 7fdff0c00640 1 -- 172.21.15.90:0/1338843134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfec14b430 msgr2=0x7fdfec074350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:47.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.034+0000 7fdff0c00640 1 --2- 172.21.15.90:0/1338843134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfec14b430 0x7fdfec074350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.034+0000 7fdff0c00640 1 -- 172.21.15.90:0/1338843134 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfec14c7e0 con 0x7fdfec06fd00 2024-09-21T03:24:47.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.034+0000 7fdff0c00640 1 --2- 172.21.15.90:0/1338843134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfec06fd00 0x7fdfec0c16b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc000c00 tx=0x7fdfdc003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:47.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.034+0000 7fdfe9600640 1 -- 172.21.15.90:0/1338843134 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc03e030 con 0x7fdfec06fd00 2024-09-21T03:24:47.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.035+0000 7fdfe9600640 1 -- 172.21.15.90:0/1338843134 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfdc003e60 con 0x7fdfec06fd00 2024-09-21T03:24:47.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.035+0000 7fdfe9600640 1 -- 172.21.15.90:0/1338843134 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc035040 con 0x7fdfec06fd00 2024-09-21T03:24:47.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.035+0000 7fdff2000640 1 -- 172.21.15.90:0/1338843134 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfec14bb90 con 0x7fdfec06fd00 2024-09-21T03:24:47.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.035+0000 7fdff2000640 1 -- 172.21.15.90:0/1338843134 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfec14cd90 con 0x7fdfec06fd00 2024-09-21T03:24:47.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.036+0000 7fdff2000640 1 -- 172.21.15.90:0/1338843134 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfec14cf90 con 0x7fdfec06fd00 2024-09-21T03:24:47.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.037+0000 7fdfe9600640 1 -- 172.21.15.90:0/1338843134 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdfdc041030 con 0x7fdfec06fd00 2024-09-21T03:24:47.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.038+0000 7fdfe9600640 1 --2- 172.21.15.90:0/1338843134 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdfc8078bc0 0x7fdfc807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:47.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.038+0000 7fdfe9600640 1 -- 172.21.15.90:0/1338843134 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fdfdc0bb840 con 0x7fdfec06fd00 2024-09-21T03:24:47.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.038+0000 7fdfe3e00640 1 --2- 172.21.15.90:0/1338843134 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdfc8078bc0 0x7fdfc807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:47.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.039+0000 7fdfe3e00640 1 --2- 172.21.15.90:0/1338843134 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdfc8078bc0 0x7fdfc807b0d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdfec1537b0 tx=0x7fdfd400a250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:47.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.043+0000 7fdfe9600640 1 -- 172.21.15.90:0/1338843134 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdfec14cf90 con 0x7fdfec06fd00 2024-09-21T03:24:47.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.227+0000 7fdff2000640 1 -- 172.21.15.90:0/1338843134 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdfec0c8930 con 0x7fdfc8078bc0 2024-09-21T03:24:47.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.236+0000 7fdfe9600640 1 -- 172.21.15.90:0/1338843134 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+494117 (secure 0 0 0) 0x7fdfec0c8930 con 0x7fdfc8078bc0 2024-09-21T03:24:47.243 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:24:47.246 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-21T03:24:47.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.241+0000 7fdff2000640 1 -- 172.21.15.90:0/1338843134 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdfc8078bc0 msgr2=0x7fdfc807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:47.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.241+0000 7fdff2000640 1 --2- 172.21.15.90:0/1338843134 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdfc8078bc0 0x7fdfc807b0d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdfec1537b0 tx=0x7fdfd400a250 comp rx=0 tx=0).stop 2024-09-21T03:24:47.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.241+0000 7fdff2000640 1 -- 172.21.15.90:0/1338843134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfec06fd00 msgr2=0x7fdfec0c16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:47.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.241+0000 7fdff2000640 1 --2- 172.21.15.90:0/1338843134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfec06fd00 0x7fdfec0c16b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc000c00 tx=0x7fdfdc003970 comp rx=0 tx=0).stop 2024-09-21T03:24:47.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.241+0000 7fdff2000640 1 -- 172.21.15.90:0/1338843134 shutdown_connections 2024-09-21T03:24:47.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.241+0000 7fdff2000640 1 --2- 172.21.15.90:0/1338843134 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdfc8078bc0 0x7fdfc807b0d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.241+0000 7fdff2000640 1 --2- 172.21.15.90:0/1338843134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfec14b430 0x7fdfec074350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.241+0000 7fdff2000640 1 --2- 172.21.15.90:0/1338843134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfec0c51a0 0x7fdfec14aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.241+0000 7fdff2000640 1 --2- 172.21.15.90:0/1338843134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfec06fd00 0x7fdfec0c16b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.241+0000 7fdff2000640 1 -- 172.21.15.90:0/1338843134 >> 172.21.15.90:0/1338843134 conn(0x7fdfec0c84c0 msgr2=0x7fdfec0aba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:47.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.242+0000 7fdff2000640 1 -- 172.21.15.90:0/1338843134 shutdown_connections 2024-09-21T03:24:47.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.242+0000 7fdff2000640 1 -- 172.21.15.90:0/1338843134 wait complete. 2024-09-21T03:24:47.270 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-09-21T03:24:46.748509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":263547516,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":126,"num_read_kb":267,"num_write":5735615,"num_write_kb":66239738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":396166,"ondisk_log_size":396166,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4218896,"kb_used_data":517072,"kb_used_omap":12,"kb_used_meta":3701683,"kb_avail":750755824,"statfs":{"total":773094113280,"available":768773963776,"internally_reserved":0,"allocated":529481728,"data_stored":528010046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":3790523952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,1,21],"upper_bound":32},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2661937050,"num_objects":-894,"num_object_clones":0,"num_object_copies":-1788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-894,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":916,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004531"},"pg_stats":[{"pgid":"5.18","version":"27'2955","reported_seq":2976,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.324436+0000","last_change":"2024-09-21T03:14:47.552762+0000","last_active":"2024-09-21T03:24:45.324436+0000","last_peered":"2024-09-21T03:24:45.324436+0000","last_clean":"2024-09-21T03:24:45.324436+0000","last_became_active":"2024-09-21T03:14:47.551883+0000","last_became_peered":"2024-09-21T03:14:47.551883+0000","last_unstale":"2024-09-21T03:24:45.324436+0000","last_undegraded":"2024-09-21T03:24:45.324436+0000","last_fullsized":"2024-09-21T03:24:45.324436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2955,"log_dups_size":0,"ondisk_log_size":2955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:51.935797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42893,"num_write_kb":435375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"27'181","reported_seq":212,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.778805+0000","last_change":"2024-09-21T03:14:37.471004+0000","last_active":"2024-09-21T03:24:32.778805+0000","last_peered":"2024-09-21T03:24:32.778805+0000","last_clean":"2024-09-21T03:24:32.778805+0000","last_became_active":"2024-09-21T03:14:37.470563+0000","last_became_peered":"2024-09-21T03:14:37.470563+0000","last_unstale":"2024-09-21T03:24:32.778805+0000","last_undegraded":"2024-09-21T03:24:32.778805+0000","last_fullsized":"2024-09-21T03:24:32.778805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.422826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7184070,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":7087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'3329","reported_seq":3358,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.558550+0000","last_change":"2024-09-21T03:14:38.496252+0000","last_active":"2024-09-21T03:24:44.558550+0000","last_peered":"2024-09-21T03:24:44.558550+0000","last_clean":"2024-09-21T03:24:44.558550+0000","last_became_active":"2024-09-21T03:14:38.488292+0000","last_became_peered":"2024-09-21T03:14:38.488292+0000","last_unstale":"2024-09-21T03:24:44.558550+0000","last_undegraded":"2024-09-21T03:24:44.558550+0000","last_fullsized":"2024-09-21T03:24:44.558550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3329,"log_dups_size":0,"ondisk_log_size":3329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:57.409792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49408,"num_write_kb":622324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.561928+0000","last_change":"2024-09-21T03:14:46.549877+0000","last_active":"2024-09-21T03:24:32.561928+0000","last_peered":"2024-09-21T03:24:32.561928+0000","last_clean":"2024-09-21T03:24:32.561928+0000","last_became_active":"2024-09-21T03:14:46.549536+0000","last_became_peered":"2024-09-21T03:14:46.549536+0000","last_unstale":"2024-09-21T03:24:32.561928+0000","last_undegraded":"2024-09-21T03:24:32.561928+0000","last_fullsized":"2024-09-21T03:24:32.561928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:57.491042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"27'3462","reported_seq":3483,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.343242+0000","last_change":"2024-09-21T03:14:47.560303+0000","last_active":"2024-09-21T03:24:45.343242+0000","last_peered":"2024-09-21T03:24:45.343242+0000","last_clean":"2024-09-21T03:24:45.343242+0000","last_became_active":"2024-09-21T03:14:47.559659+0000","last_became_peered":"2024-09-21T03:14:47.559659+0000","last_unstale":"2024-09-21T03:24:45.343242+0000","last_undegraded":"2024-09-21T03:24:45.343242+0000","last_fullsized":"2024-09-21T03:24:45.343242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3462,"log_dups_size":0,"ondisk_log_size":3462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:49.328036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50427,"num_write_kb":517490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"27'10","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.175109+0000","last_change":"2024-09-21T03:14:37.467448+0000","last_active":"2024-09-21T03:24:32.175109+0000","last_peered":"2024-09-21T03:24:32.175109+0000","last_clean":"2024-09-21T03:24:32.175109+0000","last_became_active":"2024-09-21T03:14:37.467146+0000","last_became_peered":"2024-09-21T03:14:37.467146+0000","last_unstale":"2024-09-21T03:24:32.175109+0000","last_undegraded":"2024-09-21T03:24:32.175109+0000","last_fullsized":"2024-09-21T03:24:32.175109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:53.475083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'3692","reported_seq":3721,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.533568+0000","last_change":"2024-09-21T03:14:38.486401+0000","last_active":"2024-09-21T03:24:44.533568+0000","last_peered":"2024-09-21T03:24:44.533568+0000","last_clean":"2024-09-21T03:24:44.533568+0000","last_became_active":"2024-09-21T03:14:38.486090+0000","last_became_peered":"2024-09-21T03:14:38.486090+0000","last_unstale":"2024-09-21T03:24:44.533568+0000","last_undegraded":"2024-09-21T03:24:44.533568+0000","last_fullsized":"2024-09-21T03:24:44.533568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3692,"log_dups_size":0,"ondisk_log_size":3692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:44.085100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54471,"num_write_kb":691181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'47","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.589575+0000","last_change":"2024-09-21T03:14:46.541705+0000","last_active":"2024-09-21T03:24:32.589575+0000","last_peered":"2024-09-21T03:24:32.589575+0000","last_clean":"2024-09-21T03:24:32.589575+0000","last_became_active":"2024-09-21T03:14:46.541357+0000","last_became_peered":"2024-09-21T03:14:46.541357+0000","last_unstale":"2024-09-21T03:24:32.589575+0000","last_undegraded":"2024-09-21T03:24:32.589575+0000","last_fullsized":"2024-09-21T03:24:32.589575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:31.082059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":8225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"27'2623","reported_seq":2646,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.346234+0000","last_change":"2024-09-21T03:18:52.567667+0000","last_active":"2024-09-21T03:24:45.346234+0000","last_peered":"2024-09-21T03:24:45.346234+0000","last_clean":"2024-09-21T03:24:45.346234+0000","last_became_active":"2024-09-21T03:14:47.553312+0000","last_became_peered":"2024-09-21T03:14:47.553312+0000","last_unstale":"2024-09-21T03:24:45.346234+0000","last_undegraded":"2024-09-21T03:24:45.346234+0000","last_fullsized":"2024-09-21T03:24:45.346234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2623,"log_dups_size":0,"ondisk_log_size":2623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:07.314491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37737,"num_write_kb":383006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"27'42","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.212295+0000","last_change":"2024-09-21T03:14:37.478711+0000","last_active":"2024-09-21T03:24:32.212295+0000","last_peered":"2024-09-21T03:24:32.212295+0000","last_clean":"2024-09-21T03:24:32.212295+0000","last_became_active":"2024-09-21T03:14:37.477910+0000","last_became_peered":"2024-09-21T03:14:37.477910+0000","last_unstale":"2024-09-21T03:24:32.212295+0000","last_undegraded":"2024-09-21T03:24:32.212295+0000","last_fullsized":"2024-09-21T03:24:32.212295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:40.166966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2285","reported_seq":2314,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.467936+0000","last_change":"2024-09-21T03:14:38.472992+0000","last_active":"2024-09-21T03:24:44.467936+0000","last_peered":"2024-09-21T03:24:44.467936+0000","last_clean":"2024-09-21T03:24:44.467936+0000","last_became_active":"2024-09-21T03:14:38.472426+0000","last_became_peered":"2024-09-21T03:14:38.472426+0000","last_unstale":"2024-09-21T03:24:44.467936+0000","last_undegraded":"2024-09-21T03:24:44.467936+0000","last_fullsized":"2024-09-21T03:24:44.467936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2285,"log_dups_size":0,"ondisk_log_size":2285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:36.825612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33481,"num_write_kb":420875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1061","reported_seq":1083,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:22:20.318571+0000","last_change":"2024-09-21T03:14:46.526996+0000","last_active":"2024-09-21T03:22:20.318571+0000","last_peered":"2024-09-21T03:22:20.318571+0000","last_clean":"2024-09-21T03:22:20.318571+0000","last_became_active":"2024-09-21T03:14:46.525587+0000","last_became_peered":"2024-09-21T03:14:46.525587+0000","last_unstale":"2024-09-21T03:22:20.318571+0000","last_undegraded":"2024-09-21T03:22:20.318571+0000","last_fullsized":"2024-09-21T03:22:20.318571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1061,"log_dups_size":0,"ondisk_log_size":1061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:56.977126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1059,"num_write_kb":5042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"27'2269","reported_seq":2289,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.309856+0000","last_change":"2024-09-21T03:14:47.554143+0000","last_active":"2024-09-21T03:24:45.309856+0000","last_peered":"2024-09-21T03:24:45.309856+0000","last_clean":"2024-09-21T03:24:45.309856+0000","last_became_active":"2024-09-21T03:14:47.553802+0000","last_became_peered":"2024-09-21T03:14:47.553802+0000","last_unstale":"2024-09-21T03:24:45.309856+0000","last_undegraded":"2024-09-21T03:24:45.309856+0000","last_fullsized":"2024-09-21T03:24:45.309856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2269,"log_dups_size":0,"ondisk_log_size":2269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:37.963442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32861,"num_write_kb":341635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'13","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.222962+0000","last_change":"2024-09-21T03:14:37.479842+0000","last_active":"2024-09-21T03:24:32.222962+0000","last_peered":"2024-09-21T03:24:32.222962+0000","last_clean":"2024-09-21T03:24:32.222962+0000","last_became_active":"2024-09-21T03:14:37.478893+0000","last_became_peered":"2024-09-21T03:14:37.478893+0000","last_unstale":"2024-09-21T03:24:32.222962+0000","last_undegraded":"2024-09-21T03:24:32.222962+0000","last_fullsized":"2024-09-21T03:24:32.222962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:27.916133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'3847","reported_seq":3875,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.146830+0000","last_change":"2024-09-21T03:14:38.468756+0000","last_active":"2024-09-21T03:24:32.146830+0000","last_peered":"2024-09-21T03:24:32.146830+0000","last_clean":"2024-09-21T03:24:32.146830+0000","last_became_active":"2024-09-21T03:14:38.467570+0000","last_became_peered":"2024-09-21T03:14:38.467570+0000","last_unstale":"2024-09-21T03:24:32.146830+0000","last_undegraded":"2024-09-21T03:24:32.146830+0000","last_fullsized":"2024-09-21T03:24:32.146830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3847,"log_dups_size":0,"ondisk_log_size":3847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:24.784157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57219,"num_write_kb":702431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'50","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.617288+0000","last_change":"2024-09-21T03:14:46.529932+0000","last_active":"2024-09-21T03:24:32.617288+0000","last_peered":"2024-09-21T03:24:32.617288+0000","last_clean":"2024-09-21T03:24:32.617288+0000","last_became_active":"2024-09-21T03:14:46.529629+0000","last_became_peered":"2024-09-21T03:14:46.529629+0000","last_unstale":"2024-09-21T03:24:32.617288+0000","last_undegraded":"2024-09-21T03:24:32.617288+0000","last_fullsized":"2024-09-21T03:24:32.617288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:39.808494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":8220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"27'3149","reported_seq":3170,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.310173+0000","last_change":"2024-09-21T03:14:47.547724+0000","last_active":"2024-09-21T03:24:45.310173+0000","last_peered":"2024-09-21T03:24:45.310173+0000","last_clean":"2024-09-21T03:24:45.310173+0000","last_became_active":"2024-09-21T03:14:47.546770+0000","last_became_peered":"2024-09-21T03:14:47.546770+0000","last_unstale":"2024-09-21T03:24:45.310173+0000","last_undegraded":"2024-09-21T03:24:45.310173+0000","last_fullsized":"2024-09-21T03:24:45.310173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3149,"log_dups_size":0,"ondisk_log_size":3149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:31.476710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45697,"num_write_kb":467369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"27'2911","reported_seq":2940,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.013492+0000","last_change":"2024-09-21T03:14:38.476747+0000","last_active":"2024-09-21T03:24:32.013492+0000","last_peered":"2024-09-21T03:24:32.013492+0000","last_clean":"2024-09-21T03:24:32.013492+0000","last_became_active":"2024-09-21T03:14:38.476386+0000","last_became_peered":"2024-09-21T03:14:38.476386+0000","last_unstale":"2024-09-21T03:24:32.013492+0000","last_undegraded":"2024-09-21T03:24:32.013492+0000","last_fullsized":"2024-09-21T03:24:32.013492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:28.751991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43116,"num_write_kb":539220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'226","reported_seq":257,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.178813+0000","last_change":"2024-09-21T03:14:37.463164+0000","last_active":"2024-09-21T03:24:32.178813+0000","last_peered":"2024-09-21T03:24:32.178813+0000","last_clean":"2024-09-21T03:24:32.178813+0000","last_became_active":"2024-09-21T03:14:37.461409+0000","last_became_peered":"2024-09-21T03:14:37.461409+0000","last_unstale":"2024-09-21T03:24:32.178813+0000","last_undegraded":"2024-09-21T03:24:32.178813+0000","last_fullsized":"2024-09-21T03:24:32.178813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:51.126291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":8373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'25","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:23:51.616959+0000","last_change":"2024-09-21T03:14:46.538480+0000","last_active":"2024-09-21T03:23:51.616959+0000","last_peered":"2024-09-21T03:23:51.616959+0000","last_clean":"2024-09-21T03:23:51.616959+0000","last_became_active":"2024-09-21T03:14:46.537493+0000","last_became_peered":"2024-09-21T03:14:46.537493+0000","last_unstale":"2024-09-21T03:23:51.616959+0000","last_undegraded":"2024-09-21T03:23:51.616959+0000","last_fullsized":"2024-09-21T03:23:51.616959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:52.769190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"27'3059","reported_seq":3080,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.617887+0000","last_change":"2024-09-21T03:14:47.580512+0000","last_active":"2024-09-21T03:24:32.617887+0000","last_peered":"2024-09-21T03:24:32.617887+0000","last_clean":"2024-09-21T03:24:32.617887+0000","last_became_active":"2024-09-21T03:14:47.580210+0000","last_became_peered":"2024-09-21T03:14:47.580210+0000","last_unstale":"2024-09-21T03:24:32.617887+0000","last_undegraded":"2024-09-21T03:24:32.617887+0000","last_fullsized":"2024-09-21T03:24:32.617887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3059,"log_dups_size":0,"ondisk_log_size":3059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:20.192190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44544,"num_write_kb":453960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"27'2505","reported_seq":2534,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.178918+0000","last_change":"2024-09-21T03:14:38.494021+0000","last_active":"2024-09-21T03:24:32.178918+0000","last_peered":"2024-09-21T03:24:32.178918+0000","last_clean":"2024-09-21T03:24:32.178918+0000","last_became_active":"2024-09-21T03:14:38.486802+0000","last_became_peered":"2024-09-21T03:14:38.486802+0000","last_unstale":"2024-09-21T03:24:32.178918+0000","last_undegraded":"2024-09-21T03:24:32.178918+0000","last_fullsized":"2024-09-21T03:24:32.178918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2505,"log_dups_size":0,"ondisk_log_size":2505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:31.817505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37114,"num_write_kb":476028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'16","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.188248+0000","last_change":"2024-09-21T03:14:37.465907+0000","last_active":"2024-09-21T03:24:32.188248+0000","last_peered":"2024-09-21T03:24:32.188248+0000","last_clean":"2024-09-21T03:24:32.188248+0000","last_became_active":"2024-09-21T03:14:37.465551+0000","last_became_peered":"2024-09-21T03:14:37.465551+0000","last_unstale":"2024-09-21T03:24:32.188248+0000","last_undegraded":"2024-09-21T03:24:32.188248+0000","last_fullsized":"2024-09-21T03:24:32.188248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:10.599687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:23:48.015021+0000","last_change":"2024-09-21T03:14:46.546737+0000","last_active":"2024-09-21T03:23:48.015021+0000","last_peered":"2024-09-21T03:23:48.015021+0000","last_clean":"2024-09-21T03:23:48.015021+0000","last_became_active":"2024-09-21T03:14:46.546312+0000","last_became_peered":"2024-09-21T03:14:46.546312+0000","last_unstale":"2024-09-21T03:23:48.015021+0000","last_undegraded":"2024-09-21T03:23:48.015021+0000","last_fullsized":"2024-09-21T03:23:48.015021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:03.939168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"27'2654","reported_seq":2675,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.550798+0000","last_change":"2024-09-21T03:14:47.558742+0000","last_active":"2024-09-21T03:24:32.550798+0000","last_peered":"2024-09-21T03:24:32.550798+0000","last_clean":"2024-09-21T03:24:32.550798+0000","last_became_active":"2024-09-21T03:14:47.558431+0000","last_became_peered":"2024-09-21T03:14:47.558431+0000","last_unstale":"2024-09-21T03:24:32.550798+0000","last_undegraded":"2024-09-21T03:24:32.550798+0000","last_fullsized":"2024-09-21T03:24:32.550798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2654,"log_dups_size":0,"ondisk_log_size":2654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:32.053674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38628,"num_write_kb":413288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"27'3227","reported_seq":3256,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.488971+0000","last_change":"2024-09-21T03:14:38.479370+0000","last_active":"2024-09-21T03:24:44.488971+0000","last_peered":"2024-09-21T03:24:44.488971+0000","last_clean":"2024-09-21T03:24:44.488971+0000","last_became_active":"2024-09-21T03:14:38.476976+0000","last_became_peered":"2024-09-21T03:14:38.476976+0000","last_unstale":"2024-09-21T03:24:44.488971+0000","last_undegraded":"2024-09-21T03:24:44.488971+0000","last_fullsized":"2024-09-21T03:24:44.488971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3227,"log_dups_size":0,"ondisk_log_size":3227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:14.695819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47858,"num_write_kb":595125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'15","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.163168+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:24:32.163168+0000","last_peered":"2024-09-21T03:24:32.163168+0000","last_clean":"2024-09-21T03:24:32.163168+0000","last_became_active":"2024-09-21T03:14:37.478840+0000","last_became_peered":"2024-09-21T03:14:37.478840+0000","last_unstale":"2024-09-21T03:24:32.163168+0000","last_undegraded":"2024-09-21T03:24:32.163168+0000","last_fullsized":"2024-09-21T03:24:32.163168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:00.964354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'24","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.596135+0000","last_change":"2024-09-21T03:14:46.543085+0000","last_active":"2024-09-21T03:24:32.596135+0000","last_peered":"2024-09-21T03:24:32.596135+0000","last_clean":"2024-09-21T03:24:32.596135+0000","last_became_active":"2024-09-21T03:14:46.542721+0000","last_became_peered":"2024-09-21T03:14:46.542721+0000","last_unstale":"2024-09-21T03:24:32.596135+0000","last_undegraded":"2024-09-21T03:24:32.596135+0000","last_fullsized":"2024-09-21T03:24:32.596135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:05.590871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"27'3357","reported_seq":3378,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.327911+0000","last_change":"2024-09-21T03:14:47.566806+0000","last_active":"2024-09-21T03:24:45.327911+0000","last_peered":"2024-09-21T03:24:45.327911+0000","last_clean":"2024-09-21T03:24:45.327911+0000","last_became_active":"2024-09-21T03:14:47.566634+0000","last_became_peered":"2024-09-21T03:14:47.566634+0000","last_unstale":"2024-09-21T03:24:45.327911+0000","last_undegraded":"2024-09-21T03:24:45.327911+0000","last_fullsized":"2024-09-21T03:24:45.327911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3357,"log_dups_size":0,"ondisk_log_size":3357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:03.997294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48633,"num_write_kb":505858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'2922","reported_seq":2951,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.150348+0000","last_change":"2024-09-21T03:14:38.482658+0000","last_active":"2024-09-21T03:24:32.150348+0000","last_peered":"2024-09-21T03:24:32.150348+0000","last_clean":"2024-09-21T03:24:32.150348+0000","last_became_active":"2024-09-21T03:14:38.482369+0000","last_became_peered":"2024-09-21T03:14:38.482369+0000","last_unstale":"2024-09-21T03:24:32.150348+0000","last_undegraded":"2024-09-21T03:24:32.150348+0000","last_fullsized":"2024-09-21T03:24:32.150348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2922,"log_dups_size":0,"ondisk_log_size":2922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:36.682534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43307,"num_write_kb":537343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'15","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.146260+0000","last_change":"2024-09-21T03:14:37.472962+0000","last_active":"2024-09-21T03:24:32.146260+0000","last_peered":"2024-09-21T03:24:32.146260+0000","last_clean":"2024-09-21T03:24:32.146260+0000","last_became_active":"2024-09-21T03:14:37.472271+0000","last_became_peered":"2024-09-21T03:14:37.472271+0000","last_unstale":"2024-09-21T03:24:32.146260+0000","last_undegraded":"2024-09-21T03:24:32.146260+0000","last_fullsized":"2024-09-21T03:24:32.146260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:54.952223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'30","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.602142+0000","last_change":"2024-09-21T03:14:46.537137+0000","last_active":"2024-09-21T03:24:32.602142+0000","last_peered":"2024-09-21T03:24:32.602142+0000","last_clean":"2024-09-21T03:24:32.602142+0000","last_became_active":"2024-09-21T03:14:46.536791+0000","last_became_peered":"2024-09-21T03:14:46.536791+0000","last_unstale":"2024-09-21T03:24:32.602142+0000","last_undegraded":"2024-09-21T03:24:32.602142+0000","last_fullsized":"2024-09-21T03:24:32.602142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:43.186807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"27'2826","reported_seq":2847,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.304208+0000","last_change":"2024-09-21T03:14:47.555605+0000","last_active":"2024-09-21T03:24:45.304208+0000","last_peered":"2024-09-21T03:24:45.304208+0000","last_clean":"2024-09-21T03:24:45.304208+0000","last_became_active":"2024-09-21T03:14:47.555329+0000","last_became_peered":"2024-09-21T03:14:47.555329+0000","last_unstale":"2024-09-21T03:24:45.304208+0000","last_undegraded":"2024-09-21T03:24:45.304208+0000","last_fullsized":"2024-09-21T03:24:45.304208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2826,"log_dups_size":0,"ondisk_log_size":2826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:24.271656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40983,"num_write_kb":424268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'2675","reported_seq":2704,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.467679+0000","last_change":"2024-09-21T03:14:38.479133+0000","last_active":"2024-09-21T03:24:44.467679+0000","last_peered":"2024-09-21T03:24:44.467679+0000","last_clean":"2024-09-21T03:24:44.467679+0000","last_became_active":"2024-09-21T03:14:38.478077+0000","last_became_peered":"2024-09-21T03:14:38.478077+0000","last_unstale":"2024-09-21T03:24:44.467679+0000","last_undegraded":"2024-09-21T03:24:44.467679+0000","last_fullsized":"2024-09-21T03:24:44.467679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2675,"log_dups_size":0,"ondisk_log_size":2675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:56.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39231,"num_write_kb":490681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'10","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.193121+0000","last_change":"2024-09-21T03:14:37.480508+0000","last_active":"2024-09-21T03:24:32.193121+0000","last_peered":"2024-09-21T03:24:32.193121+0000","last_clean":"2024-09-21T03:24:32.193121+0000","last_became_active":"2024-09-21T03:14:37.480218+0000","last_became_peered":"2024-09-21T03:14:37.480218+0000","last_unstale":"2024-09-21T03:24:32.193121+0000","last_undegraded":"2024-09-21T03:24:32.193121+0000","last_fullsized":"2024-09-21T03:24:32.193121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:01.851380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'33","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:34.548248+0000","last_change":"2024-09-21T03:14:46.531615+0000","last_active":"2024-09-21T03:24:34.548248+0000","last_peered":"2024-09-21T03:24:34.548248+0000","last_clean":"2024-09-21T03:24:34.548248+0000","last_became_active":"2024-09-21T03:14:46.531289+0000","last_became_peered":"2024-09-21T03:14:46.531289+0000","last_unstale":"2024-09-21T03:24:34.548248+0000","last_undegraded":"2024-09-21T03:24:34.548248+0000","last_fullsized":"2024-09-21T03:24:34.548248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:10.145489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":107,"num_write":31,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"27'2914","reported_seq":2935,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.562112+0000","last_change":"2024-09-21T03:14:47.552705+0000","last_active":"2024-09-21T03:24:32.562112+0000","last_peered":"2024-09-21T03:24:32.562112+0000","last_clean":"2024-09-21T03:24:32.562112+0000","last_became_active":"2024-09-21T03:14:47.552367+0000","last_became_peered":"2024-09-21T03:14:47.552367+0000","last_unstale":"2024-09-21T03:24:32.562112+0000","last_undegraded":"2024-09-21T03:24:32.562112+0000","last_fullsized":"2024-09-21T03:24:32.562112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2914,"log_dups_size":0,"ondisk_log_size":2914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:45.379581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42429,"num_write_kb":431357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'3268","reported_seq":3297,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.453408+0000","last_change":"2024-09-21T03:14:38.475318+0000","last_active":"2024-09-21T03:24:44.453408+0000","last_peered":"2024-09-21T03:24:44.453408+0000","last_clean":"2024-09-21T03:24:44.453408+0000","last_became_active":"2024-09-21T03:14:38.474978+0000","last_became_peered":"2024-09-21T03:14:38.474978+0000","last_unstale":"2024-09-21T03:24:44.453408+0000","last_undegraded":"2024-09-21T03:24:44.453408+0000","last_fullsized":"2024-09-21T03:24:44.453408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3268,"log_dups_size":0,"ondisk_log_size":3268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:38.209624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48313,"num_write_kb":579677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'320","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.201019+0000","last_change":"2024-09-21T03:14:37.479651+0000","last_active":"2024-09-21T03:24:32.201019+0000","last_peered":"2024-09-21T03:24:32.201019+0000","last_clean":"2024-09-21T03:24:32.201019+0000","last_became_active":"2024-09-21T03:14:37.478833+0000","last_became_peered":"2024-09-21T03:14:37.478833+0000","last_unstale":"2024-09-21T03:24:32.201019+0000","last_undegraded":"2024-09-21T03:24:32.201019+0000","last_fullsized":"2024-09-21T03:24:32.201019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:48.578637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'48","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.593440+0000","last_change":"2024-09-21T03:14:46.536054+0000","last_active":"2024-09-21T03:24:32.593440+0000","last_peered":"2024-09-21T03:24:32.593440+0000","last_clean":"2024-09-21T03:24:32.593440+0000","last_became_active":"2024-09-21T03:14:46.535569+0000","last_became_peered":"2024-09-21T03:14:46.535569+0000","last_unstale":"2024-09-21T03:24:32.593440+0000","last_undegraded":"2024-09-21T03:24:32.593440+0000","last_fullsized":"2024-09-21T03:24:32.593440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:04.556059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":8210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"27'3102","reported_seq":3123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.505571+0000","last_change":"2024-09-21T03:14:47.571889+0000","last_active":"2024-09-21T03:24:32.505571+0000","last_peered":"2024-09-21T03:24:32.505571+0000","last_clean":"2024-09-21T03:24:32.505571+0000","last_became_active":"2024-09-21T03:14:47.571620+0000","last_became_peered":"2024-09-21T03:14:47.571620+0000","last_unstale":"2024-09-21T03:24:32.505571+0000","last_undegraded":"2024-09-21T03:24:32.505571+0000","last_fullsized":"2024-09-21T03:24:32.505571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3102,"log_dups_size":0,"ondisk_log_size":3102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:23.103973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45309,"num_write_kb":459474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"27'3313","reported_seq":3336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.493139+0000","last_change":"2024-09-21T03:14:38.493350+0000","last_active":"2024-09-21T03:24:44.493139+0000","last_peered":"2024-09-21T03:24:44.493139+0000","last_clean":"2024-09-21T03:24:44.493139+0000","last_became_active":"2024-09-21T03:14:38.492830+0000","last_became_peered":"2024-09-21T03:14:38.492830+0000","last_unstale":"2024-09-21T03:24:44.493139+0000","last_undegraded":"2024-09-21T03:24:44.493139+0000","last_fullsized":"2024-09-21T03:24:44.493139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3313,"log_dups_size":0,"ondisk_log_size":3313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:19.946319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48841,"num_write_kb":610665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'18","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.156028+0000","last_change":"2024-09-21T03:14:37.473484+0000","last_active":"2024-09-21T03:24:32.156028+0000","last_peered":"2024-09-21T03:24:32.156028+0000","last_clean":"2024-09-21T03:24:32.156028+0000","last_became_active":"2024-09-21T03:14:37.473218+0000","last_became_peered":"2024-09-21T03:14:37.473218+0000","last_unstale":"2024-09-21T03:24:32.156028+0000","last_undegraded":"2024-09-21T03:24:32.156028+0000","last_fullsized":"2024-09-21T03:24:32.156028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:49.006579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:21:06.027900+0000","last_change":"2024-09-21T03:14:46.548858+0000","last_active":"2024-09-21T03:21:06.027900+0000","last_peered":"2024-09-21T03:21:06.027900+0000","last_clean":"2024-09-21T03:21:06.027900+0000","last_became_active":"2024-09-21T03:14:46.548166+0000","last_became_peered":"2024-09-21T03:14:46.548166+0000","last_unstale":"2024-09-21T03:21:06.027900+0000","last_undegraded":"2024-09-21T03:21:06.027900+0000","last_fullsized":"2024-09-21T03:21:06.027900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:41.470072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"27'2797","reported_seq":2818,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.344863+0000","last_change":"2024-09-21T03:14:47.555787+0000","last_active":"2024-09-21T03:24:45.344863+0000","last_peered":"2024-09-21T03:24:45.344863+0000","last_clean":"2024-09-21T03:24:45.344863+0000","last_became_active":"2024-09-21T03:14:47.555420+0000","last_became_peered":"2024-09-21T03:14:47.555420+0000","last_unstale":"2024-09-21T03:24:45.344863+0000","last_undegraded":"2024-09-21T03:24:45.344863+0000","last_fullsized":"2024-09-21T03:24:45.344863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2797,"log_dups_size":0,"ondisk_log_size":2797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:45.769786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40658,"num_write_kb":422641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"27'2814","reported_seq":2843,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.461833+0000","last_change":"2024-09-21T03:14:38.479657+0000","last_active":"2024-09-21T03:24:44.461833+0000","last_peered":"2024-09-21T03:24:44.461833+0000","last_clean":"2024-09-21T03:24:44.461833+0000","last_became_active":"2024-09-21T03:14:38.479439+0000","last_became_peered":"2024-09-21T03:14:38.479439+0000","last_unstale":"2024-09-21T03:24:44.461833+0000","last_undegraded":"2024-09-21T03:24:44.461833+0000","last_fullsized":"2024-09-21T03:24:44.461833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2814,"log_dups_size":0,"ondisk_log_size":2814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.107215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41573,"num_write_kb":525350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.151982+0000","last_change":"2024-09-21T03:14:37.469799+0000","last_active":"2024-09-21T03:24:32.151982+0000","last_peered":"2024-09-21T03:24:32.151982+0000","last_clean":"2024-09-21T03:24:32.151982+0000","last_became_active":"2024-09-21T03:14:37.469495+0000","last_became_peered":"2024-09-21T03:14:37.469495+0000","last_unstale":"2024-09-21T03:24:32.151982+0000","last_undegraded":"2024-09-21T03:24:32.151982+0000","last_fullsized":"2024-09-21T03:24:32.151982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:50.247050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'51","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.593953+0000","last_change":"2024-09-21T03:14:46.544320+0000","last_active":"2024-09-21T03:24:32.593953+0000","last_peered":"2024-09-21T03:24:32.593953+0000","last_clean":"2024-09-21T03:24:32.593953+0000","last_became_active":"2024-09-21T03:14:46.544038+0000","last_became_peered":"2024-09-21T03:14:46.544038+0000","last_unstale":"2024-09-21T03:24:32.593953+0000","last_undegraded":"2024-09-21T03:24:32.593953+0000","last_fullsized":"2024-09-21T03:24:32.593953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:57.457687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"27'2669","reported_seq":2696,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.562242+0000","last_change":"2024-09-21T03:19:03.606923+0000","last_active":"2024-09-21T03:24:32.562242+0000","last_peered":"2024-09-21T03:24:32.562242+0000","last_clean":"2024-09-21T03:24:32.562242+0000","last_became_active":"2024-09-21T03:14:47.579324+0000","last_became_peered":"2024-09-21T03:14:47.579324+0000","last_unstale":"2024-09-21T03:24:32.562242+0000","last_undegraded":"2024-09-21T03:24:32.562242+0000","last_fullsized":"2024-09-21T03:24:32.562242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2669,"log_dups_size":0,"ondisk_log_size":2669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:37.656859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38848,"num_write_kb":393078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"27'3056","reported_seq":3085,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.555377+0000","last_change":"2024-09-21T03:14:38.476763+0000","last_active":"2024-09-21T03:24:44.555377+0000","last_peered":"2024-09-21T03:24:44.555377+0000","last_clean":"2024-09-21T03:24:44.555377+0000","last_became_active":"2024-09-21T03:14:38.474299+0000","last_became_peered":"2024-09-21T03:14:38.474299+0000","last_unstale":"2024-09-21T03:24:44.555377+0000","last_undegraded":"2024-09-21T03:24:44.555377+0000","last_fullsized":"2024-09-21T03:24:44.555377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3056,"log_dups_size":0,"ondisk_log_size":3056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:46.544930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45199,"num_write_kb":565597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'28","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.185284+0000","last_change":"2024-09-21T03:14:37.466857+0000","last_active":"2024-09-21T03:24:32.185284+0000","last_peered":"2024-09-21T03:24:32.185284+0000","last_clean":"2024-09-21T03:24:32.185284+0000","last_became_active":"2024-09-21T03:14:37.466256+0000","last_became_peered":"2024-09-21T03:14:37.466256+0000","last_unstale":"2024-09-21T03:24:32.185284+0000","last_undegraded":"2024-09-21T03:24:32.185284+0000","last_fullsized":"2024-09-21T03:24:32.185284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:02.240461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'5","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.569629+0000","last_change":"2024-09-21T03:14:46.537315+0000","last_active":"2024-09-21T03:24:32.569629+0000","last_peered":"2024-09-21T03:24:32.569629+0000","last_clean":"2024-09-21T03:24:32.569629+0000","last_became_active":"2024-09-21T03:14:46.536975+0000","last_became_peered":"2024-09-21T03:14:46.536975+0000","last_unstale":"2024-09-21T03:24:32.569629+0000","last_undegraded":"2024-09-21T03:24:32.569629+0000","last_fullsized":"2024-09-21T03:24:32.569629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:42.529591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"27'2491","reported_seq":2512,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.547078+0000","last_change":"2024-09-21T03:14:47.573009+0000","last_active":"2024-09-21T03:24:32.547078+0000","last_peered":"2024-09-21T03:24:32.547078+0000","last_clean":"2024-09-21T03:24:32.547078+0000","last_became_active":"2024-09-21T03:14:47.572395+0000","last_became_peered":"2024-09-21T03:14:47.572395+0000","last_unstale":"2024-09-21T03:24:32.547078+0000","last_undegraded":"2024-09-21T03:24:32.547078+0000","last_fullsized":"2024-09-21T03:24:32.547078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2491,"log_dups_size":0,"ondisk_log_size":2491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:41.733447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35860,"num_write_kb":370109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"27'2994","reported_seq":3023,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.517136+0000","last_change":"2024-09-21T03:14:38.481801+0000","last_active":"2024-09-21T03:24:44.517136+0000","last_peered":"2024-09-21T03:24:44.517136+0000","last_clean":"2024-09-21T03:24:44.517136+0000","last_became_active":"2024-09-21T03:14:38.481186+0000","last_became_peered":"2024-09-21T03:14:38.481186+0000","last_unstale":"2024-09-21T03:24:44.517136+0000","last_undegraded":"2024-09-21T03:24:44.517136+0000","last_fullsized":"2024-09-21T03:24:44.517136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2994,"log_dups_size":0,"ondisk_log_size":2994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:54.271470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44221,"num_write_kb":552392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'31","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:31.011851+0000","last_change":"2024-09-21T03:14:37.474798+0000","last_active":"2024-09-21T03:24:31.011851+0000","last_peered":"2024-09-21T03:24:31.011851+0000","last_clean":"2024-09-21T03:24:31.011851+0000","last_became_active":"2024-09-21T03:14:37.473829+0000","last_became_peered":"2024-09-21T03:14:37.473829+0000","last_unstale":"2024-09-21T03:24:31.011851+0000","last_undegraded":"2024-09-21T03:24:31.011851+0000","last_fullsized":"2024-09-21T03:24:31.011851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:11.571814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":105,"num_write":29,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'5","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.581221+0000","last_change":"2024-09-21T03:14:46.542495+0000","last_active":"2024-09-21T03:24:32.581221+0000","last_peered":"2024-09-21T03:24:32.581221+0000","last_clean":"2024-09-21T03:24:32.581221+0000","last_became_active":"2024-09-21T03:14:46.542181+0000","last_became_peered":"2024-09-21T03:14:46.542181+0000","last_unstale":"2024-09-21T03:24:32.581221+0000","last_undegraded":"2024-09-21T03:24:32.581221+0000","last_fullsized":"2024-09-21T03:24:32.581221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:22.481477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"27'2890","reported_seq":2911,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.568552+0000","last_change":"2024-09-21T03:14:47.569409+0000","last_active":"2024-09-21T03:24:32.568552+0000","last_peered":"2024-09-21T03:24:32.568552+0000","last_clean":"2024-09-21T03:24:32.568552+0000","last_became_active":"2024-09-21T03:14:47.569212+0000","last_became_peered":"2024-09-21T03:14:47.569212+0000","last_unstale":"2024-09-21T03:24:32.568552+0000","last_undegraded":"2024-09-21T03:24:32.568552+0000","last_fullsized":"2024-09-21T03:24:32.568552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.851943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42005,"num_write_kb":435585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"27'3096","reported_seq":3125,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.490675+0000","last_change":"2024-09-21T03:14:38.480026+0000","last_active":"2024-09-21T03:24:44.490675+0000","last_peered":"2024-09-21T03:24:44.490675+0000","last_clean":"2024-09-21T03:24:44.490675+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:24:44.490675+0000","last_undegraded":"2024-09-21T03:24:44.490675+0000","last_fullsized":"2024-09-21T03:24:44.490675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3096,"log_dups_size":0,"ondisk_log_size":3096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:20.481816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45754,"num_write_kb":580793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'48","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.181334+0000","last_change":"2024-09-21T03:14:37.464554+0000","last_active":"2024-09-21T03:24:32.181334+0000","last_peered":"2024-09-21T03:24:32.181334+0000","last_clean":"2024-09-21T03:24:32.181334+0000","last_became_active":"2024-09-21T03:14:37.464228+0000","last_became_peered":"2024-09-21T03:14:37.464228+0000","last_unstale":"2024-09-21T03:24:32.181334+0000","last_undegraded":"2024-09-21T03:24:32.181334+0000","last_fullsized":"2024-09-21T03:24:32.181334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:32.529512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'360","reported_seq":383,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:35.060058+0000","last_change":"2024-09-21T03:14:46.538538+0000","last_active":"2024-09-21T03:24:35.060058+0000","last_peered":"2024-09-21T03:24:35.060058+0000","last_clean":"2024-09-21T03:24:35.060058+0000","last_became_active":"2024-09-21T03:14:46.537815+0000","last_became_peered":"2024-09-21T03:14:46.537815+0000","last_unstale":"2024-09-21T03:24:35.060058+0000","last_undegraded":"2024-09-21T03:24:35.060058+0000","last_fullsized":"2024-09-21T03:24:35.060058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:42.264439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"27'3073","reported_seq":3094,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.583040+0000","last_change":"2024-09-21T03:14:47.558861+0000","last_active":"2024-09-21T03:24:32.583040+0000","last_peered":"2024-09-21T03:24:32.583040+0000","last_clean":"2024-09-21T03:24:32.583040+0000","last_became_active":"2024-09-21T03:14:47.557305+0000","last_became_peered":"2024-09-21T03:14:47.557305+0000","last_unstale":"2024-09-21T03:24:32.583040+0000","last_undegraded":"2024-09-21T03:24:32.583040+0000","last_fullsized":"2024-09-21T03:24:32.583040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3073,"log_dups_size":0,"ondisk_log_size":3073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:45.962367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44879,"num_write_kb":462177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'3149","reported_seq":3178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.485035+0000","last_change":"2024-09-21T03:14:38.479181+0000","last_active":"2024-09-21T03:24:44.485035+0000","last_peered":"2024-09-21T03:24:44.485035+0000","last_clean":"2024-09-21T03:24:44.485035+0000","last_became_active":"2024-09-21T03:14:38.478842+0000","last_became_peered":"2024-09-21T03:14:38.478842+0000","last_unstale":"2024-09-21T03:24:44.485035+0000","last_undegraded":"2024-09-21T03:24:44.485035+0000","last_fullsized":"2024-09-21T03:24:44.485035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3149,"log_dups_size":0,"ondisk_log_size":3149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:08.664381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46550,"num_write_kb":599066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:22:44.179288+0000","last_change":"2024-09-21T03:14:37.463990+0000","last_active":"2024-09-21T03:22:44.179288+0000","last_peered":"2024-09-21T03:22:44.179288+0000","last_clean":"2024-09-21T03:22:44.179288+0000","last_became_active":"2024-09-21T03:14:37.463674+0000","last_became_peered":"2024-09-21T03:14:37.463674+0000","last_unstale":"2024-09-21T03:22:44.179288+0000","last_undegraded":"2024-09-21T03:22:44.179288+0000","last_fullsized":"2024-09-21T03:22:44.179288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:35.391985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":128,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:22:32.784133+0000","last_change":"2024-09-21T03:14:26.342355+0000","last_active":"2024-09-21T03:22:32.784133+0000","last_peered":"2024-09-21T03:22:32.784133+0000","last_clean":"2024-09-21T03:22:32.784133+0000","last_became_active":"2024-09-21T03:14:26.341929+0000","last_became_peered":"2024-09-21T03:14:26.341929+0000","last_unstale":"2024-09-21T03:22:32.784133+0000","last_undegraded":"2024-09-21T03:22:32.784133+0000","last_fullsized":"2024-09-21T03:22:32.784133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_clean_scrub_stamp":"2024-09-21T03:14:25.329650+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:45.390822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'5","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.576786+0000","last_change":"2024-09-21T03:14:46.538184+0000","last_active":"2024-09-21T03:24:32.576786+0000","last_peered":"2024-09-21T03:24:32.576786+0000","last_clean":"2024-09-21T03:24:32.576786+0000","last_became_active":"2024-09-21T03:14:46.536753+0000","last_became_peered":"2024-09-21T03:14:46.536753+0000","last_unstale":"2024-09-21T03:24:32.576786+0000","last_undegraded":"2024-09-21T03:24:32.576786+0000","last_fullsized":"2024-09-21T03:24:32.576786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:49.078638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"27'2392","reported_seq":2413,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.297763+0000","last_change":"2024-09-21T03:14:47.552966+0000","last_active":"2024-09-21T03:24:45.297763+0000","last_peered":"2024-09-21T03:24:45.297763+0000","last_clean":"2024-09-21T03:24:45.297763+0000","last_became_active":"2024-09-21T03:14:47.552642+0000","last_became_peered":"2024-09-21T03:14:47.552642+0000","last_unstale":"2024-09-21T03:24:45.297763+0000","last_undegraded":"2024-09-21T03:24:45.297763+0000","last_fullsized":"2024-09-21T03:24:45.297763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2392,"log_dups_size":0,"ondisk_log_size":2392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:15.928026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34629,"num_write_kb":367496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"27'3139","reported_seq":3168,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.231721+0000","last_change":"2024-09-21T03:14:38.478414+0000","last_active":"2024-09-21T03:24:32.231721+0000","last_peered":"2024-09-21T03:24:32.231721+0000","last_clean":"2024-09-21T03:24:32.231721+0000","last_became_active":"2024-09-21T03:14:38.478116+0000","last_became_peered":"2024-09-21T03:14:38.478116+0000","last_unstale":"2024-09-21T03:24:32.231721+0000","last_undegraded":"2024-09-21T03:24:32.231721+0000","last_fullsized":"2024-09-21T03:24:32.231721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3139,"log_dups_size":0,"ondisk_log_size":3139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:29.618008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46299,"num_write_kb":593160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'3","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:23:38.363866+0000","last_change":"2024-09-21T03:14:37.479578+0000","last_active":"2024-09-21T03:23:38.363866+0000","last_peered":"2024-09-21T03:23:38.363866+0000","last_clean":"2024-09-21T03:23:38.363866+0000","last_became_active":"2024-09-21T03:14:37.479284+0000","last_became_peered":"2024-09-21T03:14:37.479284+0000","last_unstale":"2024-09-21T03:23:38.363866+0000","last_undegraded":"2024-09-21T03:23:38.363866+0000","last_fullsized":"2024-09-21T03:23:38.363866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:15.732230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'32","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.602886+0000","last_change":"2024-09-21T03:14:46.531536+0000","last_active":"2024-09-21T03:24:32.602886+0000","last_peered":"2024-09-21T03:24:32.602886+0000","last_clean":"2024-09-21T03:24:32.602886+0000","last_became_active":"2024-09-21T03:14:46.531069+0000","last_became_peered":"2024-09-21T03:14:46.531069+0000","last_unstale":"2024-09-21T03:24:32.602886+0000","last_undegraded":"2024-09-21T03:24:32.602886+0000","last_fullsized":"2024-09-21T03:24:32.602886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:14.050618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"27'2635","reported_seq":2656,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.438595+0000","last_change":"2024-09-21T03:14:47.553039+0000","last_active":"2024-09-21T03:24:32.438595+0000","last_peered":"2024-09-21T03:24:32.438595+0000","last_clean":"2024-09-21T03:24:32.438595+0000","last_became_active":"2024-09-21T03:14:47.552712+0000","last_became_peered":"2024-09-21T03:14:47.552712+0000","last_unstale":"2024-09-21T03:24:32.438595+0000","last_undegraded":"2024-09-21T03:24:32.438595+0000","last_fullsized":"2024-09-21T03:24:32.438595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2635,"log_dups_size":0,"ondisk_log_size":2635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:32.630319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38453,"num_write_kb":398220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'3285","reported_seq":3314,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.506010+0000","last_change":"2024-09-21T03:14:38.488259+0000","last_active":"2024-09-21T03:24:44.506010+0000","last_peered":"2024-09-21T03:24:44.506010+0000","last_clean":"2024-09-21T03:24:44.506010+0000","last_became_active":"2024-09-21T03:14:38.487420+0000","last_became_peered":"2024-09-21T03:14:38.487420+0000","last_unstale":"2024-09-21T03:24:44.506010+0000","last_undegraded":"2024-09-21T03:24:44.506010+0000","last_fullsized":"2024-09-21T03:24:44.506010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3285,"log_dups_size":0,"ondisk_log_size":3285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:48.003893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48497,"num_write_kb":608493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'7","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:23:39.783326+0000","last_change":"2024-09-21T03:14:37.460763+0000","last_active":"2024-09-21T03:23:39.783326+0000","last_peered":"2024-09-21T03:23:39.783326+0000","last_clean":"2024-09-21T03:23:39.783326+0000","last_became_active":"2024-09-21T03:14:37.460320+0000","last_became_peered":"2024-09-21T03:14:37.460320+0000","last_unstale":"2024-09-21T03:23:39.783326+0000","last_undegraded":"2024-09-21T03:23:39.783326+0000","last_fullsized":"2024-09-21T03:23:39.783326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.907794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'468","reported_seq":491,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.184284+0000","last_change":"2024-09-21T03:14:46.540901+0000","last_active":"2024-09-21T03:24:45.184284+0000","last_peered":"2024-09-21T03:24:45.184284+0000","last_clean":"2024-09-21T03:24:45.184284+0000","last_became_active":"2024-09-21T03:14:46.540182+0000","last_became_peered":"2024-09-21T03:14:46.540182+0000","last_unstale":"2024-09-21T03:24:45.184284+0000","last_undegraded":"2024-09-21T03:24:45.184284+0000","last_fullsized":"2024-09-21T03:24:45.184284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:38.416663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8130523,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":458,"num_write_kb":8274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"27'2705","reported_seq":2726,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.315093+0000","last_change":"2024-09-21T03:14:47.553810+0000","last_active":"2024-09-21T03:24:45.315093+0000","last_peered":"2024-09-21T03:24:45.315093+0000","last_clean":"2024-09-21T03:24:45.315093+0000","last_became_active":"2024-09-21T03:14:47.552371+0000","last_became_peered":"2024-09-21T03:14:47.552371+0000","last_unstale":"2024-09-21T03:24:45.315093+0000","last_undegraded":"2024-09-21T03:24:45.315093+0000","last_fullsized":"2024-09-21T03:24:45.315093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2705,"log_dups_size":0,"ondisk_log_size":2705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:38.659512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39343,"num_write_kb":410859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"27'3625","reported_seq":3654,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.548288+0000","last_change":"2024-09-21T03:14:38.480629+0000","last_active":"2024-09-21T03:24:44.548288+0000","last_peered":"2024-09-21T03:24:44.548288+0000","last_clean":"2024-09-21T03:24:44.548288+0000","last_became_active":"2024-09-21T03:14:38.474135+0000","last_became_peered":"2024-09-21T03:14:38.474135+0000","last_unstale":"2024-09-21T03:24:44.548288+0000","last_undegraded":"2024-09-21T03:24:44.548288+0000","last_fullsized":"2024-09-21T03:24:44.548288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3625,"log_dups_size":0,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:36.171044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53421,"num_write_kb":673086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'13","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.193221+0000","last_change":"2024-09-21T03:14:37.472491+0000","last_active":"2024-09-21T03:24:32.193221+0000","last_peered":"2024-09-21T03:24:32.193221+0000","last_clean":"2024-09-21T03:24:32.193221+0000","last_became_active":"2024-09-21T03:14:37.472164+0000","last_became_peered":"2024-09-21T03:14:37.472164+0000","last_unstale":"2024-09-21T03:24:32.193221+0000","last_undegraded":"2024-09-21T03:24:32.193221+0000","last_fullsized":"2024-09-21T03:24:32.193221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.498178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'19","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.563185+0000","last_change":"2024-09-21T03:14:46.544828+0000","last_active":"2024-09-21T03:24:32.563185+0000","last_peered":"2024-09-21T03:24:32.563185+0000","last_clean":"2024-09-21T03:24:32.563185+0000","last_became_active":"2024-09-21T03:14:46.535901+0000","last_became_peered":"2024-09-21T03:14:46.535901+0000","last_unstale":"2024-09-21T03:24:32.563185+0000","last_undegraded":"2024-09-21T03:24:32.563185+0000","last_fullsized":"2024-09-21T03:24:32.563185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:08.608530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"27'3041","reported_seq":3062,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.505706+0000","last_change":"2024-09-21T03:14:47.556478+0000","last_active":"2024-09-21T03:24:32.505706+0000","last_peered":"2024-09-21T03:24:32.505706+0000","last_clean":"2024-09-21T03:24:32.505706+0000","last_became_active":"2024-09-21T03:14:47.556145+0000","last_became_peered":"2024-09-21T03:14:47.556145+0000","last_unstale":"2024-09-21T03:24:32.505706+0000","last_undegraded":"2024-09-21T03:24:32.505706+0000","last_fullsized":"2024-09-21T03:24:32.505706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3041,"log_dups_size":0,"ondisk_log_size":3041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:59.004648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44445,"num_write_kb":452313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"27'2817","reported_seq":2846,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.579922+0000","last_change":"2024-09-21T03:14:38.469502+0000","last_active":"2024-09-21T03:24:44.579922+0000","last_peered":"2024-09-21T03:24:44.579922+0000","last_clean":"2024-09-21T03:24:44.579922+0000","last_became_active":"2024-09-21T03:14:38.468972+0000","last_became_peered":"2024-09-21T03:14:38.468972+0000","last_unstale":"2024-09-21T03:24:44.579922+0000","last_undegraded":"2024-09-21T03:24:44.579922+0000","last_fullsized":"2024-09-21T03:24:44.579922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2817,"log_dups_size":0,"ondisk_log_size":2817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41476,"num_write_kb":540924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'10","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.208426+0000","last_change":"2024-09-21T03:14:37.480905+0000","last_active":"2024-09-21T03:24:32.208426+0000","last_peered":"2024-09-21T03:24:32.208426+0000","last_clean":"2024-09-21T03:24:32.208426+0000","last_became_active":"2024-09-21T03:14:37.478227+0000","last_became_peered":"2024-09-21T03:14:37.478227+0000","last_unstale":"2024-09-21T03:24:32.208426+0000","last_undegraded":"2024-09-21T03:24:32.208426+0000","last_fullsized":"2024-09-21T03:24:32.208426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:42.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.583666+0000","last_change":"2024-09-21T03:14:46.536103+0000","last_active":"2024-09-21T03:24:32.583666+0000","last_peered":"2024-09-21T03:24:32.583666+0000","last_clean":"2024-09-21T03:24:32.583666+0000","last_became_active":"2024-09-21T03:14:46.535445+0000","last_became_peered":"2024-09-21T03:14:46.535445+0000","last_unstale":"2024-09-21T03:24:32.583666+0000","last_undegraded":"2024-09-21T03:24:32.583666+0000","last_fullsized":"2024-09-21T03:24:32.583666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:59.078000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"27'2465","reported_seq":2486,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.350565+0000","last_change":"2024-09-21T03:14:47.557503+0000","last_active":"2024-09-21T03:24:45.350565+0000","last_peered":"2024-09-21T03:24:45.350565+0000","last_clean":"2024-09-21T03:24:45.350565+0000","last_became_active":"2024-09-21T03:14:47.554366+0000","last_became_peered":"2024-09-21T03:14:47.554366+0000","last_unstale":"2024-09-21T03:24:45.350565+0000","last_undegraded":"2024-09-21T03:24:45.350565+0000","last_fullsized":"2024-09-21T03:24:45.350565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2465,"log_dups_size":0,"ondisk_log_size":2465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.994560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35585,"num_write_kb":377642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'3454","reported_seq":3483,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.213157+0000","last_change":"2024-09-21T03:14:38.479516+0000","last_active":"2024-09-21T03:24:32.213157+0000","last_peered":"2024-09-21T03:24:32.213157+0000","last_clean":"2024-09-21T03:24:32.213157+0000","last_became_active":"2024-09-21T03:14:38.474826+0000","last_became_peered":"2024-09-21T03:14:38.474826+0000","last_unstale":"2024-09-21T03:24:32.213157+0000","last_undegraded":"2024-09-21T03:24:32.213157+0000","last_fullsized":"2024-09-21T03:24:32.213157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:22.181411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51413,"num_write_kb":609416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'37","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.141749+0000","last_change":"2024-09-21T03:14:37.471063+0000","last_active":"2024-09-21T03:24:32.141749+0000","last_peered":"2024-09-21T03:24:32.141749+0000","last_clean":"2024-09-21T03:24:32.141749+0000","last_became_active":"2024-09-21T03:14:37.470720+0000","last_became_peered":"2024-09-21T03:14:37.470720+0000","last_unstale":"2024-09-21T03:24:32.141749+0000","last_undegraded":"2024-09-21T03:24:32.141749+0000","last_fullsized":"2024-09-21T03:24:32.141749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:00.054692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.582741+0000","last_change":"2024-09-21T03:14:46.538665+0000","last_active":"2024-09-21T03:24:32.582741+0000","last_peered":"2024-09-21T03:24:32.582741+0000","last_clean":"2024-09-21T03:24:32.582741+0000","last_became_active":"2024-09-21T03:14:46.537774+0000","last_became_peered":"2024-09-21T03:14:46.537774+0000","last_unstale":"2024-09-21T03:24:32.582741+0000","last_undegraded":"2024-09-21T03:24:32.582741+0000","last_fullsized":"2024-09-21T03:24:32.582741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:07.736404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"27'2977","reported_seq":2998,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.568400+0000","last_change":"2024-09-21T03:14:47.553011+0000","last_active":"2024-09-21T03:24:32.568400+0000","last_peered":"2024-09-21T03:24:32.568400+0000","last_clean":"2024-09-21T03:24:32.568400+0000","last_became_active":"2024-09-21T03:14:47.552700+0000","last_became_peered":"2024-09-21T03:14:47.552700+0000","last_unstale":"2024-09-21T03:24:32.568400+0000","last_undegraded":"2024-09-21T03:24:32.568400+0000","last_fullsized":"2024-09-21T03:24:32.568400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2977,"log_dups_size":0,"ondisk_log_size":2977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:58.780132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43190,"num_write_kb":444709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"27'3323","reported_seq":3352,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.477288+0000","last_change":"2024-09-21T03:14:38.472906+0000","last_active":"2024-09-21T03:24:44.477288+0000","last_peered":"2024-09-21T03:24:44.477288+0000","last_clean":"2024-09-21T03:24:44.477288+0000","last_became_active":"2024-09-21T03:14:38.471933+0000","last_became_peered":"2024-09-21T03:14:38.471933+0000","last_unstale":"2024-09-21T03:24:44.477288+0000","last_undegraded":"2024-09-21T03:24:44.477288+0000","last_fullsized":"2024-09-21T03:24:44.477288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3323,"log_dups_size":0,"ondisk_log_size":3323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:05.395821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49154,"num_write_kb":612364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.200953+0000","last_change":"2024-09-21T03:14:37.478714+0000","last_active":"2024-09-21T03:24:32.200953+0000","last_peered":"2024-09-21T03:24:32.200953+0000","last_clean":"2024-09-21T03:24:32.200953+0000","last_became_active":"2024-09-21T03:14:37.477951+0000","last_became_peered":"2024-09-21T03:14:37.477951+0000","last_unstale":"2024-09-21T03:24:32.200953+0000","last_undegraded":"2024-09-21T03:24:32.200953+0000","last_fullsized":"2024-09-21T03:24:32.200953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:42.529545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:26.343821+0000","last_change":"2024-09-21T03:14:46.546142+0000","last_active":"2024-09-21T03:24:26.343821+0000","last_peered":"2024-09-21T03:24:26.343821+0000","last_clean":"2024-09-21T03:24:26.343821+0000","last_became_active":"2024-09-21T03:14:46.545865+0000","last_became_peered":"2024-09-21T03:14:46.545865+0000","last_unstale":"2024-09-21T03:24:26.343821+0000","last_undegraded":"2024-09-21T03:24:26.343821+0000","last_fullsized":"2024-09-21T03:24:26.343821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:11.705309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"27'2773","reported_seq":2800,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.350773+0000","last_change":"2024-09-21T03:19:03.558620+0000","last_active":"2024-09-21T03:24:32.350773+0000","last_peered":"2024-09-21T03:24:32.350773+0000","last_clean":"2024-09-21T03:24:32.350773+0000","last_became_active":"2024-09-21T03:14:47.568656+0000","last_became_peered":"2024-09-21T03:14:47.568656+0000","last_unstale":"2024-09-21T03:24:32.350773+0000","last_undegraded":"2024-09-21T03:24:32.350773+0000","last_fullsized":"2024-09-21T03:24:32.350773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2773,"log_dups_size":0,"ondisk_log_size":2773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.041710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40461,"num_write_kb":415650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'3322","reported_seq":3351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.223296+0000","last_change":"2024-09-21T03:14:38.485454+0000","last_active":"2024-09-21T03:24:32.223296+0000","last_peered":"2024-09-21T03:24:32.223296+0000","last_clean":"2024-09-21T03:24:32.223296+0000","last_became_active":"2024-09-21T03:14:38.485235+0000","last_became_peered":"2024-09-21T03:14:38.485235+0000","last_unstale":"2024-09-21T03:24:32.223296+0000","last_undegraded":"2024-09-21T03:24:32.223296+0000","last_fullsized":"2024-09-21T03:24:32.223296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3322,"log_dups_size":0,"ondisk_log_size":3322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:11.585637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48941,"num_write_kb":642004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.241707+0000","last_change":"2024-09-21T03:14:37.466544+0000","last_active":"2024-09-21T03:24:32.241707+0000","last_peered":"2024-09-21T03:24:32.241707+0000","last_clean":"2024-09-21T03:24:32.241707+0000","last_became_active":"2024-09-21T03:14:37.465817+0000","last_became_peered":"2024-09-21T03:14:37.465817+0000","last_unstale":"2024-09-21T03:24:32.241707+0000","last_undegraded":"2024-09-21T03:24:32.241707+0000","last_fullsized":"2024-09-21T03:24:32.241707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:36.113483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'229","reported_seq":252,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.596651+0000","last_change":"2024-09-21T03:14:46.549921+0000","last_active":"2024-09-21T03:24:32.596651+0000","last_peered":"2024-09-21T03:24:32.596651+0000","last_clean":"2024-09-21T03:24:32.596651+0000","last_became_active":"2024-09-21T03:14:46.549119+0000","last_became_peered":"2024-09-21T03:14:46.549119+0000","last_unstale":"2024-09-21T03:24:32.596651+0000","last_undegraded":"2024-09-21T03:24:32.596651+0000","last_fullsized":"2024-09-21T03:24:32.596651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:09.622498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"27'3932","reported_seq":3947,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.330162+0000","last_change":"2024-09-21T03:15:15.687659+0000","last_active":"2024-09-21T03:24:45.330162+0000","last_peered":"2024-09-21T03:24:45.330162+0000","last_clean":"2024-09-21T03:24:45.330162+0000","last_became_active":"2024-09-21T03:15:15.687225+0000","last_became_peered":"2024-09-21T03:15:15.687225+0000","last_unstale":"2024-09-21T03:24:45.330162+0000","last_undegraded":"2024-09-21T03:24:45.330162+0000","last_fullsized":"2024-09-21T03:24:45.330162+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3932,"log_dups_size":0,"ondisk_log_size":3932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:56.395767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57021,"num_write_kb":587488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"27'3064","reported_seq":3091,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.497573+0000","last_change":"2024-09-21T03:14:38.482528+0000","last_active":"2024-09-21T03:24:44.497573+0000","last_peered":"2024-09-21T03:24:44.497573+0000","last_clean":"2024-09-21T03:24:44.497573+0000","last_became_active":"2024-09-21T03:14:38.482241+0000","last_became_peered":"2024-09-21T03:14:38.482241+0000","last_unstale":"2024-09-21T03:24:44.497573+0000","last_undegraded":"2024-09-21T03:24:44.497573+0000","last_fullsized":"2024-09-21T03:24:44.497573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3064,"log_dups_size":0,"ondisk_log_size":3064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:23.110703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45418,"num_write_kb":562843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'19","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.197386+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:24:32.197386+0000","last_peered":"2024-09-21T03:24:32.197386+0000","last_clean":"2024-09-21T03:24:32.197386+0000","last_became_active":"2024-09-21T03:14:37.478882+0000","last_became_peered":"2024-09-21T03:14:37.478882+0000","last_unstale":"2024-09-21T03:24:32.197386+0000","last_undegraded":"2024-09-21T03:24:32.197386+0000","last_fullsized":"2024-09-21T03:24:32.197386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:11.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'22","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:33.062661+0000","last_change":"2024-09-21T03:14:46.538817+0000","last_active":"2024-09-21T03:24:33.062661+0000","last_peered":"2024-09-21T03:24:33.062661+0000","last_clean":"2024-09-21T03:24:33.062661+0000","last_became_active":"2024-09-21T03:14:46.537835+0000","last_became_peered":"2024-09-21T03:14:46.537835+0000","last_unstale":"2024-09-21T03:24:33.062661+0000","last_undegraded":"2024-09-21T03:24:33.062661+0000","last_fullsized":"2024-09-21T03:24:33.062661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:08.236663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"27'3365","reported_seq":3386,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.359474+0000","last_change":"2024-09-21T03:14:47.566534+0000","last_active":"2024-09-21T03:24:45.359474+0000","last_peered":"2024-09-21T03:24:45.359474+0000","last_clean":"2024-09-21T03:24:45.359474+0000","last_became_active":"2024-09-21T03:14:47.566157+0000","last_became_peered":"2024-09-21T03:14:47.566157+0000","last_unstale":"2024-09-21T03:24:45.359474+0000","last_undegraded":"2024-09-21T03:24:45.359474+0000","last_fullsized":"2024-09-21T03:24:45.359474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3365,"log_dups_size":0,"ondisk_log_size":3365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:35.557811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48864,"num_write_kb":499368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"27'2812","reported_seq":2841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.505020+0000","last_change":"2024-09-21T03:14:38.478509+0000","last_active":"2024-09-21T03:24:44.505020+0000","last_peered":"2024-09-21T03:24:44.505020+0000","last_clean":"2024-09-21T03:24:44.505020+0000","last_became_active":"2024-09-21T03:14:38.478197+0000","last_became_peered":"2024-09-21T03:14:38.478197+0000","last_unstale":"2024-09-21T03:24:44.505020+0000","last_undegraded":"2024-09-21T03:24:44.505020+0000","last_fullsized":"2024-09-21T03:24:44.505020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2812,"log_dups_size":0,"ondisk_log_size":2812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.411134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41544,"num_write_kb":533190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'234","reported_seq":265,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.189321+0000","last_change":"2024-09-21T03:14:37.472695+0000","last_active":"2024-09-21T03:24:32.189321+0000","last_peered":"2024-09-21T03:24:32.189321+0000","last_clean":"2024-09-21T03:24:32.189321+0000","last_became_active":"2024-09-21T03:14:37.472374+0000","last_became_peered":"2024-09-21T03:14:37.472374+0000","last_unstale":"2024-09-21T03:24:32.189321+0000","last_undegraded":"2024-09-21T03:24:32.189321+0000","last_fullsized":"2024-09-21T03:24:32.189321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:11.245914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":12446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'5","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.617539+0000","last_change":"2024-09-21T03:14:46.547433+0000","last_active":"2024-09-21T03:24:32.617539+0000","last_peered":"2024-09-21T03:24:32.617539+0000","last_clean":"2024-09-21T03:24:32.617539+0000","last_became_active":"2024-09-21T03:14:46.547192+0000","last_became_peered":"2024-09-21T03:14:46.547192+0000","last_unstale":"2024-09-21T03:24:32.617539+0000","last_undegraded":"2024-09-21T03:24:32.617539+0000","last_fullsized":"2024-09-21T03:24:32.617539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:03.238245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"27'2729","reported_seq":2750,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.457661+0000","last_change":"2024-09-21T03:14:47.545827+0000","last_active":"2024-09-21T03:24:32.457661+0000","last_peered":"2024-09-21T03:24:32.457661+0000","last_clean":"2024-09-21T03:24:32.457661+0000","last_became_active":"2024-09-21T03:14:47.545440+0000","last_became_peered":"2024-09-21T03:14:47.545440+0000","last_unstale":"2024-09-21T03:24:32.457661+0000","last_undegraded":"2024-09-21T03:24:32.457661+0000","last_fullsized":"2024-09-21T03:24:32.457661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2729,"log_dups_size":0,"ondisk_log_size":2729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:20.532645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39786,"num_write_kb":413571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"27'4229","reported_seq":4258,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.135874+0000","last_change":"2024-09-21T03:14:38.476564+0000","last_active":"2024-09-21T03:24:32.135874+0000","last_peered":"2024-09-21T03:24:32.135874+0000","last_clean":"2024-09-21T03:24:32.135874+0000","last_became_active":"2024-09-21T03:14:38.476158+0000","last_became_peered":"2024-09-21T03:14:38.476158+0000","last_unstale":"2024-09-21T03:24:32.135874+0000","last_undegraded":"2024-09-21T03:24:32.135874+0000","last_fullsized":"2024-09-21T03:24:32.135874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":4229,"log_dups_size":0,"ondisk_log_size":4229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:26.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63095,"num_write_kb":776596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'34","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.259366+0000","last_change":"2024-09-21T03:14:37.473709+0000","last_active":"2024-09-21T03:24:32.259366+0000","last_peered":"2024-09-21T03:24:32.259366+0000","last_clean":"2024-09-21T03:24:32.259366+0000","last_became_active":"2024-09-21T03:14:37.472544+0000","last_became_peered":"2024-09-21T03:14:37.472544+0000","last_unstale":"2024-09-21T03:24:32.259366+0000","last_undegraded":"2024-09-21T03:24:32.259366+0000","last_fullsized":"2024-09-21T03:24:32.259366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:47.892146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'51","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.595511+0000","last_change":"2024-09-21T03:14:46.534201+0000","last_active":"2024-09-21T03:24:32.595511+0000","last_peered":"2024-09-21T03:24:32.595511+0000","last_clean":"2024-09-21T03:24:32.595511+0000","last_became_active":"2024-09-21T03:14:46.533891+0000","last_became_peered":"2024-09-21T03:14:46.533891+0000","last_unstale":"2024-09-21T03:24:32.595511+0000","last_undegraded":"2024-09-21T03:24:32.595511+0000","last_fullsized":"2024-09-21T03:24:32.595511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:06.645173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":8218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"27'3044","reported_seq":3065,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.603649+0000","last_change":"2024-09-21T03:14:47.552016+0000","last_active":"2024-09-21T03:24:32.603649+0000","last_peered":"2024-09-21T03:24:32.603649+0000","last_clean":"2024-09-21T03:24:32.603649+0000","last_became_active":"2024-09-21T03:14:47.551622+0000","last_became_peered":"2024-09-21T03:14:47.551622+0000","last_unstale":"2024-09-21T03:24:32.603649+0000","last_undegraded":"2024-09-21T03:24:32.603649+0000","last_fullsized":"2024-09-21T03:24:32.603649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3044,"log_dups_size":0,"ondisk_log_size":3044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:56:04.849535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44676,"num_write_kb":453348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'2866","reported_seq":2895,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.559024+0000","last_change":"2024-09-21T03:14:38.484757+0000","last_active":"2024-09-21T03:24:44.559024+0000","last_peered":"2024-09-21T03:24:44.559024+0000","last_clean":"2024-09-21T03:24:44.559024+0000","last_became_active":"2024-09-21T03:14:38.483348+0000","last_became_peered":"2024-09-21T03:14:38.483348+0000","last_unstale":"2024-09-21T03:24:44.559024+0000","last_undegraded":"2024-09-21T03:24:44.559024+0000","last_fullsized":"2024-09-21T03:24:44.559024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2866,"log_dups_size":0,"ondisk_log_size":2866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:57.697723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42315,"num_write_kb":514746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'14","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.191061+0000","last_change":"2024-09-21T03:14:37.479047+0000","last_active":"2024-09-21T03:24:32.191061+0000","last_peered":"2024-09-21T03:24:32.191061+0000","last_clean":"2024-09-21T03:24:32.191061+0000","last_became_active":"2024-09-21T03:14:37.478700+0000","last_became_peered":"2024-09-21T03:14:37.478700+0000","last_unstale":"2024-09-21T03:24:32.191061+0000","last_undegraded":"2024-09-21T03:24:32.191061+0000","last_fullsized":"2024-09-21T03:24:32.191061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:31.702450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'12","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.584480+0000","last_change":"2024-09-21T03:14:46.547287+0000","last_active":"2024-09-21T03:24:32.584480+0000","last_peered":"2024-09-21T03:24:32.584480+0000","last_clean":"2024-09-21T03:24:32.584480+0000","last_became_active":"2024-09-21T03:14:46.546867+0000","last_became_peered":"2024-09-21T03:14:46.546867+0000","last_unstale":"2024-09-21T03:24:32.584480+0000","last_undegraded":"2024-09-21T03:24:32.584480+0000","last_fullsized":"2024-09-21T03:24:32.584480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:54.119841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"27'3248","reported_seq":3269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.330727+0000","last_change":"2024-09-21T03:14:47.558571+0000","last_active":"2024-09-21T03:24:45.330727+0000","last_peered":"2024-09-21T03:24:45.330727+0000","last_clean":"2024-09-21T03:24:45.330727+0000","last_became_active":"2024-09-21T03:14:47.558037+0000","last_became_peered":"2024-09-21T03:14:47.558037+0000","last_unstale":"2024-09-21T03:24:45.330727+0000","last_undegraded":"2024-09-21T03:24:45.330727+0000","last_fullsized":"2024-09-21T03:24:45.330727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3248,"log_dups_size":0,"ondisk_log_size":3248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:42.564181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47392,"num_write_kb":480920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"27'3071","reported_seq":3100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.583058+0000","last_change":"2024-09-21T03:14:38.488227+0000","last_active":"2024-09-21T03:24:44.583058+0000","last_peered":"2024-09-21T03:24:44.583058+0000","last_clean":"2024-09-21T03:24:44.583058+0000","last_became_active":"2024-09-21T03:14:38.482370+0000","last_became_peered":"2024-09-21T03:14:38.482370+0000","last_unstale":"2024-09-21T03:24:44.583058+0000","last_undegraded":"2024-09-21T03:24:44.583058+0000","last_fullsized":"2024-09-21T03:24:44.583058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3071,"log_dups_size":0,"ondisk_log_size":3071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:52.561391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45203,"num_write_kb":570065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:20.846579+0000","last_change":"2024-09-21T03:14:37.471363+0000","last_active":"2024-09-21T03:24:20.846579+0000","last_peered":"2024-09-21T03:24:20.846579+0000","last_clean":"2024-09-21T03:24:20.846579+0000","last_became_active":"2024-09-21T03:14:37.471002+0000","last_became_peered":"2024-09-21T03:14:37.471002+0000","last_unstale":"2024-09-21T03:24:20.846579+0000","last_undegraded":"2024-09-21T03:24:20.846579+0000","last_fullsized":"2024-09-21T03:24:20.846579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:25.922368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.586441+0000","last_change":"2024-09-21T03:14:46.545186+0000","last_active":"2024-09-21T03:24:32.586441+0000","last_peered":"2024-09-21T03:24:32.586441+0000","last_clean":"2024-09-21T03:24:32.586441+0000","last_became_active":"2024-09-21T03:14:46.543647+0000","last_became_peered":"2024-09-21T03:14:46.543647+0000","last_unstale":"2024-09-21T03:24:32.586441+0000","last_undegraded":"2024-09-21T03:24:32.586441+0000","last_fullsized":"2024-09-21T03:24:32.586441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:03.097368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"27'3498","reported_seq":3519,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.285413+0000","last_change":"2024-09-21T03:14:47.554766+0000","last_active":"2024-09-21T03:24:45.285413+0000","last_peered":"2024-09-21T03:24:45.285413+0000","last_clean":"2024-09-21T03:24:45.285413+0000","last_became_active":"2024-09-21T03:14:47.551563+0000","last_became_peered":"2024-09-21T03:14:47.551563+0000","last_unstale":"2024-09-21T03:24:45.285413+0000","last_undegraded":"2024-09-21T03:24:45.285413+0000","last_fullsized":"2024-09-21T03:24:45.285413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3498,"log_dups_size":0,"ondisk_log_size":3498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:08.790725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50774,"num_write_kb":531933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"27'32","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.588919+0000","last_change":"2024-09-21T03:14:46.542659+0000","last_active":"2024-09-21T03:24:32.588919+0000","last_peered":"2024-09-21T03:24:32.588919+0000","last_clean":"2024-09-21T03:24:32.588919+0000","last_became_active":"2024-09-21T03:14:46.541771+0000","last_became_peered":"2024-09-21T03:14:46.541771+0000","last_unstale":"2024-09-21T03:24:32.588919+0000","last_undegraded":"2024-09-21T03:24:32.588919+0000","last_fullsized":"2024-09-21T03:24:32.588919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:45.543904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'3639","reported_seq":3668,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.531609+0000","last_change":"2024-09-21T03:14:38.481837+0000","last_active":"2024-09-21T03:24:44.531609+0000","last_peered":"2024-09-21T03:24:44.531609+0000","last_clean":"2024-09-21T03:24:44.531609+0000","last_became_active":"2024-09-21T03:14:38.478400+0000","last_became_peered":"2024-09-21T03:14:38.478400+0000","last_unstale":"2024-09-21T03:24:44.531609+0000","last_undegraded":"2024-09-21T03:24:44.531609+0000","last_fullsized":"2024-09-21T03:24:44.531609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3639,"log_dups_size":0,"ondisk_log_size":3639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.702185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53758,"num_write_kb":679942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'29","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.101066+0000","last_change":"2024-09-21T03:14:37.459351+0000","last_active":"2024-09-21T03:24:32.101066+0000","last_peered":"2024-09-21T03:24:32.101066+0000","last_clean":"2024-09-21T03:24:32.101066+0000","last_became_active":"2024-09-21T03:14:37.458676+0000","last_became_peered":"2024-09-21T03:14:37.458676+0000","last_unstale":"2024-09-21T03:24:32.101066+0000","last_undegraded":"2024-09-21T03:24:32.101066+0000","last_fullsized":"2024-09-21T03:24:32.101066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:42.671520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"27'3276","reported_seq":3297,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.497499+0000","last_change":"2024-09-21T03:14:47.561232+0000","last_active":"2024-09-21T03:24:32.497499+0000","last_peered":"2024-09-21T03:24:32.497499+0000","last_clean":"2024-09-21T03:24:32.497499+0000","last_became_active":"2024-09-21T03:14:47.557224+0000","last_became_peered":"2024-09-21T03:14:47.557224+0000","last_unstale":"2024-09-21T03:24:32.497499+0000","last_undegraded":"2024-09-21T03:24:32.497499+0000","last_fullsized":"2024-09-21T03:24:32.497499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3276,"log_dups_size":0,"ondisk_log_size":3276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:09.611235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47961,"num_write_kb":483752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"27'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:21:00.934074+0000","last_change":"2024-09-21T03:14:46.543157+0000","last_active":"2024-09-21T03:21:00.934074+0000","last_peered":"2024-09-21T03:21:00.934074+0000","last_clean":"2024-09-21T03:21:00.934074+0000","last_became_active":"2024-09-21T03:14:46.542746+0000","last_became_peered":"2024-09-21T03:14:46.542746+0000","last_unstale":"2024-09-21T03:21:00.934074+0000","last_undegraded":"2024-09-21T03:21:00.934074+0000","last_fullsized":"2024-09-21T03:21:00.934074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:30.644843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'3052","reported_seq":3081,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.518411+0000","last_change":"2024-09-21T03:14:38.480723+0000","last_active":"2024-09-21T03:24:44.518411+0000","last_peered":"2024-09-21T03:24:44.518411+0000","last_clean":"2024-09-21T03:24:44.518411+0000","last_became_active":"2024-09-21T03:14:38.472823+0000","last_became_peered":"2024-09-21T03:14:38.472823+0000","last_unstale":"2024-09-21T03:24:44.518411+0000","last_undegraded":"2024-09-21T03:24:44.518411+0000","last_fullsized":"2024-09-21T03:24:44.518411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3052,"log_dups_size":0,"ondisk_log_size":3052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:59.862592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44791,"num_write_kb":578211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'17","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:29.478596+0000","last_change":"2024-09-21T03:14:37.472209+0000","last_active":"2024-09-21T03:24:29.478596+0000","last_peered":"2024-09-21T03:24:29.478596+0000","last_clean":"2024-09-21T03:24:29.478596+0000","last_became_active":"2024-09-21T03:14:37.471771+0000","last_became_peered":"2024-09-21T03:14:37.471771+0000","last_unstale":"2024-09-21T03:24:29.478596+0000","last_undegraded":"2024-09-21T03:24:29.478596+0000","last_fullsized":"2024-09-21T03:24:29.478596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:30.648010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"27'3552","reported_seq":3572,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.364338+0000","last_change":"2024-09-21T03:14:47.570651+0000","last_active":"2024-09-21T03:24:45.364338+0000","last_peered":"2024-09-21T03:24:45.364338+0000","last_clean":"2024-09-21T03:24:45.364338+0000","last_became_active":"2024-09-21T03:14:47.568081+0000","last_became_peered":"2024-09-21T03:14:47.568081+0000","last_unstale":"2024-09-21T03:24:45.364338+0000","last_undegraded":"2024-09-21T03:24:45.364338+0000","last_fullsized":"2024-09-21T03:24:45.364338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:45.036938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51450,"num_write_kb":532295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"27'33","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.223186+0000","last_change":"2024-09-21T03:14:37.475076+0000","last_active":"2024-09-21T03:24:32.223186+0000","last_peered":"2024-09-21T03:24:32.223186+0000","last_clean":"2024-09-21T03:24:32.223186+0000","last_became_active":"2024-09-21T03:14:37.474595+0000","last_became_peered":"2024-09-21T03:14:37.474595+0000","last_unstale":"2024-09-21T03:24:32.223186+0000","last_undegraded":"2024-09-21T03:24:32.223186+0000","last_fullsized":"2024-09-21T03:24:32.223186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:16.880647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2516","reported_seq":2545,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.531186+0000","last_change":"2024-09-21T03:14:38.483226+0000","last_active":"2024-09-21T03:24:44.531186+0000","last_peered":"2024-09-21T03:24:44.531186+0000","last_clean":"2024-09-21T03:24:44.531186+0000","last_became_active":"2024-09-21T03:14:38.482354+0000","last_became_peered":"2024-09-21T03:14:38.482354+0000","last_unstale":"2024-09-21T03:24:44.531186+0000","last_undegraded":"2024-09-21T03:24:44.531186+0000","last_fullsized":"2024-09-21T03:24:44.531186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2516,"log_dups_size":0,"ondisk_log_size":2516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:51.488594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37096,"num_write_kb":460963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'34","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.602419+0000","last_change":"2024-09-21T03:14:46.551282+0000","last_active":"2024-09-21T03:24:32.602419+0000","last_peered":"2024-09-21T03:24:32.602419+0000","last_clean":"2024-09-21T03:24:32.602419+0000","last_became_active":"2024-09-21T03:14:46.550191+0000","last_became_peered":"2024-09-21T03:14:46.550191+0000","last_unstale":"2024-09-21T03:24:32.602419+0000","last_undegraded":"2024-09-21T03:24:32.602419+0000","last_fullsized":"2024-09-21T03:24:32.602419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:32.136739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"27'2120","reported_seq":2146,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.338684+0000","last_change":"2024-09-21T03:15:15.686522+0000","last_active":"2024-09-21T03:24:45.338684+0000","last_peered":"2024-09-21T03:24:45.338684+0000","last_clean":"2024-09-21T03:24:45.338684+0000","last_became_active":"2024-09-21T03:15:15.686063+0000","last_became_peered":"2024-09-21T03:15:15.686063+0000","last_unstale":"2024-09-21T03:24:45.338684+0000","last_undegraded":"2024-09-21T03:24:45.338684+0000","last_fullsized":"2024-09-21T03:24:45.338684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2120,"log_dups_size":0,"ondisk_log_size":2120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:57.750372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30729,"num_write_kb":315555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1140","reported_seq":1171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.135682+0000","last_change":"2024-09-21T03:14:37.465536+0000","last_active":"2024-09-21T03:24:32.135682+0000","last_peered":"2024-09-21T03:24:32.135682+0000","last_clean":"2024-09-21T03:24:32.135682+0000","last_became_active":"2024-09-21T03:14:37.465240+0000","last_became_peered":"2024-09-21T03:14:37.465240+0000","last_unstale":"2024-09-21T03:24:32.135682+0000","last_undegraded":"2024-09-21T03:24:32.135682+0000","last_fullsized":"2024-09-21T03:24:32.135682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1140,"log_dups_size":0,"ondisk_log_size":1140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:34.780298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1138,"num_write_kb":5114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'2730","reported_seq":2759,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.508566+0000","last_change":"2024-09-21T03:14:38.474516+0000","last_active":"2024-09-21T03:24:44.508566+0000","last_peered":"2024-09-21T03:24:44.508566+0000","last_clean":"2024-09-21T03:24:44.508566+0000","last_became_active":"2024-09-21T03:14:38.472225+0000","last_became_peered":"2024-09-21T03:14:38.472225+0000","last_unstale":"2024-09-21T03:24:44.508566+0000","last_undegraded":"2024-09-21T03:24:44.508566+0000","last_fullsized":"2024-09-21T03:24:44.508566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2730,"log_dups_size":0,"ondisk_log_size":2730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:47.504910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40361,"num_write_kb":500658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'77","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.576199+0000","last_change":"2024-09-21T03:14:46.544072+0000","last_active":"2024-09-21T03:24:32.576199+0000","last_peered":"2024-09-21T03:24:32.576199+0000","last_clean":"2024-09-21T03:24:32.576199+0000","last_became_active":"2024-09-21T03:14:46.543729+0000","last_became_peered":"2024-09-21T03:14:46.543729+0000","last_unstale":"2024-09-21T03:24:32.576199+0000","last_undegraded":"2024-09-21T03:24:32.576199+0000","last_fullsized":"2024-09-21T03:24:32.576199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:18.560012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":12315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"27'2742","reported_seq":2763,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.365262+0000","last_change":"2024-09-21T03:14:47.563764+0000","last_active":"2024-09-21T03:24:45.365262+0000","last_peered":"2024-09-21T03:24:45.365262+0000","last_clean":"2024-09-21T03:24:45.365262+0000","last_became_active":"2024-09-21T03:14:47.562943+0000","last_became_peered":"2024-09-21T03:14:47.562943+0000","last_unstale":"2024-09-21T03:24:45.365262+0000","last_undegraded":"2024-09-21T03:24:45.365262+0000","last_fullsized":"2024-09-21T03:24:45.365262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2742,"log_dups_size":0,"ondisk_log_size":2742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:39.284350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39824,"num_write_kb":405293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"27'3827","reported_seq":3856,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.511437+0000","last_change":"2024-09-21T03:14:38.484311+0000","last_active":"2024-09-21T03:24:44.511437+0000","last_peered":"2024-09-21T03:24:44.511437+0000","last_clean":"2024-09-21T03:24:44.511437+0000","last_became_active":"2024-09-21T03:14:38.483975+0000","last_became_peered":"2024-09-21T03:14:38.483975+0000","last_unstale":"2024-09-21T03:24:44.511437+0000","last_undegraded":"2024-09-21T03:24:44.511437+0000","last_fullsized":"2024-09-21T03:24:44.511437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3827,"log_dups_size":0,"ondisk_log_size":3827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:31.145431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56663,"num_write_kb":721573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"27'3391","reported_seq":3412,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.350778+0000","last_change":"2024-09-21T03:14:47.566252+0000","last_active":"2024-09-21T03:24:45.350778+0000","last_peered":"2024-09-21T03:24:45.350778+0000","last_clean":"2024-09-21T03:24:45.350778+0000","last_became_active":"2024-09-21T03:14:47.560282+0000","last_became_peered":"2024-09-21T03:14:47.560282+0000","last_unstale":"2024-09-21T03:24:45.350778+0000","last_undegraded":"2024-09-21T03:24:45.350778+0000","last_fullsized":"2024-09-21T03:24:45.350778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3391,"log_dups_size":0,"ondisk_log_size":3391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:23.553847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49276,"num_write_kb":506666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"27'3185","reported_seq":3214,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.016946+0000","last_change":"2024-09-21T03:14:38.477183+0000","last_active":"2024-09-21T03:24:32.016946+0000","last_peered":"2024-09-21T03:24:32.016946+0000","last_clean":"2024-09-21T03:24:32.016946+0000","last_became_active":"2024-09-21T03:14:38.476657+0000","last_became_peered":"2024-09-21T03:14:38.476657+0000","last_unstale":"2024-09-21T03:24:32.016946+0000","last_undegraded":"2024-09-21T03:24:32.016946+0000","last_fullsized":"2024-09-21T03:24:32.016946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3185,"log_dups_size":0,"ondisk_log_size":3185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:36.801764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47236,"num_write_kb":609124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"27'2689","reported_seq":2710,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.343743+0000","last_change":"2024-09-21T03:14:47.574339+0000","last_active":"2024-09-21T03:24:45.343743+0000","last_peered":"2024-09-21T03:24:45.343743+0000","last_clean":"2024-09-21T03:24:45.343743+0000","last_became_active":"2024-09-21T03:14:47.565732+0000","last_became_peered":"2024-09-21T03:14:47.565732+0000","last_unstale":"2024-09-21T03:24:45.343743+0000","last_undegraded":"2024-09-21T03:24:45.343743+0000","last_fullsized":"2024-09-21T03:24:45.343743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2689,"log_dups_size":0,"ondisk_log_size":2689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:57.896810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39100,"num_write_kb":400538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'3532","reported_seq":3561,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.118361+0000","last_change":"2024-09-21T03:14:38.472860+0000","last_active":"2024-09-21T03:24:32.118361+0000","last_peered":"2024-09-21T03:24:32.118361+0000","last_clean":"2024-09-21T03:24:32.118361+0000","last_became_active":"2024-09-21T03:14:38.472548+0000","last_became_peered":"2024-09-21T03:14:38.472548+0000","last_unstale":"2024-09-21T03:24:32.118361+0000","last_undegraded":"2024-09-21T03:24:32.118361+0000","last_fullsized":"2024-09-21T03:24:32.118361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:16.071692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52273,"num_write_kb":690147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"27'3152","reported_seq":3173,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.268948+0000","last_change":"2024-09-21T03:14:47.557402+0000","last_active":"2024-09-21T03:24:45.268948+0000","last_peered":"2024-09-21T03:24:45.268948+0000","last_clean":"2024-09-21T03:24:45.268948+0000","last_became_active":"2024-09-21T03:14:47.557047+0000","last_became_peered":"2024-09-21T03:14:47.557047+0000","last_unstale":"2024-09-21T03:24:45.268948+0000","last_undegraded":"2024-09-21T03:24:45.268948+0000","last_fullsized":"2024-09-21T03:24:45.268948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3152,"log_dups_size":0,"ondisk_log_size":3152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:29.792514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46003,"num_write_kb":479339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'2575","reported_seq":2604,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.502864+0000","last_change":"2024-09-21T03:14:38.481039+0000","last_active":"2024-09-21T03:24:44.502864+0000","last_peered":"2024-09-21T03:24:44.502864+0000","last_clean":"2024-09-21T03:24:44.502864+0000","last_became_active":"2024-09-21T03:14:38.480686+0000","last_became_peered":"2024-09-21T03:14:38.480686+0000","last_unstale":"2024-09-21T03:24:44.502864+0000","last_undegraded":"2024-09-21T03:24:44.502864+0000","last_fullsized":"2024-09-21T03:24:44.502864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2575,"log_dups_size":0,"ondisk_log_size":2575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:18.603386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37971,"num_write_kb":494263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"27'3593","reported_seq":3614,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.536048+0000","last_change":"2024-09-21T03:14:47.565697+0000","last_active":"2024-09-21T03:24:32.536048+0000","last_peered":"2024-09-21T03:24:32.536048+0000","last_clean":"2024-09-21T03:24:32.536048+0000","last_became_active":"2024-09-21T03:14:47.565393+0000","last_became_peered":"2024-09-21T03:14:47.565393+0000","last_unstale":"2024-09-21T03:24:32.536048+0000","last_undegraded":"2024-09-21T03:24:32.536048+0000","last_fullsized":"2024-09-21T03:24:32.536048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3593,"log_dups_size":0,"ondisk_log_size":3593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:35.421803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52343,"num_write_kb":533323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'2829","reported_seq":2858,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.146488+0000","last_change":"2024-09-21T03:14:38.473900+0000","last_active":"2024-09-21T03:24:32.146488+0000","last_peered":"2024-09-21T03:24:32.146488+0000","last_clean":"2024-09-21T03:24:32.146488+0000","last_became_active":"2024-09-21T03:14:38.471325+0000","last_became_peered":"2024-09-21T03:14:38.471325+0000","last_unstale":"2024-09-21T03:24:32.146488+0000","last_undegraded":"2024-09-21T03:24:32.146488+0000","last_fullsized":"2024-09-21T03:24:32.146488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2829,"log_dups_size":0,"ondisk_log_size":2829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:47.556293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41957,"num_write_kb":531654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"27'2577","reported_seq":2604,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.589169+0000","last_change":"2024-09-21T03:15:15.685059+0000","last_active":"2024-09-21T03:24:32.589169+0000","last_peered":"2024-09-21T03:24:32.589169+0000","last_clean":"2024-09-21T03:24:32.589169+0000","last_became_active":"2024-09-21T03:15:15.684633+0000","last_became_peered":"2024-09-21T03:15:15.684633+0000","last_unstale":"2024-09-21T03:24:32.589169+0000","last_undegraded":"2024-09-21T03:24:32.589169+0000","last_fullsized":"2024-09-21T03:24:32.589169+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2577,"log_dups_size":0,"ondisk_log_size":2577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:22.251366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37382,"num_write_kb":380663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"27'3218","reported_seq":3247,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.489940+0000","last_change":"2024-09-21T03:14:38.478099+0000","last_active":"2024-09-21T03:24:44.489940+0000","last_peered":"2024-09-21T03:24:44.489940+0000","last_clean":"2024-09-21T03:24:44.489940+0000","last_became_active":"2024-09-21T03:14:38.475894+0000","last_became_peered":"2024-09-21T03:14:38.475894+0000","last_unstale":"2024-09-21T03:24:44.489940+0000","last_undegraded":"2024-09-21T03:24:44.489940+0000","last_fullsized":"2024-09-21T03:24:44.489940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3218,"log_dups_size":0,"ondisk_log_size":3218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:49.876430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47546,"num_write_kb":620007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"27'3711","reported_seq":3732,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.587650+0000","last_change":"2024-09-21T03:14:47.556933+0000","last_active":"2024-09-21T03:24:32.587650+0000","last_peered":"2024-09-21T03:24:32.587650+0000","last_clean":"2024-09-21T03:24:32.587650+0000","last_became_active":"2024-09-21T03:14:47.556615+0000","last_became_peered":"2024-09-21T03:14:47.556615+0000","last_unstale":"2024-09-21T03:24:32.587650+0000","last_undegraded":"2024-09-21T03:24:32.587650+0000","last_fullsized":"2024-09-21T03:24:32.587650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3711,"log_dups_size":0,"ondisk_log_size":3711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:27.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54133,"num_write_kb":557757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"27'2798","reported_seq":2827,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.581889+0000","last_change":"2024-09-21T03:14:38.484198+0000","last_active":"2024-09-21T03:24:44.581889+0000","last_peered":"2024-09-21T03:24:44.581889+0000","last_clean":"2024-09-21T03:24:44.581889+0000","last_became_active":"2024-09-21T03:14:38.483893+0000","last_became_peered":"2024-09-21T03:14:38.483893+0000","last_unstale":"2024-09-21T03:24:44.581889+0000","last_undegraded":"2024-09-21T03:24:44.581889+0000","last_fullsized":"2024-09-21T03:24:44.581889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2798,"log_dups_size":0,"ondisk_log_size":2798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:56.665359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41301,"num_write_kb":515809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"27'3224","reported_seq":3245,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.326679+0000","last_change":"2024-09-21T03:14:47.553479+0000","last_active":"2024-09-21T03:24:45.326679+0000","last_peered":"2024-09-21T03:24:45.326679+0000","last_clean":"2024-09-21T03:24:45.326679+0000","last_became_active":"2024-09-21T03:14:47.553144+0000","last_became_peered":"2024-09-21T03:14:47.553144+0000","last_unstale":"2024-09-21T03:24:45.326679+0000","last_undegraded":"2024-09-21T03:24:45.326679+0000","last_fullsized":"2024-09-21T03:24:45.326679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3224,"log_dups_size":0,"ondisk_log_size":3224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:26.321488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46752,"num_write_kb":476180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'3507","reported_seq":3536,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.533411+0000","last_change":"2024-09-21T03:14:38.487093+0000","last_active":"2024-09-21T03:24:44.533411+0000","last_peered":"2024-09-21T03:24:44.533411+0000","last_clean":"2024-09-21T03:24:44.533411+0000","last_became_active":"2024-09-21T03:14:38.486204+0000","last_became_peered":"2024-09-21T03:14:38.486204+0000","last_unstale":"2024-09-21T03:24:44.533411+0000","last_undegraded":"2024-09-21T03:24:44.533411+0000","last_fullsized":"2024-09-21T03:24:44.533411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3507,"log_dups_size":0,"ondisk_log_size":3507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:55.531046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51770,"num_write_kb":667306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"27'2344","reported_seq":2365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.614027+0000","last_change":"2024-09-21T03:14:47.573375+0000","last_active":"2024-09-21T03:24:32.614027+0000","last_peered":"2024-09-21T03:24:32.614027+0000","last_clean":"2024-09-21T03:24:32.614027+0000","last_became_active":"2024-09-21T03:14:47.572717+0000","last_became_peered":"2024-09-21T03:14:47.572717+0000","last_unstale":"2024-09-21T03:24:32.614027+0000","last_undegraded":"2024-09-21T03:24:32.614027+0000","last_fullsized":"2024-09-21T03:24:32.614027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2344,"log_dups_size":0,"ondisk_log_size":2344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:44.673283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33818,"num_write_kb":353403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"27'2605","reported_seq":2634,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.218196+0000","last_change":"2024-09-21T03:14:38.471959+0000","last_active":"2024-09-21T03:24:32.218196+0000","last_peered":"2024-09-21T03:24:32.218196+0000","last_clean":"2024-09-21T03:24:32.218196+0000","last_became_active":"2024-09-21T03:14:38.471625+0000","last_became_peered":"2024-09-21T03:14:38.471625+0000","last_unstale":"2024-09-21T03:24:32.218196+0000","last_undegraded":"2024-09-21T03:24:32.218196+0000","last_fullsized":"2024-09-21T03:24:32.218196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2605,"log_dups_size":0,"ondisk_log_size":2605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:17.761951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38420,"num_write_kb":499975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"27'3509","reported_seq":3530,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.550591+0000","last_change":"2024-09-21T03:14:47.564597+0000","last_active":"2024-09-21T03:24:32.550591+0000","last_peered":"2024-09-21T03:24:32.550591+0000","last_clean":"2024-09-21T03:24:32.550591+0000","last_became_active":"2024-09-21T03:14:47.563816+0000","last_became_peered":"2024-09-21T03:14:47.563816+0000","last_unstale":"2024-09-21T03:24:32.550591+0000","last_undegraded":"2024-09-21T03:24:32.550591+0000","last_fullsized":"2024-09-21T03:24:32.550591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3509,"log_dups_size":0,"ondisk_log_size":3509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:33.061271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50894,"num_write_kb":526303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'3043","reported_seq":3072,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.530608+0000","last_change":"2024-09-21T03:14:38.491888+0000","last_active":"2024-09-21T03:24:44.530608+0000","last_peered":"2024-09-21T03:24:44.530608+0000","last_clean":"2024-09-21T03:24:44.530608+0000","last_became_active":"2024-09-21T03:14:38.491510+0000","last_became_peered":"2024-09-21T03:14:38.491510+0000","last_unstale":"2024-09-21T03:24:44.530608+0000","last_undegraded":"2024-09-21T03:24:44.530608+0000","last_fullsized":"2024-09-21T03:24:44.530608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3043,"log_dups_size":0,"ondisk_log_size":3043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:26.740304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44704,"num_write_kb":573613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"27'2891","reported_seq":2912,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.592034+0000","last_change":"2024-09-21T03:14:47.564310+0000","last_active":"2024-09-21T03:24:32.592034+0000","last_peered":"2024-09-21T03:24:32.592034+0000","last_clean":"2024-09-21T03:24:32.592034+0000","last_became_active":"2024-09-21T03:14:47.564003+0000","last_became_peered":"2024-09-21T03:14:47.564003+0000","last_unstale":"2024-09-21T03:24:32.592034+0000","last_undegraded":"2024-09-21T03:24:32.592034+0000","last_fullsized":"2024-09-21T03:24:32.592034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2891,"log_dups_size":0,"ondisk_log_size":2891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:45.016321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42050,"num_write_kb":436747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"27'3507","reported_seq":3536,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.499180+0000","last_change":"2024-09-21T03:14:38.470991+0000","last_active":"2024-09-21T03:24:44.499180+0000","last_peered":"2024-09-21T03:24:44.499180+0000","last_clean":"2024-09-21T03:24:44.499180+0000","last_became_active":"2024-09-21T03:14:38.470666+0000","last_became_peered":"2024-09-21T03:14:38.470666+0000","last_unstale":"2024-09-21T03:24:44.499180+0000","last_undegraded":"2024-09-21T03:24:44.499180+0000","last_fullsized":"2024-09-21T03:24:44.499180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3507,"log_dups_size":0,"ondisk_log_size":3507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:25.477992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51813,"num_write_kb":639602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"27'2972","reported_seq":2993,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.605743+0000","last_change":"2024-09-21T03:14:47.575212+0000","last_active":"2024-09-21T03:24:32.605743+0000","last_peered":"2024-09-21T03:24:32.605743+0000","last_clean":"2024-09-21T03:24:32.605743+0000","last_became_active":"2024-09-21T03:14:47.574895+0000","last_became_peered":"2024-09-21T03:14:47.574895+0000","last_unstale":"2024-09-21T03:24:32.605743+0000","last_undegraded":"2024-09-21T03:24:32.605743+0000","last_fullsized":"2024-09-21T03:24:32.605743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2972,"log_dups_size":0,"ondisk_log_size":2972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:04.240949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43060,"num_write_kb":442689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"27'2924","reported_seq":2953,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.506322+0000","last_change":"2024-09-21T03:14:38.482681+0000","last_active":"2024-09-21T03:24:44.506322+0000","last_peered":"2024-09-21T03:24:44.506322+0000","last_clean":"2024-09-21T03:24:44.506322+0000","last_became_active":"2024-09-21T03:14:38.477816+0000","last_became_peered":"2024-09-21T03:14:38.477816+0000","last_unstale":"2024-09-21T03:24:44.506322+0000","last_undegraded":"2024-09-21T03:24:44.506322+0000","last_fullsized":"2024-09-21T03:24:44.506322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2924,"log_dups_size":0,"ondisk_log_size":2924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:18.675641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42673,"num_write_kb":583298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"27'3308","reported_seq":3329,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.339081+0000","last_change":"2024-09-21T03:14:47.555329+0000","last_active":"2024-09-21T03:24:45.339081+0000","last_peered":"2024-09-21T03:24:45.339081+0000","last_clean":"2024-09-21T03:24:45.339081+0000","last_became_active":"2024-09-21T03:14:47.555033+0000","last_became_peered":"2024-09-21T03:14:47.555033+0000","last_unstale":"2024-09-21T03:24:45.339081+0000","last_undegraded":"2024-09-21T03:24:45.339081+0000","last_fullsized":"2024-09-21T03:24:45.339081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3308,"log_dups_size":0,"ondisk_log_size":3308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:49.060834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48400,"num_write_kb":492898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"27'3018","reported_seq":3047,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.545961+0000","last_change":"2024-09-21T03:14:38.480638+0000","last_active":"2024-09-21T03:24:44.545961+0000","last_peered":"2024-09-21T03:24:44.545961+0000","last_clean":"2024-09-21T03:24:44.545961+0000","last_became_active":"2024-09-21T03:14:38.477739+0000","last_became_peered":"2024-09-21T03:14:38.477739+0000","last_unstale":"2024-09-21T03:24:44.545961+0000","last_undegraded":"2024-09-21T03:24:44.545961+0000","last_fullsized":"2024-09-21T03:24:44.545961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3018,"log_dups_size":0,"ondisk_log_size":3018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:35.097761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44651,"num_write_kb":569943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"27'3044","reported_seq":3065,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.602093+0000","last_change":"2024-09-21T03:14:47.573659+0000","last_active":"2024-09-21T03:24:32.602093+0000","last_peered":"2024-09-21T03:24:32.602093+0000","last_clean":"2024-09-21T03:24:32.602093+0000","last_became_active":"2024-09-21T03:14:47.572756+0000","last_became_peered":"2024-09-21T03:14:47.572756+0000","last_unstale":"2024-09-21T03:24:32.602093+0000","last_undegraded":"2024-09-21T03:24:32.602093+0000","last_fullsized":"2024-09-21T03:24:32.602093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3044,"log_dups_size":0,"ondisk_log_size":3044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:21.986681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44174,"num_write_kb":452226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'3117","reported_seq":3150,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.257690+0000","last_change":"2024-09-21T03:19:03.558825+0000","last_active":"2024-09-21T03:24:32.257690+0000","last_peered":"2024-09-21T03:24:32.257690+0000","last_clean":"2024-09-21T03:24:32.257690+0000","last_became_active":"2024-09-21T03:14:38.473843+0000","last_became_peered":"2024-09-21T03:14:38.473843+0000","last_unstale":"2024-09-21T03:24:32.257690+0000","last_undegraded":"2024-09-21T03:24:32.257690+0000","last_fullsized":"2024-09-21T03:24:32.257690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3117,"log_dups_size":0,"ondisk_log_size":3117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:27.072406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46022,"num_write_kb":573473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"27'2638","reported_seq":2659,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.342961+0000","last_change":"2024-09-21T03:14:47.555386+0000","last_active":"2024-09-21T03:24:45.342961+0000","last_peered":"2024-09-21T03:24:45.342961+0000","last_clean":"2024-09-21T03:24:45.342961+0000","last_became_active":"2024-09-21T03:14:47.554758+0000","last_became_peered":"2024-09-21T03:14:47.554758+0000","last_unstale":"2024-09-21T03:24:45.342961+0000","last_undegraded":"2024-09-21T03:24:45.342961+0000","last_fullsized":"2024-09-21T03:24:45.342961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2638,"log_dups_size":0,"ondisk_log_size":2638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:47.574672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38196,"num_write_kb":393191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"27'2520","reported_seq":2549,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.240443+0000","last_change":"2024-09-21T03:14:38.494878+0000","last_active":"2024-09-21T03:24:32.240443+0000","last_peered":"2024-09-21T03:24:32.240443+0000","last_clean":"2024-09-21T03:24:32.240443+0000","last_became_active":"2024-09-21T03:14:38.492813+0000","last_became_peered":"2024-09-21T03:14:38.492813+0000","last_unstale":"2024-09-21T03:24:32.240443+0000","last_undegraded":"2024-09-21T03:24:32.240443+0000","last_fullsized":"2024-09-21T03:24:32.240443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2520,"log_dups_size":0,"ondisk_log_size":2520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:55.064844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37062,"num_write_kb":456367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"27'2959","reported_seq":2980,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.443568+0000","last_change":"2024-09-21T03:14:47.544806+0000","last_active":"2024-09-21T03:24:32.443568+0000","last_peered":"2024-09-21T03:24:32.443568+0000","last_clean":"2024-09-21T03:24:32.443568+0000","last_became_active":"2024-09-21T03:14:47.544431+0000","last_became_peered":"2024-09-21T03:14:47.544431+0000","last_unstale":"2024-09-21T03:24:32.443568+0000","last_undegraded":"2024-09-21T03:24:32.443568+0000","last_fullsized":"2024-09-21T03:24:32.443568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2959,"log_dups_size":0,"ondisk_log_size":2959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:01.463573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43240,"num_write_kb":437209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"27'3812","reported_seq":3841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.129705+0000","last_change":"2024-09-21T03:14:38.474462+0000","last_active":"2024-09-21T03:24:32.129705+0000","last_peered":"2024-09-21T03:24:32.129705+0000","last_clean":"2024-09-21T03:24:32.129705+0000","last_became_active":"2024-09-21T03:14:38.474156+0000","last_became_peered":"2024-09-21T03:14:38.474156+0000","last_unstale":"2024-09-21T03:24:32.129705+0000","last_undegraded":"2024-09-21T03:24:32.129705+0000","last_fullsized":"2024-09-21T03:24:32.129705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3812,"log_dups_size":0,"ondisk_log_size":3812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:55.329945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56526,"num_write_kb":700246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"27'3385","reported_seq":3406,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.368613+0000","last_change":"2024-09-21T03:14:47.563297+0000","last_active":"2024-09-21T03:24:45.368613+0000","last_peered":"2024-09-21T03:24:45.368613+0000","last_clean":"2024-09-21T03:24:45.368613+0000","last_became_active":"2024-09-21T03:14:47.562519+0000","last_became_peered":"2024-09-21T03:14:47.562519+0000","last_unstale":"2024-09-21T03:24:45.368613+0000","last_undegraded":"2024-09-21T03:24:45.368613+0000","last_fullsized":"2024-09-21T03:24:45.368613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3385,"log_dups_size":0,"ondisk_log_size":3385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:47.959373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49240,"num_write_kb":516390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"27'2612","reported_seq":2641,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.135783+0000","last_change":"2024-09-21T03:14:38.474262+0000","last_active":"2024-09-21T03:24:32.135783+0000","last_peered":"2024-09-21T03:24:32.135783+0000","last_clean":"2024-09-21T03:24:32.135783+0000","last_became_active":"2024-09-21T03:14:38.473856+0000","last_became_peered":"2024-09-21T03:14:38.473856+0000","last_unstale":"2024-09-21T03:24:32.135783+0000","last_undegraded":"2024-09-21T03:24:32.135783+0000","last_fullsized":"2024-09-21T03:24:32.135783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2612,"log_dups_size":0,"ondisk_log_size":2612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38668,"num_write_kb":516995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"27'3697","reported_seq":3718,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.352816+0000","last_change":"2024-09-21T03:14:47.558732+0000","last_active":"2024-09-21T03:24:45.352816+0000","last_peered":"2024-09-21T03:24:45.352816+0000","last_clean":"2024-09-21T03:24:45.352816+0000","last_became_active":"2024-09-21T03:14:47.558403+0000","last_became_peered":"2024-09-21T03:14:47.558403+0000","last_unstale":"2024-09-21T03:24:45.352816+0000","last_undegraded":"2024-09-21T03:24:45.352816+0000","last_fullsized":"2024-09-21T03:24:45.352816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3697,"log_dups_size":0,"ondisk_log_size":3697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:46.054565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53973,"num_write_kb":552799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"27'3262","reported_seq":3291,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.523225+0000","last_change":"2024-09-21T03:14:38.469736+0000","last_active":"2024-09-21T03:24:44.523225+0000","last_peered":"2024-09-21T03:24:44.523225+0000","last_clean":"2024-09-21T03:24:44.523225+0000","last_became_active":"2024-09-21T03:14:38.469240+0000","last_became_peered":"2024-09-21T03:14:38.469240+0000","last_unstale":"2024-09-21T03:24:44.523225+0000","last_undegraded":"2024-09-21T03:24:44.523225+0000","last_fullsized":"2024-09-21T03:24:44.523225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3262,"log_dups_size":0,"ondisk_log_size":3262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:04.258761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48009,"num_write_kb":600153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"27'2369","reported_seq":2390,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.327627+0000","last_change":"2024-09-21T03:14:47.550684+0000","last_active":"2024-09-21T03:24:45.327627+0000","last_peered":"2024-09-21T03:24:45.327627+0000","last_clean":"2024-09-21T03:24:45.327627+0000","last_became_active":"2024-09-21T03:14:47.550375+0000","last_became_peered":"2024-09-21T03:14:47.550375+0000","last_unstale":"2024-09-21T03:24:45.327627+0000","last_undegraded":"2024-09-21T03:24:45.327627+0000","last_fullsized":"2024-09-21T03:24:45.327627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2369,"log_dups_size":0,"ondisk_log_size":2369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:05.268160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34335,"num_write_kb":360179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'3448","reported_seq":3477,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.462241+0000","last_change":"2024-09-21T03:14:38.487983+0000","last_active":"2024-09-21T03:24:44.462241+0000","last_peered":"2024-09-21T03:24:44.462241+0000","last_clean":"2024-09-21T03:24:44.462241+0000","last_became_active":"2024-09-21T03:14:38.487676+0000","last_became_peered":"2024-09-21T03:14:38.487676+0000","last_unstale":"2024-09-21T03:24:44.462241+0000","last_undegraded":"2024-09-21T03:24:44.462241+0000","last_fullsized":"2024-09-21T03:24:44.462241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3448,"log_dups_size":0,"ondisk_log_size":3448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:35.320169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50832,"num_write_kb":624952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"27'2804","reported_seq":2831,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.490480+0000","last_change":"2024-09-21T03:19:03.558582+0000","last_active":"2024-09-21T03:24:32.490480+0000","last_peered":"2024-09-21T03:24:32.490480+0000","last_clean":"2024-09-21T03:24:32.490480+0000","last_became_active":"2024-09-21T03:14:47.561229+0000","last_became_peered":"2024-09-21T03:14:47.561229+0000","last_unstale":"2024-09-21T03:24:32.490480+0000","last_undegraded":"2024-09-21T03:24:32.490480+0000","last_fullsized":"2024-09-21T03:24:32.490480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2804,"log_dups_size":0,"ondisk_log_size":2804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:07.280356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40720,"num_write_kb":419729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"27'2665","reported_seq":2689,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.480308+0000","last_change":"2024-09-21T03:14:38.478853+0000","last_active":"2024-09-21T03:24:44.480308+0000","last_peered":"2024-09-21T03:24:44.480308+0000","last_clean":"2024-09-21T03:24:44.480308+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:24:44.480308+0000","last_undegraded":"2024-09-21T03:24:44.480308+0000","last_fullsized":"2024-09-21T03:24:44.480308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2665,"log_dups_size":0,"ondisk_log_size":2665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:31.427596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39018,"num_write_kb":519966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"27'3111","reported_seq":3126,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.629652+0000","last_change":"2024-09-21T03:15:15.686915+0000","last_active":"2024-09-21T03:24:32.629652+0000","last_peered":"2024-09-21T03:24:32.629652+0000","last_clean":"2024-09-21T03:24:32.629652+0000","last_became_active":"2024-09-21T03:15:15.686514+0000","last_became_peered":"2024-09-21T03:15:15.686514+0000","last_unstale":"2024-09-21T03:24:32.629652+0000","last_undegraded":"2024-09-21T03:24:32.629652+0000","last_fullsized":"2024-09-21T03:24:32.629652+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3111,"log_dups_size":0,"ondisk_log_size":3111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:46.388388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45367,"num_write_kb":462728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'2758","reported_seq":2787,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.545827+0000","last_change":"2024-09-21T03:14:38.481308+0000","last_active":"2024-09-21T03:24:44.545827+0000","last_peered":"2024-09-21T03:24:44.545827+0000","last_clean":"2024-09-21T03:24:44.545827+0000","last_became_active":"2024-09-21T03:14:38.480923+0000","last_became_peered":"2024-09-21T03:14:38.480923+0000","last_unstale":"2024-09-21T03:24:44.545827+0000","last_undegraded":"2024-09-21T03:24:44.545827+0000","last_fullsized":"2024-09-21T03:24:44.545827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2758,"log_dups_size":0,"ondisk_log_size":2758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:40.689231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40836,"num_write_kb":498819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"27'2747","reported_seq":2768,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.606907+0000","last_change":"2024-09-21T03:14:47.561972+0000","last_active":"2024-09-21T03:24:32.606907+0000","last_peered":"2024-09-21T03:24:32.606907+0000","last_clean":"2024-09-21T03:24:32.606907+0000","last_became_active":"2024-09-21T03:14:47.561645+0000","last_became_peered":"2024-09-21T03:14:47.561645+0000","last_unstale":"2024-09-21T03:24:32.606907+0000","last_undegraded":"2024-09-21T03:24:32.606907+0000","last_fullsized":"2024-09-21T03:24:32.606907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2747,"log_dups_size":0,"ondisk_log_size":2747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:57.526787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40136,"num_write_kb":410250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"27'2791","reported_seq":2820,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.537487+0000","last_change":"2024-09-21T03:14:38.473907+0000","last_active":"2024-09-21T03:24:44.537487+0000","last_peered":"2024-09-21T03:24:44.537487+0000","last_clean":"2024-09-21T03:24:44.537487+0000","last_became_active":"2024-09-21T03:14:38.473579+0000","last_became_peered":"2024-09-21T03:14:38.473579+0000","last_unstale":"2024-09-21T03:24:44.537487+0000","last_undegraded":"2024-09-21T03:24:44.537487+0000","last_fullsized":"2024-09-21T03:24:44.537487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2791,"log_dups_size":0,"ondisk_log_size":2791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:32.273503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41232,"num_write_kb":540257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"27'2612","reported_seq":2633,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.554999+0000","last_change":"2024-09-21T03:14:47.566089+0000","last_active":"2024-09-21T03:24:32.554999+0000","last_peered":"2024-09-21T03:24:32.554999+0000","last_clean":"2024-09-21T03:24:32.554999+0000","last_became_active":"2024-09-21T03:14:47.565681+0000","last_became_peered":"2024-09-21T03:14:47.565681+0000","last_unstale":"2024-09-21T03:24:32.554999+0000","last_undegraded":"2024-09-21T03:24:32.554999+0000","last_fullsized":"2024-09-21T03:24:32.554999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2612,"log_dups_size":0,"ondisk_log_size":2612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.208933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37892,"num_write_kb":397863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'3465","reported_seq":3494,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.561747+0000","last_change":"2024-09-21T03:14:38.474326+0000","last_active":"2024-09-21T03:24:44.561747+0000","last_peered":"2024-09-21T03:24:44.561747+0000","last_clean":"2024-09-21T03:24:44.561747+0000","last_became_active":"2024-09-21T03:14:38.470430+0000","last_became_peered":"2024-09-21T03:14:38.470430+0000","last_unstale":"2024-09-21T03:24:44.561747+0000","last_undegraded":"2024-09-21T03:24:44.561747+0000","last_fullsized":"2024-09-21T03:24:44.561747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3465,"log_dups_size":0,"ondisk_log_size":3465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:09.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51200,"num_write_kb":673726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"27'2988","reported_seq":3009,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.590714+0000","last_change":"2024-09-21T03:14:47.571487+0000","last_active":"2024-09-21T03:24:32.590714+0000","last_peered":"2024-09-21T03:24:32.590714+0000","last_clean":"2024-09-21T03:24:32.590714+0000","last_became_active":"2024-09-21T03:14:47.571126+0000","last_became_peered":"2024-09-21T03:14:47.571126+0000","last_unstale":"2024-09-21T03:24:32.590714+0000","last_undegraded":"2024-09-21T03:24:32.590714+0000","last_fullsized":"2024-09-21T03:24:32.590714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2988,"log_dups_size":0,"ondisk_log_size":2988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:57.128853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43649,"num_write_kb":455041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'4015","reported_seq":4044,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.555332+0000","last_change":"2024-09-21T03:14:38.483370+0000","last_active":"2024-09-21T03:24:44.555332+0000","last_peered":"2024-09-21T03:24:44.555332+0000","last_clean":"2024-09-21T03:24:44.555332+0000","last_became_active":"2024-09-21T03:14:38.483019+0000","last_became_peered":"2024-09-21T03:14:38.483019+0000","last_unstale":"2024-09-21T03:24:44.555332+0000","last_undegraded":"2024-09-21T03:24:44.555332+0000","last_fullsized":"2024-09-21T03:24:44.555332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:55.085422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59359,"num_write_kb":743455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"27'3951","reported_seq":3972,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.348230+0000","last_change":"2024-09-21T03:14:47.555777+0000","last_active":"2024-09-21T03:24:45.348230+0000","last_peered":"2024-09-21T03:24:45.348230+0000","last_clean":"2024-09-21T03:24:45.348230+0000","last_became_active":"2024-09-21T03:14:47.555465+0000","last_became_peered":"2024-09-21T03:14:47.555465+0000","last_unstale":"2024-09-21T03:24:45.348230+0000","last_undegraded":"2024-09-21T03:24:45.348230+0000","last_fullsized":"2024-09-21T03:24:45.348230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3951,"log_dups_size":0,"ondisk_log_size":3951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:27.123740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57951,"num_write_kb":584164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"27'3369","reported_seq":3398,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.537637+0000","last_change":"2024-09-21T03:14:38.465771+0000","last_active":"2024-09-21T03:24:44.537637+0000","last_peered":"2024-09-21T03:24:44.537637+0000","last_clean":"2024-09-21T03:24:44.537637+0000","last_became_active":"2024-09-21T03:14:38.465479+0000","last_became_peered":"2024-09-21T03:14:38.465479+0000","last_unstale":"2024-09-21T03:24:44.537637+0000","last_undegraded":"2024-09-21T03:24:44.537637+0000","last_fullsized":"2024-09-21T03:24:44.537637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3369,"log_dups_size":0,"ondisk_log_size":3369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.754315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50038,"num_write_kb":621750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"27'2525","reported_seq":2546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.263614+0000","last_change":"2024-09-21T03:14:47.567695+0000","last_active":"2024-09-21T03:24:45.263614+0000","last_peered":"2024-09-21T03:24:45.263614+0000","last_clean":"2024-09-21T03:24:45.263614+0000","last_became_active":"2024-09-21T03:14:47.566936+0000","last_became_peered":"2024-09-21T03:14:47.566936+0000","last_unstale":"2024-09-21T03:24:45.263614+0000","last_undegraded":"2024-09-21T03:24:45.263614+0000","last_fullsized":"2024-09-21T03:24:45.263614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2525,"log_dups_size":0,"ondisk_log_size":2525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:48.182523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36538,"num_write_kb":381931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"27'2953","reported_seq":2967,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.268218+0000","last_change":"2024-09-21T03:15:15.807206+0000","last_active":"2024-09-21T03:24:32.268218+0000","last_peered":"2024-09-21T03:24:32.268218+0000","last_clean":"2024-09-21T03:24:32.268218+0000","last_became_active":"2024-09-21T03:15:15.806775+0000","last_became_peered":"2024-09-21T03:15:15.806775+0000","last_unstale":"2024-09-21T03:24:32.268218+0000","last_undegraded":"2024-09-21T03:24:32.268218+0000","last_fullsized":"2024-09-21T03:24:32.268218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2953,"log_dups_size":0,"ondisk_log_size":2953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:51.779236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43828,"num_write_kb":561683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"27'2681","reported_seq":2702,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.331920+0000","last_change":"2024-09-21T03:14:47.580314+0000","last_active":"2024-09-21T03:24:45.331920+0000","last_peered":"2024-09-21T03:24:45.331920+0000","last_clean":"2024-09-21T03:24:45.331920+0000","last_became_active":"2024-09-21T03:14:47.576499+0000","last_became_peered":"2024-09-21T03:14:47.576499+0000","last_unstale":"2024-09-21T03:24:45.331920+0000","last_undegraded":"2024-09-21T03:24:45.331920+0000","last_fullsized":"2024-09-21T03:24:45.331920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2681,"log_dups_size":0,"ondisk_log_size":2681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:46.154586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39028,"num_write_kb":398421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2546","reported_seq":2577,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.467976+0000","last_change":"2024-09-21T03:18:52.426898+0000","last_active":"2024-09-21T03:24:44.467976+0000","last_peered":"2024-09-21T03:24:44.467976+0000","last_clean":"2024-09-21T03:24:44.467976+0000","last_became_active":"2024-09-21T03:14:38.470708+0000","last_became_peered":"2024-09-21T03:14:38.470708+0000","last_unstale":"2024-09-21T03:24:44.467976+0000","last_undegraded":"2024-09-21T03:24:44.467976+0000","last_fullsized":"2024-09-21T03:24:44.467976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2546,"log_dups_size":0,"ondisk_log_size":2546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.122804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37433,"num_write_kb":500133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"27'3017","reported_seq":3038,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.328059+0000","last_change":"2024-09-21T03:14:47.554180+0000","last_active":"2024-09-21T03:24:45.328059+0000","last_peered":"2024-09-21T03:24:45.328059+0000","last_clean":"2024-09-21T03:24:45.328059+0000","last_became_active":"2024-09-21T03:14:47.552808+0000","last_became_peered":"2024-09-21T03:14:47.552808+0000","last_unstale":"2024-09-21T03:24:45.328059+0000","last_undegraded":"2024-09-21T03:24:45.328059+0000","last_fullsized":"2024-09-21T03:24:45.328059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3017,"log_dups_size":0,"ondisk_log_size":3017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:07.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43808,"num_write_kb":448579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"27'3592","reported_seq":3621,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.559429+0000","last_change":"2024-09-21T03:14:38.466077+0000","last_active":"2024-09-21T03:24:44.559429+0000","last_peered":"2024-09-21T03:24:44.559429+0000","last_clean":"2024-09-21T03:24:44.559429+0000","last_became_active":"2024-09-21T03:14:38.465818+0000","last_became_peered":"2024-09-21T03:14:38.465818+0000","last_unstale":"2024-09-21T03:24:44.559429+0000","last_undegraded":"2024-09-21T03:24:44.559429+0000","last_fullsized":"2024-09-21T03:24:44.559429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:34.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52996,"num_write_kb":671880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"27'2557","reported_seq":2577,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.462202+0000","last_change":"2024-09-21T03:14:47.577228+0000","last_active":"2024-09-21T03:24:32.462202+0000","last_peered":"2024-09-21T03:24:32.462202+0000","last_clean":"2024-09-21T03:24:32.462202+0000","last_became_active":"2024-09-21T03:14:47.576843+0000","last_became_peered":"2024-09-21T03:14:47.576843+0000","last_unstale":"2024-09-21T03:24:32.462202+0000","last_undegraded":"2024-09-21T03:24:32.462202+0000","last_fullsized":"2024-09-21T03:24:32.462202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2557,"log_dups_size":0,"ondisk_log_size":2557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:56.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37386,"num_write_kb":384305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'2860","reported_seq":2889,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.484484+0000","last_change":"2024-09-21T03:14:38.481389+0000","last_active":"2024-09-21T03:24:44.484484+0000","last_peered":"2024-09-21T03:24:44.484484+0000","last_clean":"2024-09-21T03:24:44.484484+0000","last_became_active":"2024-09-21T03:14:38.470907+0000","last_became_peered":"2024-09-21T03:14:38.470907+0000","last_unstale":"2024-09-21T03:24:44.484484+0000","last_undegraded":"2024-09-21T03:24:44.484484+0000","last_fullsized":"2024-09-21T03:24:44.484484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:30.068915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42241,"num_write_kb":536469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"27'3455","reported_seq":3475,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.317264+0000","last_change":"2024-09-21T03:14:47.551766+0000","last_active":"2024-09-21T03:24:45.317264+0000","last_peered":"2024-09-21T03:24:45.317264+0000","last_clean":"2024-09-21T03:24:45.317264+0000","last_became_active":"2024-09-21T03:14:47.551420+0000","last_became_peered":"2024-09-21T03:14:47.551420+0000","last_unstale":"2024-09-21T03:24:45.317264+0000","last_undegraded":"2024-09-21T03:24:45.317264+0000","last_fullsized":"2024-09-21T03:24:45.317264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3455,"log_dups_size":0,"ondisk_log_size":3455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:56.255472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50161,"num_write_kb":520876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'3215","reported_seq":3246,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.506746+0000","last_change":"2024-09-21T03:19:03.596591+0000","last_active":"2024-09-21T03:24:44.506746+0000","last_peered":"2024-09-21T03:24:44.506746+0000","last_clean":"2024-09-21T03:24:44.506746+0000","last_became_active":"2024-09-21T03:14:38.482306+0000","last_became_peered":"2024-09-21T03:14:38.482306+0000","last_unstale":"2024-09-21T03:24:44.506746+0000","last_undegraded":"2024-09-21T03:24:44.506746+0000","last_fullsized":"2024-09-21T03:24:44.506746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3215,"log_dups_size":0,"ondisk_log_size":3215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:40.482635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47543,"num_write_kb":599147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"27'3010","reported_seq":3031,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.350470+0000","last_change":"2024-09-21T03:14:47.555070+0000","last_active":"2024-09-21T03:24:45.350470+0000","last_peered":"2024-09-21T03:24:45.350470+0000","last_clean":"2024-09-21T03:24:45.350470+0000","last_became_active":"2024-09-21T03:14:47.554363+0000","last_became_peered":"2024-09-21T03:14:47.554363+0000","last_unstale":"2024-09-21T03:24:45.350470+0000","last_undegraded":"2024-09-21T03:24:45.350470+0000","last_fullsized":"2024-09-21T03:24:45.350470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3010,"log_dups_size":0,"ondisk_log_size":3010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:40.027266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43824,"num_write_kb":461158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"27'3736","reported_seq":3765,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.476290+0000","last_change":"2024-09-21T03:14:38.496218+0000","last_active":"2024-09-21T03:24:44.476290+0000","last_peered":"2024-09-21T03:24:44.476290+0000","last_clean":"2024-09-21T03:24:44.476290+0000","last_became_active":"2024-09-21T03:14:38.488537+0000","last_became_peered":"2024-09-21T03:14:38.488537+0000","last_unstale":"2024-09-21T03:24:44.476290+0000","last_undegraded":"2024-09-21T03:24:44.476290+0000","last_fullsized":"2024-09-21T03:24:44.476290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3736,"log_dups_size":0,"ondisk_log_size":3736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:59.667392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55343,"num_write_kb":720948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"27'2851","reported_seq":2871,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.330638+0000","last_change":"2024-09-21T03:14:47.564250+0000","last_active":"2024-09-21T03:24:45.330638+0000","last_peered":"2024-09-21T03:24:45.330638+0000","last_clean":"2024-09-21T03:24:45.330638+0000","last_became_active":"2024-09-21T03:14:47.563745+0000","last_became_peered":"2024-09-21T03:14:47.563745+0000","last_unstale":"2024-09-21T03:24:45.330638+0000","last_undegraded":"2024-09-21T03:24:45.330638+0000","last_fullsized":"2024-09-21T03:24:45.330638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2851,"log_dups_size":0,"ondisk_log_size":2851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:31.282910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41602,"num_write_kb":429183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"27'2879","reported_seq":2908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.572686+0000","last_change":"2024-09-21T03:14:38.490309+0000","last_active":"2024-09-21T03:24:44.572686+0000","last_peered":"2024-09-21T03:24:44.572686+0000","last_clean":"2024-09-21T03:24:44.572686+0000","last_became_active":"2024-09-21T03:14:38.489167+0000","last_became_peered":"2024-09-21T03:14:38.489167+0000","last_unstale":"2024-09-21T03:24:44.572686+0000","last_undegraded":"2024-09-21T03:24:44.572686+0000","last_fullsized":"2024-09-21T03:24:44.572686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:07.725691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42623,"num_write_kb":515303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2771405,"num_write_kb":28539810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190546,"ondisk_log_size":190546,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":104689166,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":31,"num_read_kb":107,"num_write":3090,"num_write_kb":104327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":209436672,"data_stored":209378256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2754,"ondisk_log_size":2754,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2958225,"num_write_kb":37437445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200210,"ondisk_log_size":200210,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":158267982,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":29,"num_read_kb":105,"num_write":2794,"num_write_kb":156528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":316596224,"data_stored":316535791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2584,"ondisk_log_size":2584,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509566,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379144,"kb_used_data":41336,"kb_used_omap":1,"kb_used_meta":337790,"kb_avail":93992696,"statfs":{"total":96636764160,"available":96248520704,"internally_reserved":0,"allocated":42328064,"data_stored":42145705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":345897418},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509562,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":538640,"kb_used_data":66240,"kb_used_omap":1,"kb_used_meta":472382,"kb_avail":93833200,"statfs":{"total":96636764160,"available":96085196800,"internally_reserved":0,"allocated":67829760,"data_stored":67644264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":483719621},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509561,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":562860,"kb_used_data":84892,"kb_used_omap":1,"kb_used_meta":477950,"kb_avail":93808980,"statfs":{"total":96636764160,"available":96060395520,"internally_reserved":0,"allocated":86929408,"data_stored":86733407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":489421253},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509562,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":616200,"kb_used_data":61816,"kb_used_omap":1,"kb_used_meta":554366,"kb_avail":93755640,"statfs":{"total":96636764160,"available":96005775360,"internally_reserved":0,"allocated":63299584,"data_stored":63117886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":567671237},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509565,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468272,"kb_used_data":54112,"kb_used_omap":1,"kb_used_meta":414142,"kb_avail":93903568,"statfs":{"total":96636764160,"available":96157253632,"internally_reserved":0,"allocated":55410688,"data_stored":55230899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":424081861},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509563,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":592432,"kb_used_data":61728,"kb_used_omap":1,"kb_used_meta":530686,"kb_avail":93779408,"statfs":{"total":96636764160,"available":96030113792,"internally_reserved":0,"allocated":63209472,"data_stored":63029145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":543422917},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,1,21],"upper_bound":32},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542267,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":477548,"kb_used_data":45340,"kb_used_omap":1,"kb_used_meta":432190,"kb_avail":93894292,"statfs":{"total":96636764160,"available":96147755008,"internally_reserved":0,"allocated":46428160,"data_stored":46252455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":442563014},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542265,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":583800,"kb_used_data":101608,"kb_used_omap":1,"kb_used_meta":482174,"kb_avail":93788040,"statfs":{"total":96636764160,"available":96038952960,"internally_reserved":0,"allocated":104046592,"data_stored":103856285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":493746631},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":62922752,"data_stored":62914616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33558528,"data_stored":33554502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65908736,"data_stored":65904153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":44949504,"data_stored":44933568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":37847040,"data_stored":37836908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25264128,"data_stored":25254028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37842944,"data_stored":37836951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37855232,"data_stored":37837693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":41697280,"data_stored":41685573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29106176,"data_stored":29102625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:24:47.276 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T03:24:47.276 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:24:47.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.529+0000 7fc076c00640 1 -- 172.21.15.90:0/1359122267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc070074220 msgr2=0x7fc070074630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:47.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.529+0000 7fc076c00640 1 --2- 172.21.15.90:0/1359122267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc070074220 0x7fc070074630 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc068009830 tx=0x7fc06802a530 comp rx=0 tx=0).stop 2024-09-21T03:24:47.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.529+0000 7fc076c00640 1 -- 172.21.15.90:0/1359122267 shutdown_connections 2024-09-21T03:24:47.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.529+0000 7fc076c00640 1 --2- 172.21.15.90:0/1359122267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc070074220 0x7fc070074630 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.529+0000 7fc076c00640 1 -- 172.21.15.90:0/1359122267 >> 172.21.15.90:0/1359122267 conn(0x7fc0700c8ba0 msgr2=0x7fc07006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:47.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.529+0000 7fc076c00640 1 -- 172.21.15.90:0/1359122267 shutdown_connections 2024-09-21T03:24:47.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.529+0000 7fc076c00640 1 -- 172.21.15.90:0/1359122267 wait complete. 2024-09-21T03:24:47.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.531+0000 7fc076c00640 1 Processor -- start 2024-09-21T03:24:47.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.531+0000 7fc076c00640 1 -- start start 2024-09-21T03:24:47.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.532+0000 7fc076c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07006d960 0x7fc07014d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:47.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.533+0000 7fc076c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc070074220 0x7fc070155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:47.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.533+0000 7fc076c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0700ac350 0x7fc070157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:47.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.533+0000 7fc076c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc0700ace70 con 0x7fc0700ac350 2024-09-21T03:24:47.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.533+0000 7fc076c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc0700abec0 con 0x7fc07006d960 2024-09-21T03:24:47.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.533+0000 7fc076c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc0700acff0 con 0x7fc070074220 2024-09-21T03:24:47.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.533+0000 7fc074c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0700ac350 0x7fc070157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:47.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.533+0000 7fc074c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0700ac350 0x7fc070157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35242/0 (socket says 172.21.15.90:35242) 2024-09-21T03:24:47.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.533+0000 7fc074c00640 1 -- 172.21.15.90:0/364517582 learned_addr learned my addr 172.21.15.90:0/364517582 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:47.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.533+0000 7fc06fe00640 1 --2- 172.21.15.90:0/364517582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07006d960 0x7fc07014d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:47.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.533+0000 7fc067400640 1 --2- 172.21.15.90:0/364517582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc070074220 0x7fc070155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:47.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.533+0000 7fc074c00640 1 -- 172.21.15.90:0/364517582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc070074220 msgr2=0x7fc070155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:47.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.533+0000 7fc074c00640 1 --2- 172.21.15.90:0/364517582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc070074220 0x7fc070155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.533+0000 7fc074c00640 1 -- 172.21.15.90:0/364517582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07006d960 msgr2=0x7fc07014d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:47.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.533+0000 7fc074c00640 1 --2- 172.21.15.90:0/364517582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07006d960 0x7fc07014d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.533+0000 7fc074c00640 1 -- 172.21.15.90:0/364517582 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07014c580 con 0x7fc0700ac350 2024-09-21T03:24:47.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.533+0000 7fc06fe00640 1 --2- 172.21.15.90:0/364517582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07006d960 0x7fc07014d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:47.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.534+0000 7fc074c00640 1 --2- 172.21.15.90:0/364517582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0700ac350 0x7fc070157c00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc068009920 tx=0x7fc068033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:47.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.534+0000 7fc06cc00640 1 -- 172.21.15.90:0/364517582 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc068005c90 con 0x7fc0700ac350 2024-09-21T03:24:47.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.534+0000 7fc06cc00640 1 -- 172.21.15.90:0/364517582 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc068031e50 con 0x7fc0700ac350 2024-09-21T03:24:47.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.534+0000 7fc076c00640 1 -- 172.21.15.90:0/364517582 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc070158a50 con 0x7fc0700ac350 2024-09-21T03:24:47.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.534+0000 7fc06cc00640 1 -- 172.21.15.90:0/364517582 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc068005260 con 0x7fc0700ac350 2024-09-21T03:24:47.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.534+0000 7fc076c00640 1 -- 172.21.15.90:0/364517582 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc07014c840 con 0x7fc0700ac350 2024-09-21T03:24:47.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.535+0000 7fc076c00640 1 -- 172.21.15.90:0/364517582 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc070074ce0 con 0x7fc0700ac350 2024-09-21T03:24:47.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.536+0000 7fc06cc00640 1 -- 172.21.15.90:0/364517582 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc068005400 con 0x7fc0700ac350 2024-09-21T03:24:47.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.537+0000 7fc06cc00640 1 --2- 172.21.15.90:0/364517582 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc04c078bc0 0x7fc04c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:47.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.537+0000 7fc06cc00640 1 -- 172.21.15.90:0/364517582 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fc0680bc020 con 0x7fc0700ac350 2024-09-21T03:24:47.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.538+0000 7fc06fe00640 1 --2- 172.21.15.90:0/364517582 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc04c078bc0 0x7fc04c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:47.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.538+0000 7fc06fe00640 1 --2- 172.21.15.90:0/364517582 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc04c078bc0 0x7fc04c07b0d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc0600017a0 tx=0x7fc060009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:47.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.542+0000 7fc06cc00640 1 -- 172.21.15.90:0/364517582 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc06803f030 con 0x7fc0700ac350 2024-09-21T03:24:47.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.726+0000 7fc076c00640 1 -- 172.21.15.90:0/364517582 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0700ad550 con 0x7fc04c078bc0 2024-09-21T03:24:47.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.736+0000 7fc06cc00640 1 -- 172.21.15.90:0/364517582 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+494117 (secure 0 0 0) 0x7fc0700ad550 con 0x7fc04c078bc0 2024-09-21T03:24:47.743 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:24:47.746 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-21T03:24:47.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.741+0000 7fc076c00640 1 -- 172.21.15.90:0/364517582 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc04c078bc0 msgr2=0x7fc04c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:47.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.741+0000 7fc076c00640 1 --2- 172.21.15.90:0/364517582 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc04c078bc0 0x7fc04c07b0d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc0600017a0 tx=0x7fc060009040 comp rx=0 tx=0).stop 2024-09-21T03:24:47.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.741+0000 7fc076c00640 1 -- 172.21.15.90:0/364517582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0700ac350 msgr2=0x7fc070157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:47.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.741+0000 7fc076c00640 1 --2- 172.21.15.90:0/364517582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0700ac350 0x7fc070157c00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc068009920 tx=0x7fc068033c20 comp rx=0 tx=0).stop 2024-09-21T03:24:47.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.741+0000 7fc076c00640 1 -- 172.21.15.90:0/364517582 shutdown_connections 2024-09-21T03:24:47.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.741+0000 7fc076c00640 1 --2- 172.21.15.90:0/364517582 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc04c078bc0 0x7fc04c07b0d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.741+0000 7fc076c00640 1 --2- 172.21.15.90:0/364517582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0700ac350 0x7fc070157c00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.741+0000 7fc076c00640 1 --2- 172.21.15.90:0/364517582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc070074220 0x7fc070155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.741+0000 7fc076c00640 1 --2- 172.21.15.90:0/364517582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07006d960 0x7fc07014d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.741+0000 7fc076c00640 1 -- 172.21.15.90:0/364517582 >> 172.21.15.90:0/364517582 conn(0x7fc0700c8ba0 msgr2=0x7fc0700c42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:47.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.741+0000 7fc076c00640 1 -- 172.21.15.90:0/364517582 shutdown_connections 2024-09-21T03:24:47.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:47.741+0000 7fc076c00640 1 -- 172.21.15.90:0/364517582 wait complete. 2024-09-21T03:24:47.768 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-09-21T03:24:46.748509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":263547516,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":126,"num_read_kb":267,"num_write":5735615,"num_write_kb":66239738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":396166,"ondisk_log_size":396166,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4218896,"kb_used_data":517072,"kb_used_omap":12,"kb_used_meta":3701683,"kb_avail":750755824,"statfs":{"total":773094113280,"available":768773963776,"internally_reserved":0,"allocated":529481728,"data_stored":528010046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":3790523952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,1,21],"upper_bound":32},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2661937050,"num_objects":-894,"num_object_clones":0,"num_object_copies":-1788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-894,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":916,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004531"},"pg_stats":[{"pgid":"5.18","version":"27'2955","reported_seq":2976,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.324436+0000","last_change":"2024-09-21T03:14:47.552762+0000","last_active":"2024-09-21T03:24:45.324436+0000","last_peered":"2024-09-21T03:24:45.324436+0000","last_clean":"2024-09-21T03:24:45.324436+0000","last_became_active":"2024-09-21T03:14:47.551883+0000","last_became_peered":"2024-09-21T03:14:47.551883+0000","last_unstale":"2024-09-21T03:24:45.324436+0000","last_undegraded":"2024-09-21T03:24:45.324436+0000","last_fullsized":"2024-09-21T03:24:45.324436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2955,"log_dups_size":0,"ondisk_log_size":2955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:51.935797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42893,"num_write_kb":435375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"27'181","reported_seq":212,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.778805+0000","last_change":"2024-09-21T03:14:37.471004+0000","last_active":"2024-09-21T03:24:32.778805+0000","last_peered":"2024-09-21T03:24:32.778805+0000","last_clean":"2024-09-21T03:24:32.778805+0000","last_became_active":"2024-09-21T03:14:37.470563+0000","last_became_peered":"2024-09-21T03:14:37.470563+0000","last_unstale":"2024-09-21T03:24:32.778805+0000","last_undegraded":"2024-09-21T03:24:32.778805+0000","last_fullsized":"2024-09-21T03:24:32.778805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.422826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7184070,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":7087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'3329","reported_seq":3358,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.558550+0000","last_change":"2024-09-21T03:14:38.496252+0000","last_active":"2024-09-21T03:24:44.558550+0000","last_peered":"2024-09-21T03:24:44.558550+0000","last_clean":"2024-09-21T03:24:44.558550+0000","last_became_active":"2024-09-21T03:14:38.488292+0000","last_became_peered":"2024-09-21T03:14:38.488292+0000","last_unstale":"2024-09-21T03:24:44.558550+0000","last_undegraded":"2024-09-21T03:24:44.558550+0000","last_fullsized":"2024-09-21T03:24:44.558550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3329,"log_dups_size":0,"ondisk_log_size":3329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:57.409792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49408,"num_write_kb":622324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.561928+0000","last_change":"2024-09-21T03:14:46.549877+0000","last_active":"2024-09-21T03:24:32.561928+0000","last_peered":"2024-09-21T03:24:32.561928+0000","last_clean":"2024-09-21T03:24:32.561928+0000","last_became_active":"2024-09-21T03:14:46.549536+0000","last_became_peered":"2024-09-21T03:14:46.549536+0000","last_unstale":"2024-09-21T03:24:32.561928+0000","last_undegraded":"2024-09-21T03:24:32.561928+0000","last_fullsized":"2024-09-21T03:24:32.561928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:57.491042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"27'3462","reported_seq":3483,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.343242+0000","last_change":"2024-09-21T03:14:47.560303+0000","last_active":"2024-09-21T03:24:45.343242+0000","last_peered":"2024-09-21T03:24:45.343242+0000","last_clean":"2024-09-21T03:24:45.343242+0000","last_became_active":"2024-09-21T03:14:47.559659+0000","last_became_peered":"2024-09-21T03:14:47.559659+0000","last_unstale":"2024-09-21T03:24:45.343242+0000","last_undegraded":"2024-09-21T03:24:45.343242+0000","last_fullsized":"2024-09-21T03:24:45.343242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3462,"log_dups_size":0,"ondisk_log_size":3462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:49.328036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50427,"num_write_kb":517490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"27'10","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.175109+0000","last_change":"2024-09-21T03:14:37.467448+0000","last_active":"2024-09-21T03:24:32.175109+0000","last_peered":"2024-09-21T03:24:32.175109+0000","last_clean":"2024-09-21T03:24:32.175109+0000","last_became_active":"2024-09-21T03:14:37.467146+0000","last_became_peered":"2024-09-21T03:14:37.467146+0000","last_unstale":"2024-09-21T03:24:32.175109+0000","last_undegraded":"2024-09-21T03:24:32.175109+0000","last_fullsized":"2024-09-21T03:24:32.175109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:53.475083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'3692","reported_seq":3721,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.533568+0000","last_change":"2024-09-21T03:14:38.486401+0000","last_active":"2024-09-21T03:24:44.533568+0000","last_peered":"2024-09-21T03:24:44.533568+0000","last_clean":"2024-09-21T03:24:44.533568+0000","last_became_active":"2024-09-21T03:14:38.486090+0000","last_became_peered":"2024-09-21T03:14:38.486090+0000","last_unstale":"2024-09-21T03:24:44.533568+0000","last_undegraded":"2024-09-21T03:24:44.533568+0000","last_fullsized":"2024-09-21T03:24:44.533568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3692,"log_dups_size":0,"ondisk_log_size":3692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:44.085100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54471,"num_write_kb":691181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'47","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.589575+0000","last_change":"2024-09-21T03:14:46.541705+0000","last_active":"2024-09-21T03:24:32.589575+0000","last_peered":"2024-09-21T03:24:32.589575+0000","last_clean":"2024-09-21T03:24:32.589575+0000","last_became_active":"2024-09-21T03:14:46.541357+0000","last_became_peered":"2024-09-21T03:14:46.541357+0000","last_unstale":"2024-09-21T03:24:32.589575+0000","last_undegraded":"2024-09-21T03:24:32.589575+0000","last_fullsized":"2024-09-21T03:24:32.589575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:31.082059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":8225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"27'2623","reported_seq":2646,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.346234+0000","last_change":"2024-09-21T03:18:52.567667+0000","last_active":"2024-09-21T03:24:45.346234+0000","last_peered":"2024-09-21T03:24:45.346234+0000","last_clean":"2024-09-21T03:24:45.346234+0000","last_became_active":"2024-09-21T03:14:47.553312+0000","last_became_peered":"2024-09-21T03:14:47.553312+0000","last_unstale":"2024-09-21T03:24:45.346234+0000","last_undegraded":"2024-09-21T03:24:45.346234+0000","last_fullsized":"2024-09-21T03:24:45.346234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2623,"log_dups_size":0,"ondisk_log_size":2623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:07.314491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37737,"num_write_kb":383006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"27'42","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.212295+0000","last_change":"2024-09-21T03:14:37.478711+0000","last_active":"2024-09-21T03:24:32.212295+0000","last_peered":"2024-09-21T03:24:32.212295+0000","last_clean":"2024-09-21T03:24:32.212295+0000","last_became_active":"2024-09-21T03:14:37.477910+0000","last_became_peered":"2024-09-21T03:14:37.477910+0000","last_unstale":"2024-09-21T03:24:32.212295+0000","last_undegraded":"2024-09-21T03:24:32.212295+0000","last_fullsized":"2024-09-21T03:24:32.212295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:40.166966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2285","reported_seq":2314,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.467936+0000","last_change":"2024-09-21T03:14:38.472992+0000","last_active":"2024-09-21T03:24:44.467936+0000","last_peered":"2024-09-21T03:24:44.467936+0000","last_clean":"2024-09-21T03:24:44.467936+0000","last_became_active":"2024-09-21T03:14:38.472426+0000","last_became_peered":"2024-09-21T03:14:38.472426+0000","last_unstale":"2024-09-21T03:24:44.467936+0000","last_undegraded":"2024-09-21T03:24:44.467936+0000","last_fullsized":"2024-09-21T03:24:44.467936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2285,"log_dups_size":0,"ondisk_log_size":2285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:36.825612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33481,"num_write_kb":420875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1061","reported_seq":1083,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:22:20.318571+0000","last_change":"2024-09-21T03:14:46.526996+0000","last_active":"2024-09-21T03:22:20.318571+0000","last_peered":"2024-09-21T03:22:20.318571+0000","last_clean":"2024-09-21T03:22:20.318571+0000","last_became_active":"2024-09-21T03:14:46.525587+0000","last_became_peered":"2024-09-21T03:14:46.525587+0000","last_unstale":"2024-09-21T03:22:20.318571+0000","last_undegraded":"2024-09-21T03:22:20.318571+0000","last_fullsized":"2024-09-21T03:22:20.318571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1061,"log_dups_size":0,"ondisk_log_size":1061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:56.977126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1059,"num_write_kb":5042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"27'2269","reported_seq":2289,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.309856+0000","last_change":"2024-09-21T03:14:47.554143+0000","last_active":"2024-09-21T03:24:45.309856+0000","last_peered":"2024-09-21T03:24:45.309856+0000","last_clean":"2024-09-21T03:24:45.309856+0000","last_became_active":"2024-09-21T03:14:47.553802+0000","last_became_peered":"2024-09-21T03:14:47.553802+0000","last_unstale":"2024-09-21T03:24:45.309856+0000","last_undegraded":"2024-09-21T03:24:45.309856+0000","last_fullsized":"2024-09-21T03:24:45.309856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2269,"log_dups_size":0,"ondisk_log_size":2269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:37.963442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32861,"num_write_kb":341635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'13","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.222962+0000","last_change":"2024-09-21T03:14:37.479842+0000","last_active":"2024-09-21T03:24:32.222962+0000","last_peered":"2024-09-21T03:24:32.222962+0000","last_clean":"2024-09-21T03:24:32.222962+0000","last_became_active":"2024-09-21T03:14:37.478893+0000","last_became_peered":"2024-09-21T03:14:37.478893+0000","last_unstale":"2024-09-21T03:24:32.222962+0000","last_undegraded":"2024-09-21T03:24:32.222962+0000","last_fullsized":"2024-09-21T03:24:32.222962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:27.916133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'3847","reported_seq":3875,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.146830+0000","last_change":"2024-09-21T03:14:38.468756+0000","last_active":"2024-09-21T03:24:32.146830+0000","last_peered":"2024-09-21T03:24:32.146830+0000","last_clean":"2024-09-21T03:24:32.146830+0000","last_became_active":"2024-09-21T03:14:38.467570+0000","last_became_peered":"2024-09-21T03:14:38.467570+0000","last_unstale":"2024-09-21T03:24:32.146830+0000","last_undegraded":"2024-09-21T03:24:32.146830+0000","last_fullsized":"2024-09-21T03:24:32.146830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3847,"log_dups_size":0,"ondisk_log_size":3847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:24.784157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57219,"num_write_kb":702431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'50","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.617288+0000","last_change":"2024-09-21T03:14:46.529932+0000","last_active":"2024-09-21T03:24:32.617288+0000","last_peered":"2024-09-21T03:24:32.617288+0000","last_clean":"2024-09-21T03:24:32.617288+0000","last_became_active":"2024-09-21T03:14:46.529629+0000","last_became_peered":"2024-09-21T03:14:46.529629+0000","last_unstale":"2024-09-21T03:24:32.617288+0000","last_undegraded":"2024-09-21T03:24:32.617288+0000","last_fullsized":"2024-09-21T03:24:32.617288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:39.808494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":8220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"27'3149","reported_seq":3170,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.310173+0000","last_change":"2024-09-21T03:14:47.547724+0000","last_active":"2024-09-21T03:24:45.310173+0000","last_peered":"2024-09-21T03:24:45.310173+0000","last_clean":"2024-09-21T03:24:45.310173+0000","last_became_active":"2024-09-21T03:14:47.546770+0000","last_became_peered":"2024-09-21T03:14:47.546770+0000","last_unstale":"2024-09-21T03:24:45.310173+0000","last_undegraded":"2024-09-21T03:24:45.310173+0000","last_fullsized":"2024-09-21T03:24:45.310173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3149,"log_dups_size":0,"ondisk_log_size":3149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:31.476710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45697,"num_write_kb":467369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"27'2911","reported_seq":2940,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.013492+0000","last_change":"2024-09-21T03:14:38.476747+0000","last_active":"2024-09-21T03:24:32.013492+0000","last_peered":"2024-09-21T03:24:32.013492+0000","last_clean":"2024-09-21T03:24:32.013492+0000","last_became_active":"2024-09-21T03:14:38.476386+0000","last_became_peered":"2024-09-21T03:14:38.476386+0000","last_unstale":"2024-09-21T03:24:32.013492+0000","last_undegraded":"2024-09-21T03:24:32.013492+0000","last_fullsized":"2024-09-21T03:24:32.013492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:28.751991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43116,"num_write_kb":539220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'226","reported_seq":257,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.178813+0000","last_change":"2024-09-21T03:14:37.463164+0000","last_active":"2024-09-21T03:24:32.178813+0000","last_peered":"2024-09-21T03:24:32.178813+0000","last_clean":"2024-09-21T03:24:32.178813+0000","last_became_active":"2024-09-21T03:14:37.461409+0000","last_became_peered":"2024-09-21T03:14:37.461409+0000","last_unstale":"2024-09-21T03:24:32.178813+0000","last_undegraded":"2024-09-21T03:24:32.178813+0000","last_fullsized":"2024-09-21T03:24:32.178813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:51.126291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":8373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'25","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:23:51.616959+0000","last_change":"2024-09-21T03:14:46.538480+0000","last_active":"2024-09-21T03:23:51.616959+0000","last_peered":"2024-09-21T03:23:51.616959+0000","last_clean":"2024-09-21T03:23:51.616959+0000","last_became_active":"2024-09-21T03:14:46.537493+0000","last_became_peered":"2024-09-21T03:14:46.537493+0000","last_unstale":"2024-09-21T03:23:51.616959+0000","last_undegraded":"2024-09-21T03:23:51.616959+0000","last_fullsized":"2024-09-21T03:23:51.616959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:52.769190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"27'3059","reported_seq":3080,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.617887+0000","last_change":"2024-09-21T03:14:47.580512+0000","last_active":"2024-09-21T03:24:32.617887+0000","last_peered":"2024-09-21T03:24:32.617887+0000","last_clean":"2024-09-21T03:24:32.617887+0000","last_became_active":"2024-09-21T03:14:47.580210+0000","last_became_peered":"2024-09-21T03:14:47.580210+0000","last_unstale":"2024-09-21T03:24:32.617887+0000","last_undegraded":"2024-09-21T03:24:32.617887+0000","last_fullsized":"2024-09-21T03:24:32.617887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3059,"log_dups_size":0,"ondisk_log_size":3059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:20.192190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44544,"num_write_kb":453960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"27'2505","reported_seq":2534,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.178918+0000","last_change":"2024-09-21T03:14:38.494021+0000","last_active":"2024-09-21T03:24:32.178918+0000","last_peered":"2024-09-21T03:24:32.178918+0000","last_clean":"2024-09-21T03:24:32.178918+0000","last_became_active":"2024-09-21T03:14:38.486802+0000","last_became_peered":"2024-09-21T03:14:38.486802+0000","last_unstale":"2024-09-21T03:24:32.178918+0000","last_undegraded":"2024-09-21T03:24:32.178918+0000","last_fullsized":"2024-09-21T03:24:32.178918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2505,"log_dups_size":0,"ondisk_log_size":2505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:31.817505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37114,"num_write_kb":476028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'16","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.188248+0000","last_change":"2024-09-21T03:14:37.465907+0000","last_active":"2024-09-21T03:24:32.188248+0000","last_peered":"2024-09-21T03:24:32.188248+0000","last_clean":"2024-09-21T03:24:32.188248+0000","last_became_active":"2024-09-21T03:14:37.465551+0000","last_became_peered":"2024-09-21T03:14:37.465551+0000","last_unstale":"2024-09-21T03:24:32.188248+0000","last_undegraded":"2024-09-21T03:24:32.188248+0000","last_fullsized":"2024-09-21T03:24:32.188248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:10.599687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:23:48.015021+0000","last_change":"2024-09-21T03:14:46.546737+0000","last_active":"2024-09-21T03:23:48.015021+0000","last_peered":"2024-09-21T03:23:48.015021+0000","last_clean":"2024-09-21T03:23:48.015021+0000","last_became_active":"2024-09-21T03:14:46.546312+0000","last_became_peered":"2024-09-21T03:14:46.546312+0000","last_unstale":"2024-09-21T03:23:48.015021+0000","last_undegraded":"2024-09-21T03:23:48.015021+0000","last_fullsized":"2024-09-21T03:23:48.015021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:03.939168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"27'2654","reported_seq":2675,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.550798+0000","last_change":"2024-09-21T03:14:47.558742+0000","last_active":"2024-09-21T03:24:32.550798+0000","last_peered":"2024-09-21T03:24:32.550798+0000","last_clean":"2024-09-21T03:24:32.550798+0000","last_became_active":"2024-09-21T03:14:47.558431+0000","last_became_peered":"2024-09-21T03:14:47.558431+0000","last_unstale":"2024-09-21T03:24:32.550798+0000","last_undegraded":"2024-09-21T03:24:32.550798+0000","last_fullsized":"2024-09-21T03:24:32.550798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2654,"log_dups_size":0,"ondisk_log_size":2654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:32.053674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38628,"num_write_kb":413288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"27'3227","reported_seq":3256,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.488971+0000","last_change":"2024-09-21T03:14:38.479370+0000","last_active":"2024-09-21T03:24:44.488971+0000","last_peered":"2024-09-21T03:24:44.488971+0000","last_clean":"2024-09-21T03:24:44.488971+0000","last_became_active":"2024-09-21T03:14:38.476976+0000","last_became_peered":"2024-09-21T03:14:38.476976+0000","last_unstale":"2024-09-21T03:24:44.488971+0000","last_undegraded":"2024-09-21T03:24:44.488971+0000","last_fullsized":"2024-09-21T03:24:44.488971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3227,"log_dups_size":0,"ondisk_log_size":3227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:14.695819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47858,"num_write_kb":595125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'15","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.163168+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:24:32.163168+0000","last_peered":"2024-09-21T03:24:32.163168+0000","last_clean":"2024-09-21T03:24:32.163168+0000","last_became_active":"2024-09-21T03:14:37.478840+0000","last_became_peered":"2024-09-21T03:14:37.478840+0000","last_unstale":"2024-09-21T03:24:32.163168+0000","last_undegraded":"2024-09-21T03:24:32.163168+0000","last_fullsized":"2024-09-21T03:24:32.163168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:00.964354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'24","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.596135+0000","last_change":"2024-09-21T03:14:46.543085+0000","last_active":"2024-09-21T03:24:32.596135+0000","last_peered":"2024-09-21T03:24:32.596135+0000","last_clean":"2024-09-21T03:24:32.596135+0000","last_became_active":"2024-09-21T03:14:46.542721+0000","last_became_peered":"2024-09-21T03:14:46.542721+0000","last_unstale":"2024-09-21T03:24:32.596135+0000","last_undegraded":"2024-09-21T03:24:32.596135+0000","last_fullsized":"2024-09-21T03:24:32.596135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:05.590871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"27'3357","reported_seq":3378,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.327911+0000","last_change":"2024-09-21T03:14:47.566806+0000","last_active":"2024-09-21T03:24:45.327911+0000","last_peered":"2024-09-21T03:24:45.327911+0000","last_clean":"2024-09-21T03:24:45.327911+0000","last_became_active":"2024-09-21T03:14:47.566634+0000","last_became_peered":"2024-09-21T03:14:47.566634+0000","last_unstale":"2024-09-21T03:24:45.327911+0000","last_undegraded":"2024-09-21T03:24:45.327911+0000","last_fullsized":"2024-09-21T03:24:45.327911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3357,"log_dups_size":0,"ondisk_log_size":3357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:03.997294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48633,"num_write_kb":505858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'2922","reported_seq":2951,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.150348+0000","last_change":"2024-09-21T03:14:38.482658+0000","last_active":"2024-09-21T03:24:32.150348+0000","last_peered":"2024-09-21T03:24:32.150348+0000","last_clean":"2024-09-21T03:24:32.150348+0000","last_became_active":"2024-09-21T03:14:38.482369+0000","last_became_peered":"2024-09-21T03:14:38.482369+0000","last_unstale":"2024-09-21T03:24:32.150348+0000","last_undegraded":"2024-09-21T03:24:32.150348+0000","last_fullsized":"2024-09-21T03:24:32.150348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2922,"log_dups_size":0,"ondisk_log_size":2922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:36.682534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43307,"num_write_kb":537343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'15","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.146260+0000","last_change":"2024-09-21T03:14:37.472962+0000","last_active":"2024-09-21T03:24:32.146260+0000","last_peered":"2024-09-21T03:24:32.146260+0000","last_clean":"2024-09-21T03:24:32.146260+0000","last_became_active":"2024-09-21T03:14:37.472271+0000","last_became_peered":"2024-09-21T03:14:37.472271+0000","last_unstale":"2024-09-21T03:24:32.146260+0000","last_undegraded":"2024-09-21T03:24:32.146260+0000","last_fullsized":"2024-09-21T03:24:32.146260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:54.952223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'30","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.602142+0000","last_change":"2024-09-21T03:14:46.537137+0000","last_active":"2024-09-21T03:24:32.602142+0000","last_peered":"2024-09-21T03:24:32.602142+0000","last_clean":"2024-09-21T03:24:32.602142+0000","last_became_active":"2024-09-21T03:14:46.536791+0000","last_became_peered":"2024-09-21T03:14:46.536791+0000","last_unstale":"2024-09-21T03:24:32.602142+0000","last_undegraded":"2024-09-21T03:24:32.602142+0000","last_fullsized":"2024-09-21T03:24:32.602142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:43.186807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"27'2826","reported_seq":2847,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.304208+0000","last_change":"2024-09-21T03:14:47.555605+0000","last_active":"2024-09-21T03:24:45.304208+0000","last_peered":"2024-09-21T03:24:45.304208+0000","last_clean":"2024-09-21T03:24:45.304208+0000","last_became_active":"2024-09-21T03:14:47.555329+0000","last_became_peered":"2024-09-21T03:14:47.555329+0000","last_unstale":"2024-09-21T03:24:45.304208+0000","last_undegraded":"2024-09-21T03:24:45.304208+0000","last_fullsized":"2024-09-21T03:24:45.304208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2826,"log_dups_size":0,"ondisk_log_size":2826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:24.271656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40983,"num_write_kb":424268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'2675","reported_seq":2704,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.467679+0000","last_change":"2024-09-21T03:14:38.479133+0000","last_active":"2024-09-21T03:24:44.467679+0000","last_peered":"2024-09-21T03:24:44.467679+0000","last_clean":"2024-09-21T03:24:44.467679+0000","last_became_active":"2024-09-21T03:14:38.478077+0000","last_became_peered":"2024-09-21T03:14:38.478077+0000","last_unstale":"2024-09-21T03:24:44.467679+0000","last_undegraded":"2024-09-21T03:24:44.467679+0000","last_fullsized":"2024-09-21T03:24:44.467679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2675,"log_dups_size":0,"ondisk_log_size":2675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:56.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39231,"num_write_kb":490681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'10","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.193121+0000","last_change":"2024-09-21T03:14:37.480508+0000","last_active":"2024-09-21T03:24:32.193121+0000","last_peered":"2024-09-21T03:24:32.193121+0000","last_clean":"2024-09-21T03:24:32.193121+0000","last_became_active":"2024-09-21T03:14:37.480218+0000","last_became_peered":"2024-09-21T03:14:37.480218+0000","last_unstale":"2024-09-21T03:24:32.193121+0000","last_undegraded":"2024-09-21T03:24:32.193121+0000","last_fullsized":"2024-09-21T03:24:32.193121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:01.851380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'33","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:34.548248+0000","last_change":"2024-09-21T03:14:46.531615+0000","last_active":"2024-09-21T03:24:34.548248+0000","last_peered":"2024-09-21T03:24:34.548248+0000","last_clean":"2024-09-21T03:24:34.548248+0000","last_became_active":"2024-09-21T03:14:46.531289+0000","last_became_peered":"2024-09-21T03:14:46.531289+0000","last_unstale":"2024-09-21T03:24:34.548248+0000","last_undegraded":"2024-09-21T03:24:34.548248+0000","last_fullsized":"2024-09-21T03:24:34.548248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:10.145489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":107,"num_write":31,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"27'2914","reported_seq":2935,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.562112+0000","last_change":"2024-09-21T03:14:47.552705+0000","last_active":"2024-09-21T03:24:32.562112+0000","last_peered":"2024-09-21T03:24:32.562112+0000","last_clean":"2024-09-21T03:24:32.562112+0000","last_became_active":"2024-09-21T03:14:47.552367+0000","last_became_peered":"2024-09-21T03:14:47.552367+0000","last_unstale":"2024-09-21T03:24:32.562112+0000","last_undegraded":"2024-09-21T03:24:32.562112+0000","last_fullsized":"2024-09-21T03:24:32.562112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2914,"log_dups_size":0,"ondisk_log_size":2914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:45.379581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42429,"num_write_kb":431357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'3268","reported_seq":3297,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.453408+0000","last_change":"2024-09-21T03:14:38.475318+0000","last_active":"2024-09-21T03:24:44.453408+0000","last_peered":"2024-09-21T03:24:44.453408+0000","last_clean":"2024-09-21T03:24:44.453408+0000","last_became_active":"2024-09-21T03:14:38.474978+0000","last_became_peered":"2024-09-21T03:14:38.474978+0000","last_unstale":"2024-09-21T03:24:44.453408+0000","last_undegraded":"2024-09-21T03:24:44.453408+0000","last_fullsized":"2024-09-21T03:24:44.453408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3268,"log_dups_size":0,"ondisk_log_size":3268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:38.209624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48313,"num_write_kb":579677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'320","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.201019+0000","last_change":"2024-09-21T03:14:37.479651+0000","last_active":"2024-09-21T03:24:32.201019+0000","last_peered":"2024-09-21T03:24:32.201019+0000","last_clean":"2024-09-21T03:24:32.201019+0000","last_became_active":"2024-09-21T03:14:37.478833+0000","last_became_peered":"2024-09-21T03:14:37.478833+0000","last_unstale":"2024-09-21T03:24:32.201019+0000","last_undegraded":"2024-09-21T03:24:32.201019+0000","last_fullsized":"2024-09-21T03:24:32.201019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:48.578637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'48","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.593440+0000","last_change":"2024-09-21T03:14:46.536054+0000","last_active":"2024-09-21T03:24:32.593440+0000","last_peered":"2024-09-21T03:24:32.593440+0000","last_clean":"2024-09-21T03:24:32.593440+0000","last_became_active":"2024-09-21T03:14:46.535569+0000","last_became_peered":"2024-09-21T03:14:46.535569+0000","last_unstale":"2024-09-21T03:24:32.593440+0000","last_undegraded":"2024-09-21T03:24:32.593440+0000","last_fullsized":"2024-09-21T03:24:32.593440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:04.556059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":8210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"27'3102","reported_seq":3123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.505571+0000","last_change":"2024-09-21T03:14:47.571889+0000","last_active":"2024-09-21T03:24:32.505571+0000","last_peered":"2024-09-21T03:24:32.505571+0000","last_clean":"2024-09-21T03:24:32.505571+0000","last_became_active":"2024-09-21T03:14:47.571620+0000","last_became_peered":"2024-09-21T03:14:47.571620+0000","last_unstale":"2024-09-21T03:24:32.505571+0000","last_undegraded":"2024-09-21T03:24:32.505571+0000","last_fullsized":"2024-09-21T03:24:32.505571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3102,"log_dups_size":0,"ondisk_log_size":3102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:23.103973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45309,"num_write_kb":459474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"27'3313","reported_seq":3336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.493139+0000","last_change":"2024-09-21T03:14:38.493350+0000","last_active":"2024-09-21T03:24:44.493139+0000","last_peered":"2024-09-21T03:24:44.493139+0000","last_clean":"2024-09-21T03:24:44.493139+0000","last_became_active":"2024-09-21T03:14:38.492830+0000","last_became_peered":"2024-09-21T03:14:38.492830+0000","last_unstale":"2024-09-21T03:24:44.493139+0000","last_undegraded":"2024-09-21T03:24:44.493139+0000","last_fullsized":"2024-09-21T03:24:44.493139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3313,"log_dups_size":0,"ondisk_log_size":3313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:19.946319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48841,"num_write_kb":610665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'18","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.156028+0000","last_change":"2024-09-21T03:14:37.473484+0000","last_active":"2024-09-21T03:24:32.156028+0000","last_peered":"2024-09-21T03:24:32.156028+0000","last_clean":"2024-09-21T03:24:32.156028+0000","last_became_active":"2024-09-21T03:14:37.473218+0000","last_became_peered":"2024-09-21T03:14:37.473218+0000","last_unstale":"2024-09-21T03:24:32.156028+0000","last_undegraded":"2024-09-21T03:24:32.156028+0000","last_fullsized":"2024-09-21T03:24:32.156028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:49.006579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:21:06.027900+0000","last_change":"2024-09-21T03:14:46.548858+0000","last_active":"2024-09-21T03:21:06.027900+0000","last_peered":"2024-09-21T03:21:06.027900+0000","last_clean":"2024-09-21T03:21:06.027900+0000","last_became_active":"2024-09-21T03:14:46.548166+0000","last_became_peered":"2024-09-21T03:14:46.548166+0000","last_unstale":"2024-09-21T03:21:06.027900+0000","last_undegraded":"2024-09-21T03:21:06.027900+0000","last_fullsized":"2024-09-21T03:21:06.027900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:41.470072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"27'2797","reported_seq":2818,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.344863+0000","last_change":"2024-09-21T03:14:47.555787+0000","last_active":"2024-09-21T03:24:45.344863+0000","last_peered":"2024-09-21T03:24:45.344863+0000","last_clean":"2024-09-21T03:24:45.344863+0000","last_became_active":"2024-09-21T03:14:47.555420+0000","last_became_peered":"2024-09-21T03:14:47.555420+0000","last_unstale":"2024-09-21T03:24:45.344863+0000","last_undegraded":"2024-09-21T03:24:45.344863+0000","last_fullsized":"2024-09-21T03:24:45.344863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2797,"log_dups_size":0,"ondisk_log_size":2797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:45.769786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40658,"num_write_kb":422641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"27'2814","reported_seq":2843,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.461833+0000","last_change":"2024-09-21T03:14:38.479657+0000","last_active":"2024-09-21T03:24:44.461833+0000","last_peered":"2024-09-21T03:24:44.461833+0000","last_clean":"2024-09-21T03:24:44.461833+0000","last_became_active":"2024-09-21T03:14:38.479439+0000","last_became_peered":"2024-09-21T03:14:38.479439+0000","last_unstale":"2024-09-21T03:24:44.461833+0000","last_undegraded":"2024-09-21T03:24:44.461833+0000","last_fullsized":"2024-09-21T03:24:44.461833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2814,"log_dups_size":0,"ondisk_log_size":2814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.107215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41573,"num_write_kb":525350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.151982+0000","last_change":"2024-09-21T03:14:37.469799+0000","last_active":"2024-09-21T03:24:32.151982+0000","last_peered":"2024-09-21T03:24:32.151982+0000","last_clean":"2024-09-21T03:24:32.151982+0000","last_became_active":"2024-09-21T03:14:37.469495+0000","last_became_peered":"2024-09-21T03:14:37.469495+0000","last_unstale":"2024-09-21T03:24:32.151982+0000","last_undegraded":"2024-09-21T03:24:32.151982+0000","last_fullsized":"2024-09-21T03:24:32.151982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:50.247050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'51","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.593953+0000","last_change":"2024-09-21T03:14:46.544320+0000","last_active":"2024-09-21T03:24:32.593953+0000","last_peered":"2024-09-21T03:24:32.593953+0000","last_clean":"2024-09-21T03:24:32.593953+0000","last_became_active":"2024-09-21T03:14:46.544038+0000","last_became_peered":"2024-09-21T03:14:46.544038+0000","last_unstale":"2024-09-21T03:24:32.593953+0000","last_undegraded":"2024-09-21T03:24:32.593953+0000","last_fullsized":"2024-09-21T03:24:32.593953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:57.457687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"27'2669","reported_seq":2696,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.562242+0000","last_change":"2024-09-21T03:19:03.606923+0000","last_active":"2024-09-21T03:24:32.562242+0000","last_peered":"2024-09-21T03:24:32.562242+0000","last_clean":"2024-09-21T03:24:32.562242+0000","last_became_active":"2024-09-21T03:14:47.579324+0000","last_became_peered":"2024-09-21T03:14:47.579324+0000","last_unstale":"2024-09-21T03:24:32.562242+0000","last_undegraded":"2024-09-21T03:24:32.562242+0000","last_fullsized":"2024-09-21T03:24:32.562242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2669,"log_dups_size":0,"ondisk_log_size":2669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:37.656859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38848,"num_write_kb":393078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"27'3056","reported_seq":3085,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.555377+0000","last_change":"2024-09-21T03:14:38.476763+0000","last_active":"2024-09-21T03:24:44.555377+0000","last_peered":"2024-09-21T03:24:44.555377+0000","last_clean":"2024-09-21T03:24:44.555377+0000","last_became_active":"2024-09-21T03:14:38.474299+0000","last_became_peered":"2024-09-21T03:14:38.474299+0000","last_unstale":"2024-09-21T03:24:44.555377+0000","last_undegraded":"2024-09-21T03:24:44.555377+0000","last_fullsized":"2024-09-21T03:24:44.555377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3056,"log_dups_size":0,"ondisk_log_size":3056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:46.544930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45199,"num_write_kb":565597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'28","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.185284+0000","last_change":"2024-09-21T03:14:37.466857+0000","last_active":"2024-09-21T03:24:32.185284+0000","last_peered":"2024-09-21T03:24:32.185284+0000","last_clean":"2024-09-21T03:24:32.185284+0000","last_became_active":"2024-09-21T03:14:37.466256+0000","last_became_peered":"2024-09-21T03:14:37.466256+0000","last_unstale":"2024-09-21T03:24:32.185284+0000","last_undegraded":"2024-09-21T03:24:32.185284+0000","last_fullsized":"2024-09-21T03:24:32.185284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:02.240461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'5","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.569629+0000","last_change":"2024-09-21T03:14:46.537315+0000","last_active":"2024-09-21T03:24:32.569629+0000","last_peered":"2024-09-21T03:24:32.569629+0000","last_clean":"2024-09-21T03:24:32.569629+0000","last_became_active":"2024-09-21T03:14:46.536975+0000","last_became_peered":"2024-09-21T03:14:46.536975+0000","last_unstale":"2024-09-21T03:24:32.569629+0000","last_undegraded":"2024-09-21T03:24:32.569629+0000","last_fullsized":"2024-09-21T03:24:32.569629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:42.529591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"27'2491","reported_seq":2512,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.547078+0000","last_change":"2024-09-21T03:14:47.573009+0000","last_active":"2024-09-21T03:24:32.547078+0000","last_peered":"2024-09-21T03:24:32.547078+0000","last_clean":"2024-09-21T03:24:32.547078+0000","last_became_active":"2024-09-21T03:14:47.572395+0000","last_became_peered":"2024-09-21T03:14:47.572395+0000","last_unstale":"2024-09-21T03:24:32.547078+0000","last_undegraded":"2024-09-21T03:24:32.547078+0000","last_fullsized":"2024-09-21T03:24:32.547078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2491,"log_dups_size":0,"ondisk_log_size":2491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:41.733447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35860,"num_write_kb":370109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"27'2994","reported_seq":3023,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.517136+0000","last_change":"2024-09-21T03:14:38.481801+0000","last_active":"2024-09-21T03:24:44.517136+0000","last_peered":"2024-09-21T03:24:44.517136+0000","last_clean":"2024-09-21T03:24:44.517136+0000","last_became_active":"2024-09-21T03:14:38.481186+0000","last_became_peered":"2024-09-21T03:14:38.481186+0000","last_unstale":"2024-09-21T03:24:44.517136+0000","last_undegraded":"2024-09-21T03:24:44.517136+0000","last_fullsized":"2024-09-21T03:24:44.517136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2994,"log_dups_size":0,"ondisk_log_size":2994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:54.271470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44221,"num_write_kb":552392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'31","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:31.011851+0000","last_change":"2024-09-21T03:14:37.474798+0000","last_active":"2024-09-21T03:24:31.011851+0000","last_peered":"2024-09-21T03:24:31.011851+0000","last_clean":"2024-09-21T03:24:31.011851+0000","last_became_active":"2024-09-21T03:14:37.473829+0000","last_became_peered":"2024-09-21T03:14:37.473829+0000","last_unstale":"2024-09-21T03:24:31.011851+0000","last_undegraded":"2024-09-21T03:24:31.011851+0000","last_fullsized":"2024-09-21T03:24:31.011851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:11.571814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":105,"num_write":29,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'5","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.581221+0000","last_change":"2024-09-21T03:14:46.542495+0000","last_active":"2024-09-21T03:24:32.581221+0000","last_peered":"2024-09-21T03:24:32.581221+0000","last_clean":"2024-09-21T03:24:32.581221+0000","last_became_active":"2024-09-21T03:14:46.542181+0000","last_became_peered":"2024-09-21T03:14:46.542181+0000","last_unstale":"2024-09-21T03:24:32.581221+0000","last_undegraded":"2024-09-21T03:24:32.581221+0000","last_fullsized":"2024-09-21T03:24:32.581221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:22.481477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"27'2890","reported_seq":2911,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.568552+0000","last_change":"2024-09-21T03:14:47.569409+0000","last_active":"2024-09-21T03:24:32.568552+0000","last_peered":"2024-09-21T03:24:32.568552+0000","last_clean":"2024-09-21T03:24:32.568552+0000","last_became_active":"2024-09-21T03:14:47.569212+0000","last_became_peered":"2024-09-21T03:14:47.569212+0000","last_unstale":"2024-09-21T03:24:32.568552+0000","last_undegraded":"2024-09-21T03:24:32.568552+0000","last_fullsized":"2024-09-21T03:24:32.568552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.851943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42005,"num_write_kb":435585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"27'3096","reported_seq":3125,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.490675+0000","last_change":"2024-09-21T03:14:38.480026+0000","last_active":"2024-09-21T03:24:44.490675+0000","last_peered":"2024-09-21T03:24:44.490675+0000","last_clean":"2024-09-21T03:24:44.490675+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:24:44.490675+0000","last_undegraded":"2024-09-21T03:24:44.490675+0000","last_fullsized":"2024-09-21T03:24:44.490675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3096,"log_dups_size":0,"ondisk_log_size":3096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:20.481816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45754,"num_write_kb":580793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'48","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.181334+0000","last_change":"2024-09-21T03:14:37.464554+0000","last_active":"2024-09-21T03:24:32.181334+0000","last_peered":"2024-09-21T03:24:32.181334+0000","last_clean":"2024-09-21T03:24:32.181334+0000","last_became_active":"2024-09-21T03:14:37.464228+0000","last_became_peered":"2024-09-21T03:14:37.464228+0000","last_unstale":"2024-09-21T03:24:32.181334+0000","last_undegraded":"2024-09-21T03:24:32.181334+0000","last_fullsized":"2024-09-21T03:24:32.181334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:32.529512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'360","reported_seq":383,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:35.060058+0000","last_change":"2024-09-21T03:14:46.538538+0000","last_active":"2024-09-21T03:24:35.060058+0000","last_peered":"2024-09-21T03:24:35.060058+0000","last_clean":"2024-09-21T03:24:35.060058+0000","last_became_active":"2024-09-21T03:14:46.537815+0000","last_became_peered":"2024-09-21T03:14:46.537815+0000","last_unstale":"2024-09-21T03:24:35.060058+0000","last_undegraded":"2024-09-21T03:24:35.060058+0000","last_fullsized":"2024-09-21T03:24:35.060058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:42.264439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"27'3073","reported_seq":3094,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.583040+0000","last_change":"2024-09-21T03:14:47.558861+0000","last_active":"2024-09-21T03:24:32.583040+0000","last_peered":"2024-09-21T03:24:32.583040+0000","last_clean":"2024-09-21T03:24:32.583040+0000","last_became_active":"2024-09-21T03:14:47.557305+0000","last_became_peered":"2024-09-21T03:14:47.557305+0000","last_unstale":"2024-09-21T03:24:32.583040+0000","last_undegraded":"2024-09-21T03:24:32.583040+0000","last_fullsized":"2024-09-21T03:24:32.583040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3073,"log_dups_size":0,"ondisk_log_size":3073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:45.962367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44879,"num_write_kb":462177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'3149","reported_seq":3178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.485035+0000","last_change":"2024-09-21T03:14:38.479181+0000","last_active":"2024-09-21T03:24:44.485035+0000","last_peered":"2024-09-21T03:24:44.485035+0000","last_clean":"2024-09-21T03:24:44.485035+0000","last_became_active":"2024-09-21T03:14:38.478842+0000","last_became_peered":"2024-09-21T03:14:38.478842+0000","last_unstale":"2024-09-21T03:24:44.485035+0000","last_undegraded":"2024-09-21T03:24:44.485035+0000","last_fullsized":"2024-09-21T03:24:44.485035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3149,"log_dups_size":0,"ondisk_log_size":3149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:08.664381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46550,"num_write_kb":599066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:22:44.179288+0000","last_change":"2024-09-21T03:14:37.463990+0000","last_active":"2024-09-21T03:22:44.179288+0000","last_peered":"2024-09-21T03:22:44.179288+0000","last_clean":"2024-09-21T03:22:44.179288+0000","last_became_active":"2024-09-21T03:14:37.463674+0000","last_became_peered":"2024-09-21T03:14:37.463674+0000","last_unstale":"2024-09-21T03:22:44.179288+0000","last_undegraded":"2024-09-21T03:22:44.179288+0000","last_fullsized":"2024-09-21T03:22:44.179288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:35.391985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":128,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:22:32.784133+0000","last_change":"2024-09-21T03:14:26.342355+0000","last_active":"2024-09-21T03:22:32.784133+0000","last_peered":"2024-09-21T03:22:32.784133+0000","last_clean":"2024-09-21T03:22:32.784133+0000","last_became_active":"2024-09-21T03:14:26.341929+0000","last_became_peered":"2024-09-21T03:14:26.341929+0000","last_unstale":"2024-09-21T03:22:32.784133+0000","last_undegraded":"2024-09-21T03:22:32.784133+0000","last_fullsized":"2024-09-21T03:22:32.784133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_clean_scrub_stamp":"2024-09-21T03:14:25.329650+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:45.390822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'5","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.576786+0000","last_change":"2024-09-21T03:14:46.538184+0000","last_active":"2024-09-21T03:24:32.576786+0000","last_peered":"2024-09-21T03:24:32.576786+0000","last_clean":"2024-09-21T03:24:32.576786+0000","last_became_active":"2024-09-21T03:14:46.536753+0000","last_became_peered":"2024-09-21T03:14:46.536753+0000","last_unstale":"2024-09-21T03:24:32.576786+0000","last_undegraded":"2024-09-21T03:24:32.576786+0000","last_fullsized":"2024-09-21T03:24:32.576786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:49.078638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"27'2392","reported_seq":2413,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.297763+0000","last_change":"2024-09-21T03:14:47.552966+0000","last_active":"2024-09-21T03:24:45.297763+0000","last_peered":"2024-09-21T03:24:45.297763+0000","last_clean":"2024-09-21T03:24:45.297763+0000","last_became_active":"2024-09-21T03:14:47.552642+0000","last_became_peered":"2024-09-21T03:14:47.552642+0000","last_unstale":"2024-09-21T03:24:45.297763+0000","last_undegraded":"2024-09-21T03:24:45.297763+0000","last_fullsized":"2024-09-21T03:24:45.297763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2392,"log_dups_size":0,"ondisk_log_size":2392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:15.928026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34629,"num_write_kb":367496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"27'3139","reported_seq":3168,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.231721+0000","last_change":"2024-09-21T03:14:38.478414+0000","last_active":"2024-09-21T03:24:32.231721+0000","last_peered":"2024-09-21T03:24:32.231721+0000","last_clean":"2024-09-21T03:24:32.231721+0000","last_became_active":"2024-09-21T03:14:38.478116+0000","last_became_peered":"2024-09-21T03:14:38.478116+0000","last_unstale":"2024-09-21T03:24:32.231721+0000","last_undegraded":"2024-09-21T03:24:32.231721+0000","last_fullsized":"2024-09-21T03:24:32.231721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3139,"log_dups_size":0,"ondisk_log_size":3139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:29.618008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46299,"num_write_kb":593160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'3","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:23:38.363866+0000","last_change":"2024-09-21T03:14:37.479578+0000","last_active":"2024-09-21T03:23:38.363866+0000","last_peered":"2024-09-21T03:23:38.363866+0000","last_clean":"2024-09-21T03:23:38.363866+0000","last_became_active":"2024-09-21T03:14:37.479284+0000","last_became_peered":"2024-09-21T03:14:37.479284+0000","last_unstale":"2024-09-21T03:23:38.363866+0000","last_undegraded":"2024-09-21T03:23:38.363866+0000","last_fullsized":"2024-09-21T03:23:38.363866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:15.732230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'32","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.602886+0000","last_change":"2024-09-21T03:14:46.531536+0000","last_active":"2024-09-21T03:24:32.602886+0000","last_peered":"2024-09-21T03:24:32.602886+0000","last_clean":"2024-09-21T03:24:32.602886+0000","last_became_active":"2024-09-21T03:14:46.531069+0000","last_became_peered":"2024-09-21T03:14:46.531069+0000","last_unstale":"2024-09-21T03:24:32.602886+0000","last_undegraded":"2024-09-21T03:24:32.602886+0000","last_fullsized":"2024-09-21T03:24:32.602886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:14.050618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"27'2635","reported_seq":2656,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.438595+0000","last_change":"2024-09-21T03:14:47.553039+0000","last_active":"2024-09-21T03:24:32.438595+0000","last_peered":"2024-09-21T03:24:32.438595+0000","last_clean":"2024-09-21T03:24:32.438595+0000","last_became_active":"2024-09-21T03:14:47.552712+0000","last_became_peered":"2024-09-21T03:14:47.552712+0000","last_unstale":"2024-09-21T03:24:32.438595+0000","last_undegraded":"2024-09-21T03:24:32.438595+0000","last_fullsized":"2024-09-21T03:24:32.438595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2635,"log_dups_size":0,"ondisk_log_size":2635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:32.630319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38453,"num_write_kb":398220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'3285","reported_seq":3314,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.506010+0000","last_change":"2024-09-21T03:14:38.488259+0000","last_active":"2024-09-21T03:24:44.506010+0000","last_peered":"2024-09-21T03:24:44.506010+0000","last_clean":"2024-09-21T03:24:44.506010+0000","last_became_active":"2024-09-21T03:14:38.487420+0000","last_became_peered":"2024-09-21T03:14:38.487420+0000","last_unstale":"2024-09-21T03:24:44.506010+0000","last_undegraded":"2024-09-21T03:24:44.506010+0000","last_fullsized":"2024-09-21T03:24:44.506010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3285,"log_dups_size":0,"ondisk_log_size":3285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:48.003893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48497,"num_write_kb":608493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'7","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:23:39.783326+0000","last_change":"2024-09-21T03:14:37.460763+0000","last_active":"2024-09-21T03:23:39.783326+0000","last_peered":"2024-09-21T03:23:39.783326+0000","last_clean":"2024-09-21T03:23:39.783326+0000","last_became_active":"2024-09-21T03:14:37.460320+0000","last_became_peered":"2024-09-21T03:14:37.460320+0000","last_unstale":"2024-09-21T03:23:39.783326+0000","last_undegraded":"2024-09-21T03:23:39.783326+0000","last_fullsized":"2024-09-21T03:23:39.783326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.907794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'468","reported_seq":491,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.184284+0000","last_change":"2024-09-21T03:14:46.540901+0000","last_active":"2024-09-21T03:24:45.184284+0000","last_peered":"2024-09-21T03:24:45.184284+0000","last_clean":"2024-09-21T03:24:45.184284+0000","last_became_active":"2024-09-21T03:14:46.540182+0000","last_became_peered":"2024-09-21T03:14:46.540182+0000","last_unstale":"2024-09-21T03:24:45.184284+0000","last_undegraded":"2024-09-21T03:24:45.184284+0000","last_fullsized":"2024-09-21T03:24:45.184284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:38.416663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8130523,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":458,"num_write_kb":8274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"27'2705","reported_seq":2726,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.315093+0000","last_change":"2024-09-21T03:14:47.553810+0000","last_active":"2024-09-21T03:24:45.315093+0000","last_peered":"2024-09-21T03:24:45.315093+0000","last_clean":"2024-09-21T03:24:45.315093+0000","last_became_active":"2024-09-21T03:14:47.552371+0000","last_became_peered":"2024-09-21T03:14:47.552371+0000","last_unstale":"2024-09-21T03:24:45.315093+0000","last_undegraded":"2024-09-21T03:24:45.315093+0000","last_fullsized":"2024-09-21T03:24:45.315093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2705,"log_dups_size":0,"ondisk_log_size":2705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:38.659512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39343,"num_write_kb":410859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"27'3625","reported_seq":3654,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.548288+0000","last_change":"2024-09-21T03:14:38.480629+0000","last_active":"2024-09-21T03:24:44.548288+0000","last_peered":"2024-09-21T03:24:44.548288+0000","last_clean":"2024-09-21T03:24:44.548288+0000","last_became_active":"2024-09-21T03:14:38.474135+0000","last_became_peered":"2024-09-21T03:14:38.474135+0000","last_unstale":"2024-09-21T03:24:44.548288+0000","last_undegraded":"2024-09-21T03:24:44.548288+0000","last_fullsized":"2024-09-21T03:24:44.548288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3625,"log_dups_size":0,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:36.171044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53421,"num_write_kb":673086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'13","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.193221+0000","last_change":"2024-09-21T03:14:37.472491+0000","last_active":"2024-09-21T03:24:32.193221+0000","last_peered":"2024-09-21T03:24:32.193221+0000","last_clean":"2024-09-21T03:24:32.193221+0000","last_became_active":"2024-09-21T03:14:37.472164+0000","last_became_peered":"2024-09-21T03:14:37.472164+0000","last_unstale":"2024-09-21T03:24:32.193221+0000","last_undegraded":"2024-09-21T03:24:32.193221+0000","last_fullsized":"2024-09-21T03:24:32.193221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.498178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'19","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.563185+0000","last_change":"2024-09-21T03:14:46.544828+0000","last_active":"2024-09-21T03:24:32.563185+0000","last_peered":"2024-09-21T03:24:32.563185+0000","last_clean":"2024-09-21T03:24:32.563185+0000","last_became_active":"2024-09-21T03:14:46.535901+0000","last_became_peered":"2024-09-21T03:14:46.535901+0000","last_unstale":"2024-09-21T03:24:32.563185+0000","last_undegraded":"2024-09-21T03:24:32.563185+0000","last_fullsized":"2024-09-21T03:24:32.563185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:08.608530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"27'3041","reported_seq":3062,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.505706+0000","last_change":"2024-09-21T03:14:47.556478+0000","last_active":"2024-09-21T03:24:32.505706+0000","last_peered":"2024-09-21T03:24:32.505706+0000","last_clean":"2024-09-21T03:24:32.505706+0000","last_became_active":"2024-09-21T03:14:47.556145+0000","last_became_peered":"2024-09-21T03:14:47.556145+0000","last_unstale":"2024-09-21T03:24:32.505706+0000","last_undegraded":"2024-09-21T03:24:32.505706+0000","last_fullsized":"2024-09-21T03:24:32.505706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3041,"log_dups_size":0,"ondisk_log_size":3041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:59.004648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44445,"num_write_kb":452313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"27'2817","reported_seq":2846,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.579922+0000","last_change":"2024-09-21T03:14:38.469502+0000","last_active":"2024-09-21T03:24:44.579922+0000","last_peered":"2024-09-21T03:24:44.579922+0000","last_clean":"2024-09-21T03:24:44.579922+0000","last_became_active":"2024-09-21T03:14:38.468972+0000","last_became_peered":"2024-09-21T03:14:38.468972+0000","last_unstale":"2024-09-21T03:24:44.579922+0000","last_undegraded":"2024-09-21T03:24:44.579922+0000","last_fullsized":"2024-09-21T03:24:44.579922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2817,"log_dups_size":0,"ondisk_log_size":2817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41476,"num_write_kb":540924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'10","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.208426+0000","last_change":"2024-09-21T03:14:37.480905+0000","last_active":"2024-09-21T03:24:32.208426+0000","last_peered":"2024-09-21T03:24:32.208426+0000","last_clean":"2024-09-21T03:24:32.208426+0000","last_became_active":"2024-09-21T03:14:37.478227+0000","last_became_peered":"2024-09-21T03:14:37.478227+0000","last_unstale":"2024-09-21T03:24:32.208426+0000","last_undegraded":"2024-09-21T03:24:32.208426+0000","last_fullsized":"2024-09-21T03:24:32.208426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:42.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.583666+0000","last_change":"2024-09-21T03:14:46.536103+0000","last_active":"2024-09-21T03:24:32.583666+0000","last_peered":"2024-09-21T03:24:32.583666+0000","last_clean":"2024-09-21T03:24:32.583666+0000","last_became_active":"2024-09-21T03:14:46.535445+0000","last_became_peered":"2024-09-21T03:14:46.535445+0000","last_unstale":"2024-09-21T03:24:32.583666+0000","last_undegraded":"2024-09-21T03:24:32.583666+0000","last_fullsized":"2024-09-21T03:24:32.583666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:59.078000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"27'2465","reported_seq":2486,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.350565+0000","last_change":"2024-09-21T03:14:47.557503+0000","last_active":"2024-09-21T03:24:45.350565+0000","last_peered":"2024-09-21T03:24:45.350565+0000","last_clean":"2024-09-21T03:24:45.350565+0000","last_became_active":"2024-09-21T03:14:47.554366+0000","last_became_peered":"2024-09-21T03:14:47.554366+0000","last_unstale":"2024-09-21T03:24:45.350565+0000","last_undegraded":"2024-09-21T03:24:45.350565+0000","last_fullsized":"2024-09-21T03:24:45.350565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2465,"log_dups_size":0,"ondisk_log_size":2465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.994560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35585,"num_write_kb":377642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'3454","reported_seq":3483,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.213157+0000","last_change":"2024-09-21T03:14:38.479516+0000","last_active":"2024-09-21T03:24:32.213157+0000","last_peered":"2024-09-21T03:24:32.213157+0000","last_clean":"2024-09-21T03:24:32.213157+0000","last_became_active":"2024-09-21T03:14:38.474826+0000","last_became_peered":"2024-09-21T03:14:38.474826+0000","last_unstale":"2024-09-21T03:24:32.213157+0000","last_undegraded":"2024-09-21T03:24:32.213157+0000","last_fullsized":"2024-09-21T03:24:32.213157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:22.181411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51413,"num_write_kb":609416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'37","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.141749+0000","last_change":"2024-09-21T03:14:37.471063+0000","last_active":"2024-09-21T03:24:32.141749+0000","last_peered":"2024-09-21T03:24:32.141749+0000","last_clean":"2024-09-21T03:24:32.141749+0000","last_became_active":"2024-09-21T03:14:37.470720+0000","last_became_peered":"2024-09-21T03:14:37.470720+0000","last_unstale":"2024-09-21T03:24:32.141749+0000","last_undegraded":"2024-09-21T03:24:32.141749+0000","last_fullsized":"2024-09-21T03:24:32.141749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:00.054692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.582741+0000","last_change":"2024-09-21T03:14:46.538665+0000","last_active":"2024-09-21T03:24:32.582741+0000","last_peered":"2024-09-21T03:24:32.582741+0000","last_clean":"2024-09-21T03:24:32.582741+0000","last_became_active":"2024-09-21T03:14:46.537774+0000","last_became_peered":"2024-09-21T03:14:46.537774+0000","last_unstale":"2024-09-21T03:24:32.582741+0000","last_undegraded":"2024-09-21T03:24:32.582741+0000","last_fullsized":"2024-09-21T03:24:32.582741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:07.736404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"27'2977","reported_seq":2998,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.568400+0000","last_change":"2024-09-21T03:14:47.553011+0000","last_active":"2024-09-21T03:24:32.568400+0000","last_peered":"2024-09-21T03:24:32.568400+0000","last_clean":"2024-09-21T03:24:32.568400+0000","last_became_active":"2024-09-21T03:14:47.552700+0000","last_became_peered":"2024-09-21T03:14:47.552700+0000","last_unstale":"2024-09-21T03:24:32.568400+0000","last_undegraded":"2024-09-21T03:24:32.568400+0000","last_fullsized":"2024-09-21T03:24:32.568400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2977,"log_dups_size":0,"ondisk_log_size":2977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:58.780132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43190,"num_write_kb":444709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"27'3323","reported_seq":3352,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.477288+0000","last_change":"2024-09-21T03:14:38.472906+0000","last_active":"2024-09-21T03:24:44.477288+0000","last_peered":"2024-09-21T03:24:44.477288+0000","last_clean":"2024-09-21T03:24:44.477288+0000","last_became_active":"2024-09-21T03:14:38.471933+0000","last_became_peered":"2024-09-21T03:14:38.471933+0000","last_unstale":"2024-09-21T03:24:44.477288+0000","last_undegraded":"2024-09-21T03:24:44.477288+0000","last_fullsized":"2024-09-21T03:24:44.477288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3323,"log_dups_size":0,"ondisk_log_size":3323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:05.395821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49154,"num_write_kb":612364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.200953+0000","last_change":"2024-09-21T03:14:37.478714+0000","last_active":"2024-09-21T03:24:32.200953+0000","last_peered":"2024-09-21T03:24:32.200953+0000","last_clean":"2024-09-21T03:24:32.200953+0000","last_became_active":"2024-09-21T03:14:37.477951+0000","last_became_peered":"2024-09-21T03:14:37.477951+0000","last_unstale":"2024-09-21T03:24:32.200953+0000","last_undegraded":"2024-09-21T03:24:32.200953+0000","last_fullsized":"2024-09-21T03:24:32.200953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:42.529545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:26.343821+0000","last_change":"2024-09-21T03:14:46.546142+0000","last_active":"2024-09-21T03:24:26.343821+0000","last_peered":"2024-09-21T03:24:26.343821+0000","last_clean":"2024-09-21T03:24:26.343821+0000","last_became_active":"2024-09-21T03:14:46.545865+0000","last_became_peered":"2024-09-21T03:14:46.545865+0000","last_unstale":"2024-09-21T03:24:26.343821+0000","last_undegraded":"2024-09-21T03:24:26.343821+0000","last_fullsized":"2024-09-21T03:24:26.343821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:11.705309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"27'2773","reported_seq":2800,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.350773+0000","last_change":"2024-09-21T03:19:03.558620+0000","last_active":"2024-09-21T03:24:32.350773+0000","last_peered":"2024-09-21T03:24:32.350773+0000","last_clean":"2024-09-21T03:24:32.350773+0000","last_became_active":"2024-09-21T03:14:47.568656+0000","last_became_peered":"2024-09-21T03:14:47.568656+0000","last_unstale":"2024-09-21T03:24:32.350773+0000","last_undegraded":"2024-09-21T03:24:32.350773+0000","last_fullsized":"2024-09-21T03:24:32.350773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2773,"log_dups_size":0,"ondisk_log_size":2773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.041710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40461,"num_write_kb":415650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'3322","reported_seq":3351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.223296+0000","last_change":"2024-09-21T03:14:38.485454+0000","last_active":"2024-09-21T03:24:32.223296+0000","last_peered":"2024-09-21T03:24:32.223296+0000","last_clean":"2024-09-21T03:24:32.223296+0000","last_became_active":"2024-09-21T03:14:38.485235+0000","last_became_peered":"2024-09-21T03:14:38.485235+0000","last_unstale":"2024-09-21T03:24:32.223296+0000","last_undegraded":"2024-09-21T03:24:32.223296+0000","last_fullsized":"2024-09-21T03:24:32.223296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3322,"log_dups_size":0,"ondisk_log_size":3322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:11.585637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48941,"num_write_kb":642004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.241707+0000","last_change":"2024-09-21T03:14:37.466544+0000","last_active":"2024-09-21T03:24:32.241707+0000","last_peered":"2024-09-21T03:24:32.241707+0000","last_clean":"2024-09-21T03:24:32.241707+0000","last_became_active":"2024-09-21T03:14:37.465817+0000","last_became_peered":"2024-09-21T03:14:37.465817+0000","last_unstale":"2024-09-21T03:24:32.241707+0000","last_undegraded":"2024-09-21T03:24:32.241707+0000","last_fullsized":"2024-09-21T03:24:32.241707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:36.113483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'229","reported_seq":252,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.596651+0000","last_change":"2024-09-21T03:14:46.549921+0000","last_active":"2024-09-21T03:24:32.596651+0000","last_peered":"2024-09-21T03:24:32.596651+0000","last_clean":"2024-09-21T03:24:32.596651+0000","last_became_active":"2024-09-21T03:14:46.549119+0000","last_became_peered":"2024-09-21T03:14:46.549119+0000","last_unstale":"2024-09-21T03:24:32.596651+0000","last_undegraded":"2024-09-21T03:24:32.596651+0000","last_fullsized":"2024-09-21T03:24:32.596651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:09.622498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"27'3932","reported_seq":3947,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.330162+0000","last_change":"2024-09-21T03:15:15.687659+0000","last_active":"2024-09-21T03:24:45.330162+0000","last_peered":"2024-09-21T03:24:45.330162+0000","last_clean":"2024-09-21T03:24:45.330162+0000","last_became_active":"2024-09-21T03:15:15.687225+0000","last_became_peered":"2024-09-21T03:15:15.687225+0000","last_unstale":"2024-09-21T03:24:45.330162+0000","last_undegraded":"2024-09-21T03:24:45.330162+0000","last_fullsized":"2024-09-21T03:24:45.330162+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3932,"log_dups_size":0,"ondisk_log_size":3932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:56.395767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57021,"num_write_kb":587488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"27'3064","reported_seq":3091,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.497573+0000","last_change":"2024-09-21T03:14:38.482528+0000","last_active":"2024-09-21T03:24:44.497573+0000","last_peered":"2024-09-21T03:24:44.497573+0000","last_clean":"2024-09-21T03:24:44.497573+0000","last_became_active":"2024-09-21T03:14:38.482241+0000","last_became_peered":"2024-09-21T03:14:38.482241+0000","last_unstale":"2024-09-21T03:24:44.497573+0000","last_undegraded":"2024-09-21T03:24:44.497573+0000","last_fullsized":"2024-09-21T03:24:44.497573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3064,"log_dups_size":0,"ondisk_log_size":3064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:23.110703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45418,"num_write_kb":562843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'19","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.197386+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:24:32.197386+0000","last_peered":"2024-09-21T03:24:32.197386+0000","last_clean":"2024-09-21T03:24:32.197386+0000","last_became_active":"2024-09-21T03:14:37.478882+0000","last_became_peered":"2024-09-21T03:14:37.478882+0000","last_unstale":"2024-09-21T03:24:32.197386+0000","last_undegraded":"2024-09-21T03:24:32.197386+0000","last_fullsized":"2024-09-21T03:24:32.197386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:11.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'22","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:33.062661+0000","last_change":"2024-09-21T03:14:46.538817+0000","last_active":"2024-09-21T03:24:33.062661+0000","last_peered":"2024-09-21T03:24:33.062661+0000","last_clean":"2024-09-21T03:24:33.062661+0000","last_became_active":"2024-09-21T03:14:46.537835+0000","last_became_peered":"2024-09-21T03:14:46.537835+0000","last_unstale":"2024-09-21T03:24:33.062661+0000","last_undegraded":"2024-09-21T03:24:33.062661+0000","last_fullsized":"2024-09-21T03:24:33.062661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:08.236663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"27'3365","reported_seq":3386,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.359474+0000","last_change":"2024-09-21T03:14:47.566534+0000","last_active":"2024-09-21T03:24:45.359474+0000","last_peered":"2024-09-21T03:24:45.359474+0000","last_clean":"2024-09-21T03:24:45.359474+0000","last_became_active":"2024-09-21T03:14:47.566157+0000","last_became_peered":"2024-09-21T03:14:47.566157+0000","last_unstale":"2024-09-21T03:24:45.359474+0000","last_undegraded":"2024-09-21T03:24:45.359474+0000","last_fullsized":"2024-09-21T03:24:45.359474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3365,"log_dups_size":0,"ondisk_log_size":3365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:35.557811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48864,"num_write_kb":499368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"27'2812","reported_seq":2841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.505020+0000","last_change":"2024-09-21T03:14:38.478509+0000","last_active":"2024-09-21T03:24:44.505020+0000","last_peered":"2024-09-21T03:24:44.505020+0000","last_clean":"2024-09-21T03:24:44.505020+0000","last_became_active":"2024-09-21T03:14:38.478197+0000","last_became_peered":"2024-09-21T03:14:38.478197+0000","last_unstale":"2024-09-21T03:24:44.505020+0000","last_undegraded":"2024-09-21T03:24:44.505020+0000","last_fullsized":"2024-09-21T03:24:44.505020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2812,"log_dups_size":0,"ondisk_log_size":2812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.411134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41544,"num_write_kb":533190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'234","reported_seq":265,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.189321+0000","last_change":"2024-09-21T03:14:37.472695+0000","last_active":"2024-09-21T03:24:32.189321+0000","last_peered":"2024-09-21T03:24:32.189321+0000","last_clean":"2024-09-21T03:24:32.189321+0000","last_became_active":"2024-09-21T03:14:37.472374+0000","last_became_peered":"2024-09-21T03:14:37.472374+0000","last_unstale":"2024-09-21T03:24:32.189321+0000","last_undegraded":"2024-09-21T03:24:32.189321+0000","last_fullsized":"2024-09-21T03:24:32.189321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:11.245914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":12446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'5","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.617539+0000","last_change":"2024-09-21T03:14:46.547433+0000","last_active":"2024-09-21T03:24:32.617539+0000","last_peered":"2024-09-21T03:24:32.617539+0000","last_clean":"2024-09-21T03:24:32.617539+0000","last_became_active":"2024-09-21T03:14:46.547192+0000","last_became_peered":"2024-09-21T03:14:46.547192+0000","last_unstale":"2024-09-21T03:24:32.617539+0000","last_undegraded":"2024-09-21T03:24:32.617539+0000","last_fullsized":"2024-09-21T03:24:32.617539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:03.238245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"27'2729","reported_seq":2750,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.457661+0000","last_change":"2024-09-21T03:14:47.545827+0000","last_active":"2024-09-21T03:24:32.457661+0000","last_peered":"2024-09-21T03:24:32.457661+0000","last_clean":"2024-09-21T03:24:32.457661+0000","last_became_active":"2024-09-21T03:14:47.545440+0000","last_became_peered":"2024-09-21T03:14:47.545440+0000","last_unstale":"2024-09-21T03:24:32.457661+0000","last_undegraded":"2024-09-21T03:24:32.457661+0000","last_fullsized":"2024-09-21T03:24:32.457661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2729,"log_dups_size":0,"ondisk_log_size":2729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:20.532645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39786,"num_write_kb":413571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"27'4229","reported_seq":4258,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.135874+0000","last_change":"2024-09-21T03:14:38.476564+0000","last_active":"2024-09-21T03:24:32.135874+0000","last_peered":"2024-09-21T03:24:32.135874+0000","last_clean":"2024-09-21T03:24:32.135874+0000","last_became_active":"2024-09-21T03:14:38.476158+0000","last_became_peered":"2024-09-21T03:14:38.476158+0000","last_unstale":"2024-09-21T03:24:32.135874+0000","last_undegraded":"2024-09-21T03:24:32.135874+0000","last_fullsized":"2024-09-21T03:24:32.135874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":4229,"log_dups_size":0,"ondisk_log_size":4229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:26.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63095,"num_write_kb":776596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'34","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.259366+0000","last_change":"2024-09-21T03:14:37.473709+0000","last_active":"2024-09-21T03:24:32.259366+0000","last_peered":"2024-09-21T03:24:32.259366+0000","last_clean":"2024-09-21T03:24:32.259366+0000","last_became_active":"2024-09-21T03:14:37.472544+0000","last_became_peered":"2024-09-21T03:14:37.472544+0000","last_unstale":"2024-09-21T03:24:32.259366+0000","last_undegraded":"2024-09-21T03:24:32.259366+0000","last_fullsized":"2024-09-21T03:24:32.259366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:47.892146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'51","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.595511+0000","last_change":"2024-09-21T03:14:46.534201+0000","last_active":"2024-09-21T03:24:32.595511+0000","last_peered":"2024-09-21T03:24:32.595511+0000","last_clean":"2024-09-21T03:24:32.595511+0000","last_became_active":"2024-09-21T03:14:46.533891+0000","last_became_peered":"2024-09-21T03:14:46.533891+0000","last_unstale":"2024-09-21T03:24:32.595511+0000","last_undegraded":"2024-09-21T03:24:32.595511+0000","last_fullsized":"2024-09-21T03:24:32.595511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:06.645173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":8218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"27'3044","reported_seq":3065,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.603649+0000","last_change":"2024-09-21T03:14:47.552016+0000","last_active":"2024-09-21T03:24:32.603649+0000","last_peered":"2024-09-21T03:24:32.603649+0000","last_clean":"2024-09-21T03:24:32.603649+0000","last_became_active":"2024-09-21T03:14:47.551622+0000","last_became_peered":"2024-09-21T03:14:47.551622+0000","last_unstale":"2024-09-21T03:24:32.603649+0000","last_undegraded":"2024-09-21T03:24:32.603649+0000","last_fullsized":"2024-09-21T03:24:32.603649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3044,"log_dups_size":0,"ondisk_log_size":3044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:56:04.849535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44676,"num_write_kb":453348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'2866","reported_seq":2895,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.559024+0000","last_change":"2024-09-21T03:14:38.484757+0000","last_active":"2024-09-21T03:24:44.559024+0000","last_peered":"2024-09-21T03:24:44.559024+0000","last_clean":"2024-09-21T03:24:44.559024+0000","last_became_active":"2024-09-21T03:14:38.483348+0000","last_became_peered":"2024-09-21T03:14:38.483348+0000","last_unstale":"2024-09-21T03:24:44.559024+0000","last_undegraded":"2024-09-21T03:24:44.559024+0000","last_fullsized":"2024-09-21T03:24:44.559024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2866,"log_dups_size":0,"ondisk_log_size":2866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:57.697723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42315,"num_write_kb":514746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'14","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.191061+0000","last_change":"2024-09-21T03:14:37.479047+0000","last_active":"2024-09-21T03:24:32.191061+0000","last_peered":"2024-09-21T03:24:32.191061+0000","last_clean":"2024-09-21T03:24:32.191061+0000","last_became_active":"2024-09-21T03:14:37.478700+0000","last_became_peered":"2024-09-21T03:14:37.478700+0000","last_unstale":"2024-09-21T03:24:32.191061+0000","last_undegraded":"2024-09-21T03:24:32.191061+0000","last_fullsized":"2024-09-21T03:24:32.191061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:31.702450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'12","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.584480+0000","last_change":"2024-09-21T03:14:46.547287+0000","last_active":"2024-09-21T03:24:32.584480+0000","last_peered":"2024-09-21T03:24:32.584480+0000","last_clean":"2024-09-21T03:24:32.584480+0000","last_became_active":"2024-09-21T03:14:46.546867+0000","last_became_peered":"2024-09-21T03:14:46.546867+0000","last_unstale":"2024-09-21T03:24:32.584480+0000","last_undegraded":"2024-09-21T03:24:32.584480+0000","last_fullsized":"2024-09-21T03:24:32.584480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:54.119841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"27'3248","reported_seq":3269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.330727+0000","last_change":"2024-09-21T03:14:47.558571+0000","last_active":"2024-09-21T03:24:45.330727+0000","last_peered":"2024-09-21T03:24:45.330727+0000","last_clean":"2024-09-21T03:24:45.330727+0000","last_became_active":"2024-09-21T03:14:47.558037+0000","last_became_peered":"2024-09-21T03:14:47.558037+0000","last_unstale":"2024-09-21T03:24:45.330727+0000","last_undegraded":"2024-09-21T03:24:45.330727+0000","last_fullsized":"2024-09-21T03:24:45.330727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3248,"log_dups_size":0,"ondisk_log_size":3248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:42.564181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47392,"num_write_kb":480920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"27'3071","reported_seq":3100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.583058+0000","last_change":"2024-09-21T03:14:38.488227+0000","last_active":"2024-09-21T03:24:44.583058+0000","last_peered":"2024-09-21T03:24:44.583058+0000","last_clean":"2024-09-21T03:24:44.583058+0000","last_became_active":"2024-09-21T03:14:38.482370+0000","last_became_peered":"2024-09-21T03:14:38.482370+0000","last_unstale":"2024-09-21T03:24:44.583058+0000","last_undegraded":"2024-09-21T03:24:44.583058+0000","last_fullsized":"2024-09-21T03:24:44.583058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3071,"log_dups_size":0,"ondisk_log_size":3071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:52.561391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45203,"num_write_kb":570065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:20.846579+0000","last_change":"2024-09-21T03:14:37.471363+0000","last_active":"2024-09-21T03:24:20.846579+0000","last_peered":"2024-09-21T03:24:20.846579+0000","last_clean":"2024-09-21T03:24:20.846579+0000","last_became_active":"2024-09-21T03:14:37.471002+0000","last_became_peered":"2024-09-21T03:14:37.471002+0000","last_unstale":"2024-09-21T03:24:20.846579+0000","last_undegraded":"2024-09-21T03:24:20.846579+0000","last_fullsized":"2024-09-21T03:24:20.846579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:25.922368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.586441+0000","last_change":"2024-09-21T03:14:46.545186+0000","last_active":"2024-09-21T03:24:32.586441+0000","last_peered":"2024-09-21T03:24:32.586441+0000","last_clean":"2024-09-21T03:24:32.586441+0000","last_became_active":"2024-09-21T03:14:46.543647+0000","last_became_peered":"2024-09-21T03:14:46.543647+0000","last_unstale":"2024-09-21T03:24:32.586441+0000","last_undegraded":"2024-09-21T03:24:32.586441+0000","last_fullsized":"2024-09-21T03:24:32.586441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:03.097368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"27'3498","reported_seq":3519,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.285413+0000","last_change":"2024-09-21T03:14:47.554766+0000","last_active":"2024-09-21T03:24:45.285413+0000","last_peered":"2024-09-21T03:24:45.285413+0000","last_clean":"2024-09-21T03:24:45.285413+0000","last_became_active":"2024-09-21T03:14:47.551563+0000","last_became_peered":"2024-09-21T03:14:47.551563+0000","last_unstale":"2024-09-21T03:24:45.285413+0000","last_undegraded":"2024-09-21T03:24:45.285413+0000","last_fullsized":"2024-09-21T03:24:45.285413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3498,"log_dups_size":0,"ondisk_log_size":3498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:08.790725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50774,"num_write_kb":531933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"27'32","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.588919+0000","last_change":"2024-09-21T03:14:46.542659+0000","last_active":"2024-09-21T03:24:32.588919+0000","last_peered":"2024-09-21T03:24:32.588919+0000","last_clean":"2024-09-21T03:24:32.588919+0000","last_became_active":"2024-09-21T03:14:46.541771+0000","last_became_peered":"2024-09-21T03:14:46.541771+0000","last_unstale":"2024-09-21T03:24:32.588919+0000","last_undegraded":"2024-09-21T03:24:32.588919+0000","last_fullsized":"2024-09-21T03:24:32.588919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:45.543904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'3639","reported_seq":3668,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.531609+0000","last_change":"2024-09-21T03:14:38.481837+0000","last_active":"2024-09-21T03:24:44.531609+0000","last_peered":"2024-09-21T03:24:44.531609+0000","last_clean":"2024-09-21T03:24:44.531609+0000","last_became_active":"2024-09-21T03:14:38.478400+0000","last_became_peered":"2024-09-21T03:14:38.478400+0000","last_unstale":"2024-09-21T03:24:44.531609+0000","last_undegraded":"2024-09-21T03:24:44.531609+0000","last_fullsized":"2024-09-21T03:24:44.531609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3639,"log_dups_size":0,"ondisk_log_size":3639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.702185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53758,"num_write_kb":679942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'29","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.101066+0000","last_change":"2024-09-21T03:14:37.459351+0000","last_active":"2024-09-21T03:24:32.101066+0000","last_peered":"2024-09-21T03:24:32.101066+0000","last_clean":"2024-09-21T03:24:32.101066+0000","last_became_active":"2024-09-21T03:14:37.458676+0000","last_became_peered":"2024-09-21T03:14:37.458676+0000","last_unstale":"2024-09-21T03:24:32.101066+0000","last_undegraded":"2024-09-21T03:24:32.101066+0000","last_fullsized":"2024-09-21T03:24:32.101066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:42.671520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"27'3276","reported_seq":3297,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.497499+0000","last_change":"2024-09-21T03:14:47.561232+0000","last_active":"2024-09-21T03:24:32.497499+0000","last_peered":"2024-09-21T03:24:32.497499+0000","last_clean":"2024-09-21T03:24:32.497499+0000","last_became_active":"2024-09-21T03:14:47.557224+0000","last_became_peered":"2024-09-21T03:14:47.557224+0000","last_unstale":"2024-09-21T03:24:32.497499+0000","last_undegraded":"2024-09-21T03:24:32.497499+0000","last_fullsized":"2024-09-21T03:24:32.497499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3276,"log_dups_size":0,"ondisk_log_size":3276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:09.611235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47961,"num_write_kb":483752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"27'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:21:00.934074+0000","last_change":"2024-09-21T03:14:46.543157+0000","last_active":"2024-09-21T03:21:00.934074+0000","last_peered":"2024-09-21T03:21:00.934074+0000","last_clean":"2024-09-21T03:21:00.934074+0000","last_became_active":"2024-09-21T03:14:46.542746+0000","last_became_peered":"2024-09-21T03:14:46.542746+0000","last_unstale":"2024-09-21T03:21:00.934074+0000","last_undegraded":"2024-09-21T03:21:00.934074+0000","last_fullsized":"2024-09-21T03:21:00.934074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:30.644843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'3052","reported_seq":3081,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.518411+0000","last_change":"2024-09-21T03:14:38.480723+0000","last_active":"2024-09-21T03:24:44.518411+0000","last_peered":"2024-09-21T03:24:44.518411+0000","last_clean":"2024-09-21T03:24:44.518411+0000","last_became_active":"2024-09-21T03:14:38.472823+0000","last_became_peered":"2024-09-21T03:14:38.472823+0000","last_unstale":"2024-09-21T03:24:44.518411+0000","last_undegraded":"2024-09-21T03:24:44.518411+0000","last_fullsized":"2024-09-21T03:24:44.518411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3052,"log_dups_size":0,"ondisk_log_size":3052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:59.862592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44791,"num_write_kb":578211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'17","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:29.478596+0000","last_change":"2024-09-21T03:14:37.472209+0000","last_active":"2024-09-21T03:24:29.478596+0000","last_peered":"2024-09-21T03:24:29.478596+0000","last_clean":"2024-09-21T03:24:29.478596+0000","last_became_active":"2024-09-21T03:14:37.471771+0000","last_became_peered":"2024-09-21T03:14:37.471771+0000","last_unstale":"2024-09-21T03:24:29.478596+0000","last_undegraded":"2024-09-21T03:24:29.478596+0000","last_fullsized":"2024-09-21T03:24:29.478596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:30.648010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"27'3552","reported_seq":3572,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.364338+0000","last_change":"2024-09-21T03:14:47.570651+0000","last_active":"2024-09-21T03:24:45.364338+0000","last_peered":"2024-09-21T03:24:45.364338+0000","last_clean":"2024-09-21T03:24:45.364338+0000","last_became_active":"2024-09-21T03:14:47.568081+0000","last_became_peered":"2024-09-21T03:14:47.568081+0000","last_unstale":"2024-09-21T03:24:45.364338+0000","last_undegraded":"2024-09-21T03:24:45.364338+0000","last_fullsized":"2024-09-21T03:24:45.364338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:45.036938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51450,"num_write_kb":532295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"27'33","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.223186+0000","last_change":"2024-09-21T03:14:37.475076+0000","last_active":"2024-09-21T03:24:32.223186+0000","last_peered":"2024-09-21T03:24:32.223186+0000","last_clean":"2024-09-21T03:24:32.223186+0000","last_became_active":"2024-09-21T03:14:37.474595+0000","last_became_peered":"2024-09-21T03:14:37.474595+0000","last_unstale":"2024-09-21T03:24:32.223186+0000","last_undegraded":"2024-09-21T03:24:32.223186+0000","last_fullsized":"2024-09-21T03:24:32.223186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:16.880647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2516","reported_seq":2545,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.531186+0000","last_change":"2024-09-21T03:14:38.483226+0000","last_active":"2024-09-21T03:24:44.531186+0000","last_peered":"2024-09-21T03:24:44.531186+0000","last_clean":"2024-09-21T03:24:44.531186+0000","last_became_active":"2024-09-21T03:14:38.482354+0000","last_became_peered":"2024-09-21T03:14:38.482354+0000","last_unstale":"2024-09-21T03:24:44.531186+0000","last_undegraded":"2024-09-21T03:24:44.531186+0000","last_fullsized":"2024-09-21T03:24:44.531186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2516,"log_dups_size":0,"ondisk_log_size":2516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:51.488594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37096,"num_write_kb":460963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'34","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.602419+0000","last_change":"2024-09-21T03:14:46.551282+0000","last_active":"2024-09-21T03:24:32.602419+0000","last_peered":"2024-09-21T03:24:32.602419+0000","last_clean":"2024-09-21T03:24:32.602419+0000","last_became_active":"2024-09-21T03:14:46.550191+0000","last_became_peered":"2024-09-21T03:14:46.550191+0000","last_unstale":"2024-09-21T03:24:32.602419+0000","last_undegraded":"2024-09-21T03:24:32.602419+0000","last_fullsized":"2024-09-21T03:24:32.602419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:32.136739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"27'2120","reported_seq":2146,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.338684+0000","last_change":"2024-09-21T03:15:15.686522+0000","last_active":"2024-09-21T03:24:45.338684+0000","last_peered":"2024-09-21T03:24:45.338684+0000","last_clean":"2024-09-21T03:24:45.338684+0000","last_became_active":"2024-09-21T03:15:15.686063+0000","last_became_peered":"2024-09-21T03:15:15.686063+0000","last_unstale":"2024-09-21T03:24:45.338684+0000","last_undegraded":"2024-09-21T03:24:45.338684+0000","last_fullsized":"2024-09-21T03:24:45.338684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2120,"log_dups_size":0,"ondisk_log_size":2120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:57.750372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30729,"num_write_kb":315555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1140","reported_seq":1171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.135682+0000","last_change":"2024-09-21T03:14:37.465536+0000","last_active":"2024-09-21T03:24:32.135682+0000","last_peered":"2024-09-21T03:24:32.135682+0000","last_clean":"2024-09-21T03:24:32.135682+0000","last_became_active":"2024-09-21T03:14:37.465240+0000","last_became_peered":"2024-09-21T03:14:37.465240+0000","last_unstale":"2024-09-21T03:24:32.135682+0000","last_undegraded":"2024-09-21T03:24:32.135682+0000","last_fullsized":"2024-09-21T03:24:32.135682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1140,"log_dups_size":0,"ondisk_log_size":1140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:34.780298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1138,"num_write_kb":5114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'2730","reported_seq":2759,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.508566+0000","last_change":"2024-09-21T03:14:38.474516+0000","last_active":"2024-09-21T03:24:44.508566+0000","last_peered":"2024-09-21T03:24:44.508566+0000","last_clean":"2024-09-21T03:24:44.508566+0000","last_became_active":"2024-09-21T03:14:38.472225+0000","last_became_peered":"2024-09-21T03:14:38.472225+0000","last_unstale":"2024-09-21T03:24:44.508566+0000","last_undegraded":"2024-09-21T03:24:44.508566+0000","last_fullsized":"2024-09-21T03:24:44.508566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2730,"log_dups_size":0,"ondisk_log_size":2730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:47.504910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40361,"num_write_kb":500658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'77","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.576199+0000","last_change":"2024-09-21T03:14:46.544072+0000","last_active":"2024-09-21T03:24:32.576199+0000","last_peered":"2024-09-21T03:24:32.576199+0000","last_clean":"2024-09-21T03:24:32.576199+0000","last_became_active":"2024-09-21T03:14:46.543729+0000","last_became_peered":"2024-09-21T03:14:46.543729+0000","last_unstale":"2024-09-21T03:24:32.576199+0000","last_undegraded":"2024-09-21T03:24:32.576199+0000","last_fullsized":"2024-09-21T03:24:32.576199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:18.560012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":12315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"27'2742","reported_seq":2763,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.365262+0000","last_change":"2024-09-21T03:14:47.563764+0000","last_active":"2024-09-21T03:24:45.365262+0000","last_peered":"2024-09-21T03:24:45.365262+0000","last_clean":"2024-09-21T03:24:45.365262+0000","last_became_active":"2024-09-21T03:14:47.562943+0000","last_became_peered":"2024-09-21T03:14:47.562943+0000","last_unstale":"2024-09-21T03:24:45.365262+0000","last_undegraded":"2024-09-21T03:24:45.365262+0000","last_fullsized":"2024-09-21T03:24:45.365262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2742,"log_dups_size":0,"ondisk_log_size":2742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:39.284350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39824,"num_write_kb":405293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"27'3827","reported_seq":3856,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.511437+0000","last_change":"2024-09-21T03:14:38.484311+0000","last_active":"2024-09-21T03:24:44.511437+0000","last_peered":"2024-09-21T03:24:44.511437+0000","last_clean":"2024-09-21T03:24:44.511437+0000","last_became_active":"2024-09-21T03:14:38.483975+0000","last_became_peered":"2024-09-21T03:14:38.483975+0000","last_unstale":"2024-09-21T03:24:44.511437+0000","last_undegraded":"2024-09-21T03:24:44.511437+0000","last_fullsized":"2024-09-21T03:24:44.511437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3827,"log_dups_size":0,"ondisk_log_size":3827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:31.145431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56663,"num_write_kb":721573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"27'3391","reported_seq":3412,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.350778+0000","last_change":"2024-09-21T03:14:47.566252+0000","last_active":"2024-09-21T03:24:45.350778+0000","last_peered":"2024-09-21T03:24:45.350778+0000","last_clean":"2024-09-21T03:24:45.350778+0000","last_became_active":"2024-09-21T03:14:47.560282+0000","last_became_peered":"2024-09-21T03:14:47.560282+0000","last_unstale":"2024-09-21T03:24:45.350778+0000","last_undegraded":"2024-09-21T03:24:45.350778+0000","last_fullsized":"2024-09-21T03:24:45.350778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3391,"log_dups_size":0,"ondisk_log_size":3391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:23.553847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49276,"num_write_kb":506666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"27'3185","reported_seq":3214,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.016946+0000","last_change":"2024-09-21T03:14:38.477183+0000","last_active":"2024-09-21T03:24:32.016946+0000","last_peered":"2024-09-21T03:24:32.016946+0000","last_clean":"2024-09-21T03:24:32.016946+0000","last_became_active":"2024-09-21T03:14:38.476657+0000","last_became_peered":"2024-09-21T03:14:38.476657+0000","last_unstale":"2024-09-21T03:24:32.016946+0000","last_undegraded":"2024-09-21T03:24:32.016946+0000","last_fullsized":"2024-09-21T03:24:32.016946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3185,"log_dups_size":0,"ondisk_log_size":3185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:36.801764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47236,"num_write_kb":609124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"27'2689","reported_seq":2710,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.343743+0000","last_change":"2024-09-21T03:14:47.574339+0000","last_active":"2024-09-21T03:24:45.343743+0000","last_peered":"2024-09-21T03:24:45.343743+0000","last_clean":"2024-09-21T03:24:45.343743+0000","last_became_active":"2024-09-21T03:14:47.565732+0000","last_became_peered":"2024-09-21T03:14:47.565732+0000","last_unstale":"2024-09-21T03:24:45.343743+0000","last_undegraded":"2024-09-21T03:24:45.343743+0000","last_fullsized":"2024-09-21T03:24:45.343743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2689,"log_dups_size":0,"ondisk_log_size":2689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:57.896810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39100,"num_write_kb":400538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'3532","reported_seq":3561,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.118361+0000","last_change":"2024-09-21T03:14:38.472860+0000","last_active":"2024-09-21T03:24:32.118361+0000","last_peered":"2024-09-21T03:24:32.118361+0000","last_clean":"2024-09-21T03:24:32.118361+0000","last_became_active":"2024-09-21T03:14:38.472548+0000","last_became_peered":"2024-09-21T03:14:38.472548+0000","last_unstale":"2024-09-21T03:24:32.118361+0000","last_undegraded":"2024-09-21T03:24:32.118361+0000","last_fullsized":"2024-09-21T03:24:32.118361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:16.071692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52273,"num_write_kb":690147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"27'3152","reported_seq":3173,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.268948+0000","last_change":"2024-09-21T03:14:47.557402+0000","last_active":"2024-09-21T03:24:45.268948+0000","last_peered":"2024-09-21T03:24:45.268948+0000","last_clean":"2024-09-21T03:24:45.268948+0000","last_became_active":"2024-09-21T03:14:47.557047+0000","last_became_peered":"2024-09-21T03:14:47.557047+0000","last_unstale":"2024-09-21T03:24:45.268948+0000","last_undegraded":"2024-09-21T03:24:45.268948+0000","last_fullsized":"2024-09-21T03:24:45.268948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3152,"log_dups_size":0,"ondisk_log_size":3152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:29.792514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46003,"num_write_kb":479339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'2575","reported_seq":2604,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.502864+0000","last_change":"2024-09-21T03:14:38.481039+0000","last_active":"2024-09-21T03:24:44.502864+0000","last_peered":"2024-09-21T03:24:44.502864+0000","last_clean":"2024-09-21T03:24:44.502864+0000","last_became_active":"2024-09-21T03:14:38.480686+0000","last_became_peered":"2024-09-21T03:14:38.480686+0000","last_unstale":"2024-09-21T03:24:44.502864+0000","last_undegraded":"2024-09-21T03:24:44.502864+0000","last_fullsized":"2024-09-21T03:24:44.502864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2575,"log_dups_size":0,"ondisk_log_size":2575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:18.603386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37971,"num_write_kb":494263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"27'3593","reported_seq":3614,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.536048+0000","last_change":"2024-09-21T03:14:47.565697+0000","last_active":"2024-09-21T03:24:32.536048+0000","last_peered":"2024-09-21T03:24:32.536048+0000","last_clean":"2024-09-21T03:24:32.536048+0000","last_became_active":"2024-09-21T03:14:47.565393+0000","last_became_peered":"2024-09-21T03:14:47.565393+0000","last_unstale":"2024-09-21T03:24:32.536048+0000","last_undegraded":"2024-09-21T03:24:32.536048+0000","last_fullsized":"2024-09-21T03:24:32.536048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3593,"log_dups_size":0,"ondisk_log_size":3593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:35.421803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52343,"num_write_kb":533323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'2829","reported_seq":2858,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.146488+0000","last_change":"2024-09-21T03:14:38.473900+0000","last_active":"2024-09-21T03:24:32.146488+0000","last_peered":"2024-09-21T03:24:32.146488+0000","last_clean":"2024-09-21T03:24:32.146488+0000","last_became_active":"2024-09-21T03:14:38.471325+0000","last_became_peered":"2024-09-21T03:14:38.471325+0000","last_unstale":"2024-09-21T03:24:32.146488+0000","last_undegraded":"2024-09-21T03:24:32.146488+0000","last_fullsized":"2024-09-21T03:24:32.146488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2829,"log_dups_size":0,"ondisk_log_size":2829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:47.556293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41957,"num_write_kb":531654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"27'2577","reported_seq":2604,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.589169+0000","last_change":"2024-09-21T03:15:15.685059+0000","last_active":"2024-09-21T03:24:32.589169+0000","last_peered":"2024-09-21T03:24:32.589169+0000","last_clean":"2024-09-21T03:24:32.589169+0000","last_became_active":"2024-09-21T03:15:15.684633+0000","last_became_peered":"2024-09-21T03:15:15.684633+0000","last_unstale":"2024-09-21T03:24:32.589169+0000","last_undegraded":"2024-09-21T03:24:32.589169+0000","last_fullsized":"2024-09-21T03:24:32.589169+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2577,"log_dups_size":0,"ondisk_log_size":2577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:22.251366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37382,"num_write_kb":380663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"27'3218","reported_seq":3247,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.489940+0000","last_change":"2024-09-21T03:14:38.478099+0000","last_active":"2024-09-21T03:24:44.489940+0000","last_peered":"2024-09-21T03:24:44.489940+0000","last_clean":"2024-09-21T03:24:44.489940+0000","last_became_active":"2024-09-21T03:14:38.475894+0000","last_became_peered":"2024-09-21T03:14:38.475894+0000","last_unstale":"2024-09-21T03:24:44.489940+0000","last_undegraded":"2024-09-21T03:24:44.489940+0000","last_fullsized":"2024-09-21T03:24:44.489940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3218,"log_dups_size":0,"ondisk_log_size":3218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:49.876430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47546,"num_write_kb":620007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"27'3711","reported_seq":3732,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.587650+0000","last_change":"2024-09-21T03:14:47.556933+0000","last_active":"2024-09-21T03:24:32.587650+0000","last_peered":"2024-09-21T03:24:32.587650+0000","last_clean":"2024-09-21T03:24:32.587650+0000","last_became_active":"2024-09-21T03:14:47.556615+0000","last_became_peered":"2024-09-21T03:14:47.556615+0000","last_unstale":"2024-09-21T03:24:32.587650+0000","last_undegraded":"2024-09-21T03:24:32.587650+0000","last_fullsized":"2024-09-21T03:24:32.587650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3711,"log_dups_size":0,"ondisk_log_size":3711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:27.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54133,"num_write_kb":557757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"27'2798","reported_seq":2827,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.581889+0000","last_change":"2024-09-21T03:14:38.484198+0000","last_active":"2024-09-21T03:24:44.581889+0000","last_peered":"2024-09-21T03:24:44.581889+0000","last_clean":"2024-09-21T03:24:44.581889+0000","last_became_active":"2024-09-21T03:14:38.483893+0000","last_became_peered":"2024-09-21T03:14:38.483893+0000","last_unstale":"2024-09-21T03:24:44.581889+0000","last_undegraded":"2024-09-21T03:24:44.581889+0000","last_fullsized":"2024-09-21T03:24:44.581889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2798,"log_dups_size":0,"ondisk_log_size":2798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:56.665359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41301,"num_write_kb":515809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"27'3224","reported_seq":3245,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.326679+0000","last_change":"2024-09-21T03:14:47.553479+0000","last_active":"2024-09-21T03:24:45.326679+0000","last_peered":"2024-09-21T03:24:45.326679+0000","last_clean":"2024-09-21T03:24:45.326679+0000","last_became_active":"2024-09-21T03:14:47.553144+0000","last_became_peered":"2024-09-21T03:14:47.553144+0000","last_unstale":"2024-09-21T03:24:45.326679+0000","last_undegraded":"2024-09-21T03:24:45.326679+0000","last_fullsized":"2024-09-21T03:24:45.326679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3224,"log_dups_size":0,"ondisk_log_size":3224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:26.321488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46752,"num_write_kb":476180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'3507","reported_seq":3536,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.533411+0000","last_change":"2024-09-21T03:14:38.487093+0000","last_active":"2024-09-21T03:24:44.533411+0000","last_peered":"2024-09-21T03:24:44.533411+0000","last_clean":"2024-09-21T03:24:44.533411+0000","last_became_active":"2024-09-21T03:14:38.486204+0000","last_became_peered":"2024-09-21T03:14:38.486204+0000","last_unstale":"2024-09-21T03:24:44.533411+0000","last_undegraded":"2024-09-21T03:24:44.533411+0000","last_fullsized":"2024-09-21T03:24:44.533411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3507,"log_dups_size":0,"ondisk_log_size":3507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:55.531046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51770,"num_write_kb":667306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"27'2344","reported_seq":2365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.614027+0000","last_change":"2024-09-21T03:14:47.573375+0000","last_active":"2024-09-21T03:24:32.614027+0000","last_peered":"2024-09-21T03:24:32.614027+0000","last_clean":"2024-09-21T03:24:32.614027+0000","last_became_active":"2024-09-21T03:14:47.572717+0000","last_became_peered":"2024-09-21T03:14:47.572717+0000","last_unstale":"2024-09-21T03:24:32.614027+0000","last_undegraded":"2024-09-21T03:24:32.614027+0000","last_fullsized":"2024-09-21T03:24:32.614027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2344,"log_dups_size":0,"ondisk_log_size":2344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:44.673283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33818,"num_write_kb":353403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"27'2605","reported_seq":2634,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.218196+0000","last_change":"2024-09-21T03:14:38.471959+0000","last_active":"2024-09-21T03:24:32.218196+0000","last_peered":"2024-09-21T03:24:32.218196+0000","last_clean":"2024-09-21T03:24:32.218196+0000","last_became_active":"2024-09-21T03:14:38.471625+0000","last_became_peered":"2024-09-21T03:14:38.471625+0000","last_unstale":"2024-09-21T03:24:32.218196+0000","last_undegraded":"2024-09-21T03:24:32.218196+0000","last_fullsized":"2024-09-21T03:24:32.218196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2605,"log_dups_size":0,"ondisk_log_size":2605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:17.761951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38420,"num_write_kb":499975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"27'3509","reported_seq":3530,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.550591+0000","last_change":"2024-09-21T03:14:47.564597+0000","last_active":"2024-09-21T03:24:32.550591+0000","last_peered":"2024-09-21T03:24:32.550591+0000","last_clean":"2024-09-21T03:24:32.550591+0000","last_became_active":"2024-09-21T03:14:47.563816+0000","last_became_peered":"2024-09-21T03:14:47.563816+0000","last_unstale":"2024-09-21T03:24:32.550591+0000","last_undegraded":"2024-09-21T03:24:32.550591+0000","last_fullsized":"2024-09-21T03:24:32.550591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3509,"log_dups_size":0,"ondisk_log_size":3509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:33.061271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50894,"num_write_kb":526303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'3043","reported_seq":3072,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.530608+0000","last_change":"2024-09-21T03:14:38.491888+0000","last_active":"2024-09-21T03:24:44.530608+0000","last_peered":"2024-09-21T03:24:44.530608+0000","last_clean":"2024-09-21T03:24:44.530608+0000","last_became_active":"2024-09-21T03:14:38.491510+0000","last_became_peered":"2024-09-21T03:14:38.491510+0000","last_unstale":"2024-09-21T03:24:44.530608+0000","last_undegraded":"2024-09-21T03:24:44.530608+0000","last_fullsized":"2024-09-21T03:24:44.530608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3043,"log_dups_size":0,"ondisk_log_size":3043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:26.740304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44704,"num_write_kb":573613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"27'2891","reported_seq":2912,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.592034+0000","last_change":"2024-09-21T03:14:47.564310+0000","last_active":"2024-09-21T03:24:32.592034+0000","last_peered":"2024-09-21T03:24:32.592034+0000","last_clean":"2024-09-21T03:24:32.592034+0000","last_became_active":"2024-09-21T03:14:47.564003+0000","last_became_peered":"2024-09-21T03:14:47.564003+0000","last_unstale":"2024-09-21T03:24:32.592034+0000","last_undegraded":"2024-09-21T03:24:32.592034+0000","last_fullsized":"2024-09-21T03:24:32.592034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2891,"log_dups_size":0,"ondisk_log_size":2891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:45.016321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42050,"num_write_kb":436747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"27'3507","reported_seq":3536,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.499180+0000","last_change":"2024-09-21T03:14:38.470991+0000","last_active":"2024-09-21T03:24:44.499180+0000","last_peered":"2024-09-21T03:24:44.499180+0000","last_clean":"2024-09-21T03:24:44.499180+0000","last_became_active":"2024-09-21T03:14:38.470666+0000","last_became_peered":"2024-09-21T03:14:38.470666+0000","last_unstale":"2024-09-21T03:24:44.499180+0000","last_undegraded":"2024-09-21T03:24:44.499180+0000","last_fullsized":"2024-09-21T03:24:44.499180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3507,"log_dups_size":0,"ondisk_log_size":3507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:25.477992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51813,"num_write_kb":639602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"27'2972","reported_seq":2993,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.605743+0000","last_change":"2024-09-21T03:14:47.575212+0000","last_active":"2024-09-21T03:24:32.605743+0000","last_peered":"2024-09-21T03:24:32.605743+0000","last_clean":"2024-09-21T03:24:32.605743+0000","last_became_active":"2024-09-21T03:14:47.574895+0000","last_became_peered":"2024-09-21T03:14:47.574895+0000","last_unstale":"2024-09-21T03:24:32.605743+0000","last_undegraded":"2024-09-21T03:24:32.605743+0000","last_fullsized":"2024-09-21T03:24:32.605743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2972,"log_dups_size":0,"ondisk_log_size":2972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:04.240949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43060,"num_write_kb":442689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"27'2924","reported_seq":2953,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.506322+0000","last_change":"2024-09-21T03:14:38.482681+0000","last_active":"2024-09-21T03:24:44.506322+0000","last_peered":"2024-09-21T03:24:44.506322+0000","last_clean":"2024-09-21T03:24:44.506322+0000","last_became_active":"2024-09-21T03:14:38.477816+0000","last_became_peered":"2024-09-21T03:14:38.477816+0000","last_unstale":"2024-09-21T03:24:44.506322+0000","last_undegraded":"2024-09-21T03:24:44.506322+0000","last_fullsized":"2024-09-21T03:24:44.506322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2924,"log_dups_size":0,"ondisk_log_size":2924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:18.675641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42673,"num_write_kb":583298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"27'3308","reported_seq":3329,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.339081+0000","last_change":"2024-09-21T03:14:47.555329+0000","last_active":"2024-09-21T03:24:45.339081+0000","last_peered":"2024-09-21T03:24:45.339081+0000","last_clean":"2024-09-21T03:24:45.339081+0000","last_became_active":"2024-09-21T03:14:47.555033+0000","last_became_peered":"2024-09-21T03:14:47.555033+0000","last_unstale":"2024-09-21T03:24:45.339081+0000","last_undegraded":"2024-09-21T03:24:45.339081+0000","last_fullsized":"2024-09-21T03:24:45.339081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3308,"log_dups_size":0,"ondisk_log_size":3308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:49.060834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48400,"num_write_kb":492898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"27'3018","reported_seq":3047,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.545961+0000","last_change":"2024-09-21T03:14:38.480638+0000","last_active":"2024-09-21T03:24:44.545961+0000","last_peered":"2024-09-21T03:24:44.545961+0000","last_clean":"2024-09-21T03:24:44.545961+0000","last_became_active":"2024-09-21T03:14:38.477739+0000","last_became_peered":"2024-09-21T03:14:38.477739+0000","last_unstale":"2024-09-21T03:24:44.545961+0000","last_undegraded":"2024-09-21T03:24:44.545961+0000","last_fullsized":"2024-09-21T03:24:44.545961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3018,"log_dups_size":0,"ondisk_log_size":3018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:35.097761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44651,"num_write_kb":569943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"27'3044","reported_seq":3065,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.602093+0000","last_change":"2024-09-21T03:14:47.573659+0000","last_active":"2024-09-21T03:24:32.602093+0000","last_peered":"2024-09-21T03:24:32.602093+0000","last_clean":"2024-09-21T03:24:32.602093+0000","last_became_active":"2024-09-21T03:14:47.572756+0000","last_became_peered":"2024-09-21T03:14:47.572756+0000","last_unstale":"2024-09-21T03:24:32.602093+0000","last_undegraded":"2024-09-21T03:24:32.602093+0000","last_fullsized":"2024-09-21T03:24:32.602093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3044,"log_dups_size":0,"ondisk_log_size":3044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:21.986681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44174,"num_write_kb":452226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'3117","reported_seq":3150,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.257690+0000","last_change":"2024-09-21T03:19:03.558825+0000","last_active":"2024-09-21T03:24:32.257690+0000","last_peered":"2024-09-21T03:24:32.257690+0000","last_clean":"2024-09-21T03:24:32.257690+0000","last_became_active":"2024-09-21T03:14:38.473843+0000","last_became_peered":"2024-09-21T03:14:38.473843+0000","last_unstale":"2024-09-21T03:24:32.257690+0000","last_undegraded":"2024-09-21T03:24:32.257690+0000","last_fullsized":"2024-09-21T03:24:32.257690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3117,"log_dups_size":0,"ondisk_log_size":3117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:27.072406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46022,"num_write_kb":573473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"27'2638","reported_seq":2659,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.342961+0000","last_change":"2024-09-21T03:14:47.555386+0000","last_active":"2024-09-21T03:24:45.342961+0000","last_peered":"2024-09-21T03:24:45.342961+0000","last_clean":"2024-09-21T03:24:45.342961+0000","last_became_active":"2024-09-21T03:14:47.554758+0000","last_became_peered":"2024-09-21T03:14:47.554758+0000","last_unstale":"2024-09-21T03:24:45.342961+0000","last_undegraded":"2024-09-21T03:24:45.342961+0000","last_fullsized":"2024-09-21T03:24:45.342961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2638,"log_dups_size":0,"ondisk_log_size":2638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:47.574672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38196,"num_write_kb":393191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"27'2520","reported_seq":2549,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.240443+0000","last_change":"2024-09-21T03:14:38.494878+0000","last_active":"2024-09-21T03:24:32.240443+0000","last_peered":"2024-09-21T03:24:32.240443+0000","last_clean":"2024-09-21T03:24:32.240443+0000","last_became_active":"2024-09-21T03:14:38.492813+0000","last_became_peered":"2024-09-21T03:14:38.492813+0000","last_unstale":"2024-09-21T03:24:32.240443+0000","last_undegraded":"2024-09-21T03:24:32.240443+0000","last_fullsized":"2024-09-21T03:24:32.240443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2520,"log_dups_size":0,"ondisk_log_size":2520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:55.064844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37062,"num_write_kb":456367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"27'2959","reported_seq":2980,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.443568+0000","last_change":"2024-09-21T03:14:47.544806+0000","last_active":"2024-09-21T03:24:32.443568+0000","last_peered":"2024-09-21T03:24:32.443568+0000","last_clean":"2024-09-21T03:24:32.443568+0000","last_became_active":"2024-09-21T03:14:47.544431+0000","last_became_peered":"2024-09-21T03:14:47.544431+0000","last_unstale":"2024-09-21T03:24:32.443568+0000","last_undegraded":"2024-09-21T03:24:32.443568+0000","last_fullsized":"2024-09-21T03:24:32.443568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2959,"log_dups_size":0,"ondisk_log_size":2959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:01.463573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43240,"num_write_kb":437209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"27'3812","reported_seq":3841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.129705+0000","last_change":"2024-09-21T03:14:38.474462+0000","last_active":"2024-09-21T03:24:32.129705+0000","last_peered":"2024-09-21T03:24:32.129705+0000","last_clean":"2024-09-21T03:24:32.129705+0000","last_became_active":"2024-09-21T03:14:38.474156+0000","last_became_peered":"2024-09-21T03:14:38.474156+0000","last_unstale":"2024-09-21T03:24:32.129705+0000","last_undegraded":"2024-09-21T03:24:32.129705+0000","last_fullsized":"2024-09-21T03:24:32.129705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3812,"log_dups_size":0,"ondisk_log_size":3812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:55.329945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56526,"num_write_kb":700246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"27'3385","reported_seq":3406,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.368613+0000","last_change":"2024-09-21T03:14:47.563297+0000","last_active":"2024-09-21T03:24:45.368613+0000","last_peered":"2024-09-21T03:24:45.368613+0000","last_clean":"2024-09-21T03:24:45.368613+0000","last_became_active":"2024-09-21T03:14:47.562519+0000","last_became_peered":"2024-09-21T03:14:47.562519+0000","last_unstale":"2024-09-21T03:24:45.368613+0000","last_undegraded":"2024-09-21T03:24:45.368613+0000","last_fullsized":"2024-09-21T03:24:45.368613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3385,"log_dups_size":0,"ondisk_log_size":3385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:47.959373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49240,"num_write_kb":516390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"27'2612","reported_seq":2641,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.135783+0000","last_change":"2024-09-21T03:14:38.474262+0000","last_active":"2024-09-21T03:24:32.135783+0000","last_peered":"2024-09-21T03:24:32.135783+0000","last_clean":"2024-09-21T03:24:32.135783+0000","last_became_active":"2024-09-21T03:14:38.473856+0000","last_became_peered":"2024-09-21T03:14:38.473856+0000","last_unstale":"2024-09-21T03:24:32.135783+0000","last_undegraded":"2024-09-21T03:24:32.135783+0000","last_fullsized":"2024-09-21T03:24:32.135783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2612,"log_dups_size":0,"ondisk_log_size":2612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38668,"num_write_kb":516995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"27'3697","reported_seq":3718,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.352816+0000","last_change":"2024-09-21T03:14:47.558732+0000","last_active":"2024-09-21T03:24:45.352816+0000","last_peered":"2024-09-21T03:24:45.352816+0000","last_clean":"2024-09-21T03:24:45.352816+0000","last_became_active":"2024-09-21T03:14:47.558403+0000","last_became_peered":"2024-09-21T03:14:47.558403+0000","last_unstale":"2024-09-21T03:24:45.352816+0000","last_undegraded":"2024-09-21T03:24:45.352816+0000","last_fullsized":"2024-09-21T03:24:45.352816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3697,"log_dups_size":0,"ondisk_log_size":3697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:46.054565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53973,"num_write_kb":552799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"27'3262","reported_seq":3291,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.523225+0000","last_change":"2024-09-21T03:14:38.469736+0000","last_active":"2024-09-21T03:24:44.523225+0000","last_peered":"2024-09-21T03:24:44.523225+0000","last_clean":"2024-09-21T03:24:44.523225+0000","last_became_active":"2024-09-21T03:14:38.469240+0000","last_became_peered":"2024-09-21T03:14:38.469240+0000","last_unstale":"2024-09-21T03:24:44.523225+0000","last_undegraded":"2024-09-21T03:24:44.523225+0000","last_fullsized":"2024-09-21T03:24:44.523225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3262,"log_dups_size":0,"ondisk_log_size":3262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:04.258761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48009,"num_write_kb":600153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"27'2369","reported_seq":2390,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.327627+0000","last_change":"2024-09-21T03:14:47.550684+0000","last_active":"2024-09-21T03:24:45.327627+0000","last_peered":"2024-09-21T03:24:45.327627+0000","last_clean":"2024-09-21T03:24:45.327627+0000","last_became_active":"2024-09-21T03:14:47.550375+0000","last_became_peered":"2024-09-21T03:14:47.550375+0000","last_unstale":"2024-09-21T03:24:45.327627+0000","last_undegraded":"2024-09-21T03:24:45.327627+0000","last_fullsized":"2024-09-21T03:24:45.327627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2369,"log_dups_size":0,"ondisk_log_size":2369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:05.268160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34335,"num_write_kb":360179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'3448","reported_seq":3477,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.462241+0000","last_change":"2024-09-21T03:14:38.487983+0000","last_active":"2024-09-21T03:24:44.462241+0000","last_peered":"2024-09-21T03:24:44.462241+0000","last_clean":"2024-09-21T03:24:44.462241+0000","last_became_active":"2024-09-21T03:14:38.487676+0000","last_became_peered":"2024-09-21T03:14:38.487676+0000","last_unstale":"2024-09-21T03:24:44.462241+0000","last_undegraded":"2024-09-21T03:24:44.462241+0000","last_fullsized":"2024-09-21T03:24:44.462241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3448,"log_dups_size":0,"ondisk_log_size":3448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:35.320169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50832,"num_write_kb":624952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"27'2804","reported_seq":2831,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.490480+0000","last_change":"2024-09-21T03:19:03.558582+0000","last_active":"2024-09-21T03:24:32.490480+0000","last_peered":"2024-09-21T03:24:32.490480+0000","last_clean":"2024-09-21T03:24:32.490480+0000","last_became_active":"2024-09-21T03:14:47.561229+0000","last_became_peered":"2024-09-21T03:14:47.561229+0000","last_unstale":"2024-09-21T03:24:32.490480+0000","last_undegraded":"2024-09-21T03:24:32.490480+0000","last_fullsized":"2024-09-21T03:24:32.490480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2804,"log_dups_size":0,"ondisk_log_size":2804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:07.280356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40720,"num_write_kb":419729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"27'2665","reported_seq":2689,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.480308+0000","last_change":"2024-09-21T03:14:38.478853+0000","last_active":"2024-09-21T03:24:44.480308+0000","last_peered":"2024-09-21T03:24:44.480308+0000","last_clean":"2024-09-21T03:24:44.480308+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:24:44.480308+0000","last_undegraded":"2024-09-21T03:24:44.480308+0000","last_fullsized":"2024-09-21T03:24:44.480308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2665,"log_dups_size":0,"ondisk_log_size":2665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:31.427596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39018,"num_write_kb":519966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"27'3111","reported_seq":3126,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.629652+0000","last_change":"2024-09-21T03:15:15.686915+0000","last_active":"2024-09-21T03:24:32.629652+0000","last_peered":"2024-09-21T03:24:32.629652+0000","last_clean":"2024-09-21T03:24:32.629652+0000","last_became_active":"2024-09-21T03:15:15.686514+0000","last_became_peered":"2024-09-21T03:15:15.686514+0000","last_unstale":"2024-09-21T03:24:32.629652+0000","last_undegraded":"2024-09-21T03:24:32.629652+0000","last_fullsized":"2024-09-21T03:24:32.629652+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3111,"log_dups_size":0,"ondisk_log_size":3111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:46.388388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45367,"num_write_kb":462728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'2758","reported_seq":2787,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.545827+0000","last_change":"2024-09-21T03:14:38.481308+0000","last_active":"2024-09-21T03:24:44.545827+0000","last_peered":"2024-09-21T03:24:44.545827+0000","last_clean":"2024-09-21T03:24:44.545827+0000","last_became_active":"2024-09-21T03:14:38.480923+0000","last_became_peered":"2024-09-21T03:14:38.480923+0000","last_unstale":"2024-09-21T03:24:44.545827+0000","last_undegraded":"2024-09-21T03:24:44.545827+0000","last_fullsized":"2024-09-21T03:24:44.545827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2758,"log_dups_size":0,"ondisk_log_size":2758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:40.689231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40836,"num_write_kb":498819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"27'2747","reported_seq":2768,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.606907+0000","last_change":"2024-09-21T03:14:47.561972+0000","last_active":"2024-09-21T03:24:32.606907+0000","last_peered":"2024-09-21T03:24:32.606907+0000","last_clean":"2024-09-21T03:24:32.606907+0000","last_became_active":"2024-09-21T03:14:47.561645+0000","last_became_peered":"2024-09-21T03:14:47.561645+0000","last_unstale":"2024-09-21T03:24:32.606907+0000","last_undegraded":"2024-09-21T03:24:32.606907+0000","last_fullsized":"2024-09-21T03:24:32.606907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2747,"log_dups_size":0,"ondisk_log_size":2747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:57.526787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40136,"num_write_kb":410250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"27'2791","reported_seq":2820,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.537487+0000","last_change":"2024-09-21T03:14:38.473907+0000","last_active":"2024-09-21T03:24:44.537487+0000","last_peered":"2024-09-21T03:24:44.537487+0000","last_clean":"2024-09-21T03:24:44.537487+0000","last_became_active":"2024-09-21T03:14:38.473579+0000","last_became_peered":"2024-09-21T03:14:38.473579+0000","last_unstale":"2024-09-21T03:24:44.537487+0000","last_undegraded":"2024-09-21T03:24:44.537487+0000","last_fullsized":"2024-09-21T03:24:44.537487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2791,"log_dups_size":0,"ondisk_log_size":2791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:32.273503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41232,"num_write_kb":540257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"27'2612","reported_seq":2633,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.554999+0000","last_change":"2024-09-21T03:14:47.566089+0000","last_active":"2024-09-21T03:24:32.554999+0000","last_peered":"2024-09-21T03:24:32.554999+0000","last_clean":"2024-09-21T03:24:32.554999+0000","last_became_active":"2024-09-21T03:14:47.565681+0000","last_became_peered":"2024-09-21T03:14:47.565681+0000","last_unstale":"2024-09-21T03:24:32.554999+0000","last_undegraded":"2024-09-21T03:24:32.554999+0000","last_fullsized":"2024-09-21T03:24:32.554999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2612,"log_dups_size":0,"ondisk_log_size":2612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.208933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37892,"num_write_kb":397863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'3465","reported_seq":3494,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.561747+0000","last_change":"2024-09-21T03:14:38.474326+0000","last_active":"2024-09-21T03:24:44.561747+0000","last_peered":"2024-09-21T03:24:44.561747+0000","last_clean":"2024-09-21T03:24:44.561747+0000","last_became_active":"2024-09-21T03:14:38.470430+0000","last_became_peered":"2024-09-21T03:14:38.470430+0000","last_unstale":"2024-09-21T03:24:44.561747+0000","last_undegraded":"2024-09-21T03:24:44.561747+0000","last_fullsized":"2024-09-21T03:24:44.561747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3465,"log_dups_size":0,"ondisk_log_size":3465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:09.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51200,"num_write_kb":673726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"27'2988","reported_seq":3009,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.590714+0000","last_change":"2024-09-21T03:14:47.571487+0000","last_active":"2024-09-21T03:24:32.590714+0000","last_peered":"2024-09-21T03:24:32.590714+0000","last_clean":"2024-09-21T03:24:32.590714+0000","last_became_active":"2024-09-21T03:14:47.571126+0000","last_became_peered":"2024-09-21T03:14:47.571126+0000","last_unstale":"2024-09-21T03:24:32.590714+0000","last_undegraded":"2024-09-21T03:24:32.590714+0000","last_fullsized":"2024-09-21T03:24:32.590714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2988,"log_dups_size":0,"ondisk_log_size":2988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:57.128853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43649,"num_write_kb":455041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'4015","reported_seq":4044,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.555332+0000","last_change":"2024-09-21T03:14:38.483370+0000","last_active":"2024-09-21T03:24:44.555332+0000","last_peered":"2024-09-21T03:24:44.555332+0000","last_clean":"2024-09-21T03:24:44.555332+0000","last_became_active":"2024-09-21T03:14:38.483019+0000","last_became_peered":"2024-09-21T03:14:38.483019+0000","last_unstale":"2024-09-21T03:24:44.555332+0000","last_undegraded":"2024-09-21T03:24:44.555332+0000","last_fullsized":"2024-09-21T03:24:44.555332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:55.085422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59359,"num_write_kb":743455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"27'3951","reported_seq":3972,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.348230+0000","last_change":"2024-09-21T03:14:47.555777+0000","last_active":"2024-09-21T03:24:45.348230+0000","last_peered":"2024-09-21T03:24:45.348230+0000","last_clean":"2024-09-21T03:24:45.348230+0000","last_became_active":"2024-09-21T03:14:47.555465+0000","last_became_peered":"2024-09-21T03:14:47.555465+0000","last_unstale":"2024-09-21T03:24:45.348230+0000","last_undegraded":"2024-09-21T03:24:45.348230+0000","last_fullsized":"2024-09-21T03:24:45.348230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3951,"log_dups_size":0,"ondisk_log_size":3951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:27.123740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57951,"num_write_kb":584164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"27'3369","reported_seq":3398,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.537637+0000","last_change":"2024-09-21T03:14:38.465771+0000","last_active":"2024-09-21T03:24:44.537637+0000","last_peered":"2024-09-21T03:24:44.537637+0000","last_clean":"2024-09-21T03:24:44.537637+0000","last_became_active":"2024-09-21T03:14:38.465479+0000","last_became_peered":"2024-09-21T03:14:38.465479+0000","last_unstale":"2024-09-21T03:24:44.537637+0000","last_undegraded":"2024-09-21T03:24:44.537637+0000","last_fullsized":"2024-09-21T03:24:44.537637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3369,"log_dups_size":0,"ondisk_log_size":3369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.754315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50038,"num_write_kb":621750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"27'2525","reported_seq":2546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.263614+0000","last_change":"2024-09-21T03:14:47.567695+0000","last_active":"2024-09-21T03:24:45.263614+0000","last_peered":"2024-09-21T03:24:45.263614+0000","last_clean":"2024-09-21T03:24:45.263614+0000","last_became_active":"2024-09-21T03:14:47.566936+0000","last_became_peered":"2024-09-21T03:14:47.566936+0000","last_unstale":"2024-09-21T03:24:45.263614+0000","last_undegraded":"2024-09-21T03:24:45.263614+0000","last_fullsized":"2024-09-21T03:24:45.263614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2525,"log_dups_size":0,"ondisk_log_size":2525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:48.182523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36538,"num_write_kb":381931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"27'2953","reported_seq":2967,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.268218+0000","last_change":"2024-09-21T03:15:15.807206+0000","last_active":"2024-09-21T03:24:32.268218+0000","last_peered":"2024-09-21T03:24:32.268218+0000","last_clean":"2024-09-21T03:24:32.268218+0000","last_became_active":"2024-09-21T03:15:15.806775+0000","last_became_peered":"2024-09-21T03:15:15.806775+0000","last_unstale":"2024-09-21T03:24:32.268218+0000","last_undegraded":"2024-09-21T03:24:32.268218+0000","last_fullsized":"2024-09-21T03:24:32.268218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2953,"log_dups_size":0,"ondisk_log_size":2953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:51.779236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43828,"num_write_kb":561683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"27'2681","reported_seq":2702,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.331920+0000","last_change":"2024-09-21T03:14:47.580314+0000","last_active":"2024-09-21T03:24:45.331920+0000","last_peered":"2024-09-21T03:24:45.331920+0000","last_clean":"2024-09-21T03:24:45.331920+0000","last_became_active":"2024-09-21T03:14:47.576499+0000","last_became_peered":"2024-09-21T03:14:47.576499+0000","last_unstale":"2024-09-21T03:24:45.331920+0000","last_undegraded":"2024-09-21T03:24:45.331920+0000","last_fullsized":"2024-09-21T03:24:45.331920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2681,"log_dups_size":0,"ondisk_log_size":2681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:46.154586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39028,"num_write_kb":398421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2546","reported_seq":2577,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.467976+0000","last_change":"2024-09-21T03:18:52.426898+0000","last_active":"2024-09-21T03:24:44.467976+0000","last_peered":"2024-09-21T03:24:44.467976+0000","last_clean":"2024-09-21T03:24:44.467976+0000","last_became_active":"2024-09-21T03:14:38.470708+0000","last_became_peered":"2024-09-21T03:14:38.470708+0000","last_unstale":"2024-09-21T03:24:44.467976+0000","last_undegraded":"2024-09-21T03:24:44.467976+0000","last_fullsized":"2024-09-21T03:24:44.467976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2546,"log_dups_size":0,"ondisk_log_size":2546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.122804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37433,"num_write_kb":500133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"27'3017","reported_seq":3038,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.328059+0000","last_change":"2024-09-21T03:14:47.554180+0000","last_active":"2024-09-21T03:24:45.328059+0000","last_peered":"2024-09-21T03:24:45.328059+0000","last_clean":"2024-09-21T03:24:45.328059+0000","last_became_active":"2024-09-21T03:14:47.552808+0000","last_became_peered":"2024-09-21T03:14:47.552808+0000","last_unstale":"2024-09-21T03:24:45.328059+0000","last_undegraded":"2024-09-21T03:24:45.328059+0000","last_fullsized":"2024-09-21T03:24:45.328059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3017,"log_dups_size":0,"ondisk_log_size":3017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:07.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43808,"num_write_kb":448579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"27'3592","reported_seq":3621,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.559429+0000","last_change":"2024-09-21T03:14:38.466077+0000","last_active":"2024-09-21T03:24:44.559429+0000","last_peered":"2024-09-21T03:24:44.559429+0000","last_clean":"2024-09-21T03:24:44.559429+0000","last_became_active":"2024-09-21T03:14:38.465818+0000","last_became_peered":"2024-09-21T03:14:38.465818+0000","last_unstale":"2024-09-21T03:24:44.559429+0000","last_undegraded":"2024-09-21T03:24:44.559429+0000","last_fullsized":"2024-09-21T03:24:44.559429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:34.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52996,"num_write_kb":671880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"27'2557","reported_seq":2577,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.462202+0000","last_change":"2024-09-21T03:14:47.577228+0000","last_active":"2024-09-21T03:24:32.462202+0000","last_peered":"2024-09-21T03:24:32.462202+0000","last_clean":"2024-09-21T03:24:32.462202+0000","last_became_active":"2024-09-21T03:14:47.576843+0000","last_became_peered":"2024-09-21T03:14:47.576843+0000","last_unstale":"2024-09-21T03:24:32.462202+0000","last_undegraded":"2024-09-21T03:24:32.462202+0000","last_fullsized":"2024-09-21T03:24:32.462202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2557,"log_dups_size":0,"ondisk_log_size":2557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:56.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37386,"num_write_kb":384305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'2860","reported_seq":2889,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.484484+0000","last_change":"2024-09-21T03:14:38.481389+0000","last_active":"2024-09-21T03:24:44.484484+0000","last_peered":"2024-09-21T03:24:44.484484+0000","last_clean":"2024-09-21T03:24:44.484484+0000","last_became_active":"2024-09-21T03:14:38.470907+0000","last_became_peered":"2024-09-21T03:14:38.470907+0000","last_unstale":"2024-09-21T03:24:44.484484+0000","last_undegraded":"2024-09-21T03:24:44.484484+0000","last_fullsized":"2024-09-21T03:24:44.484484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:30.068915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42241,"num_write_kb":536469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"27'3455","reported_seq":3475,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.317264+0000","last_change":"2024-09-21T03:14:47.551766+0000","last_active":"2024-09-21T03:24:45.317264+0000","last_peered":"2024-09-21T03:24:45.317264+0000","last_clean":"2024-09-21T03:24:45.317264+0000","last_became_active":"2024-09-21T03:14:47.551420+0000","last_became_peered":"2024-09-21T03:14:47.551420+0000","last_unstale":"2024-09-21T03:24:45.317264+0000","last_undegraded":"2024-09-21T03:24:45.317264+0000","last_fullsized":"2024-09-21T03:24:45.317264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3455,"log_dups_size":0,"ondisk_log_size":3455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:56.255472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50161,"num_write_kb":520876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'3215","reported_seq":3246,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.506746+0000","last_change":"2024-09-21T03:19:03.596591+0000","last_active":"2024-09-21T03:24:44.506746+0000","last_peered":"2024-09-21T03:24:44.506746+0000","last_clean":"2024-09-21T03:24:44.506746+0000","last_became_active":"2024-09-21T03:14:38.482306+0000","last_became_peered":"2024-09-21T03:14:38.482306+0000","last_unstale":"2024-09-21T03:24:44.506746+0000","last_undegraded":"2024-09-21T03:24:44.506746+0000","last_fullsized":"2024-09-21T03:24:44.506746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3215,"log_dups_size":0,"ondisk_log_size":3215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:40.482635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47543,"num_write_kb":599147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"27'3010","reported_seq":3031,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.350470+0000","last_change":"2024-09-21T03:14:47.555070+0000","last_active":"2024-09-21T03:24:45.350470+0000","last_peered":"2024-09-21T03:24:45.350470+0000","last_clean":"2024-09-21T03:24:45.350470+0000","last_became_active":"2024-09-21T03:14:47.554363+0000","last_became_peered":"2024-09-21T03:14:47.554363+0000","last_unstale":"2024-09-21T03:24:45.350470+0000","last_undegraded":"2024-09-21T03:24:45.350470+0000","last_fullsized":"2024-09-21T03:24:45.350470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3010,"log_dups_size":0,"ondisk_log_size":3010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:40.027266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43824,"num_write_kb":461158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"27'3736","reported_seq":3765,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.476290+0000","last_change":"2024-09-21T03:14:38.496218+0000","last_active":"2024-09-21T03:24:44.476290+0000","last_peered":"2024-09-21T03:24:44.476290+0000","last_clean":"2024-09-21T03:24:44.476290+0000","last_became_active":"2024-09-21T03:14:38.488537+0000","last_became_peered":"2024-09-21T03:14:38.488537+0000","last_unstale":"2024-09-21T03:24:44.476290+0000","last_undegraded":"2024-09-21T03:24:44.476290+0000","last_fullsized":"2024-09-21T03:24:44.476290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3736,"log_dups_size":0,"ondisk_log_size":3736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:59.667392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55343,"num_write_kb":720948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"27'2851","reported_seq":2871,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.330638+0000","last_change":"2024-09-21T03:14:47.564250+0000","last_active":"2024-09-21T03:24:45.330638+0000","last_peered":"2024-09-21T03:24:45.330638+0000","last_clean":"2024-09-21T03:24:45.330638+0000","last_became_active":"2024-09-21T03:14:47.563745+0000","last_became_peered":"2024-09-21T03:14:47.563745+0000","last_unstale":"2024-09-21T03:24:45.330638+0000","last_undegraded":"2024-09-21T03:24:45.330638+0000","last_fullsized":"2024-09-21T03:24:45.330638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2851,"log_dups_size":0,"ondisk_log_size":2851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:31.282910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41602,"num_write_kb":429183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"27'2879","reported_seq":2908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.572686+0000","last_change":"2024-09-21T03:14:38.490309+0000","last_active":"2024-09-21T03:24:44.572686+0000","last_peered":"2024-09-21T03:24:44.572686+0000","last_clean":"2024-09-21T03:24:44.572686+0000","last_became_active":"2024-09-21T03:14:38.489167+0000","last_became_peered":"2024-09-21T03:14:38.489167+0000","last_unstale":"2024-09-21T03:24:44.572686+0000","last_undegraded":"2024-09-21T03:24:44.572686+0000","last_fullsized":"2024-09-21T03:24:44.572686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:07.725691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42623,"num_write_kb":515303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2771405,"num_write_kb":28539810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190546,"ondisk_log_size":190546,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":104689166,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":31,"num_read_kb":107,"num_write":3090,"num_write_kb":104327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":209436672,"data_stored":209378256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2754,"ondisk_log_size":2754,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2958225,"num_write_kb":37437445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200210,"ondisk_log_size":200210,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":158267982,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":29,"num_read_kb":105,"num_write":2794,"num_write_kb":156528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":316596224,"data_stored":316535791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2584,"ondisk_log_size":2584,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509566,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379144,"kb_used_data":41336,"kb_used_omap":1,"kb_used_meta":337790,"kb_avail":93992696,"statfs":{"total":96636764160,"available":96248520704,"internally_reserved":0,"allocated":42328064,"data_stored":42145705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":345897418},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509562,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":538640,"kb_used_data":66240,"kb_used_omap":1,"kb_used_meta":472382,"kb_avail":93833200,"statfs":{"total":96636764160,"available":96085196800,"internally_reserved":0,"allocated":67829760,"data_stored":67644264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":483719621},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509561,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":562860,"kb_used_data":84892,"kb_used_omap":1,"kb_used_meta":477950,"kb_avail":93808980,"statfs":{"total":96636764160,"available":96060395520,"internally_reserved":0,"allocated":86929408,"data_stored":86733407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":489421253},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509562,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":616200,"kb_used_data":61816,"kb_used_omap":1,"kb_used_meta":554366,"kb_avail":93755640,"statfs":{"total":96636764160,"available":96005775360,"internally_reserved":0,"allocated":63299584,"data_stored":63117886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":567671237},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509565,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468272,"kb_used_data":54112,"kb_used_omap":1,"kb_used_meta":414142,"kb_avail":93903568,"statfs":{"total":96636764160,"available":96157253632,"internally_reserved":0,"allocated":55410688,"data_stored":55230899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":424081861},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509563,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":592432,"kb_used_data":61728,"kb_used_omap":1,"kb_used_meta":530686,"kb_avail":93779408,"statfs":{"total":96636764160,"available":96030113792,"internally_reserved":0,"allocated":63209472,"data_stored":63029145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":543422917},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,1,21],"upper_bound":32},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542267,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":477548,"kb_used_data":45340,"kb_used_omap":1,"kb_used_meta":432190,"kb_avail":93894292,"statfs":{"total":96636764160,"available":96147755008,"internally_reserved":0,"allocated":46428160,"data_stored":46252455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":442563014},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542265,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":583800,"kb_used_data":101608,"kb_used_omap":1,"kb_used_meta":482174,"kb_avail":93788040,"statfs":{"total":96636764160,"available":96038952960,"internally_reserved":0,"allocated":104046592,"data_stored":103856285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":493746631},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":62922752,"data_stored":62914616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33558528,"data_stored":33554502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65908736,"data_stored":65904153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":44949504,"data_stored":44933568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":37847040,"data_stored":37836908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25264128,"data_stored":25254028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37842944,"data_stored":37836951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37855232,"data_stored":37837693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":41697280,"data_stored":41685573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29106176,"data_stored":29102625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:24:47.774 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:24:48.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.027+0000 7f361cc00640 1 -- 172.21.15.90:0/2439940717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f361806d960 msgr2=0x7f361813dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:48.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.027+0000 7f361cc00640 1 --2- 172.21.15.90:0/2439940717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f361806d960 0x7f361813dd40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3608005fd0 tx=0x7f360802a540 comp rx=0 tx=0).stop 2024-09-21T03:24:48.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.027+0000 7f361cc00640 1 -- 172.21.15.90:0/2439940717 shutdown_connections 2024-09-21T03:24:48.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.027+0000 7f361cc00640 1 --2- 172.21.15.90:0/2439940717 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36180ac350 0x7f36180ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:48.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.027+0000 7f361cc00640 1 --2- 172.21.15.90:0/2439940717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f361806d960 0x7f361813dd40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:48.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.027+0000 7f361cc00640 1 -- 172.21.15.90:0/2439940717 >> 172.21.15.90:0/2439940717 conn(0x7f36180c8ba0 msgr2=0x7f361806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:48.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.027+0000 7f361cc00640 1 -- 172.21.15.90:0/2439940717 shutdown_connections 2024-09-21T03:24:48.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.027+0000 7f361cc00640 1 -- 172.21.15.90:0/2439940717 wait complete. 2024-09-21T03:24:48.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.029+0000 7f361cc00640 1 Processor -- start 2024-09-21T03:24:48.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.029+0000 7f361cc00640 1 -- start start 2024-09-21T03:24:48.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.031+0000 7f361cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f361806d960 0x7f3618158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:48.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.031+0000 7f361cc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36180ac350 0x7f36181f0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:48.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.031+0000 7f361cc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36180acca0 0x7f36181398f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:48.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.031+0000 7f361cc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f36180ab640 con 0x7f36180acca0 2024-09-21T03:24:48.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.031+0000 7f361cc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f36180ab360 con 0x7f361806d960 2024-09-21T03:24:48.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.031+0000 7f361cc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3618074930 con 0x7f36180ac350 2024-09-21T03:24:48.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.031+0000 7f3616800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36180acca0 0x7f36181398f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:48.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.031+0000 7f3616800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36180acca0 0x7f36181398f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35246/0 (socket says 172.21.15.90:35246) 2024-09-21T03:24:48.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.031+0000 7f3616800640 1 -- 172.21.15.90:0/2301959571 learned_addr learned my addr 172.21.15.90:0/2301959571 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:48.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.031+0000 7f360d400640 1 --2- 172.21.15.90:0/2301959571 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36180ac350 0x7f36181f0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:48.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.031+0000 7f3615e00640 1 --2- 172.21.15.90:0/2301959571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f361806d960 0x7f3618158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:48.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.031+0000 7f3616800640 1 -- 172.21.15.90:0/2301959571 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36180ac350 msgr2=0x7f36181f0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:48.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.031+0000 7f3616800640 1 --2- 172.21.15.90:0/2301959571 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36180ac350 0x7f36181f0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:48.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.031+0000 7f3616800640 1 -- 172.21.15.90:0/2301959571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f361806d960 msgr2=0x7f3618158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:48.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.031+0000 7f3616800640 1 --2- 172.21.15.90:0/2301959571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f361806d960 0x7f3618158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:48.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.031+0000 7f3616800640 1 -- 172.21.15.90:0/2301959571 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f361814c730 con 0x7f36180acca0 2024-09-21T03:24:48.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.032+0000 7f3616800640 1 --2- 172.21.15.90:0/2301959571 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36180acca0 0x7f36181398f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f361000c700 tx=0x7f361000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:48.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.032+0000 7f360ea00640 1 -- 172.21.15.90:0/2301959571 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3610003b70 con 0x7f36180acca0 2024-09-21T03:24:48.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.032+0000 7f360ea00640 1 -- 172.21.15.90:0/2301959571 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3610003d10 con 0x7f36180acca0 2024-09-21T03:24:48.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.032+0000 7f361cc00640 1 -- 172.21.15.90:0/2301959571 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f361814ebc0 con 0x7f36180acca0 2024-09-21T03:24:48.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.032+0000 7f360ea00640 1 -- 172.21.15.90:0/2301959571 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361000aab0 con 0x7f36180acca0 2024-09-21T03:24:48.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.032+0000 7f361cc00640 1 -- 172.21.15.90:0/2301959571 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f361814e0e0 con 0x7f36180acca0 2024-09-21T03:24:48.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.033+0000 7f361cc00640 1 -- 172.21.15.90:0/2301959571 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36181544a0 con 0x7f36180acca0 2024-09-21T03:24:48.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.034+0000 7f360ea00640 1 -- 172.21.15.90:0/2301959571 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f361000ac50 con 0x7f36180acca0 2024-09-21T03:24:48.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.035+0000 7f360ea00640 1 --2- 172.21.15.90:0/2301959571 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f35f4078bc0 0x7f35f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:48.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.035+0000 7f360ea00640 1 -- 172.21.15.90:0/2301959571 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f361009ad60 con 0x7f36180acca0 2024-09-21T03:24:48.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.036+0000 7f3615e00640 1 --2- 172.21.15.90:0/2301959571 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f35f4078bc0 0x7f35f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:48.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.037+0000 7f3615e00640 1 --2- 172.21.15.90:0/2301959571 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f35f4078bc0 0x7f35f407b0d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3608033000 tx=0x7f3608004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:48.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.040+0000 7f360ea00640 1 -- 172.21.15.90:0/2301959571 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f36181544a0 con 0x7f36180acca0 2024-09-21T03:24:48.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.229+0000 7f361cc00640 1 -- 172.21.15.90:0/2301959571 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3618074ec0 con 0x7f36180acca0 2024-09-21T03:24:48.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.236+0000 7f360ea00640 1 -- 172.21.15.90:0/2301959571 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+20704 (secure 0 0 0) 0x7f361813e280 con 0x7f36180acca0 2024-09-21T03:24:48.238 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:24:48.238 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":27,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","created":"2024-09-21T03:14:09.323302+0000","modified":"2024-09-21T03:15:15.672593+0000","last_up_change":"2024-09-21T03:14:25.329650+0000","last_in_change":"2024-09-21T03:14:15.386953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:14:24.511246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-21T03:14:35.815250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-21T03:14:36.914615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-21T03:14:45.298287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-21T03:14:45.977111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ceaacfab-e71c-45e2-ac50-4597dfd460bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6809","nonce":3187794863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6811","nonce":3187794863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6815","nonce":3187794863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6813","nonce":3187794863}]},"public_addr":"172.21.15.90:6809/3187794863","cluster_addr":"172.21.15.90:6811/3187794863","heartbeat_back_addr":"172.21.15.90:6815/3187794863","heartbeat_front_addr":"172.21.15.90:6813/3187794863","state":["exists","up"]},{"osd":1,"uuid":"86f91523-232b-4e80-ada7-d9e12770adb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6801","nonce":3769758484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6803","nonce":3769758484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6807","nonce":3769758484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6805","nonce":3769758484}]},"public_addr":"172.21.15.90:6801/3769758484","cluster_addr":"172.21.15.90:6803/3769758484","heartbeat_back_addr":"172.21.15.90:6807/3769758484","heartbeat_front_addr":"172.21.15.90:6805/3769758484","state":["exists","up"]},{"osd":2,"uuid":"6eb0f47b-e767-49c0-8d72-07f71b9c2e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6825","nonce":1025535744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6827","nonce":1025535744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6831","nonce":1025535744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6829","nonce":1025535744}]},"public_addr":"172.21.15.90:6825/1025535744","cluster_addr":"172.21.15.90:6827/1025535744","heartbeat_back_addr":"172.21.15.90:6831/1025535744","heartbeat_front_addr":"172.21.15.90:6829/1025535744","state":["exists","up"]},{"osd":3,"uuid":"64418862-beef-479c-be11-dfe0e515e09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6817","nonce":1515884437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6819","nonce":1515884437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6823","nonce":1515884437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6821","nonce":1515884437}]},"public_addr":"172.21.15.90:6817/1515884437","cluster_addr":"172.21.15.90:6819/1515884437","heartbeat_back_addr":"172.21.15.90:6823/1515884437","heartbeat_front_addr":"172.21.15.90:6821/1515884437","state":["exists","up"]},{"osd":4,"uuid":"a05b63f4-ec0a-426c-9d60-285e2680a897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6816","nonce":4278726553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6820","nonce":4278726553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6825","nonce":4278726553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6823","nonce":4278726553}]},"public_addr":"172.21.15.149:6816/4278726553","cluster_addr":"172.21.15.149:6820/4278726553","heartbeat_back_addr":"172.21.15.149:6825/4278726553","heartbeat_front_addr":"172.21.15.149:6823/4278726553","state":["exists","up"]},{"osd":5,"uuid":"3a1bab89-963c-4fe7-b14f-3080c5cf7830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6827","nonce":1341677333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6829","nonce":1341677333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6833","nonce":1341677333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6831","nonce":1341677333}]},"public_addr":"172.21.15.149:6827/1341677333","cluster_addr":"172.21.15.149:6829/1341677333","heartbeat_back_addr":"172.21.15.149:6833/1341677333","heartbeat_front_addr":"172.21.15.149:6831/1341677333","state":["exists","up"]},{"osd":6,"uuid":"bfcd1596-2688-4deb-be2e-55f305a5b4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6811","nonce":821196931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6813","nonce":821196931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6821","nonce":821196931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6817","nonce":821196931}]},"public_addr":"172.21.15.149:6811/821196931","cluster_addr":"172.21.15.149:6813/821196931","heartbeat_back_addr":"172.21.15.149:6821/821196931","heartbeat_front_addr":"172.21.15.149:6817/821196931","state":["exists","up"]},{"osd":7,"uuid":"58b19790-4006-4f07-966c-911b938cc1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6803","nonce":1657326880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6805","nonce":1657326880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6809","nonce":1657326880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6807","nonce":1657326880}]},"public_addr":"172.21.15.149:6803/1657326880","cluster_addr":"172.21.15.149:6805/1657326880","heartbeat_back_addr":"172.21.15.149:6809/1657326880","heartbeat_front_addr":"172.21.15.149:6807/1657326880","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.399701+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.051745+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.190159+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:23.240143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.446570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.259974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:21.990407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.459259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"5.14","mappings":[{"from":4,"to":5}]},{"pgid":"5.1c","mappings":[{"from":4,"to":5}]},{"pgid":"5.23","mappings":[{"from":4,"to":5}]},{"pgid":"5.32","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:24:48.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.238+0000 7f361cc00640 1 -- 172.21.15.90:0/2301959571 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f35f4078bc0 msgr2=0x7f35f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:48.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.238+0000 7f361cc00640 1 --2- 172.21.15.90:0/2301959571 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f35f4078bc0 0x7f35f407b0d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3608033000 tx=0x7f3608004730 comp rx=0 tx=0).stop 2024-09-21T03:24:48.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.238+0000 7f361cc00640 1 -- 172.21.15.90:0/2301959571 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36180acca0 msgr2=0x7f36181398f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:48.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.238+0000 7f361cc00640 1 --2- 172.21.15.90:0/2301959571 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36180acca0 0x7f36181398f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f361000c700 tx=0x7f361000cbc0 comp rx=0 tx=0).stop 2024-09-21T03:24:48.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.238+0000 7f361cc00640 1 -- 172.21.15.90:0/2301959571 shutdown_connections 2024-09-21T03:24:48.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.238+0000 7f361cc00640 1 --2- 172.21.15.90:0/2301959571 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f35f4078bc0 0x7f35f407b0d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:48.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.238+0000 7f361cc00640 1 --2- 172.21.15.90:0/2301959571 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36180acca0 0x7f36181398f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:48.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.238+0000 7f361cc00640 1 --2- 172.21.15.90:0/2301959571 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36180ac350 0x7f36181f0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:48.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.238+0000 7f361cc00640 1 --2- 172.21.15.90:0/2301959571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f361806d960 0x7f3618158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:48.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.238+0000 7f361cc00640 1 -- 172.21.15.90:0/2301959571 >> 172.21.15.90:0/2301959571 conn(0x7f36180c8ba0 msgr2=0x7f361813b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:48.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.238+0000 7f361cc00640 1 -- 172.21.15.90:0/2301959571 shutdown_connections 2024-09-21T03:24:48.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:48.239+0000 7f361cc00640 1 -- 172.21.15.90:0/2301959571 wait complete. 2024-09-21T03:24:49.263 INFO:tasks.ceph:Scrubbing osd.0 2024-09-21T03:24:49.264 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-21T03:24:49.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.496+0000 7fdbdfe00640 1 -- 172.21.15.90:0/4213895890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe0154710 msgr2=0x7fdbe00adeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.496+0000 7fdbdfe00640 1 --2- 172.21.15.90:0/4213895890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe0154710 0x7fdbe00adeb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0005fd0 tx=0x7fdbd002a5d0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.497+0000 7fdbdfe00640 1 -- 172.21.15.90:0/4213895890 shutdown_connections 2024-09-21T03:24:49.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.497+0000 7fdbdfe00640 1 --2- 172.21.15.90:0/4213895890 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbe00c77c0 0x7fdbe01576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.497+0000 7fdbdfe00640 1 --2- 172.21.15.90:0/4213895890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe0154710 0x7fdbe00adeb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.497+0000 7fdbdfe00640 1 -- 172.21.15.90:0/4213895890 >> 172.21.15.90:0/4213895890 conn(0x7fdbe0074c50 msgr2=0x7fdbe00cc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:49.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.497+0000 7fdbdfe00640 1 -- 172.21.15.90:0/4213895890 shutdown_connections 2024-09-21T03:24:49.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.497+0000 7fdbdfe00640 1 -- 172.21.15.90:0/4213895890 wait complete. 2024-09-21T03:24:49.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.499+0000 7fdbdfe00640 1 Processor -- start 2024-09-21T03:24:49.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.499+0000 7fdbdfe00640 1 -- start start 2024-09-21T03:24:49.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.500+0000 7fdbdfe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe00ae3f0 0x7fdbe01e03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.500+0000 7fdbdfe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbe00c77c0 0x7fdbe01f08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.500+0000 7fdbdfe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbe0154710 0x7fdbe0159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.500+0000 7fdbdfe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe00ccc20 con 0x7fdbe00ae3f0 2024-09-21T03:24:49.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.500+0000 7fdbdfe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe0157c10 con 0x7fdbe00c77c0 2024-09-21T03:24:49.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.500+0000 7fdbdfe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe00ccda0 con 0x7fdbe0154710 2024-09-21T03:24:49.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.500+0000 7fdbdea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe00ae3f0 0x7fdbe01e03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.501+0000 7fdbdea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe00ae3f0 0x7fdbe01e03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35266/0 (socket says 172.21.15.90:35266) 2024-09-21T03:24:49.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.501+0000 7fdbdea00640 1 -- 172.21.15.90:0/2852767652 learned_addr learned my addr 172.21.15.90:0/2852767652 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:49.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.501+0000 7fdbdf400640 1 --2- 172.21.15.90:0/2852767652 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbe0154710 0x7fdbe0159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.501+0000 7fdbde000640 1 --2- 172.21.15.90:0/2852767652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbe00c77c0 0x7fdbe01f08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.501+0000 7fdbdea00640 1 -- 172.21.15.90:0/2852767652 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbe0154710 msgr2=0x7fdbe0159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.501+0000 7fdbdea00640 1 --2- 172.21.15.90:0/2852767652 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbe0154710 0x7fdbe0159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.501+0000 7fdbdea00640 1 -- 172.21.15.90:0/2852767652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbe00c77c0 msgr2=0x7fdbe01f08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.501+0000 7fdbdea00640 1 --2- 172.21.15.90:0/2852767652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbe00c77c0 0x7fdbe01f08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.501+0000 7fdbdea00640 1 -- 172.21.15.90:0/2852767652 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe01e31e0 con 0x7fdbe00ae3f0 2024-09-21T03:24:49.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.501+0000 7fdbdea00640 1 --2- 172.21.15.90:0/2852767652 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe00ae3f0 0x7fdbe01e03e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0034040 tx=0x7fdbd00035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:49.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.502+0000 7fdbd6a00640 1 -- 172.21.15.90:0/2852767652 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd003e030 con 0x7fdbe00ae3f0 2024-09-21T03:24:49.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.502+0000 7fdbd6a00640 1 -- 172.21.15.90:0/2852767652 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbd0003ae0 con 0x7fdbe00ae3f0 2024-09-21T03:24:49.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.502+0000 7fdbdfe00640 1 -- 172.21.15.90:0/2852767652 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe01e1c20 con 0x7fdbe00ae3f0 2024-09-21T03:24:49.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.502+0000 7fdbd6a00640 1 -- 172.21.15.90:0/2852767652 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0035040 con 0x7fdbe00ae3f0 2024-09-21T03:24:49.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.502+0000 7fdbdfe00640 1 -- 172.21.15.90:0/2852767652 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe01504d0 con 0x7fdbe00ae3f0 2024-09-21T03:24:49.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.503+0000 7fdbdfe00640 1 -- 172.21.15.90:0/2852767652 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdbe015ae00 con 0x7fdbe00ae3f0 2024-09-21T03:24:49.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.504+0000 7fdbd6a00640 1 -- 172.21.15.90:0/2852767652 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdbd0041030 con 0x7fdbe00ae3f0 2024-09-21T03:24:49.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.505+0000 7fdbd6a00640 1 --2- 172.21.15.90:0/2852767652 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdbc0078b90 0x7fdbc007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.505+0000 7fdbd6a00640 1 -- 172.21.15.90:0/2852767652 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fdbd00bb5f0 con 0x7fdbe00ae3f0 2024-09-21T03:24:49.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.505+0000 7fdbd6a00640 1 --2- 172.21.15.90:0/2852767652 >> [v2:172.21.15.90:6808/3187794863,v1:172.21.15.90:6809/3187794863] conn(0x7fdbc00835e0 0x7fdbc0085ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.505+0000 7fdbd6a00640 1 -- 172.21.15.90:0/2852767652 --> [v2:172.21.15.90:6808/3187794863,v1:172.21.15.90:6809/3187794863] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdbd0034e90 con 0x7fdbc00835e0 2024-09-21T03:24:49.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.505+0000 7fdbd6a00640 1 -- 172.21.15.90:0/2852767652 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdbd00c2050 con 0x7fdbe00ae3f0 2024-09-21T03:24:49.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.506+0000 7fdbde000640 1 --2- 172.21.15.90:0/2852767652 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdbc0078b90 0x7fdbc007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.506+0000 7fdbdf400640 1 --2- 172.21.15.90:0/2852767652 >> [v2:172.21.15.90:6808/3187794863,v1:172.21.15.90:6809/3187794863] conn(0x7fdbc00835e0 0x7fdbc0085ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.506+0000 7fdbdf400640 1 --2- 172.21.15.90:0/2852767652 >> [v2:172.21.15.90:6808/3187794863,v1:172.21.15.90:6809/3187794863] conn(0x7fdbc00835e0 0x7fdbc0085ad0 crc :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:49.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.506+0000 7fdbde000640 1 --2- 172.21.15.90:0/2852767652 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdbc0078b90 0x7fdbc007b0a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00ae3c0 tx=0x7fdbcc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:49.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.507+0000 7fdbd6a00640 1 -- 172.21.15.90:0/2852767652 <== osd.0 v2:172.21.15.90:6808/3187794863 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdbd0034e90 con 0x7fdbc00835e0 2024-09-21T03:24:49.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.520+0000 7fdbdfe00640 1 -- 172.21.15.90:0/2852767652 --> [v2:172.21.15.90:6808/3187794863,v1:172.21.15.90:6809/3187794863] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdbe00cb4f0 con 0x7fdbc00835e0 2024-09-21T03:24:49.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.521+0000 7fdbd6a00640 1 -- 172.21.15.90:0/2852767652 <== osd.0 v2:172.21.15.90:6808/3187794863 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdbe00cb4f0 con 0x7fdbc00835e0 2024-09-21T03:24:49.523 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:24:49.523 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T03:24:49.523 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:24:49.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.521+0000 7fdbdfe00640 1 -- 172.21.15.90:0/2852767652 >> [v2:172.21.15.90:6808/3187794863,v1:172.21.15.90:6809/3187794863] conn(0x7fdbc00835e0 msgr2=0x7fdbc0085ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.521+0000 7fdbdfe00640 1 --2- 172.21.15.90:0/2852767652 >> [v2:172.21.15.90:6808/3187794863,v1:172.21.15.90:6809/3187794863] conn(0x7fdbc00835e0 0x7fdbc0085ad0 crc :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.521+0000 7fdbdfe00640 1 -- 172.21.15.90:0/2852767652 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdbc0078b90 msgr2=0x7fdbc007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.521+0000 7fdbdfe00640 1 --2- 172.21.15.90:0/2852767652 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fdbc0078b90 0x7fdbc007b0a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00ae3c0 tx=0x7fdbcc009040 comp rx=0 tx=0).stop 2024-09-21T03:24:49.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.521+0000 7fdbdfe00640 1 -- 172.21.15.90:0/2852767652 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe00ae3f0 msgr2=0x7fdbe01e03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.521+0000 7fdbdfe00640 1 --2- 172.21.15.90:0/2852767652 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe00ae3f0 0x7fdbe01e03e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0034040 tx=0x7fdbd00035f0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.521+0000 7fdbdf400640 1 -- 172.21.15.90:0/2852767652 reap_dead start 2024-09-21T03:24:49.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.521+0000 7fdbdfe00640 1 -- 172.21.15.90:0/2852767652 shutdown_connections 2024-09-21T03:24:49.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.521+0000 7fdbdfe00640 1 -- 172.21.15.90:0/2852767652 >> 172.21.15.90:0/2852767652 conn(0x7fdbe0074c50 msgr2=0x7fdbe00ad5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:49.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.521+0000 7fdbdfe00640 1 -- 172.21.15.90:0/2852767652 shutdown_connections 2024-09-21T03:24:49.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.521+0000 7fdbdfe00640 1 -- 172.21.15.90:0/2852767652 wait complete. 2024-09-21T03:24:49.546 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-21T03:24:49.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.767+0000 7fc70d400640 1 -- 172.21.15.90:0/1660254886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc70806fa20 msgr2=0x7fc70806fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.767+0000 7fc70d400640 1 --2- 172.21.15.90:0/1660254886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc70806fa20 0x7fc70806fe30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc700005fd0 tx=0x7fc70002aa10 comp rx=0 tx=0).stop 2024-09-21T03:24:49.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.767+0000 7fc70d400640 1 -- 172.21.15.90:0/1660254886 shutdown_connections 2024-09-21T03:24:49.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.767+0000 7fc70d400640 1 --2- 172.21.15.90:0/1660254886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc70806fa20 0x7fc70806fe30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.767+0000 7fc70d400640 1 --2- 172.21.15.90:0/1660254886 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7080c4fe0 0x7fc7080c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.767+0000 7fc70d400640 1 -- 172.21.15.90:0/1660254886 >> 172.21.15.90:0/1660254886 conn(0x7fc70806d200 msgr2=0x7fc70806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:49.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.767+0000 7fc70d400640 1 -- 172.21.15.90:0/1660254886 shutdown_connections 2024-09-21T03:24:49.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.767+0000 7fc70d400640 1 -- 172.21.15.90:0/1660254886 wait complete. 2024-09-21T03:24:49.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.770+0000 7fc70d400640 1 Processor -- start 2024-09-21T03:24:49.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.770+0000 7fc70d400640 1 -- start start 2024-09-21T03:24:49.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.771+0000 7fc70d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc70806fa20 0x7fc7081e1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.771+0000 7fc70d400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7080aaec0 0x7fc708157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.771+0000 7fc70d400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7080c4fe0 0x7fc708158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.771+0000 7fc70d400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc7081525c0 con 0x7fc7080aaec0 2024-09-21T03:24:49.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.771+0000 7fc70d400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc7081553c0 con 0x7fc70806fa20 2024-09-21T03:24:49.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.771+0000 7fc70d400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc7080ad3d0 con 0x7fc7080c4fe0 2024-09-21T03:24:49.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.771+0000 7fc707400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7080aaec0 0x7fc708157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.771+0000 7fc707400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7080aaec0 0x7fc708157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35272/0 (socket says 172.21.15.90:35272) 2024-09-21T03:24:49.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.771+0000 7fc707400640 1 -- 172.21.15.90:0/3281948217 learned_addr learned my addr 172.21.15.90:0/3281948217 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:49.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.771+0000 7fc707e00640 1 --2- 172.21.15.90:0/3281948217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc70806fa20 0x7fc7081e1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.771+0000 7fc70ca00640 1 --2- 172.21.15.90:0/3281948217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7080c4fe0 0x7fc708158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.772+0000 7fc707400640 1 -- 172.21.15.90:0/3281948217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7080c4fe0 msgr2=0x7fc708158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.772+0000 7fc707400640 1 --2- 172.21.15.90:0/3281948217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7080c4fe0 0x7fc708158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.772+0000 7fc707400640 1 -- 172.21.15.90:0/3281948217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc70806fa20 msgr2=0x7fc7081e1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.772+0000 7fc707400640 1 --2- 172.21.15.90:0/3281948217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc70806fa20 0x7fc7081e1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.772+0000 7fc707400640 1 -- 172.21.15.90:0/3281948217 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc70814ff10 con 0x7fc7080aaec0 2024-09-21T03:24:49.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.772+0000 7fc707400640 1 --2- 172.21.15.90:0/3281948217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7080aaec0 0x7fc708157fd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009fd0 tx=0x7fc6f400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:49.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.772+0000 7fc6ffe00640 1 -- 172.21.15.90:0/3281948217 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f400ccc0 con 0x7fc7080aaec0 2024-09-21T03:24:49.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.772+0000 7fc6ffe00640 1 -- 172.21.15.90:0/3281948217 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6f400ee70 con 0x7fc7080aaec0 2024-09-21T03:24:49.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.772+0000 7fc70d400640 1 -- 172.21.15.90:0/3281948217 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7081ed980 con 0x7fc7080aaec0 2024-09-21T03:24:49.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.772+0000 7fc6ffe00640 1 -- 172.21.15.90:0/3281948217 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f400ce60 con 0x7fc7080aaec0 2024-09-21T03:24:49.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.773+0000 7fc70d400640 1 -- 172.21.15.90:0/3281948217 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7081ed6a0 con 0x7fc7080aaec0 2024-09-21T03:24:49.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.774+0000 7fc70d400640 1 -- 172.21.15.90:0/3281948217 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc70814dad0 con 0x7fc7080aaec0 2024-09-21T03:24:49.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.775+0000 7fc6ffe00640 1 -- 172.21.15.90:0/3281948217 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc6f4005260 con 0x7fc7080aaec0 2024-09-21T03:24:49.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.776+0000 7fc6ffe00640 1 --2- 172.21.15.90:0/3281948217 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc6e8078bc0 0x7fc6e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.776+0000 7fc6ffe00640 1 -- 172.21.15.90:0/3281948217 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fc6f409b920 con 0x7fc7080aaec0 2024-09-21T03:24:49.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.776+0000 7fc707e00640 1 --2- 172.21.15.90:0/3281948217 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc6e8078bc0 0x7fc6e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.777+0000 7fc707e00640 1 --2- 172.21.15.90:0/3281948217 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc6e8078bc0 0x7fc6e807b0d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8001720 tx=0x7fc6f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:49.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.781+0000 7fc6ffe00640 1 -- 172.21.15.90:0/3281948217 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc6f4063340 con 0x7fc7080aaec0 2024-09-21T03:24:49.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.967+0000 7fc70d400640 1 -- 172.21.15.90:0/3281948217 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fc7081ed450 con 0x7fc6e8078bc0 2024-09-21T03:24:49.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.968+0000 7fc6ffe00640 1 -- 172.21.15.90:0/3281948217 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc7081ed450 con 0x7fc6e8078bc0 2024-09-21T03:24:49.970 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 0 to deep-scrub 2024-09-21T03:24:49.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.971+0000 7fc70d400640 1 -- 172.21.15.90:0/3281948217 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc6e8078bc0 msgr2=0x7fc6e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.971+0000 7fc70d400640 1 --2- 172.21.15.90:0/3281948217 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc6e8078bc0 0x7fc6e807b0d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8001720 tx=0x7fc6f8009040 comp rx=0 tx=0).stop 2024-09-21T03:24:49.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.971+0000 7fc70d400640 1 -- 172.21.15.90:0/3281948217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7080aaec0 msgr2=0x7fc708157fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.971+0000 7fc70d400640 1 --2- 172.21.15.90:0/3281948217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7080aaec0 0x7fc708157fd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009fd0 tx=0x7fc6f400ec20 comp rx=0 tx=0).stop 2024-09-21T03:24:49.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.971+0000 7fc70d400640 1 -- 172.21.15.90:0/3281948217 shutdown_connections 2024-09-21T03:24:49.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.971+0000 7fc70d400640 1 --2- 172.21.15.90:0/3281948217 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc6e8078bc0 0x7fc6e807b0d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.971+0000 7fc70d400640 1 --2- 172.21.15.90:0/3281948217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7080c4fe0 0x7fc708158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.971+0000 7fc70d400640 1 --2- 172.21.15.90:0/3281948217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7080aaec0 0x7fc708157fd0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.971+0000 7fc70d400640 1 --2- 172.21.15.90:0/3281948217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc70806fa20 0x7fc7081e1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.971+0000 7fc70d400640 1 -- 172.21.15.90:0/3281948217 >> 172.21.15.90:0/3281948217 conn(0x7fc70806d200 msgr2=0x7fc708154090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:49.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.971+0000 7fc70d400640 1 -- 172.21.15.90:0/3281948217 shutdown_connections 2024-09-21T03:24:49.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:49.971+0000 7fc70d400640 1 -- 172.21.15.90:0/3281948217 wait complete. 2024-09-21T03:24:49.996 INFO:tasks.ceph:Scrubbing osd.1 2024-09-21T03:24:49.997 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-21T03:24:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.222+0000 7f8977200640 1 -- 172.21.15.90:0/72914465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8978157500 msgr2=0x7f8978157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.222+0000 7f8977200640 1 --2- 172.21.15.90:0/72914465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8978157500 0x7f8978157910 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8970005fd0 tx=0x7f897002aa90 comp rx=0 tx=0).stop 2024-09-21T03:24:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.223+0000 7f8977200640 1 -- 172.21.15.90:0/72914465 shutdown_connections 2024-09-21T03:24:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.223+0000 7f8977200640 1 --2- 172.21.15.90:0/72914465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8978157500 0x7f8978157910 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.223+0000 7f8977200640 1 --2- 172.21.15.90:0/72914465 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f89780c77c0 0x7f8978156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.223+0000 7f8977200640 1 -- 172.21.15.90:0/72914465 >> 172.21.15.90:0/72914465 conn(0x7f8978074c50 msgr2=0x7f89780cc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.223+0000 7f8977200640 1 -- 172.21.15.90:0/72914465 shutdown_connections 2024-09-21T03:24:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.223+0000 7f8977200640 1 -- 172.21.15.90:0/72914465 wait complete. 2024-09-21T03:24:50.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.225+0000 7f8977200640 1 Processor -- start 2024-09-21T03:24:50.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.225+0000 7f8977200640 1 -- start start 2024-09-21T03:24:50.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.226+0000 7f8977200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89780c77c0 0x7f8978151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:50.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.226+0000 7f8977200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8978154710 0x7f8978152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:50.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.226+0000 7f8977200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8978157500 0x7f897814e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:50.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.226+0000 7f8977200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f89780ae740 con 0x7f89780c77c0 2024-09-21T03:24:50.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.226+0000 7f8977200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f89780ae5c0 con 0x7f8978154710 2024-09-21T03:24:50.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.226+0000 7f8977200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f89780ccc20 con 0x7f8978157500 2024-09-21T03:24:50.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.226+0000 7f8975e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89780c77c0 0x7f8978151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:50.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.227+0000 7f8975e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89780c77c0 0x7f8978151760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35294/0 (socket says 172.21.15.90:35294) 2024-09-21T03:24:50.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.227+0000 7f8975e00640 1 -- 172.21.15.90:0/3052863009 learned_addr learned my addr 172.21.15.90:0/3052863009 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:50.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.227+0000 7f8976800640 1 --2- 172.21.15.90:0/3052863009 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8978157500 0x7f897814e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:50.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.227+0000 7f896fe00640 1 --2- 172.21.15.90:0/3052863009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8978154710 0x7f8978152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:50.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.227+0000 7f8975e00640 1 -- 172.21.15.90:0/3052863009 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8978157500 msgr2=0x7f897814e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.227+0000 7f8975e00640 1 --2- 172.21.15.90:0/3052863009 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8978157500 0x7f897814e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.227+0000 7f8975e00640 1 -- 172.21.15.90:0/3052863009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8978154710 msgr2=0x7f8978152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.227+0000 7f8975e00640 1 --2- 172.21.15.90:0/3052863009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8978154710 0x7f8978152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.227+0000 7f8975e00640 1 -- 172.21.15.90:0/3052863009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8978151ca0 con 0x7f89780c77c0 2024-09-21T03:24:50.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.227+0000 7f8975e00640 1 --2- 172.21.15.90:0/3052863009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89780c77c0 0x7f8978151760 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f896800c3d0 tx=0x7f896800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:50.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.227+0000 7f896e000640 1 -- 172.21.15.90:0/3052863009 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8968017070 con 0x7f89780c77c0 2024-09-21T03:24:50.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.227+0000 7f896e000640 1 -- 172.21.15.90:0/3052863009 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89680053c0 con 0x7f89780c77c0 2024-09-21T03:24:50.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.227+0000 7f896e000640 1 -- 172.21.15.90:0/3052863009 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8968003850 con 0x7f89780c77c0 2024-09-21T03:24:50.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.228+0000 7f8977200640 1 -- 172.21.15.90:0/3052863009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8978150ab0 con 0x7f89780c77c0 2024-09-21T03:24:50.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.228+0000 7f8977200640 1 -- 172.21.15.90:0/3052863009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89781f0ab0 con 0x7f89780c77c0 2024-09-21T03:24:50.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.228+0000 7f8977200640 1 -- 172.21.15.90:0/3052863009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f89780cae90 con 0x7f89780c77c0 2024-09-21T03:24:50.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.230+0000 7f896e000640 1 -- 172.21.15.90:0/3052863009 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f896801a070 con 0x7f89780c77c0 2024-09-21T03:24:50.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.231+0000 7f896e000640 1 --2- 172.21.15.90:0/3052863009 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8954078b90 0x7f895407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:50.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.231+0000 7f896e000640 1 -- 172.21.15.90:0/3052863009 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f896809ab70 con 0x7f89780c77c0 2024-09-21T03:24:50.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.231+0000 7f896e000640 1 --2- 172.21.15.90:0/3052863009 >> [v2:172.21.15.90:6800/3769758484,v1:172.21.15.90:6801/3769758484] conn(0x7f89540835d0 0x7f8954085ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:50.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.231+0000 7f896fe00640 1 --2- 172.21.15.90:0/3052863009 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8954078b90 0x7f895407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:50.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.231+0000 7f896e000640 1 -- 172.21.15.90:0/3052863009 --> [v2:172.21.15.90:6800/3769758484,v1:172.21.15.90:6801/3769758484] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8968009e50 con 0x7f89540835d0 2024-09-21T03:24:50.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.231+0000 7f896e000640 1 -- 172.21.15.90:0/3052863009 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f896809af20 con 0x7f89780c77c0 2024-09-21T03:24:50.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.231+0000 7f8976800640 1 --2- 172.21.15.90:0/3052863009 >> [v2:172.21.15.90:6800/3769758484,v1:172.21.15.90:6801/3769758484] conn(0x7f89540835d0 0x7f8954085ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:50.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.232+0000 7f896fe00640 1 --2- 172.21.15.90:0/3052863009 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8954078b90 0x7f895407b0a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f89780afd20 tx=0x7f8960005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:50.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.232+0000 7f8976800640 1 --2- 172.21.15.90:0/3052863009 >> [v2:172.21.15.90:6800/3769758484,v1:172.21.15.90:6801/3769758484] conn(0x7f89540835d0 0x7f8954085ac0 crc :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:50.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.233+0000 7f896e000640 1 -- 172.21.15.90:0/3052863009 <== osd.1 v2:172.21.15.90:6800/3769758484 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8968009e50 con 0x7f89540835d0 2024-09-21T03:24:50.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.246+0000 7f8977200640 1 -- 172.21.15.90:0/3052863009 --> [v2:172.21.15.90:6800/3769758484,v1:172.21.15.90:6801/3769758484] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f89780cb4f0 con 0x7f89540835d0 2024-09-21T03:24:50.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.246+0000 7f896e000640 1 -- 172.21.15.90:0/3052863009 <== osd.1 v2:172.21.15.90:6800/3769758484 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f89780cb4f0 con 0x7f89540835d0 2024-09-21T03:24:50.248 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:24:50.248 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T03:24:50.248 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:24:50.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.247+0000 7f8977200640 1 -- 172.21.15.90:0/3052863009 >> [v2:172.21.15.90:6800/3769758484,v1:172.21.15.90:6801/3769758484] conn(0x7f89540835d0 msgr2=0x7f8954085ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.247+0000 7f8977200640 1 --2- 172.21.15.90:0/3052863009 >> [v2:172.21.15.90:6800/3769758484,v1:172.21.15.90:6801/3769758484] conn(0x7f89540835d0 0x7f8954085ac0 crc :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.247+0000 7f8977200640 1 -- 172.21.15.90:0/3052863009 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8954078b90 msgr2=0x7f895407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.247+0000 7f8977200640 1 --2- 172.21.15.90:0/3052863009 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8954078b90 0x7f895407b0a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f89780afd20 tx=0x7f8960005f90 comp rx=0 tx=0).stop 2024-09-21T03:24:50.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.247+0000 7f8977200640 1 -- 172.21.15.90:0/3052863009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89780c77c0 msgr2=0x7f8978151760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.247+0000 7f8977200640 1 --2- 172.21.15.90:0/3052863009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89780c77c0 0x7f8978151760 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f896800c3d0 tx=0x7f896800c890 comp rx=0 tx=0).stop 2024-09-21T03:24:50.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.247+0000 7f8976800640 1 -- 172.21.15.90:0/3052863009 reap_dead start 2024-09-21T03:24:50.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.247+0000 7f8977200640 1 -- 172.21.15.90:0/3052863009 shutdown_connections 2024-09-21T03:24:50.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.247+0000 7f8977200640 1 -- 172.21.15.90:0/3052863009 >> 172.21.15.90:0/3052863009 conn(0x7f8978074c50 msgr2=0x7f897814fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:50.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.247+0000 7f8977200640 1 -- 172.21.15.90:0/3052863009 shutdown_connections 2024-09-21T03:24:50.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.247+0000 7f8977200640 1 -- 172.21.15.90:0/3052863009 wait complete. 2024-09-21T03:24:50.272 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-21T03:24:50.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.496+0000 7fcc50800640 1 -- 172.21.15.90:0/886676655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc48073080 msgr2=0x7fcc48073490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.496+0000 7fcc50800640 1 --2- 172.21.15.90:0/886676655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc48073080 0x7fcc48073490 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcc480ab5a0 tx=0x7fcc3802a480 comp rx=0 tx=0).stop 2024-09-21T03:24:50.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.496+0000 7fcc50800640 1 -- 172.21.15.90:0/886676655 shutdown_connections 2024-09-21T03:24:50.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.496+0000 7fcc50800640 1 --2- 172.21.15.90:0/886676655 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc48154aa0 0x7fcc48154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.496+0000 7fcc50800640 1 --2- 172.21.15.90:0/886676655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc48073080 0x7fcc48073490 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.496+0000 7fcc50800640 1 -- 172.21.15.90:0/886676655 >> 172.21.15.90:0/886676655 conn(0x7fcc480c85a0 msgr2=0x7fcc480c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:50.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.496+0000 7fcc50800640 1 -- 172.21.15.90:0/886676655 shutdown_connections 2024-09-21T03:24:50.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.496+0000 7fcc50800640 1 -- 172.21.15.90:0/886676655 wait complete. 2024-09-21T03:24:50.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.498+0000 7fcc50800640 1 Processor -- start 2024-09-21T03:24:50.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.498+0000 7fcc50800640 1 -- start start 2024-09-21T03:24:50.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.500+0000 7fcc50800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc48073080 0x7fcc481eccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:50.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.500+0000 7fcc50800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc480ae0a0 0x7fcc481de4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:50.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.500+0000 7fcc50800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc48154aa0 0x7fcc480c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:50.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.500+0000 7fcc50800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcc480abf10 con 0x7fcc480ae0a0 2024-09-21T03:24:50.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.500+0000 7fcc50800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcc480abd90 con 0x7fcc48154aa0 2024-09-21T03:24:50.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.500+0000 7fcc50800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcc48074220 con 0x7fcc48073080 2024-09-21T03:24:50.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.500+0000 7fcc4d400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc480ae0a0 0x7fcc481de4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:50.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.500+0000 7fcc4d400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc480ae0a0 0x7fcc481de4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35300/0 (socket says 172.21.15.90:35300) 2024-09-21T03:24:50.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.500+0000 7fcc4d400640 1 -- 172.21.15.90:0/3791617829 learned_addr learned my addr 172.21.15.90:0/3791617829 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:50.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.500+0000 7fcc4e800640 1 --2- 172.21.15.90:0/3791617829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc48154aa0 0x7fcc480c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:50.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.500+0000 7fcc4de00640 1 --2- 172.21.15.90:0/3791617829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc48073080 0x7fcc481eccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:50.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.500+0000 7fcc4d400640 1 -- 172.21.15.90:0/3791617829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc48073080 msgr2=0x7fcc481eccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.500+0000 7fcc4d400640 1 --2- 172.21.15.90:0/3791617829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc48073080 0x7fcc481eccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.500+0000 7fcc4d400640 1 -- 172.21.15.90:0/3791617829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc48154aa0 msgr2=0x7fcc480c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.500+0000 7fcc4d400640 1 --2- 172.21.15.90:0/3791617829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc48154aa0 0x7fcc480c6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.500+0000 7fcc4d400640 1 -- 172.21.15.90:0/3791617829 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc481f0fa0 con 0x7fcc480ae0a0 2024-09-21T03:24:50.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.501+0000 7fcc4d400640 1 --2- 172.21.15.90:0/3791617829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc480ae0a0 0x7fcc481de4e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcc38009780 tx=0x7fcc38033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:50.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.501+0000 7fcc42000640 1 -- 172.21.15.90:0/3791617829 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc38031d60 con 0x7fcc480ae0a0 2024-09-21T03:24:50.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.501+0000 7fcc42000640 1 -- 172.21.15.90:0/3791617829 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc38033e10 con 0x7fcc480ae0a0 2024-09-21T03:24:50.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.501+0000 7fcc50800640 1 -- 172.21.15.90:0/3791617829 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc4806e9e0 con 0x7fcc480ae0a0 2024-09-21T03:24:50.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.501+0000 7fcc42000640 1 -- 172.21.15.90:0/3791617829 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc38005260 con 0x7fcc480ae0a0 2024-09-21T03:24:50.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.501+0000 7fcc50800640 1 -- 172.21.15.90:0/3791617829 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc480c26e0 con 0x7fcc480ae0a0 2024-09-21T03:24:50.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.502+0000 7fcc50800640 1 -- 172.21.15.90:0/3791617829 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc481f0ce0 con 0x7fcc480ae0a0 2024-09-21T03:24:50.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.503+0000 7fcc42000640 1 -- 172.21.15.90:0/3791617829 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc38005400 con 0x7fcc480ae0a0 2024-09-21T03:24:50.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.504+0000 7fcc42000640 1 --2- 172.21.15.90:0/3791617829 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc2c078b90 0x7fcc2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:50.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.504+0000 7fcc42000640 1 -- 172.21.15.90:0/3791617829 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fcc380bbf70 con 0x7fcc480ae0a0 2024-09-21T03:24:50.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.504+0000 7fcc4de00640 1 --2- 172.21.15.90:0/3791617829 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc2c078b90 0x7fcc2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:50.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.505+0000 7fcc4de00640 1 --2- 172.21.15.90:0/3791617829 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc2c078b90 0x7fcc2c07b0a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c001760 tx=0x7fcc3c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:50.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.509+0000 7fcc42000640 1 -- 172.21.15.90:0/3791617829 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcc3803f030 con 0x7fcc480ae0a0 2024-09-21T03:24:50.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.697+0000 7fcc50800640 1 -- 172.21.15.90:0/3791617829 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fcc48073490 con 0x7fcc2c078b90 2024-09-21T03:24:50.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.698+0000 7fcc42000640 1 -- 172.21.15.90:0/3791617829 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcc48073490 con 0x7fcc2c078b90 2024-09-21T03:24:50.700 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 1 to deep-scrub 2024-09-21T03:24:50.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.701+0000 7fcc50800640 1 -- 172.21.15.90:0/3791617829 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc2c078b90 msgr2=0x7fcc2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.701+0000 7fcc50800640 1 --2- 172.21.15.90:0/3791617829 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc2c078b90 0x7fcc2c07b0a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c001760 tx=0x7fcc3c009040 comp rx=0 tx=0).stop 2024-09-21T03:24:50.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.701+0000 7fcc50800640 1 -- 172.21.15.90:0/3791617829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc480ae0a0 msgr2=0x7fcc481de4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.701+0000 7fcc50800640 1 --2- 172.21.15.90:0/3791617829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc480ae0a0 0x7fcc481de4e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcc38009780 tx=0x7fcc38033c20 comp rx=0 tx=0).stop 2024-09-21T03:24:50.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.701+0000 7fcc50800640 1 -- 172.21.15.90:0/3791617829 shutdown_connections 2024-09-21T03:24:50.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.701+0000 7fcc50800640 1 --2- 172.21.15.90:0/3791617829 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcc2c078b90 0x7fcc2c07b0a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.701+0000 7fcc50800640 1 --2- 172.21.15.90:0/3791617829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc48154aa0 0x7fcc480c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.701+0000 7fcc50800640 1 --2- 172.21.15.90:0/3791617829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc480ae0a0 0x7fcc481de4e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.701+0000 7fcc50800640 1 --2- 172.21.15.90:0/3791617829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc48073080 0x7fcc481eccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.701+0000 7fcc50800640 1 -- 172.21.15.90:0/3791617829 >> 172.21.15.90:0/3791617829 conn(0x7fcc480c85a0 msgr2=0x7fcc480763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:50.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.701+0000 7fcc50800640 1 -- 172.21.15.90:0/3791617829 shutdown_connections 2024-09-21T03:24:50.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.701+0000 7fcc50800640 1 -- 172.21.15.90:0/3791617829 wait complete. 2024-09-21T03:24:50.725 INFO:tasks.ceph:Scrubbing osd.2 2024-09-21T03:24:50.726 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-21T03:24:50.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.952+0000 7fd518a00640 1 -- 172.21.15.90:0/1156610213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4f8004d40 msgr2=0x7fd4f8005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.952+0000 7fd518a00640 1 --2- 172.21.15.90:0/1156610213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4f8004d40 0x7fd4f8005150 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00c640 tx=0x7fd4f8005830 comp rx=0 tx=0).stop 2024-09-21T03:24:50.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.952+0000 7fd513e00640 1 -- 172.21.15.90:0/1156610213 reap_dead start 2024-09-21T03:24:50.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.952+0000 7fd518a00640 1 -- 172.21.15.90:0/1156610213 shutdown_connections 2024-09-21T03:24:50.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.952+0000 7fd518a00640 1 -- 172.21.15.90:0/1156610213 >> 172.21.15.90:0/1156610213 conn(0x7fd51406d1d0 msgr2=0x7fd51406d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:50.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.953+0000 7fd518a00640 1 -- 172.21.15.90:0/1156610213 shutdown_connections 2024-09-21T03:24:50.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.953+0000 7fd518a00640 1 -- 172.21.15.90:0/1156610213 wait complete. 2024-09-21T03:24:50.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.956+0000 7fd518a00640 1 Processor -- start 2024-09-21T03:24:50.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.956+0000 7fd518a00640 1 -- start start 2024-09-21T03:24:50.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.957+0000 7fd518a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5141485e0 0x7fd5141445f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:50.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.957+0000 7fd518a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd514145260 0x7fd514150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:50.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.957+0000 7fd518a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd514150d80 0x7fd5141ee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:50.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.957+0000 7fd518a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd514073760 con 0x7fd514150d80 2024-09-21T03:24:50.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.957+0000 7fd518a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd5140ac000 con 0x7fd514145260 2024-09-21T03:24:50.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.957+0000 7fd518a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd514155520 con 0x7fd5141485e0 2024-09-21T03:24:50.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.957+0000 7fd513e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd514150d80 0x7fd5141ee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:50.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.957+0000 7fd513e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd514150d80 0x7fd5141ee0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35322/0 (socket says 172.21.15.90:35322) 2024-09-21T03:24:50.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.957+0000 7fd513e00640 1 -- 172.21.15.90:0/673990268 learned_addr learned my addr 172.21.15.90:0/673990268 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:50.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.957+0000 7fd513400640 1 --2- 172.21.15.90:0/673990268 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5141485e0 0x7fd5141445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:50.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.957+0000 7fd512a00640 1 --2- 172.21.15.90:0/673990268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd514145260 0x7fd514150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:50.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.958+0000 7fd513e00640 1 -- 172.21.15.90:0/673990268 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5141485e0 msgr2=0x7fd5141445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.958+0000 7fd513e00640 1 --2- 172.21.15.90:0/673990268 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5141485e0 0x7fd5141445f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.958+0000 7fd513e00640 1 -- 172.21.15.90:0/673990268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd514145260 msgr2=0x7fd514150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.958+0000 7fd513e00640 1 --2- 172.21.15.90:0/673990268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd514145260 0x7fd514150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.958+0000 7fd513e00640 1 -- 172.21.15.90:0/673990268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd514144b30 con 0x7fd514150d80 2024-09-21T03:24:50.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.958+0000 7fd513e00640 1 --2- 172.21.15.90:0/673990268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd514150d80 0x7fd5141ee0f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd50c02b490 tx=0x7fd50c001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:50.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.958+0000 7fd50b400640 1 -- 172.21.15.90:0/673990268 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c039070 con 0x7fd514150d80 2024-09-21T03:24:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.958+0000 7fd50b400640 1 -- 172.21.15.90:0/673990268 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd50c006680 con 0x7fd514150d80 2024-09-21T03:24:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.958+0000 7fd50b400640 1 -- 172.21.15.90:0/673990268 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c002030 con 0x7fd514150d80 2024-09-21T03:24:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.958+0000 7fd518a00640 1 -- 172.21.15.90:0/673990268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd514144ed0 con 0x7fd514150d80 2024-09-21T03:24:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.958+0000 7fd518a00640 1 -- 172.21.15.90:0/673990268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd514147660 con 0x7fd514150d80 2024-09-21T03:24:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.959+0000 7fd518a00640 1 -- 172.21.15.90:0/673990268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd514074be0 con 0x7fd514150d80 2024-09-21T03:24:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.961+0000 7fd50b400640 1 -- 172.21.15.90:0/673990268 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd50c03c020 con 0x7fd514150d80 2024-09-21T03:24:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.962+0000 7fd50b400640 1 --2- 172.21.15.90:0/673990268 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd4f4078b90 0x7fd4f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.962+0000 7fd50b400640 1 -- 172.21.15.90:0/673990268 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fd50c0bb580 con 0x7fd514150d80 2024-09-21T03:24:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.962+0000 7fd50b400640 1 --2- 172.21.15.90:0/673990268 >> [v2:172.21.15.90:6824/1025535744,v1:172.21.15.90:6825/1025535744] conn(0x7fd4f40835e0 0x7fd4f4085ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.962+0000 7fd50b400640 1 -- 172.21.15.90:0/673990268 --> [v2:172.21.15.90:6824/1025535744,v1:172.21.15.90:6825/1025535744] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd50c00a030 con 0x7fd4f40835e0 2024-09-21T03:24:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.962+0000 7fd50b400640 1 -- 172.21.15.90:0/673990268 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd50c0bb930 con 0x7fd514150d80 2024-09-21T03:24:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.962+0000 7fd513400640 1 --2- 172.21.15.90:0/673990268 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd4f4078b90 0x7fd4f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.962+0000 7fd512a00640 1 --2- 172.21.15.90:0/673990268 >> [v2:172.21.15.90:6824/1025535744,v1:172.21.15.90:6825/1025535744] conn(0x7fd4f40835e0 0x7fd4f4085ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.963+0000 7fd512a00640 1 --2- 172.21.15.90:0/673990268 >> [v2:172.21.15.90:6824/1025535744,v1:172.21.15.90:6825/1025535744] conn(0x7fd4f40835e0 0x7fd4f4085ad0 crc :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.963+0000 7fd513400640 1 --2- 172.21.15.90:0/673990268 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd4f4078b90 0x7fd4f407b0a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd504009e50 tx=0x7fd504005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.963+0000 7fd50b400640 1 -- 172.21.15.90:0/673990268 <== osd.2 v2:172.21.15.90:6824/1025535744 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd50c00a030 con 0x7fd4f40835e0 2024-09-21T03:24:50.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.976+0000 7fd518a00640 1 -- 172.21.15.90:0/673990268 --> [v2:172.21.15.90:6824/1025535744,v1:172.21.15.90:6825/1025535744] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd5140c28f0 con 0x7fd4f40835e0 2024-09-21T03:24:50.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.977+0000 7fd50b400640 1 -- 172.21.15.90:0/673990268 <== osd.2 v2:172.21.15.90:6824/1025535744 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd5140c28f0 con 0x7fd4f40835e0 2024-09-21T03:24:50.979 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:24:50.979 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T03:24:50.979 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:24:50.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.977+0000 7fd518a00640 1 -- 172.21.15.90:0/673990268 >> [v2:172.21.15.90:6824/1025535744,v1:172.21.15.90:6825/1025535744] conn(0x7fd4f40835e0 msgr2=0x7fd4f4085ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.977+0000 7fd518a00640 1 --2- 172.21.15.90:0/673990268 >> [v2:172.21.15.90:6824/1025535744,v1:172.21.15.90:6825/1025535744] conn(0x7fd4f40835e0 0x7fd4f4085ad0 crc :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.977+0000 7fd518a00640 1 -- 172.21.15.90:0/673990268 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd4f4078b90 msgr2=0x7fd4f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.977+0000 7fd518a00640 1 --2- 172.21.15.90:0/673990268 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd4f4078b90 0x7fd4f407b0a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd504009e50 tx=0x7fd504005f90 comp rx=0 tx=0).stop 2024-09-21T03:24:50.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.977+0000 7fd518a00640 1 -- 172.21.15.90:0/673990268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd514150d80 msgr2=0x7fd5141ee0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.977+0000 7fd518a00640 1 --2- 172.21.15.90:0/673990268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd514150d80 0x7fd5141ee0f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd50c02b490 tx=0x7fd50c001aa0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.977+0000 7fd513e00640 1 -- 172.21.15.90:0/673990268 reap_dead start 2024-09-21T03:24:50.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.978+0000 7fd518a00640 1 -- 172.21.15.90:0/673990268 shutdown_connections 2024-09-21T03:24:50.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.978+0000 7fd518a00640 1 -- 172.21.15.90:0/673990268 >> 172.21.15.90:0/673990268 conn(0x7fd51406d1d0 msgr2=0x7fd51406d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:50.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.978+0000 7fd518a00640 1 -- 172.21.15.90:0/673990268 shutdown_connections 2024-09-21T03:24:50.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:50.978+0000 7fd518a00640 1 -- 172.21.15.90:0/673990268 wait complete. 2024-09-21T03:24:51.004 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-21T03:24:51.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.224+0000 7f1e9e800640 1 -- 172.21.15.90:0/3411310885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e98069160 msgr2=0x7f1e980a9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:51.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.224+0000 7f1e9e800640 1 --2- 172.21.15.90:0/3411310885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e98069160 0x7f1e980a9fa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1e980ab3e0 tx=0x7f1e8c02a560 comp rx=0 tx=0).stop 2024-09-21T03:24:51.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.224+0000 7f1e9e800640 1 -- 172.21.15.90:0/3411310885 shutdown_connections 2024-09-21T03:24:51.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.224+0000 7f1e9e800640 1 --2- 172.21.15.90:0/3411310885 >> v2:172.21.15.149:3300/0 conn(0x7f1e980c2990 0x7f1e9806dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.224+0000 7f1e9e800640 1 --2- 172.21.15.90:0/3411310885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e98069160 0x7f1e980a9fa0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.224+0000 7f1e9e800640 1 -- 172.21.15.90:0/3411310885 >> 172.21.15.90:0/3411310885 conn(0x7f1e9806cde0 msgr2=0x7f1e9806d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:51.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.224+0000 7f1e9e800640 1 -- 172.21.15.90:0/3411310885 shutdown_connections 2024-09-21T03:24:51.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.224+0000 7f1e9e800640 1 -- 172.21.15.90:0/3411310885 wait complete. 2024-09-21T03:24:51.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.226+0000 7f1e9e800640 1 Processor -- start 2024-09-21T03:24:51.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.226+0000 7f1e9e800640 1 -- start start 2024-09-21T03:24:51.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.227+0000 7f1e9e800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e98069160 0x7f1e980c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:51.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.227+0000 7f1e9e800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e980c2990 0x7f1e980ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:51.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.228+0000 7f1e9e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e98154250 0x7f1e980adc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:51.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.228+0000 7f1e9e800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9806e020 con 0x7f1e98154250 2024-09-21T03:24:51.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.228+0000 7f1e9e800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1e980c4880 con 0x7f1e98069160 2024-09-21T03:24:51.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.228+0000 7f1e9e800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1e98154660 con 0x7f1e980c2990 2024-09-21T03:24:51.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.228+0000 7f1e9de00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e98154250 0x7f1e980adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:51.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.228+0000 7f1e9d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e98069160 0x7f1e980c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:51.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.228+0000 7f1e9ca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e980c2990 0x7f1e980ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:51.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.228+0000 7f1e9d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e98069160 0x7f1e980c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.90:33186/0 (socket says 172.21.15.90:33186) 2024-09-21T03:24:51.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.228+0000 7f1e9ca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e980c2990 0x7f1e980ad740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.90:50654/0 (socket says 172.21.15.90:50654) 2024-09-21T03:24:51.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.228+0000 7f1e9d400640 1 -- 172.21.15.90:0/2340709123 learned_addr learned my addr 172.21.15.90:0/2340709123 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:51.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.228+0000 7f1e9de00640 1 -- 172.21.15.90:0/2340709123 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e980c2990 msgr2=0x7f1e980ad740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:51.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.228+0000 7f1e9de00640 1 --2- 172.21.15.90:0/2340709123 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e980c2990 0x7f1e980ad740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.228+0000 7f1e9de00640 1 -- 172.21.15.90:0/2340709123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e98069160 msgr2=0x7f1e980c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:51.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.228+0000 7f1e9de00640 1 --2- 172.21.15.90:0/2340709123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e98069160 0x7f1e980c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.228+0000 7f1e9de00640 1 -- 172.21.15.90:0/2340709123 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e980c6eb0 con 0x7f1e98154250 2024-09-21T03:24:51.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.228+0000 7f1e9d400640 1 --2- 172.21.15.90:0/2340709123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e98069160 0x7f1e980c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:24:51.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.228+0000 7f1e9ca00640 1 --2- 172.21.15.90:0/2340709123 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e980c2990 0x7f1e980ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:24:51.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.229+0000 7f1e9de00640 1 --2- 172.21.15.90:0/2340709123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e98154250 0x7f1e980adc80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000c730 tx=0x7f1e9000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:51.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.229+0000 7f1e95600640 1 -- 172.21.15.90:0/2340709123 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e90003b70 con 0x7f1e98154250 2024-09-21T03:24:51.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.229+0000 7f1e95600640 1 -- 172.21.15.90:0/2340709123 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e90003d10 con 0x7f1e98154250 2024-09-21T03:24:51.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.229+0000 7f1e9e800640 1 -- 172.21.15.90:0/2340709123 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e981eb7d0 con 0x7f1e98154250 2024-09-21T03:24:51.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.229+0000 7f1e95600640 1 -- 172.21.15.90:0/2340709123 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e90005330 con 0x7f1e98154250 2024-09-21T03:24:51.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.229+0000 7f1e9e800640 1 -- 172.21.15.90:0/2340709123 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e981eba70 con 0x7f1e98154250 2024-09-21T03:24:51.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.230+0000 7f1e9e800640 1 -- 172.21.15.90:0/2340709123 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e980c8440 con 0x7f1e98154250 2024-09-21T03:24:51.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.231+0000 7f1e95600640 1 -- 172.21.15.90:0/2340709123 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1e900056e0 con 0x7f1e98154250 2024-09-21T03:24:51.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.232+0000 7f1e95600640 1 --2- 172.21.15.90:0/2340709123 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1e78078b90 0x7f1e7807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:51.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.232+0000 7f1e95600640 1 -- 172.21.15.90:0/2340709123 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f1e9009aeb0 con 0x7f1e98154250 2024-09-21T03:24:51.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.233+0000 7f1e9d400640 1 --2- 172.21.15.90:0/2340709123 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1e78078b90 0x7f1e7807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:51.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.233+0000 7f1e9d400640 1 --2- 172.21.15.90:0/2340709123 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1e78078b90 0x7f1e7807b0a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c009230 tx=0x7f1e8c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:51.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.237+0000 7f1e95600640 1 -- 172.21.15.90:0/2340709123 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1e980c8440 con 0x7f1e98154250 2024-09-21T03:24:51.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.424+0000 7f1e9e800640 1 -- 172.21.15.90:0/2340709123 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f1e9814eae0 con 0x7f1e78078b90 2024-09-21T03:24:51.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.424+0000 7f1e95600640 1 -- 172.21.15.90:0/2340709123 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1e9814eae0 con 0x7f1e78078b90 2024-09-21T03:24:51.426 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 2 to deep-scrub 2024-09-21T03:24:51.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.427+0000 7f1e9e800640 1 -- 172.21.15.90:0/2340709123 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1e78078b90 msgr2=0x7f1e7807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:51.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.427+0000 7f1e9e800640 1 --2- 172.21.15.90:0/2340709123 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1e78078b90 0x7f1e7807b0a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c009230 tx=0x7f1e8c004730 comp rx=0 tx=0).stop 2024-09-21T03:24:51.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.427+0000 7f1e9e800640 1 -- 172.21.15.90:0/2340709123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e98154250 msgr2=0x7f1e980adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:51.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.427+0000 7f1e9e800640 1 --2- 172.21.15.90:0/2340709123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e98154250 0x7f1e980adc80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000c730 tx=0x7f1e9000cbf0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.427+0000 7f1e9e800640 1 -- 172.21.15.90:0/2340709123 shutdown_connections 2024-09-21T03:24:51.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.427+0000 7f1e9e800640 1 --2- 172.21.15.90:0/2340709123 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1e78078b90 0x7f1e7807b0a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.427+0000 7f1e9e800640 1 --2- 172.21.15.90:0/2340709123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e98154250 0x7f1e980adc80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.427+0000 7f1e9e800640 1 --2- 172.21.15.90:0/2340709123 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e980c2990 0x7f1e980ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.427+0000 7f1e9e800640 1 --2- 172.21.15.90:0/2340709123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e98069160 0x7f1e980c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.427+0000 7f1e9e800640 1 -- 172.21.15.90:0/2340709123 >> 172.21.15.90:0/2340709123 conn(0x7f1e9806cde0 msgr2=0x7f1e98155380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:51.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.427+0000 7f1e9e800640 1 -- 172.21.15.90:0/2340709123 shutdown_connections 2024-09-21T03:24:51.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.427+0000 7f1e9e800640 1 -- 172.21.15.90:0/2340709123 wait complete. 2024-09-21T03:24:51.455 INFO:tasks.ceph:Scrubbing osd.3 2024-09-21T03:24:51.455 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-21T03:24:51.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.681+0000 7f26dd000640 1 -- 172.21.15.90:0/1384967722 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26d81577b0 msgr2=0x7f26d80acce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:51.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.681+0000 7f26dd000640 1 --2- 172.21.15.90:0/1384967722 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26d81577b0 0x7f26d80acce0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f26d0009be0 tx=0x7f26d002a790 comp rx=0 tx=0).stop 2024-09-21T03:24:51.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.681+0000 7f26dd000640 1 -- 172.21.15.90:0/1384967722 shutdown_connections 2024-09-21T03:24:51.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.681+0000 7f26dd000640 1 --2- 172.21.15.90:0/1384967722 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26d81577b0 0x7f26d80acce0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.681+0000 7f26dd000640 1 -- 172.21.15.90:0/1384967722 >> 172.21.15.90:0/1384967722 conn(0x7f26d80c85a0 msgr2=0x7f26d80c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:51.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.681+0000 7f26dd000640 1 -- 172.21.15.90:0/1384967722 shutdown_connections 2024-09-21T03:24:51.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.681+0000 7f26dd000640 1 -- 172.21.15.90:0/1384967722 wait complete. 2024-09-21T03:24:51.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.684+0000 7f26dd000640 1 Processor -- start 2024-09-21T03:24:51.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.684+0000 7f26dd000640 1 -- start start 2024-09-21T03:24:51.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.685+0000 7f26dd000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26d8149f50 0x7f26d814c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:51.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.685+0000 7f26dd000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26d814a360 0x7f26d81f0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:51.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.685+0000 7f26dd000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26d81577b0 0x7f26d80c39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:51.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.685+0000 7f26dd000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f26d80ad220 con 0x7f26d81577b0 2024-09-21T03:24:51.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.685+0000 7f26dd000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f26d80747d0 con 0x7f26d8149f50 2024-09-21T03:24:51.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.685+0000 7f26dd000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f26d8073b70 con 0x7f26d814a360 2024-09-21T03:24:51.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.686+0000 7f26d6800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26d81577b0 0x7f26d80c39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:51.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.686+0000 7f26d5e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26d8149f50 0x7f26d814c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:51.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.686+0000 7f26d6800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26d81577b0 0x7f26d80c39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35340/0 (socket says 172.21.15.90:35340) 2024-09-21T03:24:51.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.686+0000 7f26d5400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26d814a360 0x7f26d81f0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:51.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.686+0000 7f26d6800640 1 -- 172.21.15.90:0/596784155 learned_addr learned my addr 172.21.15.90:0/596784155 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:51.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.686+0000 7f26d6800640 1 -- 172.21.15.90:0/596784155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26d814a360 msgr2=0x7f26d81f0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:51.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.686+0000 7f26d6800640 1 --2- 172.21.15.90:0/596784155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26d814a360 0x7f26d81f0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.686+0000 7f26d6800640 1 -- 172.21.15.90:0/596784155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26d8149f50 msgr2=0x7f26d814c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:51.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.686+0000 7f26d6800640 1 --2- 172.21.15.90:0/596784155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26d8149f50 0x7f26d814c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.686+0000 7f26d6800640 1 -- 172.21.15.90:0/596784155 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d81544b0 con 0x7f26d81577b0 2024-09-21T03:24:51.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.687+0000 7f26d6800640 1 --2- 172.21.15.90:0/596784155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26d81577b0 0x7f26d80c39a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f26d0009be0 tx=0x7f26d0032be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:51.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.687+0000 7f26ce000640 1 -- 172.21.15.90:0/596784155 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d0041020 con 0x7f26d81577b0 2024-09-21T03:24:51.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.687+0000 7f26ce000640 1 -- 172.21.15.90:0/596784155 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26d0004040 con 0x7f26d81577b0 2024-09-21T03:24:51.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.687+0000 7f26dd000640 1 -- 172.21.15.90:0/596784155 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26d814cd20 con 0x7f26d81577b0 2024-09-21T03:24:51.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.687+0000 7f26ce000640 1 -- 172.21.15.90:0/596784155 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d0036040 con 0x7f26d81577b0 2024-09-21T03:24:51.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.687+0000 7f26dd000640 1 -- 172.21.15.90:0/596784155 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d814cfe0 con 0x7f26d81577b0 2024-09-21T03:24:51.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.688+0000 7f26dd000640 1 -- 172.21.15.90:0/596784155 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f26d80c2f30 con 0x7f26d81577b0 2024-09-21T03:24:51.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.689+0000 7f26ce000640 1 -- 172.21.15.90:0/596784155 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f26d0044020 con 0x7f26d81577b0 2024-09-21T03:24:51.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.690+0000 7f26ce000640 1 --2- 172.21.15.90:0/596784155 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f26b8078b90 0x7f26b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:51.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.691+0000 7f26ce000640 1 -- 172.21.15.90:0/596784155 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f26d00bc240 con 0x7f26d81577b0 2024-09-21T03:24:51.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.691+0000 7f26d5e00640 1 --2- 172.21.15.90:0/596784155 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f26b8078b90 0x7f26b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:51.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.691+0000 7f26ce000640 1 --2- 172.21.15.90:0/596784155 >> [v2:172.21.15.90:6816/1515884437,v1:172.21.15.90:6817/1515884437] conn(0x7f26b80835d0 0x7f26b8085ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:51.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.691+0000 7f26ce000640 1 -- 172.21.15.90:0/596784155 --> [v2:172.21.15.90:6816/1515884437,v1:172.21.15.90:6817/1515884437] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f26b8086190 con 0x7f26b80835d0 2024-09-21T03:24:51.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.691+0000 7f26ce000640 1 -- 172.21.15.90:0/596784155 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f26d00bc5f0 con 0x7f26d81577b0 2024-09-21T03:24:51.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.691+0000 7f26d5400640 1 --2- 172.21.15.90:0/596784155 >> [v2:172.21.15.90:6816/1515884437,v1:172.21.15.90:6817/1515884437] conn(0x7f26b80835d0 0x7f26b8085ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:51.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.692+0000 7f26d5e00640 1 --2- 172.21.15.90:0/596784155 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f26b8078b90 0x7f26b807b0a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f26c8001120 tx=0x7f26c8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:51.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.692+0000 7f26d5400640 1 --2- 172.21.15.90:0/596784155 >> [v2:172.21.15.90:6816/1515884437,v1:172.21.15.90:6817/1515884437] conn(0x7f26b80835d0 0x7f26b8085ac0 crc :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:51.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.693+0000 7f26ce000640 1 -- 172.21.15.90:0/596784155 <== osd.3 v2:172.21.15.90:6816/1515884437 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f26b8086190 con 0x7f26b80835d0 2024-09-21T03:24:51.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.706+0000 7f26dd000640 1 -- 172.21.15.90:0/596784155 --> [v2:172.21.15.90:6816/1515884437,v1:172.21.15.90:6817/1515884437] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f26d80c8d20 con 0x7f26b80835d0 2024-09-21T03:24:51.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.707+0000 7f26ce000640 1 -- 172.21.15.90:0/596784155 <== osd.3 v2:172.21.15.90:6816/1515884437 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f26d80c8d20 con 0x7f26b80835d0 2024-09-21T03:24:51.709 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:24:51.709 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T03:24:51.709 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:24:51.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.707+0000 7f26dd000640 1 -- 172.21.15.90:0/596784155 >> [v2:172.21.15.90:6816/1515884437,v1:172.21.15.90:6817/1515884437] conn(0x7f26b80835d0 msgr2=0x7f26b8085ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:51.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.707+0000 7f26dd000640 1 --2- 172.21.15.90:0/596784155 >> [v2:172.21.15.90:6816/1515884437,v1:172.21.15.90:6817/1515884437] conn(0x7f26b80835d0 0x7f26b8085ac0 crc :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.707+0000 7f26dd000640 1 -- 172.21.15.90:0/596784155 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f26b8078b90 msgr2=0x7f26b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:51.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.707+0000 7f26dd000640 1 --2- 172.21.15.90:0/596784155 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f26b8078b90 0x7f26b807b0a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f26c8001120 tx=0x7f26c8009040 comp rx=0 tx=0).stop 2024-09-21T03:24:51.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.707+0000 7f26dd000640 1 -- 172.21.15.90:0/596784155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26d81577b0 msgr2=0x7f26d80c39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:51.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.707+0000 7f26dd000640 1 --2- 172.21.15.90:0/596784155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26d81577b0 0x7f26d80c39a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f26d0009be0 tx=0x7f26d0032be0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.707+0000 7f26d6800640 1 -- 172.21.15.90:0/596784155 reap_dead start 2024-09-21T03:24:51.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.707+0000 7f26dd000640 1 -- 172.21.15.90:0/596784155 shutdown_connections 2024-09-21T03:24:51.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.707+0000 7f26dd000640 1 -- 172.21.15.90:0/596784155 >> 172.21.15.90:0/596784155 conn(0x7f26d80c85a0 msgr2=0x7f26d806f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:51.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.708+0000 7f26dd000640 1 -- 172.21.15.90:0/596784155 shutdown_connections 2024-09-21T03:24:51.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.708+0000 7f26dd000640 1 -- 172.21.15.90:0/596784155 wait complete. 2024-09-21T03:24:51.730 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-21T03:24:51.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.957+0000 7f5b72800640 1 -- 172.21.15.90:0/988433281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b6c156f60 msgr2=0x7f5b6c157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:51.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.957+0000 7f5b72800640 1 --2- 172.21.15.90:0/988433281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b6c156f60 0x7f5b6c157370 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0ae4f0 tx=0x7f5b6402a980 comp rx=0 tx=0).stop 2024-09-21T03:24:51.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.957+0000 7f5b72800640 1 -- 172.21.15.90:0/988433281 shutdown_connections 2024-09-21T03:24:51.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.957+0000 7f5b72800640 1 --2- 172.21.15.90:0/988433281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b6c156f60 0x7f5b6c157370 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.957+0000 7f5b72800640 1 --2- 172.21.15.90:0/988433281 >> v2:172.21.15.149:3300/0 conn(0x7f5b6c06e760 0x7f5b6c06eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.957+0000 7f5b72800640 1 -- 172.21.15.90:0/988433281 >> 172.21.15.90:0/988433281 conn(0x7f5b6c0c85a0 msgr2=0x7f5b6c0c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:51.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.957+0000 7f5b72800640 1 -- 172.21.15.90:0/988433281 shutdown_connections 2024-09-21T03:24:51.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.957+0000 7f5b72800640 1 -- 172.21.15.90:0/988433281 wait complete. 2024-09-21T03:24:51.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.959+0000 7f5b72800640 1 Processor -- start 2024-09-21T03:24:51.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.959+0000 7f5b72800640 1 -- start start 2024-09-21T03:24:51.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.960+0000 7f5b72800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b6c06e760 0x7f5b6c0c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:51.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.960+0000 7f5b72800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b6c074ec0 0x7f5b6c14d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:51.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.960+0000 7f5b72800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b6c156f60 0x7f5b6c155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:51.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.961+0000 7f5b72800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c074330 con 0x7f5b6c074ec0 2024-09-21T03:24:51.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.961+0000 7f5b72800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1578b0 con 0x7f5b6c156f60 2024-09-21T03:24:51.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.961+0000 7f5b72800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5b6c156880 con 0x7f5b6c06e760 2024-09-21T03:24:51.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.961+0000 7f5b63e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b6c074ec0 0x7f5b6c14d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:51.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.961+0000 7f5b63e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b6c074ec0 0x7f5b6c14d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35358/0 (socket says 172.21.15.90:35358) 2024-09-21T03:24:51.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.961+0000 7f5b63e00640 1 -- 172.21.15.90:0/2678101467 learned_addr learned my addr 172.21.15.90:0/2678101467 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:51.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.961+0000 7f5b6b400640 1 --2- 172.21.15.90:0/2678101467 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b6c06e760 0x7f5b6c0c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:51.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.961+0000 7f5b6be00640 1 --2- 172.21.15.90:0/2678101467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b6c156f60 0x7f5b6c155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:51.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.961+0000 7f5b63e00640 1 -- 172.21.15.90:0/2678101467 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b6c06e760 msgr2=0x7f5b6c0c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:51.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.961+0000 7f5b63e00640 1 --2- 172.21.15.90:0/2678101467 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b6c06e760 0x7f5b6c0c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.961+0000 7f5b63e00640 1 -- 172.21.15.90:0/2678101467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b6c156f60 msgr2=0x7f5b6c155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:51.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.961+0000 7f5b63e00640 1 --2- 172.21.15.90:0/2678101467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b6c156f60 0x7f5b6c155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.961+0000 7f5b63e00640 1 -- 172.21.15.90:0/2678101467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6c0c7ba0 con 0x7f5b6c074ec0 2024-09-21T03:24:51.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.962+0000 7f5b63e00640 1 --2- 172.21.15.90:0/2678101467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b6c074ec0 0x7f5b6c14d670 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400d700 tx=0x7f5b5400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:51.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.962+0000 7f5b63400640 1 -- 172.21.15.90:0/2678101467 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b54017070 con 0x7f5b6c074ec0 2024-09-21T03:24:51.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.962+0000 7f5b63400640 1 -- 172.21.15.90:0/2678101467 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b54005310 con 0x7f5b6c074ec0 2024-09-21T03:24:51.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.962+0000 7f5b63400640 1 -- 172.21.15.90:0/2678101467 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b54009820 con 0x7f5b6c074ec0 2024-09-21T03:24:51.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.962+0000 7f5b72800640 1 -- 172.21.15.90:0/2678101467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b6c1e0570 con 0x7f5b6c074ec0 2024-09-21T03:24:51.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.962+0000 7f5b72800640 1 -- 172.21.15.90:0/2678101467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b6c150700 con 0x7f5b6c074ec0 2024-09-21T03:24:51.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.963+0000 7f5b72800640 1 -- 172.21.15.90:0/2678101467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b6c1e0360 con 0x7f5b6c074ec0 2024-09-21T03:24:51.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.964+0000 7f5b63400640 1 -- 172.21.15.90:0/2678101467 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5b540099c0 con 0x7f5b6c074ec0 2024-09-21T03:24:51.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.965+0000 7f5b63400640 1 --2- 172.21.15.90:0/2678101467 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5b48078b90 0x7f5b4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:51.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.965+0000 7f5b63400640 1 -- 172.21.15.90:0/2678101467 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f5b5409b130 con 0x7f5b6c074ec0 2024-09-21T03:24:51.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.966+0000 7f5b6b400640 1 --2- 172.21.15.90:0/2678101467 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5b48078b90 0x7f5b4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:51.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.966+0000 7f5b6b400640 1 --2- 172.21.15.90:0/2678101467 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5b48078b90 0x7f5b4807b0a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0098c0 tx=0x7f5b5c009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:51.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:51.970+0000 7f5b63400640 1 -- 172.21.15.90:0/2678101467 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5b54062b50 con 0x7f5b6c074ec0 2024-09-21T03:24:52.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.160+0000 7f5b72800640 1 -- 172.21.15.90:0/2678101467 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f5b6c06eb70 con 0x7f5b48078b90 2024-09-21T03:24:52.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.161+0000 7f5b63400640 1 -- 172.21.15.90:0/2678101467 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5b6c06eb70 con 0x7f5b48078b90 2024-09-21T03:24:52.163 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 3 to deep-scrub 2024-09-21T03:24:52.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.164+0000 7f5b72800640 1 -- 172.21.15.90:0/2678101467 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5b48078b90 msgr2=0x7f5b4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.164+0000 7f5b72800640 1 --2- 172.21.15.90:0/2678101467 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5b48078b90 0x7f5b4807b0a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0098c0 tx=0x7f5b5c009060 comp rx=0 tx=0).stop 2024-09-21T03:24:52.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.164+0000 7f5b72800640 1 -- 172.21.15.90:0/2678101467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b6c074ec0 msgr2=0x7f5b6c14d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.164+0000 7f5b72800640 1 --2- 172.21.15.90:0/2678101467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b6c074ec0 0x7f5b6c14d670 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400d700 tx=0x7f5b5400dbc0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.164+0000 7f5b72800640 1 -- 172.21.15.90:0/2678101467 shutdown_connections 2024-09-21T03:24:52.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.164+0000 7f5b72800640 1 --2- 172.21.15.90:0/2678101467 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f5b48078b90 0x7f5b4807b0a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.164+0000 7f5b72800640 1 --2- 172.21.15.90:0/2678101467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b6c156f60 0x7f5b6c155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.164+0000 7f5b72800640 1 --2- 172.21.15.90:0/2678101467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b6c074ec0 0x7f5b6c14d670 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.164+0000 7f5b72800640 1 --2- 172.21.15.90:0/2678101467 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b6c06e760 0x7f5b6c0c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.164+0000 7f5b72800640 1 -- 172.21.15.90:0/2678101467 >> 172.21.15.90:0/2678101467 conn(0x7f5b6c0c85a0 msgr2=0x7f5b6c0c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:52.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.164+0000 7f5b72800640 1 -- 172.21.15.90:0/2678101467 shutdown_connections 2024-09-21T03:24:52.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.164+0000 7f5b72800640 1 -- 172.21.15.90:0/2678101467 wait complete. 2024-09-21T03:24:52.192 INFO:tasks.ceph:Scrubbing osd.4 2024-09-21T03:24:52.192 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-21T03:24:52.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.675+0000 7feaa3e00640 1 -- 172.21.15.90:0/3519282938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaa40735b0 msgr2=0x7feaa4160ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.675+0000 7feaa3e00640 1 --2- 172.21.15.90:0/3519282938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaa40735b0 0x7feaa4160ef0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7feaa4072500 tx=0x7fea8c02a560 comp rx=0 tx=0).stop 2024-09-21T03:24:52.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.675+0000 7feaa3e00640 1 -- 172.21.15.90:0/3519282938 shutdown_connections 2024-09-21T03:24:52.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.675+0000 7feaa3e00640 1 --2- 172.21.15.90:0/3519282938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaa40735b0 0x7feaa4160ef0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.675+0000 7feaa3e00640 1 --2- 172.21.15.90:0/3519282938 >> v2:172.21.15.149:3300/0 conn(0x7feaa406fea0 0x7feaa40c2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.675+0000 7feaa3e00640 1 -- 172.21.15.90:0/3519282938 >> 172.21.15.90:0/3519282938 conn(0x7feaa406cde0 msgr2=0x7feaa406d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:52.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.675+0000 7feaa3e00640 1 -- 172.21.15.90:0/3519282938 shutdown_connections 2024-09-21T03:24:52.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.675+0000 7feaa3e00640 1 -- 172.21.15.90:0/3519282938 wait complete. 2024-09-21T03:24:52.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.677+0000 7feaa3e00640 1 Processor -- start 2024-09-21T03:24:52.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.677+0000 7feaa3e00640 1 -- start start 2024-09-21T03:24:52.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.679+0000 7feaa3e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feaa40735b0 0x7feaa40bd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.679+0000 7feaa3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaa4164000 0x7feaa41676e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.679+0000 7feaa3e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feaa41ff2b0 0x7feaa415a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.679+0000 7feaa3e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feaa40732e0 con 0x7feaa4164000 2024-09-21T03:24:52.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.679+0000 7feaa3e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7feaa4073160 con 0x7feaa41ff2b0 2024-09-21T03:24:52.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.679+0000 7feaa3e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7feaa406e8d0 con 0x7feaa40735b0 2024-09-21T03:24:52.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.679+0000 7fea9be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaa4164000 0x7feaa41676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.679+0000 7fea9be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaa4164000 0x7feaa41676e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35376/0 (socket says 172.21.15.90:35376) 2024-09-21T03:24:52.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.679+0000 7fea9be00640 1 -- 172.21.15.90:0/4142266852 learned_addr learned my addr 172.21.15.90:0/4142266852 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:52.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.679+0000 7feaa2a00640 1 --2- 172.21.15.90:0/4142266852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feaa40735b0 0x7feaa40bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.679+0000 7feaa3400640 1 --2- 172.21.15.90:0/4142266852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feaa41ff2b0 0x7feaa415a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.680+0000 7fea9be00640 1 -- 172.21.15.90:0/4142266852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feaa40735b0 msgr2=0x7feaa40bd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.680+0000 7fea9be00640 1 --2- 172.21.15.90:0/4142266852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feaa40735b0 0x7feaa40bd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.680+0000 7fea9be00640 1 -- 172.21.15.90:0/4142266852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feaa41ff2b0 msgr2=0x7feaa415a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.680+0000 7fea9be00640 1 --2- 172.21.15.90:0/4142266852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feaa41ff2b0 0x7feaa415a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.680+0000 7fea9be00640 1 -- 172.21.15.90:0/4142266852 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa40c1d50 con 0x7feaa4164000 2024-09-21T03:24:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.680+0000 7feaa2a00640 1 --2- 172.21.15.90:0/4142266852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feaa40735b0 0x7feaa40bd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:24:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.680+0000 7feaa3400640 1 --2- 172.21.15.90:0/4142266852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feaa41ff2b0 0x7feaa415a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:24:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.680+0000 7fea9be00640 1 --2- 172.21.15.90:0/4142266852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaa4164000 0x7feaa41676e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fea8c000c00 tx=0x7fea8c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.681+0000 7fea9b400640 1 -- 172.21.15.90:0/4142266852 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c03e030 con 0x7feaa4164000 2024-09-21T03:24:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.681+0000 7fea9b400640 1 -- 172.21.15.90:0/4142266852 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea8c003d10 con 0x7feaa4164000 2024-09-21T03:24:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.681+0000 7fea9b400640 1 -- 172.21.15.90:0/4142266852 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c035040 con 0x7feaa4164000 2024-09-21T03:24:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.681+0000 7feaa3e00640 1 -- 172.21.15.90:0/4142266852 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa415b4b0 con 0x7feaa4164000 2024-09-21T03:24:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.681+0000 7feaa3e00640 1 -- 172.21.15.90:0/4142266852 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa40c4110 con 0x7feaa4164000 2024-09-21T03:24:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.682+0000 7feaa3e00640 1 -- 172.21.15.90:0/4142266852 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feaa415b790 con 0x7feaa4164000 2024-09-21T03:24:52.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.684+0000 7fea9b400640 1 -- 172.21.15.90:0/4142266852 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea8c041030 con 0x7feaa4164000 2024-09-21T03:24:52.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.684+0000 7fea9b400640 1 --2- 172.21.15.90:0/4142266852 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fea80078b90 0x7fea8007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.685+0000 7fea9b400640 1 -- 172.21.15.90:0/4142266852 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fea8c0bbd00 con 0x7feaa4164000 2024-09-21T03:24:52.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.685+0000 7fea9b400640 1 --2- 172.21.15.90:0/4142266852 >> [v2:172.21.15.149:6814/4278726553,v1:172.21.15.149:6816/4278726553] conn(0x7fea800835e0 0x7fea80085ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.685+0000 7feaa2a00640 1 --2- 172.21.15.90:0/4142266852 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fea80078b90 0x7fea8007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.685+0000 7fea9b400640 1 -- 172.21.15.90:0/4142266852 --> [v2:172.21.15.149:6814/4278726553,v1:172.21.15.149:6816/4278726553] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fea8c005310 con 0x7fea800835e0 2024-09-21T03:24:52.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.685+0000 7fea9b400640 1 -- 172.21.15.90:0/4142266852 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fea8c0bc0b0 con 0x7feaa4164000 2024-09-21T03:24:52.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.685+0000 7feaa3400640 1 --2- 172.21.15.90:0/4142266852 >> [v2:172.21.15.149:6814/4278726553,v1:172.21.15.149:6816/4278726553] conn(0x7fea800835e0 0x7fea80085ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.686+0000 7feaa2a00640 1 --2- 172.21.15.90:0/4142266852 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fea80078b90 0x7fea8007b0a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fea9400df50 tx=0x7fea94011040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:52.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.686+0000 7feaa3400640 1 --2- 172.21.15.90:0/4142266852 >> [v2:172.21.15.149:6814/4278726553,v1:172.21.15.149:6816/4278726553] conn(0x7fea800835e0 0x7fea80085ad0 crc :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:52.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.687+0000 7fea9b400640 1 -- 172.21.15.90:0/4142266852 <== osd.4 v2:172.21.15.149:6814/4278726553 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fea8c005310 con 0x7fea800835e0 2024-09-21T03:24:52.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.701+0000 7feaa3e00640 1 -- 172.21.15.90:0/4142266852 --> [v2:172.21.15.149:6814/4278726553,v1:172.21.15.149:6816/4278726553] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7feaa4074990 con 0x7fea800835e0 2024-09-21T03:24:52.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.702+0000 7fea9b400640 1 -- 172.21.15.90:0/4142266852 <== osd.4 v2:172.21.15.149:6814/4278726553 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7feaa4074990 con 0x7fea800835e0 2024-09-21T03:24:52.704 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:24:52.704 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T03:24:52.704 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:24:52.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.702+0000 7feaa3e00640 1 -- 172.21.15.90:0/4142266852 >> [v2:172.21.15.149:6814/4278726553,v1:172.21.15.149:6816/4278726553] conn(0x7fea800835e0 msgr2=0x7fea80085ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.702+0000 7feaa3e00640 1 --2- 172.21.15.90:0/4142266852 >> [v2:172.21.15.149:6814/4278726553,v1:172.21.15.149:6816/4278726553] conn(0x7fea800835e0 0x7fea80085ad0 crc :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.702+0000 7feaa3e00640 1 -- 172.21.15.90:0/4142266852 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fea80078b90 msgr2=0x7fea8007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.702+0000 7feaa3e00640 1 --2- 172.21.15.90:0/4142266852 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fea80078b90 0x7fea8007b0a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fea9400df50 tx=0x7fea94011040 comp rx=0 tx=0).stop 2024-09-21T03:24:52.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.702+0000 7feaa3e00640 1 -- 172.21.15.90:0/4142266852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaa4164000 msgr2=0x7feaa41676e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.702+0000 7feaa3e00640 1 --2- 172.21.15.90:0/4142266852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaa4164000 0x7feaa41676e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fea8c000c00 tx=0x7fea8c003820 comp rx=0 tx=0).stop 2024-09-21T03:24:52.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.703+0000 7feaa3400640 1 -- 172.21.15.90:0/4142266852 reap_dead start 2024-09-21T03:24:52.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.703+0000 7feaa3e00640 1 -- 172.21.15.90:0/4142266852 shutdown_connections 2024-09-21T03:24:52.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.703+0000 7feaa3e00640 1 -- 172.21.15.90:0/4142266852 >> 172.21.15.90:0/4142266852 conn(0x7feaa406cde0 msgr2=0x7feaa4160090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:52.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.703+0000 7feaa3e00640 1 -- 172.21.15.90:0/4142266852 shutdown_connections 2024-09-21T03:24:52.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.703+0000 7feaa3e00640 1 -- 172.21.15.90:0/4142266852 wait complete. 2024-09-21T03:24:52.727 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-21T03:24:52.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.953+0000 7fabdbe00640 1 -- 172.21.15.90:0/2867604387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabdc06f920 msgr2=0x7fabdc06fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.953+0000 7fabdbe00640 1 --2- 172.21.15.90:0/2867604387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabdc06f920 0x7fabdc06fd30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fabdc155a40 tx=0x7fabd402aa10 comp rx=0 tx=0).stop 2024-09-21T03:24:52.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.954+0000 7fabdbe00640 1 -- 172.21.15.90:0/2867604387 shutdown_connections 2024-09-21T03:24:52.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.954+0000 7fabdbe00640 1 --2- 172.21.15.90:0/2867604387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabdc06f920 0x7fabdc06fd30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.954+0000 7fabdbe00640 1 --2- 172.21.15.90:0/2867604387 >> v2:172.21.15.149:3300/0 conn(0x7fabdc0acbf0 0x7fabdc0ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.954+0000 7fabdbe00640 1 --2- 172.21.15.90:0/2867604387 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabdc0c4fc0 0x7fabdc0c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.954+0000 7fabdbe00640 1 -- 172.21.15.90:0/2867604387 >> 172.21.15.90:0/2867604387 conn(0x7fabdc06d200 msgr2=0x7fabdc06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:52.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.954+0000 7fabdbe00640 1 -- 172.21.15.90:0/2867604387 shutdown_connections 2024-09-21T03:24:52.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.954+0000 7fabdbe00640 1 -- 172.21.15.90:0/2867604387 wait complete. 2024-09-21T03:24:52.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.956+0000 7fabdbe00640 1 Processor -- start 2024-09-21T03:24:52.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.956+0000 7fabdbe00640 1 -- start start 2024-09-21T03:24:52.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.957+0000 7fabdbe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabdc06f920 0x7fabdc0c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.957+0000 7fabdbe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabdc0acbf0 0x7fabdc0c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.957+0000 7fabdbe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabdc0c4fc0 0x7fabdc14ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.957+0000 7fabdbe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fabdc155080 con 0x7fabdc06f920 2024-09-21T03:24:52.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.957+0000 7fabdbe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fabdc154da0 con 0x7fabdc0c4fc0 2024-09-21T03:24:52.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.957+0000 7fabdbe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fabdc155360 con 0x7fabdc0acbf0 2024-09-21T03:24:52.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.957+0000 7fabdaa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabdc06f920 0x7fabdc0c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.958+0000 7fabdaa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabdc06f920 0x7fabdc0c5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35396/0 (socket says 172.21.15.90:35396) 2024-09-21T03:24:52.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.958+0000 7fabdaa00640 1 -- 172.21.15.90:0/3125377293 learned_addr learned my addr 172.21.15.90:0/3125377293 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:52.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.958+0000 7fabd3e00640 1 --2- 172.21.15.90:0/3125377293 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabdc0acbf0 0x7fabdc0c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.958+0000 7fabdb400640 1 --2- 172.21.15.90:0/3125377293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabdc0c4fc0 0x7fabdc14ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.958+0000 7fabdaa00640 1 -- 172.21.15.90:0/3125377293 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabdc0acbf0 msgr2=0x7fabdc0c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.958+0000 7fabdaa00640 1 --2- 172.21.15.90:0/3125377293 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabdc0acbf0 0x7fabdc0c7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.958+0000 7fabdaa00640 1 -- 172.21.15.90:0/3125377293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabdc0c4fc0 msgr2=0x7fabdc14ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.958+0000 7fabdaa00640 1 --2- 172.21.15.90:0/3125377293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabdc0c4fc0 0x7fabdc14ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.958+0000 7fabdaa00640 1 -- 172.21.15.90:0/3125377293 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabdc0c60d0 con 0x7fabdc06f920 2024-09-21T03:24:52.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.958+0000 7fabdb400640 1 --2- 172.21.15.90:0/3125377293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabdc0c4fc0 0x7fabdc14ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:52.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.958+0000 7fabdaa00640 1 --2- 172.21.15.90:0/3125377293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabdc06f920 0x7fabdc0c5b90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fabcc00b410 tx=0x7fabcc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:52.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.958+0000 7fabd2a00640 1 -- 172.21.15.90:0/3125377293 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabcc015020 con 0x7fabdc06f920 2024-09-21T03:24:52.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.958+0000 7fabd2a00640 1 -- 172.21.15.90:0/3125377293 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabcc011940 con 0x7fabdc06f920 2024-09-21T03:24:52.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.958+0000 7fabdbe00640 1 -- 172.21.15.90:0/3125377293 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabdc1589f0 con 0x7fabdc06f920 2024-09-21T03:24:52.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.959+0000 7fabd2a00640 1 -- 172.21.15.90:0/3125377293 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabcc011d90 con 0x7fabdc06f920 2024-09-21T03:24:52.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.959+0000 7fabdbe00640 1 -- 172.21.15.90:0/3125377293 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabdc1f0530 con 0x7fabdc06f920 2024-09-21T03:24:52.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.960+0000 7fabdbe00640 1 -- 172.21.15.90:0/3125377293 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabdc0aaa80 con 0x7fabdc06f920 2024-09-21T03:24:52.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.961+0000 7fabd2a00640 1 -- 172.21.15.90:0/3125377293 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fabcc018020 con 0x7fabdc06f920 2024-09-21T03:24:52.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.962+0000 7fabd2a00640 1 --2- 172.21.15.90:0/3125377293 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fabb8078b90 0x7fabb807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.962+0000 7fabd2a00640 1 -- 172.21.15.90:0/3125377293 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fabcc09b080 con 0x7fabdc06f920 2024-09-21T03:24:52.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.962+0000 7fabd3e00640 1 --2- 172.21.15.90:0/3125377293 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fabb8078b90 0x7fabb807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.963+0000 7fabd3e00640 1 --2- 172.21.15.90:0/3125377293 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fabb8078b90 0x7fabb807b0a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fabdc158da0 tx=0x7fabc400a250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:52.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:52.966+0000 7fabd2a00640 1 -- 172.21.15.90:0/3125377293 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fabcc01f020 con 0x7fabdc06f920 2024-09-21T03:24:53.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.151+0000 7fabdbe00640 1 -- 172.21.15.90:0/3125377293 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fabdc1e2be0 con 0x7fabb8078b90 2024-09-21T03:24:53.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.152+0000 7fabd2a00640 1 -- 172.21.15.90:0/3125377293 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fabdc1e2be0 con 0x7fabb8078b90 2024-09-21T03:24:53.154 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 4 to deep-scrub 2024-09-21T03:24:53.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.154+0000 7fabdbe00640 1 -- 172.21.15.90:0/3125377293 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fabb8078b90 msgr2=0x7fabb807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.154+0000 7fabdbe00640 1 --2- 172.21.15.90:0/3125377293 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fabb8078b90 0x7fabb807b0a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fabdc158da0 tx=0x7fabc400a250 comp rx=0 tx=0).stop 2024-09-21T03:24:53.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.154+0000 7fabdbe00640 1 -- 172.21.15.90:0/3125377293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabdc06f920 msgr2=0x7fabdc0c5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.154+0000 7fabdbe00640 1 --2- 172.21.15.90:0/3125377293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabdc06f920 0x7fabdc0c5b90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fabcc00b410 tx=0x7fabcc00b8d0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.154+0000 7fabdbe00640 1 -- 172.21.15.90:0/3125377293 shutdown_connections 2024-09-21T03:24:53.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.154+0000 7fabdbe00640 1 --2- 172.21.15.90:0/3125377293 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fabb8078b90 0x7fabb807b0a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.154+0000 7fabdbe00640 1 --2- 172.21.15.90:0/3125377293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabdc0c4fc0 0x7fabdc14ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.154+0000 7fabdbe00640 1 --2- 172.21.15.90:0/3125377293 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabdc0acbf0 0x7fabdc0c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.154+0000 7fabdbe00640 1 --2- 172.21.15.90:0/3125377293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabdc06f920 0x7fabdc0c5b90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.154+0000 7fabdbe00640 1 -- 172.21.15.90:0/3125377293 >> 172.21.15.90:0/3125377293 conn(0x7fabdc06d200 msgr2=0x7fabdc0c13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:53.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.154+0000 7fabdbe00640 1 -- 172.21.15.90:0/3125377293 shutdown_connections 2024-09-21T03:24:53.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.154+0000 7fabdbe00640 1 -- 172.21.15.90:0/3125377293 wait complete. 2024-09-21T03:24:53.178 INFO:tasks.ceph:Scrubbing osd.5 2024-09-21T03:24:53.179 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-21T03:24:53.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.405+0000 7f862e400640 1 -- 172.21.15.90:0/2994542622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86280ae000 msgr2=0x7f8628073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.405+0000 7f862e400640 1 --2- 172.21.15.90:0/2994542622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86280ae000 0x7f8628073220 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f86280c4b40 tx=0x7f861802a440 comp rx=0 tx=0).stop 2024-09-21T03:24:53.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.405+0000 7f862e400640 1 -- 172.21.15.90:0/2994542622 shutdown_connections 2024-09-21T03:24:53.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.405+0000 7f862e400640 1 --2- 172.21.15.90:0/2994542622 >> v2:172.21.15.149:3300/0 conn(0x7f8628151e30 0x7f8628152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.405+0000 7f862e400640 1 --2- 172.21.15.90:0/2994542622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86280ae000 0x7f8628073220 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.405+0000 7f862e400640 1 -- 172.21.15.90:0/2994542622 >> 172.21.15.90:0/2994542622 conn(0x7f862806d1d0 msgr2=0x7f862806d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:53.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.405+0000 7f862e400640 1 -- 172.21.15.90:0/2994542622 shutdown_connections 2024-09-21T03:24:53.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.405+0000 7f862e400640 1 -- 172.21.15.90:0/2994542622 wait complete. 2024-09-21T03:24:53.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.407+0000 7f862e400640 1 Processor -- start 2024-09-21T03:24:53.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.407+0000 7f862e400640 1 -- start start 2024-09-21T03:24:53.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.409+0000 7f862e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86280ae000 0x7f86280c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.409+0000 7f862e400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8628151e30 0x7f86280c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.409+0000 7f862e400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8628154a00 0x7f862814aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.409+0000 7f862e400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8628073760 con 0x7f8628151e30 2024-09-21T03:24:53.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.409+0000 7f862e400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f86280ac000 con 0x7f8628154a00 2024-09-21T03:24:53.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.409+0000 7f862e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8628155520 con 0x7f86280ae000 2024-09-21T03:24:53.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.409+0000 7f8627e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8628151e30 0x7f86280c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:53.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.409+0000 7f8627e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8628151e30 0x7f86280c60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35406/0 (socket says 172.21.15.90:35406) 2024-09-21T03:24:53.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.409+0000 7f8627e00640 1 -- 172.21.15.90:0/2524354362 learned_addr learned my addr 172.21.15.90:0/2524354362 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:53.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.409+0000 7f8627e00640 1 -- 172.21.15.90:0/2524354362 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86280ae000 msgr2=0x7f86280c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.409+0000 7f8627e00640 1 --2- 172.21.15.90:0/2524354362 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86280ae000 0x7f86280c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.409+0000 7f8627e00640 1 -- 172.21.15.90:0/2524354362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8628154a00 msgr2=0x7f862814aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.409+0000 7f8627e00640 1 --2- 172.21.15.90:0/2524354362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8628154a00 0x7f862814aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.409+0000 7f8627e00640 1 -- 172.21.15.90:0/2524354362 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86280c6fb0 con 0x7f8628151e30 2024-09-21T03:24:53.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.410+0000 7f8627e00640 1 --2- 172.21.15.90:0/2524354362 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8628151e30 0x7f86280c60e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f861400d780 tx=0x7f861400dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:53.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.410+0000 7f8624c00640 1 -- 172.21.15.90:0/2524354362 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614017070 con 0x7f8628151e30 2024-09-21T03:24:53.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.410+0000 7f8624c00640 1 -- 172.21.15.90:0/2524354362 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8614009b10 con 0x7f8628151e30 2024-09-21T03:24:53.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.410+0000 7f8624c00640 1 -- 172.21.15.90:0/2524354362 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614010460 con 0x7f8628151e30 2024-09-21T03:24:53.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.410+0000 7f862e400640 1 -- 172.21.15.90:0/2524354362 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86281f02d0 con 0x7f8628151e30 2024-09-21T03:24:53.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.410+0000 7f862e400640 1 -- 172.21.15.90:0/2524354362 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8628151740 con 0x7f8628151e30 2024-09-21T03:24:53.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.411+0000 7f862e400640 1 -- 172.21.15.90:0/2524354362 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8628074be0 con 0x7f8628151e30 2024-09-21T03:24:53.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.412+0000 7f8624c00640 1 -- 172.21.15.90:0/2524354362 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f861401a070 con 0x7f8628151e30 2024-09-21T03:24:53.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.413+0000 7f8624c00640 1 --2- 172.21.15.90:0/2524354362 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8608078b90 0x7f860807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.414+0000 7f8624c00640 1 -- 172.21.15.90:0/2524354362 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f861409b8b0 con 0x7f8628151e30 2024-09-21T03:24:53.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.414+0000 7f862d000640 1 --2- 172.21.15.90:0/2524354362 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8608078b90 0x7f860807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:53.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.414+0000 7f8624c00640 1 --2- 172.21.15.90:0/2524354362 >> [v2:172.21.15.149:6826/1341677333,v1:172.21.15.149:6827/1341677333] conn(0x7f86080835d0 0x7f8608085ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.414+0000 7f8624c00640 1 -- 172.21.15.90:0/2524354362 --> [v2:172.21.15.149:6826/1341677333,v1:172.21.15.149:6827/1341677333] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8614013e50 con 0x7f86080835d0 2024-09-21T03:24:53.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.414+0000 7f8624c00640 1 -- 172.21.15.90:0/2524354362 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f861409bc60 con 0x7f8628151e30 2024-09-21T03:24:53.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.414+0000 7f862da00640 1 --2- 172.21.15.90:0/2524354362 >> [v2:172.21.15.149:6826/1341677333,v1:172.21.15.149:6827/1341677333] conn(0x7f86080835d0 0x7f8608085ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:53.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.415+0000 7f862d000640 1 --2- 172.21.15.90:0/2524354362 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8608078b90 0x7f860807b0a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8618033000 tx=0x7f86180046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:53.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.415+0000 7f862da00640 1 --2- 172.21.15.90:0/2524354362 >> [v2:172.21.15.149:6826/1341677333,v1:172.21.15.149:6827/1341677333] conn(0x7f86080835d0 0x7f8608085ac0 crc :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:53.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.416+0000 7f8624c00640 1 -- 172.21.15.90:0/2524354362 <== osd.5 v2:172.21.15.149:6826/1341677333 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8614013e50 con 0x7f86080835d0 2024-09-21T03:24:53.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.429+0000 7f862e400640 1 -- 172.21.15.90:0/2524354362 --> [v2:172.21.15.149:6826/1341677333,v1:172.21.15.149:6827/1341677333] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8628153b90 con 0x7f86080835d0 2024-09-21T03:24:53.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.430+0000 7f8624c00640 1 -- 172.21.15.90:0/2524354362 <== osd.5 v2:172.21.15.149:6826/1341677333 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8628153b90 con 0x7f86080835d0 2024-09-21T03:24:53.431 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:24:53.432 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T03:24:53.432 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:24:53.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.430+0000 7f862e400640 1 -- 172.21.15.90:0/2524354362 >> [v2:172.21.15.149:6826/1341677333,v1:172.21.15.149:6827/1341677333] conn(0x7f86080835d0 msgr2=0x7f8608085ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.430+0000 7f862e400640 1 --2- 172.21.15.90:0/2524354362 >> [v2:172.21.15.149:6826/1341677333,v1:172.21.15.149:6827/1341677333] conn(0x7f86080835d0 0x7f8608085ac0 crc :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.430+0000 7f862e400640 1 -- 172.21.15.90:0/2524354362 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8608078b90 msgr2=0x7f860807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.430+0000 7f862e400640 1 --2- 172.21.15.90:0/2524354362 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8608078b90 0x7f860807b0a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8618033000 tx=0x7f86180046c0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.430+0000 7f862e400640 1 -- 172.21.15.90:0/2524354362 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8628151e30 msgr2=0x7f86280c60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.430+0000 7f862e400640 1 --2- 172.21.15.90:0/2524354362 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8628151e30 0x7f86280c60e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f861400d780 tx=0x7f861400dc40 comp rx=0 tx=0).stop 2024-09-21T03:24:53.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.430+0000 7f862da00640 1 -- 172.21.15.90:0/2524354362 reap_dead start 2024-09-21T03:24:53.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.430+0000 7f862e400640 1 -- 172.21.15.90:0/2524354362 shutdown_connections 2024-09-21T03:24:53.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.430+0000 7f862e400640 1 -- 172.21.15.90:0/2524354362 >> 172.21.15.90:0/2524354362 conn(0x7f862806d1d0 msgr2=0x7f862814dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:53.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.430+0000 7f862e400640 1 -- 172.21.15.90:0/2524354362 shutdown_connections 2024-09-21T03:24:53.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.430+0000 7f862e400640 1 -- 172.21.15.90:0/2524354362 wait complete. 2024-09-21T03:24:53.454 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-21T03:24:53.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.674+0000 7ffa0e200640 1 -- 172.21.15.90:0/1479930626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa08156f60 msgr2=0x7ffa08157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.674+0000 7ffa0e200640 1 --2- 172.21.15.90:0/1479930626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa08156f60 0x7ffa08157370 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ffa00005fd0 tx=0x7ffa0002aaa0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.674+0000 7ffa0e200640 1 -- 172.21.15.90:0/1479930626 shutdown_connections 2024-09-21T03:24:53.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.674+0000 7ffa0e200640 1 --2- 172.21.15.90:0/1479930626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa08156f60 0x7ffa08157370 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.674+0000 7ffa0e200640 1 -- 172.21.15.90:0/1479930626 >> 172.21.15.90:0/1479930626 conn(0x7ffa080c85a0 msgr2=0x7ffa080c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:53.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.674+0000 7ffa0e200640 1 -- 172.21.15.90:0/1479930626 shutdown_connections 2024-09-21T03:24:53.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.674+0000 7ffa0e200640 1 -- 172.21.15.90:0/1479930626 wait complete. 2024-09-21T03:24:53.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.676+0000 7ffa0e200640 1 Processor -- start 2024-09-21T03:24:53.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.677+0000 7ffa0e200640 1 -- start start 2024-09-21T03:24:53.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.678+0000 7ffa0e200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa0806e760 0x7ffa081ee5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.678+0000 7ffa0e200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa08074ec0 0x7ffa080c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.678+0000 7ffa0e200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa08156f60 0x7ffa08144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.678+0000 7ffa0e200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffa08157a30 con 0x7ffa0806e760 2024-09-21T03:24:53.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.678+0000 7ffa0e200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ffa081578b0 con 0x7ffa08156f60 2024-09-21T03:24:53.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.678+0000 7ffa0e200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ffa08157bb0 con 0x7ffa08074ec0 2024-09-21T03:24:53.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.678+0000 7ffa07400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa0806e760 0x7ffa081ee5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:53.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.678+0000 7ffa07400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa0806e760 0x7ffa081ee5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35434/0 (socket says 172.21.15.90:35434) 2024-09-21T03:24:53.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.678+0000 7ffa07400640 1 -- 172.21.15.90:0/4190589467 learned_addr learned my addr 172.21.15.90:0/4190589467 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:53.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.678+0000 7ffa07e00640 1 --2- 172.21.15.90:0/4190589467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa08156f60 0x7ffa08144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:53.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.678+0000 7ffa06a00640 1 --2- 172.21.15.90:0/4190589467 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa08074ec0 0x7ffa080c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:53.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.679+0000 7ffa07400640 1 -- 172.21.15.90:0/4190589467 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa08074ec0 msgr2=0x7ffa080c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.679+0000 7ffa07400640 1 --2- 172.21.15.90:0/4190589467 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa08074ec0 0x7ffa080c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.679+0000 7ffa07400640 1 -- 172.21.15.90:0/4190589467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa08156f60 msgr2=0x7ffa08144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.679+0000 7ffa07400640 1 --2- 172.21.15.90:0/4190589467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa08156f60 0x7ffa08144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.679+0000 7ffa07400640 1 -- 172.21.15.90:0/4190589467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa081462c0 con 0x7ffa0806e760 2024-09-21T03:24:53.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.679+0000 7ffa06a00640 1 --2- 172.21.15.90:0/4190589467 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa08074ec0 0x7ffa080c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:24:53.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.679+0000 7ffa07400640 1 --2- 172.21.15.90:0/4190589467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa0806e760 0x7ffa081ee5f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800c430 tx=0x7ff9f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:53.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.679+0000 7ff9ff400640 1 -- 172.21.15.90:0/4190589467 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8017070 con 0x7ffa0806e760 2024-09-21T03:24:53.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.679+0000 7ff9ff400640 1 -- 172.21.15.90:0/4190589467 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9f80035f0 con 0x7ffa0806e760 2024-09-21T03:24:53.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.679+0000 7ff9ff400640 1 -- 172.21.15.90:0/4190589467 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8003a20 con 0x7ffa0806e760 2024-09-21T03:24:53.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.679+0000 7ffa0e200640 1 -- 172.21.15.90:0/4190589467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa08149850 con 0x7ffa0806e760 2024-09-21T03:24:53.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.679+0000 7ffa0e200640 1 -- 172.21.15.90:0/4190589467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa081eef00 con 0x7ffa0806e760 2024-09-21T03:24:53.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.680+0000 7ffa0e200640 1 -- 172.21.15.90:0/4190589467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa08157370 con 0x7ffa0806e760 2024-09-21T03:24:53.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.682+0000 7ff9ff400640 1 -- 172.21.15.90:0/4190589467 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff9f801a070 con 0x7ffa0806e760 2024-09-21T03:24:53.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.683+0000 7ff9ff400640 1 --2- 172.21.15.90:0/4190589467 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff9e8078b90 0x7ff9e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.683+0000 7ff9ff400640 1 -- 172.21.15.90:0/4190589467 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7ff9f809a400 con 0x7ffa0806e760 2024-09-21T03:24:53.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.683+0000 7ffa06a00640 1 --2- 172.21.15.90:0/4190589467 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff9e8078b90 0x7ff9e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:53.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.684+0000 7ffa06a00640 1 --2- 172.21.15.90:0/4190589467 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff9e8078b90 0x7ff9e807b0a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ffa080c8140 tx=0x7ff9f4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:53.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.687+0000 7ff9ff400640 1 -- 172.21.15.90:0/4190589467 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff9f8062510 con 0x7ffa0806e760 2024-09-21T03:24:53.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.878+0000 7ffa0e200640 1 -- 172.21.15.90:0/4190589467 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7ffa081465c0 con 0x7ff9e8078b90 2024-09-21T03:24:53.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.879+0000 7ff9ff400640 1 -- 172.21.15.90:0/4190589467 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ffa081465c0 con 0x7ff9e8078b90 2024-09-21T03:24:53.881 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 5 to deep-scrub 2024-09-21T03:24:53.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.881+0000 7ffa0e200640 1 -- 172.21.15.90:0/4190589467 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff9e8078b90 msgr2=0x7ff9e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.881+0000 7ffa0e200640 1 --2- 172.21.15.90:0/4190589467 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff9e8078b90 0x7ff9e807b0a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ffa080c8140 tx=0x7ff9f4009040 comp rx=0 tx=0).stop 2024-09-21T03:24:53.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.881+0000 7ffa0e200640 1 -- 172.21.15.90:0/4190589467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa0806e760 msgr2=0x7ffa081ee5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.881+0000 7ffa0e200640 1 --2- 172.21.15.90:0/4190589467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa0806e760 0x7ffa081ee5f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800c430 tx=0x7ff9f800c8f0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.881+0000 7ffa0e200640 1 -- 172.21.15.90:0/4190589467 shutdown_connections 2024-09-21T03:24:53.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.881+0000 7ffa0e200640 1 --2- 172.21.15.90:0/4190589467 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7ff9e8078b90 0x7ff9e807b0a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.881+0000 7ffa0e200640 1 --2- 172.21.15.90:0/4190589467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa08156f60 0x7ffa08144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.881+0000 7ffa0e200640 1 --2- 172.21.15.90:0/4190589467 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa08074ec0 0x7ffa080c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.881+0000 7ffa0e200640 1 --2- 172.21.15.90:0/4190589467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa0806e760 0x7ffa081ee5f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.881+0000 7ffa0e200640 1 -- 172.21.15.90:0/4190589467 >> 172.21.15.90:0/4190589467 conn(0x7ffa080c85a0 msgr2=0x7ffa0814dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:53.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.881+0000 7ffa0e200640 1 -- 172.21.15.90:0/4190589467 shutdown_connections 2024-09-21T03:24:53.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:53.881+0000 7ffa0e200640 1 -- 172.21.15.90:0/4190589467 wait complete. 2024-09-21T03:24:53.905 INFO:tasks.ceph:Scrubbing osd.6 2024-09-21T03:24:53.905 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-21T03:24:54.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.127+0000 7f9b42200640 1 -- 172.21.15.90:0/3411376405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b3c1522b0 msgr2=0x7f9b3c073af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.127+0000 7f9b42200640 1 --2- 172.21.15.90:0/3411376405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b3c1522b0 0x7f9b3c073af0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9b28005fd0 tx=0x7f9b2802a5d0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.127+0000 7f9b42200640 1 -- 172.21.15.90:0/3411376405 shutdown_connections 2024-09-21T03:24:54.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.127+0000 7f9b42200640 1 --2- 172.21.15.90:0/3411376405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b3c1522b0 0x7f9b3c073af0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.127+0000 7f9b42200640 1 -- 172.21.15.90:0/3411376405 >> 172.21.15.90:0/3411376405 conn(0x7f9b3c0c85a0 msgr2=0x7f9b3c0c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:54.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.127+0000 7f9b42200640 1 -- 172.21.15.90:0/3411376405 shutdown_connections 2024-09-21T03:24:54.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.127+0000 7f9b42200640 1 -- 172.21.15.90:0/3411376405 wait complete. 2024-09-21T03:24:54.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.129+0000 7f9b42200640 1 Processor -- start 2024-09-21T03:24:54.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.129+0000 7f9b42200640 1 -- start start 2024-09-21T03:24:54.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.131+0000 7f9b42200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b3c0abde0 0x7f9b3c154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.131+0000 7f9b42200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b3c0ad600 0x7f9b3c0c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.131+0000 7f9b42200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b3c1522b0 0x7f9b3c144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.131+0000 7f9b42200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c073080 con 0x7f9b3c0abde0 2024-09-21T03:24:54.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.131+0000 7f9b42200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c074030 con 0x7f9b3c1522b0 2024-09-21T03:24:54.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.131+0000 7f9b42200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9b3c154a30 con 0x7f9b3c0ad600 2024-09-21T03:24:54.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.131+0000 7f9b3b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b3c0abde0 0x7f9b3c154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:54.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.131+0000 7f9b3b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b3c0abde0 0x7f9b3c154020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35444/0 (socket says 172.21.15.90:35444) 2024-09-21T03:24:54.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.131+0000 7f9b3b400640 1 -- 172.21.15.90:0/3352856118 learned_addr learned my addr 172.21.15.90:0/3352856118 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:54.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.131+0000 7f9b3b400640 1 -- 172.21.15.90:0/3352856118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b3c0ad600 msgr2=0x7f9b3c0c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.131+0000 7f9b3b400640 1 --2- 172.21.15.90:0/3352856118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b3c0ad600 0x7f9b3c0c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.131+0000 7f9b3b400640 1 -- 172.21.15.90:0/3352856118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b3c1522b0 msgr2=0x7f9b3c144770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.131+0000 7f9b3b400640 1 --2- 172.21.15.90:0/3352856118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b3c1522b0 0x7f9b3c144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.131+0000 7f9b3b400640 1 -- 172.21.15.90:0/3352856118 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c154560 con 0x7f9b3c0abde0 2024-09-21T03:24:54.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.132+0000 7f9b3b400640 1 --2- 172.21.15.90:0/3352856118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b3c0abde0 0x7f9b3c154020 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00c3d0 tx=0x7f9b2c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:54.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.132+0000 7f9b33400640 1 -- 172.21.15.90:0/3352856118 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c017070 con 0x7f9b3c0abde0 2024-09-21T03:24:54.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.132+0000 7f9b33400640 1 -- 172.21.15.90:0/3352856118 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b2c0053c0 con 0x7f9b3c0abde0 2024-09-21T03:24:54.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.132+0000 7f9b33400640 1 -- 172.21.15.90:0/3352856118 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c003850 con 0x7f9b3c0abde0 2024-09-21T03:24:54.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.132+0000 7f9b42200640 1 -- 172.21.15.90:0/3352856118 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3c1e8d00 con 0x7f9b3c0abde0 2024-09-21T03:24:54.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.132+0000 7f9b42200640 1 -- 172.21.15.90:0/3352856118 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b3c158ea0 con 0x7f9b3c0abde0 2024-09-21T03:24:54.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.133+0000 7f9b42200640 1 -- 172.21.15.90:0/3352856118 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9b3c0ada10 con 0x7f9b3c0abde0 2024-09-21T03:24:54.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.134+0000 7f9b33400640 1 -- 172.21.15.90:0/3352856118 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9b2c01a070 con 0x7f9b3c0abde0 2024-09-21T03:24:54.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.135+0000 7f9b33400640 1 --2- 172.21.15.90:0/3352856118 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9b1c078bc0 0x7f9b1c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.135+0000 7f9b33400640 1 -- 172.21.15.90:0/3352856118 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f9b2c09a440 con 0x7f9b3c0abde0 2024-09-21T03:24:54.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.136+0000 7f9b33400640 1 --2- 172.21.15.90:0/3352856118 >> [v2:172.21.15.149:6810/821196931,v1:172.21.15.149:6811/821196931] conn(0x7f9b1c083600 0x7f9b1c085af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.136+0000 7f9b3aa00640 1 --2- 172.21.15.90:0/3352856118 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9b1c078bc0 0x7f9b1c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:54.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.136+0000 7f9b33400640 1 -- 172.21.15.90:0/3352856118 --> [v2:172.21.15.149:6810/821196931,v1:172.21.15.149:6811/821196931] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b2c016ec0 con 0x7f9b1c083600 2024-09-21T03:24:54.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.136+0000 7f9b33400640 1 -- 172.21.15.90:0/3352856118 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9b2c0a1050 con 0x7f9b3c0abde0 2024-09-21T03:24:54.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.136+0000 7f9b3be00640 1 --2- 172.21.15.90:0/3352856118 >> [v2:172.21.15.149:6810/821196931,v1:172.21.15.149:6811/821196931] conn(0x7f9b1c083600 0x7f9b1c085af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:54.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.137+0000 7f9b3aa00640 1 --2- 172.21.15.90:0/3352856118 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9b1c078bc0 0x7f9b1c07b0d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9b28033000 tx=0x7f9b280046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:54.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.137+0000 7f9b3be00640 1 --2- 172.21.15.90:0/3352856118 >> [v2:172.21.15.149:6810/821196931,v1:172.21.15.149:6811/821196931] conn(0x7f9b1c083600 0x7f9b1c085af0 crc :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:54.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.138+0000 7f9b33400640 1 -- 172.21.15.90:0/3352856118 <== osd.6 v2:172.21.15.149:6810/821196931 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9b2c016ec0 con 0x7f9b1c083600 2024-09-21T03:24:54.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.150+0000 7f9b42200640 1 -- 172.21.15.90:0/3352856118 --> [v2:172.21.15.149:6810/821196931,v1:172.21.15.149:6811/821196931] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9b3c0c8e30 con 0x7f9b1c083600 2024-09-21T03:24:54.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.151+0000 7f9b33400640 1 -- 172.21.15.90:0/3352856118 <== osd.6 v2:172.21.15.149:6810/821196931 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9b3c0c8e30 con 0x7f9b1c083600 2024-09-21T03:24:54.153 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:24:54.154 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T03:24:54.154 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:24:54.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.152+0000 7f9b42200640 1 -- 172.21.15.90:0/3352856118 >> [v2:172.21.15.149:6810/821196931,v1:172.21.15.149:6811/821196931] conn(0x7f9b1c083600 msgr2=0x7f9b1c085af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.152+0000 7f9b42200640 1 --2- 172.21.15.90:0/3352856118 >> [v2:172.21.15.149:6810/821196931,v1:172.21.15.149:6811/821196931] conn(0x7f9b1c083600 0x7f9b1c085af0 crc :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.152+0000 7f9b42200640 1 -- 172.21.15.90:0/3352856118 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9b1c078bc0 msgr2=0x7f9b1c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.152+0000 7f9b42200640 1 --2- 172.21.15.90:0/3352856118 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9b1c078bc0 0x7f9b1c07b0d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9b28033000 tx=0x7f9b280046c0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.152+0000 7f9b42200640 1 -- 172.21.15.90:0/3352856118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b3c0abde0 msgr2=0x7f9b3c154020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.152+0000 7f9b42200640 1 --2- 172.21.15.90:0/3352856118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b3c0abde0 0x7f9b3c154020 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00c3d0 tx=0x7f9b2c00c890 comp rx=0 tx=0).stop 2024-09-21T03:24:54.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.152+0000 7f9b3be00640 1 -- 172.21.15.90:0/3352856118 reap_dead start 2024-09-21T03:24:54.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.152+0000 7f9b42200640 1 -- 172.21.15.90:0/3352856118 shutdown_connections 2024-09-21T03:24:54.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.152+0000 7f9b42200640 1 -- 172.21.15.90:0/3352856118 >> 172.21.15.90:0/3352856118 conn(0x7f9b3c0c85a0 msgr2=0x7f9b3c14fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:54.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.152+0000 7f9b42200640 1 -- 172.21.15.90:0/3352856118 shutdown_connections 2024-09-21T03:24:54.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.152+0000 7f9b42200640 1 -- 172.21.15.90:0/3352856118 wait complete. 2024-09-21T03:24:54.175 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-21T03:24:54.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.399+0000 7fafdc000640 1 -- 172.21.15.90:0/1890071641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd414b7b0 msgr2=0x7fafd40ad600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.399+0000 7fafdc000640 1 --2- 172.21.15.90:0/1890071641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd414b7b0 0x7fafd40ad600 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fafd406e7f0 tx=0x7fafc802a560 comp rx=0 tx=0).stop 2024-09-21T03:24:54.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.399+0000 7fafdc000640 1 -- 172.21.15.90:0/1890071641 shutdown_connections 2024-09-21T03:24:54.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.399+0000 7fafdc000640 1 --2- 172.21.15.90:0/1890071641 >> v2:172.21.15.149:3300/0 conn(0x7fafd40abd30 0x7fafd40adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.399+0000 7fafdc000640 1 --2- 172.21.15.90:0/1890071641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd414b7b0 0x7fafd40ad600 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.399+0000 7fafdc000640 1 -- 172.21.15.90:0/1890071641 >> 172.21.15.90:0/1890071641 conn(0x7fafd40c85a0 msgr2=0x7fafd40c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:54.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.399+0000 7fafdc000640 1 -- 172.21.15.90:0/1890071641 shutdown_connections 2024-09-21T03:24:54.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.399+0000 7fafdc000640 1 -- 172.21.15.90:0/1890071641 wait complete. 2024-09-21T03:24:54.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.401+0000 7fafdc000640 1 Processor -- start 2024-09-21T03:24:54.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.401+0000 7fafdc000640 1 -- start start 2024-09-21T03:24:54.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.403+0000 7fafdc000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafd40ab3d0 0x7fafd41e05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.403+0000 7fafdc000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fafd40abd30 0x7fafd41482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.403+0000 7fafdc000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd414b7b0 0x7fafd4148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.403+0000 7fafdc000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fafd40ae150 con 0x7fafd414b7b0 2024-09-21T03:24:54.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.403+0000 7fafdc000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fafd4074f60 con 0x7fafd40ab3d0 2024-09-21T03:24:54.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.403+0000 7fafdc000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fafd40ae2d0 con 0x7fafd40abd30 2024-09-21T03:24:54.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.403+0000 7fafda000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd414b7b0 0x7fafd4148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:54.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.403+0000 7fafda000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd414b7b0 0x7fafd4148830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35464/0 (socket says 172.21.15.90:35464) 2024-09-21T03:24:54.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.403+0000 7fafda000640 1 -- 172.21.15.90:0/4252582245 learned_addr learned my addr 172.21.15.90:0/4252582245 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:54.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.403+0000 7fafd9600640 1 --2- 172.21.15.90:0/4252582245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafd40ab3d0 0x7fafd41e05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:54.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.403+0000 7fafd8c00640 1 --2- 172.21.15.90:0/4252582245 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fafd40abd30 0x7fafd41482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:54.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.404+0000 7fafda000640 1 -- 172.21.15.90:0/4252582245 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fafd40abd30 msgr2=0x7fafd41482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.404+0000 7fafda000640 1 --2- 172.21.15.90:0/4252582245 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fafd40abd30 0x7fafd41482f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.404+0000 7fafda000640 1 -- 172.21.15.90:0/4252582245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafd40ab3d0 msgr2=0x7fafd41e05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.404+0000 7fafda000640 1 --2- 172.21.15.90:0/4252582245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafd40ab3d0 0x7fafd41e05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.404+0000 7fafda000640 1 -- 172.21.15.90:0/4252582245 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd4149420 con 0x7fafd414b7b0 2024-09-21T03:24:54.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.404+0000 7fafda000640 1 --2- 172.21.15.90:0/4252582245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd414b7b0 0x7fafd4148830 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00caa0 tx=0x7fafcc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:54.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.404+0000 7fafd1600640 1 -- 172.21.15.90:0/4252582245 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc00adf0 con 0x7fafd414b7b0 2024-09-21T03:24:54.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.404+0000 7fafd1600640 1 -- 172.21.15.90:0/4252582245 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafcc00f540 con 0x7fafd414b7b0 2024-09-21T03:24:54.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.404+0000 7fafd1600640 1 -- 172.21.15.90:0/4252582245 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc00f990 con 0x7fafd414b7b0 2024-09-21T03:24:54.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.404+0000 7fafdc000640 1 -- 172.21.15.90:0/4252582245 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd4076870 con 0x7fafd414b7b0 2024-09-21T03:24:54.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.404+0000 7fafdc000640 1 -- 172.21.15.90:0/4252582245 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd4148e40 con 0x7fafd414b7b0 2024-09-21T03:24:54.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.405+0000 7fafdc000640 1 -- 172.21.15.90:0/4252582245 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd4073ae0 con 0x7fafd414b7b0 2024-09-21T03:24:54.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.406+0000 7fafd1600640 1 -- 172.21.15.90:0/4252582245 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fafcc00fb30 con 0x7fafd414b7b0 2024-09-21T03:24:54.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.407+0000 7fafd1600640 1 --2- 172.21.15.90:0/4252582245 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fafb4078bc0 0x7fafb407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.407+0000 7fafd1600640 1 -- 172.21.15.90:0/4252582245 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fafcc09bd00 con 0x7fafd414b7b0 2024-09-21T03:24:54.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.408+0000 7fafd9600640 1 --2- 172.21.15.90:0/4252582245 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fafb4078bc0 0x7fafb407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:54.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.408+0000 7fafd9600640 1 --2- 172.21.15.90:0/4252582245 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fafb4078bc0 0x7fafb407b0d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fafc8034000 tx=0x7fafc8004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:54.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.412+0000 7fafd1600640 1 -- 172.21.15.90:0/4252582245 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fafcc014030 con 0x7fafd414b7b0 2024-09-21T03:24:54.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.599+0000 7fafdc000640 1 -- 172.21.15.90:0/4252582245 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fafd40c6cb0 con 0x7fafb4078bc0 2024-09-21T03:24:54.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.600+0000 7fafd1600640 1 -- 172.21.15.90:0/4252582245 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fafd40c6cb0 con 0x7fafb4078bc0 2024-09-21T03:24:54.602 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 6 to deep-scrub 2024-09-21T03:24:54.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.602+0000 7fafdc000640 1 -- 172.21.15.90:0/4252582245 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fafb4078bc0 msgr2=0x7fafb407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.602+0000 7fafdc000640 1 --2- 172.21.15.90:0/4252582245 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fafb4078bc0 0x7fafb407b0d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fafc8034000 tx=0x7fafc8004730 comp rx=0 tx=0).stop 2024-09-21T03:24:54.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.602+0000 7fafdc000640 1 -- 172.21.15.90:0/4252582245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd414b7b0 msgr2=0x7fafd4148830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.602+0000 7fafdc000640 1 --2- 172.21.15.90:0/4252582245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd414b7b0 0x7fafd4148830 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00caa0 tx=0x7fafcc00cf60 comp rx=0 tx=0).stop 2024-09-21T03:24:54.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.602+0000 7fafdc000640 1 -- 172.21.15.90:0/4252582245 shutdown_connections 2024-09-21T03:24:54.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.602+0000 7fafdc000640 1 --2- 172.21.15.90:0/4252582245 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fafb4078bc0 0x7fafb407b0d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.602+0000 7fafdc000640 1 --2- 172.21.15.90:0/4252582245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd414b7b0 0x7fafd4148830 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.602+0000 7fafdc000640 1 --2- 172.21.15.90:0/4252582245 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fafd40abd30 0x7fafd41482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.602+0000 7fafdc000640 1 --2- 172.21.15.90:0/4252582245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafd40ab3d0 0x7fafd41e05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.602+0000 7fafdc000640 1 -- 172.21.15.90:0/4252582245 >> 172.21.15.90:0/4252582245 conn(0x7fafd40c85a0 msgr2=0x7fafd414adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:54.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.603+0000 7fafdc000640 1 -- 172.21.15.90:0/4252582245 shutdown_connections 2024-09-21T03:24:54.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.603+0000 7fafdc000640 1 -- 172.21.15.90:0/4252582245 wait complete. 2024-09-21T03:24:54.627 INFO:tasks.ceph:Scrubbing osd.7 2024-09-21T03:24:54.627 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-21T03:24:54.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.856+0000 7fc0ea200640 1 -- 172.21.15.90:0/492598696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0e4074d10 msgr2=0x7fc0e414d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.856+0000 7fc0ea200640 1 --2- 172.21.15.90:0/492598696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0e4074d10 0x7fc0e414d8b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc0e40c91d0 tx=0x7fc0d802a510 comp rx=0 tx=0).stop 2024-09-21T03:24:54.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.856+0000 7fc0ea200640 1 -- 172.21.15.90:0/492598696 shutdown_connections 2024-09-21T03:24:54.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.856+0000 7fc0ea200640 1 --2- 172.21.15.90:0/492598696 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0e4156f70 0x7fc0e4157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.856+0000 7fc0ea200640 1 --2- 172.21.15.90:0/492598696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0e4074d10 0x7fc0e414d8b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.856+0000 7fc0ea200640 1 -- 172.21.15.90:0/492598696 >> 172.21.15.90:0/492598696 conn(0x7fc0e406d1d0 msgr2=0x7fc0e406d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:54.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.856+0000 7fc0ea200640 1 -- 172.21.15.90:0/492598696 shutdown_connections 2024-09-21T03:24:54.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.856+0000 7fc0ea200640 1 -- 172.21.15.90:0/492598696 wait complete. 2024-09-21T03:24:54.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.858+0000 7fc0ea200640 1 Processor -- start 2024-09-21T03:24:54.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.858+0000 7fc0ea200640 1 -- start start 2024-09-21T03:24:54.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.860+0000 7fc0ea200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0e406e860 0x7fc0e4156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.860+0000 7fc0ea200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0e4074d10 0x7fc0e40c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.860+0000 7fc0ea200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0e4156f70 0x7fc0e40c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.860+0000 7fc0ea200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e40707f0 con 0x7fc0e4156f70 2024-09-21T03:24:54.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.860+0000 7fc0ea200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e4070670 con 0x7fc0e406e860 2024-09-21T03:24:54.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.860+0000 7fc0ea200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc0e41578c0 con 0x7fc0e4074d10 2024-09-21T03:24:54.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.860+0000 7fc0e9800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0e4156f70 0x7fc0e40c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:54.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.860+0000 7fc0e9800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0e4156f70 0x7fc0e40c79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55024/0 (socket says 172.21.15.90:55024) 2024-09-21T03:24:54.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.860+0000 7fc0e9800640 1 -- 172.21.15.90:0/150009024 learned_addr learned my addr 172.21.15.90:0/150009024 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:54.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.860+0000 7fc0e3e00640 1 --2- 172.21.15.90:0/150009024 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0e4074d10 0x7fc0e40c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:54.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.860+0000 7fc0e8e00640 1 --2- 172.21.15.90:0/150009024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0e406e860 0x7fc0e4156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:54.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.861+0000 7fc0e9800640 1 -- 172.21.15.90:0/150009024 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0e4074d10 msgr2=0x7fc0e40c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.861+0000 7fc0e9800640 1 --2- 172.21.15.90:0/150009024 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0e4074d10 0x7fc0e40c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.861+0000 7fc0e9800640 1 -- 172.21.15.90:0/150009024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0e406e860 msgr2=0x7fc0e4156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.861+0000 7fc0e9800640 1 --2- 172.21.15.90:0/150009024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0e406e860 0x7fc0e4156600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.861+0000 7fc0e9800640 1 -- 172.21.15.90:0/150009024 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e41ed360 con 0x7fc0e4156f70 2024-09-21T03:24:54.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.861+0000 7fc0e9800640 1 --2- 172.21.15.90:0/150009024 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0e4156f70 0x7fc0e40c79f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc00e960 tx=0x7fc0dc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:54.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.861+0000 7fc0e0c00640 1 -- 172.21.15.90:0/150009024 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc004d20 con 0x7fc0e4156f70 2024-09-21T03:24:54.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.861+0000 7fc0e0c00640 1 -- 172.21.15.90:0/150009024 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0dc00cb20 con 0x7fc0e4156f70 2024-09-21T03:24:54.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.861+0000 7fc0ea200640 1 -- 172.21.15.90:0/150009024 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e40adf50 con 0x7fc0e4156f70 2024-09-21T03:24:54.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.861+0000 7fc0e0c00640 1 -- 172.21.15.90:0/150009024 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc005020 con 0x7fc0e4156f70 2024-09-21T03:24:54.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.861+0000 7fc0ea200640 1 -- 172.21.15.90:0/150009024 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e41ed570 con 0x7fc0e4156f70 2024-09-21T03:24:54.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.862+0000 7fc0ea200640 1 -- 172.21.15.90:0/150009024 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc0e4069b50 con 0x7fc0e4156f70 2024-09-21T03:24:54.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.864+0000 7fc0e0c00640 1 -- 172.21.15.90:0/150009024 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc0dc0051c0 con 0x7fc0e4156f70 2024-09-21T03:24:54.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.864+0000 7fc0e0c00640 1 --2- 172.21.15.90:0/150009024 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc0c4078b90 0x7fc0c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.865+0000 7fc0e0c00640 1 -- 172.21.15.90:0/150009024 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fc0dc09ba90 con 0x7fc0e4156f70 2024-09-21T03:24:54.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.865+0000 7fc0e0c00640 1 --2- 172.21.15.90:0/150009024 >> [v2:172.21.15.149:6802/1657326880,v1:172.21.15.149:6803/1657326880] conn(0x7fc0c4083550 0x7fc0c4085a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.865+0000 7fc0e0c00640 1 -- 172.21.15.90:0/150009024 --> [v2:172.21.15.149:6802/1657326880,v1:172.21.15.149:6803/1657326880] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0dc009050 con 0x7fc0c4083550 2024-09-21T03:24:54.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.865+0000 7fc0e8e00640 1 --2- 172.21.15.90:0/150009024 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc0c4078b90 0x7fc0c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:54.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.865+0000 7fc0e0c00640 1 -- 172.21.15.90:0/150009024 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc0dc0a02a0 con 0x7fc0e4156f70 2024-09-21T03:24:54.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.865+0000 7fc0e3e00640 1 --2- 172.21.15.90:0/150009024 >> [v2:172.21.15.149:6802/1657326880,v1:172.21.15.149:6803/1657326880] conn(0x7fc0c4083550 0x7fc0c4085a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:54.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.866+0000 7fc0e8e00640 1 --2- 172.21.15.90:0/150009024 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc0c4078b90 0x7fc0c407b0a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8033000 tx=0x7fc0d8004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:54.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.866+0000 7fc0e3e00640 1 --2- 172.21.15.90:0/150009024 >> [v2:172.21.15.149:6802/1657326880,v1:172.21.15.149:6803/1657326880] conn(0x7fc0c4083550 0x7fc0c4085a40 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:54.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.867+0000 7fc0e0c00640 1 -- 172.21.15.90:0/150009024 <== osd.7 v2:172.21.15.149:6802/1657326880 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc0dc009050 con 0x7fc0c4083550 2024-09-21T03:24:54.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.880+0000 7fc0ea200640 1 -- 172.21.15.90:0/150009024 --> [v2:172.21.15.149:6802/1657326880,v1:172.21.15.149:6803/1657326880] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc0e41ed7d0 con 0x7fc0c4083550 2024-09-21T03:24:54.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.881+0000 7fc0e0c00640 1 -- 172.21.15.90:0/150009024 <== osd.7 v2:172.21.15.149:6802/1657326880 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc0e41ed7d0 con 0x7fc0c4083550 2024-09-21T03:24:54.883 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T03:24:54.883 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T03:24:54.883 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T03:24:54.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.881+0000 7fc0ea200640 1 -- 172.21.15.90:0/150009024 >> [v2:172.21.15.149:6802/1657326880,v1:172.21.15.149:6803/1657326880] conn(0x7fc0c4083550 msgr2=0x7fc0c4085a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.881+0000 7fc0ea200640 1 --2- 172.21.15.90:0/150009024 >> [v2:172.21.15.149:6802/1657326880,v1:172.21.15.149:6803/1657326880] conn(0x7fc0c4083550 0x7fc0c4085a40 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.881+0000 7fc0ea200640 1 -- 172.21.15.90:0/150009024 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc0c4078b90 msgr2=0x7fc0c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.881+0000 7fc0ea200640 1 --2- 172.21.15.90:0/150009024 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fc0c4078b90 0x7fc0c407b0a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8033000 tx=0x7fc0d8004730 comp rx=0 tx=0).stop 2024-09-21T03:24:54.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.881+0000 7fc0ea200640 1 -- 172.21.15.90:0/150009024 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0e4156f70 msgr2=0x7fc0e40c79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.881+0000 7fc0ea200640 1 --2- 172.21.15.90:0/150009024 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0e4156f70 0x7fc0e40c79f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc00e960 tx=0x7fc0dc00ee20 comp rx=0 tx=0).stop 2024-09-21T03:24:54.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.881+0000 7fc0e9800640 1 -- 172.21.15.90:0/150009024 reap_dead start 2024-09-21T03:24:54.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.881+0000 7fc0ea200640 1 -- 172.21.15.90:0/150009024 shutdown_connections 2024-09-21T03:24:54.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.881+0000 7fc0ea200640 1 -- 172.21.15.90:0/150009024 >> 172.21.15.90:0/150009024 conn(0x7fc0e406d1d0 msgr2=0x7fc0e406ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:54.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.882+0000 7fc0ea200640 1 -- 172.21.15.90:0/150009024 shutdown_connections 2024-09-21T03:24:54.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:54.882+0000 7fc0ea200640 1 -- 172.21.15.90:0/150009024 wait complete. 2024-09-21T03:24:54.905 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-21T03:24:55.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.126+0000 7f012b200640 1 -- 172.21.15.90:0/3965731869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01240c81b0 msgr2=0x7f01241541c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:55.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.126+0000 7f012b200640 1 --2- 172.21.15.90:0/3965731869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01240c81b0 0x7f01241541c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0114005fd0 tx=0x7f011402a540 comp rx=0 tx=0).stop 2024-09-21T03:24:55.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.126+0000 7f012b200640 1 -- 172.21.15.90:0/3965731869 shutdown_connections 2024-09-21T03:24:55.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.126+0000 7f012b200640 1 --2- 172.21.15.90:0/3965731869 >> v2:172.21.15.149:3300/0 conn(0x7f01240ca2c0 0x7f012406e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.126+0000 7f012b200640 1 --2- 172.21.15.90:0/3965731869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01240c81b0 0x7f01241541c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.126+0000 7f012b200640 1 -- 172.21.15.90:0/3965731869 >> 172.21.15.90:0/3965731869 conn(0x7f01240c8e40 msgr2=0x7f01240c9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:55.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.126+0000 7f012b200640 1 -- 172.21.15.90:0/3965731869 shutdown_connections 2024-09-21T03:24:55.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.126+0000 7f012b200640 1 -- 172.21.15.90:0/3965731869 wait complete. 2024-09-21T03:24:55.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.128+0000 7f012b200640 1 Processor -- start 2024-09-21T03:24:55.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.129+0000 7f012b200640 1 -- start start 2024-09-21T03:24:55.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.130+0000 7f012b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01240c7420 0x7f01241e1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:55.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.130+0000 7f012b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01240c81b0 0x7f01241e2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:55.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.130+0000 7f012b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01240ca2c0 0x7f01240ad240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:55.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.130+0000 7f012b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f012406e7d0 con 0x7f01240c7420 2024-09-21T03:24:55.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.130+0000 7f012b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0124157bd0 con 0x7f01240ca2c0 2024-09-21T03:24:55.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.130+0000 7f012b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f01240ca6d0 con 0x7f01240c81b0 2024-09-21T03:24:55.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.130+0000 7f0123e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01240c7420 0x7f01241e1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:55.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.130+0000 7f0123e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01240c7420 0x7f01241e1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55034/0 (socket says 172.21.15.90:55034) 2024-09-21T03:24:55.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.130+0000 7f0123e00640 1 -- 172.21.15.90:0/1224095168 learned_addr learned my addr 172.21.15.90:0/1224095168 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:55.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.130+0000 7f0123400640 1 --2- 172.21.15.90:0/1224095168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01240c81b0 0x7f01241e2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:55.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.130+0000 7f0123e00640 1 -- 172.21.15.90:0/1224095168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01240c81b0 msgr2=0x7f01241e2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:55.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.130+0000 7f0129200640 1 --2- 172.21.15.90:0/1224095168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01240ca2c0 0x7f01240ad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:55.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.131+0000 7f0123e00640 1 --2- 172.21.15.90:0/1224095168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01240c81b0 0x7f01241e2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.131+0000 7f0123e00640 1 -- 172.21.15.90:0/1224095168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01240ca2c0 msgr2=0x7f01240ad240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:55.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.131+0000 7f0123e00640 1 --2- 172.21.15.90:0/1224095168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01240ca2c0 0x7f01240ad240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.131+0000 7f0123e00640 1 -- 172.21.15.90:0/1224095168 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01241e2f50 con 0x7f01240c7420 2024-09-21T03:24:55.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.131+0000 7f0123400640 1 --2- 172.21.15.90:0/1224095168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01240c81b0 0x7f01241e2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:24:55.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.131+0000 7f0129200640 1 --2- 172.21.15.90:0/1224095168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01240ca2c0 0x7f01240ad240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:24:55.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.131+0000 7f0123e00640 1 --2- 172.21.15.90:0/1224095168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01240c7420 0x7f01241e1390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0114006010 tx=0x7f01140038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:55.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.131+0000 7f011be00640 1 -- 172.21.15.90:0/1224095168 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011403e030 con 0x7f01240c7420 2024-09-21T03:24:55.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.131+0000 7f011be00640 1 -- 172.21.15.90:0/1224095168 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0114003d90 con 0x7f01240c7420 2024-09-21T03:24:55.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.131+0000 7f012b200640 1 -- 172.21.15.90:0/1224095168 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01241e18d0 con 0x7f01240c7420 2024-09-21T03:24:55.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.131+0000 7f011be00640 1 -- 172.21.15.90:0/1224095168 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0114035040 con 0x7f01240c7420 2024-09-21T03:24:55.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.131+0000 7f012b200640 1 -- 172.21.15.90:0/1224095168 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f012414e4f0 con 0x7f01240c7420 2024-09-21T03:24:55.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.132+0000 7f012b200640 1 -- 172.21.15.90:0/1224095168 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01240c8990 con 0x7f01240c7420 2024-09-21T03:24:55.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.133+0000 7f011be00640 1 -- 172.21.15.90:0/1224095168 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0114041030 con 0x7f01240c7420 2024-09-21T03:24:55.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.134+0000 7f011be00640 1 --2- 172.21.15.90:0/1224095168 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0104078b90 0x7f010407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:55.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.135+0000 7f011be00640 1 -- 172.21.15.90:0/1224095168 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f01140bb870 con 0x7f01240c7420 2024-09-21T03:24:55.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.135+0000 7f0123400640 1 --2- 172.21.15.90:0/1224095168 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0104078b90 0x7f010407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:55.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.136+0000 7f0123400640 1 --2- 172.21.15.90:0/1224095168 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0104078b90 0x7f010407b0a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0124156d10 tx=0x7f0110005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:55.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.139+0000 7f011be00640 1 -- 172.21.15.90:0/1224095168 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0114083900 con 0x7f01240c7420 2024-09-21T03:24:55.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.327+0000 7f012b200640 1 -- 172.21.15.90:0/1224095168 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f01240ac200 con 0x7f0104078b90 2024-09-21T03:24:55.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.328+0000 7f011be00640 1 -- 172.21.15.90:0/1224095168 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0110010ab0 con 0x7f0104078b90 2024-09-21T03:24:55.330 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 7 to deep-scrub 2024-09-21T03:24:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.330+0000 7f012b200640 1 -- 172.21.15.90:0/1224095168 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0104078b90 msgr2=0x7f010407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.330+0000 7f012b200640 1 --2- 172.21.15.90:0/1224095168 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0104078b90 0x7f010407b0a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0124156d10 tx=0x7f0110005f90 comp rx=0 tx=0).stop 2024-09-21T03:24:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.330+0000 7f012b200640 1 -- 172.21.15.90:0/1224095168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01240c7420 msgr2=0x7f01241e1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.330+0000 7f012b200640 1 --2- 172.21.15.90:0/1224095168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01240c7420 0x7f01241e1390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0114006010 tx=0x7f01140038a0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.330+0000 7f012b200640 1 -- 172.21.15.90:0/1224095168 shutdown_connections 2024-09-21T03:24:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.330+0000 7f012b200640 1 --2- 172.21.15.90:0/1224095168 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f0104078b90 0x7f010407b0a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.330+0000 7f012b200640 1 --2- 172.21.15.90:0/1224095168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01240ca2c0 0x7f01240ad240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.330+0000 7f012b200640 1 --2- 172.21.15.90:0/1224095168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01240c81b0 0x7f01241e2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.330+0000 7f012b200640 1 --2- 172.21.15.90:0/1224095168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01240c7420 0x7f01241e1390 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.331+0000 7f012b200640 1 -- 172.21.15.90:0/1224095168 >> 172.21.15.90:0/1224095168 conn(0x7f01240c8e40 msgr2=0x7f01240c7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:55.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.331+0000 7f012b200640 1 -- 172.21.15.90:0/1224095168 shutdown_connections 2024-09-21T03:24:55.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.331+0000 7f012b200640 1 -- 172.21.15.90:0/1224095168 wait complete. 2024-09-21T03:24:55.355 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:24:55.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.578+0000 7f2505200640 1 -- 172.21.15.90:0/3392093988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25000c47b0 msgr2=0x7f25000ad2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:55.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.578+0000 7f2505200640 1 --2- 172.21.15.90:0/3392093988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25000c47b0 0x7f25000ad2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2500154b30 tx=0x7f24f002a440 comp rx=0 tx=0).stop 2024-09-21T03:24:55.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.578+0000 7f2505200640 1 -- 172.21.15.90:0/3392093988 shutdown_connections 2024-09-21T03:24:55.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.578+0000 7f2505200640 1 --2- 172.21.15.90:0/3392093988 >> v2:172.21.15.149:3300/0 conn(0x7f25000c3d40 0x7f25000c1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.578+0000 7f2505200640 1 --2- 172.21.15.90:0/3392093988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25000c47b0 0x7f25000ad2f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.578+0000 7f2505200640 1 -- 172.21.15.90:0/3392093988 >> 172.21.15.90:0/3392093988 conn(0x7f25000c8ba0 msgr2=0x7f250006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:55.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.579+0000 7f2505200640 1 -- 172.21.15.90:0/3392093988 shutdown_connections 2024-09-21T03:24:55.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.579+0000 7f2505200640 1 -- 172.21.15.90:0/3392093988 wait complete. 2024-09-21T03:24:55.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.581+0000 7f2505200640 1 Processor -- start 2024-09-21T03:24:55.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.581+0000 7f2505200640 1 -- start start 2024-09-21T03:24:55.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.583+0000 7f2505200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f25000c1a80 0x7f25000abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:55.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.583+0000 7f2505200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25000c3d40 0x7f25001ed170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:55.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.583+0000 7f2505200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25000c47b0 0x7f250014ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:55.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.583+0000 7f2505200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f25000c26e0 con 0x7f25000c3d40 2024-09-21T03:24:55.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.583+0000 7f2505200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f250006fcb0 con 0x7f25000c47b0 2024-09-21T03:24:55.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.583+0000 7f2505200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2500157850 con 0x7f25000c1a80 2024-09-21T03:24:55.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.583+0000 7f24fd400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25000c3d40 0x7f25001ed170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:55.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.583+0000 7f24fd400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25000c3d40 0x7f25001ed170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55052/0 (socket says 172.21.15.90:55052) 2024-09-21T03:24:55.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.583+0000 7f24fd400640 1 -- 172.21.15.90:0/1350531039 learned_addr learned my addr 172.21.15.90:0/1350531039 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:24:55.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.583+0000 7f24fde00640 1 --2- 172.21.15.90:0/1350531039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f25000c1a80 0x7f25000abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:55.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.583+0000 7f24fe800640 1 --2- 172.21.15.90:0/1350531039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25000c47b0 0x7f250014ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:55.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.584+0000 7f24fd400640 1 -- 172.21.15.90:0/1350531039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f25000c1a80 msgr2=0x7f25000abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:55.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.584+0000 7f24fd400640 1 --2- 172.21.15.90:0/1350531039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f25000c1a80 0x7f25000abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.584+0000 7f24fd400640 1 -- 172.21.15.90:0/1350531039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25000c47b0 msgr2=0x7f250014ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:55.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.584+0000 7f24fd400640 1 --2- 172.21.15.90:0/1350531039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25000c47b0 0x7f250014ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.584+0000 7f24fd400640 1 -- 172.21.15.90:0/1350531039 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2500074000 con 0x7f25000c3d40 2024-09-21T03:24:55.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.584+0000 7f24fd400640 1 --2- 172.21.15.90:0/1350531039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25000c3d40 0x7f25001ed170 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00d6d0 tx=0x7f24ec00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:55.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.584+0000 7f24f6000640 1 -- 172.21.15.90:0/1350531039 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec017070 con 0x7f25000c3d40 2024-09-21T03:24:55.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.584+0000 7f24f6000640 1 -- 172.21.15.90:0/1350531039 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24ec005310 con 0x7f25000c3d40 2024-09-21T03:24:55.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.584+0000 7f24f6000640 1 -- 172.21.15.90:0/1350531039 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec009820 con 0x7f25000c3d40 2024-09-21T03:24:55.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.584+0000 7f2505200640 1 -- 172.21.15.90:0/1350531039 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25001e1f60 con 0x7f25000c3d40 2024-09-21T03:24:55.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.585+0000 7f2505200640 1 -- 172.21.15.90:0/1350531039 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25000742c0 con 0x7f25000c3d40 2024-09-21T03:24:55.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.586+0000 7f2505200640 1 -- 172.21.15.90:0/1350531039 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25000c1540 con 0x7f25000c3d40 2024-09-21T03:24:55.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.587+0000 7f24f6000640 1 -- 172.21.15.90:0/1350531039 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f24ec0099c0 con 0x7f25000c3d40 2024-09-21T03:24:55.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.588+0000 7f24f6000640 1 --2- 172.21.15.90:0/1350531039 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f24e0078bc0 0x7f24e007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:55.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.589+0000 7f24f6000640 1 -- 172.21.15.90:0/1350531039 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f24ec09b000 con 0x7f25000c3d40 2024-09-21T03:24:55.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.589+0000 7f24fde00640 1 --2- 172.21.15.90:0/1350531039 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f24e0078bc0 0x7f24e007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:55.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.590+0000 7f24fde00640 1 --2- 172.21.15.90:0/1350531039 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f24e0078bc0 0x7f24e007b0d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f24f0033000 tx=0x7f24f0004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:55.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.593+0000 7f24f6000640 1 -- 172.21.15.90:0/1350531039 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f24ec062b50 con 0x7f25000c3d40 2024-09-21T03:24:55.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.782+0000 7f2505200640 1 -- 172.21.15.90:0/1350531039 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f25000c3b20 con 0x7f24e0078bc0 2024-09-21T03:24:55.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.791+0000 7f24f6000640 1 -- 172.21.15.90:0/1350531039 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+493820 (secure 0 0 0) 0x7f25000c3b20 con 0x7f24e0078bc0 2024-09-21T03:24:55.799 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:24:55.802 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-21T03:24:55.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.797+0000 7f2505200640 1 -- 172.21.15.90:0/1350531039 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f24e0078bc0 msgr2=0x7f24e007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:55.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.797+0000 7f2505200640 1 --2- 172.21.15.90:0/1350531039 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f24e0078bc0 0x7f24e007b0d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f24f0033000 tx=0x7f24f0004730 comp rx=0 tx=0).stop 2024-09-21T03:24:55.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.797+0000 7f2505200640 1 -- 172.21.15.90:0/1350531039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25000c3d40 msgr2=0x7f25001ed170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:55.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.797+0000 7f2505200640 1 --2- 172.21.15.90:0/1350531039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25000c3d40 0x7f25001ed170 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00d6d0 tx=0x7f24ec00db90 comp rx=0 tx=0).stop 2024-09-21T03:24:55.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.797+0000 7f2505200640 1 -- 172.21.15.90:0/1350531039 shutdown_connections 2024-09-21T03:24:55.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.797+0000 7f2505200640 1 --2- 172.21.15.90:0/1350531039 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f24e0078bc0 0x7f24e007b0d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.797+0000 7f2505200640 1 --2- 172.21.15.90:0/1350531039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25000c47b0 0x7f250014ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.798+0000 7f2505200640 1 --2- 172.21.15.90:0/1350531039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25000c3d40 0x7f25001ed170 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.798+0000 7f2505200640 1 --2- 172.21.15.90:0/1350531039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f25000c1a80 0x7f25000abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.798+0000 7f2505200640 1 -- 172.21.15.90:0/1350531039 >> 172.21.15.90:0/1350531039 conn(0x7f25000c8ba0 msgr2=0x7f25001e27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:55.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.798+0000 7f2505200640 1 -- 172.21.15.90:0/1350531039 shutdown_connections 2024-09-21T03:24:55.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:24:55.798+0000 7f2505200640 1 -- 172.21.15.90:0/1350531039 wait complete. 2024-09-21T03:24:55.828 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-09-21T03:24:54.751031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":263547592,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":126,"num_read_kb":267,"num_write":5735616,"num_write_kb":66239739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":396529,"ondisk_log_size":396529,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4223056,"kb_used_data":517072,"kb_used_omap":12,"kb_used_meta":3705843,"kb_avail":750751664,"statfs":{"total":773094113280,"available":768769703936,"internally_reserved":0,"allocated":529481728,"data_stored":528010696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":3794783792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,1,21],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":498,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003999"},"pg_stats":[{"pgid":"5.18","version":"27'2955","reported_seq":2976,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.324436+0000","last_change":"2024-09-21T03:14:47.552762+0000","last_active":"2024-09-21T03:24:45.324436+0000","last_peered":"2024-09-21T03:24:45.324436+0000","last_clean":"2024-09-21T03:24:45.324436+0000","last_became_active":"2024-09-21T03:14:47.551883+0000","last_became_peered":"2024-09-21T03:14:47.551883+0000","last_unstale":"2024-09-21T03:24:45.324436+0000","last_undegraded":"2024-09-21T03:24:45.324436+0000","last_fullsized":"2024-09-21T03:24:45.324436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2955,"log_dups_size":0,"ondisk_log_size":2955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:51.935797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42893,"num_write_kb":435375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"27'182","reported_seq":213,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.375091+0000","last_change":"2024-09-21T03:14:37.471004+0000","last_active":"2024-09-21T03:24:44.375091+0000","last_peered":"2024-09-21T03:24:44.375091+0000","last_clean":"2024-09-21T03:24:44.375091+0000","last_became_active":"2024-09-21T03:14:37.470563+0000","last_became_peered":"2024-09-21T03:14:37.470563+0000","last_unstale":"2024-09-21T03:24:44.375091+0000","last_undegraded":"2024-09-21T03:24:44.375091+0000","last_fullsized":"2024-09-21T03:24:44.375091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:20.422826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7184146,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":7088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'3329","reported_seq":3358,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.558550+0000","last_change":"2024-09-21T03:14:38.496252+0000","last_active":"2024-09-21T03:24:44.558550+0000","last_peered":"2024-09-21T03:24:44.558550+0000","last_clean":"2024-09-21T03:24:44.558550+0000","last_became_active":"2024-09-21T03:14:38.488292+0000","last_became_peered":"2024-09-21T03:14:38.488292+0000","last_unstale":"2024-09-21T03:24:44.558550+0000","last_undegraded":"2024-09-21T03:24:44.558550+0000","last_fullsized":"2024-09-21T03:24:44.558550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3329,"log_dups_size":0,"ondisk_log_size":3329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:57.409792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49408,"num_write_kb":622324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.561928+0000","last_change":"2024-09-21T03:14:46.549877+0000","last_active":"2024-09-21T03:24:32.561928+0000","last_peered":"2024-09-21T03:24:32.561928+0000","last_clean":"2024-09-21T03:24:32.561928+0000","last_became_active":"2024-09-21T03:14:46.549536+0000","last_became_peered":"2024-09-21T03:14:46.549536+0000","last_unstale":"2024-09-21T03:24:32.561928+0000","last_undegraded":"2024-09-21T03:24:32.561928+0000","last_fullsized":"2024-09-21T03:24:32.561928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:57.491042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"27'3463","reported_seq":3484,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.343341+0000","last_change":"2024-09-21T03:14:47.560303+0000","last_active":"2024-09-21T03:24:45.343341+0000","last_peered":"2024-09-21T03:24:45.343341+0000","last_clean":"2024-09-21T03:24:45.343341+0000","last_became_active":"2024-09-21T03:14:47.559659+0000","last_became_peered":"2024-09-21T03:14:47.559659+0000","last_unstale":"2024-09-21T03:24:45.343341+0000","last_undegraded":"2024-09-21T03:24:45.343341+0000","last_fullsized":"2024-09-21T03:24:45.343341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3463,"log_dups_size":0,"ondisk_log_size":3463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:49.328036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50427,"num_write_kb":517490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"27'10","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.175109+0000","last_change":"2024-09-21T03:14:37.467448+0000","last_active":"2024-09-21T03:24:32.175109+0000","last_peered":"2024-09-21T03:24:32.175109+0000","last_clean":"2024-09-21T03:24:32.175109+0000","last_became_active":"2024-09-21T03:14:37.467146+0000","last_became_peered":"2024-09-21T03:14:37.467146+0000","last_unstale":"2024-09-21T03:24:32.175109+0000","last_undegraded":"2024-09-21T03:24:32.175109+0000","last_fullsized":"2024-09-21T03:24:32.175109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:53.475083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'3692","reported_seq":3721,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.533568+0000","last_change":"2024-09-21T03:14:38.486401+0000","last_active":"2024-09-21T03:24:44.533568+0000","last_peered":"2024-09-21T03:24:44.533568+0000","last_clean":"2024-09-21T03:24:44.533568+0000","last_became_active":"2024-09-21T03:14:38.486090+0000","last_became_peered":"2024-09-21T03:14:38.486090+0000","last_unstale":"2024-09-21T03:24:44.533568+0000","last_undegraded":"2024-09-21T03:24:44.533568+0000","last_fullsized":"2024-09-21T03:24:44.533568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3692,"log_dups_size":0,"ondisk_log_size":3692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:44.085100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54471,"num_write_kb":691181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'47","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.589575+0000","last_change":"2024-09-21T03:14:46.541705+0000","last_active":"2024-09-21T03:24:32.589575+0000","last_peered":"2024-09-21T03:24:32.589575+0000","last_clean":"2024-09-21T03:24:32.589575+0000","last_became_active":"2024-09-21T03:14:46.541357+0000","last_became_peered":"2024-09-21T03:14:46.541357+0000","last_unstale":"2024-09-21T03:24:32.589575+0000","last_undegraded":"2024-09-21T03:24:32.589575+0000","last_fullsized":"2024-09-21T03:24:32.589575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:31.082059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":8225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"27'2623","reported_seq":2646,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.346234+0000","last_change":"2024-09-21T03:18:52.567667+0000","last_active":"2024-09-21T03:24:45.346234+0000","last_peered":"2024-09-21T03:24:45.346234+0000","last_clean":"2024-09-21T03:24:45.346234+0000","last_became_active":"2024-09-21T03:14:47.553312+0000","last_became_peered":"2024-09-21T03:14:47.553312+0000","last_unstale":"2024-09-21T03:24:45.346234+0000","last_undegraded":"2024-09-21T03:24:45.346234+0000","last_fullsized":"2024-09-21T03:24:45.346234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2623,"log_dups_size":0,"ondisk_log_size":2623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:07.314491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37737,"num_write_kb":383006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"27'42","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.212295+0000","last_change":"2024-09-21T03:14:37.478711+0000","last_active":"2024-09-21T03:24:32.212295+0000","last_peered":"2024-09-21T03:24:32.212295+0000","last_clean":"2024-09-21T03:24:32.212295+0000","last_became_active":"2024-09-21T03:14:37.477910+0000","last_became_peered":"2024-09-21T03:14:37.477910+0000","last_unstale":"2024-09-21T03:24:32.212295+0000","last_undegraded":"2024-09-21T03:24:32.212295+0000","last_fullsized":"2024-09-21T03:24:32.212295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:40.166966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2285","reported_seq":2314,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.467936+0000","last_change":"2024-09-21T03:14:38.472992+0000","last_active":"2024-09-21T03:24:44.467936+0000","last_peered":"2024-09-21T03:24:44.467936+0000","last_clean":"2024-09-21T03:24:44.467936+0000","last_became_active":"2024-09-21T03:14:38.472426+0000","last_became_peered":"2024-09-21T03:14:38.472426+0000","last_unstale":"2024-09-21T03:24:44.467936+0000","last_undegraded":"2024-09-21T03:24:44.467936+0000","last_fullsized":"2024-09-21T03:24:44.467936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2285,"log_dups_size":0,"ondisk_log_size":2285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:36.825612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33481,"num_write_kb":420875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1061","reported_seq":1084,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.557686+0000","last_change":"2024-09-21T03:14:46.526996+0000","last_active":"2024-09-21T03:24:32.557686+0000","last_peered":"2024-09-21T03:24:32.557686+0000","last_clean":"2024-09-21T03:24:32.557686+0000","last_became_active":"2024-09-21T03:14:46.525587+0000","last_became_peered":"2024-09-21T03:14:46.525587+0000","last_unstale":"2024-09-21T03:24:32.557686+0000","last_undegraded":"2024-09-21T03:24:32.557686+0000","last_fullsized":"2024-09-21T03:24:32.557686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1061,"log_dups_size":0,"ondisk_log_size":1061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1059,"num_write_kb":5042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"27'2269","reported_seq":2290,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.309977+0000","last_change":"2024-09-21T03:14:47.554143+0000","last_active":"2024-09-21T03:24:45.309977+0000","last_peered":"2024-09-21T03:24:45.309977+0000","last_clean":"2024-09-21T03:24:45.309977+0000","last_became_active":"2024-09-21T03:14:47.553802+0000","last_became_peered":"2024-09-21T03:14:47.553802+0000","last_unstale":"2024-09-21T03:24:45.309977+0000","last_undegraded":"2024-09-21T03:24:45.309977+0000","last_fullsized":"2024-09-21T03:24:45.309977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2269,"log_dups_size":0,"ondisk_log_size":2269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32861,"num_write_kb":341635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'13","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.222962+0000","last_change":"2024-09-21T03:14:37.479842+0000","last_active":"2024-09-21T03:24:32.222962+0000","last_peered":"2024-09-21T03:24:32.222962+0000","last_clean":"2024-09-21T03:24:32.222962+0000","last_became_active":"2024-09-21T03:14:37.478893+0000","last_became_peered":"2024-09-21T03:14:37.478893+0000","last_unstale":"2024-09-21T03:24:32.222962+0000","last_undegraded":"2024-09-21T03:24:32.222962+0000","last_fullsized":"2024-09-21T03:24:32.222962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:27.916133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'3862","reported_seq":3891,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.571927+0000","last_change":"2024-09-21T03:14:38.468756+0000","last_active":"2024-09-21T03:24:44.571927+0000","last_peered":"2024-09-21T03:24:44.571927+0000","last_clean":"2024-09-21T03:24:44.571927+0000","last_became_active":"2024-09-21T03:14:38.467570+0000","last_became_peered":"2024-09-21T03:14:38.467570+0000","last_unstale":"2024-09-21T03:24:44.571927+0000","last_undegraded":"2024-09-21T03:24:44.571927+0000","last_fullsized":"2024-09-21T03:24:44.571927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3862,"log_dups_size":0,"ondisk_log_size":3862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:24.784157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57219,"num_write_kb":702431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'50","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.617288+0000","last_change":"2024-09-21T03:14:46.529932+0000","last_active":"2024-09-21T03:24:32.617288+0000","last_peered":"2024-09-21T03:24:32.617288+0000","last_clean":"2024-09-21T03:24:32.617288+0000","last_became_active":"2024-09-21T03:14:46.529629+0000","last_became_peered":"2024-09-21T03:14:46.529629+0000","last_unstale":"2024-09-21T03:24:32.617288+0000","last_undegraded":"2024-09-21T03:24:32.617288+0000","last_fullsized":"2024-09-21T03:24:32.617288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:39.808494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":8220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"27'3149","reported_seq":3170,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.310173+0000","last_change":"2024-09-21T03:14:47.547724+0000","last_active":"2024-09-21T03:24:45.310173+0000","last_peered":"2024-09-21T03:24:45.310173+0000","last_clean":"2024-09-21T03:24:45.310173+0000","last_became_active":"2024-09-21T03:14:47.546770+0000","last_became_peered":"2024-09-21T03:14:47.546770+0000","last_unstale":"2024-09-21T03:24:45.310173+0000","last_undegraded":"2024-09-21T03:24:45.310173+0000","last_fullsized":"2024-09-21T03:24:45.310173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3149,"log_dups_size":0,"ondisk_log_size":3149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:31.476710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45697,"num_write_kb":467369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"27'2916","reported_seq":2945,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.524858+0000","last_change":"2024-09-21T03:14:38.476747+0000","last_active":"2024-09-21T03:24:44.524858+0000","last_peered":"2024-09-21T03:24:44.524858+0000","last_clean":"2024-09-21T03:24:44.524858+0000","last_became_active":"2024-09-21T03:14:38.476386+0000","last_became_peered":"2024-09-21T03:14:38.476386+0000","last_unstale":"2024-09-21T03:24:44.524858+0000","last_undegraded":"2024-09-21T03:24:44.524858+0000","last_fullsized":"2024-09-21T03:24:44.524858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:28.751991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43116,"num_write_kb":539220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'226","reported_seq":257,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.178813+0000","last_change":"2024-09-21T03:14:37.463164+0000","last_active":"2024-09-21T03:24:32.178813+0000","last_peered":"2024-09-21T03:24:32.178813+0000","last_clean":"2024-09-21T03:24:32.178813+0000","last_became_active":"2024-09-21T03:14:37.461409+0000","last_became_peered":"2024-09-21T03:14:37.461409+0000","last_unstale":"2024-09-21T03:24:32.178813+0000","last_undegraded":"2024-09-21T03:24:32.178813+0000","last_fullsized":"2024-09-21T03:24:32.178813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:51.126291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":8373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'25","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:23:51.616959+0000","last_change":"2024-09-21T03:14:46.538480+0000","last_active":"2024-09-21T03:23:51.616959+0000","last_peered":"2024-09-21T03:23:51.616959+0000","last_clean":"2024-09-21T03:23:51.616959+0000","last_became_active":"2024-09-21T03:14:46.537493+0000","last_became_peered":"2024-09-21T03:14:46.537493+0000","last_unstale":"2024-09-21T03:23:51.616959+0000","last_undegraded":"2024-09-21T03:23:51.616959+0000","last_fullsized":"2024-09-21T03:23:51.616959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:52.769190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"27'3066","reported_seq":3087,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.316144+0000","last_change":"2024-09-21T03:14:47.580512+0000","last_active":"2024-09-21T03:24:45.316144+0000","last_peered":"2024-09-21T03:24:45.316144+0000","last_clean":"2024-09-21T03:24:45.316144+0000","last_became_active":"2024-09-21T03:14:47.580210+0000","last_became_peered":"2024-09-21T03:14:47.580210+0000","last_unstale":"2024-09-21T03:24:45.316144+0000","last_undegraded":"2024-09-21T03:24:45.316144+0000","last_fullsized":"2024-09-21T03:24:45.316144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3066,"log_dups_size":0,"ondisk_log_size":3066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:20.192190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44544,"num_write_kb":453960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"27'2513","reported_seq":2542,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.487168+0000","last_change":"2024-09-21T03:14:38.494021+0000","last_active":"2024-09-21T03:24:44.487168+0000","last_peered":"2024-09-21T03:24:44.487168+0000","last_clean":"2024-09-21T03:24:44.487168+0000","last_became_active":"2024-09-21T03:14:38.486802+0000","last_became_peered":"2024-09-21T03:14:38.486802+0000","last_unstale":"2024-09-21T03:24:44.487168+0000","last_undegraded":"2024-09-21T03:24:44.487168+0000","last_fullsized":"2024-09-21T03:24:44.487168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2513,"log_dups_size":0,"ondisk_log_size":2513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:31.817505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37114,"num_write_kb":476028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'16","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.188248+0000","last_change":"2024-09-21T03:14:37.465907+0000","last_active":"2024-09-21T03:24:32.188248+0000","last_peered":"2024-09-21T03:24:32.188248+0000","last_clean":"2024-09-21T03:24:32.188248+0000","last_became_active":"2024-09-21T03:14:37.465551+0000","last_became_peered":"2024-09-21T03:14:37.465551+0000","last_unstale":"2024-09-21T03:24:32.188248+0000","last_undegraded":"2024-09-21T03:24:32.188248+0000","last_fullsized":"2024-09-21T03:24:32.188248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:10.599687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:23:48.015021+0000","last_change":"2024-09-21T03:14:46.546737+0000","last_active":"2024-09-21T03:23:48.015021+0000","last_peered":"2024-09-21T03:23:48.015021+0000","last_clean":"2024-09-21T03:23:48.015021+0000","last_became_active":"2024-09-21T03:14:46.546312+0000","last_became_peered":"2024-09-21T03:14:46.546312+0000","last_unstale":"2024-09-21T03:23:48.015021+0000","last_undegraded":"2024-09-21T03:23:48.015021+0000","last_fullsized":"2024-09-21T03:23:48.015021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:03.939168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"27'2659","reported_seq":2680,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.357667+0000","last_change":"2024-09-21T03:14:47.558742+0000","last_active":"2024-09-21T03:24:45.357667+0000","last_peered":"2024-09-21T03:24:45.357667+0000","last_clean":"2024-09-21T03:24:45.357667+0000","last_became_active":"2024-09-21T03:14:47.558431+0000","last_became_peered":"2024-09-21T03:14:47.558431+0000","last_unstale":"2024-09-21T03:24:45.357667+0000","last_undegraded":"2024-09-21T03:24:45.357667+0000","last_fullsized":"2024-09-21T03:24:45.357667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2659,"log_dups_size":0,"ondisk_log_size":2659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:32.053674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38628,"num_write_kb":413288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"27'3227","reported_seq":3256,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.488971+0000","last_change":"2024-09-21T03:14:38.479370+0000","last_active":"2024-09-21T03:24:44.488971+0000","last_peered":"2024-09-21T03:24:44.488971+0000","last_clean":"2024-09-21T03:24:44.488971+0000","last_became_active":"2024-09-21T03:14:38.476976+0000","last_became_peered":"2024-09-21T03:14:38.476976+0000","last_unstale":"2024-09-21T03:24:44.488971+0000","last_undegraded":"2024-09-21T03:24:44.488971+0000","last_fullsized":"2024-09-21T03:24:44.488971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3227,"log_dups_size":0,"ondisk_log_size":3227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:14.695819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47858,"num_write_kb":595125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'15","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.163168+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:24:32.163168+0000","last_peered":"2024-09-21T03:24:32.163168+0000","last_clean":"2024-09-21T03:24:32.163168+0000","last_became_active":"2024-09-21T03:14:37.478840+0000","last_became_peered":"2024-09-21T03:14:37.478840+0000","last_unstale":"2024-09-21T03:24:32.163168+0000","last_undegraded":"2024-09-21T03:24:32.163168+0000","last_fullsized":"2024-09-21T03:24:32.163168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:00.964354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'24","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.596135+0000","last_change":"2024-09-21T03:14:46.543085+0000","last_active":"2024-09-21T03:24:32.596135+0000","last_peered":"2024-09-21T03:24:32.596135+0000","last_clean":"2024-09-21T03:24:32.596135+0000","last_became_active":"2024-09-21T03:14:46.542721+0000","last_became_peered":"2024-09-21T03:14:46.542721+0000","last_unstale":"2024-09-21T03:24:32.596135+0000","last_undegraded":"2024-09-21T03:24:32.596135+0000","last_fullsized":"2024-09-21T03:24:32.596135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:05.590871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"27'3357","reported_seq":3378,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.327911+0000","last_change":"2024-09-21T03:14:47.566806+0000","last_active":"2024-09-21T03:24:45.327911+0000","last_peered":"2024-09-21T03:24:45.327911+0000","last_clean":"2024-09-21T03:24:45.327911+0000","last_became_active":"2024-09-21T03:14:47.566634+0000","last_became_peered":"2024-09-21T03:14:47.566634+0000","last_unstale":"2024-09-21T03:24:45.327911+0000","last_undegraded":"2024-09-21T03:24:45.327911+0000","last_fullsized":"2024-09-21T03:24:45.327911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3357,"log_dups_size":0,"ondisk_log_size":3357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:03.997294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48633,"num_write_kb":505858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'2924","reported_seq":2953,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.462475+0000","last_change":"2024-09-21T03:14:38.482658+0000","last_active":"2024-09-21T03:24:44.462475+0000","last_peered":"2024-09-21T03:24:44.462475+0000","last_clean":"2024-09-21T03:24:44.462475+0000","last_became_active":"2024-09-21T03:14:38.482369+0000","last_became_peered":"2024-09-21T03:14:38.482369+0000","last_unstale":"2024-09-21T03:24:44.462475+0000","last_undegraded":"2024-09-21T03:24:44.462475+0000","last_fullsized":"2024-09-21T03:24:44.462475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2924,"log_dups_size":0,"ondisk_log_size":2924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:36.682534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43307,"num_write_kb":537343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'15","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.146260+0000","last_change":"2024-09-21T03:14:37.472962+0000","last_active":"2024-09-21T03:24:32.146260+0000","last_peered":"2024-09-21T03:24:32.146260+0000","last_clean":"2024-09-21T03:24:32.146260+0000","last_became_active":"2024-09-21T03:14:37.472271+0000","last_became_peered":"2024-09-21T03:14:37.472271+0000","last_unstale":"2024-09-21T03:24:32.146260+0000","last_undegraded":"2024-09-21T03:24:32.146260+0000","last_fullsized":"2024-09-21T03:24:32.146260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:54.952223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'30","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.602142+0000","last_change":"2024-09-21T03:14:46.537137+0000","last_active":"2024-09-21T03:24:32.602142+0000","last_peered":"2024-09-21T03:24:32.602142+0000","last_clean":"2024-09-21T03:24:32.602142+0000","last_became_active":"2024-09-21T03:14:46.536791+0000","last_became_peered":"2024-09-21T03:14:46.536791+0000","last_unstale":"2024-09-21T03:24:32.602142+0000","last_undegraded":"2024-09-21T03:24:32.602142+0000","last_fullsized":"2024-09-21T03:24:32.602142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:43.186807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"27'2826","reported_seq":2847,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.304208+0000","last_change":"2024-09-21T03:14:47.555605+0000","last_active":"2024-09-21T03:24:45.304208+0000","last_peered":"2024-09-21T03:24:45.304208+0000","last_clean":"2024-09-21T03:24:45.304208+0000","last_became_active":"2024-09-21T03:14:47.555329+0000","last_became_peered":"2024-09-21T03:14:47.555329+0000","last_unstale":"2024-09-21T03:24:45.304208+0000","last_undegraded":"2024-09-21T03:24:45.304208+0000","last_fullsized":"2024-09-21T03:24:45.304208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2826,"log_dups_size":0,"ondisk_log_size":2826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:24.271656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40983,"num_write_kb":424268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'2675","reported_seq":2704,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.467679+0000","last_change":"2024-09-21T03:14:38.479133+0000","last_active":"2024-09-21T03:24:44.467679+0000","last_peered":"2024-09-21T03:24:44.467679+0000","last_clean":"2024-09-21T03:24:44.467679+0000","last_became_active":"2024-09-21T03:14:38.478077+0000","last_became_peered":"2024-09-21T03:14:38.478077+0000","last_unstale":"2024-09-21T03:24:44.467679+0000","last_undegraded":"2024-09-21T03:24:44.467679+0000","last_fullsized":"2024-09-21T03:24:44.467679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2675,"log_dups_size":0,"ondisk_log_size":2675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:56.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39231,"num_write_kb":490681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'10","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.193121+0000","last_change":"2024-09-21T03:14:37.480508+0000","last_active":"2024-09-21T03:24:32.193121+0000","last_peered":"2024-09-21T03:24:32.193121+0000","last_clean":"2024-09-21T03:24:32.193121+0000","last_became_active":"2024-09-21T03:14:37.480218+0000","last_became_peered":"2024-09-21T03:14:37.480218+0000","last_unstale":"2024-09-21T03:24:32.193121+0000","last_undegraded":"2024-09-21T03:24:32.193121+0000","last_fullsized":"2024-09-21T03:24:32.193121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:01.851380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'33","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:34.548248+0000","last_change":"2024-09-21T03:14:46.531615+0000","last_active":"2024-09-21T03:24:34.548248+0000","last_peered":"2024-09-21T03:24:34.548248+0000","last_clean":"2024-09-21T03:24:34.548248+0000","last_became_active":"2024-09-21T03:14:46.531289+0000","last_became_peered":"2024-09-21T03:14:46.531289+0000","last_unstale":"2024-09-21T03:24:34.548248+0000","last_undegraded":"2024-09-21T03:24:34.548248+0000","last_fullsized":"2024-09-21T03:24:34.548248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:10.145489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":107,"num_write":31,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"27'2919","reported_seq":2940,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.327633+0000","last_change":"2024-09-21T03:14:47.552705+0000","last_active":"2024-09-21T03:24:45.327633+0000","last_peered":"2024-09-21T03:24:45.327633+0000","last_clean":"2024-09-21T03:24:45.327633+0000","last_became_active":"2024-09-21T03:14:47.552367+0000","last_became_peered":"2024-09-21T03:14:47.552367+0000","last_unstale":"2024-09-21T03:24:45.327633+0000","last_undegraded":"2024-09-21T03:24:45.327633+0000","last_fullsized":"2024-09-21T03:24:45.327633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2919,"log_dups_size":0,"ondisk_log_size":2919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:45.379581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42429,"num_write_kb":431357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'3268","reported_seq":3297,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.453408+0000","last_change":"2024-09-21T03:14:38.475318+0000","last_active":"2024-09-21T03:24:44.453408+0000","last_peered":"2024-09-21T03:24:44.453408+0000","last_clean":"2024-09-21T03:24:44.453408+0000","last_became_active":"2024-09-21T03:14:38.474978+0000","last_became_peered":"2024-09-21T03:14:38.474978+0000","last_unstale":"2024-09-21T03:24:44.453408+0000","last_undegraded":"2024-09-21T03:24:44.453408+0000","last_fullsized":"2024-09-21T03:24:44.453408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3268,"log_dups_size":0,"ondisk_log_size":3268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:38.209624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48313,"num_write_kb":579677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'320","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.201019+0000","last_change":"2024-09-21T03:14:37.479651+0000","last_active":"2024-09-21T03:24:32.201019+0000","last_peered":"2024-09-21T03:24:32.201019+0000","last_clean":"2024-09-21T03:24:32.201019+0000","last_became_active":"2024-09-21T03:14:37.478833+0000","last_became_peered":"2024-09-21T03:14:37.478833+0000","last_unstale":"2024-09-21T03:24:32.201019+0000","last_undegraded":"2024-09-21T03:24:32.201019+0000","last_fullsized":"2024-09-21T03:24:32.201019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:48.578637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'48","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.615611+0000","last_change":"2024-09-21T03:14:46.536054+0000","last_active":"2024-09-21T03:24:32.615611+0000","last_peered":"2024-09-21T03:24:32.615611+0000","last_clean":"2024-09-21T03:24:32.615611+0000","last_became_active":"2024-09-21T03:14:46.535569+0000","last_became_peered":"2024-09-21T03:14:46.535569+0000","last_unstale":"2024-09-21T03:24:32.615611+0000","last_undegraded":"2024-09-21T03:24:32.615611+0000","last_fullsized":"2024-09-21T03:24:32.615611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:04.556059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":8210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"27'3110","reported_seq":3131,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.325621+0000","last_change":"2024-09-21T03:14:47.571889+0000","last_active":"2024-09-21T03:24:45.325621+0000","last_peered":"2024-09-21T03:24:45.325621+0000","last_clean":"2024-09-21T03:24:45.325621+0000","last_became_active":"2024-09-21T03:14:47.571620+0000","last_became_peered":"2024-09-21T03:14:47.571620+0000","last_unstale":"2024-09-21T03:24:45.325621+0000","last_undegraded":"2024-09-21T03:24:45.325621+0000","last_fullsized":"2024-09-21T03:24:45.325621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3110,"log_dups_size":0,"ondisk_log_size":3110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:23.103973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45309,"num_write_kb":459474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"27'3313","reported_seq":3342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.510750+0000","last_change":"2024-09-21T03:14:38.493350+0000","last_active":"2024-09-21T03:24:44.510750+0000","last_peered":"2024-09-21T03:24:44.510750+0000","last_clean":"2024-09-21T03:24:44.510750+0000","last_became_active":"2024-09-21T03:14:38.492830+0000","last_became_peered":"2024-09-21T03:14:38.492830+0000","last_unstale":"2024-09-21T03:24:44.510750+0000","last_undegraded":"2024-09-21T03:24:44.510750+0000","last_fullsized":"2024-09-21T03:24:44.510750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3313,"log_dups_size":0,"ondisk_log_size":3313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:19.946319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48841,"num_write_kb":610665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'18","reported_seq":53,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-21T03:24:53.806945+0000","last_change":"2024-09-21T03:24:53.806650+0000","last_active":"2024-09-21T03:24:53.806945+0000","last_peered":"2024-09-21T03:24:53.806945+0000","last_clean":"2024-09-21T03:24:53.806945+0000","last_became_active":"2024-09-21T03:14:37.473218+0000","last_became_peered":"2024-09-21T03:14:37.473218+0000","last_unstale":"2024-09-21T03:24:53.806945+0000","last_undegraded":"2024-09-21T03:24:53.806945+0000","last_fullsized":"2024-09-21T03:24:53.806945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:21:06.027900+0000","last_change":"2024-09-21T03:14:46.548858+0000","last_active":"2024-09-21T03:21:06.027900+0000","last_peered":"2024-09-21T03:21:06.027900+0000","last_clean":"2024-09-21T03:21:06.027900+0000","last_became_active":"2024-09-21T03:14:46.548166+0000","last_became_peered":"2024-09-21T03:14:46.548166+0000","last_unstale":"2024-09-21T03:21:06.027900+0000","last_undegraded":"2024-09-21T03:21:06.027900+0000","last_fullsized":"2024-09-21T03:21:06.027900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:41.470072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"27'2797","reported_seq":2818,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.344863+0000","last_change":"2024-09-21T03:14:47.555787+0000","last_active":"2024-09-21T03:24:45.344863+0000","last_peered":"2024-09-21T03:24:45.344863+0000","last_clean":"2024-09-21T03:24:45.344863+0000","last_became_active":"2024-09-21T03:14:47.555420+0000","last_became_peered":"2024-09-21T03:14:47.555420+0000","last_unstale":"2024-09-21T03:24:45.344863+0000","last_undegraded":"2024-09-21T03:24:45.344863+0000","last_fullsized":"2024-09-21T03:24:45.344863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2797,"log_dups_size":0,"ondisk_log_size":2797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:45.769786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40658,"num_write_kb":422641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"27'2814","reported_seq":2843,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.461833+0000","last_change":"2024-09-21T03:14:38.479657+0000","last_active":"2024-09-21T03:24:44.461833+0000","last_peered":"2024-09-21T03:24:44.461833+0000","last_clean":"2024-09-21T03:24:44.461833+0000","last_became_active":"2024-09-21T03:14:38.479439+0000","last_became_peered":"2024-09-21T03:14:38.479439+0000","last_unstale":"2024-09-21T03:24:44.461833+0000","last_undegraded":"2024-09-21T03:24:44.461833+0000","last_fullsized":"2024-09-21T03:24:44.461833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2814,"log_dups_size":0,"ondisk_log_size":2814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.107215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41573,"num_write_kb":525350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.151982+0000","last_change":"2024-09-21T03:14:37.469799+0000","last_active":"2024-09-21T03:24:32.151982+0000","last_peered":"2024-09-21T03:24:32.151982+0000","last_clean":"2024-09-21T03:24:32.151982+0000","last_became_active":"2024-09-21T03:14:37.469495+0000","last_became_peered":"2024-09-21T03:14:37.469495+0000","last_unstale":"2024-09-21T03:24:32.151982+0000","last_undegraded":"2024-09-21T03:24:32.151982+0000","last_fullsized":"2024-09-21T03:24:32.151982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:50.247050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'51","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.593953+0000","last_change":"2024-09-21T03:14:46.544320+0000","last_active":"2024-09-21T03:24:32.593953+0000","last_peered":"2024-09-21T03:24:32.593953+0000","last_clean":"2024-09-21T03:24:32.593953+0000","last_became_active":"2024-09-21T03:14:46.544038+0000","last_became_peered":"2024-09-21T03:14:46.544038+0000","last_unstale":"2024-09-21T03:24:32.593953+0000","last_undegraded":"2024-09-21T03:24:32.593953+0000","last_fullsized":"2024-09-21T03:24:32.593953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:57.457687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"27'2673","reported_seq":2700,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.355013+0000","last_change":"2024-09-21T03:19:03.606923+0000","last_active":"2024-09-21T03:24:45.355013+0000","last_peered":"2024-09-21T03:24:45.355013+0000","last_clean":"2024-09-21T03:24:45.355013+0000","last_became_active":"2024-09-21T03:14:47.579324+0000","last_became_peered":"2024-09-21T03:14:47.579324+0000","last_unstale":"2024-09-21T03:24:45.355013+0000","last_undegraded":"2024-09-21T03:24:45.355013+0000","last_fullsized":"2024-09-21T03:24:45.355013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2673,"log_dups_size":0,"ondisk_log_size":2673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:37.656859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38848,"num_write_kb":393078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"27'3056","reported_seq":3085,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.555377+0000","last_change":"2024-09-21T03:14:38.476763+0000","last_active":"2024-09-21T03:24:44.555377+0000","last_peered":"2024-09-21T03:24:44.555377+0000","last_clean":"2024-09-21T03:24:44.555377+0000","last_became_active":"2024-09-21T03:14:38.474299+0000","last_became_peered":"2024-09-21T03:14:38.474299+0000","last_unstale":"2024-09-21T03:24:44.555377+0000","last_undegraded":"2024-09-21T03:24:44.555377+0000","last_fullsized":"2024-09-21T03:24:44.555377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3056,"log_dups_size":0,"ondisk_log_size":3056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:46.544930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45199,"num_write_kb":565597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'30","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:52.822304+0000","last_change":"2024-09-21T03:24:52.822304+0000","last_active":"2024-09-21T03:24:52.822304+0000","last_peered":"2024-09-21T03:24:52.822304+0000","last_clean":"2024-09-21T03:24:52.822304+0000","last_became_active":"2024-09-21T03:14:37.466256+0000","last_became_peered":"2024-09-21T03:14:37.466256+0000","last_unstale":"2024-09-21T03:24:52.822304+0000","last_undegraded":"2024-09-21T03:24:52.822304+0000","last_fullsized":"2024-09-21T03:24:52.822304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-09-21T03:24:52.822233+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-09-21T03:24:52.822233+0000","last_clean_scrub_stamp":"2024-09-21T03:24:52.822233+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:03.022192+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'5","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.569629+0000","last_change":"2024-09-21T03:14:46.537315+0000","last_active":"2024-09-21T03:24:32.569629+0000","last_peered":"2024-09-21T03:24:32.569629+0000","last_clean":"2024-09-21T03:24:32.569629+0000","last_became_active":"2024-09-21T03:14:46.536975+0000","last_became_peered":"2024-09-21T03:14:46.536975+0000","last_unstale":"2024-09-21T03:24:32.569629+0000","last_undegraded":"2024-09-21T03:24:32.569629+0000","last_fullsized":"2024-09-21T03:24:32.569629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:42.529591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"27'2498","reported_seq":2519,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.299634+0000","last_change":"2024-09-21T03:14:47.573009+0000","last_active":"2024-09-21T03:24:45.299634+0000","last_peered":"2024-09-21T03:24:45.299634+0000","last_clean":"2024-09-21T03:24:45.299634+0000","last_became_active":"2024-09-21T03:14:47.572395+0000","last_became_peered":"2024-09-21T03:14:47.572395+0000","last_unstale":"2024-09-21T03:24:45.299634+0000","last_undegraded":"2024-09-21T03:24:45.299634+0000","last_fullsized":"2024-09-21T03:24:45.299634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2498,"log_dups_size":0,"ondisk_log_size":2498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:41.733447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35860,"num_write_kb":370109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"27'2994","reported_seq":3023,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.517136+0000","last_change":"2024-09-21T03:14:38.481801+0000","last_active":"2024-09-21T03:24:44.517136+0000","last_peered":"2024-09-21T03:24:44.517136+0000","last_clean":"2024-09-21T03:24:44.517136+0000","last_became_active":"2024-09-21T03:14:38.481186+0000","last_became_peered":"2024-09-21T03:14:38.481186+0000","last_unstale":"2024-09-21T03:24:44.517136+0000","last_undegraded":"2024-09-21T03:24:44.517136+0000","last_fullsized":"2024-09-21T03:24:44.517136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2994,"log_dups_size":0,"ondisk_log_size":2994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:54.271470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44221,"num_write_kb":552392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'31","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:31.011851+0000","last_change":"2024-09-21T03:14:37.474798+0000","last_active":"2024-09-21T03:24:31.011851+0000","last_peered":"2024-09-21T03:24:31.011851+0000","last_clean":"2024-09-21T03:24:31.011851+0000","last_became_active":"2024-09-21T03:14:37.473829+0000","last_became_peered":"2024-09-21T03:14:37.473829+0000","last_unstale":"2024-09-21T03:24:31.011851+0000","last_undegraded":"2024-09-21T03:24:31.011851+0000","last_fullsized":"2024-09-21T03:24:31.011851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:11.571814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":105,"num_write":29,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'5","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.581221+0000","last_change":"2024-09-21T03:14:46.542495+0000","last_active":"2024-09-21T03:24:32.581221+0000","last_peered":"2024-09-21T03:24:32.581221+0000","last_clean":"2024-09-21T03:24:32.581221+0000","last_became_active":"2024-09-21T03:14:46.542181+0000","last_became_peered":"2024-09-21T03:14:46.542181+0000","last_unstale":"2024-09-21T03:24:32.581221+0000","last_undegraded":"2024-09-21T03:24:32.581221+0000","last_fullsized":"2024-09-21T03:24:32.581221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:22.481477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"27'2895","reported_seq":2916,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.325179+0000","last_change":"2024-09-21T03:14:47.569409+0000","last_active":"2024-09-21T03:24:45.325179+0000","last_peered":"2024-09-21T03:24:45.325179+0000","last_clean":"2024-09-21T03:24:45.325179+0000","last_became_active":"2024-09-21T03:14:47.569212+0000","last_became_peered":"2024-09-21T03:14:47.569212+0000","last_unstale":"2024-09-21T03:24:45.325179+0000","last_undegraded":"2024-09-21T03:24:45.325179+0000","last_fullsized":"2024-09-21T03:24:45.325179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2895,"log_dups_size":0,"ondisk_log_size":2895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.851943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42005,"num_write_kb":435585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"27'3096","reported_seq":3125,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.490675+0000","last_change":"2024-09-21T03:14:38.480026+0000","last_active":"2024-09-21T03:24:44.490675+0000","last_peered":"2024-09-21T03:24:44.490675+0000","last_clean":"2024-09-21T03:24:44.490675+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:24:44.490675+0000","last_undegraded":"2024-09-21T03:24:44.490675+0000","last_fullsized":"2024-09-21T03:24:44.490675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3096,"log_dups_size":0,"ondisk_log_size":3096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:20.481816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45754,"num_write_kb":580793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'48","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.253167+0000","last_change":"2024-09-21T03:14:37.464554+0000","last_active":"2024-09-21T03:24:32.253167+0000","last_peered":"2024-09-21T03:24:32.253167+0000","last_clean":"2024-09-21T03:24:32.253167+0000","last_became_active":"2024-09-21T03:14:37.464228+0000","last_became_peered":"2024-09-21T03:14:37.464228+0000","last_unstale":"2024-09-21T03:24:32.253167+0000","last_undegraded":"2024-09-21T03:24:32.253167+0000","last_fullsized":"2024-09-21T03:24:32.253167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:32.529512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'360","reported_seq":383,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:35.060058+0000","last_change":"2024-09-21T03:14:46.538538+0000","last_active":"2024-09-21T03:24:35.060058+0000","last_peered":"2024-09-21T03:24:35.060058+0000","last_clean":"2024-09-21T03:24:35.060058+0000","last_became_active":"2024-09-21T03:14:46.537815+0000","last_became_peered":"2024-09-21T03:14:46.537815+0000","last_unstale":"2024-09-21T03:24:35.060058+0000","last_undegraded":"2024-09-21T03:24:35.060058+0000","last_fullsized":"2024-09-21T03:24:35.060058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:42.264439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"27'3082","reported_seq":3103,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.299571+0000","last_change":"2024-09-21T03:14:47.558861+0000","last_active":"2024-09-21T03:24:45.299571+0000","last_peered":"2024-09-21T03:24:45.299571+0000","last_clean":"2024-09-21T03:24:45.299571+0000","last_became_active":"2024-09-21T03:14:47.557305+0000","last_became_peered":"2024-09-21T03:14:47.557305+0000","last_unstale":"2024-09-21T03:24:45.299571+0000","last_undegraded":"2024-09-21T03:24:45.299571+0000","last_fullsized":"2024-09-21T03:24:45.299571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3082,"log_dups_size":0,"ondisk_log_size":3082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:45.962367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44879,"num_write_kb":462177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'3149","reported_seq":3178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.485035+0000","last_change":"2024-09-21T03:14:38.479181+0000","last_active":"2024-09-21T03:24:44.485035+0000","last_peered":"2024-09-21T03:24:44.485035+0000","last_clean":"2024-09-21T03:24:44.485035+0000","last_became_active":"2024-09-21T03:14:38.478842+0000","last_became_peered":"2024-09-21T03:14:38.478842+0000","last_unstale":"2024-09-21T03:24:44.485035+0000","last_undegraded":"2024-09-21T03:24:44.485035+0000","last_fullsized":"2024-09-21T03:24:44.485035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3149,"log_dups_size":0,"ondisk_log_size":3149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:08.664381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46550,"num_write_kb":599066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:22:44.179288+0000","last_change":"2024-09-21T03:14:37.463990+0000","last_active":"2024-09-21T03:22:44.179288+0000","last_peered":"2024-09-21T03:22:44.179288+0000","last_clean":"2024-09-21T03:22:44.179288+0000","last_became_active":"2024-09-21T03:14:37.463674+0000","last_became_peered":"2024-09-21T03:14:37.463674+0000","last_unstale":"2024-09-21T03:22:44.179288+0000","last_undegraded":"2024-09-21T03:22:44.179288+0000","last_fullsized":"2024-09-21T03:22:44.179288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:35.391985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":128,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:22:32.784133+0000","last_change":"2024-09-21T03:14:26.342355+0000","last_active":"2024-09-21T03:22:32.784133+0000","last_peered":"2024-09-21T03:22:32.784133+0000","last_clean":"2024-09-21T03:22:32.784133+0000","last_became_active":"2024-09-21T03:14:26.341929+0000","last_became_peered":"2024-09-21T03:14:26.341929+0000","last_unstale":"2024-09-21T03:22:32.784133+0000","last_undegraded":"2024-09-21T03:22:32.784133+0000","last_fullsized":"2024-09-21T03:22:32.784133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:25.329650+0000","last_clean_scrub_stamp":"2024-09-21T03:14:25.329650+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:45.390822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'5","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.576786+0000","last_change":"2024-09-21T03:14:46.538184+0000","last_active":"2024-09-21T03:24:32.576786+0000","last_peered":"2024-09-21T03:24:32.576786+0000","last_clean":"2024-09-21T03:24:32.576786+0000","last_became_active":"2024-09-21T03:14:46.536753+0000","last_became_peered":"2024-09-21T03:14:46.536753+0000","last_unstale":"2024-09-21T03:24:32.576786+0000","last_undegraded":"2024-09-21T03:24:32.576786+0000","last_fullsized":"2024-09-21T03:24:32.576786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:49.078638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"27'2392","reported_seq":2413,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.297763+0000","last_change":"2024-09-21T03:14:47.552966+0000","last_active":"2024-09-21T03:24:45.297763+0000","last_peered":"2024-09-21T03:24:45.297763+0000","last_clean":"2024-09-21T03:24:45.297763+0000","last_became_active":"2024-09-21T03:14:47.552642+0000","last_became_peered":"2024-09-21T03:14:47.552642+0000","last_unstale":"2024-09-21T03:24:45.297763+0000","last_undegraded":"2024-09-21T03:24:45.297763+0000","last_fullsized":"2024-09-21T03:24:45.297763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2392,"log_dups_size":0,"ondisk_log_size":2392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:15.928026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34629,"num_write_kb":367496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"27'3146","reported_seq":3175,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.570766+0000","last_change":"2024-09-21T03:14:38.478414+0000","last_active":"2024-09-21T03:24:44.570766+0000","last_peered":"2024-09-21T03:24:44.570766+0000","last_clean":"2024-09-21T03:24:44.570766+0000","last_became_active":"2024-09-21T03:14:38.478116+0000","last_became_peered":"2024-09-21T03:14:38.478116+0000","last_unstale":"2024-09-21T03:24:44.570766+0000","last_undegraded":"2024-09-21T03:24:44.570766+0000","last_fullsized":"2024-09-21T03:24:44.570766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3146,"log_dups_size":0,"ondisk_log_size":3146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:29.618008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46299,"num_write_kb":593160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'3","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:23:38.363866+0000","last_change":"2024-09-21T03:14:37.479578+0000","last_active":"2024-09-21T03:23:38.363866+0000","last_peered":"2024-09-21T03:23:38.363866+0000","last_clean":"2024-09-21T03:23:38.363866+0000","last_became_active":"2024-09-21T03:14:37.479284+0000","last_became_peered":"2024-09-21T03:14:37.479284+0000","last_unstale":"2024-09-21T03:23:38.363866+0000","last_undegraded":"2024-09-21T03:23:38.363866+0000","last_fullsized":"2024-09-21T03:23:38.363866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:15.732230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'32","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.602886+0000","last_change":"2024-09-21T03:14:46.531536+0000","last_active":"2024-09-21T03:24:32.602886+0000","last_peered":"2024-09-21T03:24:32.602886+0000","last_clean":"2024-09-21T03:24:32.602886+0000","last_became_active":"2024-09-21T03:14:46.531069+0000","last_became_peered":"2024-09-21T03:14:46.531069+0000","last_unstale":"2024-09-21T03:24:32.602886+0000","last_undegraded":"2024-09-21T03:24:32.602886+0000","last_fullsized":"2024-09-21T03:24:32.602886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:14.050618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"27'2640","reported_seq":2661,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.334161+0000","last_change":"2024-09-21T03:14:47.553039+0000","last_active":"2024-09-21T03:24:45.334161+0000","last_peered":"2024-09-21T03:24:45.334161+0000","last_clean":"2024-09-21T03:24:45.334161+0000","last_became_active":"2024-09-21T03:14:47.552712+0000","last_became_peered":"2024-09-21T03:14:47.552712+0000","last_unstale":"2024-09-21T03:24:45.334161+0000","last_undegraded":"2024-09-21T03:24:45.334161+0000","last_fullsized":"2024-09-21T03:24:45.334161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2640,"log_dups_size":0,"ondisk_log_size":2640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:32.630319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38453,"num_write_kb":398220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'3285","reported_seq":3314,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.506010+0000","last_change":"2024-09-21T03:14:38.488259+0000","last_active":"2024-09-21T03:24:44.506010+0000","last_peered":"2024-09-21T03:24:44.506010+0000","last_clean":"2024-09-21T03:24:44.506010+0000","last_became_active":"2024-09-21T03:14:38.487420+0000","last_became_peered":"2024-09-21T03:14:38.487420+0000","last_unstale":"2024-09-21T03:24:44.506010+0000","last_undegraded":"2024-09-21T03:24:44.506010+0000","last_fullsized":"2024-09-21T03:24:44.506010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3285,"log_dups_size":0,"ondisk_log_size":3285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:48.003893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48497,"num_write_kb":608493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'7","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:23:39.783326+0000","last_change":"2024-09-21T03:14:37.460763+0000","last_active":"2024-09-21T03:23:39.783326+0000","last_peered":"2024-09-21T03:23:39.783326+0000","last_clean":"2024-09-21T03:23:39.783326+0000","last_became_active":"2024-09-21T03:14:37.460320+0000","last_became_peered":"2024-09-21T03:14:37.460320+0000","last_unstale":"2024-09-21T03:23:39.783326+0000","last_undegraded":"2024-09-21T03:23:39.783326+0000","last_fullsized":"2024-09-21T03:23:39.783326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.907794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'468","reported_seq":491,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.184284+0000","last_change":"2024-09-21T03:14:46.540901+0000","last_active":"2024-09-21T03:24:45.184284+0000","last_peered":"2024-09-21T03:24:45.184284+0000","last_clean":"2024-09-21T03:24:45.184284+0000","last_became_active":"2024-09-21T03:14:46.540182+0000","last_became_peered":"2024-09-21T03:14:46.540182+0000","last_unstale":"2024-09-21T03:24:45.184284+0000","last_undegraded":"2024-09-21T03:24:45.184284+0000","last_fullsized":"2024-09-21T03:24:45.184284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:38.416663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8130523,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":458,"num_write_kb":8274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"27'2705","reported_seq":2726,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.315093+0000","last_change":"2024-09-21T03:14:47.553810+0000","last_active":"2024-09-21T03:24:45.315093+0000","last_peered":"2024-09-21T03:24:45.315093+0000","last_clean":"2024-09-21T03:24:45.315093+0000","last_became_active":"2024-09-21T03:14:47.552371+0000","last_became_peered":"2024-09-21T03:14:47.552371+0000","last_unstale":"2024-09-21T03:24:45.315093+0000","last_undegraded":"2024-09-21T03:24:45.315093+0000","last_fullsized":"2024-09-21T03:24:45.315093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2705,"log_dups_size":0,"ondisk_log_size":2705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:38.659512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39343,"num_write_kb":410859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"27'3625","reported_seq":3654,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.548288+0000","last_change":"2024-09-21T03:14:38.480629+0000","last_active":"2024-09-21T03:24:44.548288+0000","last_peered":"2024-09-21T03:24:44.548288+0000","last_clean":"2024-09-21T03:24:44.548288+0000","last_became_active":"2024-09-21T03:14:38.474135+0000","last_became_peered":"2024-09-21T03:14:38.474135+0000","last_unstale":"2024-09-21T03:24:44.548288+0000","last_undegraded":"2024-09-21T03:24:44.548288+0000","last_fullsized":"2024-09-21T03:24:44.548288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3625,"log_dups_size":0,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:36.171044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53421,"num_write_kb":673086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'13","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.193221+0000","last_change":"2024-09-21T03:14:37.472491+0000","last_active":"2024-09-21T03:24:32.193221+0000","last_peered":"2024-09-21T03:24:32.193221+0000","last_clean":"2024-09-21T03:24:32.193221+0000","last_became_active":"2024-09-21T03:14:37.472164+0000","last_became_peered":"2024-09-21T03:14:37.472164+0000","last_unstale":"2024-09-21T03:24:32.193221+0000","last_undegraded":"2024-09-21T03:24:32.193221+0000","last_fullsized":"2024-09-21T03:24:32.193221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:17.498178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'19","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.563185+0000","last_change":"2024-09-21T03:14:46.544828+0000","last_active":"2024-09-21T03:24:32.563185+0000","last_peered":"2024-09-21T03:24:32.563185+0000","last_clean":"2024-09-21T03:24:32.563185+0000","last_became_active":"2024-09-21T03:14:46.535901+0000","last_became_peered":"2024-09-21T03:14:46.535901+0000","last_unstale":"2024-09-21T03:24:32.563185+0000","last_undegraded":"2024-09-21T03:24:32.563185+0000","last_fullsized":"2024-09-21T03:24:32.563185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:08.608530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"27'3050","reported_seq":3071,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.324443+0000","last_change":"2024-09-21T03:14:47.556478+0000","last_active":"2024-09-21T03:24:45.324443+0000","last_peered":"2024-09-21T03:24:45.324443+0000","last_clean":"2024-09-21T03:24:45.324443+0000","last_became_active":"2024-09-21T03:14:47.556145+0000","last_became_peered":"2024-09-21T03:14:47.556145+0000","last_unstale":"2024-09-21T03:24:45.324443+0000","last_undegraded":"2024-09-21T03:24:45.324443+0000","last_fullsized":"2024-09-21T03:24:45.324443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3050,"log_dups_size":0,"ondisk_log_size":3050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:59.004648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44445,"num_write_kb":452313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"27'2817","reported_seq":2846,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.579922+0000","last_change":"2024-09-21T03:14:38.469502+0000","last_active":"2024-09-21T03:24:44.579922+0000","last_peered":"2024-09-21T03:24:44.579922+0000","last_clean":"2024-09-21T03:24:44.579922+0000","last_became_active":"2024-09-21T03:14:38.468972+0000","last_became_peered":"2024-09-21T03:14:38.468972+0000","last_unstale":"2024-09-21T03:24:44.579922+0000","last_undegraded":"2024-09-21T03:24:44.579922+0000","last_fullsized":"2024-09-21T03:24:44.579922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2817,"log_dups_size":0,"ondisk_log_size":2817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41476,"num_write_kb":540924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'10","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.208426+0000","last_change":"2024-09-21T03:14:37.480905+0000","last_active":"2024-09-21T03:24:32.208426+0000","last_peered":"2024-09-21T03:24:32.208426+0000","last_clean":"2024-09-21T03:24:32.208426+0000","last_became_active":"2024-09-21T03:14:37.478227+0000","last_became_peered":"2024-09-21T03:14:37.478227+0000","last_unstale":"2024-09-21T03:24:32.208426+0000","last_undegraded":"2024-09-21T03:24:32.208426+0000","last_fullsized":"2024-09-21T03:24:32.208426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:42.765416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.583666+0000","last_change":"2024-09-21T03:14:46.536103+0000","last_active":"2024-09-21T03:24:32.583666+0000","last_peered":"2024-09-21T03:24:32.583666+0000","last_clean":"2024-09-21T03:24:32.583666+0000","last_became_active":"2024-09-21T03:14:46.535445+0000","last_became_peered":"2024-09-21T03:14:46.535445+0000","last_unstale":"2024-09-21T03:24:32.583666+0000","last_undegraded":"2024-09-21T03:24:32.583666+0000","last_fullsized":"2024-09-21T03:24:32.583666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:59.078000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"27'2465","reported_seq":2486,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.350565+0000","last_change":"2024-09-21T03:14:47.557503+0000","last_active":"2024-09-21T03:24:45.350565+0000","last_peered":"2024-09-21T03:24:45.350565+0000","last_clean":"2024-09-21T03:24:45.350565+0000","last_became_active":"2024-09-21T03:14:47.554366+0000","last_became_peered":"2024-09-21T03:14:47.554366+0000","last_unstale":"2024-09-21T03:24:45.350565+0000","last_undegraded":"2024-09-21T03:24:45.350565+0000","last_fullsized":"2024-09-21T03:24:45.350565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2465,"log_dups_size":0,"ondisk_log_size":2465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.994560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35585,"num_write_kb":377642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'3460","reported_seq":3489,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.499012+0000","last_change":"2024-09-21T03:14:38.479516+0000","last_active":"2024-09-21T03:24:44.499012+0000","last_peered":"2024-09-21T03:24:44.499012+0000","last_clean":"2024-09-21T03:24:44.499012+0000","last_became_active":"2024-09-21T03:14:38.474826+0000","last_became_peered":"2024-09-21T03:14:38.474826+0000","last_unstale":"2024-09-21T03:24:44.499012+0000","last_undegraded":"2024-09-21T03:24:44.499012+0000","last_fullsized":"2024-09-21T03:24:44.499012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3460,"log_dups_size":0,"ondisk_log_size":3460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:22.181411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51413,"num_write_kb":609416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'37","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.141749+0000","last_change":"2024-09-21T03:14:37.471063+0000","last_active":"2024-09-21T03:24:32.141749+0000","last_peered":"2024-09-21T03:24:32.141749+0000","last_clean":"2024-09-21T03:24:32.141749+0000","last_became_active":"2024-09-21T03:14:37.470720+0000","last_became_peered":"2024-09-21T03:14:37.470720+0000","last_unstale":"2024-09-21T03:24:32.141749+0000","last_undegraded":"2024-09-21T03:24:32.141749+0000","last_fullsized":"2024-09-21T03:24:32.141749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:00.054692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.582741+0000","last_change":"2024-09-21T03:14:46.538665+0000","last_active":"2024-09-21T03:24:32.582741+0000","last_peered":"2024-09-21T03:24:32.582741+0000","last_clean":"2024-09-21T03:24:32.582741+0000","last_became_active":"2024-09-21T03:14:46.537774+0000","last_became_peered":"2024-09-21T03:14:46.537774+0000","last_unstale":"2024-09-21T03:24:32.582741+0000","last_undegraded":"2024-09-21T03:24:32.582741+0000","last_fullsized":"2024-09-21T03:24:32.582741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:07.736404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"27'2987","reported_seq":3008,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.341975+0000","last_change":"2024-09-21T03:14:47.553011+0000","last_active":"2024-09-21T03:24:45.341975+0000","last_peered":"2024-09-21T03:24:45.341975+0000","last_clean":"2024-09-21T03:24:45.341975+0000","last_became_active":"2024-09-21T03:14:47.552700+0000","last_became_peered":"2024-09-21T03:14:47.552700+0000","last_unstale":"2024-09-21T03:24:45.341975+0000","last_undegraded":"2024-09-21T03:24:45.341975+0000","last_fullsized":"2024-09-21T03:24:45.341975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2987,"log_dups_size":0,"ondisk_log_size":2987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:58.780132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43190,"num_write_kb":444709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"27'3323","reported_seq":3352,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.477288+0000","last_change":"2024-09-21T03:14:38.472906+0000","last_active":"2024-09-21T03:24:44.477288+0000","last_peered":"2024-09-21T03:24:44.477288+0000","last_clean":"2024-09-21T03:24:44.477288+0000","last_became_active":"2024-09-21T03:14:38.471933+0000","last_became_peered":"2024-09-21T03:14:38.471933+0000","last_unstale":"2024-09-21T03:24:44.477288+0000","last_undegraded":"2024-09-21T03:24:44.477288+0000","last_fullsized":"2024-09-21T03:24:44.477288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3323,"log_dups_size":0,"ondisk_log_size":3323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:05.395821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49154,"num_write_kb":612364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.200953+0000","last_change":"2024-09-21T03:14:37.478714+0000","last_active":"2024-09-21T03:24:32.200953+0000","last_peered":"2024-09-21T03:24:32.200953+0000","last_clean":"2024-09-21T03:24:32.200953+0000","last_became_active":"2024-09-21T03:14:37.477951+0000","last_became_peered":"2024-09-21T03:14:37.477951+0000","last_unstale":"2024-09-21T03:24:32.200953+0000","last_undegraded":"2024-09-21T03:24:32.200953+0000","last_fullsized":"2024-09-21T03:24:32.200953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:42.529545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:26.343821+0000","last_change":"2024-09-21T03:14:46.546142+0000","last_active":"2024-09-21T03:24:26.343821+0000","last_peered":"2024-09-21T03:24:26.343821+0000","last_clean":"2024-09-21T03:24:26.343821+0000","last_became_active":"2024-09-21T03:14:46.545865+0000","last_became_peered":"2024-09-21T03:14:46.545865+0000","last_unstale":"2024-09-21T03:24:26.343821+0000","last_undegraded":"2024-09-21T03:24:26.343821+0000","last_fullsized":"2024-09-21T03:24:26.343821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:11.705309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"27'2779","reported_seq":2806,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.354268+0000","last_change":"2024-09-21T03:19:03.558620+0000","last_active":"2024-09-21T03:24:45.354268+0000","last_peered":"2024-09-21T03:24:45.354268+0000","last_clean":"2024-09-21T03:24:45.354268+0000","last_became_active":"2024-09-21T03:14:47.568656+0000","last_became_peered":"2024-09-21T03:14:47.568656+0000","last_unstale":"2024-09-21T03:24:45.354268+0000","last_undegraded":"2024-09-21T03:24:45.354268+0000","last_fullsized":"2024-09-21T03:24:45.354268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2779,"log_dups_size":0,"ondisk_log_size":2779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.041710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40461,"num_write_kb":415650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'3337","reported_seq":3366,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.555169+0000","last_change":"2024-09-21T03:14:38.485454+0000","last_active":"2024-09-21T03:24:44.555169+0000","last_peered":"2024-09-21T03:24:44.555169+0000","last_clean":"2024-09-21T03:24:44.555169+0000","last_became_active":"2024-09-21T03:14:38.485235+0000","last_became_peered":"2024-09-21T03:14:38.485235+0000","last_unstale":"2024-09-21T03:24:44.555169+0000","last_undegraded":"2024-09-21T03:24:44.555169+0000","last_fullsized":"2024-09-21T03:24:44.555169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:11.585637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48941,"num_write_kb":642004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.241707+0000","last_change":"2024-09-21T03:14:37.466544+0000","last_active":"2024-09-21T03:24:32.241707+0000","last_peered":"2024-09-21T03:24:32.241707+0000","last_clean":"2024-09-21T03:24:32.241707+0000","last_became_active":"2024-09-21T03:14:37.465817+0000","last_became_peered":"2024-09-21T03:14:37.465817+0000","last_unstale":"2024-09-21T03:24:32.241707+0000","last_undegraded":"2024-09-21T03:24:32.241707+0000","last_fullsized":"2024-09-21T03:24:32.241707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:36.113483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'229","reported_seq":252,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.596651+0000","last_change":"2024-09-21T03:14:46.549921+0000","last_active":"2024-09-21T03:24:32.596651+0000","last_peered":"2024-09-21T03:24:32.596651+0000","last_clean":"2024-09-21T03:24:32.596651+0000","last_became_active":"2024-09-21T03:14:46.549119+0000","last_became_peered":"2024-09-21T03:14:46.549119+0000","last_unstale":"2024-09-21T03:24:32.596651+0000","last_undegraded":"2024-09-21T03:24:32.596651+0000","last_fullsized":"2024-09-21T03:24:32.596651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:09.622498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"27'3932","reported_seq":3947,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.330162+0000","last_change":"2024-09-21T03:15:15.687659+0000","last_active":"2024-09-21T03:24:45.330162+0000","last_peered":"2024-09-21T03:24:45.330162+0000","last_clean":"2024-09-21T03:24:45.330162+0000","last_became_active":"2024-09-21T03:15:15.687225+0000","last_became_peered":"2024-09-21T03:15:15.687225+0000","last_unstale":"2024-09-21T03:24:45.330162+0000","last_undegraded":"2024-09-21T03:24:45.330162+0000","last_fullsized":"2024-09-21T03:24:45.330162+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3932,"log_dups_size":0,"ondisk_log_size":3932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:56.395767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57021,"num_write_kb":587488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"27'3064","reported_seq":3093,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.514657+0000","last_change":"2024-09-21T03:14:38.482528+0000","last_active":"2024-09-21T03:24:44.514657+0000","last_peered":"2024-09-21T03:24:44.514657+0000","last_clean":"2024-09-21T03:24:44.514657+0000","last_became_active":"2024-09-21T03:14:38.482241+0000","last_became_peered":"2024-09-21T03:14:38.482241+0000","last_unstale":"2024-09-21T03:24:44.514657+0000","last_undegraded":"2024-09-21T03:24:44.514657+0000","last_fullsized":"2024-09-21T03:24:44.514657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3064,"log_dups_size":0,"ondisk_log_size":3064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:23.110703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45418,"num_write_kb":562843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'19","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.197386+0000","last_change":"2024-09-21T03:14:37.479223+0000","last_active":"2024-09-21T03:24:32.197386+0000","last_peered":"2024-09-21T03:24:32.197386+0000","last_clean":"2024-09-21T03:24:32.197386+0000","last_became_active":"2024-09-21T03:14:37.478882+0000","last_became_peered":"2024-09-21T03:14:37.478882+0000","last_unstale":"2024-09-21T03:24:32.197386+0000","last_undegraded":"2024-09-21T03:24:32.197386+0000","last_fullsized":"2024-09-21T03:24:32.197386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:11.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'22","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:33.062661+0000","last_change":"2024-09-21T03:14:46.538817+0000","last_active":"2024-09-21T03:24:33.062661+0000","last_peered":"2024-09-21T03:24:33.062661+0000","last_clean":"2024-09-21T03:24:33.062661+0000","last_became_active":"2024-09-21T03:14:46.537835+0000","last_became_peered":"2024-09-21T03:14:46.537835+0000","last_unstale":"2024-09-21T03:24:33.062661+0000","last_undegraded":"2024-09-21T03:24:33.062661+0000","last_fullsized":"2024-09-21T03:24:33.062661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:08.236663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"27'3365","reported_seq":3386,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.359474+0000","last_change":"2024-09-21T03:14:47.566534+0000","last_active":"2024-09-21T03:24:45.359474+0000","last_peered":"2024-09-21T03:24:45.359474+0000","last_clean":"2024-09-21T03:24:45.359474+0000","last_became_active":"2024-09-21T03:14:47.566157+0000","last_became_peered":"2024-09-21T03:14:47.566157+0000","last_unstale":"2024-09-21T03:24:45.359474+0000","last_undegraded":"2024-09-21T03:24:45.359474+0000","last_fullsized":"2024-09-21T03:24:45.359474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3365,"log_dups_size":0,"ondisk_log_size":3365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:35.557811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48864,"num_write_kb":499368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"27'2812","reported_seq":2841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.505020+0000","last_change":"2024-09-21T03:14:38.478509+0000","last_active":"2024-09-21T03:24:44.505020+0000","last_peered":"2024-09-21T03:24:44.505020+0000","last_clean":"2024-09-21T03:24:44.505020+0000","last_became_active":"2024-09-21T03:14:38.478197+0000","last_became_peered":"2024-09-21T03:14:38.478197+0000","last_unstale":"2024-09-21T03:24:44.505020+0000","last_undegraded":"2024-09-21T03:24:44.505020+0000","last_fullsized":"2024-09-21T03:24:44.505020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2812,"log_dups_size":0,"ondisk_log_size":2812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.411134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41544,"num_write_kb":533190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'234","reported_seq":265,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.189321+0000","last_change":"2024-09-21T03:14:37.472695+0000","last_active":"2024-09-21T03:24:32.189321+0000","last_peered":"2024-09-21T03:24:32.189321+0000","last_clean":"2024-09-21T03:24:32.189321+0000","last_became_active":"2024-09-21T03:14:37.472374+0000","last_became_peered":"2024-09-21T03:14:37.472374+0000","last_unstale":"2024-09-21T03:24:32.189321+0000","last_undegraded":"2024-09-21T03:24:32.189321+0000","last_fullsized":"2024-09-21T03:24:32.189321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:11.245914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":12446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'5","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.617539+0000","last_change":"2024-09-21T03:14:46.547433+0000","last_active":"2024-09-21T03:24:32.617539+0000","last_peered":"2024-09-21T03:24:32.617539+0000","last_clean":"2024-09-21T03:24:32.617539+0000","last_became_active":"2024-09-21T03:14:46.547192+0000","last_became_peered":"2024-09-21T03:14:46.547192+0000","last_unstale":"2024-09-21T03:24:32.617539+0000","last_undegraded":"2024-09-21T03:24:32.617539+0000","last_fullsized":"2024-09-21T03:24:32.617539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:03.238245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"27'2738","reported_seq":2759,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.327239+0000","last_change":"2024-09-21T03:14:47.545827+0000","last_active":"2024-09-21T03:24:45.327239+0000","last_peered":"2024-09-21T03:24:45.327239+0000","last_clean":"2024-09-21T03:24:45.327239+0000","last_became_active":"2024-09-21T03:14:47.545440+0000","last_became_peered":"2024-09-21T03:14:47.545440+0000","last_unstale":"2024-09-21T03:24:45.327239+0000","last_undegraded":"2024-09-21T03:24:45.327239+0000","last_fullsized":"2024-09-21T03:24:45.327239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2738,"log_dups_size":0,"ondisk_log_size":2738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:20.532645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39786,"num_write_kb":413571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"27'4240","reported_seq":4269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.548539+0000","last_change":"2024-09-21T03:14:38.476564+0000","last_active":"2024-09-21T03:24:44.548539+0000","last_peered":"2024-09-21T03:24:44.548539+0000","last_clean":"2024-09-21T03:24:44.548539+0000","last_became_active":"2024-09-21T03:14:38.476158+0000","last_became_peered":"2024-09-21T03:14:38.476158+0000","last_unstale":"2024-09-21T03:24:44.548539+0000","last_undegraded":"2024-09-21T03:24:44.548539+0000","last_fullsized":"2024-09-21T03:24:44.548539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":4240,"log_dups_size":0,"ondisk_log_size":4240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:26.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63095,"num_write_kb":776596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'34","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.259366+0000","last_change":"2024-09-21T03:14:37.473709+0000","last_active":"2024-09-21T03:24:32.259366+0000","last_peered":"2024-09-21T03:24:32.259366+0000","last_clean":"2024-09-21T03:24:32.259366+0000","last_became_active":"2024-09-21T03:14:37.472544+0000","last_became_peered":"2024-09-21T03:14:37.472544+0000","last_unstale":"2024-09-21T03:24:32.259366+0000","last_undegraded":"2024-09-21T03:24:32.259366+0000","last_fullsized":"2024-09-21T03:24:32.259366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:47.892146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'51","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.595511+0000","last_change":"2024-09-21T03:14:46.534201+0000","last_active":"2024-09-21T03:24:32.595511+0000","last_peered":"2024-09-21T03:24:32.595511+0000","last_clean":"2024-09-21T03:24:32.595511+0000","last_became_active":"2024-09-21T03:14:46.533891+0000","last_became_peered":"2024-09-21T03:14:46.533891+0000","last_unstale":"2024-09-21T03:24:32.595511+0000","last_undegraded":"2024-09-21T03:24:32.595511+0000","last_fullsized":"2024-09-21T03:24:32.595511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:06.645173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":8218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"27'3050","reported_seq":3071,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.318616+0000","last_change":"2024-09-21T03:14:47.552016+0000","last_active":"2024-09-21T03:24:45.318616+0000","last_peered":"2024-09-21T03:24:45.318616+0000","last_clean":"2024-09-21T03:24:45.318616+0000","last_became_active":"2024-09-21T03:14:47.551622+0000","last_became_peered":"2024-09-21T03:14:47.551622+0000","last_unstale":"2024-09-21T03:24:45.318616+0000","last_undegraded":"2024-09-21T03:24:45.318616+0000","last_fullsized":"2024-09-21T03:24:45.318616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3050,"log_dups_size":0,"ondisk_log_size":3050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:56:04.849535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44676,"num_write_kb":453348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'2866","reported_seq":2895,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.559024+0000","last_change":"2024-09-21T03:14:38.484757+0000","last_active":"2024-09-21T03:24:44.559024+0000","last_peered":"2024-09-21T03:24:44.559024+0000","last_clean":"2024-09-21T03:24:44.559024+0000","last_became_active":"2024-09-21T03:14:38.483348+0000","last_became_peered":"2024-09-21T03:14:38.483348+0000","last_unstale":"2024-09-21T03:24:44.559024+0000","last_undegraded":"2024-09-21T03:24:44.559024+0000","last_fullsized":"2024-09-21T03:24:44.559024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2866,"log_dups_size":0,"ondisk_log_size":2866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:57.697723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42315,"num_write_kb":514746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'14","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.191061+0000","last_change":"2024-09-21T03:14:37.479047+0000","last_active":"2024-09-21T03:24:32.191061+0000","last_peered":"2024-09-21T03:24:32.191061+0000","last_clean":"2024-09-21T03:24:32.191061+0000","last_became_active":"2024-09-21T03:14:37.478700+0000","last_became_peered":"2024-09-21T03:14:37.478700+0000","last_unstale":"2024-09-21T03:24:32.191061+0000","last_undegraded":"2024-09-21T03:24:32.191061+0000","last_fullsized":"2024-09-21T03:24:32.191061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:31.702450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'12","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.584480+0000","last_change":"2024-09-21T03:14:46.547287+0000","last_active":"2024-09-21T03:24:32.584480+0000","last_peered":"2024-09-21T03:24:32.584480+0000","last_clean":"2024-09-21T03:24:32.584480+0000","last_became_active":"2024-09-21T03:14:46.546867+0000","last_became_peered":"2024-09-21T03:14:46.546867+0000","last_unstale":"2024-09-21T03:24:32.584480+0000","last_undegraded":"2024-09-21T03:24:32.584480+0000","last_fullsized":"2024-09-21T03:24:32.584480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:54.119841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"27'3248","reported_seq":3269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.330727+0000","last_change":"2024-09-21T03:14:47.558571+0000","last_active":"2024-09-21T03:24:45.330727+0000","last_peered":"2024-09-21T03:24:45.330727+0000","last_clean":"2024-09-21T03:24:45.330727+0000","last_became_active":"2024-09-21T03:14:47.558037+0000","last_became_peered":"2024-09-21T03:14:47.558037+0000","last_unstale":"2024-09-21T03:24:45.330727+0000","last_undegraded":"2024-09-21T03:24:45.330727+0000","last_fullsized":"2024-09-21T03:24:45.330727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3248,"log_dups_size":0,"ondisk_log_size":3248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:42.564181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47392,"num_write_kb":480920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"27'3071","reported_seq":3100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.583058+0000","last_change":"2024-09-21T03:14:38.488227+0000","last_active":"2024-09-21T03:24:44.583058+0000","last_peered":"2024-09-21T03:24:44.583058+0000","last_clean":"2024-09-21T03:24:44.583058+0000","last_became_active":"2024-09-21T03:14:38.482370+0000","last_became_peered":"2024-09-21T03:14:38.482370+0000","last_unstale":"2024-09-21T03:24:44.583058+0000","last_undegraded":"2024-09-21T03:24:44.583058+0000","last_fullsized":"2024-09-21T03:24:44.583058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3071,"log_dups_size":0,"ondisk_log_size":3071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:52.561391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45203,"num_write_kb":570065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:20.846579+0000","last_change":"2024-09-21T03:14:37.471363+0000","last_active":"2024-09-21T03:24:20.846579+0000","last_peered":"2024-09-21T03:24:20.846579+0000","last_clean":"2024-09-21T03:24:20.846579+0000","last_became_active":"2024-09-21T03:14:37.471002+0000","last_became_peered":"2024-09-21T03:14:37.471002+0000","last_unstale":"2024-09-21T03:24:20.846579+0000","last_undegraded":"2024-09-21T03:24:20.846579+0000","last_fullsized":"2024-09-21T03:24:20.846579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:25.922368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.586441+0000","last_change":"2024-09-21T03:14:46.545186+0000","last_active":"2024-09-21T03:24:32.586441+0000","last_peered":"2024-09-21T03:24:32.586441+0000","last_clean":"2024-09-21T03:24:32.586441+0000","last_became_active":"2024-09-21T03:14:46.543647+0000","last_became_peered":"2024-09-21T03:14:46.543647+0000","last_unstale":"2024-09-21T03:24:32.586441+0000","last_undegraded":"2024-09-21T03:24:32.586441+0000","last_fullsized":"2024-09-21T03:24:32.586441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:03.097368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"27'3498","reported_seq":3519,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.285413+0000","last_change":"2024-09-21T03:14:47.554766+0000","last_active":"2024-09-21T03:24:45.285413+0000","last_peered":"2024-09-21T03:24:45.285413+0000","last_clean":"2024-09-21T03:24:45.285413+0000","last_became_active":"2024-09-21T03:14:47.551563+0000","last_became_peered":"2024-09-21T03:14:47.551563+0000","last_unstale":"2024-09-21T03:24:45.285413+0000","last_undegraded":"2024-09-21T03:24:45.285413+0000","last_fullsized":"2024-09-21T03:24:45.285413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3498,"log_dups_size":0,"ondisk_log_size":3498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:08.790725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50774,"num_write_kb":531933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"27'32","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.618450+0000","last_change":"2024-09-21T03:14:46.542659+0000","last_active":"2024-09-21T03:24:32.618450+0000","last_peered":"2024-09-21T03:24:32.618450+0000","last_clean":"2024-09-21T03:24:32.618450+0000","last_became_active":"2024-09-21T03:14:46.541771+0000","last_became_peered":"2024-09-21T03:14:46.541771+0000","last_unstale":"2024-09-21T03:24:32.618450+0000","last_undegraded":"2024-09-21T03:24:32.618450+0000","last_fullsized":"2024-09-21T03:24:32.618450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:45.543904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'3639","reported_seq":3668,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.531609+0000","last_change":"2024-09-21T03:14:38.481837+0000","last_active":"2024-09-21T03:24:44.531609+0000","last_peered":"2024-09-21T03:24:44.531609+0000","last_clean":"2024-09-21T03:24:44.531609+0000","last_became_active":"2024-09-21T03:14:38.478400+0000","last_became_peered":"2024-09-21T03:14:38.478400+0000","last_unstale":"2024-09-21T03:24:44.531609+0000","last_undegraded":"2024-09-21T03:24:44.531609+0000","last_fullsized":"2024-09-21T03:24:44.531609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3639,"log_dups_size":0,"ondisk_log_size":3639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.702185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53758,"num_write_kb":679942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'29","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.101066+0000","last_change":"2024-09-21T03:14:37.459351+0000","last_active":"2024-09-21T03:24:32.101066+0000","last_peered":"2024-09-21T03:24:32.101066+0000","last_clean":"2024-09-21T03:24:32.101066+0000","last_became_active":"2024-09-21T03:14:37.458676+0000","last_became_peered":"2024-09-21T03:14:37.458676+0000","last_unstale":"2024-09-21T03:24:32.101066+0000","last_undegraded":"2024-09-21T03:24:32.101066+0000","last_fullsized":"2024-09-21T03:24:32.101066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:42.671520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"27'3281","reported_seq":3302,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.343605+0000","last_change":"2024-09-21T03:14:47.561232+0000","last_active":"2024-09-21T03:24:45.343605+0000","last_peered":"2024-09-21T03:24:45.343605+0000","last_clean":"2024-09-21T03:24:45.343605+0000","last_became_active":"2024-09-21T03:14:47.557224+0000","last_became_peered":"2024-09-21T03:14:47.557224+0000","last_unstale":"2024-09-21T03:24:45.343605+0000","last_undegraded":"2024-09-21T03:24:45.343605+0000","last_fullsized":"2024-09-21T03:24:45.343605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3281,"log_dups_size":0,"ondisk_log_size":3281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:09.611235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47961,"num_write_kb":483752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"27'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:21:00.934074+0000","last_change":"2024-09-21T03:14:46.543157+0000","last_active":"2024-09-21T03:21:00.934074+0000","last_peered":"2024-09-21T03:21:00.934074+0000","last_clean":"2024-09-21T03:21:00.934074+0000","last_became_active":"2024-09-21T03:14:46.542746+0000","last_became_peered":"2024-09-21T03:14:46.542746+0000","last_unstale":"2024-09-21T03:21:00.934074+0000","last_undegraded":"2024-09-21T03:21:00.934074+0000","last_fullsized":"2024-09-21T03:21:00.934074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:30.644843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'3052","reported_seq":3081,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.518411+0000","last_change":"2024-09-21T03:14:38.480723+0000","last_active":"2024-09-21T03:24:44.518411+0000","last_peered":"2024-09-21T03:24:44.518411+0000","last_clean":"2024-09-21T03:24:44.518411+0000","last_became_active":"2024-09-21T03:14:38.472823+0000","last_became_peered":"2024-09-21T03:14:38.472823+0000","last_unstale":"2024-09-21T03:24:44.518411+0000","last_undegraded":"2024-09-21T03:24:44.518411+0000","last_fullsized":"2024-09-21T03:24:44.518411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3052,"log_dups_size":0,"ondisk_log_size":3052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:59.862592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44791,"num_write_kb":578211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'17","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:29.478596+0000","last_change":"2024-09-21T03:14:37.472209+0000","last_active":"2024-09-21T03:24:29.478596+0000","last_peered":"2024-09-21T03:24:29.478596+0000","last_clean":"2024-09-21T03:24:29.478596+0000","last_became_active":"2024-09-21T03:14:37.471771+0000","last_became_peered":"2024-09-21T03:14:37.471771+0000","last_unstale":"2024-09-21T03:24:29.478596+0000","last_undegraded":"2024-09-21T03:24:29.478596+0000","last_fullsized":"2024-09-21T03:24:29.478596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:30.648010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"27'3552","reported_seq":3572,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.364338+0000","last_change":"2024-09-21T03:14:47.570651+0000","last_active":"2024-09-21T03:24:45.364338+0000","last_peered":"2024-09-21T03:24:45.364338+0000","last_clean":"2024-09-21T03:24:45.364338+0000","last_became_active":"2024-09-21T03:14:47.568081+0000","last_became_peered":"2024-09-21T03:14:47.568081+0000","last_unstale":"2024-09-21T03:24:45.364338+0000","last_undegraded":"2024-09-21T03:24:45.364338+0000","last_fullsized":"2024-09-21T03:24:45.364338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:45.036938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51450,"num_write_kb":532295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"27'33","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.223186+0000","last_change":"2024-09-21T03:14:37.475076+0000","last_active":"2024-09-21T03:24:32.223186+0000","last_peered":"2024-09-21T03:24:32.223186+0000","last_clean":"2024-09-21T03:24:32.223186+0000","last_became_active":"2024-09-21T03:14:37.474595+0000","last_became_peered":"2024-09-21T03:14:37.474595+0000","last_unstale":"2024-09-21T03:24:32.223186+0000","last_undegraded":"2024-09-21T03:24:32.223186+0000","last_fullsized":"2024-09-21T03:24:32.223186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:16.880647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2516","reported_seq":2545,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.531186+0000","last_change":"2024-09-21T03:14:38.483226+0000","last_active":"2024-09-21T03:24:44.531186+0000","last_peered":"2024-09-21T03:24:44.531186+0000","last_clean":"2024-09-21T03:24:44.531186+0000","last_became_active":"2024-09-21T03:14:38.482354+0000","last_became_peered":"2024-09-21T03:14:38.482354+0000","last_unstale":"2024-09-21T03:24:44.531186+0000","last_undegraded":"2024-09-21T03:24:44.531186+0000","last_fullsized":"2024-09-21T03:24:44.531186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2516,"log_dups_size":0,"ondisk_log_size":2516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:51.488594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37096,"num_write_kb":460963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'34","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.602419+0000","last_change":"2024-09-21T03:14:46.551282+0000","last_active":"2024-09-21T03:24:32.602419+0000","last_peered":"2024-09-21T03:24:32.602419+0000","last_clean":"2024-09-21T03:24:32.602419+0000","last_became_active":"2024-09-21T03:14:46.550191+0000","last_became_peered":"2024-09-21T03:14:46.550191+0000","last_unstale":"2024-09-21T03:24:32.602419+0000","last_undegraded":"2024-09-21T03:24:32.602419+0000","last_fullsized":"2024-09-21T03:24:32.602419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:32.136739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"27'2120","reported_seq":2147,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.338828+0000","last_change":"2024-09-21T03:15:15.686522+0000","last_active":"2024-09-21T03:24:45.338828+0000","last_peered":"2024-09-21T03:24:45.338828+0000","last_clean":"2024-09-21T03:24:45.338828+0000","last_became_active":"2024-09-21T03:15:15.686063+0000","last_became_peered":"2024-09-21T03:15:15.686063+0000","last_unstale":"2024-09-21T03:24:45.338828+0000","last_undegraded":"2024-09-21T03:24:45.338828+0000","last_fullsized":"2024-09-21T03:24:45.338828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2120,"log_dups_size":0,"ondisk_log_size":2120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30729,"num_write_kb":315555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1140","reported_seq":1171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.135682+0000","last_change":"2024-09-21T03:14:37.465536+0000","last_active":"2024-09-21T03:24:32.135682+0000","last_peered":"2024-09-21T03:24:32.135682+0000","last_clean":"2024-09-21T03:24:32.135682+0000","last_became_active":"2024-09-21T03:14:37.465240+0000","last_became_peered":"2024-09-21T03:14:37.465240+0000","last_unstale":"2024-09-21T03:24:32.135682+0000","last_undegraded":"2024-09-21T03:24:32.135682+0000","last_fullsized":"2024-09-21T03:24:32.135682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:36.431393+0000","last_clean_scrub_stamp":"2024-09-21T03:14:36.431393+0000","objects_scrubbed":0,"log_size":1140,"log_dups_size":0,"ondisk_log_size":1140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:34.780298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1138,"num_write_kb":5114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'2730","reported_seq":2759,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.508566+0000","last_change":"2024-09-21T03:14:38.474516+0000","last_active":"2024-09-21T03:24:44.508566+0000","last_peered":"2024-09-21T03:24:44.508566+0000","last_clean":"2024-09-21T03:24:44.508566+0000","last_became_active":"2024-09-21T03:14:38.472225+0000","last_became_peered":"2024-09-21T03:14:38.472225+0000","last_unstale":"2024-09-21T03:24:44.508566+0000","last_undegraded":"2024-09-21T03:24:44.508566+0000","last_fullsized":"2024-09-21T03:24:44.508566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2730,"log_dups_size":0,"ondisk_log_size":2730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:47.504910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40361,"num_write_kb":500658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'77","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.604901+0000","last_change":"2024-09-21T03:14:46.544072+0000","last_active":"2024-09-21T03:24:32.604901+0000","last_peered":"2024-09-21T03:24:32.604901+0000","last_clean":"2024-09-21T03:24:32.604901+0000","last_became_active":"2024-09-21T03:14:46.543729+0000","last_became_peered":"2024-09-21T03:14:46.543729+0000","last_unstale":"2024-09-21T03:24:32.604901+0000","last_undegraded":"2024-09-21T03:24:32.604901+0000","last_fullsized":"2024-09-21T03:24:32.604901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:18.560012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":12315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"27'2742","reported_seq":2763,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.365262+0000","last_change":"2024-09-21T03:14:47.563764+0000","last_active":"2024-09-21T03:24:45.365262+0000","last_peered":"2024-09-21T03:24:45.365262+0000","last_clean":"2024-09-21T03:24:45.365262+0000","last_became_active":"2024-09-21T03:14:47.562943+0000","last_became_peered":"2024-09-21T03:14:47.562943+0000","last_unstale":"2024-09-21T03:24:45.365262+0000","last_undegraded":"2024-09-21T03:24:45.365262+0000","last_fullsized":"2024-09-21T03:24:45.365262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2742,"log_dups_size":0,"ondisk_log_size":2742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:39.284350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39824,"num_write_kb":405293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"27'3827","reported_seq":3856,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.511437+0000","last_change":"2024-09-21T03:14:38.484311+0000","last_active":"2024-09-21T03:24:44.511437+0000","last_peered":"2024-09-21T03:24:44.511437+0000","last_clean":"2024-09-21T03:24:44.511437+0000","last_became_active":"2024-09-21T03:14:38.483975+0000","last_became_peered":"2024-09-21T03:14:38.483975+0000","last_unstale":"2024-09-21T03:24:44.511437+0000","last_undegraded":"2024-09-21T03:24:44.511437+0000","last_fullsized":"2024-09-21T03:24:44.511437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3827,"log_dups_size":0,"ondisk_log_size":3827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:31.145431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56663,"num_write_kb":721573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"27'3391","reported_seq":3412,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.350778+0000","last_change":"2024-09-21T03:14:47.566252+0000","last_active":"2024-09-21T03:24:45.350778+0000","last_peered":"2024-09-21T03:24:45.350778+0000","last_clean":"2024-09-21T03:24:45.350778+0000","last_became_active":"2024-09-21T03:14:47.560282+0000","last_became_peered":"2024-09-21T03:14:47.560282+0000","last_unstale":"2024-09-21T03:24:45.350778+0000","last_undegraded":"2024-09-21T03:24:45.350778+0000","last_fullsized":"2024-09-21T03:24:45.350778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3391,"log_dups_size":0,"ondisk_log_size":3391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:23.553847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49276,"num_write_kb":506666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"27'3197","reported_seq":3226,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.520108+0000","last_change":"2024-09-21T03:14:38.477183+0000","last_active":"2024-09-21T03:24:44.520108+0000","last_peered":"2024-09-21T03:24:44.520108+0000","last_clean":"2024-09-21T03:24:44.520108+0000","last_became_active":"2024-09-21T03:14:38.476657+0000","last_became_peered":"2024-09-21T03:14:38.476657+0000","last_unstale":"2024-09-21T03:24:44.520108+0000","last_undegraded":"2024-09-21T03:24:44.520108+0000","last_fullsized":"2024-09-21T03:24:44.520108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3197,"log_dups_size":0,"ondisk_log_size":3197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:36.801764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47236,"num_write_kb":609124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"27'2689","reported_seq":2710,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.343743+0000","last_change":"2024-09-21T03:14:47.574339+0000","last_active":"2024-09-21T03:24:45.343743+0000","last_peered":"2024-09-21T03:24:45.343743+0000","last_clean":"2024-09-21T03:24:45.343743+0000","last_became_active":"2024-09-21T03:14:47.565732+0000","last_became_peered":"2024-09-21T03:14:47.565732+0000","last_unstale":"2024-09-21T03:24:45.343743+0000","last_undegraded":"2024-09-21T03:24:45.343743+0000","last_fullsized":"2024-09-21T03:24:45.343743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2689,"log_dups_size":0,"ondisk_log_size":2689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:57.896810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39100,"num_write_kb":400538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'3540","reported_seq":3569,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.510055+0000","last_change":"2024-09-21T03:14:38.472860+0000","last_active":"2024-09-21T03:24:44.510055+0000","last_peered":"2024-09-21T03:24:44.510055+0000","last_clean":"2024-09-21T03:24:44.510055+0000","last_became_active":"2024-09-21T03:14:38.472548+0000","last_became_peered":"2024-09-21T03:14:38.472548+0000","last_unstale":"2024-09-21T03:24:44.510055+0000","last_undegraded":"2024-09-21T03:24:44.510055+0000","last_fullsized":"2024-09-21T03:24:44.510055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3540,"log_dups_size":0,"ondisk_log_size":3540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:16.071692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52273,"num_write_kb":690147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"27'3152","reported_seq":3173,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.268948+0000","last_change":"2024-09-21T03:14:47.557402+0000","last_active":"2024-09-21T03:24:45.268948+0000","last_peered":"2024-09-21T03:24:45.268948+0000","last_clean":"2024-09-21T03:24:45.268948+0000","last_became_active":"2024-09-21T03:14:47.557047+0000","last_became_peered":"2024-09-21T03:14:47.557047+0000","last_unstale":"2024-09-21T03:24:45.268948+0000","last_undegraded":"2024-09-21T03:24:45.268948+0000","last_fullsized":"2024-09-21T03:24:45.268948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3152,"log_dups_size":0,"ondisk_log_size":3152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:29.792514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46003,"num_write_kb":479339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'2575","reported_seq":2604,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.502864+0000","last_change":"2024-09-21T03:14:38.481039+0000","last_active":"2024-09-21T03:24:44.502864+0000","last_peered":"2024-09-21T03:24:44.502864+0000","last_clean":"2024-09-21T03:24:44.502864+0000","last_became_active":"2024-09-21T03:14:38.480686+0000","last_became_peered":"2024-09-21T03:14:38.480686+0000","last_unstale":"2024-09-21T03:24:44.502864+0000","last_undegraded":"2024-09-21T03:24:44.502864+0000","last_fullsized":"2024-09-21T03:24:44.502864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2575,"log_dups_size":0,"ondisk_log_size":2575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:18.603386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37971,"num_write_kb":494263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"27'3601","reported_seq":3622,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.293618+0000","last_change":"2024-09-21T03:14:47.565697+0000","last_active":"2024-09-21T03:24:45.293618+0000","last_peered":"2024-09-21T03:24:45.293618+0000","last_clean":"2024-09-21T03:24:45.293618+0000","last_became_active":"2024-09-21T03:14:47.565393+0000","last_became_peered":"2024-09-21T03:14:47.565393+0000","last_unstale":"2024-09-21T03:24:45.293618+0000","last_undegraded":"2024-09-21T03:24:45.293618+0000","last_fullsized":"2024-09-21T03:24:45.293618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3601,"log_dups_size":0,"ondisk_log_size":3601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:35.421803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52343,"num_write_kb":533323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'2833","reported_seq":2862,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.526047+0000","last_change":"2024-09-21T03:14:38.473900+0000","last_active":"2024-09-21T03:24:44.526047+0000","last_peered":"2024-09-21T03:24:44.526047+0000","last_clean":"2024-09-21T03:24:44.526047+0000","last_became_active":"2024-09-21T03:14:38.471325+0000","last_became_peered":"2024-09-21T03:14:38.471325+0000","last_unstale":"2024-09-21T03:24:44.526047+0000","last_undegraded":"2024-09-21T03:24:44.526047+0000","last_fullsized":"2024-09-21T03:24:44.526047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2833,"log_dups_size":0,"ondisk_log_size":2833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:47.556293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41957,"num_write_kb":531654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"27'2584","reported_seq":2611,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.304489+0000","last_change":"2024-09-21T03:15:15.685059+0000","last_active":"2024-09-21T03:24:45.304489+0000","last_peered":"2024-09-21T03:24:45.304489+0000","last_clean":"2024-09-21T03:24:45.304489+0000","last_became_active":"2024-09-21T03:15:15.684633+0000","last_became_peered":"2024-09-21T03:15:15.684633+0000","last_unstale":"2024-09-21T03:24:45.304489+0000","last_undegraded":"2024-09-21T03:24:45.304489+0000","last_fullsized":"2024-09-21T03:24:45.304489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2584,"log_dups_size":0,"ondisk_log_size":2584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:22.251366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37382,"num_write_kb":380663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"27'3218","reported_seq":3247,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.489940+0000","last_change":"2024-09-21T03:14:38.478099+0000","last_active":"2024-09-21T03:24:44.489940+0000","last_peered":"2024-09-21T03:24:44.489940+0000","last_clean":"2024-09-21T03:24:44.489940+0000","last_became_active":"2024-09-21T03:14:38.475894+0000","last_became_peered":"2024-09-21T03:14:38.475894+0000","last_unstale":"2024-09-21T03:24:44.489940+0000","last_undegraded":"2024-09-21T03:24:44.489940+0000","last_fullsized":"2024-09-21T03:24:44.489940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3218,"log_dups_size":0,"ondisk_log_size":3218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:49.876430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47546,"num_write_kb":620007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"27'3720","reported_seq":3741,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.326932+0000","last_change":"2024-09-21T03:14:47.556933+0000","last_active":"2024-09-21T03:24:45.326932+0000","last_peered":"2024-09-21T03:24:45.326932+0000","last_clean":"2024-09-21T03:24:45.326932+0000","last_became_active":"2024-09-21T03:14:47.556615+0000","last_became_peered":"2024-09-21T03:14:47.556615+0000","last_unstale":"2024-09-21T03:24:45.326932+0000","last_undegraded":"2024-09-21T03:24:45.326932+0000","last_fullsized":"2024-09-21T03:24:45.326932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3720,"log_dups_size":0,"ondisk_log_size":3720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:27.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54133,"num_write_kb":557757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"27'2798","reported_seq":2827,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.581889+0000","last_change":"2024-09-21T03:14:38.484198+0000","last_active":"2024-09-21T03:24:44.581889+0000","last_peered":"2024-09-21T03:24:44.581889+0000","last_clean":"2024-09-21T03:24:44.581889+0000","last_became_active":"2024-09-21T03:14:38.483893+0000","last_became_peered":"2024-09-21T03:14:38.483893+0000","last_unstale":"2024-09-21T03:24:44.581889+0000","last_undegraded":"2024-09-21T03:24:44.581889+0000","last_fullsized":"2024-09-21T03:24:44.581889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2798,"log_dups_size":0,"ondisk_log_size":2798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:56.665359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41301,"num_write_kb":515809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"27'3224","reported_seq":3245,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.326679+0000","last_change":"2024-09-21T03:14:47.553479+0000","last_active":"2024-09-21T03:24:45.326679+0000","last_peered":"2024-09-21T03:24:45.326679+0000","last_clean":"2024-09-21T03:24:45.326679+0000","last_became_active":"2024-09-21T03:14:47.553144+0000","last_became_peered":"2024-09-21T03:14:47.553144+0000","last_unstale":"2024-09-21T03:24:45.326679+0000","last_undegraded":"2024-09-21T03:24:45.326679+0000","last_fullsized":"2024-09-21T03:24:45.326679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3224,"log_dups_size":0,"ondisk_log_size":3224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:26.321488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46752,"num_write_kb":476180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'3507","reported_seq":3536,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.533411+0000","last_change":"2024-09-21T03:14:38.487093+0000","last_active":"2024-09-21T03:24:44.533411+0000","last_peered":"2024-09-21T03:24:44.533411+0000","last_clean":"2024-09-21T03:24:44.533411+0000","last_became_active":"2024-09-21T03:14:38.486204+0000","last_became_peered":"2024-09-21T03:14:38.486204+0000","last_unstale":"2024-09-21T03:24:44.533411+0000","last_undegraded":"2024-09-21T03:24:44.533411+0000","last_fullsized":"2024-09-21T03:24:44.533411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3507,"log_dups_size":0,"ondisk_log_size":3507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:55.531046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51770,"num_write_kb":667306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"27'2354","reported_seq":2375,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.342291+0000","last_change":"2024-09-21T03:14:47.573375+0000","last_active":"2024-09-21T03:24:45.342291+0000","last_peered":"2024-09-21T03:24:45.342291+0000","last_clean":"2024-09-21T03:24:45.342291+0000","last_became_active":"2024-09-21T03:14:47.572717+0000","last_became_peered":"2024-09-21T03:14:47.572717+0000","last_unstale":"2024-09-21T03:24:45.342291+0000","last_undegraded":"2024-09-21T03:24:45.342291+0000","last_fullsized":"2024-09-21T03:24:45.342291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2354,"log_dups_size":0,"ondisk_log_size":2354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:44.673283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33818,"num_write_kb":353403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"27'2611","reported_seq":2640,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.540526+0000","last_change":"2024-09-21T03:14:38.471959+0000","last_active":"2024-09-21T03:24:44.540526+0000","last_peered":"2024-09-21T03:24:44.540526+0000","last_clean":"2024-09-21T03:24:44.540526+0000","last_became_active":"2024-09-21T03:14:38.471625+0000","last_became_peered":"2024-09-21T03:14:38.471625+0000","last_unstale":"2024-09-21T03:24:44.540526+0000","last_undegraded":"2024-09-21T03:24:44.540526+0000","last_fullsized":"2024-09-21T03:24:44.540526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2611,"log_dups_size":0,"ondisk_log_size":2611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:17.761951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38420,"num_write_kb":499975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"27'3517","reported_seq":3538,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.318484+0000","last_change":"2024-09-21T03:14:47.564597+0000","last_active":"2024-09-21T03:24:45.318484+0000","last_peered":"2024-09-21T03:24:45.318484+0000","last_clean":"2024-09-21T03:24:45.318484+0000","last_became_active":"2024-09-21T03:14:47.563816+0000","last_became_peered":"2024-09-21T03:14:47.563816+0000","last_unstale":"2024-09-21T03:24:45.318484+0000","last_undegraded":"2024-09-21T03:24:45.318484+0000","last_fullsized":"2024-09-21T03:24:45.318484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3517,"log_dups_size":0,"ondisk_log_size":3517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:33.061271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50894,"num_write_kb":526303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'3043","reported_seq":3072,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.530608+0000","last_change":"2024-09-21T03:14:38.491888+0000","last_active":"2024-09-21T03:24:44.530608+0000","last_peered":"2024-09-21T03:24:44.530608+0000","last_clean":"2024-09-21T03:24:44.530608+0000","last_became_active":"2024-09-21T03:14:38.491510+0000","last_became_peered":"2024-09-21T03:14:38.491510+0000","last_unstale":"2024-09-21T03:24:44.530608+0000","last_undegraded":"2024-09-21T03:24:44.530608+0000","last_fullsized":"2024-09-21T03:24:44.530608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3043,"log_dups_size":0,"ondisk_log_size":3043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:26.740304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44704,"num_write_kb":573613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"27'2899","reported_seq":2920,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.335427+0000","last_change":"2024-09-21T03:14:47.564310+0000","last_active":"2024-09-21T03:24:45.335427+0000","last_peered":"2024-09-21T03:24:45.335427+0000","last_clean":"2024-09-21T03:24:45.335427+0000","last_became_active":"2024-09-21T03:14:47.564003+0000","last_became_peered":"2024-09-21T03:14:47.564003+0000","last_unstale":"2024-09-21T03:24:45.335427+0000","last_undegraded":"2024-09-21T03:24:45.335427+0000","last_fullsized":"2024-09-21T03:24:45.335427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2899,"log_dups_size":0,"ondisk_log_size":2899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:45.016321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42050,"num_write_kb":436747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"27'3507","reported_seq":3536,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.499180+0000","last_change":"2024-09-21T03:14:38.470991+0000","last_active":"2024-09-21T03:24:44.499180+0000","last_peered":"2024-09-21T03:24:44.499180+0000","last_clean":"2024-09-21T03:24:44.499180+0000","last_became_active":"2024-09-21T03:14:38.470666+0000","last_became_peered":"2024-09-21T03:14:38.470666+0000","last_unstale":"2024-09-21T03:24:44.499180+0000","last_undegraded":"2024-09-21T03:24:44.499180+0000","last_fullsized":"2024-09-21T03:24:44.499180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3507,"log_dups_size":0,"ondisk_log_size":3507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:25.477992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51813,"num_write_kb":639602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"27'2979","reported_seq":3000,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.306052+0000","last_change":"2024-09-21T03:14:47.575212+0000","last_active":"2024-09-21T03:24:45.306052+0000","last_peered":"2024-09-21T03:24:45.306052+0000","last_clean":"2024-09-21T03:24:45.306052+0000","last_became_active":"2024-09-21T03:14:47.574895+0000","last_became_peered":"2024-09-21T03:14:47.574895+0000","last_unstale":"2024-09-21T03:24:45.306052+0000","last_undegraded":"2024-09-21T03:24:45.306052+0000","last_fullsized":"2024-09-21T03:24:45.306052+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2979,"log_dups_size":0,"ondisk_log_size":2979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:04.240949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43060,"num_write_kb":442689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"27'2924","reported_seq":2953,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.506322+0000","last_change":"2024-09-21T03:14:38.482681+0000","last_active":"2024-09-21T03:24:44.506322+0000","last_peered":"2024-09-21T03:24:44.506322+0000","last_clean":"2024-09-21T03:24:44.506322+0000","last_became_active":"2024-09-21T03:14:38.477816+0000","last_became_peered":"2024-09-21T03:14:38.477816+0000","last_unstale":"2024-09-21T03:24:44.506322+0000","last_undegraded":"2024-09-21T03:24:44.506322+0000","last_fullsized":"2024-09-21T03:24:44.506322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2924,"log_dups_size":0,"ondisk_log_size":2924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:18.675641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42673,"num_write_kb":583298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"27'3308","reported_seq":3329,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.339081+0000","last_change":"2024-09-21T03:14:47.555329+0000","last_active":"2024-09-21T03:24:45.339081+0000","last_peered":"2024-09-21T03:24:45.339081+0000","last_clean":"2024-09-21T03:24:45.339081+0000","last_became_active":"2024-09-21T03:14:47.555033+0000","last_became_peered":"2024-09-21T03:14:47.555033+0000","last_unstale":"2024-09-21T03:24:45.339081+0000","last_undegraded":"2024-09-21T03:24:45.339081+0000","last_fullsized":"2024-09-21T03:24:45.339081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3308,"log_dups_size":0,"ondisk_log_size":3308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:49.060834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48400,"num_write_kb":492898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"27'3018","reported_seq":3047,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.545961+0000","last_change":"2024-09-21T03:14:38.480638+0000","last_active":"2024-09-21T03:24:44.545961+0000","last_peered":"2024-09-21T03:24:44.545961+0000","last_clean":"2024-09-21T03:24:44.545961+0000","last_became_active":"2024-09-21T03:14:38.477739+0000","last_became_peered":"2024-09-21T03:14:38.477739+0000","last_unstale":"2024-09-21T03:24:44.545961+0000","last_undegraded":"2024-09-21T03:24:44.545961+0000","last_fullsized":"2024-09-21T03:24:44.545961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3018,"log_dups_size":0,"ondisk_log_size":3018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:35.097761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44651,"num_write_kb":569943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"27'3055","reported_seq":3076,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.339299+0000","last_change":"2024-09-21T03:14:47.573659+0000","last_active":"2024-09-21T03:24:45.339299+0000","last_peered":"2024-09-21T03:24:45.339299+0000","last_clean":"2024-09-21T03:24:45.339299+0000","last_became_active":"2024-09-21T03:14:47.572756+0000","last_became_peered":"2024-09-21T03:14:47.572756+0000","last_unstale":"2024-09-21T03:24:45.339299+0000","last_undegraded":"2024-09-21T03:24:45.339299+0000","last_fullsized":"2024-09-21T03:24:45.339299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3055,"log_dups_size":0,"ondisk_log_size":3055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:21.986681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44174,"num_write_kb":452226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'3124","reported_seq":3157,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.556636+0000","last_change":"2024-09-21T03:19:03.558825+0000","last_active":"2024-09-21T03:24:44.556636+0000","last_peered":"2024-09-21T03:24:44.556636+0000","last_clean":"2024-09-21T03:24:44.556636+0000","last_became_active":"2024-09-21T03:14:38.473843+0000","last_became_peered":"2024-09-21T03:14:38.473843+0000","last_unstale":"2024-09-21T03:24:44.556636+0000","last_undegraded":"2024-09-21T03:24:44.556636+0000","last_fullsized":"2024-09-21T03:24:44.556636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3124,"log_dups_size":0,"ondisk_log_size":3124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:27.072406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46022,"num_write_kb":573473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"27'2638","reported_seq":2659,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.342961+0000","last_change":"2024-09-21T03:14:47.555386+0000","last_active":"2024-09-21T03:24:45.342961+0000","last_peered":"2024-09-21T03:24:45.342961+0000","last_clean":"2024-09-21T03:24:45.342961+0000","last_became_active":"2024-09-21T03:14:47.554758+0000","last_became_peered":"2024-09-21T03:14:47.554758+0000","last_unstale":"2024-09-21T03:24:45.342961+0000","last_undegraded":"2024-09-21T03:24:45.342961+0000","last_fullsized":"2024-09-21T03:24:45.342961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2638,"log_dups_size":0,"ondisk_log_size":2638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:47.574672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38196,"num_write_kb":393191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"27'2530","reported_seq":2559,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.557520+0000","last_change":"2024-09-21T03:14:38.494878+0000","last_active":"2024-09-21T03:24:44.557520+0000","last_peered":"2024-09-21T03:24:44.557520+0000","last_clean":"2024-09-21T03:24:44.557520+0000","last_became_active":"2024-09-21T03:14:38.492813+0000","last_became_peered":"2024-09-21T03:14:38.492813+0000","last_unstale":"2024-09-21T03:24:44.557520+0000","last_undegraded":"2024-09-21T03:24:44.557520+0000","last_fullsized":"2024-09-21T03:24:44.557520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2530,"log_dups_size":0,"ondisk_log_size":2530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:55.064844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37062,"num_write_kb":456367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"27'2967","reported_seq":2988,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.320547+0000","last_change":"2024-09-21T03:14:47.544806+0000","last_active":"2024-09-21T03:24:45.320547+0000","last_peered":"2024-09-21T03:24:45.320547+0000","last_clean":"2024-09-21T03:24:45.320547+0000","last_became_active":"2024-09-21T03:14:47.544431+0000","last_became_peered":"2024-09-21T03:14:47.544431+0000","last_unstale":"2024-09-21T03:24:45.320547+0000","last_undegraded":"2024-09-21T03:24:45.320547+0000","last_fullsized":"2024-09-21T03:24:45.320547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2967,"log_dups_size":0,"ondisk_log_size":2967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:01.463573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43240,"num_write_kb":437209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"27'3820","reported_seq":3849,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.584094+0000","last_change":"2024-09-21T03:14:38.474462+0000","last_active":"2024-09-21T03:24:44.584094+0000","last_peered":"2024-09-21T03:24:44.584094+0000","last_clean":"2024-09-21T03:24:44.584094+0000","last_became_active":"2024-09-21T03:14:38.474156+0000","last_became_peered":"2024-09-21T03:14:38.474156+0000","last_unstale":"2024-09-21T03:24:44.584094+0000","last_undegraded":"2024-09-21T03:24:44.584094+0000","last_fullsized":"2024-09-21T03:24:44.584094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3820,"log_dups_size":0,"ondisk_log_size":3820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:55.329945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56526,"num_write_kb":700246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"27'3385","reported_seq":3406,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.368613+0000","last_change":"2024-09-21T03:14:47.563297+0000","last_active":"2024-09-21T03:24:45.368613+0000","last_peered":"2024-09-21T03:24:45.368613+0000","last_clean":"2024-09-21T03:24:45.368613+0000","last_became_active":"2024-09-21T03:14:47.562519+0000","last_became_peered":"2024-09-21T03:14:47.562519+0000","last_unstale":"2024-09-21T03:24:45.368613+0000","last_undegraded":"2024-09-21T03:24:45.368613+0000","last_fullsized":"2024-09-21T03:24:45.368613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3385,"log_dups_size":0,"ondisk_log_size":3385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:47.959373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49240,"num_write_kb":516390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"27'2621","reported_seq":2650,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.552070+0000","last_change":"2024-09-21T03:14:38.474262+0000","last_active":"2024-09-21T03:24:44.552070+0000","last_peered":"2024-09-21T03:24:44.552070+0000","last_clean":"2024-09-21T03:24:44.552070+0000","last_became_active":"2024-09-21T03:14:38.473856+0000","last_became_peered":"2024-09-21T03:14:38.473856+0000","last_unstale":"2024-09-21T03:24:44.552070+0000","last_undegraded":"2024-09-21T03:24:44.552070+0000","last_fullsized":"2024-09-21T03:24:44.552070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2621,"log_dups_size":0,"ondisk_log_size":2621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38668,"num_write_kb":516995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"27'3697","reported_seq":3718,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.352816+0000","last_change":"2024-09-21T03:14:47.558732+0000","last_active":"2024-09-21T03:24:45.352816+0000","last_peered":"2024-09-21T03:24:45.352816+0000","last_clean":"2024-09-21T03:24:45.352816+0000","last_became_active":"2024-09-21T03:14:47.558403+0000","last_became_peered":"2024-09-21T03:14:47.558403+0000","last_unstale":"2024-09-21T03:24:45.352816+0000","last_undegraded":"2024-09-21T03:24:45.352816+0000","last_fullsized":"2024-09-21T03:24:45.352816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3697,"log_dups_size":0,"ondisk_log_size":3697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:46.054565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53973,"num_write_kb":552799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"27'3262","reported_seq":3291,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.523225+0000","last_change":"2024-09-21T03:14:38.469736+0000","last_active":"2024-09-21T03:24:44.523225+0000","last_peered":"2024-09-21T03:24:44.523225+0000","last_clean":"2024-09-21T03:24:44.523225+0000","last_became_active":"2024-09-21T03:14:38.469240+0000","last_became_peered":"2024-09-21T03:14:38.469240+0000","last_unstale":"2024-09-21T03:24:44.523225+0000","last_undegraded":"2024-09-21T03:24:44.523225+0000","last_fullsized":"2024-09-21T03:24:44.523225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3262,"log_dups_size":0,"ondisk_log_size":3262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:04.258761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48009,"num_write_kb":600153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"27'2369","reported_seq":2390,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.327627+0000","last_change":"2024-09-21T03:14:47.550684+0000","last_active":"2024-09-21T03:24:45.327627+0000","last_peered":"2024-09-21T03:24:45.327627+0000","last_clean":"2024-09-21T03:24:45.327627+0000","last_became_active":"2024-09-21T03:14:47.550375+0000","last_became_peered":"2024-09-21T03:14:47.550375+0000","last_unstale":"2024-09-21T03:24:45.327627+0000","last_undegraded":"2024-09-21T03:24:45.327627+0000","last_fullsized":"2024-09-21T03:24:45.327627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2369,"log_dups_size":0,"ondisk_log_size":2369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:05.268160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34335,"num_write_kb":360179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'3448","reported_seq":3477,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.462241+0000","last_change":"2024-09-21T03:14:38.487983+0000","last_active":"2024-09-21T03:24:44.462241+0000","last_peered":"2024-09-21T03:24:44.462241+0000","last_clean":"2024-09-21T03:24:44.462241+0000","last_became_active":"2024-09-21T03:14:38.487676+0000","last_became_peered":"2024-09-21T03:14:38.487676+0000","last_unstale":"2024-09-21T03:24:44.462241+0000","last_undegraded":"2024-09-21T03:24:44.462241+0000","last_fullsized":"2024-09-21T03:24:44.462241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3448,"log_dups_size":0,"ondisk_log_size":3448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:35.320169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50832,"num_write_kb":624952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"27'2810","reported_seq":2837,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.354509+0000","last_change":"2024-09-21T03:19:03.558582+0000","last_active":"2024-09-21T03:24:45.354509+0000","last_peered":"2024-09-21T03:24:45.354509+0000","last_clean":"2024-09-21T03:24:45.354509+0000","last_became_active":"2024-09-21T03:14:47.561229+0000","last_became_peered":"2024-09-21T03:14:47.561229+0000","last_unstale":"2024-09-21T03:24:45.354509+0000","last_undegraded":"2024-09-21T03:24:45.354509+0000","last_fullsized":"2024-09-21T03:24:45.354509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2810,"log_dups_size":0,"ondisk_log_size":2810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:07.280356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40720,"num_write_kb":419729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"27'2665","reported_seq":2694,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.536888+0000","last_change":"2024-09-21T03:14:38.478853+0000","last_active":"2024-09-21T03:24:44.536888+0000","last_peered":"2024-09-21T03:24:44.536888+0000","last_clean":"2024-09-21T03:24:44.536888+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:24:44.536888+0000","last_undegraded":"2024-09-21T03:24:44.536888+0000","last_fullsized":"2024-09-21T03:24:44.536888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2665,"log_dups_size":0,"ondisk_log_size":2665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:31.427596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39018,"num_write_kb":519966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"27'3118","reported_seq":3133,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.314578+0000","last_change":"2024-09-21T03:15:15.686915+0000","last_active":"2024-09-21T03:24:45.314578+0000","last_peered":"2024-09-21T03:24:45.314578+0000","last_clean":"2024-09-21T03:24:45.314578+0000","last_became_active":"2024-09-21T03:15:15.686514+0000","last_became_peered":"2024-09-21T03:15:15.686514+0000","last_unstale":"2024-09-21T03:24:45.314578+0000","last_undegraded":"2024-09-21T03:24:45.314578+0000","last_fullsized":"2024-09-21T03:24:45.314578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3118,"log_dups_size":0,"ondisk_log_size":3118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:46.388388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45367,"num_write_kb":462728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'2758","reported_seq":2787,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.545827+0000","last_change":"2024-09-21T03:14:38.481308+0000","last_active":"2024-09-21T03:24:44.545827+0000","last_peered":"2024-09-21T03:24:44.545827+0000","last_clean":"2024-09-21T03:24:44.545827+0000","last_became_active":"2024-09-21T03:14:38.480923+0000","last_became_peered":"2024-09-21T03:14:38.480923+0000","last_unstale":"2024-09-21T03:24:44.545827+0000","last_undegraded":"2024-09-21T03:24:44.545827+0000","last_fullsized":"2024-09-21T03:24:44.545827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2758,"log_dups_size":0,"ondisk_log_size":2758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:40.689231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40836,"num_write_kb":498819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"27'2757","reported_seq":2778,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.341206+0000","last_change":"2024-09-21T03:14:47.561972+0000","last_active":"2024-09-21T03:24:45.341206+0000","last_peered":"2024-09-21T03:24:45.341206+0000","last_clean":"2024-09-21T03:24:45.341206+0000","last_became_active":"2024-09-21T03:14:47.561645+0000","last_became_peered":"2024-09-21T03:14:47.561645+0000","last_unstale":"2024-09-21T03:24:45.341206+0000","last_undegraded":"2024-09-21T03:24:45.341206+0000","last_fullsized":"2024-09-21T03:24:45.341206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2757,"log_dups_size":0,"ondisk_log_size":2757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:57.526787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40136,"num_write_kb":410250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"27'2791","reported_seq":2820,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.537487+0000","last_change":"2024-09-21T03:14:38.473907+0000","last_active":"2024-09-21T03:24:44.537487+0000","last_peered":"2024-09-21T03:24:44.537487+0000","last_clean":"2024-09-21T03:24:44.537487+0000","last_became_active":"2024-09-21T03:14:38.473579+0000","last_became_peered":"2024-09-21T03:14:38.473579+0000","last_unstale":"2024-09-21T03:24:44.537487+0000","last_undegraded":"2024-09-21T03:24:44.537487+0000","last_fullsized":"2024-09-21T03:24:44.537487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2791,"log_dups_size":0,"ondisk_log_size":2791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:32.273503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41232,"num_write_kb":540257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"27'2621","reported_seq":2642,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.300722+0000","last_change":"2024-09-21T03:14:47.566089+0000","last_active":"2024-09-21T03:24:45.300722+0000","last_peered":"2024-09-21T03:24:45.300722+0000","last_clean":"2024-09-21T03:24:45.300722+0000","last_became_active":"2024-09-21T03:14:47.565681+0000","last_became_peered":"2024-09-21T03:14:47.565681+0000","last_unstale":"2024-09-21T03:24:45.300722+0000","last_undegraded":"2024-09-21T03:24:45.300722+0000","last_fullsized":"2024-09-21T03:24:45.300722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2621,"log_dups_size":0,"ondisk_log_size":2621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.208933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37892,"num_write_kb":397863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'3465","reported_seq":3494,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.561747+0000","last_change":"2024-09-21T03:14:38.474326+0000","last_active":"2024-09-21T03:24:44.561747+0000","last_peered":"2024-09-21T03:24:44.561747+0000","last_clean":"2024-09-21T03:24:44.561747+0000","last_became_active":"2024-09-21T03:14:38.470430+0000","last_became_peered":"2024-09-21T03:14:38.470430+0000","last_unstale":"2024-09-21T03:24:44.561747+0000","last_undegraded":"2024-09-21T03:24:44.561747+0000","last_fullsized":"2024-09-21T03:24:44.561747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3465,"log_dups_size":0,"ondisk_log_size":3465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:09.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51200,"num_write_kb":673726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"27'2995","reported_seq":3016,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.287299+0000","last_change":"2024-09-21T03:14:47.571487+0000","last_active":"2024-09-21T03:24:45.287299+0000","last_peered":"2024-09-21T03:24:45.287299+0000","last_clean":"2024-09-21T03:24:45.287299+0000","last_became_active":"2024-09-21T03:14:47.571126+0000","last_became_peered":"2024-09-21T03:14:47.571126+0000","last_unstale":"2024-09-21T03:24:45.287299+0000","last_undegraded":"2024-09-21T03:24:45.287299+0000","last_fullsized":"2024-09-21T03:24:45.287299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2995,"log_dups_size":0,"ondisk_log_size":2995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:57.128853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43649,"num_write_kb":455041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'4015","reported_seq":4044,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.555332+0000","last_change":"2024-09-21T03:14:38.483370+0000","last_active":"2024-09-21T03:24:44.555332+0000","last_peered":"2024-09-21T03:24:44.555332+0000","last_clean":"2024-09-21T03:24:44.555332+0000","last_became_active":"2024-09-21T03:14:38.483019+0000","last_became_peered":"2024-09-21T03:14:38.483019+0000","last_unstale":"2024-09-21T03:24:44.555332+0000","last_undegraded":"2024-09-21T03:24:44.555332+0000","last_fullsized":"2024-09-21T03:24:44.555332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:55.085422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59359,"num_write_kb":743455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"27'3951","reported_seq":3972,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.348230+0000","last_change":"2024-09-21T03:14:47.555777+0000","last_active":"2024-09-21T03:24:45.348230+0000","last_peered":"2024-09-21T03:24:45.348230+0000","last_clean":"2024-09-21T03:24:45.348230+0000","last_became_active":"2024-09-21T03:14:47.555465+0000","last_became_peered":"2024-09-21T03:14:47.555465+0000","last_unstale":"2024-09-21T03:24:45.348230+0000","last_undegraded":"2024-09-21T03:24:45.348230+0000","last_fullsized":"2024-09-21T03:24:45.348230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3951,"log_dups_size":0,"ondisk_log_size":3951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:27.123740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57951,"num_write_kb":584164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"27'3369","reported_seq":3398,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.537637+0000","last_change":"2024-09-21T03:14:38.465771+0000","last_active":"2024-09-21T03:24:44.537637+0000","last_peered":"2024-09-21T03:24:44.537637+0000","last_clean":"2024-09-21T03:24:44.537637+0000","last_became_active":"2024-09-21T03:14:38.465479+0000","last_became_peered":"2024-09-21T03:14:38.465479+0000","last_unstale":"2024-09-21T03:24:44.537637+0000","last_undegraded":"2024-09-21T03:24:44.537637+0000","last_fullsized":"2024-09-21T03:24:44.537637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3369,"log_dups_size":0,"ondisk_log_size":3369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.754315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50038,"num_write_kb":621750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"27'2525","reported_seq":2546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.263614+0000","last_change":"2024-09-21T03:14:47.567695+0000","last_active":"2024-09-21T03:24:45.263614+0000","last_peered":"2024-09-21T03:24:45.263614+0000","last_clean":"2024-09-21T03:24:45.263614+0000","last_became_active":"2024-09-21T03:14:47.566936+0000","last_became_peered":"2024-09-21T03:14:47.566936+0000","last_unstale":"2024-09-21T03:24:45.263614+0000","last_undegraded":"2024-09-21T03:24:45.263614+0000","last_fullsized":"2024-09-21T03:24:45.263614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2525,"log_dups_size":0,"ondisk_log_size":2525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:48.182523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36538,"num_write_kb":381931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"27'2958","reported_seq":2972,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.489259+0000","last_change":"2024-09-21T03:15:15.807206+0000","last_active":"2024-09-21T03:24:44.489259+0000","last_peered":"2024-09-21T03:24:44.489259+0000","last_clean":"2024-09-21T03:24:44.489259+0000","last_became_active":"2024-09-21T03:15:15.806775+0000","last_became_peered":"2024-09-21T03:15:15.806775+0000","last_unstale":"2024-09-21T03:24:44.489259+0000","last_undegraded":"2024-09-21T03:24:44.489259+0000","last_fullsized":"2024-09-21T03:24:44.489259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2958,"log_dups_size":0,"ondisk_log_size":2958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:51.779236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43828,"num_write_kb":561683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"27'2681","reported_seq":2702,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.331920+0000","last_change":"2024-09-21T03:14:47.580314+0000","last_active":"2024-09-21T03:24:45.331920+0000","last_peered":"2024-09-21T03:24:45.331920+0000","last_clean":"2024-09-21T03:24:45.331920+0000","last_became_active":"2024-09-21T03:14:47.576499+0000","last_became_peered":"2024-09-21T03:14:47.576499+0000","last_unstale":"2024-09-21T03:24:45.331920+0000","last_undegraded":"2024-09-21T03:24:45.331920+0000","last_fullsized":"2024-09-21T03:24:45.331920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2681,"log_dups_size":0,"ondisk_log_size":2681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:46.154586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39028,"num_write_kb":398421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2546","reported_seq":2577,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.467976+0000","last_change":"2024-09-21T03:18:52.426898+0000","last_active":"2024-09-21T03:24:44.467976+0000","last_peered":"2024-09-21T03:24:44.467976+0000","last_clean":"2024-09-21T03:24:44.467976+0000","last_became_active":"2024-09-21T03:14:38.470708+0000","last_became_peered":"2024-09-21T03:14:38.470708+0000","last_unstale":"2024-09-21T03:24:44.467976+0000","last_undegraded":"2024-09-21T03:24:44.467976+0000","last_fullsized":"2024-09-21T03:24:44.467976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2546,"log_dups_size":0,"ondisk_log_size":2546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.122804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37433,"num_write_kb":500133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"27'3017","reported_seq":3038,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.328059+0000","last_change":"2024-09-21T03:14:47.554180+0000","last_active":"2024-09-21T03:24:45.328059+0000","last_peered":"2024-09-21T03:24:45.328059+0000","last_clean":"2024-09-21T03:24:45.328059+0000","last_became_active":"2024-09-21T03:14:47.552808+0000","last_became_peered":"2024-09-21T03:14:47.552808+0000","last_unstale":"2024-09-21T03:24:45.328059+0000","last_undegraded":"2024-09-21T03:24:45.328059+0000","last_fullsized":"2024-09-21T03:24:45.328059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3017,"log_dups_size":0,"ondisk_log_size":3017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:07.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43808,"num_write_kb":448579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"27'3592","reported_seq":3621,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.559429+0000","last_change":"2024-09-21T03:14:38.466077+0000","last_active":"2024-09-21T03:24:44.559429+0000","last_peered":"2024-09-21T03:24:44.559429+0000","last_clean":"2024-09-21T03:24:44.559429+0000","last_became_active":"2024-09-21T03:14:38.465818+0000","last_became_peered":"2024-09-21T03:14:38.465818+0000","last_unstale":"2024-09-21T03:24:44.559429+0000","last_undegraded":"2024-09-21T03:24:44.559429+0000","last_fullsized":"2024-09-21T03:24:44.559429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:34.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52996,"num_write_kb":671880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"27'2563","reported_seq":2584,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.328218+0000","last_change":"2024-09-21T03:14:47.577228+0000","last_active":"2024-09-21T03:24:45.328218+0000","last_peered":"2024-09-21T03:24:45.328218+0000","last_clean":"2024-09-21T03:24:45.328218+0000","last_became_active":"2024-09-21T03:14:47.576843+0000","last_became_peered":"2024-09-21T03:14:47.576843+0000","last_unstale":"2024-09-21T03:24:45.328218+0000","last_undegraded":"2024-09-21T03:24:45.328218+0000","last_fullsized":"2024-09-21T03:24:45.328218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2563,"log_dups_size":0,"ondisk_log_size":2563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:56.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37386,"num_write_kb":384305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'2860","reported_seq":2890,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.095639+0000","last_change":"2024-09-21T03:14:38.481389+0000","last_active":"2024-09-21T03:24:45.095639+0000","last_peered":"2024-09-21T03:24:45.095639+0000","last_clean":"2024-09-21T03:24:45.095639+0000","last_became_active":"2024-09-21T03:14:38.470907+0000","last_became_peered":"2024-09-21T03:14:38.470907+0000","last_unstale":"2024-09-21T03:24:45.095639+0000","last_undegraded":"2024-09-21T03:24:45.095639+0000","last_fullsized":"2024-09-21T03:24:45.095639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42241,"num_write_kb":536469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"27'3455","reported_seq":3475,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.317264+0000","last_change":"2024-09-21T03:14:47.551766+0000","last_active":"2024-09-21T03:24:45.317264+0000","last_peered":"2024-09-21T03:24:45.317264+0000","last_clean":"2024-09-21T03:24:45.317264+0000","last_became_active":"2024-09-21T03:14:47.551420+0000","last_became_peered":"2024-09-21T03:14:47.551420+0000","last_unstale":"2024-09-21T03:24:45.317264+0000","last_undegraded":"2024-09-21T03:24:45.317264+0000","last_fullsized":"2024-09-21T03:24:45.317264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3455,"log_dups_size":0,"ondisk_log_size":3455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:56.255472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50161,"num_write_kb":520876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'3215","reported_seq":3246,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.506746+0000","last_change":"2024-09-21T03:19:03.596591+0000","last_active":"2024-09-21T03:24:44.506746+0000","last_peered":"2024-09-21T03:24:44.506746+0000","last_clean":"2024-09-21T03:24:44.506746+0000","last_became_active":"2024-09-21T03:14:38.482306+0000","last_became_peered":"2024-09-21T03:14:38.482306+0000","last_unstale":"2024-09-21T03:24:44.506746+0000","last_undegraded":"2024-09-21T03:24:44.506746+0000","last_fullsized":"2024-09-21T03:24:44.506746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3215,"log_dups_size":0,"ondisk_log_size":3215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:40.482635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47543,"num_write_kb":599147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"27'3010","reported_seq":3031,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.350470+0000","last_change":"2024-09-21T03:14:47.555070+0000","last_active":"2024-09-21T03:24:45.350470+0000","last_peered":"2024-09-21T03:24:45.350470+0000","last_clean":"2024-09-21T03:24:45.350470+0000","last_became_active":"2024-09-21T03:14:47.554363+0000","last_became_peered":"2024-09-21T03:14:47.554363+0000","last_unstale":"2024-09-21T03:24:45.350470+0000","last_undegraded":"2024-09-21T03:24:45.350470+0000","last_fullsized":"2024-09-21T03:24:45.350470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3010,"log_dups_size":0,"ondisk_log_size":3010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:40.027266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43824,"num_write_kb":461158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"27'3736","reported_seq":3765,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.476290+0000","last_change":"2024-09-21T03:14:38.496218+0000","last_active":"2024-09-21T03:24:44.476290+0000","last_peered":"2024-09-21T03:24:44.476290+0000","last_clean":"2024-09-21T03:24:44.476290+0000","last_became_active":"2024-09-21T03:14:38.488537+0000","last_became_peered":"2024-09-21T03:14:38.488537+0000","last_unstale":"2024-09-21T03:24:44.476290+0000","last_undegraded":"2024-09-21T03:24:44.476290+0000","last_fullsized":"2024-09-21T03:24:44.476290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":3736,"log_dups_size":0,"ondisk_log_size":3736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:59.667392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55343,"num_write_kb":720948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"27'2851","reported_seq":2872,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.330815+0000","last_change":"2024-09-21T03:14:47.564250+0000","last_active":"2024-09-21T03:24:45.330815+0000","last_peered":"2024-09-21T03:24:45.330815+0000","last_clean":"2024-09-21T03:24:45.330815+0000","last_became_active":"2024-09-21T03:14:47.563745+0000","last_became_peered":"2024-09-21T03:14:47.563745+0000","last_unstale":"2024-09-21T03:24:45.330815+0000","last_undegraded":"2024-09-21T03:24:45.330815+0000","last_fullsized":"2024-09-21T03:24:45.330815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2851,"log_dups_size":0,"ondisk_log_size":2851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41602,"num_write_kb":429183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"27'2879","reported_seq":2908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:44.572686+0000","last_change":"2024-09-21T03:14:38.490309+0000","last_active":"2024-09-21T03:24:44.572686+0000","last_peered":"2024-09-21T03:24:44.572686+0000","last_clean":"2024-09-21T03:24:44.572686+0000","last_became_active":"2024-09-21T03:14:38.489167+0000","last_became_peered":"2024-09-21T03:14:38.489167+0000","last_unstale":"2024-09-21T03:24:44.572686+0000","last_undegraded":"2024-09-21T03:24:44.572686+0000","last_fullsized":"2024-09-21T03:24:44.572686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:37.438635+0000","last_clean_scrub_stamp":"2024-09-21T03:14:37.438635+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:07.725691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42623,"num_write_kb":515303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2771405,"num_write_kb":28539810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190768,"ondisk_log_size":190768,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":104689166,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":31,"num_read_kb":107,"num_write":3090,"num_write_kb":104327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":209436672,"data_stored":209378332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2754,"ondisk_log_size":2754,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2958225,"num_write_kb":37437445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200348,"ondisk_log_size":200348,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":158268058,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":29,"num_read_kb":105,"num_write":2795,"num_write_kb":156529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":316596224,"data_stored":316536116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2587,"ondisk_log_size":2587,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509568,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379144,"kb_used_data":41336,"kb_used_omap":1,"kb_used_meta":337790,"kb_avail":93992696,"statfs":{"total":96636764160,"available":96248520704,"internally_reserved":0,"allocated":42328064,"data_stored":42145705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":345897418},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509563,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":538640,"kb_used_data":66240,"kb_used_omap":1,"kb_used_meta":472382,"kb_avail":93833200,"statfs":{"total":96636764160,"available":96085196800,"internally_reserved":0,"allocated":67829760,"data_stored":67644340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":483719621},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509562,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":562860,"kb_used_data":84892,"kb_used_omap":1,"kb_used_meta":477950,"kb_avail":93808980,"statfs":{"total":96636764160,"available":96060395520,"internally_reserved":0,"allocated":86929408,"data_stored":86733732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":489421253},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509563,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":616200,"kb_used_data":61816,"kb_used_omap":1,"kb_used_meta":554366,"kb_avail":93755640,"statfs":{"total":96636764160,"available":96005775360,"internally_reserved":0,"allocated":63299584,"data_stored":63117886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":567671237},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509566,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468272,"kb_used_data":54112,"kb_used_omap":1,"kb_used_meta":414142,"kb_avail":93903568,"statfs":{"total":96636764160,"available":96157253632,"internally_reserved":0,"allocated":55410688,"data_stored":55230899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":424081861},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509564,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":592432,"kb_used_data":61728,"kb_used_omap":1,"kb_used_meta":530686,"kb_avail":93779408,"statfs":{"total":96636764160,"available":96030113792,"internally_reserved":0,"allocated":63209472,"data_stored":63029145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":543422917},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,1,21],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542269,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":477548,"kb_used_data":45340,"kb_used_omap":1,"kb_used_meta":432190,"kb_avail":93894292,"statfs":{"total":96636764160,"available":96147755008,"internally_reserved":0,"allocated":46428160,"data_stored":46252455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":442563014},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542267,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":587960,"kb_used_data":101608,"kb_used_omap":1,"kb_used_meta":486334,"kb_avail":93783880,"statfs":{"total":96636764160,"available":96034693120,"internally_reserved":0,"allocated":104046592,"data_stored":103856534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":498006471},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":62922752,"data_stored":62914616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33558528,"data_stored":33554502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65908736,"data_stored":65904402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":44949504,"data_stored":44933644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":37847040,"data_stored":37836908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25264128,"data_stored":25254028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37842944,"data_stored":37836951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37855232,"data_stored":37837693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":41697280,"data_stored":41685649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29106176,"data_stored":29102625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:24:55.837 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.837 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.838 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.838 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.838 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.838 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.838 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.838 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.838 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.838 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.838 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.839 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.839 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.839 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.839 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.839 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.839 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.839 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.839 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.839 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.839 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.840 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.840 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.840 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.840 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.840 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.840 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.840 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.840 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.840 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.840 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.841 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.841 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.841 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.841 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.841 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.841 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.841 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.841 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.841 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.841 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.842 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.842 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.842 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.842 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.842 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.842 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.842 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.842 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.842 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.843 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.843 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.843 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.843 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.843 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.843 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.843 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.843 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.843 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.844 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.844 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.844 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.844 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-21T03:14:25.329650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.844 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.844 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.844 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.844 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.844 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.844 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.845 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.845 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.845 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.845 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.845 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.845 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.845 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.845 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.845 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.846 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.846 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.846 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.846 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.846 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.846 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.846 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.846 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.846 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.846 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.847 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.847 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.847 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.847 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.847 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.847 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.847 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.847 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.847 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.848 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.848 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.848 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.848 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.848 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.848 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.848 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.848 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.848 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.849 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.849 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.849 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.849 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.849 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.849 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.849 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.849 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.849 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.849 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.850 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.850 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.850 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.850 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.850 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.850 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.850 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.850 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.850 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.850 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-21T03:14:36.431393+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.851 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.851 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.851 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.851 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.851 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.851 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.851 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.851 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.851 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.852 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.852 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.852 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.852 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.852 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.852 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.852 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.852 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.852 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.853 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.853 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.853 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.853 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.853 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.853 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.853 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.853 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.853 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.853 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.854 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.854 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.854 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.854 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.854 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.854 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.854 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.854 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.854 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.855 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.855 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.855 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.855 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.855 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.855 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.855 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.855 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.855 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.855 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.856 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.856 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.856 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.856 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.856 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.856 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.856 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.856 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.856 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.856 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.857 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.857 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.857 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.857 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.857 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.857 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.857 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.857 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.857 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-21T03:14:37.438635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:24:55.857 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T03:25:02.987 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:25:02.992 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:25:15.858 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:25:16.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.082+0000 7f29ff400640 1 -- 172.21.15.90:0/1591814241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29f806d960 msgr2=0x7f29f813dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.082+0000 7f29ff400640 1 --2- 172.21.15.90:0/1591814241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29f806d960 0x7f29f813dd40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f29e8005fd0 tx=0x7f29e802a4b0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.082+0000 7f29ff400640 1 -- 172.21.15.90:0/1591814241 shutdown_connections 2024-09-21T03:25:16.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.082+0000 7f29ff400640 1 --2- 172.21.15.90:0/1591814241 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29f8074220 0x7f29f8074630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.082+0000 7f29ff400640 1 --2- 172.21.15.90:0/1591814241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29f806d960 0x7f29f813dd40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.082+0000 7f29ff400640 1 -- 172.21.15.90:0/1591814241 >> 172.21.15.90:0/1591814241 conn(0x7f29f80c8ba0 msgr2=0x7f29f806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:16.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.082+0000 7f29ff400640 1 -- 172.21.15.90:0/1591814241 shutdown_connections 2024-09-21T03:25:16.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.082+0000 7f29ff400640 1 -- 172.21.15.90:0/1591814241 wait complete. 2024-09-21T03:25:16.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.084+0000 7f29ff400640 1 Processor -- start 2024-09-21T03:25:16.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.084+0000 7f29ff400640 1 -- start start 2024-09-21T03:25:16.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.085+0000 7f29ff400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29f806d960 0x7f29f814e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.086+0000 7f29ff400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29f8074220 0x7f29f81586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.086+0000 7f29ff400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29f80ac350 0x7f29f80c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.086+0000 7f29ff400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f29f80ab640 con 0x7f29f806d960 2024-09-21T03:25:16.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.086+0000 7f29ff400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f29f80ab360 con 0x7f29f8074220 2024-09-21T03:25:16.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.086+0000 7f29ff400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f29f80ace70 con 0x7f29f80ac350 2024-09-21T03:25:16.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.086+0000 7f29fca00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29f806d960 0x7f29f814e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.086+0000 7f29fca00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29f806d960 0x7f29f814e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42372/0 (socket says 172.21.15.90:42372) 2024-09-21T03:25:16.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.086+0000 7f29fca00640 1 -- 172.21.15.90:0/1697541472 learned_addr learned my addr 172.21.15.90:0/1697541472 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:25:16.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.086+0000 7f29fd400640 1 --2- 172.21.15.90:0/1697541472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29f80ac350 0x7f29f80c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.086+0000 7f29efe00640 1 --2- 172.21.15.90:0/1697541472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29f8074220 0x7f29f81586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.086+0000 7f29fca00640 1 -- 172.21.15.90:0/1697541472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29f80ac350 msgr2=0x7f29f80c74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.086+0000 7f29fca00640 1 --2- 172.21.15.90:0/1697541472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29f80ac350 0x7f29f80c74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.086+0000 7f29fca00640 1 -- 172.21.15.90:0/1697541472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29f8074220 msgr2=0x7f29f81586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.086+0000 7f29fca00640 1 --2- 172.21.15.90:0/1697541472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29f8074220 0x7f29f81586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.086+0000 7f29fca00640 1 -- 172.21.15.90:0/1697541472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f8158410 con 0x7f29f806d960 2024-09-21T03:25:16.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.087+0000 7f29fca00640 1 --2- 172.21.15.90:0/1697541472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29f806d960 0x7f29f814e810 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f29e80099f0 tx=0x7f29e8003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:16.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.087+0000 7f29f5600640 1 -- 172.21.15.90:0/1697541472 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e803e030 con 0x7f29f806d960 2024-09-21T03:25:16.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.087+0000 7f29f5600640 1 -- 172.21.15.90:0/1697541472 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29e8003e60 con 0x7f29f806d960 2024-09-21T03:25:16.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.087+0000 7f29ff400640 1 -- 172.21.15.90:0/1697541472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f814c910 con 0x7f29f806d960 2024-09-21T03:25:16.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.087+0000 7f29f5600640 1 -- 172.21.15.90:0/1697541472 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8035040 con 0x7f29f806d960 2024-09-21T03:25:16.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.087+0000 7f29ff400640 1 -- 172.21.15.90:0/1697541472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f813d510 con 0x7f29f806d960 2024-09-21T03:25:16.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.088+0000 7f29ff400640 1 -- 172.21.15.90:0/1697541472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f813dd40 con 0x7f29f806d960 2024-09-21T03:25:16.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.089+0000 7f29f5600640 1 -- 172.21.15.90:0/1697541472 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f29e8041030 con 0x7f29f806d960 2024-09-21T03:25:16.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.090+0000 7f29f5600640 1 --2- 172.21.15.90:0/1697541472 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f29d4078b90 0x7f29d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.090+0000 7f29f5600640 1 -- 172.21.15.90:0/1697541472 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f29e80bb780 con 0x7f29f806d960 2024-09-21T03:25:16.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.091+0000 7f29efe00640 1 --2- 172.21.15.90:0/1697541472 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f29d4078b90 0x7f29d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.091+0000 7f29efe00640 1 --2- 172.21.15.90:0/1697541472 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f29d4078b90 0x7f29d407b0a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f29f80c3e00 tx=0x7f29e0009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:16.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.095+0000 7f29f5600640 1 -- 172.21.15.90:0/1697541472 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f29f813e280 con 0x7f29f806d960 2024-09-21T03:25:16.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.278+0000 7f29ff400640 1 -- 172.21.15.90:0/1697541472 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29f8076d70 con 0x7f29d4078b90 2024-09-21T03:25:16.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.288+0000 7f29f5600640 1 -- 172.21.15.90:0/1697541472 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+494685 (secure 0 0 0) 0x7f29f8076d70 con 0x7f29d4078b90 2024-09-21T03:25:16.297 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:25:16.301 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-21T03:25:16.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.293+0000 7f29ff400640 1 -- 172.21.15.90:0/1697541472 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f29d4078b90 msgr2=0x7f29d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.293+0000 7f29ff400640 1 --2- 172.21.15.90:0/1697541472 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f29d4078b90 0x7f29d407b0a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f29f80c3e00 tx=0x7f29e0009060 comp rx=0 tx=0).stop 2024-09-21T03:25:16.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.293+0000 7f29ff400640 1 -- 172.21.15.90:0/1697541472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29f806d960 msgr2=0x7f29f814e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.293+0000 7f29ff400640 1 --2- 172.21.15.90:0/1697541472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29f806d960 0x7f29f814e810 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f29e80099f0 tx=0x7f29e8003970 comp rx=0 tx=0).stop 2024-09-21T03:25:16.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.294+0000 7f29ff400640 1 -- 172.21.15.90:0/1697541472 shutdown_connections 2024-09-21T03:25:16.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.294+0000 7f29ff400640 1 --2- 172.21.15.90:0/1697541472 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f29d4078b90 0x7f29d407b0a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.294+0000 7f29ff400640 1 --2- 172.21.15.90:0/1697541472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29f80ac350 0x7f29f80c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.294+0000 7f29ff400640 1 --2- 172.21.15.90:0/1697541472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29f8074220 0x7f29f81586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.294+0000 7f29ff400640 1 --2- 172.21.15.90:0/1697541472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29f806d960 0x7f29f814e810 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.294+0000 7f29ff400640 1 -- 172.21.15.90:0/1697541472 >> 172.21.15.90:0/1697541472 conn(0x7f29f80c8ba0 msgr2=0x7f29f80c3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:16.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.294+0000 7f29ff400640 1 -- 172.21.15.90:0/1697541472 shutdown_connections 2024-09-21T03:25:16.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:16.294+0000 7f29ff400640 1 -- 172.21.15.90:0/1697541472 wait complete. 2024-09-21T03:25:16.318 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2024-09-21T03:25:14.758224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":263547592,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":126,"num_read_kb":267,"num_write":5735616,"num_write_kb":66239739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":396620,"ondisk_log_size":396620,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4206416,"kb_used_data":517072,"kb_used_omap":12,"kb_used_meta":3689203,"kb_avail":750768304,"statfs":{"total":773094113280,"available":768786743296,"internally_reserved":0,"allocated":529481728,"data_stored":528010696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":3777744432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004384"},"pg_stats":[{"pgid":"5.18","version":"27'2955","reported_seq":2984,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:00.507641+0000","last_change":"2024-09-21T03:25:00.507641+0000","last_active":"2024-09-21T03:25:00.507641+0000","last_peered":"2024-09-21T03:25:00.507641+0000","last_clean":"2024-09-21T03:25:00.507641+0000","last_became_active":"2024-09-21T03:14:47.551883+0000","last_became_peered":"2024-09-21T03:14:47.551883+0000","last_unstale":"2024-09-21T03:25:00.507641+0000","last_undegraded":"2024-09-21T03:25:00.507641+0000","last_fullsized":"2024-09-21T03:25:00.507641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2955","last_scrub_stamp":"2024-09-21T03:25:00.507540+0000","last_deep_scrub":"27'2955","last_deep_scrub_stamp":"2024-09-21T03:25:00.507540+0000","last_clean_scrub_stamp":"2024-09-21T03:25:00.507540+0000","objects_scrubbed":0,"log_size":2955,"log_dups_size":0,"ondisk_log_size":2955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:57.221123+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42893,"num_write_kb":435375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"27'185","reported_seq":225,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:57.651608+0000","last_change":"2024-09-21T03:24:57.651531+0000","last_active":"2024-09-21T03:24:57.651608+0000","last_peered":"2024-09-21T03:24:57.651608+0000","last_clean":"2024-09-21T03:24:57.651608+0000","last_became_active":"2024-09-21T03:14:37.470563+0000","last_became_peered":"2024-09-21T03:14:37.470563+0000","last_unstale":"2024-09-21T03:24:57.651608+0000","last_undegraded":"2024-09-21T03:24:57.651608+0000","last_fullsized":"2024-09-21T03:24:57.651608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'185","last_scrub_stamp":"2024-09-21T03:24:57.651414+0000","last_deep_scrub":"27'185","last_deep_scrub_stamp":"2024-09-21T03:24:57.651414+0000","last_clean_scrub_stamp":"2024-09-21T03:24:57.651414+0000","objects_scrubbed":4,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:49.472472+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7184146,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":7088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'3329","reported_seq":3367,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:01.469310+0000","last_change":"2024-09-21T03:25:01.469310+0000","last_active":"2024-09-21T03:25:01.469310+0000","last_peered":"2024-09-21T03:25:01.469310+0000","last_clean":"2024-09-21T03:25:01.469310+0000","last_became_active":"2024-09-21T03:14:38.488292+0000","last_became_peered":"2024-09-21T03:14:38.488292+0000","last_unstale":"2024-09-21T03:25:01.469310+0000","last_undegraded":"2024-09-21T03:25:01.469310+0000","last_fullsized":"2024-09-21T03:25:01.469310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3329","last_scrub_stamp":"2024-09-21T03:25:01.469210+0000","last_deep_scrub":"27'3329","last_deep_scrub_stamp":"2024-09-21T03:25:01.469210+0000","last_clean_scrub_stamp":"2024-09-21T03:25:01.469210+0000","objects_scrubbed":0,"log_size":3329,"log_dups_size":0,"ondisk_log_size":3329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:08.097646+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49408,"num_write_kb":622324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:04.350555+0000","last_change":"2024-09-21T03:25:04.350555+0000","last_active":"2024-09-21T03:25:04.350555+0000","last_peered":"2024-09-21T03:25:04.350555+0000","last_clean":"2024-09-21T03:25:04.350555+0000","last_became_active":"2024-09-21T03:14:46.549536+0000","last_became_peered":"2024-09-21T03:14:46.549536+0000","last_unstale":"2024-09-21T03:25:04.350555+0000","last_undegraded":"2024-09-21T03:25:04.350555+0000","last_fullsized":"2024-09-21T03:25:04.350555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-09-21T03:25:04.350437+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-09-21T03:25:04.350437+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.350437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:49:45.571099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"27'3463","reported_seq":3484,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.343341+0000","last_change":"2024-09-21T03:14:47.560303+0000","last_active":"2024-09-21T03:24:45.343341+0000","last_peered":"2024-09-21T03:24:45.343341+0000","last_clean":"2024-09-21T03:24:45.343341+0000","last_became_active":"2024-09-21T03:14:47.559659+0000","last_became_peered":"2024-09-21T03:14:47.559659+0000","last_unstale":"2024-09-21T03:24:45.343341+0000","last_undegraded":"2024-09-21T03:24:45.343341+0000","last_fullsized":"2024-09-21T03:24:45.343341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3463,"log_dups_size":0,"ondisk_log_size":3463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:49.328036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50427,"num_write_kb":517490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"27'11","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:56.483636+0000","last_change":"2024-09-21T03:24:56.483636+0000","last_active":"2024-09-21T03:24:56.483636+0000","last_peered":"2024-09-21T03:24:56.483636+0000","last_clean":"2024-09-21T03:24:56.483636+0000","last_became_active":"2024-09-21T03:14:37.467146+0000","last_became_peered":"2024-09-21T03:14:37.467146+0000","last_unstale":"2024-09-21T03:24:56.483636+0000","last_undegraded":"2024-09-21T03:24:56.483636+0000","last_fullsized":"2024-09-21T03:24:56.483636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-09-21T03:24:56.483537+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-09-21T03:24:56.483537+0000","last_clean_scrub_stamp":"2024-09-21T03:24:56.483537+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:02.364107+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'3692","reported_seq":3730,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:02.449436+0000","last_change":"2024-09-21T03:25:02.449367+0000","last_active":"2024-09-21T03:25:02.449436+0000","last_peered":"2024-09-21T03:25:02.449436+0000","last_clean":"2024-09-21T03:25:02.449436+0000","last_became_active":"2024-09-21T03:14:38.486090+0000","last_became_peered":"2024-09-21T03:14:38.486090+0000","last_unstale":"2024-09-21T03:25:02.449436+0000","last_undegraded":"2024-09-21T03:25:02.449436+0000","last_fullsized":"2024-09-21T03:25:02.449436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3692","last_scrub_stamp":"2024-09-21T03:25:02.449256+0000","last_deep_scrub":"27'3692","last_deep_scrub_stamp":"2024-09-21T03:25:02.449256+0000","last_clean_scrub_stamp":"2024-09-21T03:25:02.449256+0000","objects_scrubbed":0,"log_size":3692,"log_dups_size":0,"ondisk_log_size":3692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:20.161317+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54471,"num_write_kb":691181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'49","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:03.758108+0000","last_change":"2024-09-21T03:25:03.758108+0000","last_active":"2024-09-21T03:25:03.758108+0000","last_peered":"2024-09-21T03:25:03.758108+0000","last_clean":"2024-09-21T03:25:03.758108+0000","last_became_active":"2024-09-21T03:14:46.541357+0000","last_became_peered":"2024-09-21T03:14:46.541357+0000","last_unstale":"2024-09-21T03:25:03.758108+0000","last_undegraded":"2024-09-21T03:25:03.758108+0000","last_fullsized":"2024-09-21T03:25:03.758108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2024-09-21T03:25:03.758031+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2024-09-21T03:25:03.758031+0000","last_clean_scrub_stamp":"2024-09-21T03:25:03.758031+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:21.737949+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":8225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"27'2623","reported_seq":2654,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:03.538042+0000","last_change":"2024-09-21T03:25:03.538042+0000","last_active":"2024-09-21T03:25:03.538042+0000","last_peered":"2024-09-21T03:25:03.538042+0000","last_clean":"2024-09-21T03:25:03.538042+0000","last_became_active":"2024-09-21T03:14:47.553312+0000","last_became_peered":"2024-09-21T03:14:47.553312+0000","last_unstale":"2024-09-21T03:25:03.538042+0000","last_undegraded":"2024-09-21T03:25:03.538042+0000","last_fullsized":"2024-09-21T03:25:03.538042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2623","last_scrub_stamp":"2024-09-21T03:25:03.537938+0000","last_deep_scrub":"27'2623","last_deep_scrub_stamp":"2024-09-21T03:25:03.537938+0000","last_clean_scrub_stamp":"2024-09-21T03:25:03.537938+0000","objects_scrubbed":0,"log_size":2623,"log_dups_size":0,"ondisk_log_size":2623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:18.371564+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37737,"num_write_kb":383006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"27'46","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:56.318856+0000","last_change":"2024-09-21T03:24:56.318856+0000","last_active":"2024-09-21T03:24:56.318856+0000","last_peered":"2024-09-21T03:24:56.318856+0000","last_clean":"2024-09-21T03:24:56.318856+0000","last_became_active":"2024-09-21T03:14:37.477910+0000","last_became_peered":"2024-09-21T03:14:37.477910+0000","last_unstale":"2024-09-21T03:24:56.318856+0000","last_undegraded":"2024-09-21T03:24:56.318856+0000","last_fullsized":"2024-09-21T03:24:56.318856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-09-21T03:24:56.318773+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-09-21T03:24:56.318773+0000","last_clean_scrub_stamp":"2024-09-21T03:24:56.318773+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:56.545132+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2285","reported_seq":2322,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:55.598504+0000","last_change":"2024-09-21T03:24:55.598504+0000","last_active":"2024-09-21T03:24:55.598504+0000","last_peered":"2024-09-21T03:24:55.598504+0000","last_clean":"2024-09-21T03:24:55.598504+0000","last_became_active":"2024-09-21T03:14:38.472426+0000","last_became_peered":"2024-09-21T03:14:38.472426+0000","last_unstale":"2024-09-21T03:24:55.598504+0000","last_undegraded":"2024-09-21T03:24:55.598504+0000","last_fullsized":"2024-09-21T03:24:55.598504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2285","last_scrub_stamp":"2024-09-21T03:24:55.598420+0000","last_deep_scrub":"27'2285","last_deep_scrub_stamp":"2024-09-21T03:24:55.598420+0000","last_clean_scrub_stamp":"2024-09-21T03:24:55.598420+0000","objects_scrubbed":0,"log_size":2285,"log_dups_size":0,"ondisk_log_size":2285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:43.228751+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33481,"num_write_kb":420875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1062","reported_seq":1093,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.741521+0000","last_change":"2024-09-21T03:25:06.741521+0000","last_active":"2024-09-21T03:25:06.741521+0000","last_peered":"2024-09-21T03:25:06.741521+0000","last_clean":"2024-09-21T03:25:06.741521+0000","last_became_active":"2024-09-21T03:14:46.525587+0000","last_became_peered":"2024-09-21T03:14:46.525587+0000","last_unstale":"2024-09-21T03:25:06.741521+0000","last_undegraded":"2024-09-21T03:25:06.741521+0000","last_fullsized":"2024-09-21T03:25:06.741521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1062","last_scrub_stamp":"2024-09-21T03:25:06.741387+0000","last_deep_scrub":"27'1062","last_deep_scrub_stamp":"2024-09-21T03:25:06.741387+0000","last_clean_scrub_stamp":"2024-09-21T03:25:06.741387+0000","objects_scrubbed":1,"log_size":1062,"log_dups_size":0,"ondisk_log_size":1062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:05.252964+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1059,"num_write_kb":5042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"27'2269","reported_seq":2290,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.309977+0000","last_change":"2024-09-21T03:14:47.554143+0000","last_active":"2024-09-21T03:24:45.309977+0000","last_peered":"2024-09-21T03:24:45.309977+0000","last_clean":"2024-09-21T03:24:45.309977+0000","last_became_active":"2024-09-21T03:14:47.553802+0000","last_became_peered":"2024-09-21T03:14:47.553802+0000","last_unstale":"2024-09-21T03:24:45.309977+0000","last_undegraded":"2024-09-21T03:24:45.309977+0000","last_fullsized":"2024-09-21T03:24:45.309977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2269,"log_dups_size":0,"ondisk_log_size":2269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32861,"num_write_kb":341635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'15","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:54.235628+0000","last_change":"2024-09-21T03:24:54.235628+0000","last_active":"2024-09-21T03:24:54.235628+0000","last_peered":"2024-09-21T03:24:54.235628+0000","last_clean":"2024-09-21T03:24:54.235628+0000","last_became_active":"2024-09-21T03:14:37.478893+0000","last_became_peered":"2024-09-21T03:14:37.478893+0000","last_unstale":"2024-09-21T03:24:54.235628+0000","last_undegraded":"2024-09-21T03:24:54.235628+0000","last_fullsized":"2024-09-21T03:24:54.235628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-09-21T03:24:54.235523+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-09-21T03:24:54.235523+0000","last_clean_scrub_stamp":"2024-09-21T03:24:54.235523+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:05.978658+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'3862","reported_seq":3899,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.707440+0000","last_change":"2024-09-21T03:25:07.707440+0000","last_active":"2024-09-21T03:25:07.707440+0000","last_peered":"2024-09-21T03:25:07.707440+0000","last_clean":"2024-09-21T03:25:07.707440+0000","last_became_active":"2024-09-21T03:14:38.467570+0000","last_became_peered":"2024-09-21T03:14:38.467570+0000","last_unstale":"2024-09-21T03:25:07.707440+0000","last_undegraded":"2024-09-21T03:25:07.707440+0000","last_fullsized":"2024-09-21T03:25:07.707440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3862","last_scrub_stamp":"2024-09-21T03:25:07.707332+0000","last_deep_scrub":"27'3862","last_deep_scrub_stamp":"2024-09-21T03:25:07.707332+0000","last_clean_scrub_stamp":"2024-09-21T03:25:07.707332+0000","objects_scrubbed":0,"log_size":3862,"log_dups_size":0,"ondisk_log_size":3862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:08:12.447025+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57219,"num_write_kb":702431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'52","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:02.731779+0000","last_change":"2024-09-21T03:25:02.731779+0000","last_active":"2024-09-21T03:25:02.731779+0000","last_peered":"2024-09-21T03:25:02.731779+0000","last_clean":"2024-09-21T03:25:02.731779+0000","last_became_active":"2024-09-21T03:14:46.529629+0000","last_became_peered":"2024-09-21T03:14:46.529629+0000","last_unstale":"2024-09-21T03:25:02.731779+0000","last_undegraded":"2024-09-21T03:25:02.731779+0000","last_fullsized":"2024-09-21T03:25:02.731779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2024-09-21T03:25:02.731689+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2024-09-21T03:25:02.731689+0000","last_clean_scrub_stamp":"2024-09-21T03:25:02.731689+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:33:24.871448+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":8220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"27'3149","reported_seq":3170,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.310173+0000","last_change":"2024-09-21T03:14:47.547724+0000","last_active":"2024-09-21T03:24:45.310173+0000","last_peered":"2024-09-21T03:24:45.310173+0000","last_clean":"2024-09-21T03:24:45.310173+0000","last_became_active":"2024-09-21T03:14:47.546770+0000","last_became_peered":"2024-09-21T03:14:47.546770+0000","last_unstale":"2024-09-21T03:24:45.310173+0000","last_undegraded":"2024-09-21T03:24:45.310173+0000","last_fullsized":"2024-09-21T03:24:45.310173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3149,"log_dups_size":0,"ondisk_log_size":3149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:31.476710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45697,"num_write_kb":467369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"27'2916","reported_seq":2953,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:01.748514+0000","last_change":"2024-09-21T03:25:01.748514+0000","last_active":"2024-09-21T03:25:01.748514+0000","last_peered":"2024-09-21T03:25:01.748514+0000","last_clean":"2024-09-21T03:25:01.748514+0000","last_became_active":"2024-09-21T03:14:38.476386+0000","last_became_peered":"2024-09-21T03:14:38.476386+0000","last_unstale":"2024-09-21T03:25:01.748514+0000","last_undegraded":"2024-09-21T03:25:01.748514+0000","last_fullsized":"2024-09-21T03:25:01.748514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2916","last_scrub_stamp":"2024-09-21T03:25:01.748423+0000","last_deep_scrub":"27'2916","last_deep_scrub_stamp":"2024-09-21T03:25:01.748423+0000","last_clean_scrub_stamp":"2024-09-21T03:25:01.748423+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:57.204079+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43116,"num_write_kb":539220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'229","reported_seq":268,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:58.771599+0000","last_change":"2024-09-21T03:24:58.771599+0000","last_active":"2024-09-21T03:24:58.771599+0000","last_peered":"2024-09-21T03:24:58.771599+0000","last_clean":"2024-09-21T03:24:58.771599+0000","last_became_active":"2024-09-21T03:14:37.461409+0000","last_became_peered":"2024-09-21T03:14:37.461409+0000","last_unstale":"2024-09-21T03:24:58.771599+0000","last_undegraded":"2024-09-21T03:24:58.771599+0000","last_fullsized":"2024-09-21T03:24:58.771599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'229","last_scrub_stamp":"2024-09-21T03:24:58.771491+0000","last_deep_scrub":"27'229","last_deep_scrub_stamp":"2024-09-21T03:24:58.771491+0000","last_clean_scrub_stamp":"2024-09-21T03:24:58.771491+0000","objects_scrubbed":3,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:33.406519+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":8373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'25","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:23:51.616959+0000","last_change":"2024-09-21T03:14:46.538480+0000","last_active":"2024-09-21T03:23:51.616959+0000","last_peered":"2024-09-21T03:23:51.616959+0000","last_clean":"2024-09-21T03:23:51.616959+0000","last_became_active":"2024-09-21T03:14:46.537493+0000","last_became_peered":"2024-09-21T03:14:46.537493+0000","last_unstale":"2024-09-21T03:23:51.616959+0000","last_undegraded":"2024-09-21T03:23:51.616959+0000","last_fullsized":"2024-09-21T03:23:51.616959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:52.769190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"27'3066","reported_seq":3095,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:08.341306+0000","last_change":"2024-09-21T03:25:08.341306+0000","last_active":"2024-09-21T03:25:08.341306+0000","last_peered":"2024-09-21T03:25:08.341306+0000","last_clean":"2024-09-21T03:25:08.341306+0000","last_became_active":"2024-09-21T03:14:47.580210+0000","last_became_peered":"2024-09-21T03:14:47.580210+0000","last_unstale":"2024-09-21T03:25:08.341306+0000","last_undegraded":"2024-09-21T03:25:08.341306+0000","last_fullsized":"2024-09-21T03:25:08.341306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3066","last_scrub_stamp":"2024-09-21T03:25:08.341149+0000","last_deep_scrub":"27'3066","last_deep_scrub_stamp":"2024-09-21T03:25:08.341149+0000","last_clean_scrub_stamp":"2024-09-21T03:25:08.341149+0000","objects_scrubbed":0,"log_size":3066,"log_dups_size":0,"ondisk_log_size":3066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:30.772179+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44544,"num_write_kb":453960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"27'2513","reported_seq":2550,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:58.318820+0000","last_change":"2024-09-21T03:24:58.318820+0000","last_active":"2024-09-21T03:24:58.318820+0000","last_peered":"2024-09-21T03:24:58.318820+0000","last_clean":"2024-09-21T03:24:58.318820+0000","last_became_active":"2024-09-21T03:14:38.486802+0000","last_became_peered":"2024-09-21T03:14:38.486802+0000","last_unstale":"2024-09-21T03:24:58.318820+0000","last_undegraded":"2024-09-21T03:24:58.318820+0000","last_fullsized":"2024-09-21T03:24:58.318820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2513","last_scrub_stamp":"2024-09-21T03:24:58.318727+0000","last_deep_scrub":"27'2513","last_deep_scrub_stamp":"2024-09-21T03:24:58.318727+0000","last_clean_scrub_stamp":"2024-09-21T03:24:58.318727+0000","objects_scrubbed":0,"log_size":2513,"log_dups_size":0,"ondisk_log_size":2513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:27.443831+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37114,"num_write_kb":476028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'17","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:55.811250+0000","last_change":"2024-09-21T03:24:55.811250+0000","last_active":"2024-09-21T03:24:55.811250+0000","last_peered":"2024-09-21T03:24:55.811250+0000","last_clean":"2024-09-21T03:24:55.811250+0000","last_became_active":"2024-09-21T03:14:37.465551+0000","last_became_peered":"2024-09-21T03:14:37.465551+0000","last_unstale":"2024-09-21T03:24:55.811250+0000","last_undegraded":"2024-09-21T03:24:55.811250+0000","last_fullsized":"2024-09-21T03:24:55.811250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-09-21T03:24:55.811156+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-09-21T03:24:55.811156+0000","last_clean_scrub_stamp":"2024-09-21T03:24:55.811156+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:25.006798+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.448299+0000","last_change":"2024-09-21T03:25:05.448299+0000","last_active":"2024-09-21T03:25:05.448299+0000","last_peered":"2024-09-21T03:25:05.448299+0000","last_clean":"2024-09-21T03:25:05.448299+0000","last_became_active":"2024-09-21T03:14:46.546312+0000","last_became_peered":"2024-09-21T03:14:46.546312+0000","last_unstale":"2024-09-21T03:25:05.448299+0000","last_undegraded":"2024-09-21T03:25:05.448299+0000","last_fullsized":"2024-09-21T03:25:05.448299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-09-21T03:25:05.448215+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-09-21T03:25:05.448215+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.448215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:03.847300+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"27'2659","reported_seq":2680,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.357667+0000","last_change":"2024-09-21T03:14:47.558742+0000","last_active":"2024-09-21T03:24:45.357667+0000","last_peered":"2024-09-21T03:24:45.357667+0000","last_clean":"2024-09-21T03:24:45.357667+0000","last_became_active":"2024-09-21T03:14:47.558431+0000","last_became_peered":"2024-09-21T03:14:47.558431+0000","last_unstale":"2024-09-21T03:24:45.357667+0000","last_undegraded":"2024-09-21T03:24:45.357667+0000","last_fullsized":"2024-09-21T03:24:45.357667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2659,"log_dups_size":0,"ondisk_log_size":2659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:32.053674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38628,"num_write_kb":413288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"27'3227","reported_seq":3264,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:01.612537+0000","last_change":"2024-09-21T03:25:01.612537+0000","last_active":"2024-09-21T03:25:01.612537+0000","last_peered":"2024-09-21T03:25:01.612537+0000","last_clean":"2024-09-21T03:25:01.612537+0000","last_became_active":"2024-09-21T03:14:38.476976+0000","last_became_peered":"2024-09-21T03:14:38.476976+0000","last_unstale":"2024-09-21T03:25:01.612537+0000","last_undegraded":"2024-09-21T03:25:01.612537+0000","last_fullsized":"2024-09-21T03:25:01.612537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3227","last_scrub_stamp":"2024-09-21T03:25:01.612446+0000","last_deep_scrub":"27'3227","last_deep_scrub_stamp":"2024-09-21T03:25:01.612446+0000","last_clean_scrub_stamp":"2024-09-21T03:25:01.612446+0000","objects_scrubbed":0,"log_size":3227,"log_dups_size":0,"ondisk_log_size":3227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:32.017166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47858,"num_write_kb":595125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'16","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:55.590273+0000","last_change":"2024-09-21T03:24:55.590273+0000","last_active":"2024-09-21T03:24:55.590273+0000","last_peered":"2024-09-21T03:24:55.590273+0000","last_clean":"2024-09-21T03:24:55.590273+0000","last_became_active":"2024-09-21T03:14:37.478840+0000","last_became_peered":"2024-09-21T03:14:37.478840+0000","last_unstale":"2024-09-21T03:24:55.590273+0000","last_undegraded":"2024-09-21T03:24:55.590273+0000","last_fullsized":"2024-09-21T03:24:55.590273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-09-21T03:24:55.590153+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-09-21T03:24:55.590153+0000","last_clean_scrub_stamp":"2024-09-21T03:24:55.590153+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:06.788193+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'26","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:03.321924+0000","last_change":"2024-09-21T03:25:03.321924+0000","last_active":"2024-09-21T03:25:03.321924+0000","last_peered":"2024-09-21T03:25:03.321924+0000","last_clean":"2024-09-21T03:25:03.321924+0000","last_became_active":"2024-09-21T03:14:46.542721+0000","last_became_peered":"2024-09-21T03:14:46.542721+0000","last_unstale":"2024-09-21T03:25:03.321924+0000","last_undegraded":"2024-09-21T03:25:03.321924+0000","last_fullsized":"2024-09-21T03:25:03.321924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2024-09-21T03:25:03.321828+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2024-09-21T03:25:03.321828+0000","last_clean_scrub_stamp":"2024-09-21T03:25:03.321828+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:09.410532+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"27'3357","reported_seq":3386,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:58.564594+0000","last_change":"2024-09-21T03:24:58.564594+0000","last_active":"2024-09-21T03:24:58.564594+0000","last_peered":"2024-09-21T03:24:58.564594+0000","last_clean":"2024-09-21T03:24:58.564594+0000","last_became_active":"2024-09-21T03:14:47.566634+0000","last_became_peered":"2024-09-21T03:14:47.566634+0000","last_unstale":"2024-09-21T03:24:58.564594+0000","last_undegraded":"2024-09-21T03:24:58.564594+0000","last_fullsized":"2024-09-21T03:24:58.564594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3357","last_scrub_stamp":"2024-09-21T03:24:58.564510+0000","last_deep_scrub":"27'3357","last_deep_scrub_stamp":"2024-09-21T03:24:58.564510+0000","last_clean_scrub_stamp":"2024-09-21T03:24:58.564510+0000","objects_scrubbed":0,"log_size":3357,"log_dups_size":0,"ondisk_log_size":3357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:40:06.038265+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48633,"num_write_kb":505858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'2924","reported_seq":2961,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:02.705830+0000","last_change":"2024-09-21T03:25:02.705830+0000","last_active":"2024-09-21T03:25:02.705830+0000","last_peered":"2024-09-21T03:25:02.705830+0000","last_clean":"2024-09-21T03:25:02.705830+0000","last_became_active":"2024-09-21T03:14:38.482369+0000","last_became_peered":"2024-09-21T03:14:38.482369+0000","last_unstale":"2024-09-21T03:25:02.705830+0000","last_undegraded":"2024-09-21T03:25:02.705830+0000","last_fullsized":"2024-09-21T03:25:02.705830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2924","last_scrub_stamp":"2024-09-21T03:25:02.705279+0000","last_deep_scrub":"27'2924","last_deep_scrub_stamp":"2024-09-21T03:25:02.705279+0000","last_clean_scrub_stamp":"2024-09-21T03:25:02.705279+0000","objects_scrubbed":0,"log_size":2924,"log_dups_size":0,"ondisk_log_size":2924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:01.762843+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43307,"num_write_kb":537343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'16","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:53.273178+0000","last_change":"2024-09-21T03:24:53.273178+0000","last_active":"2024-09-21T03:24:53.273178+0000","last_peered":"2024-09-21T03:24:53.273178+0000","last_clean":"2024-09-21T03:24:53.273178+0000","last_became_active":"2024-09-21T03:14:37.472271+0000","last_became_peered":"2024-09-21T03:14:37.472271+0000","last_unstale":"2024-09-21T03:24:53.273178+0000","last_undegraded":"2024-09-21T03:24:53.273178+0000","last_fullsized":"2024-09-21T03:24:53.273178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-09-21T03:24:53.273086+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-09-21T03:24:53.273086+0000","last_clean_scrub_stamp":"2024-09-21T03:24:53.273086+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:00.016606+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'32","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:01.730241+0000","last_change":"2024-09-21T03:25:01.730241+0000","last_active":"2024-09-21T03:25:01.730241+0000","last_peered":"2024-09-21T03:25:01.730241+0000","last_clean":"2024-09-21T03:25:01.730241+0000","last_became_active":"2024-09-21T03:14:46.536791+0000","last_became_peered":"2024-09-21T03:14:46.536791+0000","last_unstale":"2024-09-21T03:25:01.730241+0000","last_undegraded":"2024-09-21T03:25:01.730241+0000","last_fullsized":"2024-09-21T03:25:01.730241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2024-09-21T03:25:01.730136+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2024-09-21T03:25:01.730136+0000","last_clean_scrub_stamp":"2024-09-21T03:25:01.730136+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:23:55.468107+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"27'2826","reported_seq":2848,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.328092+0000","last_change":"2024-09-21T03:14:47.555605+0000","last_active":"2024-09-21T03:24:45.328092+0000","last_peered":"2024-09-21T03:24:45.328092+0000","last_clean":"2024-09-21T03:24:45.328092+0000","last_became_active":"2024-09-21T03:14:47.555329+0000","last_became_peered":"2024-09-21T03:14:47.555329+0000","last_unstale":"2024-09-21T03:24:45.328092+0000","last_undegraded":"2024-09-21T03:24:45.328092+0000","last_fullsized":"2024-09-21T03:24:45.328092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2826,"log_dups_size":0,"ondisk_log_size":2826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40983,"num_write_kb":424268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'2675","reported_seq":2712,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:59.611727+0000","last_change":"2024-09-21T03:24:59.611727+0000","last_active":"2024-09-21T03:24:59.611727+0000","last_peered":"2024-09-21T03:24:59.611727+0000","last_clean":"2024-09-21T03:24:59.611727+0000","last_became_active":"2024-09-21T03:14:38.478077+0000","last_became_peered":"2024-09-21T03:14:38.478077+0000","last_unstale":"2024-09-21T03:24:59.611727+0000","last_undegraded":"2024-09-21T03:24:59.611727+0000","last_fullsized":"2024-09-21T03:24:59.611727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2675","last_scrub_stamp":"2024-09-21T03:24:59.611584+0000","last_deep_scrub":"27'2675","last_deep_scrub_stamp":"2024-09-21T03:24:59.611584+0000","last_clean_scrub_stamp":"2024-09-21T03:24:59.611584+0000","objects_scrubbed":0,"log_size":2675,"log_dups_size":0,"ondisk_log_size":2675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:50.559875+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39231,"num_write_kb":490681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'12","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:55.811354+0000","last_change":"2024-09-21T03:24:55.811354+0000","last_active":"2024-09-21T03:24:55.811354+0000","last_peered":"2024-09-21T03:24:55.811354+0000","last_clean":"2024-09-21T03:24:55.811354+0000","last_became_active":"2024-09-21T03:14:37.480218+0000","last_became_peered":"2024-09-21T03:14:37.480218+0000","last_unstale":"2024-09-21T03:24:55.811354+0000","last_undegraded":"2024-09-21T03:24:55.811354+0000","last_fullsized":"2024-09-21T03:24:55.811354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-09-21T03:24:55.811256+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-09-21T03:24:55.811256+0000","last_clean_scrub_stamp":"2024-09-21T03:24:55.811256+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:31.668231+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'33","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:59.721068+0000","last_change":"2024-09-21T03:24:59.721068+0000","last_active":"2024-09-21T03:24:59.721068+0000","last_peered":"2024-09-21T03:24:59.721068+0000","last_clean":"2024-09-21T03:24:59.721068+0000","last_became_active":"2024-09-21T03:14:46.531289+0000","last_became_peered":"2024-09-21T03:14:46.531289+0000","last_unstale":"2024-09-21T03:24:59.721068+0000","last_undegraded":"2024-09-21T03:24:59.721068+0000","last_fullsized":"2024-09-21T03:24:59.721068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2024-09-21T03:24:59.720903+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2024-09-21T03:24:59.720903+0000","last_clean_scrub_stamp":"2024-09-21T03:24:59.720903+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:59.283607+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":107,"num_write":31,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"27'2919","reported_seq":2941,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.329403+0000","last_change":"2024-09-21T03:14:47.552705+0000","last_active":"2024-09-21T03:24:45.329403+0000","last_peered":"2024-09-21T03:24:45.329403+0000","last_clean":"2024-09-21T03:24:45.329403+0000","last_became_active":"2024-09-21T03:14:47.552367+0000","last_became_peered":"2024-09-21T03:14:47.552367+0000","last_unstale":"2024-09-21T03:24:45.329403+0000","last_undegraded":"2024-09-21T03:24:45.329403+0000","last_fullsized":"2024-09-21T03:24:45.329403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2919,"log_dups_size":0,"ondisk_log_size":2919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42429,"num_write_kb":431357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'3268","reported_seq":3305,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:00.618387+0000","last_change":"2024-09-21T03:25:00.618387+0000","last_active":"2024-09-21T03:25:00.618387+0000","last_peered":"2024-09-21T03:25:00.618387+0000","last_clean":"2024-09-21T03:25:00.618387+0000","last_became_active":"2024-09-21T03:14:38.474978+0000","last_became_peered":"2024-09-21T03:14:38.474978+0000","last_unstale":"2024-09-21T03:25:00.618387+0000","last_undegraded":"2024-09-21T03:25:00.618387+0000","last_fullsized":"2024-09-21T03:25:00.618387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3268","last_scrub_stamp":"2024-09-21T03:25:00.618252+0000","last_deep_scrub":"27'3268","last_deep_scrub_stamp":"2024-09-21T03:25:00.618252+0000","last_clean_scrub_stamp":"2024-09-21T03:25:00.618252+0000","objects_scrubbed":0,"log_size":3268,"log_dups_size":0,"ondisk_log_size":3268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:14.028129+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48313,"num_write_kb":579677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'320","reported_seq":359,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:53.577859+0000","last_change":"2024-09-21T03:24:53.577859+0000","last_active":"2024-09-21T03:24:53.577859+0000","last_peered":"2024-09-21T03:24:53.577859+0000","last_clean":"2024-09-21T03:24:53.577859+0000","last_became_active":"2024-09-21T03:14:37.478833+0000","last_became_peered":"2024-09-21T03:14:37.478833+0000","last_unstale":"2024-09-21T03:24:53.577859+0000","last_undegraded":"2024-09-21T03:24:53.577859+0000","last_fullsized":"2024-09-21T03:24:53.577859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'320","last_scrub_stamp":"2024-09-21T03:24:53.577756+0000","last_deep_scrub":"27'320","last_deep_scrub_stamp":"2024-09-21T03:24:53.577756+0000","last_clean_scrub_stamp":"2024-09-21T03:24:53.577756+0000","objects_scrubbed":1,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:44.824631+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'50","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.660937+0000","last_change":"2024-09-21T03:25:05.660937+0000","last_active":"2024-09-21T03:25:05.660937+0000","last_peered":"2024-09-21T03:25:05.660937+0000","last_clean":"2024-09-21T03:25:05.660937+0000","last_became_active":"2024-09-21T03:14:46.535569+0000","last_became_peered":"2024-09-21T03:14:46.535569+0000","last_unstale":"2024-09-21T03:25:05.660937+0000","last_undegraded":"2024-09-21T03:25:05.660937+0000","last_fullsized":"2024-09-21T03:25:05.660937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-09-21T03:25:05.660851+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-09-21T03:25:05.660851+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.660851+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:50.851437+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":8210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"27'3110","reported_seq":3139,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.414320+0000","last_change":"2024-09-21T03:25:07.414320+0000","last_active":"2024-09-21T03:25:07.414320+0000","last_peered":"2024-09-21T03:25:07.414320+0000","last_clean":"2024-09-21T03:25:07.414320+0000","last_became_active":"2024-09-21T03:14:47.571620+0000","last_became_peered":"2024-09-21T03:14:47.571620+0000","last_unstale":"2024-09-21T03:25:07.414320+0000","last_undegraded":"2024-09-21T03:25:07.414320+0000","last_fullsized":"2024-09-21T03:25:07.414320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3110","last_scrub_stamp":"2024-09-21T03:25:07.414193+0000","last_deep_scrub":"27'3110","last_deep_scrub_stamp":"2024-09-21T03:25:07.414193+0000","last_clean_scrub_stamp":"2024-09-21T03:25:07.414193+0000","objects_scrubbed":0,"log_size":3110,"log_dups_size":0,"ondisk_log_size":3110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:27:47.569967+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45309,"num_write_kb":459474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"27'3313","reported_seq":3351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:57.881205+0000","last_change":"2024-09-21T03:24:57.881102+0000","last_active":"2024-09-21T03:24:57.881205+0000","last_peered":"2024-09-21T03:24:57.881205+0000","last_clean":"2024-09-21T03:24:57.881205+0000","last_became_active":"2024-09-21T03:14:38.492830+0000","last_became_peered":"2024-09-21T03:14:38.492830+0000","last_unstale":"2024-09-21T03:24:57.881205+0000","last_undegraded":"2024-09-21T03:24:57.881205+0000","last_fullsized":"2024-09-21T03:24:57.881205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3313","last_scrub_stamp":"2024-09-21T03:24:57.880980+0000","last_deep_scrub":"27'3313","last_deep_scrub_stamp":"2024-09-21T03:24:57.880980+0000","last_clean_scrub_stamp":"2024-09-21T03:24:57.880980+0000","objects_scrubbed":0,"log_size":3313,"log_dups_size":0,"ondisk_log_size":3313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:18.144121+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48841,"num_write_kb":610665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'19","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:53.824126+0000","last_change":"2024-09-21T03:24:53.824126+0000","last_active":"2024-09-21T03:24:53.824126+0000","last_peered":"2024-09-21T03:24:53.824126+0000","last_clean":"2024-09-21T03:24:53.824126+0000","last_became_active":"2024-09-21T03:14:37.473218+0000","last_became_peered":"2024-09-21T03:14:37.473218+0000","last_unstale":"2024-09-21T03:24:53.824126+0000","last_undegraded":"2024-09-21T03:24:53.824126+0000","last_fullsized":"2024-09-21T03:24:53.824126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-09-21T03:24:53.824042+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-09-21T03:24:53.824042+0000","last_clean_scrub_stamp":"2024-09-21T03:24:53.824042+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:47.393460+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'1","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.804211+0000","last_change":"2024-09-21T03:25:05.804150+0000","last_active":"2024-09-21T03:25:05.804211+0000","last_peered":"2024-09-21T03:25:05.804211+0000","last_clean":"2024-09-21T03:25:05.804211+0000","last_became_active":"2024-09-21T03:14:46.548166+0000","last_became_peered":"2024-09-21T03:14:46.548166+0000","last_unstale":"2024-09-21T03:25:05.804211+0000","last_undegraded":"2024-09-21T03:25:05.804211+0000","last_fullsized":"2024-09-21T03:25:05.804211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-09-21T03:25:05.804057+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-09-21T03:25:05.804057+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.804057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:38.472475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"27'2797","reported_seq":2818,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.344863+0000","last_change":"2024-09-21T03:14:47.555787+0000","last_active":"2024-09-21T03:24:45.344863+0000","last_peered":"2024-09-21T03:24:45.344863+0000","last_clean":"2024-09-21T03:24:45.344863+0000","last_became_active":"2024-09-21T03:14:47.555420+0000","last_became_peered":"2024-09-21T03:14:47.555420+0000","last_unstale":"2024-09-21T03:24:45.344863+0000","last_undegraded":"2024-09-21T03:24:45.344863+0000","last_fullsized":"2024-09-21T03:24:45.344863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2797,"log_dups_size":0,"ondisk_log_size":2797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:45.769786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40658,"num_write_kb":422641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"27'2814","reported_seq":2852,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:54.702449+0000","last_change":"2024-09-21T03:24:54.702394+0000","last_active":"2024-09-21T03:24:54.702449+0000","last_peered":"2024-09-21T03:24:54.702449+0000","last_clean":"2024-09-21T03:24:54.702449+0000","last_became_active":"2024-09-21T03:14:38.479439+0000","last_became_peered":"2024-09-21T03:14:38.479439+0000","last_unstale":"2024-09-21T03:24:54.702449+0000","last_undegraded":"2024-09-21T03:24:54.702449+0000","last_fullsized":"2024-09-21T03:24:54.702449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2814","last_scrub_stamp":"2024-09-21T03:24:54.702304+0000","last_deep_scrub":"27'2814","last_deep_scrub_stamp":"2024-09-21T03:24:54.702304+0000","last_clean_scrub_stamp":"2024-09-21T03:24:54.702304+0000","objects_scrubbed":0,"log_size":2814,"log_dups_size":0,"ondisk_log_size":2814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:10.082316+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41573,"num_write_kb":525350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:57.513548+0000","last_change":"2024-09-21T03:24:57.513548+0000","last_active":"2024-09-21T03:24:57.513548+0000","last_peered":"2024-09-21T03:24:57.513548+0000","last_clean":"2024-09-21T03:24:57.513548+0000","last_became_active":"2024-09-21T03:14:37.469495+0000","last_became_peered":"2024-09-21T03:14:37.469495+0000","last_unstale":"2024-09-21T03:24:57.513548+0000","last_undegraded":"2024-09-21T03:24:57.513548+0000","last_fullsized":"2024-09-21T03:24:57.513548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-09-21T03:24:57.513181+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-09-21T03:24:57.513181+0000","last_clean_scrub_stamp":"2024-09-21T03:24:57.513181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:05.236033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'53","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:04.844571+0000","last_change":"2024-09-21T03:25:04.844435+0000","last_active":"2024-09-21T03:25:04.844571+0000","last_peered":"2024-09-21T03:25:04.844571+0000","last_clean":"2024-09-21T03:25:04.844571+0000","last_became_active":"2024-09-21T03:14:46.544038+0000","last_became_peered":"2024-09-21T03:14:46.544038+0000","last_unstale":"2024-09-21T03:25:04.844571+0000","last_undegraded":"2024-09-21T03:25:04.844571+0000","last_fullsized":"2024-09-21T03:25:04.844571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'53","last_scrub_stamp":"2024-09-21T03:25:04.844310+0000","last_deep_scrub":"27'53","last_deep_scrub_stamp":"2024-09-21T03:25:04.844310+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.844310+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:23.375722+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"27'2673","reported_seq":2708,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.329835+0000","last_change":"2024-09-21T03:25:06.329835+0000","last_active":"2024-09-21T03:25:06.329835+0000","last_peered":"2024-09-21T03:25:06.329835+0000","last_clean":"2024-09-21T03:25:06.329835+0000","last_became_active":"2024-09-21T03:14:47.579324+0000","last_became_peered":"2024-09-21T03:14:47.579324+0000","last_unstale":"2024-09-21T03:25:06.329835+0000","last_undegraded":"2024-09-21T03:25:06.329835+0000","last_fullsized":"2024-09-21T03:25:06.329835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2673","last_scrub_stamp":"2024-09-21T03:25:06.329698+0000","last_deep_scrub":"27'2673","last_deep_scrub_stamp":"2024-09-21T03:25:06.329698+0000","last_clean_scrub_stamp":"2024-09-21T03:25:06.329698+0000","objects_scrubbed":0,"log_size":2673,"log_dups_size":0,"ondisk_log_size":2673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:32.530606+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38848,"num_write_kb":393078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"27'3056","reported_seq":3094,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:55.274924+0000","last_change":"2024-09-21T03:24:55.274832+0000","last_active":"2024-09-21T03:24:55.274924+0000","last_peered":"2024-09-21T03:24:55.274924+0000","last_clean":"2024-09-21T03:24:55.274924+0000","last_became_active":"2024-09-21T03:14:38.474299+0000","last_became_peered":"2024-09-21T03:14:38.474299+0000","last_unstale":"2024-09-21T03:24:55.274924+0000","last_undegraded":"2024-09-21T03:24:55.274924+0000","last_fullsized":"2024-09-21T03:24:55.274924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3056","last_scrub_stamp":"2024-09-21T03:24:55.274732+0000","last_deep_scrub":"27'3056","last_deep_scrub_stamp":"2024-09-21T03:24:55.274732+0000","last_clean_scrub_stamp":"2024-09-21T03:24:55.274732+0000","objects_scrubbed":0,"log_size":3056,"log_dups_size":0,"ondisk_log_size":3056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:22.166985+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45199,"num_write_kb":565597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'30","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:52.822358+0000","last_change":"2024-09-21T03:24:52.822304+0000","last_active":"2024-09-21T03:24:52.822358+0000","last_peered":"2024-09-21T03:24:52.822358+0000","last_clean":"2024-09-21T03:24:52.822358+0000","last_became_active":"2024-09-21T03:14:37.466256+0000","last_became_peered":"2024-09-21T03:14:37.466256+0000","last_unstale":"2024-09-21T03:24:52.822358+0000","last_undegraded":"2024-09-21T03:24:52.822358+0000","last_fullsized":"2024-09-21T03:24:52.822358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-09-21T03:24:52.822233+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-09-21T03:24:52.822233+0000","last_clean_scrub_stamp":"2024-09-21T03:24:52.822233+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:03.022192+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'5","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.797349+0000","last_change":"2024-09-21T03:25:06.797349+0000","last_active":"2024-09-21T03:25:06.797349+0000","last_peered":"2024-09-21T03:25:06.797349+0000","last_clean":"2024-09-21T03:25:06.797349+0000","last_became_active":"2024-09-21T03:14:46.536975+0000","last_became_peered":"2024-09-21T03:14:46.536975+0000","last_unstale":"2024-09-21T03:25:06.797349+0000","last_undegraded":"2024-09-21T03:25:06.797349+0000","last_fullsized":"2024-09-21T03:25:06.797349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-21T03:25:06.797255+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-21T03:25:06.797255+0000","last_clean_scrub_stamp":"2024-09-21T03:25:06.797255+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:13.065467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"27'2498","reported_seq":2527,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.333756+0000","last_change":"2024-09-21T03:25:07.333756+0000","last_active":"2024-09-21T03:25:07.333756+0000","last_peered":"2024-09-21T03:25:07.333756+0000","last_clean":"2024-09-21T03:25:07.333756+0000","last_became_active":"2024-09-21T03:14:47.572395+0000","last_became_peered":"2024-09-21T03:14:47.572395+0000","last_unstale":"2024-09-21T03:25:07.333756+0000","last_undegraded":"2024-09-21T03:25:07.333756+0000","last_fullsized":"2024-09-21T03:25:07.333756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2498","last_scrub_stamp":"2024-09-21T03:25:07.333608+0000","last_deep_scrub":"27'2498","last_deep_scrub_stamp":"2024-09-21T03:25:07.333608+0000","last_clean_scrub_stamp":"2024-09-21T03:25:07.333608+0000","objects_scrubbed":0,"log_size":2498,"log_dups_size":0,"ondisk_log_size":2498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:00.948907+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35860,"num_write_kb":370109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"27'2994","reported_seq":3032,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:58.541003+0000","last_change":"2024-09-21T03:24:58.541003+0000","last_active":"2024-09-21T03:24:58.541003+0000","last_peered":"2024-09-21T03:24:58.541003+0000","last_clean":"2024-09-21T03:24:58.541003+0000","last_became_active":"2024-09-21T03:14:38.481186+0000","last_became_peered":"2024-09-21T03:14:38.481186+0000","last_unstale":"2024-09-21T03:24:58.541003+0000","last_undegraded":"2024-09-21T03:24:58.541003+0000","last_fullsized":"2024-09-21T03:24:58.541003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2994","last_scrub_stamp":"2024-09-21T03:24:58.540904+0000","last_deep_scrub":"27'2994","last_deep_scrub_stamp":"2024-09-21T03:24:58.540904+0000","last_clean_scrub_stamp":"2024-09-21T03:24:58.540904+0000","objects_scrubbed":0,"log_size":2994,"log_dups_size":0,"ondisk_log_size":2994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:08.588690+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44221,"num_write_kb":552392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'31","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:55.373904+0000","last_change":"2024-09-21T03:24:55.373840+0000","last_active":"2024-09-21T03:24:55.373904+0000","last_peered":"2024-09-21T03:24:55.373904+0000","last_clean":"2024-09-21T03:24:55.373904+0000","last_became_active":"2024-09-21T03:14:37.473829+0000","last_became_peered":"2024-09-21T03:14:37.473829+0000","last_unstale":"2024-09-21T03:24:55.373904+0000","last_undegraded":"2024-09-21T03:24:55.373904+0000","last_fullsized":"2024-09-21T03:24:55.373904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-09-21T03:24:55.373736+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-09-21T03:24:55.373736+0000","last_clean_scrub_stamp":"2024-09-21T03:24:55.373736+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:20.191062+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":105,"num_write":29,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:08.849039+0000","last_change":"2024-09-21T03:25:08.849039+0000","last_active":"2024-09-21T03:25:08.849039+0000","last_peered":"2024-09-21T03:25:08.849039+0000","last_clean":"2024-09-21T03:25:08.849039+0000","last_became_active":"2024-09-21T03:14:46.542181+0000","last_became_peered":"2024-09-21T03:14:46.542181+0000","last_unstale":"2024-09-21T03:25:08.849039+0000","last_undegraded":"2024-09-21T03:25:08.849039+0000","last_fullsized":"2024-09-21T03:25:08.849039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-09-21T03:25:08.848944+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-09-21T03:25:08.848944+0000","last_clean_scrub_stamp":"2024-09-21T03:25:08.848944+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:42.532022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"27'2895","reported_seq":2916,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.325179+0000","last_change":"2024-09-21T03:14:47.569409+0000","last_active":"2024-09-21T03:24:45.325179+0000","last_peered":"2024-09-21T03:24:45.325179+0000","last_clean":"2024-09-21T03:24:45.325179+0000","last_became_active":"2024-09-21T03:14:47.569212+0000","last_became_peered":"2024-09-21T03:14:47.569212+0000","last_unstale":"2024-09-21T03:24:45.325179+0000","last_undegraded":"2024-09-21T03:24:45.325179+0000","last_fullsized":"2024-09-21T03:24:45.325179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2895,"log_dups_size":0,"ondisk_log_size":2895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:35.851943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42005,"num_write_kb":435585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"27'3096","reported_seq":3134,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:58.923988+0000","last_change":"2024-09-21T03:24:58.923930+0000","last_active":"2024-09-21T03:24:58.923988+0000","last_peered":"2024-09-21T03:24:58.923988+0000","last_clean":"2024-09-21T03:24:58.923988+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:24:58.923988+0000","last_undegraded":"2024-09-21T03:24:58.923988+0000","last_fullsized":"2024-09-21T03:24:58.923988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3096","last_scrub_stamp":"2024-09-21T03:24:58.923829+0000","last_deep_scrub":"27'3096","last_deep_scrub_stamp":"2024-09-21T03:24:58.923829+0000","last_clean_scrub_stamp":"2024-09-21T03:24:58.923829+0000","objects_scrubbed":0,"log_size":3096,"log_dups_size":0,"ondisk_log_size":3096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:18.363030+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45754,"num_write_kb":580793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'51","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:57.813970+0000","last_change":"2024-09-21T03:24:57.813970+0000","last_active":"2024-09-21T03:24:57.813970+0000","last_peered":"2024-09-21T03:24:57.813970+0000","last_clean":"2024-09-21T03:24:57.813970+0000","last_became_active":"2024-09-21T03:14:37.464228+0000","last_became_peered":"2024-09-21T03:14:37.464228+0000","last_unstale":"2024-09-21T03:24:57.813970+0000","last_undegraded":"2024-09-21T03:24:57.813970+0000","last_fullsized":"2024-09-21T03:24:57.813970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2024-09-21T03:24:57.813886+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2024-09-21T03:24:57.813886+0000","last_clean_scrub_stamp":"2024-09-21T03:24:57.813886+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:57.644809+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'360","reported_seq":383,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:35.060058+0000","last_change":"2024-09-21T03:14:46.538538+0000","last_active":"2024-09-21T03:24:35.060058+0000","last_peered":"2024-09-21T03:24:35.060058+0000","last_clean":"2024-09-21T03:24:35.060058+0000","last_became_active":"2024-09-21T03:14:46.537815+0000","last_became_peered":"2024-09-21T03:14:46.537815+0000","last_unstale":"2024-09-21T03:24:35.060058+0000","last_undegraded":"2024-09-21T03:24:35.060058+0000","last_fullsized":"2024-09-21T03:24:35.060058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:42.264439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"27'3082","reported_seq":3111,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:08.461573+0000","last_change":"2024-09-21T03:25:08.461573+0000","last_active":"2024-09-21T03:25:08.461573+0000","last_peered":"2024-09-21T03:25:08.461573+0000","last_clean":"2024-09-21T03:25:08.461573+0000","last_became_active":"2024-09-21T03:14:47.557305+0000","last_became_peered":"2024-09-21T03:14:47.557305+0000","last_unstale":"2024-09-21T03:25:08.461573+0000","last_undegraded":"2024-09-21T03:25:08.461573+0000","last_fullsized":"2024-09-21T03:25:08.461573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3082","last_scrub_stamp":"2024-09-21T03:25:08.461457+0000","last_deep_scrub":"27'3082","last_deep_scrub_stamp":"2024-09-21T03:25:08.461457+0000","last_clean_scrub_stamp":"2024-09-21T03:25:08.461457+0000","objects_scrubbed":0,"log_size":3082,"log_dups_size":0,"ondisk_log_size":3082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:51.731442+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44879,"num_write_kb":462177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'3149","reported_seq":3187,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:58.609945+0000","last_change":"2024-09-21T03:24:58.609879+0000","last_active":"2024-09-21T03:24:58.609945+0000","last_peered":"2024-09-21T03:24:58.609945+0000","last_clean":"2024-09-21T03:24:58.609945+0000","last_became_active":"2024-09-21T03:14:38.478842+0000","last_became_peered":"2024-09-21T03:14:38.478842+0000","last_unstale":"2024-09-21T03:24:58.609945+0000","last_undegraded":"2024-09-21T03:24:58.609945+0000","last_fullsized":"2024-09-21T03:24:58.609945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3149","last_scrub_stamp":"2024-09-21T03:24:58.609795+0000","last_deep_scrub":"27'3149","last_deep_scrub_stamp":"2024-09-21T03:24:58.609795+0000","last_clean_scrub_stamp":"2024-09-21T03:24:58.609795+0000","objects_scrubbed":0,"log_size":3149,"log_dups_size":0,"ondisk_log_size":3149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:01.183453+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46550,"num_write_kb":599066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:54.814992+0000","last_change":"2024-09-21T03:24:54.814888+0000","last_active":"2024-09-21T03:24:54.814992+0000","last_peered":"2024-09-21T03:24:54.814992+0000","last_clean":"2024-09-21T03:24:54.814992+0000","last_became_active":"2024-09-21T03:14:37.463674+0000","last_became_peered":"2024-09-21T03:14:37.463674+0000","last_unstale":"2024-09-21T03:24:54.814992+0000","last_undegraded":"2024-09-21T03:24:54.814992+0000","last_fullsized":"2024-09-21T03:24:54.814992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-09-21T03:24:54.814806+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-09-21T03:24:54.814806+0000","last_clean_scrub_stamp":"2024-09-21T03:24:54.814806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:38.484813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'74","reported_seq":138,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:52.658780+0000","last_change":"2024-09-21T03:24:52.658780+0000","last_active":"2024-09-21T03:24:52.658780+0000","last_peered":"2024-09-21T03:24:52.658780+0000","last_clean":"2024-09-21T03:24:52.658780+0000","last_became_active":"2024-09-21T03:14:26.341929+0000","last_became_peered":"2024-09-21T03:14:26.341929+0000","last_unstale":"2024-09-21T03:24:52.658780+0000","last_undegraded":"2024-09-21T03:24:52.658780+0000","last_fullsized":"2024-09-21T03:24:52.658780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'74","last_scrub_stamp":"2024-09-21T03:24:52.658698+0000","last_deep_scrub":"27'74","last_deep_scrub_stamp":"2024-09-21T03:24:52.658698+0000","last_clean_scrub_stamp":"2024-09-21T03:24:52.658698+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:11.245925+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'5","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:13.799413+0000","last_change":"2024-09-21T03:25:13.799413+0000","last_active":"2024-09-21T03:25:13.799413+0000","last_peered":"2024-09-21T03:25:13.799413+0000","last_clean":"2024-09-21T03:25:13.799413+0000","last_became_active":"2024-09-21T03:14:46.536753+0000","last_became_peered":"2024-09-21T03:14:46.536753+0000","last_unstale":"2024-09-21T03:25:13.799413+0000","last_undegraded":"2024-09-21T03:25:13.799413+0000","last_fullsized":"2024-09-21T03:25:13.799413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-21T03:25:13.799325+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-21T03:25:13.799325+0000","last_clean_scrub_stamp":"2024-09-21T03:25:13.799325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:43.080499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"27'2392","reported_seq":2413,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.297763+0000","last_change":"2024-09-21T03:14:47.552966+0000","last_active":"2024-09-21T03:24:45.297763+0000","last_peered":"2024-09-21T03:24:45.297763+0000","last_clean":"2024-09-21T03:24:45.297763+0000","last_became_active":"2024-09-21T03:14:47.552642+0000","last_became_peered":"2024-09-21T03:14:47.552642+0000","last_unstale":"2024-09-21T03:24:45.297763+0000","last_undegraded":"2024-09-21T03:24:45.297763+0000","last_fullsized":"2024-09-21T03:24:45.297763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2392,"log_dups_size":0,"ondisk_log_size":2392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:15.928026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34629,"num_write_kb":367496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"27'3146","reported_seq":3183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:03.658452+0000","last_change":"2024-09-21T03:25:03.658452+0000","last_active":"2024-09-21T03:25:03.658452+0000","last_peered":"2024-09-21T03:25:03.658452+0000","last_clean":"2024-09-21T03:25:03.658452+0000","last_became_active":"2024-09-21T03:14:38.478116+0000","last_became_peered":"2024-09-21T03:14:38.478116+0000","last_unstale":"2024-09-21T03:25:03.658452+0000","last_undegraded":"2024-09-21T03:25:03.658452+0000","last_fullsized":"2024-09-21T03:25:03.658452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3146","last_scrub_stamp":"2024-09-21T03:25:03.658345+0000","last_deep_scrub":"27'3146","last_deep_scrub_stamp":"2024-09-21T03:25:03.658345+0000","last_clean_scrub_stamp":"2024-09-21T03:25:03.658345+0000","objects_scrubbed":0,"log_size":3146,"log_dups_size":0,"ondisk_log_size":3146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:30.442847+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46299,"num_write_kb":593160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'3","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:54.778867+0000","last_change":"2024-09-21T03:24:54.778867+0000","last_active":"2024-09-21T03:24:54.778867+0000","last_peered":"2024-09-21T03:24:54.778867+0000","last_clean":"2024-09-21T03:24:54.778867+0000","last_became_active":"2024-09-21T03:14:37.479284+0000","last_became_peered":"2024-09-21T03:14:37.479284+0000","last_unstale":"2024-09-21T03:24:54.778867+0000","last_undegraded":"2024-09-21T03:24:54.778867+0000","last_fullsized":"2024-09-21T03:24:54.778867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-21T03:24:54.778776+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-21T03:24:54.778776+0000","last_clean_scrub_stamp":"2024-09-21T03:24:54.778776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:23.078542+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'33","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:00.737257+0000","last_change":"2024-09-21T03:25:00.737257+0000","last_active":"2024-09-21T03:25:00.737257+0000","last_peered":"2024-09-21T03:25:00.737257+0000","last_clean":"2024-09-21T03:25:00.737257+0000","last_became_active":"2024-09-21T03:14:46.531069+0000","last_became_peered":"2024-09-21T03:14:46.531069+0000","last_unstale":"2024-09-21T03:25:00.737257+0000","last_undegraded":"2024-09-21T03:25:00.737257+0000","last_fullsized":"2024-09-21T03:25:00.737257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2024-09-21T03:25:00.737165+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2024-09-21T03:25:00.737165+0000","last_clean_scrub_stamp":"2024-09-21T03:25:00.737165+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:06.466017+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"27'2640","reported_seq":2669,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:10.842843+0000","last_change":"2024-09-21T03:25:10.842843+0000","last_active":"2024-09-21T03:25:10.842843+0000","last_peered":"2024-09-21T03:25:10.842843+0000","last_clean":"2024-09-21T03:25:10.842843+0000","last_became_active":"2024-09-21T03:14:47.552712+0000","last_became_peered":"2024-09-21T03:14:47.552712+0000","last_unstale":"2024-09-21T03:25:10.842843+0000","last_undegraded":"2024-09-21T03:25:10.842843+0000","last_fullsized":"2024-09-21T03:25:10.842843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2640","last_scrub_stamp":"2024-09-21T03:25:10.842696+0000","last_deep_scrub":"27'2640","last_deep_scrub_stamp":"2024-09-21T03:25:10.842696+0000","last_clean_scrub_stamp":"2024-09-21T03:25:10.842696+0000","objects_scrubbed":0,"log_size":2640,"log_dups_size":0,"ondisk_log_size":2640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:30.888354+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38453,"num_write_kb":398220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'3285","reported_seq":3322,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:57.298479+0000","last_change":"2024-09-21T03:24:57.298479+0000","last_active":"2024-09-21T03:24:57.298479+0000","last_peered":"2024-09-21T03:24:57.298479+0000","last_clean":"2024-09-21T03:24:57.298479+0000","last_became_active":"2024-09-21T03:14:38.487420+0000","last_became_peered":"2024-09-21T03:14:38.487420+0000","last_unstale":"2024-09-21T03:24:57.298479+0000","last_undegraded":"2024-09-21T03:24:57.298479+0000","last_fullsized":"2024-09-21T03:24:57.298479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3285","last_scrub_stamp":"2024-09-21T03:24:57.298394+0000","last_deep_scrub":"27'3285","last_deep_scrub_stamp":"2024-09-21T03:24:57.298394+0000","last_clean_scrub_stamp":"2024-09-21T03:24:57.298394+0000","objects_scrubbed":0,"log_size":3285,"log_dups_size":0,"ondisk_log_size":3285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:16.767937+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48497,"num_write_kb":608493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'9","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:55.484974+0000","last_change":"2024-09-21T03:24:55.484974+0000","last_active":"2024-09-21T03:24:55.484974+0000","last_peered":"2024-09-21T03:24:55.484974+0000","last_clean":"2024-09-21T03:24:55.484974+0000","last_became_active":"2024-09-21T03:14:37.460320+0000","last_became_peered":"2024-09-21T03:14:37.460320+0000","last_unstale":"2024-09-21T03:24:55.484974+0000","last_undegraded":"2024-09-21T03:24:55.484974+0000","last_fullsized":"2024-09-21T03:24:55.484974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-09-21T03:24:55.484883+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-09-21T03:24:55.484883+0000","last_clean_scrub_stamp":"2024-09-21T03:24:55.484883+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:28.513539+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'470","reported_seq":501,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:10.403273+0000","last_change":"2024-09-21T03:25:10.403273+0000","last_active":"2024-09-21T03:25:10.403273+0000","last_peered":"2024-09-21T03:25:10.403273+0000","last_clean":"2024-09-21T03:25:10.403273+0000","last_became_active":"2024-09-21T03:14:46.540182+0000","last_became_peered":"2024-09-21T03:14:46.540182+0000","last_unstale":"2024-09-21T03:25:10.403273+0000","last_undegraded":"2024-09-21T03:25:10.403273+0000","last_fullsized":"2024-09-21T03:25:10.403273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'470","last_scrub_stamp":"2024-09-21T03:25:10.403178+0000","last_deep_scrub":"27'470","last_deep_scrub_stamp":"2024-09-21T03:25:10.403178+0000","last_clean_scrub_stamp":"2024-09-21T03:25:10.403178+0000","objects_scrubbed":3,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:08.919215+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8130523,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":458,"num_write_kb":8274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"27'2705","reported_seq":2734,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:02.499902+0000","last_change":"2024-09-21T03:25:02.499902+0000","last_active":"2024-09-21T03:25:02.499902+0000","last_peered":"2024-09-21T03:25:02.499902+0000","last_clean":"2024-09-21T03:25:02.499902+0000","last_became_active":"2024-09-21T03:14:47.552371+0000","last_became_peered":"2024-09-21T03:14:47.552371+0000","last_unstale":"2024-09-21T03:25:02.499902+0000","last_undegraded":"2024-09-21T03:25:02.499902+0000","last_fullsized":"2024-09-21T03:25:02.499902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2705","last_scrub_stamp":"2024-09-21T03:25:02.499767+0000","last_deep_scrub":"27'2705","last_deep_scrub_stamp":"2024-09-21T03:25:02.499767+0000","last_clean_scrub_stamp":"2024-09-21T03:25:02.499767+0000","objects_scrubbed":0,"log_size":2705,"log_dups_size":0,"ondisk_log_size":2705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:36.439460+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39343,"num_write_kb":410859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"27'3625","reported_seq":3662,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:58.315319+0000","last_change":"2024-09-21T03:24:58.315319+0000","last_active":"2024-09-21T03:24:58.315319+0000","last_peered":"2024-09-21T03:24:58.315319+0000","last_clean":"2024-09-21T03:24:58.315319+0000","last_became_active":"2024-09-21T03:14:38.474135+0000","last_became_peered":"2024-09-21T03:14:38.474135+0000","last_unstale":"2024-09-21T03:24:58.315319+0000","last_undegraded":"2024-09-21T03:24:58.315319+0000","last_fullsized":"2024-09-21T03:24:58.315319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3625","last_scrub_stamp":"2024-09-21T03:24:58.315226+0000","last_deep_scrub":"27'3625","last_deep_scrub_stamp":"2024-09-21T03:24:58.315226+0000","last_clean_scrub_stamp":"2024-09-21T03:24:58.315226+0000","objects_scrubbed":0,"log_size":3625,"log_dups_size":0,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:52.444411+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53421,"num_write_kb":673086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'15","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:54.582487+0000","last_change":"2024-09-21T03:24:54.582487+0000","last_active":"2024-09-21T03:24:54.582487+0000","last_peered":"2024-09-21T03:24:54.582487+0000","last_clean":"2024-09-21T03:24:54.582487+0000","last_became_active":"2024-09-21T03:14:37.472164+0000","last_became_peered":"2024-09-21T03:14:37.472164+0000","last_unstale":"2024-09-21T03:24:54.582487+0000","last_undegraded":"2024-09-21T03:24:54.582487+0000","last_fullsized":"2024-09-21T03:24:54.582487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-09-21T03:24:54.582392+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-09-21T03:24:54.582392+0000","last_clean_scrub_stamp":"2024-09-21T03:24:54.582392+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:13.201390+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'19","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.563185+0000","last_change":"2024-09-21T03:14:46.544828+0000","last_active":"2024-09-21T03:24:32.563185+0000","last_peered":"2024-09-21T03:24:32.563185+0000","last_clean":"2024-09-21T03:24:32.563185+0000","last_became_active":"2024-09-21T03:14:46.535901+0000","last_became_peered":"2024-09-21T03:14:46.535901+0000","last_unstale":"2024-09-21T03:24:32.563185+0000","last_undegraded":"2024-09-21T03:24:32.563185+0000","last_fullsized":"2024-09-21T03:24:32.563185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:08.608530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"27'3050","reported_seq":3079,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.835538+0000","last_change":"2024-09-21T03:25:09.835538+0000","last_active":"2024-09-21T03:25:09.835538+0000","last_peered":"2024-09-21T03:25:09.835538+0000","last_clean":"2024-09-21T03:25:09.835538+0000","last_became_active":"2024-09-21T03:14:47.556145+0000","last_became_peered":"2024-09-21T03:14:47.556145+0000","last_unstale":"2024-09-21T03:25:09.835538+0000","last_undegraded":"2024-09-21T03:25:09.835538+0000","last_fullsized":"2024-09-21T03:25:09.835538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3050","last_scrub_stamp":"2024-09-21T03:25:09.835435+0000","last_deep_scrub":"27'3050","last_deep_scrub_stamp":"2024-09-21T03:25:09.835435+0000","last_clean_scrub_stamp":"2024-09-21T03:25:09.835435+0000","objects_scrubbed":0,"log_size":3050,"log_dups_size":0,"ondisk_log_size":3050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:16.816041+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44445,"num_write_kb":452313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"27'2817","reported_seq":2854,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:55.687759+0000","last_change":"2024-09-21T03:24:55.687759+0000","last_active":"2024-09-21T03:24:55.687759+0000","last_peered":"2024-09-21T03:24:55.687759+0000","last_clean":"2024-09-21T03:24:55.687759+0000","last_became_active":"2024-09-21T03:14:38.468972+0000","last_became_peered":"2024-09-21T03:14:38.468972+0000","last_unstale":"2024-09-21T03:24:55.687759+0000","last_undegraded":"2024-09-21T03:24:55.687759+0000","last_fullsized":"2024-09-21T03:24:55.687759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2817","last_scrub_stamp":"2024-09-21T03:24:55.687670+0000","last_deep_scrub":"27'2817","last_deep_scrub_stamp":"2024-09-21T03:24:55.687670+0000","last_clean_scrub_stamp":"2024-09-21T03:24:55.687670+0000","objects_scrubbed":0,"log_size":2817,"log_dups_size":0,"ondisk_log_size":2817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:05.015811+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41476,"num_write_kb":540924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'12","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:50.264827+0000","last_change":"2024-09-21T03:24:50.264827+0000","last_active":"2024-09-21T03:24:50.264827+0000","last_peered":"2024-09-21T03:24:50.264827+0000","last_clean":"2024-09-21T03:24:50.264827+0000","last_became_active":"2024-09-21T03:14:37.478227+0000","last_became_peered":"2024-09-21T03:14:37.478227+0000","last_unstale":"2024-09-21T03:24:50.264827+0000","last_undegraded":"2024-09-21T03:24:50.264827+0000","last_fullsized":"2024-09-21T03:24:50.264827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-09-21T03:24:50.264373+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-09-21T03:24:50.264373+0000","last_clean_scrub_stamp":"2024-09-21T03:24:50.264373+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:32.434893+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'3","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:59.538310+0000","last_change":"2024-09-21T03:24:59.538310+0000","last_active":"2024-09-21T03:24:59.538310+0000","last_peered":"2024-09-21T03:24:59.538310+0000","last_clean":"2024-09-21T03:24:59.538310+0000","last_became_active":"2024-09-21T03:14:46.535445+0000","last_became_peered":"2024-09-21T03:14:46.535445+0000","last_unstale":"2024-09-21T03:24:59.538310+0000","last_undegraded":"2024-09-21T03:24:59.538310+0000","last_fullsized":"2024-09-21T03:24:59.538310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-21T03:24:59.538221+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-21T03:24:59.538221+0000","last_clean_scrub_stamp":"2024-09-21T03:24:59.538221+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:00.107079+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"27'2465","reported_seq":2486,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.350565+0000","last_change":"2024-09-21T03:14:47.557503+0000","last_active":"2024-09-21T03:24:45.350565+0000","last_peered":"2024-09-21T03:24:45.350565+0000","last_clean":"2024-09-21T03:24:45.350565+0000","last_became_active":"2024-09-21T03:14:47.554366+0000","last_became_peered":"2024-09-21T03:14:47.554366+0000","last_unstale":"2024-09-21T03:24:45.350565+0000","last_undegraded":"2024-09-21T03:24:45.350565+0000","last_fullsized":"2024-09-21T03:24:45.350565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2465,"log_dups_size":0,"ondisk_log_size":2465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.994560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35585,"num_write_kb":377642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'3460","reported_seq":3497,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:04.658494+0000","last_change":"2024-09-21T03:25:04.658494+0000","last_active":"2024-09-21T03:25:04.658494+0000","last_peered":"2024-09-21T03:25:04.658494+0000","last_clean":"2024-09-21T03:25:04.658494+0000","last_became_active":"2024-09-21T03:14:38.474826+0000","last_became_peered":"2024-09-21T03:14:38.474826+0000","last_unstale":"2024-09-21T03:25:04.658494+0000","last_undegraded":"2024-09-21T03:25:04.658494+0000","last_fullsized":"2024-09-21T03:25:04.658494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3460","last_scrub_stamp":"2024-09-21T03:25:04.658401+0000","last_deep_scrub":"27'3460","last_deep_scrub_stamp":"2024-09-21T03:25:04.658401+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.658401+0000","objects_scrubbed":0,"log_size":3460,"log_dups_size":0,"ondisk_log_size":3460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:41.448593+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51413,"num_write_kb":609416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'43","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:56.626904+0000","last_change":"2024-09-21T03:24:56.626904+0000","last_active":"2024-09-21T03:24:56.626904+0000","last_peered":"2024-09-21T03:24:56.626904+0000","last_clean":"2024-09-21T03:24:56.626904+0000","last_became_active":"2024-09-21T03:14:37.470720+0000","last_became_peered":"2024-09-21T03:14:37.470720+0000","last_unstale":"2024-09-21T03:24:56.626904+0000","last_undegraded":"2024-09-21T03:24:56.626904+0000","last_fullsized":"2024-09-21T03:24:56.626904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-09-21T03:24:56.626794+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-09-21T03:24:56.626794+0000","last_clean_scrub_stamp":"2024-09-21T03:24:56.626794+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:59.478860+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:32.582741+0000","last_change":"2024-09-21T03:14:46.538665+0000","last_active":"2024-09-21T03:24:32.582741+0000","last_peered":"2024-09-21T03:24:32.582741+0000","last_clean":"2024-09-21T03:24:32.582741+0000","last_became_active":"2024-09-21T03:14:46.537774+0000","last_became_peered":"2024-09-21T03:14:46.537774+0000","last_unstale":"2024-09-21T03:24:32.582741+0000","last_undegraded":"2024-09-21T03:24:32.582741+0000","last_fullsized":"2024-09-21T03:24:32.582741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:07.736404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"27'2987","reported_seq":3008,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.341975+0000","last_change":"2024-09-21T03:14:47.553011+0000","last_active":"2024-09-21T03:24:45.341975+0000","last_peered":"2024-09-21T03:24:45.341975+0000","last_clean":"2024-09-21T03:24:45.341975+0000","last_became_active":"2024-09-21T03:14:47.552700+0000","last_became_peered":"2024-09-21T03:14:47.552700+0000","last_unstale":"2024-09-21T03:24:45.341975+0000","last_undegraded":"2024-09-21T03:24:45.341975+0000","last_fullsized":"2024-09-21T03:24:45.341975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2987,"log_dups_size":0,"ondisk_log_size":2987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:58.780132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43190,"num_write_kb":444709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"27'3323","reported_seq":3360,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:53.643283+0000","last_change":"2024-09-21T03:24:53.643283+0000","last_active":"2024-09-21T03:24:53.643283+0000","last_peered":"2024-09-21T03:24:53.643283+0000","last_clean":"2024-09-21T03:24:53.643283+0000","last_became_active":"2024-09-21T03:14:38.471933+0000","last_became_peered":"2024-09-21T03:14:38.471933+0000","last_unstale":"2024-09-21T03:24:53.643283+0000","last_undegraded":"2024-09-21T03:24:53.643283+0000","last_fullsized":"2024-09-21T03:24:53.643283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3323","last_scrub_stamp":"2024-09-21T03:24:53.643188+0000","last_deep_scrub":"27'3323","last_deep_scrub_stamp":"2024-09-21T03:24:53.643188+0000","last_clean_scrub_stamp":"2024-09-21T03:24:53.643188+0000","objects_scrubbed":0,"log_size":3323,"log_dups_size":0,"ondisk_log_size":3323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:29.929917+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49154,"num_write_kb":612364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:51.286647+0000","last_change":"2024-09-21T03:24:51.286647+0000","last_active":"2024-09-21T03:24:51.286647+0000","last_peered":"2024-09-21T03:24:51.286647+0000","last_clean":"2024-09-21T03:24:51.286647+0000","last_became_active":"2024-09-21T03:14:37.477951+0000","last_became_peered":"2024-09-21T03:14:37.477951+0000","last_unstale":"2024-09-21T03:24:51.286647+0000","last_undegraded":"2024-09-21T03:24:51.286647+0000","last_fullsized":"2024-09-21T03:24:51.286647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-09-21T03:24:51.286569+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-09-21T03:24:51.286569+0000","last_clean_scrub_stamp":"2024-09-21T03:24:51.286569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:56.560513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:26.343821+0000","last_change":"2024-09-21T03:14:46.546142+0000","last_active":"2024-09-21T03:24:26.343821+0000","last_peered":"2024-09-21T03:24:26.343821+0000","last_clean":"2024-09-21T03:24:26.343821+0000","last_became_active":"2024-09-21T03:14:46.545865+0000","last_became_peered":"2024-09-21T03:14:46.545865+0000","last_unstale":"2024-09-21T03:24:26.343821+0000","last_undegraded":"2024-09-21T03:24:26.343821+0000","last_fullsized":"2024-09-21T03:24:26.343821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:11.705309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"27'2779","reported_seq":2806,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.354268+0000","last_change":"2024-09-21T03:19:03.558620+0000","last_active":"2024-09-21T03:24:45.354268+0000","last_peered":"2024-09-21T03:24:45.354268+0000","last_clean":"2024-09-21T03:24:45.354268+0000","last_became_active":"2024-09-21T03:14:47.568656+0000","last_became_peered":"2024-09-21T03:14:47.568656+0000","last_unstale":"2024-09-21T03:24:45.354268+0000","last_undegraded":"2024-09-21T03:24:45.354268+0000","last_fullsized":"2024-09-21T03:24:45.354268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2779,"log_dups_size":0,"ondisk_log_size":2779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:50.041710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40461,"num_write_kb":415650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'3337","reported_seq":3374,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.632675+0000","last_change":"2024-09-21T03:25:05.632675+0000","last_active":"2024-09-21T03:25:05.632675+0000","last_peered":"2024-09-21T03:25:05.632675+0000","last_clean":"2024-09-21T03:25:05.632675+0000","last_became_active":"2024-09-21T03:14:38.485235+0000","last_became_peered":"2024-09-21T03:14:38.485235+0000","last_unstale":"2024-09-21T03:25:05.632675+0000","last_undegraded":"2024-09-21T03:25:05.632675+0000","last_fullsized":"2024-09-21T03:25:05.632675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3337","last_scrub_stamp":"2024-09-21T03:25:05.632583+0000","last_deep_scrub":"27'3337","last_deep_scrub_stamp":"2024-09-21T03:25:05.632583+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.632583+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:00.981106+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48941,"num_write_kb":642004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:56.792042+0000","last_change":"2024-09-21T03:24:56.792042+0000","last_active":"2024-09-21T03:24:56.792042+0000","last_peered":"2024-09-21T03:24:56.792042+0000","last_clean":"2024-09-21T03:24:56.792042+0000","last_became_active":"2024-09-21T03:14:37.465817+0000","last_became_peered":"2024-09-21T03:14:37.465817+0000","last_unstale":"2024-09-21T03:24:56.792042+0000","last_undegraded":"2024-09-21T03:24:56.792042+0000","last_fullsized":"2024-09-21T03:24:56.792042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-21T03:24:56.791950+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-21T03:24:56.791950+0000","last_clean_scrub_stamp":"2024-09-21T03:24:56.791950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:09.813730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'233","reported_seq":264,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.864621+0000","last_change":"2024-09-21T03:25:07.864621+0000","last_active":"2024-09-21T03:25:07.864621+0000","last_peered":"2024-09-21T03:25:07.864621+0000","last_clean":"2024-09-21T03:25:07.864621+0000","last_became_active":"2024-09-21T03:14:46.549119+0000","last_became_peered":"2024-09-21T03:14:46.549119+0000","last_unstale":"2024-09-21T03:25:07.864621+0000","last_undegraded":"2024-09-21T03:25:07.864621+0000","last_fullsized":"2024-09-21T03:25:07.864621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'233","last_scrub_stamp":"2024-09-21T03:25:07.864499+0000","last_deep_scrub":"27'233","last_deep_scrub_stamp":"2024-09-21T03:25:07.864499+0000","last_clean_scrub_stamp":"2024-09-21T03:25:07.864499+0000","objects_scrubbed":4,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:36.987208+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"27'3932","reported_seq":3947,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.330162+0000","last_change":"2024-09-21T03:15:15.687659+0000","last_active":"2024-09-21T03:24:45.330162+0000","last_peered":"2024-09-21T03:24:45.330162+0000","last_clean":"2024-09-21T03:24:45.330162+0000","last_became_active":"2024-09-21T03:15:15.687225+0000","last_became_peered":"2024-09-21T03:15:15.687225+0000","last_unstale":"2024-09-21T03:24:45.330162+0000","last_undegraded":"2024-09-21T03:24:45.330162+0000","last_fullsized":"2024-09-21T03:24:45.330162+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3932,"log_dups_size":0,"ondisk_log_size":3932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:56.395767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57021,"num_write_kb":587488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"27'3064","reported_seq":3101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:59.881290+0000","last_change":"2024-09-21T03:24:59.881290+0000","last_active":"2024-09-21T03:24:59.881290+0000","last_peered":"2024-09-21T03:24:59.881290+0000","last_clean":"2024-09-21T03:24:59.881290+0000","last_became_active":"2024-09-21T03:14:38.482241+0000","last_became_peered":"2024-09-21T03:14:38.482241+0000","last_unstale":"2024-09-21T03:24:59.881290+0000","last_undegraded":"2024-09-21T03:24:59.881290+0000","last_fullsized":"2024-09-21T03:24:59.881290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3064","last_scrub_stamp":"2024-09-21T03:24:59.881166+0000","last_deep_scrub":"27'3064","last_deep_scrub_stamp":"2024-09-21T03:24:59.881166+0000","last_clean_scrub_stamp":"2024-09-21T03:24:59.881166+0000","objects_scrubbed":0,"log_size":3064,"log_dups_size":0,"ondisk_log_size":3064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:36:54.659394+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45418,"num_write_kb":562843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'23","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:56.382960+0000","last_change":"2024-09-21T03:24:56.382960+0000","last_active":"2024-09-21T03:24:56.382960+0000","last_peered":"2024-09-21T03:24:56.382960+0000","last_clean":"2024-09-21T03:24:56.382960+0000","last_became_active":"2024-09-21T03:14:37.478882+0000","last_became_peered":"2024-09-21T03:14:37.478882+0000","last_unstale":"2024-09-21T03:24:56.382960+0000","last_undegraded":"2024-09-21T03:24:56.382960+0000","last_fullsized":"2024-09-21T03:24:56.382960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-09-21T03:24:56.382871+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-09-21T03:24:56.382871+0000","last_clean_scrub_stamp":"2024-09-21T03:24:56.382871+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:04.672006+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'22","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:33.062661+0000","last_change":"2024-09-21T03:14:46.538817+0000","last_active":"2024-09-21T03:24:33.062661+0000","last_peered":"2024-09-21T03:24:33.062661+0000","last_clean":"2024-09-21T03:24:33.062661+0000","last_became_active":"2024-09-21T03:14:46.537835+0000","last_became_peered":"2024-09-21T03:14:46.537835+0000","last_unstale":"2024-09-21T03:24:33.062661+0000","last_undegraded":"2024-09-21T03:24:33.062661+0000","last_fullsized":"2024-09-21T03:24:33.062661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:08.236663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"27'3365","reported_seq":3386,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.359474+0000","last_change":"2024-09-21T03:14:47.566534+0000","last_active":"2024-09-21T03:24:45.359474+0000","last_peered":"2024-09-21T03:24:45.359474+0000","last_clean":"2024-09-21T03:24:45.359474+0000","last_became_active":"2024-09-21T03:14:47.566157+0000","last_became_peered":"2024-09-21T03:14:47.566157+0000","last_unstale":"2024-09-21T03:24:45.359474+0000","last_undegraded":"2024-09-21T03:24:45.359474+0000","last_fullsized":"2024-09-21T03:24:45.359474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3365,"log_dups_size":0,"ondisk_log_size":3365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:35.557811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48864,"num_write_kb":499368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"27'2812","reported_seq":2849,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:00.375612+0000","last_change":"2024-09-21T03:25:00.375612+0000","last_active":"2024-09-21T03:25:00.375612+0000","last_peered":"2024-09-21T03:25:00.375612+0000","last_clean":"2024-09-21T03:25:00.375612+0000","last_became_active":"2024-09-21T03:14:38.478197+0000","last_became_peered":"2024-09-21T03:14:38.478197+0000","last_unstale":"2024-09-21T03:25:00.375612+0000","last_undegraded":"2024-09-21T03:25:00.375612+0000","last_fullsized":"2024-09-21T03:25:00.375612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2812","last_scrub_stamp":"2024-09-21T03:25:00.375509+0000","last_deep_scrub":"27'2812","last_deep_scrub_stamp":"2024-09-21T03:25:00.375509+0000","last_clean_scrub_stamp":"2024-09-21T03:25:00.375509+0000","objects_scrubbed":0,"log_size":2812,"log_dups_size":0,"ondisk_log_size":2812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:21.965006+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41544,"num_write_kb":533190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'239","reported_seq":278,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:51.702240+0000","last_change":"2024-09-21T03:24:51.702240+0000","last_active":"2024-09-21T03:24:51.702240+0000","last_peered":"2024-09-21T03:24:51.702240+0000","last_clean":"2024-09-21T03:24:51.702240+0000","last_became_active":"2024-09-21T03:14:37.472374+0000","last_became_peered":"2024-09-21T03:14:37.472374+0000","last_unstale":"2024-09-21T03:24:51.702240+0000","last_undegraded":"2024-09-21T03:24:51.702240+0000","last_fullsized":"2024-09-21T03:24:51.702240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'239","last_scrub_stamp":"2024-09-21T03:24:51.702166+0000","last_deep_scrub":"27'239","last_deep_scrub_stamp":"2024-09-21T03:24:51.702166+0000","last_clean_scrub_stamp":"2024-09-21T03:24:51.702166+0000","objects_scrubbed":6,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:39.767588+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":12446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'5","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.670277+0000","last_change":"2024-09-21T03:25:07.670277+0000","last_active":"2024-09-21T03:25:07.670277+0000","last_peered":"2024-09-21T03:25:07.670277+0000","last_clean":"2024-09-21T03:25:07.670277+0000","last_became_active":"2024-09-21T03:14:46.547192+0000","last_became_peered":"2024-09-21T03:14:46.547192+0000","last_unstale":"2024-09-21T03:25:07.670277+0000","last_undegraded":"2024-09-21T03:25:07.670277+0000","last_fullsized":"2024-09-21T03:25:07.670277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-21T03:25:07.670175+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-21T03:25:07.670175+0000","last_clean_scrub_stamp":"2024-09-21T03:25:07.670175+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:07.667049+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"27'2738","reported_seq":2767,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:12.830833+0000","last_change":"2024-09-21T03:25:12.830833+0000","last_active":"2024-09-21T03:25:12.830833+0000","last_peered":"2024-09-21T03:25:12.830833+0000","last_clean":"2024-09-21T03:25:12.830833+0000","last_became_active":"2024-09-21T03:14:47.545440+0000","last_became_peered":"2024-09-21T03:14:47.545440+0000","last_unstale":"2024-09-21T03:25:12.830833+0000","last_undegraded":"2024-09-21T03:25:12.830833+0000","last_fullsized":"2024-09-21T03:25:12.830833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2738","last_scrub_stamp":"2024-09-21T03:25:12.830715+0000","last_deep_scrub":"27'2738","last_deep_scrub_stamp":"2024-09-21T03:25:12.830715+0000","last_clean_scrub_stamp":"2024-09-21T03:25:12.830715+0000","objects_scrubbed":0,"log_size":2738,"log_dups_size":0,"ondisk_log_size":2738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:21.957527+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39786,"num_write_kb":413571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"27'4240","reported_seq":4277,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.683106+0000","last_change":"2024-09-21T03:25:06.683106+0000","last_active":"2024-09-21T03:25:06.683106+0000","last_peered":"2024-09-21T03:25:06.683106+0000","last_clean":"2024-09-21T03:25:06.683106+0000","last_became_active":"2024-09-21T03:14:38.476158+0000","last_became_peered":"2024-09-21T03:14:38.476158+0000","last_unstale":"2024-09-21T03:25:06.683106+0000","last_undegraded":"2024-09-21T03:25:06.683106+0000","last_fullsized":"2024-09-21T03:25:06.683106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4240","last_scrub_stamp":"2024-09-21T03:25:06.683026+0000","last_deep_scrub":"27'4240","last_deep_scrub_stamp":"2024-09-21T03:25:06.683026+0000","last_clean_scrub_stamp":"2024-09-21T03:25:06.683026+0000","objects_scrubbed":0,"log_size":4240,"log_dups_size":0,"ondisk_log_size":4240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:22.948780+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63095,"num_write_kb":776596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'36","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:57.344640+0000","last_change":"2024-09-21T03:24:57.344640+0000","last_active":"2024-09-21T03:24:57.344640+0000","last_peered":"2024-09-21T03:24:57.344640+0000","last_clean":"2024-09-21T03:24:57.344640+0000","last_became_active":"2024-09-21T03:14:37.472544+0000","last_became_peered":"2024-09-21T03:14:37.472544+0000","last_unstale":"2024-09-21T03:24:57.344640+0000","last_undegraded":"2024-09-21T03:24:57.344640+0000","last_fullsized":"2024-09-21T03:24:57.344640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-09-21T03:24:57.344345+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-09-21T03:24:57.344345+0000","last_clean_scrub_stamp":"2024-09-21T03:24:57.344345+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:06.924018+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'55","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:04.747323+0000","last_change":"2024-09-21T03:25:04.747323+0000","last_active":"2024-09-21T03:25:04.747323+0000","last_peered":"2024-09-21T03:25:04.747323+0000","last_clean":"2024-09-21T03:25:04.747323+0000","last_became_active":"2024-09-21T03:14:46.533891+0000","last_became_peered":"2024-09-21T03:14:46.533891+0000","last_unstale":"2024-09-21T03:25:04.747323+0000","last_undegraded":"2024-09-21T03:25:04.747323+0000","last_fullsized":"2024-09-21T03:25:04.747323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2024-09-21T03:25:04.747236+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2024-09-21T03:25:04.747236+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.747236+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:52.821848+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":8218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"27'3050","reported_seq":3071,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.318616+0000","last_change":"2024-09-21T03:14:47.552016+0000","last_active":"2024-09-21T03:24:45.318616+0000","last_peered":"2024-09-21T03:24:45.318616+0000","last_clean":"2024-09-21T03:24:45.318616+0000","last_became_active":"2024-09-21T03:14:47.551622+0000","last_became_peered":"2024-09-21T03:14:47.551622+0000","last_unstale":"2024-09-21T03:24:45.318616+0000","last_undegraded":"2024-09-21T03:24:45.318616+0000","last_fullsized":"2024-09-21T03:24:45.318616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3050,"log_dups_size":0,"ondisk_log_size":3050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:56:04.849535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44676,"num_write_kb":453348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'2866","reported_seq":2903,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:59.502557+0000","last_change":"2024-09-21T03:24:59.502557+0000","last_active":"2024-09-21T03:24:59.502557+0000","last_peered":"2024-09-21T03:24:59.502557+0000","last_clean":"2024-09-21T03:24:59.502557+0000","last_became_active":"2024-09-21T03:14:38.483348+0000","last_became_peered":"2024-09-21T03:14:38.483348+0000","last_unstale":"2024-09-21T03:24:59.502557+0000","last_undegraded":"2024-09-21T03:24:59.502557+0000","last_fullsized":"2024-09-21T03:24:59.502557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2866","last_scrub_stamp":"2024-09-21T03:24:59.502442+0000","last_deep_scrub":"27'2866","last_deep_scrub_stamp":"2024-09-21T03:24:59.502442+0000","last_clean_scrub_stamp":"2024-09-21T03:24:59.502442+0000","objects_scrubbed":0,"log_size":2866,"log_dups_size":0,"ondisk_log_size":2866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:14.399805+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42315,"num_write_kb":514746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'15","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:52.319636+0000","last_change":"2024-09-21T03:24:52.319636+0000","last_active":"2024-09-21T03:24:52.319636+0000","last_peered":"2024-09-21T03:24:52.319636+0000","last_clean":"2024-09-21T03:24:52.319636+0000","last_became_active":"2024-09-21T03:14:37.478700+0000","last_became_peered":"2024-09-21T03:14:37.478700+0000","last_unstale":"2024-09-21T03:24:52.319636+0000","last_undegraded":"2024-09-21T03:24:52.319636+0000","last_fullsized":"2024-09-21T03:24:52.319636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-09-21T03:24:52.319558+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-09-21T03:24:52.319558+0000","last_clean_scrub_stamp":"2024-09-21T03:24:52.319558+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:27:43.884491+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'16","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:02.292183+0000","last_change":"2024-09-21T03:25:02.292183+0000","last_active":"2024-09-21T03:25:02.292183+0000","last_peered":"2024-09-21T03:25:02.292183+0000","last_clean":"2024-09-21T03:25:02.292183+0000","last_became_active":"2024-09-21T03:14:46.546867+0000","last_became_peered":"2024-09-21T03:14:46.546867+0000","last_unstale":"2024-09-21T03:25:02.292183+0000","last_undegraded":"2024-09-21T03:25:02.292183+0000","last_fullsized":"2024-09-21T03:25:02.292183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-09-21T03:25:02.292070+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-09-21T03:25:02.292070+0000","last_clean_scrub_stamp":"2024-09-21T03:25:02.292070+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:01.854203+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"27'3248","reported_seq":3277,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.688672+0000","last_change":"2024-09-21T03:25:05.688672+0000","last_active":"2024-09-21T03:25:05.688672+0000","last_peered":"2024-09-21T03:25:05.688672+0000","last_clean":"2024-09-21T03:25:05.688672+0000","last_became_active":"2024-09-21T03:14:47.558037+0000","last_became_peered":"2024-09-21T03:14:47.558037+0000","last_unstale":"2024-09-21T03:25:05.688672+0000","last_undegraded":"2024-09-21T03:25:05.688672+0000","last_fullsized":"2024-09-21T03:25:05.688672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3248","last_scrub_stamp":"2024-09-21T03:25:05.688592+0000","last_deep_scrub":"27'3248","last_deep_scrub_stamp":"2024-09-21T03:25:05.688592+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.688592+0000","objects_scrubbed":0,"log_size":3248,"log_dups_size":0,"ondisk_log_size":3248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:46.293035+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47392,"num_write_kb":480920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"27'3071","reported_seq":3108,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:52.705841+0000","last_change":"2024-09-21T03:24:52.705841+0000","last_active":"2024-09-21T03:24:52.705841+0000","last_peered":"2024-09-21T03:24:52.705841+0000","last_clean":"2024-09-21T03:24:52.705841+0000","last_became_active":"2024-09-21T03:14:38.482370+0000","last_became_peered":"2024-09-21T03:14:38.482370+0000","last_unstale":"2024-09-21T03:24:52.705841+0000","last_undegraded":"2024-09-21T03:24:52.705841+0000","last_fullsized":"2024-09-21T03:24:52.705841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3071","last_scrub_stamp":"2024-09-21T03:24:52.705738+0000","last_deep_scrub":"27'3071","last_deep_scrub_stamp":"2024-09-21T03:24:52.705738+0000","last_clean_scrub_stamp":"2024-09-21T03:24:52.705738+0000","objects_scrubbed":0,"log_size":3071,"log_dups_size":0,"ondisk_log_size":3071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:13.109136+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45203,"num_write_kb":570065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:51.637324+0000","last_change":"2024-09-21T03:24:51.637324+0000","last_active":"2024-09-21T03:24:51.637324+0000","last_peered":"2024-09-21T03:24:51.637324+0000","last_clean":"2024-09-21T03:24:51.637324+0000","last_became_active":"2024-09-21T03:14:37.471002+0000","last_became_peered":"2024-09-21T03:14:37.471002+0000","last_unstale":"2024-09-21T03:24:51.637324+0000","last_undegraded":"2024-09-21T03:24:51.637324+0000","last_fullsized":"2024-09-21T03:24:51.637324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-09-21T03:24:51.637239+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-09-21T03:24:51.637239+0000","last_clean_scrub_stamp":"2024-09-21T03:24:51.637239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:49.069586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.664314+0000","last_change":"2024-09-21T03:25:06.664314+0000","last_active":"2024-09-21T03:25:06.664314+0000","last_peered":"2024-09-21T03:25:06.664314+0000","last_clean":"2024-09-21T03:25:06.664314+0000","last_became_active":"2024-09-21T03:14:46.543647+0000","last_became_peered":"2024-09-21T03:14:46.543647+0000","last_unstale":"2024-09-21T03:25:06.664314+0000","last_undegraded":"2024-09-21T03:25:06.664314+0000","last_fullsized":"2024-09-21T03:25:06.664314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-09-21T03:25:06.664221+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-09-21T03:25:06.664221+0000","last_clean_scrub_stamp":"2024-09-21T03:25:06.664221+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:00.963769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"27'3498","reported_seq":3527,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:08.715181+0000","last_change":"2024-09-21T03:25:08.715181+0000","last_active":"2024-09-21T03:25:08.715181+0000","last_peered":"2024-09-21T03:25:08.715181+0000","last_clean":"2024-09-21T03:25:08.715181+0000","last_became_active":"2024-09-21T03:14:47.551563+0000","last_became_peered":"2024-09-21T03:14:47.551563+0000","last_unstale":"2024-09-21T03:25:08.715181+0000","last_undegraded":"2024-09-21T03:25:08.715181+0000","last_fullsized":"2024-09-21T03:25:08.715181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3498","last_scrub_stamp":"2024-09-21T03:25:08.715088+0000","last_deep_scrub":"27'3498","last_deep_scrub_stamp":"2024-09-21T03:25:08.715088+0000","last_clean_scrub_stamp":"2024-09-21T03:25:08.715088+0000","objects_scrubbed":0,"log_size":3498,"log_dups_size":0,"ondisk_log_size":3498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:52.596975+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50774,"num_write_kb":531933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"27'33","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:08.700265+0000","last_change":"2024-09-21T03:25:08.700265+0000","last_active":"2024-09-21T03:25:08.700265+0000","last_peered":"2024-09-21T03:25:08.700265+0000","last_clean":"2024-09-21T03:25:08.700265+0000","last_became_active":"2024-09-21T03:14:46.541771+0000","last_became_peered":"2024-09-21T03:14:46.541771+0000","last_unstale":"2024-09-21T03:25:08.700265+0000","last_undegraded":"2024-09-21T03:25:08.700265+0000","last_fullsized":"2024-09-21T03:25:08.700265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2024-09-21T03:25:08.700167+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2024-09-21T03:25:08.700167+0000","last_clean_scrub_stamp":"2024-09-21T03:25:08.700167+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:23:59.466680+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'3639","reported_seq":3676,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:02.663553+0000","last_change":"2024-09-21T03:25:02.663553+0000","last_active":"2024-09-21T03:25:02.663553+0000","last_peered":"2024-09-21T03:25:02.663553+0000","last_clean":"2024-09-21T03:25:02.663553+0000","last_became_active":"2024-09-21T03:14:38.478400+0000","last_became_peered":"2024-09-21T03:14:38.478400+0000","last_unstale":"2024-09-21T03:25:02.663553+0000","last_undegraded":"2024-09-21T03:25:02.663553+0000","last_fullsized":"2024-09-21T03:25:02.663553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3639","last_scrub_stamp":"2024-09-21T03:25:02.663449+0000","last_deep_scrub":"27'3639","last_deep_scrub_stamp":"2024-09-21T03:25:02.663449+0000","last_clean_scrub_stamp":"2024-09-21T03:25:02.663449+0000","objects_scrubbed":0,"log_size":3639,"log_dups_size":0,"ondisk_log_size":3639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:04.399421+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53758,"num_write_kb":679942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'31","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:00.722304+0000","last_change":"2024-09-21T03:25:00.722304+0000","last_active":"2024-09-21T03:25:00.722304+0000","last_peered":"2024-09-21T03:25:00.722304+0000","last_clean":"2024-09-21T03:25:00.722304+0000","last_became_active":"2024-09-21T03:14:37.458676+0000","last_became_peered":"2024-09-21T03:14:37.458676+0000","last_unstale":"2024-09-21T03:25:00.722304+0000","last_undegraded":"2024-09-21T03:25:00.722304+0000","last_fullsized":"2024-09-21T03:25:00.722304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-09-21T03:25:00.722199+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-09-21T03:25:00.722199+0000","last_clean_scrub_stamp":"2024-09-21T03:25:00.722199+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:00:43.809124+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"27'3281","reported_seq":3311,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:11.843385+0000","last_change":"2024-09-21T03:25:11.843385+0000","last_active":"2024-09-21T03:25:11.843385+0000","last_peered":"2024-09-21T03:25:11.843385+0000","last_clean":"2024-09-21T03:25:11.843385+0000","last_became_active":"2024-09-21T03:14:47.557224+0000","last_became_peered":"2024-09-21T03:14:47.557224+0000","last_unstale":"2024-09-21T03:25:11.843385+0000","last_undegraded":"2024-09-21T03:25:11.843385+0000","last_fullsized":"2024-09-21T03:25:11.843385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3281","last_scrub_stamp":"2024-09-21T03:25:11.843293+0000","last_deep_scrub":"27'3281","last_deep_scrub_stamp":"2024-09-21T03:25:11.843293+0000","last_clean_scrub_stamp":"2024-09-21T03:25:11.843293+0000","objects_scrubbed":0,"log_size":3281,"log_dups_size":0,"ondisk_log_size":3281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:25.461361+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47961,"num_write_kb":483752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"27'8","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:23:02.449845+0000","last_change":"2024-09-21T03:14:46.543157+0000","last_active":"2024-09-21T03:23:02.449845+0000","last_peered":"2024-09-21T03:23:02.449845+0000","last_clean":"2024-09-21T03:23:02.449845+0000","last_became_active":"2024-09-21T03:14:46.542746+0000","last_became_peered":"2024-09-21T03:14:46.542746+0000","last_unstale":"2024-09-21T03:23:02.449845+0000","last_undegraded":"2024-09-21T03:23:02.449845+0000","last_fullsized":"2024-09-21T03:23:02.449845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:45.508021+0000","last_clean_scrub_stamp":"2024-09-21T03:14:45.508021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'3052","reported_seq":3089,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:00.494226+0000","last_change":"2024-09-21T03:25:00.494226+0000","last_active":"2024-09-21T03:25:00.494226+0000","last_peered":"2024-09-21T03:25:00.494226+0000","last_clean":"2024-09-21T03:25:00.494226+0000","last_became_active":"2024-09-21T03:14:38.472823+0000","last_became_peered":"2024-09-21T03:14:38.472823+0000","last_unstale":"2024-09-21T03:25:00.494226+0000","last_undegraded":"2024-09-21T03:25:00.494226+0000","last_fullsized":"2024-09-21T03:25:00.494226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3052","last_scrub_stamp":"2024-09-21T03:25:00.494132+0000","last_deep_scrub":"27'3052","last_deep_scrub_stamp":"2024-09-21T03:25:00.494132+0000","last_clean_scrub_stamp":"2024-09-21T03:25:00.494132+0000","objects_scrubbed":0,"log_size":3052,"log_dups_size":0,"ondisk_log_size":3052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:02.275963+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44791,"num_write_kb":578211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'18","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:56.843576+0000","last_change":"2024-09-21T03:24:56.843576+0000","last_active":"2024-09-21T03:24:56.843576+0000","last_peered":"2024-09-21T03:24:56.843576+0000","last_clean":"2024-09-21T03:24:56.843576+0000","last_became_active":"2024-09-21T03:14:37.471771+0000","last_became_peered":"2024-09-21T03:14:37.471771+0000","last_unstale":"2024-09-21T03:24:56.843576+0000","last_undegraded":"2024-09-21T03:24:56.843576+0000","last_fullsized":"2024-09-21T03:24:56.843576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-09-21T03:24:56.843462+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-09-21T03:24:56.843462+0000","last_clean_scrub_stamp":"2024-09-21T03:24:56.843462+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:47.003731+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"27'3552","reported_seq":3573,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.364792+0000","last_change":"2024-09-21T03:14:47.570651+0000","last_active":"2024-09-21T03:24:45.364792+0000","last_peered":"2024-09-21T03:24:45.364792+0000","last_clean":"2024-09-21T03:24:45.364792+0000","last_became_active":"2024-09-21T03:14:47.568081+0000","last_became_peered":"2024-09-21T03:14:47.568081+0000","last_unstale":"2024-09-21T03:24:45.364792+0000","last_undegraded":"2024-09-21T03:24:45.364792+0000","last_fullsized":"2024-09-21T03:24:45.364792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51450,"num_write_kb":532295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"27'36","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:59.753269+0000","last_change":"2024-09-21T03:24:59.753269+0000","last_active":"2024-09-21T03:24:59.753269+0000","last_peered":"2024-09-21T03:24:59.753269+0000","last_clean":"2024-09-21T03:24:59.753269+0000","last_became_active":"2024-09-21T03:14:37.474595+0000","last_became_peered":"2024-09-21T03:14:37.474595+0000","last_unstale":"2024-09-21T03:24:59.753269+0000","last_undegraded":"2024-09-21T03:24:59.753269+0000","last_fullsized":"2024-09-21T03:24:59.753269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-09-21T03:24:59.753174+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-09-21T03:24:59.753174+0000","last_clean_scrub_stamp":"2024-09-21T03:24:59.753174+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:11.825438+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2516","reported_seq":2553,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:03.658699+0000","last_change":"2024-09-21T03:25:03.658699+0000","last_active":"2024-09-21T03:25:03.658699+0000","last_peered":"2024-09-21T03:25:03.658699+0000","last_clean":"2024-09-21T03:25:03.658699+0000","last_became_active":"2024-09-21T03:14:38.482354+0000","last_became_peered":"2024-09-21T03:14:38.482354+0000","last_unstale":"2024-09-21T03:25:03.658699+0000","last_undegraded":"2024-09-21T03:25:03.658699+0000","last_fullsized":"2024-09-21T03:25:03.658699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2516","last_scrub_stamp":"2024-09-21T03:25:03.658584+0000","last_deep_scrub":"27'2516","last_deep_scrub_stamp":"2024-09-21T03:25:03.658584+0000","last_clean_scrub_stamp":"2024-09-21T03:25:03.658584+0000","objects_scrubbed":0,"log_size":2516,"log_dups_size":0,"ondisk_log_size":2516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:53.542866+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37096,"num_write_kb":460963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'36","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.743143+0000","last_change":"2024-09-21T03:25:09.743143+0000","last_active":"2024-09-21T03:25:09.743143+0000","last_peered":"2024-09-21T03:25:09.743143+0000","last_clean":"2024-09-21T03:25:09.743143+0000","last_became_active":"2024-09-21T03:14:46.550191+0000","last_became_peered":"2024-09-21T03:14:46.550191+0000","last_unstale":"2024-09-21T03:25:09.743143+0000","last_undegraded":"2024-09-21T03:25:09.743143+0000","last_fullsized":"2024-09-21T03:25:09.743143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-09-21T03:25:09.743050+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-09-21T03:25:09.743050+0000","last_clean_scrub_stamp":"2024-09-21T03:25:09.743050+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:36.573960+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"27'2120","reported_seq":2155,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.696039+0000","last_change":"2024-09-21T03:25:07.696039+0000","last_active":"2024-09-21T03:25:07.696039+0000","last_peered":"2024-09-21T03:25:07.696039+0000","last_clean":"2024-09-21T03:25:07.696039+0000","last_became_active":"2024-09-21T03:15:15.686063+0000","last_became_peered":"2024-09-21T03:15:15.686063+0000","last_unstale":"2024-09-21T03:25:07.696039+0000","last_undegraded":"2024-09-21T03:25:07.696039+0000","last_fullsized":"2024-09-21T03:25:07.696039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2120","last_scrub_stamp":"2024-09-21T03:25:07.695898+0000","last_deep_scrub":"27'2120","last_deep_scrub_stamp":"2024-09-21T03:25:07.695898+0000","last_clean_scrub_stamp":"2024-09-21T03:25:07.695898+0000","objects_scrubbed":0,"log_size":2120,"log_dups_size":0,"ondisk_log_size":2120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:35.021288+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30729,"num_write_kb":315555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1141","reported_seq":1180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:54.497821+0000","last_change":"2024-09-21T03:24:54.497821+0000","last_active":"2024-09-21T03:24:54.497821+0000","last_peered":"2024-09-21T03:24:54.497821+0000","last_clean":"2024-09-21T03:24:54.497821+0000","last_became_active":"2024-09-21T03:14:37.465240+0000","last_became_peered":"2024-09-21T03:14:37.465240+0000","last_unstale":"2024-09-21T03:24:54.497821+0000","last_undegraded":"2024-09-21T03:24:54.497821+0000","last_fullsized":"2024-09-21T03:24:54.497821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1141","last_scrub_stamp":"2024-09-21T03:24:54.497722+0000","last_deep_scrub":"27'1141","last_deep_scrub_stamp":"2024-09-21T03:24:54.497722+0000","last_clean_scrub_stamp":"2024-09-21T03:24:54.497722+0000","objects_scrubbed":1,"log_size":1141,"log_dups_size":0,"ondisk_log_size":1141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:31.119993+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1138,"num_write_kb":5114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'2730","reported_seq":2767,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:54.605635+0000","last_change":"2024-09-21T03:24:54.605635+0000","last_active":"2024-09-21T03:24:54.605635+0000","last_peered":"2024-09-21T03:24:54.605635+0000","last_clean":"2024-09-21T03:24:54.605635+0000","last_became_active":"2024-09-21T03:14:38.472225+0000","last_became_peered":"2024-09-21T03:14:38.472225+0000","last_unstale":"2024-09-21T03:24:54.605635+0000","last_undegraded":"2024-09-21T03:24:54.605635+0000","last_fullsized":"2024-09-21T03:24:54.605635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2730","last_scrub_stamp":"2024-09-21T03:24:54.605532+0000","last_deep_scrub":"27'2730","last_deep_scrub_stamp":"2024-09-21T03:24:54.605532+0000","last_clean_scrub_stamp":"2024-09-21T03:24:54.605532+0000","objects_scrubbed":0,"log_size":2730,"log_dups_size":0,"ondisk_log_size":2730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:57.251920+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40361,"num_write_kb":500658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'81","reported_seq":112,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.410108+0000","last_change":"2024-09-21T03:25:05.410108+0000","last_active":"2024-09-21T03:25:05.410108+0000","last_peered":"2024-09-21T03:25:05.410108+0000","last_clean":"2024-09-21T03:25:05.410108+0000","last_became_active":"2024-09-21T03:14:46.543729+0000","last_became_peered":"2024-09-21T03:14:46.543729+0000","last_unstale":"2024-09-21T03:25:05.410108+0000","last_undegraded":"2024-09-21T03:25:05.410108+0000","last_fullsized":"2024-09-21T03:25:05.410108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'81","last_scrub_stamp":"2024-09-21T03:25:05.409994+0000","last_deep_scrub":"27'81","last_deep_scrub_stamp":"2024-09-21T03:25:05.409994+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.409994+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:13.871092+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":12315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"27'2742","reported_seq":2763,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.365262+0000","last_change":"2024-09-21T03:14:47.563764+0000","last_active":"2024-09-21T03:24:45.365262+0000","last_peered":"2024-09-21T03:24:45.365262+0000","last_clean":"2024-09-21T03:24:45.365262+0000","last_became_active":"2024-09-21T03:14:47.562943+0000","last_became_peered":"2024-09-21T03:14:47.562943+0000","last_unstale":"2024-09-21T03:24:45.365262+0000","last_undegraded":"2024-09-21T03:24:45.365262+0000","last_fullsized":"2024-09-21T03:24:45.365262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2742,"log_dups_size":0,"ondisk_log_size":2742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:39.284350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39824,"num_write_kb":405293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"27'3827","reported_seq":3865,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:53.658701+0000","last_change":"2024-09-21T03:24:53.658648+0000","last_active":"2024-09-21T03:24:53.658701+0000","last_peered":"2024-09-21T03:24:53.658701+0000","last_clean":"2024-09-21T03:24:53.658701+0000","last_became_active":"2024-09-21T03:14:38.483975+0000","last_became_peered":"2024-09-21T03:14:38.483975+0000","last_unstale":"2024-09-21T03:24:53.658701+0000","last_undegraded":"2024-09-21T03:24:53.658701+0000","last_fullsized":"2024-09-21T03:24:53.658701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3827","last_scrub_stamp":"2024-09-21T03:24:53.658564+0000","last_deep_scrub":"27'3827","last_deep_scrub_stamp":"2024-09-21T03:24:53.658564+0000","last_clean_scrub_stamp":"2024-09-21T03:24:53.658564+0000","objects_scrubbed":0,"log_size":3827,"log_dups_size":0,"ondisk_log_size":3827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:02.242965+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56663,"num_write_kb":721573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"27'3391","reported_seq":3412,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.350778+0000","last_change":"2024-09-21T03:14:47.566252+0000","last_active":"2024-09-21T03:24:45.350778+0000","last_peered":"2024-09-21T03:24:45.350778+0000","last_clean":"2024-09-21T03:24:45.350778+0000","last_became_active":"2024-09-21T03:14:47.560282+0000","last_became_peered":"2024-09-21T03:14:47.560282+0000","last_unstale":"2024-09-21T03:24:45.350778+0000","last_undegraded":"2024-09-21T03:24:45.350778+0000","last_fullsized":"2024-09-21T03:24:45.350778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3391,"log_dups_size":0,"ondisk_log_size":3391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:23.553847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49276,"num_write_kb":506666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"27'3197","reported_seq":3235,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:59.310611+0000","last_change":"2024-09-21T03:24:59.310543+0000","last_active":"2024-09-21T03:24:59.310611+0000","last_peered":"2024-09-21T03:24:59.310611+0000","last_clean":"2024-09-21T03:24:59.310611+0000","last_became_active":"2024-09-21T03:14:38.476657+0000","last_became_peered":"2024-09-21T03:14:38.476657+0000","last_unstale":"2024-09-21T03:24:59.310611+0000","last_undegraded":"2024-09-21T03:24:59.310611+0000","last_fullsized":"2024-09-21T03:24:59.310611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3197","last_scrub_stamp":"2024-09-21T03:24:59.310435+0000","last_deep_scrub":"27'3197","last_deep_scrub_stamp":"2024-09-21T03:24:59.310435+0000","last_clean_scrub_stamp":"2024-09-21T03:24:59.310435+0000","objects_scrubbed":0,"log_size":3197,"log_dups_size":0,"ondisk_log_size":3197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:47.245423+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47236,"num_write_kb":609124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"27'2689","reported_seq":2718,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.686271+0000","last_change":"2024-09-21T03:25:09.686271+0000","last_active":"2024-09-21T03:25:09.686271+0000","last_peered":"2024-09-21T03:25:09.686271+0000","last_clean":"2024-09-21T03:25:09.686271+0000","last_became_active":"2024-09-21T03:14:47.565732+0000","last_became_peered":"2024-09-21T03:14:47.565732+0000","last_unstale":"2024-09-21T03:25:09.686271+0000","last_undegraded":"2024-09-21T03:25:09.686271+0000","last_fullsized":"2024-09-21T03:25:09.686271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2689","last_scrub_stamp":"2024-09-21T03:25:09.686177+0000","last_deep_scrub":"27'2689","last_deep_scrub_stamp":"2024-09-21T03:25:09.686177+0000","last_clean_scrub_stamp":"2024-09-21T03:25:09.686177+0000","objects_scrubbed":0,"log_size":2689,"log_dups_size":0,"ondisk_log_size":2689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:17.135758+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39100,"num_write_kb":400538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'3540","reported_seq":3578,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:08.754779+0000","last_change":"2024-09-21T03:25:08.754717+0000","last_active":"2024-09-21T03:25:08.754779+0000","last_peered":"2024-09-21T03:25:08.754779+0000","last_clean":"2024-09-21T03:25:08.754779+0000","last_became_active":"2024-09-21T03:14:38.472548+0000","last_became_peered":"2024-09-21T03:14:38.472548+0000","last_unstale":"2024-09-21T03:25:08.754779+0000","last_undegraded":"2024-09-21T03:25:08.754779+0000","last_fullsized":"2024-09-21T03:25:08.754779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3540","last_scrub_stamp":"2024-09-21T03:25:08.754633+0000","last_deep_scrub":"27'3540","last_deep_scrub_stamp":"2024-09-21T03:25:08.754633+0000","last_clean_scrub_stamp":"2024-09-21T03:25:08.754633+0000","objects_scrubbed":0,"log_size":3540,"log_dups_size":0,"ondisk_log_size":3540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:48.025671+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52273,"num_write_kb":690147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"27'3152","reported_seq":3173,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.268948+0000","last_change":"2024-09-21T03:14:47.557402+0000","last_active":"2024-09-21T03:24:45.268948+0000","last_peered":"2024-09-21T03:24:45.268948+0000","last_clean":"2024-09-21T03:24:45.268948+0000","last_became_active":"2024-09-21T03:14:47.557047+0000","last_became_peered":"2024-09-21T03:14:47.557047+0000","last_unstale":"2024-09-21T03:24:45.268948+0000","last_undegraded":"2024-09-21T03:24:45.268948+0000","last_fullsized":"2024-09-21T03:24:45.268948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3152,"log_dups_size":0,"ondisk_log_size":3152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:29.792514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46003,"num_write_kb":479339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'2575","reported_seq":2612,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:04.452786+0000","last_change":"2024-09-21T03:25:04.452786+0000","last_active":"2024-09-21T03:25:04.452786+0000","last_peered":"2024-09-21T03:25:04.452786+0000","last_clean":"2024-09-21T03:25:04.452786+0000","last_became_active":"2024-09-21T03:14:38.480686+0000","last_became_peered":"2024-09-21T03:14:38.480686+0000","last_unstale":"2024-09-21T03:25:04.452786+0000","last_undegraded":"2024-09-21T03:25:04.452786+0000","last_fullsized":"2024-09-21T03:25:04.452786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2575","last_scrub_stamp":"2024-09-21T03:25:04.452696+0000","last_deep_scrub":"27'2575","last_deep_scrub_stamp":"2024-09-21T03:25:04.452696+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.452696+0000","objects_scrubbed":0,"log_size":2575,"log_dups_size":0,"ondisk_log_size":2575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:10.179636+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37971,"num_write_kb":494263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"27'3601","reported_seq":3630,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.472519+0000","last_change":"2024-09-21T03:25:09.472519+0000","last_active":"2024-09-21T03:25:09.472519+0000","last_peered":"2024-09-21T03:25:09.472519+0000","last_clean":"2024-09-21T03:25:09.472519+0000","last_became_active":"2024-09-21T03:14:47.565393+0000","last_became_peered":"2024-09-21T03:14:47.565393+0000","last_unstale":"2024-09-21T03:25:09.472519+0000","last_undegraded":"2024-09-21T03:25:09.472519+0000","last_fullsized":"2024-09-21T03:25:09.472519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3601","last_scrub_stamp":"2024-09-21T03:25:09.472408+0000","last_deep_scrub":"27'3601","last_deep_scrub_stamp":"2024-09-21T03:25:09.472408+0000","last_clean_scrub_stamp":"2024-09-21T03:25:09.472408+0000","objects_scrubbed":0,"log_size":3601,"log_dups_size":0,"ondisk_log_size":3601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:49:50.142358+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52343,"num_write_kb":533323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'2833","reported_seq":2870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:00.850441+0000","last_change":"2024-09-21T03:25:00.850441+0000","last_active":"2024-09-21T03:25:00.850441+0000","last_peered":"2024-09-21T03:25:00.850441+0000","last_clean":"2024-09-21T03:25:00.850441+0000","last_became_active":"2024-09-21T03:14:38.471325+0000","last_became_peered":"2024-09-21T03:14:38.471325+0000","last_unstale":"2024-09-21T03:25:00.850441+0000","last_undegraded":"2024-09-21T03:25:00.850441+0000","last_fullsized":"2024-09-21T03:25:00.850441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2833","last_scrub_stamp":"2024-09-21T03:25:00.850341+0000","last_deep_scrub":"27'2833","last_deep_scrub_stamp":"2024-09-21T03:25:00.850341+0000","last_clean_scrub_stamp":"2024-09-21T03:25:00.850341+0000","objects_scrubbed":0,"log_size":2833,"log_dups_size":0,"ondisk_log_size":2833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:15.818345+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41957,"num_write_kb":531654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"27'2584","reported_seq":2611,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.304489+0000","last_change":"2024-09-21T03:15:15.685059+0000","last_active":"2024-09-21T03:24:45.304489+0000","last_peered":"2024-09-21T03:24:45.304489+0000","last_clean":"2024-09-21T03:24:45.304489+0000","last_became_active":"2024-09-21T03:15:15.684633+0000","last_became_peered":"2024-09-21T03:15:15.684633+0000","last_unstale":"2024-09-21T03:24:45.304489+0000","last_undegraded":"2024-09-21T03:24:45.304489+0000","last_fullsized":"2024-09-21T03:24:45.304489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2584,"log_dups_size":0,"ondisk_log_size":2584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:22.251366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37382,"num_write_kb":380663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"27'3218","reported_seq":3255,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:01.889279+0000","last_change":"2024-09-21T03:25:01.889279+0000","last_active":"2024-09-21T03:25:01.889279+0000","last_peered":"2024-09-21T03:25:01.889279+0000","last_clean":"2024-09-21T03:25:01.889279+0000","last_became_active":"2024-09-21T03:14:38.475894+0000","last_became_peered":"2024-09-21T03:14:38.475894+0000","last_unstale":"2024-09-21T03:25:01.889279+0000","last_undegraded":"2024-09-21T03:25:01.889279+0000","last_fullsized":"2024-09-21T03:25:01.889279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3218","last_scrub_stamp":"2024-09-21T03:25:01.889182+0000","last_deep_scrub":"27'3218","last_deep_scrub_stamp":"2024-09-21T03:25:01.889182+0000","last_clean_scrub_stamp":"2024-09-21T03:25:01.889182+0000","objects_scrubbed":0,"log_size":3218,"log_dups_size":0,"ondisk_log_size":3218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:00.016717+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47546,"num_write_kb":620007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"27'3720","reported_seq":3741,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.326932+0000","last_change":"2024-09-21T03:14:47.556933+0000","last_active":"2024-09-21T03:24:45.326932+0000","last_peered":"2024-09-21T03:24:45.326932+0000","last_clean":"2024-09-21T03:24:45.326932+0000","last_became_active":"2024-09-21T03:14:47.556615+0000","last_became_peered":"2024-09-21T03:14:47.556615+0000","last_unstale":"2024-09-21T03:24:45.326932+0000","last_undegraded":"2024-09-21T03:24:45.326932+0000","last_fullsized":"2024-09-21T03:24:45.326932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3720,"log_dups_size":0,"ondisk_log_size":3720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:27.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54133,"num_write_kb":557757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"27'2798","reported_seq":2835,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:56.730321+0000","last_change":"2024-09-21T03:24:56.730321+0000","last_active":"2024-09-21T03:24:56.730321+0000","last_peered":"2024-09-21T03:24:56.730321+0000","last_clean":"2024-09-21T03:24:56.730321+0000","last_became_active":"2024-09-21T03:14:38.483893+0000","last_became_peered":"2024-09-21T03:14:38.483893+0000","last_unstale":"2024-09-21T03:24:56.730321+0000","last_undegraded":"2024-09-21T03:24:56.730321+0000","last_fullsized":"2024-09-21T03:24:56.730321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2798","last_scrub_stamp":"2024-09-21T03:24:56.730241+0000","last_deep_scrub":"27'2798","last_deep_scrub_stamp":"2024-09-21T03:24:56.730241+0000","last_clean_scrub_stamp":"2024-09-21T03:24:56.730241+0000","objects_scrubbed":0,"log_size":2798,"log_dups_size":0,"ondisk_log_size":2798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:09.247648+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41301,"num_write_kb":515809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"27'3224","reported_seq":3253,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:10.729883+0000","last_change":"2024-09-21T03:25:10.729883+0000","last_active":"2024-09-21T03:25:10.729883+0000","last_peered":"2024-09-21T03:25:10.729883+0000","last_clean":"2024-09-21T03:25:10.729883+0000","last_became_active":"2024-09-21T03:14:47.553144+0000","last_became_peered":"2024-09-21T03:14:47.553144+0000","last_unstale":"2024-09-21T03:25:10.729883+0000","last_undegraded":"2024-09-21T03:25:10.729883+0000","last_fullsized":"2024-09-21T03:25:10.729883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3224","last_scrub_stamp":"2024-09-21T03:25:10.729774+0000","last_deep_scrub":"27'3224","last_deep_scrub_stamp":"2024-09-21T03:25:10.729774+0000","last_clean_scrub_stamp":"2024-09-21T03:25:10.729774+0000","objects_scrubbed":0,"log_size":3224,"log_dups_size":0,"ondisk_log_size":3224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:22.461613+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46752,"num_write_kb":476180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'3507","reported_seq":3544,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:03.455993+0000","last_change":"2024-09-21T03:25:03.455993+0000","last_active":"2024-09-21T03:25:03.455993+0000","last_peered":"2024-09-21T03:25:03.455993+0000","last_clean":"2024-09-21T03:25:03.455993+0000","last_became_active":"2024-09-21T03:14:38.486204+0000","last_became_peered":"2024-09-21T03:14:38.486204+0000","last_unstale":"2024-09-21T03:25:03.455993+0000","last_undegraded":"2024-09-21T03:25:03.455993+0000","last_fullsized":"2024-09-21T03:25:03.455993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3507","last_scrub_stamp":"2024-09-21T03:25:03.455852+0000","last_deep_scrub":"27'3507","last_deep_scrub_stamp":"2024-09-21T03:25:03.455852+0000","last_clean_scrub_stamp":"2024-09-21T03:25:03.455852+0000","objects_scrubbed":0,"log_size":3507,"log_dups_size":0,"ondisk_log_size":3507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:19.386876+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51770,"num_write_kb":667306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"27'2354","reported_seq":2383,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:10.255588+0000","last_change":"2024-09-21T03:25:10.255588+0000","last_active":"2024-09-21T03:25:10.255588+0000","last_peered":"2024-09-21T03:25:10.255588+0000","last_clean":"2024-09-21T03:25:10.255588+0000","last_became_active":"2024-09-21T03:14:47.572717+0000","last_became_peered":"2024-09-21T03:14:47.572717+0000","last_unstale":"2024-09-21T03:25:10.255588+0000","last_undegraded":"2024-09-21T03:25:10.255588+0000","last_fullsized":"2024-09-21T03:25:10.255588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2354","last_scrub_stamp":"2024-09-21T03:25:10.255488+0000","last_deep_scrub":"27'2354","last_deep_scrub_stamp":"2024-09-21T03:25:10.255488+0000","last_clean_scrub_stamp":"2024-09-21T03:25:10.255488+0000","objects_scrubbed":0,"log_size":2354,"log_dups_size":0,"ondisk_log_size":2354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:59.844054+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33818,"num_write_kb":353403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"27'2611","reported_seq":2648,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.781862+0000","last_change":"2024-09-21T03:25:09.781862+0000","last_active":"2024-09-21T03:25:09.781862+0000","last_peered":"2024-09-21T03:25:09.781862+0000","last_clean":"2024-09-21T03:25:09.781862+0000","last_became_active":"2024-09-21T03:14:38.471625+0000","last_became_peered":"2024-09-21T03:14:38.471625+0000","last_unstale":"2024-09-21T03:25:09.781862+0000","last_undegraded":"2024-09-21T03:25:09.781862+0000","last_fullsized":"2024-09-21T03:25:09.781862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2611","last_scrub_stamp":"2024-09-21T03:25:09.781758+0000","last_deep_scrub":"27'2611","last_deep_scrub_stamp":"2024-09-21T03:25:09.781758+0000","last_clean_scrub_stamp":"2024-09-21T03:25:09.781758+0000","objects_scrubbed":0,"log_size":2611,"log_dups_size":0,"ondisk_log_size":2611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:45.660599+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38420,"num_write_kb":499975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"27'3517","reported_seq":3538,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.318484+0000","last_change":"2024-09-21T03:14:47.564597+0000","last_active":"2024-09-21T03:24:45.318484+0000","last_peered":"2024-09-21T03:24:45.318484+0000","last_clean":"2024-09-21T03:24:45.318484+0000","last_became_active":"2024-09-21T03:14:47.563816+0000","last_became_peered":"2024-09-21T03:14:47.563816+0000","last_unstale":"2024-09-21T03:24:45.318484+0000","last_undegraded":"2024-09-21T03:24:45.318484+0000","last_fullsized":"2024-09-21T03:24:45.318484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3517,"log_dups_size":0,"ondisk_log_size":3517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:33.061271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50894,"num_write_kb":526303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'3043","reported_seq":3080,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.450492+0000","last_change":"2024-09-21T03:25:05.450492+0000","last_active":"2024-09-21T03:25:05.450492+0000","last_peered":"2024-09-21T03:25:05.450492+0000","last_clean":"2024-09-21T03:25:05.450492+0000","last_became_active":"2024-09-21T03:14:38.491510+0000","last_became_peered":"2024-09-21T03:14:38.491510+0000","last_unstale":"2024-09-21T03:25:05.450492+0000","last_undegraded":"2024-09-21T03:25:05.450492+0000","last_fullsized":"2024-09-21T03:25:05.450492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3043","last_scrub_stamp":"2024-09-21T03:25:05.450404+0000","last_deep_scrub":"27'3043","last_deep_scrub_stamp":"2024-09-21T03:25:05.450404+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.450404+0000","objects_scrubbed":0,"log_size":3043,"log_dups_size":0,"ondisk_log_size":3043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:05.540997+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44704,"num_write_kb":573613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"27'2899","reported_seq":2920,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.335427+0000","last_change":"2024-09-21T03:14:47.564310+0000","last_active":"2024-09-21T03:24:45.335427+0000","last_peered":"2024-09-21T03:24:45.335427+0000","last_clean":"2024-09-21T03:24:45.335427+0000","last_became_active":"2024-09-21T03:14:47.564003+0000","last_became_peered":"2024-09-21T03:14:47.564003+0000","last_unstale":"2024-09-21T03:24:45.335427+0000","last_undegraded":"2024-09-21T03:24:45.335427+0000","last_fullsized":"2024-09-21T03:24:45.335427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2899,"log_dups_size":0,"ondisk_log_size":2899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:45.016321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42050,"num_write_kb":436747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"27'3507","reported_seq":3544,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:56.604068+0000","last_change":"2024-09-21T03:24:56.604068+0000","last_active":"2024-09-21T03:24:56.604068+0000","last_peered":"2024-09-21T03:24:56.604068+0000","last_clean":"2024-09-21T03:24:56.604068+0000","last_became_active":"2024-09-21T03:14:38.470666+0000","last_became_peered":"2024-09-21T03:14:38.470666+0000","last_unstale":"2024-09-21T03:24:56.604068+0000","last_undegraded":"2024-09-21T03:24:56.604068+0000","last_fullsized":"2024-09-21T03:24:56.604068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3507","last_scrub_stamp":"2024-09-21T03:24:56.603974+0000","last_deep_scrub":"27'3507","last_deep_scrub_stamp":"2024-09-21T03:24:56.603974+0000","last_clean_scrub_stamp":"2024-09-21T03:24:56.603974+0000","objects_scrubbed":0,"log_size":3507,"log_dups_size":0,"ondisk_log_size":3507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:00.807277+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51813,"num_write_kb":639602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"27'2979","reported_seq":3008,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.292278+0000","last_change":"2024-09-21T03:25:09.292278+0000","last_active":"2024-09-21T03:25:09.292278+0000","last_peered":"2024-09-21T03:25:09.292278+0000","last_clean":"2024-09-21T03:25:09.292278+0000","last_became_active":"2024-09-21T03:14:47.574895+0000","last_became_peered":"2024-09-21T03:14:47.574895+0000","last_unstale":"2024-09-21T03:25:09.292278+0000","last_undegraded":"2024-09-21T03:25:09.292278+0000","last_fullsized":"2024-09-21T03:25:09.292278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2979","last_scrub_stamp":"2024-09-21T03:25:09.292151+0000","last_deep_scrub":"27'2979","last_deep_scrub_stamp":"2024-09-21T03:25:09.292151+0000","last_clean_scrub_stamp":"2024-09-21T03:25:09.292151+0000","objects_scrubbed":0,"log_size":2979,"log_dups_size":0,"ondisk_log_size":2979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:51.462728+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43060,"num_write_kb":442689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"27'2924","reported_seq":2961,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:04.663220+0000","last_change":"2024-09-21T03:25:04.663220+0000","last_active":"2024-09-21T03:25:04.663220+0000","last_peered":"2024-09-21T03:25:04.663220+0000","last_clean":"2024-09-21T03:25:04.663220+0000","last_became_active":"2024-09-21T03:14:38.477816+0000","last_became_peered":"2024-09-21T03:14:38.477816+0000","last_unstale":"2024-09-21T03:25:04.663220+0000","last_undegraded":"2024-09-21T03:25:04.663220+0000","last_fullsized":"2024-09-21T03:25:04.663220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2924","last_scrub_stamp":"2024-09-21T03:25:04.663094+0000","last_deep_scrub":"27'2924","last_deep_scrub_stamp":"2024-09-21T03:25:04.663094+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.663094+0000","objects_scrubbed":0,"log_size":2924,"log_dups_size":0,"ondisk_log_size":2924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:30.900198+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42673,"num_write_kb":583298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"27'3308","reported_seq":3329,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.339081+0000","last_change":"2024-09-21T03:14:47.555329+0000","last_active":"2024-09-21T03:24:45.339081+0000","last_peered":"2024-09-21T03:24:45.339081+0000","last_clean":"2024-09-21T03:24:45.339081+0000","last_became_active":"2024-09-21T03:14:47.555033+0000","last_became_peered":"2024-09-21T03:14:47.555033+0000","last_unstale":"2024-09-21T03:24:45.339081+0000","last_undegraded":"2024-09-21T03:24:45.339081+0000","last_fullsized":"2024-09-21T03:24:45.339081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3308,"log_dups_size":0,"ondisk_log_size":3308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:49.060834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48400,"num_write_kb":492898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"27'3018","reported_seq":3055,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:02.431446+0000","last_change":"2024-09-21T03:25:02.431446+0000","last_active":"2024-09-21T03:25:02.431446+0000","last_peered":"2024-09-21T03:25:02.431446+0000","last_clean":"2024-09-21T03:25:02.431446+0000","last_became_active":"2024-09-21T03:14:38.477739+0000","last_became_peered":"2024-09-21T03:14:38.477739+0000","last_unstale":"2024-09-21T03:25:02.431446+0000","last_undegraded":"2024-09-21T03:25:02.431446+0000","last_fullsized":"2024-09-21T03:25:02.431446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3018","last_scrub_stamp":"2024-09-21T03:25:02.431345+0000","last_deep_scrub":"27'3018","last_deep_scrub_stamp":"2024-09-21T03:25:02.431345+0000","last_clean_scrub_stamp":"2024-09-21T03:25:02.431345+0000","objects_scrubbed":0,"log_size":3018,"log_dups_size":0,"ondisk_log_size":3018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:07.844557+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44651,"num_write_kb":569943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"27'3055","reported_seq":3076,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.339299+0000","last_change":"2024-09-21T03:14:47.573659+0000","last_active":"2024-09-21T03:24:45.339299+0000","last_peered":"2024-09-21T03:24:45.339299+0000","last_clean":"2024-09-21T03:24:45.339299+0000","last_became_active":"2024-09-21T03:14:47.572756+0000","last_became_peered":"2024-09-21T03:14:47.572756+0000","last_unstale":"2024-09-21T03:24:45.339299+0000","last_undegraded":"2024-09-21T03:24:45.339299+0000","last_fullsized":"2024-09-21T03:24:45.339299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3055,"log_dups_size":0,"ondisk_log_size":3055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:21.986681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44174,"num_write_kb":452226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'3124","reported_seq":3165,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:10.745108+0000","last_change":"2024-09-21T03:25:10.745108+0000","last_active":"2024-09-21T03:25:10.745108+0000","last_peered":"2024-09-21T03:25:10.745108+0000","last_clean":"2024-09-21T03:25:10.745108+0000","last_became_active":"2024-09-21T03:14:38.473843+0000","last_became_peered":"2024-09-21T03:14:38.473843+0000","last_unstale":"2024-09-21T03:25:10.745108+0000","last_undegraded":"2024-09-21T03:25:10.745108+0000","last_fullsized":"2024-09-21T03:25:10.745108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3124","last_scrub_stamp":"2024-09-21T03:25:10.745014+0000","last_deep_scrub":"27'3124","last_deep_scrub_stamp":"2024-09-21T03:25:10.745014+0000","last_clean_scrub_stamp":"2024-09-21T03:25:10.745014+0000","objects_scrubbed":0,"log_size":3124,"log_dups_size":0,"ondisk_log_size":3124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:05.856637+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46022,"num_write_kb":573473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"27'2638","reported_seq":2659,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.342961+0000","last_change":"2024-09-21T03:14:47.555386+0000","last_active":"2024-09-21T03:24:45.342961+0000","last_peered":"2024-09-21T03:24:45.342961+0000","last_clean":"2024-09-21T03:24:45.342961+0000","last_became_active":"2024-09-21T03:14:47.554758+0000","last_became_peered":"2024-09-21T03:14:47.554758+0000","last_unstale":"2024-09-21T03:24:45.342961+0000","last_undegraded":"2024-09-21T03:24:45.342961+0000","last_fullsized":"2024-09-21T03:24:45.342961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2638,"log_dups_size":0,"ondisk_log_size":2638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:47.574672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38196,"num_write_kb":393191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"27'2530","reported_seq":2567,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:00.281288+0000","last_change":"2024-09-21T03:25:00.281288+0000","last_active":"2024-09-21T03:25:00.281288+0000","last_peered":"2024-09-21T03:25:00.281288+0000","last_clean":"2024-09-21T03:25:00.281288+0000","last_became_active":"2024-09-21T03:14:38.492813+0000","last_became_peered":"2024-09-21T03:14:38.492813+0000","last_unstale":"2024-09-21T03:25:00.281288+0000","last_undegraded":"2024-09-21T03:25:00.281288+0000","last_fullsized":"2024-09-21T03:25:00.281288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2530","last_scrub_stamp":"2024-09-21T03:25:00.281167+0000","last_deep_scrub":"27'2530","last_deep_scrub_stamp":"2024-09-21T03:25:00.281167+0000","last_clean_scrub_stamp":"2024-09-21T03:25:00.281167+0000","objects_scrubbed":0,"log_size":2530,"log_dups_size":0,"ondisk_log_size":2530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:26.004120+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37062,"num_write_kb":456367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"27'2967","reported_seq":2996,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:13.839367+0000","last_change":"2024-09-21T03:25:13.839367+0000","last_active":"2024-09-21T03:25:13.839367+0000","last_peered":"2024-09-21T03:25:13.839367+0000","last_clean":"2024-09-21T03:25:13.839367+0000","last_became_active":"2024-09-21T03:14:47.544431+0000","last_became_peered":"2024-09-21T03:14:47.544431+0000","last_unstale":"2024-09-21T03:25:13.839367+0000","last_undegraded":"2024-09-21T03:25:13.839367+0000","last_fullsized":"2024-09-21T03:25:13.839367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2967","last_scrub_stamp":"2024-09-21T03:25:13.839251+0000","last_deep_scrub":"27'2967","last_deep_scrub_stamp":"2024-09-21T03:25:13.839251+0000","last_clean_scrub_stamp":"2024-09-21T03:25:13.839251+0000","objects_scrubbed":0,"log_size":2967,"log_dups_size":0,"ondisk_log_size":2967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:50.378982+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43240,"num_write_kb":437209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"27'3820","reported_seq":3857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:11.780973+0000","last_change":"2024-09-21T03:25:11.780973+0000","last_active":"2024-09-21T03:25:11.780973+0000","last_peered":"2024-09-21T03:25:11.780973+0000","last_clean":"2024-09-21T03:25:11.780973+0000","last_became_active":"2024-09-21T03:14:38.474156+0000","last_became_peered":"2024-09-21T03:14:38.474156+0000","last_unstale":"2024-09-21T03:25:11.780973+0000","last_undegraded":"2024-09-21T03:25:11.780973+0000","last_fullsized":"2024-09-21T03:25:11.780973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3820","last_scrub_stamp":"2024-09-21T03:25:11.780846+0000","last_deep_scrub":"27'3820","last_deep_scrub_stamp":"2024-09-21T03:25:11.780846+0000","last_clean_scrub_stamp":"2024-09-21T03:25:11.780846+0000","objects_scrubbed":0,"log_size":3820,"log_dups_size":0,"ondisk_log_size":3820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:09.849312+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56526,"num_write_kb":700246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"27'3385","reported_seq":3406,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.368613+0000","last_change":"2024-09-21T03:14:47.563297+0000","last_active":"2024-09-21T03:24:45.368613+0000","last_peered":"2024-09-21T03:24:45.368613+0000","last_clean":"2024-09-21T03:24:45.368613+0000","last_became_active":"2024-09-21T03:14:47.562519+0000","last_became_peered":"2024-09-21T03:14:47.562519+0000","last_unstale":"2024-09-21T03:24:45.368613+0000","last_undegraded":"2024-09-21T03:24:45.368613+0000","last_fullsized":"2024-09-21T03:24:45.368613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3385,"log_dups_size":0,"ondisk_log_size":3385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:47.959373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49240,"num_write_kb":516390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"27'2621","reported_seq":2658,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:12.826205+0000","last_change":"2024-09-21T03:25:12.826205+0000","last_active":"2024-09-21T03:25:12.826205+0000","last_peered":"2024-09-21T03:25:12.826205+0000","last_clean":"2024-09-21T03:25:12.826205+0000","last_became_active":"2024-09-21T03:14:38.473856+0000","last_became_peered":"2024-09-21T03:14:38.473856+0000","last_unstale":"2024-09-21T03:25:12.826205+0000","last_undegraded":"2024-09-21T03:25:12.826205+0000","last_fullsized":"2024-09-21T03:25:12.826205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2621","last_scrub_stamp":"2024-09-21T03:25:12.826100+0000","last_deep_scrub":"27'2621","last_deep_scrub_stamp":"2024-09-21T03:25:12.826100+0000","last_clean_scrub_stamp":"2024-09-21T03:25:12.826100+0000","objects_scrubbed":0,"log_size":2621,"log_dups_size":0,"ondisk_log_size":2621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:52.102331+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38668,"num_write_kb":516995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"27'3697","reported_seq":3726,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:04.563251+0000","last_change":"2024-09-21T03:25:04.563251+0000","last_active":"2024-09-21T03:25:04.563251+0000","last_peered":"2024-09-21T03:25:04.563251+0000","last_clean":"2024-09-21T03:25:04.563251+0000","last_became_active":"2024-09-21T03:14:47.558403+0000","last_became_peered":"2024-09-21T03:14:47.558403+0000","last_unstale":"2024-09-21T03:25:04.563251+0000","last_undegraded":"2024-09-21T03:25:04.563251+0000","last_fullsized":"2024-09-21T03:25:04.563251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3697","last_scrub_stamp":"2024-09-21T03:25:04.563147+0000","last_deep_scrub":"27'3697","last_deep_scrub_stamp":"2024-09-21T03:25:04.563147+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.563147+0000","objects_scrubbed":0,"log_size":3697,"log_dups_size":0,"ondisk_log_size":3697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:45.910137+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53973,"num_write_kb":552799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"27'3262","reported_seq":3299,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.436068+0000","last_change":"2024-09-21T03:25:07.436068+0000","last_active":"2024-09-21T03:25:07.436068+0000","last_peered":"2024-09-21T03:25:07.436068+0000","last_clean":"2024-09-21T03:25:07.436068+0000","last_became_active":"2024-09-21T03:14:38.469240+0000","last_became_peered":"2024-09-21T03:14:38.469240+0000","last_unstale":"2024-09-21T03:25:07.436068+0000","last_undegraded":"2024-09-21T03:25:07.436068+0000","last_fullsized":"2024-09-21T03:25:07.436068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3262","last_scrub_stamp":"2024-09-21T03:25:07.435932+0000","last_deep_scrub":"27'3262","last_deep_scrub_stamp":"2024-09-21T03:25:07.435932+0000","last_clean_scrub_stamp":"2024-09-21T03:25:07.435932+0000","objects_scrubbed":0,"log_size":3262,"log_dups_size":0,"ondisk_log_size":3262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:31.079457+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48009,"num_write_kb":600153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"27'2369","reported_seq":2398,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:01.479271+0000","last_change":"2024-09-21T03:25:01.479271+0000","last_active":"2024-09-21T03:25:01.479271+0000","last_peered":"2024-09-21T03:25:01.479271+0000","last_clean":"2024-09-21T03:25:01.479271+0000","last_became_active":"2024-09-21T03:14:47.550375+0000","last_became_peered":"2024-09-21T03:14:47.550375+0000","last_unstale":"2024-09-21T03:25:01.479271+0000","last_undegraded":"2024-09-21T03:25:01.479271+0000","last_fullsized":"2024-09-21T03:25:01.479271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2369","last_scrub_stamp":"2024-09-21T03:25:01.479179+0000","last_deep_scrub":"27'2369","last_deep_scrub_stamp":"2024-09-21T03:25:01.479179+0000","last_clean_scrub_stamp":"2024-09-21T03:25:01.479179+0000","objects_scrubbed":0,"log_size":2369,"log_dups_size":0,"ondisk_log_size":2369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:33:06.745584+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34335,"num_write_kb":360179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'3448","reported_seq":3485,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:02.850247+0000","last_change":"2024-09-21T03:25:02.850247+0000","last_active":"2024-09-21T03:25:02.850247+0000","last_peered":"2024-09-21T03:25:02.850247+0000","last_clean":"2024-09-21T03:25:02.850247+0000","last_became_active":"2024-09-21T03:14:38.487676+0000","last_became_peered":"2024-09-21T03:14:38.487676+0000","last_unstale":"2024-09-21T03:25:02.850247+0000","last_undegraded":"2024-09-21T03:25:02.850247+0000","last_fullsized":"2024-09-21T03:25:02.850247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3448","last_scrub_stamp":"2024-09-21T03:25:02.850139+0000","last_deep_scrub":"27'3448","last_deep_scrub_stamp":"2024-09-21T03:25:02.850139+0000","last_clean_scrub_stamp":"2024-09-21T03:25:02.850139+0000","objects_scrubbed":0,"log_size":3448,"log_dups_size":0,"ondisk_log_size":3448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:39.355086+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50832,"num_write_kb":624952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"27'2810","reported_seq":2837,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.354509+0000","last_change":"2024-09-21T03:19:03.558582+0000","last_active":"2024-09-21T03:24:45.354509+0000","last_peered":"2024-09-21T03:24:45.354509+0000","last_clean":"2024-09-21T03:24:45.354509+0000","last_became_active":"2024-09-21T03:14:47.561229+0000","last_became_peered":"2024-09-21T03:14:47.561229+0000","last_unstale":"2024-09-21T03:24:45.354509+0000","last_undegraded":"2024-09-21T03:24:45.354509+0000","last_fullsized":"2024-09-21T03:24:45.354509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2810,"log_dups_size":0,"ondisk_log_size":2810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:07.280356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40720,"num_write_kb":419729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"27'2665","reported_seq":2702,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:03.805838+0000","last_change":"2024-09-21T03:25:03.805838+0000","last_active":"2024-09-21T03:25:03.805838+0000","last_peered":"2024-09-21T03:25:03.805838+0000","last_clean":"2024-09-21T03:25:03.805838+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:25:03.805838+0000","last_undegraded":"2024-09-21T03:25:03.805838+0000","last_fullsized":"2024-09-21T03:25:03.805838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2665","last_scrub_stamp":"2024-09-21T03:25:03.805748+0000","last_deep_scrub":"27'2665","last_deep_scrub_stamp":"2024-09-21T03:25:03.805748+0000","last_clean_scrub_stamp":"2024-09-21T03:25:03.805748+0000","objects_scrubbed":0,"log_size":2665,"log_dups_size":0,"ondisk_log_size":2665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:36.641806+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39018,"num_write_kb":519966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"27'3118","reported_seq":3133,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.314578+0000","last_change":"2024-09-21T03:15:15.686915+0000","last_active":"2024-09-21T03:24:45.314578+0000","last_peered":"2024-09-21T03:24:45.314578+0000","last_clean":"2024-09-21T03:24:45.314578+0000","last_became_active":"2024-09-21T03:15:15.686514+0000","last_became_peered":"2024-09-21T03:15:15.686514+0000","last_unstale":"2024-09-21T03:24:45.314578+0000","last_undegraded":"2024-09-21T03:24:45.314578+0000","last_fullsized":"2024-09-21T03:24:45.314578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3118,"log_dups_size":0,"ondisk_log_size":3118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:46.388388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45367,"num_write_kb":462728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'2758","reported_seq":2795,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:03.437074+0000","last_change":"2024-09-21T03:25:03.437074+0000","last_active":"2024-09-21T03:25:03.437074+0000","last_peered":"2024-09-21T03:25:03.437074+0000","last_clean":"2024-09-21T03:25:03.437074+0000","last_became_active":"2024-09-21T03:14:38.480923+0000","last_became_peered":"2024-09-21T03:14:38.480923+0000","last_unstale":"2024-09-21T03:25:03.437074+0000","last_undegraded":"2024-09-21T03:25:03.437074+0000","last_fullsized":"2024-09-21T03:25:03.437074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2758","last_scrub_stamp":"2024-09-21T03:25:03.436948+0000","last_deep_scrub":"27'2758","last_deep_scrub_stamp":"2024-09-21T03:25:03.436948+0000","last_clean_scrub_stamp":"2024-09-21T03:25:03.436948+0000","objects_scrubbed":0,"log_size":2758,"log_dups_size":0,"ondisk_log_size":2758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:48.067323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40836,"num_write_kb":498819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"27'2757","reported_seq":2778,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.341206+0000","last_change":"2024-09-21T03:14:47.561972+0000","last_active":"2024-09-21T03:24:45.341206+0000","last_peered":"2024-09-21T03:24:45.341206+0000","last_clean":"2024-09-21T03:24:45.341206+0000","last_became_active":"2024-09-21T03:14:47.561645+0000","last_became_peered":"2024-09-21T03:14:47.561645+0000","last_unstale":"2024-09-21T03:24:45.341206+0000","last_undegraded":"2024-09-21T03:24:45.341206+0000","last_fullsized":"2024-09-21T03:24:45.341206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2757,"log_dups_size":0,"ondisk_log_size":2757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:57.526787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40136,"num_write_kb":410250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"27'2791","reported_seq":2828,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:59.329137+0000","last_change":"2024-09-21T03:24:59.329137+0000","last_active":"2024-09-21T03:24:59.329137+0000","last_peered":"2024-09-21T03:24:59.329137+0000","last_clean":"2024-09-21T03:24:59.329137+0000","last_became_active":"2024-09-21T03:14:38.473579+0000","last_became_peered":"2024-09-21T03:14:38.473579+0000","last_unstale":"2024-09-21T03:24:59.329137+0000","last_undegraded":"2024-09-21T03:24:59.329137+0000","last_fullsized":"2024-09-21T03:24:59.329137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2791","last_scrub_stamp":"2024-09-21T03:24:59.329022+0000","last_deep_scrub":"27'2791","last_deep_scrub_stamp":"2024-09-21T03:24:59.329022+0000","last_clean_scrub_stamp":"2024-09-21T03:24:59.329022+0000","objects_scrubbed":0,"log_size":2791,"log_dups_size":0,"ondisk_log_size":2791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:58.789696+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41232,"num_write_kb":540257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"27'2621","reported_seq":2642,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.300722+0000","last_change":"2024-09-21T03:14:47.566089+0000","last_active":"2024-09-21T03:24:45.300722+0000","last_peered":"2024-09-21T03:24:45.300722+0000","last_clean":"2024-09-21T03:24:45.300722+0000","last_became_active":"2024-09-21T03:14:47.565681+0000","last_became_peered":"2024-09-21T03:14:47.565681+0000","last_unstale":"2024-09-21T03:24:45.300722+0000","last_undegraded":"2024-09-21T03:24:45.300722+0000","last_fullsized":"2024-09-21T03:24:45.300722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2621,"log_dups_size":0,"ondisk_log_size":2621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.208933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37892,"num_write_kb":397863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'3465","reported_seq":3502,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:01.427195+0000","last_change":"2024-09-21T03:25:01.427195+0000","last_active":"2024-09-21T03:25:01.427195+0000","last_peered":"2024-09-21T03:25:01.427195+0000","last_clean":"2024-09-21T03:25:01.427195+0000","last_became_active":"2024-09-21T03:14:38.470430+0000","last_became_peered":"2024-09-21T03:14:38.470430+0000","last_unstale":"2024-09-21T03:25:01.427195+0000","last_undegraded":"2024-09-21T03:25:01.427195+0000","last_fullsized":"2024-09-21T03:25:01.427195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3465","last_scrub_stamp":"2024-09-21T03:25:01.426921+0000","last_deep_scrub":"27'3465","last_deep_scrub_stamp":"2024-09-21T03:25:01.426921+0000","last_clean_scrub_stamp":"2024-09-21T03:25:01.426921+0000","objects_scrubbed":0,"log_size":3465,"log_dups_size":0,"ondisk_log_size":3465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:08.804731+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51200,"num_write_kb":673726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"27'2995","reported_seq":3016,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.287299+0000","last_change":"2024-09-21T03:14:47.571487+0000","last_active":"2024-09-21T03:24:45.287299+0000","last_peered":"2024-09-21T03:24:45.287299+0000","last_clean":"2024-09-21T03:24:45.287299+0000","last_became_active":"2024-09-21T03:14:47.571126+0000","last_became_peered":"2024-09-21T03:14:47.571126+0000","last_unstale":"2024-09-21T03:24:45.287299+0000","last_undegraded":"2024-09-21T03:24:45.287299+0000","last_fullsized":"2024-09-21T03:24:45.287299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2995,"log_dups_size":0,"ondisk_log_size":2995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:57.128853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43649,"num_write_kb":455041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'4015","reported_seq":4052,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:57.579909+0000","last_change":"2024-09-21T03:24:57.579909+0000","last_active":"2024-09-21T03:24:57.579909+0000","last_peered":"2024-09-21T03:24:57.579909+0000","last_clean":"2024-09-21T03:24:57.579909+0000","last_became_active":"2024-09-21T03:14:38.483019+0000","last_became_peered":"2024-09-21T03:14:38.483019+0000","last_unstale":"2024-09-21T03:24:57.579909+0000","last_undegraded":"2024-09-21T03:24:57.579909+0000","last_fullsized":"2024-09-21T03:24:57.579909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4015","last_scrub_stamp":"2024-09-21T03:24:57.579800+0000","last_deep_scrub":"27'4015","last_deep_scrub_stamp":"2024-09-21T03:24:57.579800+0000","last_clean_scrub_stamp":"2024-09-21T03:24:57.579800+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:39.078319+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59359,"num_write_kb":743455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"27'3951","reported_seq":3973,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.357526+0000","last_change":"2024-09-21T03:14:47.555777+0000","last_active":"2024-09-21T03:24:45.357526+0000","last_peered":"2024-09-21T03:24:45.357526+0000","last_clean":"2024-09-21T03:24:45.357526+0000","last_became_active":"2024-09-21T03:14:47.555465+0000","last_became_peered":"2024-09-21T03:14:47.555465+0000","last_unstale":"2024-09-21T03:24:45.357526+0000","last_undegraded":"2024-09-21T03:24:45.357526+0000","last_fullsized":"2024-09-21T03:24:45.357526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3951,"log_dups_size":0,"ondisk_log_size":3951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57951,"num_write_kb":584164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"27'3369","reported_seq":3406,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.483009+0000","last_change":"2024-09-21T03:25:06.483009+0000","last_active":"2024-09-21T03:25:06.483009+0000","last_peered":"2024-09-21T03:25:06.483009+0000","last_clean":"2024-09-21T03:25:06.483009+0000","last_became_active":"2024-09-21T03:14:38.465479+0000","last_became_peered":"2024-09-21T03:14:38.465479+0000","last_unstale":"2024-09-21T03:25:06.483009+0000","last_undegraded":"2024-09-21T03:25:06.483009+0000","last_fullsized":"2024-09-21T03:25:06.483009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3369","last_scrub_stamp":"2024-09-21T03:25:06.482906+0000","last_deep_scrub":"27'3369","last_deep_scrub_stamp":"2024-09-21T03:25:06.482906+0000","last_clean_scrub_stamp":"2024-09-21T03:25:06.482906+0000","objects_scrubbed":0,"log_size":3369,"log_dups_size":0,"ondisk_log_size":3369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:35.528096+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50038,"num_write_kb":621750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"27'2525","reported_seq":2546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.263614+0000","last_change":"2024-09-21T03:14:47.567695+0000","last_active":"2024-09-21T03:24:45.263614+0000","last_peered":"2024-09-21T03:24:45.263614+0000","last_clean":"2024-09-21T03:24:45.263614+0000","last_became_active":"2024-09-21T03:14:47.566936+0000","last_became_peered":"2024-09-21T03:14:47.566936+0000","last_unstale":"2024-09-21T03:24:45.263614+0000","last_undegraded":"2024-09-21T03:24:45.263614+0000","last_fullsized":"2024-09-21T03:24:45.263614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2525,"log_dups_size":0,"ondisk_log_size":2525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:48.182523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36538,"num_write_kb":381931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"27'2958","reported_seq":2981,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:01.256000+0000","last_change":"2024-09-21T03:25:01.255928+0000","last_active":"2024-09-21T03:25:01.256000+0000","last_peered":"2024-09-21T03:25:01.256000+0000","last_clean":"2024-09-21T03:25:01.256000+0000","last_became_active":"2024-09-21T03:15:15.806775+0000","last_became_peered":"2024-09-21T03:15:15.806775+0000","last_unstale":"2024-09-21T03:25:01.256000+0000","last_undegraded":"2024-09-21T03:25:01.256000+0000","last_fullsized":"2024-09-21T03:25:01.256000+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2958","last_scrub_stamp":"2024-09-21T03:25:01.255834+0000","last_deep_scrub":"27'2958","last_deep_scrub_stamp":"2024-09-21T03:25:01.255834+0000","last_clean_scrub_stamp":"2024-09-21T03:25:01.255834+0000","objects_scrubbed":0,"log_size":2958,"log_dups_size":0,"ondisk_log_size":2958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:00.119549+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43828,"num_write_kb":561683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"27'2681","reported_seq":2703,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.335411+0000","last_change":"2024-09-21T03:14:47.580314+0000","last_active":"2024-09-21T03:24:45.335411+0000","last_peered":"2024-09-21T03:24:45.335411+0000","last_clean":"2024-09-21T03:24:45.335411+0000","last_became_active":"2024-09-21T03:14:47.576499+0000","last_became_peered":"2024-09-21T03:14:47.576499+0000","last_unstale":"2024-09-21T03:24:45.335411+0000","last_undegraded":"2024-09-21T03:24:45.335411+0000","last_fullsized":"2024-09-21T03:24:45.335411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2681,"log_dups_size":0,"ondisk_log_size":2681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39028,"num_write_kb":398421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2546","reported_seq":2585,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:57.732333+0000","last_change":"2024-09-21T03:24:57.732333+0000","last_active":"2024-09-21T03:24:57.732333+0000","last_peered":"2024-09-21T03:24:57.732333+0000","last_clean":"2024-09-21T03:24:57.732333+0000","last_became_active":"2024-09-21T03:14:38.470708+0000","last_became_peered":"2024-09-21T03:14:38.470708+0000","last_unstale":"2024-09-21T03:24:57.732333+0000","last_undegraded":"2024-09-21T03:24:57.732333+0000","last_fullsized":"2024-09-21T03:24:57.732333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2546","last_scrub_stamp":"2024-09-21T03:24:57.732250+0000","last_deep_scrub":"27'2546","last_deep_scrub_stamp":"2024-09-21T03:24:57.732250+0000","last_clean_scrub_stamp":"2024-09-21T03:24:57.732250+0000","objects_scrubbed":0,"log_size":2546,"log_dups_size":0,"ondisk_log_size":2546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:06.929563+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37433,"num_write_kb":500133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"27'3017","reported_seq":3047,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.565306+0000","last_change":"2024-09-21T03:25:05.565240+0000","last_active":"2024-09-21T03:25:05.565306+0000","last_peered":"2024-09-21T03:25:05.565306+0000","last_clean":"2024-09-21T03:25:05.565306+0000","last_became_active":"2024-09-21T03:14:47.552808+0000","last_became_peered":"2024-09-21T03:14:47.552808+0000","last_unstale":"2024-09-21T03:25:05.565306+0000","last_undegraded":"2024-09-21T03:25:05.565306+0000","last_fullsized":"2024-09-21T03:25:05.565306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3017","last_scrub_stamp":"2024-09-21T03:25:05.565160+0000","last_deep_scrub":"27'3017","last_deep_scrub_stamp":"2024-09-21T03:25:05.565160+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.565160+0000","objects_scrubbed":0,"log_size":3017,"log_dups_size":0,"ondisk_log_size":3017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:08.203176+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43808,"num_write_kb":448579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"27'3592","reported_seq":3629,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:04.451823+0000","last_change":"2024-09-21T03:25:04.451823+0000","last_active":"2024-09-21T03:25:04.451823+0000","last_peered":"2024-09-21T03:25:04.451823+0000","last_clean":"2024-09-21T03:25:04.451823+0000","last_became_active":"2024-09-21T03:14:38.465818+0000","last_became_peered":"2024-09-21T03:14:38.465818+0000","last_unstale":"2024-09-21T03:25:04.451823+0000","last_undegraded":"2024-09-21T03:25:04.451823+0000","last_fullsized":"2024-09-21T03:25:04.451823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3592","last_scrub_stamp":"2024-09-21T03:25:04.451721+0000","last_deep_scrub":"27'3592","last_deep_scrub_stamp":"2024-09-21T03:25:04.451721+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.451721+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:35.358061+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52996,"num_write_kb":671880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"27'2563","reported_seq":2592,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:11.289790+0000","last_change":"2024-09-21T03:25:11.289790+0000","last_active":"2024-09-21T03:25:11.289790+0000","last_peered":"2024-09-21T03:25:11.289790+0000","last_clean":"2024-09-21T03:25:11.289790+0000","last_became_active":"2024-09-21T03:14:47.576843+0000","last_became_peered":"2024-09-21T03:14:47.576843+0000","last_unstale":"2024-09-21T03:25:11.289790+0000","last_undegraded":"2024-09-21T03:25:11.289790+0000","last_fullsized":"2024-09-21T03:25:11.289790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2563","last_scrub_stamp":"2024-09-21T03:25:11.289634+0000","last_deep_scrub":"27'2563","last_deep_scrub_stamp":"2024-09-21T03:25:11.289634+0000","last_clean_scrub_stamp":"2024-09-21T03:25:11.289634+0000","objects_scrubbed":0,"log_size":2563,"log_dups_size":0,"ondisk_log_size":2563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:48.123663+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37386,"num_write_kb":384305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'2860","reported_seq":2898,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:58.694372+0000","last_change":"2024-09-21T03:24:58.694372+0000","last_active":"2024-09-21T03:24:58.694372+0000","last_peered":"2024-09-21T03:24:58.694372+0000","last_clean":"2024-09-21T03:24:58.694372+0000","last_became_active":"2024-09-21T03:14:38.470907+0000","last_became_peered":"2024-09-21T03:14:38.470907+0000","last_unstale":"2024-09-21T03:24:58.694372+0000","last_undegraded":"2024-09-21T03:24:58.694372+0000","last_fullsized":"2024-09-21T03:24:58.694372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2860","last_scrub_stamp":"2024-09-21T03:24:58.694251+0000","last_deep_scrub":"27'2860","last_deep_scrub_stamp":"2024-09-21T03:24:58.694251+0000","last_clean_scrub_stamp":"2024-09-21T03:24:58.694251+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:39.244244+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42241,"num_write_kb":536469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"27'3455","reported_seq":3476,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.323287+0000","last_change":"2024-09-21T03:14:47.551766+0000","last_active":"2024-09-21T03:24:45.323287+0000","last_peered":"2024-09-21T03:24:45.323287+0000","last_clean":"2024-09-21T03:24:45.323287+0000","last_became_active":"2024-09-21T03:14:47.551420+0000","last_became_peered":"2024-09-21T03:14:47.551420+0000","last_unstale":"2024-09-21T03:24:45.323287+0000","last_undegraded":"2024-09-21T03:24:45.323287+0000","last_fullsized":"2024-09-21T03:24:45.323287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3455,"log_dups_size":0,"ondisk_log_size":3455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50161,"num_write_kb":520876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'3215","reported_seq":3255,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.416550+0000","last_change":"2024-09-21T03:25:09.416476+0000","last_active":"2024-09-21T03:25:09.416550+0000","last_peered":"2024-09-21T03:25:09.416550+0000","last_clean":"2024-09-21T03:25:09.416550+0000","last_became_active":"2024-09-21T03:14:38.482306+0000","last_became_peered":"2024-09-21T03:14:38.482306+0000","last_unstale":"2024-09-21T03:25:09.416550+0000","last_undegraded":"2024-09-21T03:25:09.416550+0000","last_fullsized":"2024-09-21T03:25:09.416550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3215","last_scrub_stamp":"2024-09-21T03:25:09.416335+0000","last_deep_scrub":"27'3215","last_deep_scrub_stamp":"2024-09-21T03:25:09.416335+0000","last_clean_scrub_stamp":"2024-09-21T03:25:09.416335+0000","objects_scrubbed":0,"log_size":3215,"log_dups_size":0,"ondisk_log_size":3215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:52.859932+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47543,"num_write_kb":599147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"27'3010","reported_seq":3031,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.350470+0000","last_change":"2024-09-21T03:14:47.555070+0000","last_active":"2024-09-21T03:24:45.350470+0000","last_peered":"2024-09-21T03:24:45.350470+0000","last_clean":"2024-09-21T03:24:45.350470+0000","last_became_active":"2024-09-21T03:14:47.554363+0000","last_became_peered":"2024-09-21T03:14:47.554363+0000","last_unstale":"2024-09-21T03:24:45.350470+0000","last_undegraded":"2024-09-21T03:24:45.350470+0000","last_fullsized":"2024-09-21T03:24:45.350470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":3010,"log_dups_size":0,"ondisk_log_size":3010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:40.027266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43824,"num_write_kb":461158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"27'3736","reported_seq":3774,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:08.394652+0000","last_change":"2024-09-21T03:25:08.394579+0000","last_active":"2024-09-21T03:25:08.394652+0000","last_peered":"2024-09-21T03:25:08.394652+0000","last_clean":"2024-09-21T03:25:08.394652+0000","last_became_active":"2024-09-21T03:14:38.488537+0000","last_became_peered":"2024-09-21T03:14:38.488537+0000","last_unstale":"2024-09-21T03:25:08.394652+0000","last_undegraded":"2024-09-21T03:25:08.394652+0000","last_fullsized":"2024-09-21T03:25:08.394652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3736","last_scrub_stamp":"2024-09-21T03:25:08.394438+0000","last_deep_scrub":"27'3736","last_deep_scrub_stamp":"2024-09-21T03:25:08.394438+0000","last_clean_scrub_stamp":"2024-09-21T03:25:08.394438+0000","objects_scrubbed":0,"log_size":3736,"log_dups_size":0,"ondisk_log_size":3736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:06.352296+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55343,"num_write_kb":720948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"27'2851","reported_seq":2872,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:45.330815+0000","last_change":"2024-09-21T03:14:47.564250+0000","last_active":"2024-09-21T03:24:45.330815+0000","last_peered":"2024-09-21T03:24:45.330815+0000","last_clean":"2024-09-21T03:24:45.330815+0000","last_became_active":"2024-09-21T03:14:47.563745+0000","last_became_peered":"2024-09-21T03:14:47.563745+0000","last_unstale":"2024-09-21T03:24:45.330815+0000","last_undegraded":"2024-09-21T03:24:45.330815+0000","last_fullsized":"2024-09-21T03:24:45.330815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:14:46.510725+0000","last_clean_scrub_stamp":"2024-09-21T03:14:46.510725+0000","objects_scrubbed":0,"log_size":2851,"log_dups_size":0,"ondisk_log_size":2851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41602,"num_write_kb":429183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"27'2879","reported_seq":2917,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.411629+0000","last_change":"2024-09-21T03:25:06.411578+0000","last_active":"2024-09-21T03:25:06.411629+0000","last_peered":"2024-09-21T03:25:06.411629+0000","last_clean":"2024-09-21T03:25:06.411629+0000","last_became_active":"2024-09-21T03:14:38.489167+0000","last_became_peered":"2024-09-21T03:14:38.489167+0000","last_unstale":"2024-09-21T03:25:06.411629+0000","last_undegraded":"2024-09-21T03:25:06.411629+0000","last_fullsized":"2024-09-21T03:25:06.411629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2879","last_scrub_stamp":"2024-09-21T03:25:06.411489+0000","last_deep_scrub":"27'2879","last_deep_scrub_stamp":"2024-09-21T03:25:06.411489+0000","last_clean_scrub_stamp":"2024-09-21T03:25:06.411489+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:58.996378+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42623,"num_write_kb":515303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2771405,"num_write_kb":28539810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190768,"ondisk_log_size":190768,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":104689166,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":31,"num_read_kb":107,"num_write":3090,"num_write_kb":104327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":209436672,"data_stored":209378332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2790,"ondisk_log_size":2790,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2958225,"num_write_kb":37437445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200348,"ondisk_log_size":200348,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":158268058,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":29,"num_read_kb":105,"num_write":2795,"num_write_kb":156529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":316596224,"data_stored":316536116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2640,"ondisk_log_size":2640,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509572,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379144,"kb_used_data":41336,"kb_used_omap":1,"kb_used_meta":337790,"kb_avail":93992696,"statfs":{"total":96636764160,"available":96248520704,"internally_reserved":0,"allocated":42328064,"data_stored":42145705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":345897418},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509567,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":538640,"kb_used_data":66240,"kb_used_omap":1,"kb_used_meta":472382,"kb_avail":93833200,"statfs":{"total":96636764160,"available":96085196800,"internally_reserved":0,"allocated":67829760,"data_stored":67644340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":483719621},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509566,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":562860,"kb_used_data":84892,"kb_used_omap":1,"kb_used_meta":477950,"kb_avail":93808980,"statfs":{"total":96636764160,"available":96060395520,"internally_reserved":0,"allocated":86929408,"data_stored":86733732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":489421253},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509567,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":616200,"kb_used_data":61816,"kb_used_omap":1,"kb_used_meta":554366,"kb_avail":93755640,"statfs":{"total":96636764160,"available":96005775360,"internally_reserved":0,"allocated":63299584,"data_stored":63117886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":567671237},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509570,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468272,"kb_used_data":54112,"kb_used_omap":1,"kb_used_meta":414142,"kb_avail":93903568,"statfs":{"total":96636764160,"available":96157253632,"internally_reserved":0,"allocated":55410688,"data_stored":55230899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":424081861},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509568,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":575792,"kb_used_data":61728,"kb_used_omap":1,"kb_used_meta":514046,"kb_avail":93796048,"statfs":{"total":96636764160,"available":96047153152,"internally_reserved":0,"allocated":63209472,"data_stored":63029145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":526383557},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542273,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":477548,"kb_used_data":45340,"kb_used_omap":1,"kb_used_meta":432190,"kb_avail":93894292,"statfs":{"total":96636764160,"available":96147755008,"internally_reserved":0,"allocated":46428160,"data_stored":46252455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":442563014},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542271,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":587960,"kb_used_data":101608,"kb_used_omap":1,"kb_used_meta":486334,"kb_avail":93783880,"statfs":{"total":96636764160,"available":96034693120,"internally_reserved":0,"allocated":104046592,"data_stored":103856534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":498006471},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":62922752,"data_stored":62914616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33558528,"data_stored":33554502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65908736,"data_stored":65904402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":44949504,"data_stored":44933644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":37847040,"data_stored":37836908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25264128,"data_stored":25254028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37842944,"data_stored":37836951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37855232,"data_stored":37837693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":41697280,"data_stored":41685649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29106176,"data_stored":29102625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:25:16.326 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.326 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.326 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.327 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.327 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.327 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.327 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.327 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.327 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.328 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.328 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.328 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.328 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.329 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.329 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.329 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.329 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.329 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.329 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.329 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.330 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.330 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-21T03:14:45.508021+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.330 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.330 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.330 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.330 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.331 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.331 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.331 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.331 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.331 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.331 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.331 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.332 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.332 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.332 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.332 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.332 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.332 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.332 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.333 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.333 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.333 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.333 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.333 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-09-21T03:14:46.510725+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=14, tm_sec=46, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=24, tm_sec=48, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:25:16.333 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T03:25:33.137 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:25:33.142 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:25:36.334 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:25:36.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.564+0000 7f60d5600640 1 -- 172.21.15.90:0/3153462304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60b4004800 msgr2=0x7f60b4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.564+0000 7f60d5600640 1 --2- 172.21.15.90:0/3153462304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60b4004800 0x7f60b4004c10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00c310 tx=0x7f60b4005830 comp rx=0 tx=0).stop 2024-09-21T03:25:36.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.564+0000 7f60d5600640 1 -- 172.21.15.90:0/3153462304 shutdown_connections 2024-09-21T03:25:36.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.564+0000 7f60d5600640 1 --2- 172.21.15.90:0/3153462304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60b4004800 0x7f60b4004c10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.564+0000 7f60d5600640 1 -- 172.21.15.90:0/3153462304 >> 172.21.15.90:0/3153462304 conn(0x7f60d00ccda0 msgr2=0x7f60d00c8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:36.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.565+0000 7f60d5600640 1 -- 172.21.15.90:0/3153462304 shutdown_connections 2024-09-21T03:25:36.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.565+0000 7f60d5600640 1 -- 172.21.15.90:0/3153462304 wait complete. 2024-09-21T03:25:36.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.567+0000 7f60d5600640 1 Processor -- start 2024-09-21T03:25:36.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.567+0000 7f60d5600640 1 -- start start 2024-09-21T03:25:36.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.568+0000 7f60d5600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60b4004800 0x7f60d01e1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:36.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.568+0000 7f60d5600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60d00b1cc0 0x7f60d01592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:36.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.568+0000 7f60d5600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60d00ae280 0x7f60d00ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.568+0000 7f60d5600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f60d00c83f0 con 0x7f60d00b1cc0 2024-09-21T03:25:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.568+0000 7f60d5600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f60d00c8570 con 0x7f60b4004800 2024-09-21T03:25:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.568+0000 7f60d5600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f60d006df80 con 0x7f60d00ae280 2024-09-21T03:25:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.568+0000 7f60cf400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60d00b1cc0 0x7f60d01592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.569+0000 7f60cf400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60d00b1cc0 0x7f60d01592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35806/0 (socket says 172.21.15.90:35806) 2024-09-21T03:25:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.569+0000 7f60cf400640 1 -- 172.21.15.90:0/1953634564 learned_addr learned my addr 172.21.15.90:0/1953634564 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:25:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.569+0000 7f60d4c00640 1 --2- 172.21.15.90:0/1953634564 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60d00ae280 0x7f60d00ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.569+0000 7f60cfe00640 1 --2- 172.21.15.90:0/1953634564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60b4004800 0x7f60d01e1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.569+0000 7f60cf400640 1 -- 172.21.15.90:0/1953634564 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60d00ae280 msgr2=0x7f60d00ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.569+0000 7f60cf400640 1 --2- 172.21.15.90:0/1953634564 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60d00ae280 0x7f60d00ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.569+0000 7f60cf400640 1 -- 172.21.15.90:0/1953634564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60b4004800 msgr2=0x7f60d01e1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.569+0000 7f60cf400640 1 --2- 172.21.15.90:0/1953634564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60b4004800 0x7f60d01e1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.569+0000 7f60cf400640 1 -- 172.21.15.90:0/1953634564 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d00b0570 con 0x7f60d00b1cc0 2024-09-21T03:25:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.569+0000 7f60cf400640 1 --2- 172.21.15.90:0/1953634564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60d00b1cc0 0x7f60d01592e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f60bc02b160 tx=0x7f60bc001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.570+0000 7f60c7e00640 1 -- 172.21.15.90:0/1953634564 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60bc031040 con 0x7f60d00b1cc0 2024-09-21T03:25:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.570+0000 7f60c7e00640 1 -- 172.21.15.90:0/1953634564 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60bc0035f0 con 0x7f60d00b1cc0 2024-09-21T03:25:36.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.570+0000 7f60d5600640 1 -- 172.21.15.90:0/1953634564 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60d014a460 con 0x7f60d00b1cc0 2024-09-21T03:25:36.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.570+0000 7f60c7e00640 1 -- 172.21.15.90:0/1953634564 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60bc003a20 con 0x7f60d00b1cc0 2024-09-21T03:25:36.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.570+0000 7f60d5600640 1 -- 172.21.15.90:0/1953634564 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60d00b0f80 con 0x7f60d00b1cc0 2024-09-21T03:25:36.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.571+0000 7f60d5600640 1 -- 172.21.15.90:0/1953634564 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60d015ad00 con 0x7f60d00b1cc0 2024-09-21T03:25:36.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.572+0000 7f60c7e00640 1 -- 172.21.15.90:0/1953634564 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f60bc03e030 con 0x7f60d00b1cc0 2024-09-21T03:25:36.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.573+0000 7f60c7e00640 1 --2- 172.21.15.90:0/1953634564 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f60b0078b90 0x7f60b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:36.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.573+0000 7f60c7e00640 1 -- 172.21.15.90:0/1953634564 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f60bc0bad40 con 0x7f60d00b1cc0 2024-09-21T03:25:36.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.574+0000 7f60cfe00640 1 --2- 172.21.15.90:0/1953634564 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f60b0078b90 0x7f60b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:36.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.574+0000 7f60cfe00640 1 --2- 172.21.15.90:0/1953634564 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f60b0078b90 0x7f60b007b0a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f60c0009cd0 tx=0x7f60c0005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:36.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.578+0000 7f60c7e00640 1 -- 172.21.15.90:0/1953634564 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f60bc082760 con 0x7f60d00b1cc0 2024-09-21T03:25:36.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.759+0000 7f60d5600640 1 -- 172.21.15.90:0/1953634564 --> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f60d014e730 con 0x7f60b0078b90 2024-09-21T03:25:36.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.768+0000 7f60c7e00640 1 -- 172.21.15.90:0/1953634564 <== mgr.4106 v2:172.21.15.149:6800/1230645092 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+495381 (secure 0 0 0) 0x7f60c0099f30 con 0x7f60b0078b90 2024-09-21T03:25:36.776 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:25:36.779 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-21T03:25:36.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.773+0000 7f60d5600640 1 -- 172.21.15.90:0/1953634564 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f60b0078b90 msgr2=0x7f60b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.773+0000 7f60d5600640 1 --2- 172.21.15.90:0/1953634564 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f60b0078b90 0x7f60b007b0a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f60c0009cd0 tx=0x7f60c0005f90 comp rx=0 tx=0).stop 2024-09-21T03:25:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.773+0000 7f60d5600640 1 -- 172.21.15.90:0/1953634564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60d00b1cc0 msgr2=0x7f60d01592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.773+0000 7f60d5600640 1 --2- 172.21.15.90:0/1953634564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60d00b1cc0 0x7f60d01592e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f60bc02b160 tx=0x7f60bc001d80 comp rx=0 tx=0).stop 2024-09-21T03:25:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.774+0000 7f60d5600640 1 -- 172.21.15.90:0/1953634564 shutdown_connections 2024-09-21T03:25:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.774+0000 7f60d5600640 1 --2- 172.21.15.90:0/1953634564 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f60b0078b90 0x7f60b007b0a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.774+0000 7f60d5600640 1 --2- 172.21.15.90:0/1953634564 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60d00ae280 0x7f60d00ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.774+0000 7f60d5600640 1 --2- 172.21.15.90:0/1953634564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60d00b1cc0 0x7f60d01592e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.774+0000 7f60d5600640 1 --2- 172.21.15.90:0/1953634564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60b4004800 0x7f60d01e1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.774+0000 7f60d5600640 1 -- 172.21.15.90:0/1953634564 >> 172.21.15.90:0/1953634564 conn(0x7f60d00ccda0 msgr2=0x7f60d014f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.774+0000 7f60d5600640 1 -- 172.21.15.90:0/1953634564 shutdown_connections 2024-09-21T03:25:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:36.774+0000 7f60d5600640 1 -- 172.21.15.90:0/1953634564 wait complete. 2024-09-21T03:25:36.802 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":358,"stamp":"2024-09-21T03:25:34.765408+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":263547592,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":126,"num_read_kb":267,"num_write":5735616,"num_write_kb":66239739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":396628,"ondisk_log_size":396628,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4206416,"kb_used_data":517072,"kb_used_omap":12,"kb_used_meta":3689203,"kb_avail":750768304,"statfs":{"total":773094113280,"available":768786743296,"internally_reserved":0,"allocated":529481728,"data_stored":528010696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":3777744432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004262"},"pg_stats":[{"pgid":"5.18","version":"27'2955","reported_seq":2984,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:00.507641+0000","last_change":"2024-09-21T03:25:00.507641+0000","last_active":"2024-09-21T03:25:00.507641+0000","last_peered":"2024-09-21T03:25:00.507641+0000","last_clean":"2024-09-21T03:25:00.507641+0000","last_became_active":"2024-09-21T03:14:47.551883+0000","last_became_peered":"2024-09-21T03:14:47.551883+0000","last_unstale":"2024-09-21T03:25:00.507641+0000","last_undegraded":"2024-09-21T03:25:00.507641+0000","last_fullsized":"2024-09-21T03:25:00.507641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2955","last_scrub_stamp":"2024-09-21T03:25:00.507540+0000","last_deep_scrub":"27'2955","last_deep_scrub_stamp":"2024-09-21T03:25:00.507540+0000","last_clean_scrub_stamp":"2024-09-21T03:25:00.507540+0000","objects_scrubbed":0,"log_size":2955,"log_dups_size":0,"ondisk_log_size":2955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:57.221123+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42893,"num_write_kb":435375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"27'185","reported_seq":225,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:57.651608+0000","last_change":"2024-09-21T03:24:57.651531+0000","last_active":"2024-09-21T03:24:57.651608+0000","last_peered":"2024-09-21T03:24:57.651608+0000","last_clean":"2024-09-21T03:24:57.651608+0000","last_became_active":"2024-09-21T03:14:37.470563+0000","last_became_peered":"2024-09-21T03:14:37.470563+0000","last_unstale":"2024-09-21T03:24:57.651608+0000","last_undegraded":"2024-09-21T03:24:57.651608+0000","last_fullsized":"2024-09-21T03:24:57.651608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'185","last_scrub_stamp":"2024-09-21T03:24:57.651414+0000","last_deep_scrub":"27'185","last_deep_scrub_stamp":"2024-09-21T03:24:57.651414+0000","last_clean_scrub_stamp":"2024-09-21T03:24:57.651414+0000","objects_scrubbed":4,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:49.472472+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7184146,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":7088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'3329","reported_seq":3367,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:01.469310+0000","last_change":"2024-09-21T03:25:01.469310+0000","last_active":"2024-09-21T03:25:01.469310+0000","last_peered":"2024-09-21T03:25:01.469310+0000","last_clean":"2024-09-21T03:25:01.469310+0000","last_became_active":"2024-09-21T03:14:38.488292+0000","last_became_peered":"2024-09-21T03:14:38.488292+0000","last_unstale":"2024-09-21T03:25:01.469310+0000","last_undegraded":"2024-09-21T03:25:01.469310+0000","last_fullsized":"2024-09-21T03:25:01.469310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3329","last_scrub_stamp":"2024-09-21T03:25:01.469210+0000","last_deep_scrub":"27'3329","last_deep_scrub_stamp":"2024-09-21T03:25:01.469210+0000","last_clean_scrub_stamp":"2024-09-21T03:25:01.469210+0000","objects_scrubbed":0,"log_size":3329,"log_dups_size":0,"ondisk_log_size":3329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:08.097646+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49408,"num_write_kb":622324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:04.350555+0000","last_change":"2024-09-21T03:25:04.350555+0000","last_active":"2024-09-21T03:25:04.350555+0000","last_peered":"2024-09-21T03:25:04.350555+0000","last_clean":"2024-09-21T03:25:04.350555+0000","last_became_active":"2024-09-21T03:14:46.549536+0000","last_became_peered":"2024-09-21T03:14:46.549536+0000","last_unstale":"2024-09-21T03:25:04.350555+0000","last_undegraded":"2024-09-21T03:25:04.350555+0000","last_fullsized":"2024-09-21T03:25:04.350555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-09-21T03:25:04.350437+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-09-21T03:25:04.350437+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.350437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:49:45.571099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"27'3463","reported_seq":3492,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:17.731792+0000","last_change":"2024-09-21T03:25:17.731792+0000","last_active":"2024-09-21T03:25:17.731792+0000","last_peered":"2024-09-21T03:25:17.731792+0000","last_clean":"2024-09-21T03:25:17.731792+0000","last_became_active":"2024-09-21T03:14:47.559659+0000","last_became_peered":"2024-09-21T03:14:47.559659+0000","last_unstale":"2024-09-21T03:25:17.731792+0000","last_undegraded":"2024-09-21T03:25:17.731792+0000","last_fullsized":"2024-09-21T03:25:17.731792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3463","last_scrub_stamp":"2024-09-21T03:25:17.731660+0000","last_deep_scrub":"27'3463","last_deep_scrub_stamp":"2024-09-21T03:25:17.731660+0000","last_clean_scrub_stamp":"2024-09-21T03:25:17.731660+0000","objects_scrubbed":0,"log_size":3463,"log_dups_size":0,"ondisk_log_size":3463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:24.859857+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50427,"num_write_kb":517490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"27'11","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:56.483636+0000","last_change":"2024-09-21T03:24:56.483636+0000","last_active":"2024-09-21T03:24:56.483636+0000","last_peered":"2024-09-21T03:24:56.483636+0000","last_clean":"2024-09-21T03:24:56.483636+0000","last_became_active":"2024-09-21T03:14:37.467146+0000","last_became_peered":"2024-09-21T03:14:37.467146+0000","last_unstale":"2024-09-21T03:24:56.483636+0000","last_undegraded":"2024-09-21T03:24:56.483636+0000","last_fullsized":"2024-09-21T03:24:56.483636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-09-21T03:24:56.483537+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-09-21T03:24:56.483537+0000","last_clean_scrub_stamp":"2024-09-21T03:24:56.483537+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:02.364107+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'3692","reported_seq":3730,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:02.449436+0000","last_change":"2024-09-21T03:25:02.449367+0000","last_active":"2024-09-21T03:25:02.449436+0000","last_peered":"2024-09-21T03:25:02.449436+0000","last_clean":"2024-09-21T03:25:02.449436+0000","last_became_active":"2024-09-21T03:14:38.486090+0000","last_became_peered":"2024-09-21T03:14:38.486090+0000","last_unstale":"2024-09-21T03:25:02.449436+0000","last_undegraded":"2024-09-21T03:25:02.449436+0000","last_fullsized":"2024-09-21T03:25:02.449436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3692","last_scrub_stamp":"2024-09-21T03:25:02.449256+0000","last_deep_scrub":"27'3692","last_deep_scrub_stamp":"2024-09-21T03:25:02.449256+0000","last_clean_scrub_stamp":"2024-09-21T03:25:02.449256+0000","objects_scrubbed":0,"log_size":3692,"log_dups_size":0,"ondisk_log_size":3692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:20.161317+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54471,"num_write_kb":691181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'49","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:03.758108+0000","last_change":"2024-09-21T03:25:03.758108+0000","last_active":"2024-09-21T03:25:03.758108+0000","last_peered":"2024-09-21T03:25:03.758108+0000","last_clean":"2024-09-21T03:25:03.758108+0000","last_became_active":"2024-09-21T03:14:46.541357+0000","last_became_peered":"2024-09-21T03:14:46.541357+0000","last_unstale":"2024-09-21T03:25:03.758108+0000","last_undegraded":"2024-09-21T03:25:03.758108+0000","last_fullsized":"2024-09-21T03:25:03.758108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2024-09-21T03:25:03.758031+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2024-09-21T03:25:03.758031+0000","last_clean_scrub_stamp":"2024-09-21T03:25:03.758031+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:21.737949+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":8225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"27'2623","reported_seq":2654,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:03.538042+0000","last_change":"2024-09-21T03:25:03.538042+0000","last_active":"2024-09-21T03:25:03.538042+0000","last_peered":"2024-09-21T03:25:03.538042+0000","last_clean":"2024-09-21T03:25:03.538042+0000","last_became_active":"2024-09-21T03:14:47.553312+0000","last_became_peered":"2024-09-21T03:14:47.553312+0000","last_unstale":"2024-09-21T03:25:03.538042+0000","last_undegraded":"2024-09-21T03:25:03.538042+0000","last_fullsized":"2024-09-21T03:25:03.538042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2623","last_scrub_stamp":"2024-09-21T03:25:03.537938+0000","last_deep_scrub":"27'2623","last_deep_scrub_stamp":"2024-09-21T03:25:03.537938+0000","last_clean_scrub_stamp":"2024-09-21T03:25:03.537938+0000","objects_scrubbed":0,"log_size":2623,"log_dups_size":0,"ondisk_log_size":2623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:18.371564+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37737,"num_write_kb":383006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"27'46","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:56.318856+0000","last_change":"2024-09-21T03:24:56.318856+0000","last_active":"2024-09-21T03:24:56.318856+0000","last_peered":"2024-09-21T03:24:56.318856+0000","last_clean":"2024-09-21T03:24:56.318856+0000","last_became_active":"2024-09-21T03:14:37.477910+0000","last_became_peered":"2024-09-21T03:14:37.477910+0000","last_unstale":"2024-09-21T03:24:56.318856+0000","last_undegraded":"2024-09-21T03:24:56.318856+0000","last_fullsized":"2024-09-21T03:24:56.318856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-09-21T03:24:56.318773+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-09-21T03:24:56.318773+0000","last_clean_scrub_stamp":"2024-09-21T03:24:56.318773+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:56.545132+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2285","reported_seq":2322,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:55.598504+0000","last_change":"2024-09-21T03:24:55.598504+0000","last_active":"2024-09-21T03:24:55.598504+0000","last_peered":"2024-09-21T03:24:55.598504+0000","last_clean":"2024-09-21T03:24:55.598504+0000","last_became_active":"2024-09-21T03:14:38.472426+0000","last_became_peered":"2024-09-21T03:14:38.472426+0000","last_unstale":"2024-09-21T03:24:55.598504+0000","last_undegraded":"2024-09-21T03:24:55.598504+0000","last_fullsized":"2024-09-21T03:24:55.598504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2285","last_scrub_stamp":"2024-09-21T03:24:55.598420+0000","last_deep_scrub":"27'2285","last_deep_scrub_stamp":"2024-09-21T03:24:55.598420+0000","last_clean_scrub_stamp":"2024-09-21T03:24:55.598420+0000","objects_scrubbed":0,"log_size":2285,"log_dups_size":0,"ondisk_log_size":2285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:43.228751+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33481,"num_write_kb":420875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1062","reported_seq":1093,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.741521+0000","last_change":"2024-09-21T03:25:06.741521+0000","last_active":"2024-09-21T03:25:06.741521+0000","last_peered":"2024-09-21T03:25:06.741521+0000","last_clean":"2024-09-21T03:25:06.741521+0000","last_became_active":"2024-09-21T03:14:46.525587+0000","last_became_peered":"2024-09-21T03:14:46.525587+0000","last_unstale":"2024-09-21T03:25:06.741521+0000","last_undegraded":"2024-09-21T03:25:06.741521+0000","last_fullsized":"2024-09-21T03:25:06.741521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1062","last_scrub_stamp":"2024-09-21T03:25:06.741387+0000","last_deep_scrub":"27'1062","last_deep_scrub_stamp":"2024-09-21T03:25:06.741387+0000","last_clean_scrub_stamp":"2024-09-21T03:25:06.741387+0000","objects_scrubbed":1,"log_size":1062,"log_dups_size":0,"ondisk_log_size":1062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:05.252964+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1059,"num_write_kb":5042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"27'2269","reported_seq":2298,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:11.762745+0000","last_change":"2024-09-21T03:25:11.762745+0000","last_active":"2024-09-21T03:25:11.762745+0000","last_peered":"2024-09-21T03:25:11.762745+0000","last_clean":"2024-09-21T03:25:11.762745+0000","last_became_active":"2024-09-21T03:14:47.553802+0000","last_became_peered":"2024-09-21T03:14:47.553802+0000","last_unstale":"2024-09-21T03:25:11.762745+0000","last_undegraded":"2024-09-21T03:25:11.762745+0000","last_fullsized":"2024-09-21T03:25:11.762745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2269","last_scrub_stamp":"2024-09-21T03:25:11.762620+0000","last_deep_scrub":"27'2269","last_deep_scrub_stamp":"2024-09-21T03:25:11.762620+0000","last_clean_scrub_stamp":"2024-09-21T03:25:11.762620+0000","objects_scrubbed":0,"log_size":2269,"log_dups_size":0,"ondisk_log_size":2269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:46.383594+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32861,"num_write_kb":341635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'15","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:54.235628+0000","last_change":"2024-09-21T03:24:54.235628+0000","last_active":"2024-09-21T03:24:54.235628+0000","last_peered":"2024-09-21T03:24:54.235628+0000","last_clean":"2024-09-21T03:24:54.235628+0000","last_became_active":"2024-09-21T03:14:37.478893+0000","last_became_peered":"2024-09-21T03:14:37.478893+0000","last_unstale":"2024-09-21T03:24:54.235628+0000","last_undegraded":"2024-09-21T03:24:54.235628+0000","last_fullsized":"2024-09-21T03:24:54.235628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-09-21T03:24:54.235523+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-09-21T03:24:54.235523+0000","last_clean_scrub_stamp":"2024-09-21T03:24:54.235523+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:05.978658+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'3862","reported_seq":3899,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.707440+0000","last_change":"2024-09-21T03:25:07.707440+0000","last_active":"2024-09-21T03:25:07.707440+0000","last_peered":"2024-09-21T03:25:07.707440+0000","last_clean":"2024-09-21T03:25:07.707440+0000","last_became_active":"2024-09-21T03:14:38.467570+0000","last_became_peered":"2024-09-21T03:14:38.467570+0000","last_unstale":"2024-09-21T03:25:07.707440+0000","last_undegraded":"2024-09-21T03:25:07.707440+0000","last_fullsized":"2024-09-21T03:25:07.707440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3862","last_scrub_stamp":"2024-09-21T03:25:07.707332+0000","last_deep_scrub":"27'3862","last_deep_scrub_stamp":"2024-09-21T03:25:07.707332+0000","last_clean_scrub_stamp":"2024-09-21T03:25:07.707332+0000","objects_scrubbed":0,"log_size":3862,"log_dups_size":0,"ondisk_log_size":3862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:08:12.447025+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57219,"num_write_kb":702431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'52","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:02.731779+0000","last_change":"2024-09-21T03:25:02.731779+0000","last_active":"2024-09-21T03:25:02.731779+0000","last_peered":"2024-09-21T03:25:02.731779+0000","last_clean":"2024-09-21T03:25:02.731779+0000","last_became_active":"2024-09-21T03:14:46.529629+0000","last_became_peered":"2024-09-21T03:14:46.529629+0000","last_unstale":"2024-09-21T03:25:02.731779+0000","last_undegraded":"2024-09-21T03:25:02.731779+0000","last_fullsized":"2024-09-21T03:25:02.731779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2024-09-21T03:25:02.731689+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2024-09-21T03:25:02.731689+0000","last_clean_scrub_stamp":"2024-09-21T03:25:02.731689+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:33:24.871448+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":8220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"27'3149","reported_seq":3178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:15.234511+0000","last_change":"2024-09-21T03:25:15.234511+0000","last_active":"2024-09-21T03:25:15.234511+0000","last_peered":"2024-09-21T03:25:15.234511+0000","last_clean":"2024-09-21T03:25:15.234511+0000","last_became_active":"2024-09-21T03:14:47.546770+0000","last_became_peered":"2024-09-21T03:14:47.546770+0000","last_unstale":"2024-09-21T03:25:15.234511+0000","last_undegraded":"2024-09-21T03:25:15.234511+0000","last_fullsized":"2024-09-21T03:25:15.234511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3149","last_scrub_stamp":"2024-09-21T03:25:15.234378+0000","last_deep_scrub":"27'3149","last_deep_scrub_stamp":"2024-09-21T03:25:15.234378+0000","last_clean_scrub_stamp":"2024-09-21T03:25:15.234378+0000","objects_scrubbed":0,"log_size":3149,"log_dups_size":0,"ondisk_log_size":3149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:12.947008+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45697,"num_write_kb":467369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"27'2916","reported_seq":2953,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:01.748514+0000","last_change":"2024-09-21T03:25:01.748514+0000","last_active":"2024-09-21T03:25:01.748514+0000","last_peered":"2024-09-21T03:25:01.748514+0000","last_clean":"2024-09-21T03:25:01.748514+0000","last_became_active":"2024-09-21T03:14:38.476386+0000","last_became_peered":"2024-09-21T03:14:38.476386+0000","last_unstale":"2024-09-21T03:25:01.748514+0000","last_undegraded":"2024-09-21T03:25:01.748514+0000","last_fullsized":"2024-09-21T03:25:01.748514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2916","last_scrub_stamp":"2024-09-21T03:25:01.748423+0000","last_deep_scrub":"27'2916","last_deep_scrub_stamp":"2024-09-21T03:25:01.748423+0000","last_clean_scrub_stamp":"2024-09-21T03:25:01.748423+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:57.204079+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43116,"num_write_kb":539220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'229","reported_seq":268,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:58.771599+0000","last_change":"2024-09-21T03:24:58.771599+0000","last_active":"2024-09-21T03:24:58.771599+0000","last_peered":"2024-09-21T03:24:58.771599+0000","last_clean":"2024-09-21T03:24:58.771599+0000","last_became_active":"2024-09-21T03:14:37.461409+0000","last_became_peered":"2024-09-21T03:14:37.461409+0000","last_unstale":"2024-09-21T03:24:58.771599+0000","last_undegraded":"2024-09-21T03:24:58.771599+0000","last_fullsized":"2024-09-21T03:24:58.771599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'229","last_scrub_stamp":"2024-09-21T03:24:58.771491+0000","last_deep_scrub":"27'229","last_deep_scrub_stamp":"2024-09-21T03:24:58.771491+0000","last_clean_scrub_stamp":"2024-09-21T03:24:58.771491+0000","objects_scrubbed":3,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:33.406519+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":8373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'27","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:14.778104+0000","last_change":"2024-09-21T03:25:14.778104+0000","last_active":"2024-09-21T03:25:14.778104+0000","last_peered":"2024-09-21T03:25:14.778104+0000","last_clean":"2024-09-21T03:25:14.778104+0000","last_became_active":"2024-09-21T03:14:46.537493+0000","last_became_peered":"2024-09-21T03:14:46.537493+0000","last_unstale":"2024-09-21T03:25:14.778104+0000","last_undegraded":"2024-09-21T03:25:14.778104+0000","last_fullsized":"2024-09-21T03:25:14.778104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-09-21T03:25:14.777945+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-09-21T03:25:14.777945+0000","last_clean_scrub_stamp":"2024-09-21T03:25:14.777945+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:22.504278+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"27'3066","reported_seq":3095,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:08.341306+0000","last_change":"2024-09-21T03:25:08.341306+0000","last_active":"2024-09-21T03:25:08.341306+0000","last_peered":"2024-09-21T03:25:08.341306+0000","last_clean":"2024-09-21T03:25:08.341306+0000","last_became_active":"2024-09-21T03:14:47.580210+0000","last_became_peered":"2024-09-21T03:14:47.580210+0000","last_unstale":"2024-09-21T03:25:08.341306+0000","last_undegraded":"2024-09-21T03:25:08.341306+0000","last_fullsized":"2024-09-21T03:25:08.341306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3066","last_scrub_stamp":"2024-09-21T03:25:08.341149+0000","last_deep_scrub":"27'3066","last_deep_scrub_stamp":"2024-09-21T03:25:08.341149+0000","last_clean_scrub_stamp":"2024-09-21T03:25:08.341149+0000","objects_scrubbed":0,"log_size":3066,"log_dups_size":0,"ondisk_log_size":3066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:30.772179+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44544,"num_write_kb":453960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"27'2513","reported_seq":2550,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:58.318820+0000","last_change":"2024-09-21T03:24:58.318820+0000","last_active":"2024-09-21T03:24:58.318820+0000","last_peered":"2024-09-21T03:24:58.318820+0000","last_clean":"2024-09-21T03:24:58.318820+0000","last_became_active":"2024-09-21T03:14:38.486802+0000","last_became_peered":"2024-09-21T03:14:38.486802+0000","last_unstale":"2024-09-21T03:24:58.318820+0000","last_undegraded":"2024-09-21T03:24:58.318820+0000","last_fullsized":"2024-09-21T03:24:58.318820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2513","last_scrub_stamp":"2024-09-21T03:24:58.318727+0000","last_deep_scrub":"27'2513","last_deep_scrub_stamp":"2024-09-21T03:24:58.318727+0000","last_clean_scrub_stamp":"2024-09-21T03:24:58.318727+0000","objects_scrubbed":0,"log_size":2513,"log_dups_size":0,"ondisk_log_size":2513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:27.443831+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37114,"num_write_kb":476028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'17","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:55.811250+0000","last_change":"2024-09-21T03:24:55.811250+0000","last_active":"2024-09-21T03:24:55.811250+0000","last_peered":"2024-09-21T03:24:55.811250+0000","last_clean":"2024-09-21T03:24:55.811250+0000","last_became_active":"2024-09-21T03:14:37.465551+0000","last_became_peered":"2024-09-21T03:14:37.465551+0000","last_unstale":"2024-09-21T03:24:55.811250+0000","last_undegraded":"2024-09-21T03:24:55.811250+0000","last_fullsized":"2024-09-21T03:24:55.811250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-09-21T03:24:55.811156+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-09-21T03:24:55.811156+0000","last_clean_scrub_stamp":"2024-09-21T03:24:55.811156+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:25.006798+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.448299+0000","last_change":"2024-09-21T03:25:05.448299+0000","last_active":"2024-09-21T03:25:05.448299+0000","last_peered":"2024-09-21T03:25:05.448299+0000","last_clean":"2024-09-21T03:25:05.448299+0000","last_became_active":"2024-09-21T03:14:46.546312+0000","last_became_peered":"2024-09-21T03:14:46.546312+0000","last_unstale":"2024-09-21T03:25:05.448299+0000","last_undegraded":"2024-09-21T03:25:05.448299+0000","last_fullsized":"2024-09-21T03:25:05.448299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-09-21T03:25:05.448215+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-09-21T03:25:05.448215+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.448215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:03.847300+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"27'2659","reported_seq":2688,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:20.797328+0000","last_change":"2024-09-21T03:25:20.797328+0000","last_active":"2024-09-21T03:25:20.797328+0000","last_peered":"2024-09-21T03:25:20.797328+0000","last_clean":"2024-09-21T03:25:20.797328+0000","last_became_active":"2024-09-21T03:14:47.558431+0000","last_became_peered":"2024-09-21T03:14:47.558431+0000","last_unstale":"2024-09-21T03:25:20.797328+0000","last_undegraded":"2024-09-21T03:25:20.797328+0000","last_fullsized":"2024-09-21T03:25:20.797328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2659","last_scrub_stamp":"2024-09-21T03:25:20.797215+0000","last_deep_scrub":"27'2659","last_deep_scrub_stamp":"2024-09-21T03:25:20.797215+0000","last_clean_scrub_stamp":"2024-09-21T03:25:20.797215+0000","objects_scrubbed":0,"log_size":2659,"log_dups_size":0,"ondisk_log_size":2659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:34.985022+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38628,"num_write_kb":413288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"27'3227","reported_seq":3264,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:01.612537+0000","last_change":"2024-09-21T03:25:01.612537+0000","last_active":"2024-09-21T03:25:01.612537+0000","last_peered":"2024-09-21T03:25:01.612537+0000","last_clean":"2024-09-21T03:25:01.612537+0000","last_became_active":"2024-09-21T03:14:38.476976+0000","last_became_peered":"2024-09-21T03:14:38.476976+0000","last_unstale":"2024-09-21T03:25:01.612537+0000","last_undegraded":"2024-09-21T03:25:01.612537+0000","last_fullsized":"2024-09-21T03:25:01.612537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3227","last_scrub_stamp":"2024-09-21T03:25:01.612446+0000","last_deep_scrub":"27'3227","last_deep_scrub_stamp":"2024-09-21T03:25:01.612446+0000","last_clean_scrub_stamp":"2024-09-21T03:25:01.612446+0000","objects_scrubbed":0,"log_size":3227,"log_dups_size":0,"ondisk_log_size":3227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:32.017166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47858,"num_write_kb":595125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'16","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:55.590273+0000","last_change":"2024-09-21T03:24:55.590273+0000","last_active":"2024-09-21T03:24:55.590273+0000","last_peered":"2024-09-21T03:24:55.590273+0000","last_clean":"2024-09-21T03:24:55.590273+0000","last_became_active":"2024-09-21T03:14:37.478840+0000","last_became_peered":"2024-09-21T03:14:37.478840+0000","last_unstale":"2024-09-21T03:24:55.590273+0000","last_undegraded":"2024-09-21T03:24:55.590273+0000","last_fullsized":"2024-09-21T03:24:55.590273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-09-21T03:24:55.590153+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-09-21T03:24:55.590153+0000","last_clean_scrub_stamp":"2024-09-21T03:24:55.590153+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:06.788193+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'26","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:03.321924+0000","last_change":"2024-09-21T03:25:03.321924+0000","last_active":"2024-09-21T03:25:03.321924+0000","last_peered":"2024-09-21T03:25:03.321924+0000","last_clean":"2024-09-21T03:25:03.321924+0000","last_became_active":"2024-09-21T03:14:46.542721+0000","last_became_peered":"2024-09-21T03:14:46.542721+0000","last_unstale":"2024-09-21T03:25:03.321924+0000","last_undegraded":"2024-09-21T03:25:03.321924+0000","last_fullsized":"2024-09-21T03:25:03.321924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2024-09-21T03:25:03.321828+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2024-09-21T03:25:03.321828+0000","last_clean_scrub_stamp":"2024-09-21T03:25:03.321828+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:09.410532+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"27'3357","reported_seq":3386,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:58.564594+0000","last_change":"2024-09-21T03:24:58.564594+0000","last_active":"2024-09-21T03:24:58.564594+0000","last_peered":"2024-09-21T03:24:58.564594+0000","last_clean":"2024-09-21T03:24:58.564594+0000","last_became_active":"2024-09-21T03:14:47.566634+0000","last_became_peered":"2024-09-21T03:14:47.566634+0000","last_unstale":"2024-09-21T03:24:58.564594+0000","last_undegraded":"2024-09-21T03:24:58.564594+0000","last_fullsized":"2024-09-21T03:24:58.564594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3357","last_scrub_stamp":"2024-09-21T03:24:58.564510+0000","last_deep_scrub":"27'3357","last_deep_scrub_stamp":"2024-09-21T03:24:58.564510+0000","last_clean_scrub_stamp":"2024-09-21T03:24:58.564510+0000","objects_scrubbed":0,"log_size":3357,"log_dups_size":0,"ondisk_log_size":3357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:40:06.038265+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48633,"num_write_kb":505858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'2924","reported_seq":2962,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:02.705890+0000","last_change":"2024-09-21T03:25:02.705830+0000","last_active":"2024-09-21T03:25:02.705890+0000","last_peered":"2024-09-21T03:25:02.705890+0000","last_clean":"2024-09-21T03:25:02.705890+0000","last_became_active":"2024-09-21T03:14:38.482369+0000","last_became_peered":"2024-09-21T03:14:38.482369+0000","last_unstale":"2024-09-21T03:25:02.705890+0000","last_undegraded":"2024-09-21T03:25:02.705890+0000","last_fullsized":"2024-09-21T03:25:02.705890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2924","last_scrub_stamp":"2024-09-21T03:25:02.705279+0000","last_deep_scrub":"27'2924","last_deep_scrub_stamp":"2024-09-21T03:25:02.705279+0000","last_clean_scrub_stamp":"2024-09-21T03:25:02.705279+0000","objects_scrubbed":0,"log_size":2924,"log_dups_size":0,"ondisk_log_size":2924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:01.762843+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43307,"num_write_kb":537343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'16","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:53.273178+0000","last_change":"2024-09-21T03:24:53.273178+0000","last_active":"2024-09-21T03:24:53.273178+0000","last_peered":"2024-09-21T03:24:53.273178+0000","last_clean":"2024-09-21T03:24:53.273178+0000","last_became_active":"2024-09-21T03:14:37.472271+0000","last_became_peered":"2024-09-21T03:14:37.472271+0000","last_unstale":"2024-09-21T03:24:53.273178+0000","last_undegraded":"2024-09-21T03:24:53.273178+0000","last_fullsized":"2024-09-21T03:24:53.273178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-09-21T03:24:53.273086+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-09-21T03:24:53.273086+0000","last_clean_scrub_stamp":"2024-09-21T03:24:53.273086+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:00.016606+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'32","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:01.730241+0000","last_change":"2024-09-21T03:25:01.730241+0000","last_active":"2024-09-21T03:25:01.730241+0000","last_peered":"2024-09-21T03:25:01.730241+0000","last_clean":"2024-09-21T03:25:01.730241+0000","last_became_active":"2024-09-21T03:14:46.536791+0000","last_became_peered":"2024-09-21T03:14:46.536791+0000","last_unstale":"2024-09-21T03:25:01.730241+0000","last_undegraded":"2024-09-21T03:25:01.730241+0000","last_fullsized":"2024-09-21T03:25:01.730241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2024-09-21T03:25:01.730136+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2024-09-21T03:25:01.730136+0000","last_clean_scrub_stamp":"2024-09-21T03:25:01.730136+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:23:55.468107+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"27'2826","reported_seq":2856,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:11.757697+0000","last_change":"2024-09-21T03:25:11.757697+0000","last_active":"2024-09-21T03:25:11.757697+0000","last_peered":"2024-09-21T03:25:11.757697+0000","last_clean":"2024-09-21T03:25:11.757697+0000","last_became_active":"2024-09-21T03:14:47.555329+0000","last_became_peered":"2024-09-21T03:14:47.555329+0000","last_unstale":"2024-09-21T03:25:11.757697+0000","last_undegraded":"2024-09-21T03:25:11.757697+0000","last_fullsized":"2024-09-21T03:25:11.757697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2826","last_scrub_stamp":"2024-09-21T03:25:11.757557+0000","last_deep_scrub":"27'2826","last_deep_scrub_stamp":"2024-09-21T03:25:11.757557+0000","last_clean_scrub_stamp":"2024-09-21T03:25:11.757557+0000","objects_scrubbed":0,"log_size":2826,"log_dups_size":0,"ondisk_log_size":2826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:23.754813+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40983,"num_write_kb":424268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'2675","reported_seq":2713,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:59.611794+0000","last_change":"2024-09-21T03:24:59.611727+0000","last_active":"2024-09-21T03:24:59.611794+0000","last_peered":"2024-09-21T03:24:59.611794+0000","last_clean":"2024-09-21T03:24:59.611794+0000","last_became_active":"2024-09-21T03:14:38.478077+0000","last_became_peered":"2024-09-21T03:14:38.478077+0000","last_unstale":"2024-09-21T03:24:59.611794+0000","last_undegraded":"2024-09-21T03:24:59.611794+0000","last_fullsized":"2024-09-21T03:24:59.611794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2675","last_scrub_stamp":"2024-09-21T03:24:59.611584+0000","last_deep_scrub":"27'2675","last_deep_scrub_stamp":"2024-09-21T03:24:59.611584+0000","last_clean_scrub_stamp":"2024-09-21T03:24:59.611584+0000","objects_scrubbed":0,"log_size":2675,"log_dups_size":0,"ondisk_log_size":2675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:50.559875+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39231,"num_write_kb":490681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'12","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:55.811456+0000","last_change":"2024-09-21T03:24:55.811354+0000","last_active":"2024-09-21T03:24:55.811456+0000","last_peered":"2024-09-21T03:24:55.811456+0000","last_clean":"2024-09-21T03:24:55.811456+0000","last_became_active":"2024-09-21T03:14:37.480218+0000","last_became_peered":"2024-09-21T03:14:37.480218+0000","last_unstale":"2024-09-21T03:24:55.811456+0000","last_undegraded":"2024-09-21T03:24:55.811456+0000","last_fullsized":"2024-09-21T03:24:55.811456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-09-21T03:24:55.811256+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-09-21T03:24:55.811256+0000","last_clean_scrub_stamp":"2024-09-21T03:24:55.811256+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:31.668231+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'33","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:59.721152+0000","last_change":"2024-09-21T03:24:59.721068+0000","last_active":"2024-09-21T03:24:59.721152+0000","last_peered":"2024-09-21T03:24:59.721152+0000","last_clean":"2024-09-21T03:24:59.721152+0000","last_became_active":"2024-09-21T03:14:46.531289+0000","last_became_peered":"2024-09-21T03:14:46.531289+0000","last_unstale":"2024-09-21T03:24:59.721152+0000","last_undegraded":"2024-09-21T03:24:59.721152+0000","last_fullsized":"2024-09-21T03:24:59.721152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2024-09-21T03:24:59.720903+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2024-09-21T03:24:59.720903+0000","last_clean_scrub_stamp":"2024-09-21T03:24:59.720903+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:59.283607+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":107,"num_write":31,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"27'2919","reported_seq":2949,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:19.784927+0000","last_change":"2024-09-21T03:25:19.784927+0000","last_active":"2024-09-21T03:25:19.784927+0000","last_peered":"2024-09-21T03:25:19.784927+0000","last_clean":"2024-09-21T03:25:19.784927+0000","last_became_active":"2024-09-21T03:14:47.552367+0000","last_became_peered":"2024-09-21T03:14:47.552367+0000","last_unstale":"2024-09-21T03:25:19.784927+0000","last_undegraded":"2024-09-21T03:25:19.784927+0000","last_fullsized":"2024-09-21T03:25:19.784927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2919","last_scrub_stamp":"2024-09-21T03:25:19.784817+0000","last_deep_scrub":"27'2919","last_deep_scrub_stamp":"2024-09-21T03:25:19.784817+0000","last_clean_scrub_stamp":"2024-09-21T03:25:19.784817+0000","objects_scrubbed":0,"log_size":2919,"log_dups_size":0,"ondisk_log_size":2919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:19.911348+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42429,"num_write_kb":431357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'3268","reported_seq":3306,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:00.618514+0000","last_change":"2024-09-21T03:25:00.618387+0000","last_active":"2024-09-21T03:25:00.618514+0000","last_peered":"2024-09-21T03:25:00.618514+0000","last_clean":"2024-09-21T03:25:00.618514+0000","last_became_active":"2024-09-21T03:14:38.474978+0000","last_became_peered":"2024-09-21T03:14:38.474978+0000","last_unstale":"2024-09-21T03:25:00.618514+0000","last_undegraded":"2024-09-21T03:25:00.618514+0000","last_fullsized":"2024-09-21T03:25:00.618514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3268","last_scrub_stamp":"2024-09-21T03:25:00.618252+0000","last_deep_scrub":"27'3268","last_deep_scrub_stamp":"2024-09-21T03:25:00.618252+0000","last_clean_scrub_stamp":"2024-09-21T03:25:00.618252+0000","objects_scrubbed":0,"log_size":3268,"log_dups_size":0,"ondisk_log_size":3268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:14.028129+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48313,"num_write_kb":579677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'320","reported_seq":360,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:53.577917+0000","last_change":"2024-09-21T03:24:53.577859+0000","last_active":"2024-09-21T03:24:53.577917+0000","last_peered":"2024-09-21T03:24:53.577917+0000","last_clean":"2024-09-21T03:24:53.577917+0000","last_became_active":"2024-09-21T03:14:37.478833+0000","last_became_peered":"2024-09-21T03:14:37.478833+0000","last_unstale":"2024-09-21T03:24:53.577917+0000","last_undegraded":"2024-09-21T03:24:53.577917+0000","last_fullsized":"2024-09-21T03:24:53.577917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'320","last_scrub_stamp":"2024-09-21T03:24:53.577756+0000","last_deep_scrub":"27'320","last_deep_scrub_stamp":"2024-09-21T03:24:53.577756+0000","last_clean_scrub_stamp":"2024-09-21T03:24:53.577756+0000","objects_scrubbed":1,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:44.824631+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'50","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.660937+0000","last_change":"2024-09-21T03:25:05.660937+0000","last_active":"2024-09-21T03:25:05.660937+0000","last_peered":"2024-09-21T03:25:05.660937+0000","last_clean":"2024-09-21T03:25:05.660937+0000","last_became_active":"2024-09-21T03:14:46.535569+0000","last_became_peered":"2024-09-21T03:14:46.535569+0000","last_unstale":"2024-09-21T03:25:05.660937+0000","last_undegraded":"2024-09-21T03:25:05.660937+0000","last_fullsized":"2024-09-21T03:25:05.660937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-09-21T03:25:05.660851+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-09-21T03:25:05.660851+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.660851+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:50.851437+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":8210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2","version":"27'3110","reported_seq":3140,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.414409+0000","last_change":"2024-09-21T03:25:07.414320+0000","last_active":"2024-09-21T03:25:07.414409+0000","last_peered":"2024-09-21T03:25:07.414409+0000","last_clean":"2024-09-21T03:25:07.414409+0000","last_became_active":"2024-09-21T03:14:47.571620+0000","last_became_peered":"2024-09-21T03:14:47.571620+0000","last_unstale":"2024-09-21T03:25:07.414409+0000","last_undegraded":"2024-09-21T03:25:07.414409+0000","last_fullsized":"2024-09-21T03:25:07.414409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3110","last_scrub_stamp":"2024-09-21T03:25:07.414193+0000","last_deep_scrub":"27'3110","last_deep_scrub_stamp":"2024-09-21T03:25:07.414193+0000","last_clean_scrub_stamp":"2024-09-21T03:25:07.414193+0000","objects_scrubbed":0,"log_size":3110,"log_dups_size":0,"ondisk_log_size":3110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:27:47.569967+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45309,"num_write_kb":459474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"27'3313","reported_seq":3351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:57.881205+0000","last_change":"2024-09-21T03:24:57.881102+0000","last_active":"2024-09-21T03:24:57.881205+0000","last_peered":"2024-09-21T03:24:57.881205+0000","last_clean":"2024-09-21T03:24:57.881205+0000","last_became_active":"2024-09-21T03:14:38.492830+0000","last_became_peered":"2024-09-21T03:14:38.492830+0000","last_unstale":"2024-09-21T03:24:57.881205+0000","last_undegraded":"2024-09-21T03:24:57.881205+0000","last_fullsized":"2024-09-21T03:24:57.881205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3313","last_scrub_stamp":"2024-09-21T03:24:57.880980+0000","last_deep_scrub":"27'3313","last_deep_scrub_stamp":"2024-09-21T03:24:57.880980+0000","last_clean_scrub_stamp":"2024-09-21T03:24:57.880980+0000","objects_scrubbed":0,"log_size":3313,"log_dups_size":0,"ondisk_log_size":3313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:18.144121+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48841,"num_write_kb":610665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'19","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:53.824126+0000","last_change":"2024-09-21T03:24:53.824126+0000","last_active":"2024-09-21T03:24:53.824126+0000","last_peered":"2024-09-21T03:24:53.824126+0000","last_clean":"2024-09-21T03:24:53.824126+0000","last_became_active":"2024-09-21T03:14:37.473218+0000","last_became_peered":"2024-09-21T03:14:37.473218+0000","last_unstale":"2024-09-21T03:24:53.824126+0000","last_undegraded":"2024-09-21T03:24:53.824126+0000","last_fullsized":"2024-09-21T03:24:53.824126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-09-21T03:24:53.824042+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-09-21T03:24:53.824042+0000","last_clean_scrub_stamp":"2024-09-21T03:24:53.824042+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:47.393460+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'1","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.804211+0000","last_change":"2024-09-21T03:25:05.804150+0000","last_active":"2024-09-21T03:25:05.804211+0000","last_peered":"2024-09-21T03:25:05.804211+0000","last_clean":"2024-09-21T03:25:05.804211+0000","last_became_active":"2024-09-21T03:14:46.548166+0000","last_became_peered":"2024-09-21T03:14:46.548166+0000","last_unstale":"2024-09-21T03:25:05.804211+0000","last_undegraded":"2024-09-21T03:25:05.804211+0000","last_fullsized":"2024-09-21T03:25:05.804211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-09-21T03:25:05.804057+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-09-21T03:25:05.804057+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.804057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:38.472475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"27'2797","reported_seq":2827,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:10.778407+0000","last_change":"2024-09-21T03:25:10.778343+0000","last_active":"2024-09-21T03:25:10.778407+0000","last_peered":"2024-09-21T03:25:10.778407+0000","last_clean":"2024-09-21T03:25:10.778407+0000","last_became_active":"2024-09-21T03:14:47.555420+0000","last_became_peered":"2024-09-21T03:14:47.555420+0000","last_unstale":"2024-09-21T03:25:10.778407+0000","last_undegraded":"2024-09-21T03:25:10.778407+0000","last_fullsized":"2024-09-21T03:25:10.778407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2797","last_scrub_stamp":"2024-09-21T03:25:10.778252+0000","last_deep_scrub":"27'2797","last_deep_scrub_stamp":"2024-09-21T03:25:10.778252+0000","last_clean_scrub_stamp":"2024-09-21T03:25:10.778252+0000","objects_scrubbed":0,"log_size":2797,"log_dups_size":0,"ondisk_log_size":2797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:46:46.077886+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40658,"num_write_kb":422641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.5","version":"27'2814","reported_seq":2852,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:54.702449+0000","last_change":"2024-09-21T03:24:54.702394+0000","last_active":"2024-09-21T03:24:54.702449+0000","last_peered":"2024-09-21T03:24:54.702449+0000","last_clean":"2024-09-21T03:24:54.702449+0000","last_became_active":"2024-09-21T03:14:38.479439+0000","last_became_peered":"2024-09-21T03:14:38.479439+0000","last_unstale":"2024-09-21T03:24:54.702449+0000","last_undegraded":"2024-09-21T03:24:54.702449+0000","last_fullsized":"2024-09-21T03:24:54.702449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2814","last_scrub_stamp":"2024-09-21T03:24:54.702304+0000","last_deep_scrub":"27'2814","last_deep_scrub_stamp":"2024-09-21T03:24:54.702304+0000","last_clean_scrub_stamp":"2024-09-21T03:24:54.702304+0000","objects_scrubbed":0,"log_size":2814,"log_dups_size":0,"ondisk_log_size":2814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:10.082316+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41573,"num_write_kb":525350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'6","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:57.513606+0000","last_change":"2024-09-21T03:24:57.513548+0000","last_active":"2024-09-21T03:24:57.513606+0000","last_peered":"2024-09-21T03:24:57.513606+0000","last_clean":"2024-09-21T03:24:57.513606+0000","last_became_active":"2024-09-21T03:14:37.469495+0000","last_became_peered":"2024-09-21T03:14:37.469495+0000","last_unstale":"2024-09-21T03:24:57.513606+0000","last_undegraded":"2024-09-21T03:24:57.513606+0000","last_fullsized":"2024-09-21T03:24:57.513606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-09-21T03:24:57.513181+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-09-21T03:24:57.513181+0000","last_clean_scrub_stamp":"2024-09-21T03:24:57.513181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:05.236033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'53","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:04.844571+0000","last_change":"2024-09-21T03:25:04.844435+0000","last_active":"2024-09-21T03:25:04.844571+0000","last_peered":"2024-09-21T03:25:04.844571+0000","last_clean":"2024-09-21T03:25:04.844571+0000","last_became_active":"2024-09-21T03:14:46.544038+0000","last_became_peered":"2024-09-21T03:14:46.544038+0000","last_unstale":"2024-09-21T03:25:04.844571+0000","last_undegraded":"2024-09-21T03:25:04.844571+0000","last_fullsized":"2024-09-21T03:25:04.844571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'53","last_scrub_stamp":"2024-09-21T03:25:04.844310+0000","last_deep_scrub":"27'53","last_deep_scrub_stamp":"2024-09-21T03:25:04.844310+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.844310+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:23.375722+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"27'2673","reported_seq":2709,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.330003+0000","last_change":"2024-09-21T03:25:06.329835+0000","last_active":"2024-09-21T03:25:06.330003+0000","last_peered":"2024-09-21T03:25:06.330003+0000","last_clean":"2024-09-21T03:25:06.330003+0000","last_became_active":"2024-09-21T03:14:47.579324+0000","last_became_peered":"2024-09-21T03:14:47.579324+0000","last_unstale":"2024-09-21T03:25:06.330003+0000","last_undegraded":"2024-09-21T03:25:06.330003+0000","last_fullsized":"2024-09-21T03:25:06.330003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2673","last_scrub_stamp":"2024-09-21T03:25:06.329698+0000","last_deep_scrub":"27'2673","last_deep_scrub_stamp":"2024-09-21T03:25:06.329698+0000","last_clean_scrub_stamp":"2024-09-21T03:25:06.329698+0000","objects_scrubbed":0,"log_size":2673,"log_dups_size":0,"ondisk_log_size":2673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:32.530606+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38848,"num_write_kb":393078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"27'3056","reported_seq":3094,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:55.274924+0000","last_change":"2024-09-21T03:24:55.274832+0000","last_active":"2024-09-21T03:24:55.274924+0000","last_peered":"2024-09-21T03:24:55.274924+0000","last_clean":"2024-09-21T03:24:55.274924+0000","last_became_active":"2024-09-21T03:14:38.474299+0000","last_became_peered":"2024-09-21T03:14:38.474299+0000","last_unstale":"2024-09-21T03:24:55.274924+0000","last_undegraded":"2024-09-21T03:24:55.274924+0000","last_fullsized":"2024-09-21T03:24:55.274924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3056","last_scrub_stamp":"2024-09-21T03:24:55.274732+0000","last_deep_scrub":"27'3056","last_deep_scrub_stamp":"2024-09-21T03:24:55.274732+0000","last_clean_scrub_stamp":"2024-09-21T03:24:55.274732+0000","objects_scrubbed":0,"log_size":3056,"log_dups_size":0,"ondisk_log_size":3056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:22.166985+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45199,"num_write_kb":565597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'30","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:52.822358+0000","last_change":"2024-09-21T03:24:52.822304+0000","last_active":"2024-09-21T03:24:52.822358+0000","last_peered":"2024-09-21T03:24:52.822358+0000","last_clean":"2024-09-21T03:24:52.822358+0000","last_became_active":"2024-09-21T03:14:37.466256+0000","last_became_peered":"2024-09-21T03:14:37.466256+0000","last_unstale":"2024-09-21T03:24:52.822358+0000","last_undegraded":"2024-09-21T03:24:52.822358+0000","last_fullsized":"2024-09-21T03:24:52.822358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-09-21T03:24:52.822233+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-09-21T03:24:52.822233+0000","last_clean_scrub_stamp":"2024-09-21T03:24:52.822233+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:03.022192+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'5","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.797411+0000","last_change":"2024-09-21T03:25:06.797349+0000","last_active":"2024-09-21T03:25:06.797411+0000","last_peered":"2024-09-21T03:25:06.797411+0000","last_clean":"2024-09-21T03:25:06.797411+0000","last_became_active":"2024-09-21T03:14:46.536975+0000","last_became_peered":"2024-09-21T03:14:46.536975+0000","last_unstale":"2024-09-21T03:25:06.797411+0000","last_undegraded":"2024-09-21T03:25:06.797411+0000","last_fullsized":"2024-09-21T03:25:06.797411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-21T03:25:06.797255+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-21T03:25:06.797255+0000","last_clean_scrub_stamp":"2024-09-21T03:25:06.797255+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:13.065467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"27'2498","reported_seq":2528,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.333880+0000","last_change":"2024-09-21T03:25:07.333756+0000","last_active":"2024-09-21T03:25:07.333880+0000","last_peered":"2024-09-21T03:25:07.333880+0000","last_clean":"2024-09-21T03:25:07.333880+0000","last_became_active":"2024-09-21T03:14:47.572395+0000","last_became_peered":"2024-09-21T03:14:47.572395+0000","last_unstale":"2024-09-21T03:25:07.333880+0000","last_undegraded":"2024-09-21T03:25:07.333880+0000","last_fullsized":"2024-09-21T03:25:07.333880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2498","last_scrub_stamp":"2024-09-21T03:25:07.333608+0000","last_deep_scrub":"27'2498","last_deep_scrub_stamp":"2024-09-21T03:25:07.333608+0000","last_clean_scrub_stamp":"2024-09-21T03:25:07.333608+0000","objects_scrubbed":0,"log_size":2498,"log_dups_size":0,"ondisk_log_size":2498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:00.948907+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35860,"num_write_kb":370109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"27'2994","reported_seq":3032,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:58.541003+0000","last_change":"2024-09-21T03:24:58.541003+0000","last_active":"2024-09-21T03:24:58.541003+0000","last_peered":"2024-09-21T03:24:58.541003+0000","last_clean":"2024-09-21T03:24:58.541003+0000","last_became_active":"2024-09-21T03:14:38.481186+0000","last_became_peered":"2024-09-21T03:14:38.481186+0000","last_unstale":"2024-09-21T03:24:58.541003+0000","last_undegraded":"2024-09-21T03:24:58.541003+0000","last_fullsized":"2024-09-21T03:24:58.541003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2994","last_scrub_stamp":"2024-09-21T03:24:58.540904+0000","last_deep_scrub":"27'2994","last_deep_scrub_stamp":"2024-09-21T03:24:58.540904+0000","last_clean_scrub_stamp":"2024-09-21T03:24:58.540904+0000","objects_scrubbed":0,"log_size":2994,"log_dups_size":0,"ondisk_log_size":2994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:08.588690+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44221,"num_write_kb":552392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'31","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:55.373904+0000","last_change":"2024-09-21T03:24:55.373840+0000","last_active":"2024-09-21T03:24:55.373904+0000","last_peered":"2024-09-21T03:24:55.373904+0000","last_clean":"2024-09-21T03:24:55.373904+0000","last_became_active":"2024-09-21T03:14:37.473829+0000","last_became_peered":"2024-09-21T03:14:37.473829+0000","last_unstale":"2024-09-21T03:24:55.373904+0000","last_undegraded":"2024-09-21T03:24:55.373904+0000","last_fullsized":"2024-09-21T03:24:55.373904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-09-21T03:24:55.373736+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-09-21T03:24:55.373736+0000","last_clean_scrub_stamp":"2024-09-21T03:24:55.373736+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:20.191062+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":105,"num_write":29,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'6","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:08.849110+0000","last_change":"2024-09-21T03:25:08.849039+0000","last_active":"2024-09-21T03:25:08.849110+0000","last_peered":"2024-09-21T03:25:08.849110+0000","last_clean":"2024-09-21T03:25:08.849110+0000","last_became_active":"2024-09-21T03:14:46.542181+0000","last_became_peered":"2024-09-21T03:14:46.542181+0000","last_unstale":"2024-09-21T03:25:08.849110+0000","last_undegraded":"2024-09-21T03:25:08.849110+0000","last_fullsized":"2024-09-21T03:25:08.849110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-09-21T03:25:08.848944+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-09-21T03:25:08.848944+0000","last_clean_scrub_stamp":"2024-09-21T03:25:08.848944+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:42.532022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"27'2895","reported_seq":2924,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:18.759696+0000","last_change":"2024-09-21T03:25:18.759696+0000","last_active":"2024-09-21T03:25:18.759696+0000","last_peered":"2024-09-21T03:25:18.759696+0000","last_clean":"2024-09-21T03:25:18.759696+0000","last_became_active":"2024-09-21T03:14:47.569212+0000","last_became_peered":"2024-09-21T03:14:47.569212+0000","last_unstale":"2024-09-21T03:25:18.759696+0000","last_undegraded":"2024-09-21T03:25:18.759696+0000","last_fullsized":"2024-09-21T03:25:18.759696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2895","last_scrub_stamp":"2024-09-21T03:25:18.759588+0000","last_deep_scrub":"27'2895","last_deep_scrub_stamp":"2024-09-21T03:25:18.759588+0000","last_clean_scrub_stamp":"2024-09-21T03:25:18.759588+0000","objects_scrubbed":0,"log_size":2895,"log_dups_size":0,"ondisk_log_size":2895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:33.152979+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42005,"num_write_kb":435585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"27'3096","reported_seq":3134,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:58.923988+0000","last_change":"2024-09-21T03:24:58.923930+0000","last_active":"2024-09-21T03:24:58.923988+0000","last_peered":"2024-09-21T03:24:58.923988+0000","last_clean":"2024-09-21T03:24:58.923988+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:24:58.923988+0000","last_undegraded":"2024-09-21T03:24:58.923988+0000","last_fullsized":"2024-09-21T03:24:58.923988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3096","last_scrub_stamp":"2024-09-21T03:24:58.923829+0000","last_deep_scrub":"27'3096","last_deep_scrub_stamp":"2024-09-21T03:24:58.923829+0000","last_clean_scrub_stamp":"2024-09-21T03:24:58.923829+0000","objects_scrubbed":0,"log_size":3096,"log_dups_size":0,"ondisk_log_size":3096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:18.363030+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45754,"num_write_kb":580793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'51","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:57.813970+0000","last_change":"2024-09-21T03:24:57.813970+0000","last_active":"2024-09-21T03:24:57.813970+0000","last_peered":"2024-09-21T03:24:57.813970+0000","last_clean":"2024-09-21T03:24:57.813970+0000","last_became_active":"2024-09-21T03:14:37.464228+0000","last_became_peered":"2024-09-21T03:14:37.464228+0000","last_unstale":"2024-09-21T03:24:57.813970+0000","last_undegraded":"2024-09-21T03:24:57.813970+0000","last_fullsized":"2024-09-21T03:24:57.813970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2024-09-21T03:24:57.813886+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2024-09-21T03:24:57.813886+0000","last_clean_scrub_stamp":"2024-09-21T03:24:57.813886+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:57.644809+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'360","reported_seq":392,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:11.379300+0000","last_change":"2024-09-21T03:25:11.379225+0000","last_active":"2024-09-21T03:25:11.379300+0000","last_peered":"2024-09-21T03:25:11.379300+0000","last_clean":"2024-09-21T03:25:11.379300+0000","last_became_active":"2024-09-21T03:14:46.537815+0000","last_became_peered":"2024-09-21T03:14:46.537815+0000","last_unstale":"2024-09-21T03:25:11.379300+0000","last_undegraded":"2024-09-21T03:25:11.379300+0000","last_fullsized":"2024-09-21T03:25:11.379300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'360","last_scrub_stamp":"2024-09-21T03:25:11.379114+0000","last_deep_scrub":"27'360","last_deep_scrub_stamp":"2024-09-21T03:25:11.379114+0000","last_clean_scrub_stamp":"2024-09-21T03:25:11.379114+0000","objects_scrubbed":1,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:22.035859+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"27'3082","reported_seq":3112,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:08.461659+0000","last_change":"2024-09-21T03:25:08.461573+0000","last_active":"2024-09-21T03:25:08.461659+0000","last_peered":"2024-09-21T03:25:08.461659+0000","last_clean":"2024-09-21T03:25:08.461659+0000","last_became_active":"2024-09-21T03:14:47.557305+0000","last_became_peered":"2024-09-21T03:14:47.557305+0000","last_unstale":"2024-09-21T03:25:08.461659+0000","last_undegraded":"2024-09-21T03:25:08.461659+0000","last_fullsized":"2024-09-21T03:25:08.461659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3082","last_scrub_stamp":"2024-09-21T03:25:08.461457+0000","last_deep_scrub":"27'3082","last_deep_scrub_stamp":"2024-09-21T03:25:08.461457+0000","last_clean_scrub_stamp":"2024-09-21T03:25:08.461457+0000","objects_scrubbed":0,"log_size":3082,"log_dups_size":0,"ondisk_log_size":3082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:51.731442+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44879,"num_write_kb":462177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'3149","reported_seq":3187,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:58.609945+0000","last_change":"2024-09-21T03:24:58.609879+0000","last_active":"2024-09-21T03:24:58.609945+0000","last_peered":"2024-09-21T03:24:58.609945+0000","last_clean":"2024-09-21T03:24:58.609945+0000","last_became_active":"2024-09-21T03:14:38.478842+0000","last_became_peered":"2024-09-21T03:14:38.478842+0000","last_unstale":"2024-09-21T03:24:58.609945+0000","last_undegraded":"2024-09-21T03:24:58.609945+0000","last_fullsized":"2024-09-21T03:24:58.609945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3149","last_scrub_stamp":"2024-09-21T03:24:58.609795+0000","last_deep_scrub":"27'3149","last_deep_scrub_stamp":"2024-09-21T03:24:58.609795+0000","last_clean_scrub_stamp":"2024-09-21T03:24:58.609795+0000","objects_scrubbed":0,"log_size":3149,"log_dups_size":0,"ondisk_log_size":3149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:01.183453+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46550,"num_write_kb":599066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:54.814992+0000","last_change":"2024-09-21T03:24:54.814888+0000","last_active":"2024-09-21T03:24:54.814992+0000","last_peered":"2024-09-21T03:24:54.814992+0000","last_clean":"2024-09-21T03:24:54.814992+0000","last_became_active":"2024-09-21T03:14:37.463674+0000","last_became_peered":"2024-09-21T03:14:37.463674+0000","last_unstale":"2024-09-21T03:24:54.814992+0000","last_undegraded":"2024-09-21T03:24:54.814992+0000","last_fullsized":"2024-09-21T03:24:54.814992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-09-21T03:24:54.814806+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-09-21T03:24:54.814806+0000","last_clean_scrub_stamp":"2024-09-21T03:24:54.814806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:38.484813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'74","reported_seq":138,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:52.658780+0000","last_change":"2024-09-21T03:24:52.658780+0000","last_active":"2024-09-21T03:24:52.658780+0000","last_peered":"2024-09-21T03:24:52.658780+0000","last_clean":"2024-09-21T03:24:52.658780+0000","last_became_active":"2024-09-21T03:14:26.341929+0000","last_became_peered":"2024-09-21T03:14:26.341929+0000","last_unstale":"2024-09-21T03:24:52.658780+0000","last_undegraded":"2024-09-21T03:24:52.658780+0000","last_fullsized":"2024-09-21T03:24:52.658780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'74","last_scrub_stamp":"2024-09-21T03:24:52.658698+0000","last_deep_scrub":"27'74","last_deep_scrub_stamp":"2024-09-21T03:24:52.658698+0000","last_clean_scrub_stamp":"2024-09-21T03:24:52.658698+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:11.245925+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'5","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:13.799471+0000","last_change":"2024-09-21T03:25:13.799413+0000","last_active":"2024-09-21T03:25:13.799471+0000","last_peered":"2024-09-21T03:25:13.799471+0000","last_clean":"2024-09-21T03:25:13.799471+0000","last_became_active":"2024-09-21T03:14:46.536753+0000","last_became_peered":"2024-09-21T03:14:46.536753+0000","last_unstale":"2024-09-21T03:25:13.799471+0000","last_undegraded":"2024-09-21T03:25:13.799471+0000","last_fullsized":"2024-09-21T03:25:13.799471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-21T03:25:13.799325+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-21T03:25:13.799325+0000","last_clean_scrub_stamp":"2024-09-21T03:25:13.799325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:43.080499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"27'2392","reported_seq":2421,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:14.273654+0000","last_change":"2024-09-21T03:25:14.273654+0000","last_active":"2024-09-21T03:25:14.273654+0000","last_peered":"2024-09-21T03:25:14.273654+0000","last_clean":"2024-09-21T03:25:14.273654+0000","last_became_active":"2024-09-21T03:14:47.552642+0000","last_became_peered":"2024-09-21T03:14:47.552642+0000","last_unstale":"2024-09-21T03:25:14.273654+0000","last_undegraded":"2024-09-21T03:25:14.273654+0000","last_fullsized":"2024-09-21T03:25:14.273654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2392","last_scrub_stamp":"2024-09-21T03:25:14.273528+0000","last_deep_scrub":"27'2392","last_deep_scrub_stamp":"2024-09-21T03:25:14.273528+0000","last_clean_scrub_stamp":"2024-09-21T03:25:14.273528+0000","objects_scrubbed":0,"log_size":2392,"log_dups_size":0,"ondisk_log_size":2392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:35:27.450002+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34629,"num_write_kb":367496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"27'3146","reported_seq":3183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:03.658452+0000","last_change":"2024-09-21T03:25:03.658452+0000","last_active":"2024-09-21T03:25:03.658452+0000","last_peered":"2024-09-21T03:25:03.658452+0000","last_clean":"2024-09-21T03:25:03.658452+0000","last_became_active":"2024-09-21T03:14:38.478116+0000","last_became_peered":"2024-09-21T03:14:38.478116+0000","last_unstale":"2024-09-21T03:25:03.658452+0000","last_undegraded":"2024-09-21T03:25:03.658452+0000","last_fullsized":"2024-09-21T03:25:03.658452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3146","last_scrub_stamp":"2024-09-21T03:25:03.658345+0000","last_deep_scrub":"27'3146","last_deep_scrub_stamp":"2024-09-21T03:25:03.658345+0000","last_clean_scrub_stamp":"2024-09-21T03:25:03.658345+0000","objects_scrubbed":0,"log_size":3146,"log_dups_size":0,"ondisk_log_size":3146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:30.442847+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46299,"num_write_kb":593160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'3","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:54.778867+0000","last_change":"2024-09-21T03:24:54.778867+0000","last_active":"2024-09-21T03:24:54.778867+0000","last_peered":"2024-09-21T03:24:54.778867+0000","last_clean":"2024-09-21T03:24:54.778867+0000","last_became_active":"2024-09-21T03:14:37.479284+0000","last_became_peered":"2024-09-21T03:14:37.479284+0000","last_unstale":"2024-09-21T03:24:54.778867+0000","last_undegraded":"2024-09-21T03:24:54.778867+0000","last_fullsized":"2024-09-21T03:24:54.778867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-21T03:24:54.778776+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-21T03:24:54.778776+0000","last_clean_scrub_stamp":"2024-09-21T03:24:54.778776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:23.078542+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'33","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:00.737257+0000","last_change":"2024-09-21T03:25:00.737257+0000","last_active":"2024-09-21T03:25:00.737257+0000","last_peered":"2024-09-21T03:25:00.737257+0000","last_clean":"2024-09-21T03:25:00.737257+0000","last_became_active":"2024-09-21T03:14:46.531069+0000","last_became_peered":"2024-09-21T03:14:46.531069+0000","last_unstale":"2024-09-21T03:25:00.737257+0000","last_undegraded":"2024-09-21T03:25:00.737257+0000","last_fullsized":"2024-09-21T03:25:00.737257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2024-09-21T03:25:00.737165+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2024-09-21T03:25:00.737165+0000","last_clean_scrub_stamp":"2024-09-21T03:25:00.737165+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:06.466017+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"27'2640","reported_seq":2669,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:10.842843+0000","last_change":"2024-09-21T03:25:10.842843+0000","last_active":"2024-09-21T03:25:10.842843+0000","last_peered":"2024-09-21T03:25:10.842843+0000","last_clean":"2024-09-21T03:25:10.842843+0000","last_became_active":"2024-09-21T03:14:47.552712+0000","last_became_peered":"2024-09-21T03:14:47.552712+0000","last_unstale":"2024-09-21T03:25:10.842843+0000","last_undegraded":"2024-09-21T03:25:10.842843+0000","last_fullsized":"2024-09-21T03:25:10.842843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2640","last_scrub_stamp":"2024-09-21T03:25:10.842696+0000","last_deep_scrub":"27'2640","last_deep_scrub_stamp":"2024-09-21T03:25:10.842696+0000","last_clean_scrub_stamp":"2024-09-21T03:25:10.842696+0000","objects_scrubbed":0,"log_size":2640,"log_dups_size":0,"ondisk_log_size":2640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:30.888354+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38453,"num_write_kb":398220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'3285","reported_seq":3322,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:57.298479+0000","last_change":"2024-09-21T03:24:57.298479+0000","last_active":"2024-09-21T03:24:57.298479+0000","last_peered":"2024-09-21T03:24:57.298479+0000","last_clean":"2024-09-21T03:24:57.298479+0000","last_became_active":"2024-09-21T03:14:38.487420+0000","last_became_peered":"2024-09-21T03:14:38.487420+0000","last_unstale":"2024-09-21T03:24:57.298479+0000","last_undegraded":"2024-09-21T03:24:57.298479+0000","last_fullsized":"2024-09-21T03:24:57.298479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3285","last_scrub_stamp":"2024-09-21T03:24:57.298394+0000","last_deep_scrub":"27'3285","last_deep_scrub_stamp":"2024-09-21T03:24:57.298394+0000","last_clean_scrub_stamp":"2024-09-21T03:24:57.298394+0000","objects_scrubbed":0,"log_size":3285,"log_dups_size":0,"ondisk_log_size":3285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:16.767937+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48497,"num_write_kb":608493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'9","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:55.484974+0000","last_change":"2024-09-21T03:24:55.484974+0000","last_active":"2024-09-21T03:24:55.484974+0000","last_peered":"2024-09-21T03:24:55.484974+0000","last_clean":"2024-09-21T03:24:55.484974+0000","last_became_active":"2024-09-21T03:14:37.460320+0000","last_became_peered":"2024-09-21T03:14:37.460320+0000","last_unstale":"2024-09-21T03:24:55.484974+0000","last_undegraded":"2024-09-21T03:24:55.484974+0000","last_fullsized":"2024-09-21T03:24:55.484974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-09-21T03:24:55.484883+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-09-21T03:24:55.484883+0000","last_clean_scrub_stamp":"2024-09-21T03:24:55.484883+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:28.513539+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'470","reported_seq":501,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:10.403273+0000","last_change":"2024-09-21T03:25:10.403273+0000","last_active":"2024-09-21T03:25:10.403273+0000","last_peered":"2024-09-21T03:25:10.403273+0000","last_clean":"2024-09-21T03:25:10.403273+0000","last_became_active":"2024-09-21T03:14:46.540182+0000","last_became_peered":"2024-09-21T03:14:46.540182+0000","last_unstale":"2024-09-21T03:25:10.403273+0000","last_undegraded":"2024-09-21T03:25:10.403273+0000","last_fullsized":"2024-09-21T03:25:10.403273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'470","last_scrub_stamp":"2024-09-21T03:25:10.403178+0000","last_deep_scrub":"27'470","last_deep_scrub_stamp":"2024-09-21T03:25:10.403178+0000","last_clean_scrub_stamp":"2024-09-21T03:25:10.403178+0000","objects_scrubbed":3,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:08.919215+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8130523,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":458,"num_write_kb":8274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"27'2705","reported_seq":2734,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:02.499902+0000","last_change":"2024-09-21T03:25:02.499902+0000","last_active":"2024-09-21T03:25:02.499902+0000","last_peered":"2024-09-21T03:25:02.499902+0000","last_clean":"2024-09-21T03:25:02.499902+0000","last_became_active":"2024-09-21T03:14:47.552371+0000","last_became_peered":"2024-09-21T03:14:47.552371+0000","last_unstale":"2024-09-21T03:25:02.499902+0000","last_undegraded":"2024-09-21T03:25:02.499902+0000","last_fullsized":"2024-09-21T03:25:02.499902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2705","last_scrub_stamp":"2024-09-21T03:25:02.499767+0000","last_deep_scrub":"27'2705","last_deep_scrub_stamp":"2024-09-21T03:25:02.499767+0000","last_clean_scrub_stamp":"2024-09-21T03:25:02.499767+0000","objects_scrubbed":0,"log_size":2705,"log_dups_size":0,"ondisk_log_size":2705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:36.439460+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39343,"num_write_kb":410859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"27'3625","reported_seq":3662,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:58.315319+0000","last_change":"2024-09-21T03:24:58.315319+0000","last_active":"2024-09-21T03:24:58.315319+0000","last_peered":"2024-09-21T03:24:58.315319+0000","last_clean":"2024-09-21T03:24:58.315319+0000","last_became_active":"2024-09-21T03:14:38.474135+0000","last_became_peered":"2024-09-21T03:14:38.474135+0000","last_unstale":"2024-09-21T03:24:58.315319+0000","last_undegraded":"2024-09-21T03:24:58.315319+0000","last_fullsized":"2024-09-21T03:24:58.315319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3625","last_scrub_stamp":"2024-09-21T03:24:58.315226+0000","last_deep_scrub":"27'3625","last_deep_scrub_stamp":"2024-09-21T03:24:58.315226+0000","last_clean_scrub_stamp":"2024-09-21T03:24:58.315226+0000","objects_scrubbed":0,"log_size":3625,"log_dups_size":0,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:52.444411+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53421,"num_write_kb":673086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'15","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:54.582487+0000","last_change":"2024-09-21T03:24:54.582487+0000","last_active":"2024-09-21T03:24:54.582487+0000","last_peered":"2024-09-21T03:24:54.582487+0000","last_clean":"2024-09-21T03:24:54.582487+0000","last_became_active":"2024-09-21T03:14:37.472164+0000","last_became_peered":"2024-09-21T03:14:37.472164+0000","last_unstale":"2024-09-21T03:24:54.582487+0000","last_undegraded":"2024-09-21T03:24:54.582487+0000","last_fullsized":"2024-09-21T03:24:54.582487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-09-21T03:24:54.582392+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-09-21T03:24:54.582392+0000","last_clean_scrub_stamp":"2024-09-21T03:24:54.582392+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:13.201390+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'20","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:15.771955+0000","last_change":"2024-09-21T03:25:15.771955+0000","last_active":"2024-09-21T03:25:15.771955+0000","last_peered":"2024-09-21T03:25:15.771955+0000","last_clean":"2024-09-21T03:25:15.771955+0000","last_became_active":"2024-09-21T03:14:46.535901+0000","last_became_peered":"2024-09-21T03:14:46.535901+0000","last_unstale":"2024-09-21T03:25:15.771955+0000","last_undegraded":"2024-09-21T03:25:15.771955+0000","last_fullsized":"2024-09-21T03:25:15.771955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-09-21T03:25:15.771872+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-09-21T03:25:15.771872+0000","last_clean_scrub_stamp":"2024-09-21T03:25:15.771872+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:05.349189+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"27'3050","reported_seq":3079,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.835538+0000","last_change":"2024-09-21T03:25:09.835538+0000","last_active":"2024-09-21T03:25:09.835538+0000","last_peered":"2024-09-21T03:25:09.835538+0000","last_clean":"2024-09-21T03:25:09.835538+0000","last_became_active":"2024-09-21T03:14:47.556145+0000","last_became_peered":"2024-09-21T03:14:47.556145+0000","last_unstale":"2024-09-21T03:25:09.835538+0000","last_undegraded":"2024-09-21T03:25:09.835538+0000","last_fullsized":"2024-09-21T03:25:09.835538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3050","last_scrub_stamp":"2024-09-21T03:25:09.835435+0000","last_deep_scrub":"27'3050","last_deep_scrub_stamp":"2024-09-21T03:25:09.835435+0000","last_clean_scrub_stamp":"2024-09-21T03:25:09.835435+0000","objects_scrubbed":0,"log_size":3050,"log_dups_size":0,"ondisk_log_size":3050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:16.816041+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44445,"num_write_kb":452313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"27'2817","reported_seq":2854,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:55.687759+0000","last_change":"2024-09-21T03:24:55.687759+0000","last_active":"2024-09-21T03:24:55.687759+0000","last_peered":"2024-09-21T03:24:55.687759+0000","last_clean":"2024-09-21T03:24:55.687759+0000","last_became_active":"2024-09-21T03:14:38.468972+0000","last_became_peered":"2024-09-21T03:14:38.468972+0000","last_unstale":"2024-09-21T03:24:55.687759+0000","last_undegraded":"2024-09-21T03:24:55.687759+0000","last_fullsized":"2024-09-21T03:24:55.687759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2817","last_scrub_stamp":"2024-09-21T03:24:55.687670+0000","last_deep_scrub":"27'2817","last_deep_scrub_stamp":"2024-09-21T03:24:55.687670+0000","last_clean_scrub_stamp":"2024-09-21T03:24:55.687670+0000","objects_scrubbed":0,"log_size":2817,"log_dups_size":0,"ondisk_log_size":2817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:05.015811+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41476,"num_write_kb":540924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'12","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:50.264827+0000","last_change":"2024-09-21T03:24:50.264827+0000","last_active":"2024-09-21T03:24:50.264827+0000","last_peered":"2024-09-21T03:24:50.264827+0000","last_clean":"2024-09-21T03:24:50.264827+0000","last_became_active":"2024-09-21T03:14:37.478227+0000","last_became_peered":"2024-09-21T03:14:37.478227+0000","last_unstale":"2024-09-21T03:24:50.264827+0000","last_undegraded":"2024-09-21T03:24:50.264827+0000","last_fullsized":"2024-09-21T03:24:50.264827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-09-21T03:24:50.264373+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-09-21T03:24:50.264373+0000","last_clean_scrub_stamp":"2024-09-21T03:24:50.264373+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:32.434893+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'3","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:59.538310+0000","last_change":"2024-09-21T03:24:59.538310+0000","last_active":"2024-09-21T03:24:59.538310+0000","last_peered":"2024-09-21T03:24:59.538310+0000","last_clean":"2024-09-21T03:24:59.538310+0000","last_became_active":"2024-09-21T03:14:46.535445+0000","last_became_peered":"2024-09-21T03:14:46.535445+0000","last_unstale":"2024-09-21T03:24:59.538310+0000","last_undegraded":"2024-09-21T03:24:59.538310+0000","last_fullsized":"2024-09-21T03:24:59.538310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-21T03:24:59.538221+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-21T03:24:59.538221+0000","last_clean_scrub_stamp":"2024-09-21T03:24:59.538221+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:00.107079+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.17","version":"27'2465","reported_seq":2494,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:13.701616+0000","last_change":"2024-09-21T03:25:13.701616+0000","last_active":"2024-09-21T03:25:13.701616+0000","last_peered":"2024-09-21T03:25:13.701616+0000","last_clean":"2024-09-21T03:25:13.701616+0000","last_became_active":"2024-09-21T03:14:47.554366+0000","last_became_peered":"2024-09-21T03:14:47.554366+0000","last_unstale":"2024-09-21T03:25:13.701616+0000","last_undegraded":"2024-09-21T03:25:13.701616+0000","last_fullsized":"2024-09-21T03:25:13.701616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2465","last_scrub_stamp":"2024-09-21T03:25:13.701512+0000","last_deep_scrub":"27'2465","last_deep_scrub_stamp":"2024-09-21T03:25:13.701512+0000","last_clean_scrub_stamp":"2024-09-21T03:25:13.701512+0000","objects_scrubbed":0,"log_size":2465,"log_dups_size":0,"ondisk_log_size":2465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:26.735816+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35585,"num_write_kb":377642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'3460","reported_seq":3497,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:04.658494+0000","last_change":"2024-09-21T03:25:04.658494+0000","last_active":"2024-09-21T03:25:04.658494+0000","last_peered":"2024-09-21T03:25:04.658494+0000","last_clean":"2024-09-21T03:25:04.658494+0000","last_became_active":"2024-09-21T03:14:38.474826+0000","last_became_peered":"2024-09-21T03:14:38.474826+0000","last_unstale":"2024-09-21T03:25:04.658494+0000","last_undegraded":"2024-09-21T03:25:04.658494+0000","last_fullsized":"2024-09-21T03:25:04.658494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3460","last_scrub_stamp":"2024-09-21T03:25:04.658401+0000","last_deep_scrub":"27'3460","last_deep_scrub_stamp":"2024-09-21T03:25:04.658401+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.658401+0000","objects_scrubbed":0,"log_size":3460,"log_dups_size":0,"ondisk_log_size":3460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:41.448593+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51413,"num_write_kb":609416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'43","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:56.626904+0000","last_change":"2024-09-21T03:24:56.626904+0000","last_active":"2024-09-21T03:24:56.626904+0000","last_peered":"2024-09-21T03:24:56.626904+0000","last_clean":"2024-09-21T03:24:56.626904+0000","last_became_active":"2024-09-21T03:14:37.470720+0000","last_became_peered":"2024-09-21T03:14:37.470720+0000","last_unstale":"2024-09-21T03:24:56.626904+0000","last_undegraded":"2024-09-21T03:24:56.626904+0000","last_fullsized":"2024-09-21T03:24:56.626904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-09-21T03:24:56.626794+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-09-21T03:24:56.626794+0000","last_clean_scrub_stamp":"2024-09-21T03:24:56.626794+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:59.478860+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'3","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:13.309595+0000","last_change":"2024-09-21T03:25:13.309595+0000","last_active":"2024-09-21T03:25:13.309595+0000","last_peered":"2024-09-21T03:25:13.309595+0000","last_clean":"2024-09-21T03:25:13.309595+0000","last_became_active":"2024-09-21T03:14:46.537774+0000","last_became_peered":"2024-09-21T03:14:46.537774+0000","last_unstale":"2024-09-21T03:25:13.309595+0000","last_undegraded":"2024-09-21T03:25:13.309595+0000","last_fullsized":"2024-09-21T03:25:13.309595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-21T03:25:13.309494+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-21T03:25:13.309494+0000","last_clean_scrub_stamp":"2024-09-21T03:25:13.309494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:53.881541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"27'2987","reported_seq":3016,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:21.788551+0000","last_change":"2024-09-21T03:25:21.788551+0000","last_active":"2024-09-21T03:25:21.788551+0000","last_peered":"2024-09-21T03:25:21.788551+0000","last_clean":"2024-09-21T03:25:21.788551+0000","last_became_active":"2024-09-21T03:14:47.552700+0000","last_became_peered":"2024-09-21T03:14:47.552700+0000","last_unstale":"2024-09-21T03:25:21.788551+0000","last_undegraded":"2024-09-21T03:25:21.788551+0000","last_fullsized":"2024-09-21T03:25:21.788551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2987","last_scrub_stamp":"2024-09-21T03:25:21.788446+0000","last_deep_scrub":"27'2987","last_deep_scrub_stamp":"2024-09-21T03:25:21.788446+0000","last_clean_scrub_stamp":"2024-09-21T03:25:21.788446+0000","objects_scrubbed":0,"log_size":2987,"log_dups_size":0,"ondisk_log_size":2987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:17.653357+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43190,"num_write_kb":444709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"27'3323","reported_seq":3360,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:53.643283+0000","last_change":"2024-09-21T03:24:53.643283+0000","last_active":"2024-09-21T03:24:53.643283+0000","last_peered":"2024-09-21T03:24:53.643283+0000","last_clean":"2024-09-21T03:24:53.643283+0000","last_became_active":"2024-09-21T03:14:38.471933+0000","last_became_peered":"2024-09-21T03:14:38.471933+0000","last_unstale":"2024-09-21T03:24:53.643283+0000","last_undegraded":"2024-09-21T03:24:53.643283+0000","last_fullsized":"2024-09-21T03:24:53.643283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3323","last_scrub_stamp":"2024-09-21T03:24:53.643188+0000","last_deep_scrub":"27'3323","last_deep_scrub_stamp":"2024-09-21T03:24:53.643188+0000","last_clean_scrub_stamp":"2024-09-21T03:24:53.643188+0000","objects_scrubbed":0,"log_size":3323,"log_dups_size":0,"ondisk_log_size":3323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:29.929917+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49154,"num_write_kb":612364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:51.286647+0000","last_change":"2024-09-21T03:24:51.286647+0000","last_active":"2024-09-21T03:24:51.286647+0000","last_peered":"2024-09-21T03:24:51.286647+0000","last_clean":"2024-09-21T03:24:51.286647+0000","last_became_active":"2024-09-21T03:14:37.477951+0000","last_became_peered":"2024-09-21T03:14:37.477951+0000","last_unstale":"2024-09-21T03:24:51.286647+0000","last_undegraded":"2024-09-21T03:24:51.286647+0000","last_fullsized":"2024-09-21T03:24:51.286647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-09-21T03:24:51.286569+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-09-21T03:24:51.286569+0000","last_clean_scrub_stamp":"2024-09-21T03:24:51.286569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:56.560513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:12.355285+0000","last_change":"2024-09-21T03:25:12.355285+0000","last_active":"2024-09-21T03:25:12.355285+0000","last_peered":"2024-09-21T03:25:12.355285+0000","last_clean":"2024-09-21T03:25:12.355285+0000","last_became_active":"2024-09-21T03:14:46.545865+0000","last_became_peered":"2024-09-21T03:14:46.545865+0000","last_unstale":"2024-09-21T03:25:12.355285+0000","last_undegraded":"2024-09-21T03:25:12.355285+0000","last_fullsized":"2024-09-21T03:25:12.355285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-09-21T03:25:12.355166+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-09-21T03:25:12.355166+0000","last_clean_scrub_stamp":"2024-09-21T03:25:12.355166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:19.484606+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"27'2779","reported_seq":2814,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:24.747543+0000","last_change":"2024-09-21T03:25:24.747543+0000","last_active":"2024-09-21T03:25:24.747543+0000","last_peered":"2024-09-21T03:25:24.747543+0000","last_clean":"2024-09-21T03:25:24.747543+0000","last_became_active":"2024-09-21T03:14:47.568656+0000","last_became_peered":"2024-09-21T03:14:47.568656+0000","last_unstale":"2024-09-21T03:25:24.747543+0000","last_undegraded":"2024-09-21T03:25:24.747543+0000","last_fullsized":"2024-09-21T03:25:24.747543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2779","last_scrub_stamp":"2024-09-21T03:25:24.747435+0000","last_deep_scrub":"27'2779","last_deep_scrub_stamp":"2024-09-21T03:25:24.747435+0000","last_clean_scrub_stamp":"2024-09-21T03:25:24.747435+0000","objects_scrubbed":0,"log_size":2779,"log_dups_size":0,"ondisk_log_size":2779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:03.313714+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40461,"num_write_kb":415650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'3337","reported_seq":3374,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.632675+0000","last_change":"2024-09-21T03:25:05.632675+0000","last_active":"2024-09-21T03:25:05.632675+0000","last_peered":"2024-09-21T03:25:05.632675+0000","last_clean":"2024-09-21T03:25:05.632675+0000","last_became_active":"2024-09-21T03:14:38.485235+0000","last_became_peered":"2024-09-21T03:14:38.485235+0000","last_unstale":"2024-09-21T03:25:05.632675+0000","last_undegraded":"2024-09-21T03:25:05.632675+0000","last_fullsized":"2024-09-21T03:25:05.632675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3337","last_scrub_stamp":"2024-09-21T03:25:05.632583+0000","last_deep_scrub":"27'3337","last_deep_scrub_stamp":"2024-09-21T03:25:05.632583+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.632583+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:00.981106+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48941,"num_write_kb":642004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:56.792042+0000","last_change":"2024-09-21T03:24:56.792042+0000","last_active":"2024-09-21T03:24:56.792042+0000","last_peered":"2024-09-21T03:24:56.792042+0000","last_clean":"2024-09-21T03:24:56.792042+0000","last_became_active":"2024-09-21T03:14:37.465817+0000","last_became_peered":"2024-09-21T03:14:37.465817+0000","last_unstale":"2024-09-21T03:24:56.792042+0000","last_undegraded":"2024-09-21T03:24:56.792042+0000","last_fullsized":"2024-09-21T03:24:56.792042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-21T03:24:56.791950+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-21T03:24:56.791950+0000","last_clean_scrub_stamp":"2024-09-21T03:24:56.791950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:09.813730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'233","reported_seq":264,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.864621+0000","last_change":"2024-09-21T03:25:07.864621+0000","last_active":"2024-09-21T03:25:07.864621+0000","last_peered":"2024-09-21T03:25:07.864621+0000","last_clean":"2024-09-21T03:25:07.864621+0000","last_became_active":"2024-09-21T03:14:46.549119+0000","last_became_peered":"2024-09-21T03:14:46.549119+0000","last_unstale":"2024-09-21T03:25:07.864621+0000","last_undegraded":"2024-09-21T03:25:07.864621+0000","last_fullsized":"2024-09-21T03:25:07.864621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'233","last_scrub_stamp":"2024-09-21T03:25:07.864499+0000","last_deep_scrub":"27'233","last_deep_scrub_stamp":"2024-09-21T03:25:07.864499+0000","last_clean_scrub_stamp":"2024-09-21T03:25:07.864499+0000","objects_scrubbed":4,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:36.987208+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"27'3932","reported_seq":3955,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:17.182729+0000","last_change":"2024-09-21T03:25:17.182729+0000","last_active":"2024-09-21T03:25:17.182729+0000","last_peered":"2024-09-21T03:25:17.182729+0000","last_clean":"2024-09-21T03:25:17.182729+0000","last_became_active":"2024-09-21T03:15:15.687225+0000","last_became_peered":"2024-09-21T03:15:15.687225+0000","last_unstale":"2024-09-21T03:25:17.182729+0000","last_undegraded":"2024-09-21T03:25:17.182729+0000","last_fullsized":"2024-09-21T03:25:17.182729+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3932","last_scrub_stamp":"2024-09-21T03:25:17.182590+0000","last_deep_scrub":"27'3932","last_deep_scrub_stamp":"2024-09-21T03:25:17.182590+0000","last_clean_scrub_stamp":"2024-09-21T03:25:17.182590+0000","objects_scrubbed":0,"log_size":3932,"log_dups_size":0,"ondisk_log_size":3932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:30.102377+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57021,"num_write_kb":587488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"27'3064","reported_seq":3101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:59.881290+0000","last_change":"2024-09-21T03:24:59.881290+0000","last_active":"2024-09-21T03:24:59.881290+0000","last_peered":"2024-09-21T03:24:59.881290+0000","last_clean":"2024-09-21T03:24:59.881290+0000","last_became_active":"2024-09-21T03:14:38.482241+0000","last_became_peered":"2024-09-21T03:14:38.482241+0000","last_unstale":"2024-09-21T03:24:59.881290+0000","last_undegraded":"2024-09-21T03:24:59.881290+0000","last_fullsized":"2024-09-21T03:24:59.881290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3064","last_scrub_stamp":"2024-09-21T03:24:59.881166+0000","last_deep_scrub":"27'3064","last_deep_scrub_stamp":"2024-09-21T03:24:59.881166+0000","last_clean_scrub_stamp":"2024-09-21T03:24:59.881166+0000","objects_scrubbed":0,"log_size":3064,"log_dups_size":0,"ondisk_log_size":3064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:36:54.659394+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45418,"num_write_kb":562843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'23","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:56.382960+0000","last_change":"2024-09-21T03:24:56.382960+0000","last_active":"2024-09-21T03:24:56.382960+0000","last_peered":"2024-09-21T03:24:56.382960+0000","last_clean":"2024-09-21T03:24:56.382960+0000","last_became_active":"2024-09-21T03:14:37.478882+0000","last_became_peered":"2024-09-21T03:14:37.478882+0000","last_unstale":"2024-09-21T03:24:56.382960+0000","last_undegraded":"2024-09-21T03:24:56.382960+0000","last_fullsized":"2024-09-21T03:24:56.382960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-09-21T03:24:56.382871+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-09-21T03:24:56.382871+0000","last_clean_scrub_stamp":"2024-09-21T03:24:56.382871+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:04.672006+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'24","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:16.723828+0000","last_change":"2024-09-21T03:25:16.723828+0000","last_active":"2024-09-21T03:25:16.723828+0000","last_peered":"2024-09-21T03:25:16.723828+0000","last_clean":"2024-09-21T03:25:16.723828+0000","last_became_active":"2024-09-21T03:14:46.537835+0000","last_became_peered":"2024-09-21T03:14:46.537835+0000","last_unstale":"2024-09-21T03:25:16.723828+0000","last_undegraded":"2024-09-21T03:25:16.723828+0000","last_fullsized":"2024-09-21T03:25:16.723828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-09-21T03:25:16.723732+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-09-21T03:25:16.723732+0000","last_clean_scrub_stamp":"2024-09-21T03:25:16.723732+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:33.595915+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"27'3365","reported_seq":3394,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:12.754440+0000","last_change":"2024-09-21T03:25:12.754440+0000","last_active":"2024-09-21T03:25:12.754440+0000","last_peered":"2024-09-21T03:25:12.754440+0000","last_clean":"2024-09-21T03:25:12.754440+0000","last_became_active":"2024-09-21T03:14:47.566157+0000","last_became_peered":"2024-09-21T03:14:47.566157+0000","last_unstale":"2024-09-21T03:25:12.754440+0000","last_undegraded":"2024-09-21T03:25:12.754440+0000","last_fullsized":"2024-09-21T03:25:12.754440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3365","last_scrub_stamp":"2024-09-21T03:25:12.754329+0000","last_deep_scrub":"27'3365","last_deep_scrub_stamp":"2024-09-21T03:25:12.754329+0000","last_clean_scrub_stamp":"2024-09-21T03:25:12.754329+0000","objects_scrubbed":0,"log_size":3365,"log_dups_size":0,"ondisk_log_size":3365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:26.625059+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48864,"num_write_kb":499368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"27'2812","reported_seq":2849,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:00.375612+0000","last_change":"2024-09-21T03:25:00.375612+0000","last_active":"2024-09-21T03:25:00.375612+0000","last_peered":"2024-09-21T03:25:00.375612+0000","last_clean":"2024-09-21T03:25:00.375612+0000","last_became_active":"2024-09-21T03:14:38.478197+0000","last_became_peered":"2024-09-21T03:14:38.478197+0000","last_unstale":"2024-09-21T03:25:00.375612+0000","last_undegraded":"2024-09-21T03:25:00.375612+0000","last_fullsized":"2024-09-21T03:25:00.375612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2812","last_scrub_stamp":"2024-09-21T03:25:00.375509+0000","last_deep_scrub":"27'2812","last_deep_scrub_stamp":"2024-09-21T03:25:00.375509+0000","last_clean_scrub_stamp":"2024-09-21T03:25:00.375509+0000","objects_scrubbed":0,"log_size":2812,"log_dups_size":0,"ondisk_log_size":2812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:21.965006+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41544,"num_write_kb":533190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'239","reported_seq":278,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:51.702240+0000","last_change":"2024-09-21T03:24:51.702240+0000","last_active":"2024-09-21T03:24:51.702240+0000","last_peered":"2024-09-21T03:24:51.702240+0000","last_clean":"2024-09-21T03:24:51.702240+0000","last_became_active":"2024-09-21T03:14:37.472374+0000","last_became_peered":"2024-09-21T03:14:37.472374+0000","last_unstale":"2024-09-21T03:24:51.702240+0000","last_undegraded":"2024-09-21T03:24:51.702240+0000","last_fullsized":"2024-09-21T03:24:51.702240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'239","last_scrub_stamp":"2024-09-21T03:24:51.702166+0000","last_deep_scrub":"27'239","last_deep_scrub_stamp":"2024-09-21T03:24:51.702166+0000","last_clean_scrub_stamp":"2024-09-21T03:24:51.702166+0000","objects_scrubbed":6,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:39.767588+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":12446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'5","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.670277+0000","last_change":"2024-09-21T03:25:07.670277+0000","last_active":"2024-09-21T03:25:07.670277+0000","last_peered":"2024-09-21T03:25:07.670277+0000","last_clean":"2024-09-21T03:25:07.670277+0000","last_became_active":"2024-09-21T03:14:46.547192+0000","last_became_peered":"2024-09-21T03:14:46.547192+0000","last_unstale":"2024-09-21T03:25:07.670277+0000","last_undegraded":"2024-09-21T03:25:07.670277+0000","last_fullsized":"2024-09-21T03:25:07.670277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-21T03:25:07.670175+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-21T03:25:07.670175+0000","last_clean_scrub_stamp":"2024-09-21T03:25:07.670175+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:07.667049+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"27'2738","reported_seq":2767,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:12.830833+0000","last_change":"2024-09-21T03:25:12.830833+0000","last_active":"2024-09-21T03:25:12.830833+0000","last_peered":"2024-09-21T03:25:12.830833+0000","last_clean":"2024-09-21T03:25:12.830833+0000","last_became_active":"2024-09-21T03:14:47.545440+0000","last_became_peered":"2024-09-21T03:14:47.545440+0000","last_unstale":"2024-09-21T03:25:12.830833+0000","last_undegraded":"2024-09-21T03:25:12.830833+0000","last_fullsized":"2024-09-21T03:25:12.830833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2738","last_scrub_stamp":"2024-09-21T03:25:12.830715+0000","last_deep_scrub":"27'2738","last_deep_scrub_stamp":"2024-09-21T03:25:12.830715+0000","last_clean_scrub_stamp":"2024-09-21T03:25:12.830715+0000","objects_scrubbed":0,"log_size":2738,"log_dups_size":0,"ondisk_log_size":2738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:21.957527+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39786,"num_write_kb":413571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"27'4240","reported_seq":4277,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.683106+0000","last_change":"2024-09-21T03:25:06.683106+0000","last_active":"2024-09-21T03:25:06.683106+0000","last_peered":"2024-09-21T03:25:06.683106+0000","last_clean":"2024-09-21T03:25:06.683106+0000","last_became_active":"2024-09-21T03:14:38.476158+0000","last_became_peered":"2024-09-21T03:14:38.476158+0000","last_unstale":"2024-09-21T03:25:06.683106+0000","last_undegraded":"2024-09-21T03:25:06.683106+0000","last_fullsized":"2024-09-21T03:25:06.683106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4240","last_scrub_stamp":"2024-09-21T03:25:06.683026+0000","last_deep_scrub":"27'4240","last_deep_scrub_stamp":"2024-09-21T03:25:06.683026+0000","last_clean_scrub_stamp":"2024-09-21T03:25:06.683026+0000","objects_scrubbed":0,"log_size":4240,"log_dups_size":0,"ondisk_log_size":4240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:22.948780+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63095,"num_write_kb":776596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'36","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:57.344640+0000","last_change":"2024-09-21T03:24:57.344640+0000","last_active":"2024-09-21T03:24:57.344640+0000","last_peered":"2024-09-21T03:24:57.344640+0000","last_clean":"2024-09-21T03:24:57.344640+0000","last_became_active":"2024-09-21T03:14:37.472544+0000","last_became_peered":"2024-09-21T03:14:37.472544+0000","last_unstale":"2024-09-21T03:24:57.344640+0000","last_undegraded":"2024-09-21T03:24:57.344640+0000","last_fullsized":"2024-09-21T03:24:57.344640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-09-21T03:24:57.344345+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-09-21T03:24:57.344345+0000","last_clean_scrub_stamp":"2024-09-21T03:24:57.344345+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:06.924018+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'55","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:04.747323+0000","last_change":"2024-09-21T03:25:04.747323+0000","last_active":"2024-09-21T03:25:04.747323+0000","last_peered":"2024-09-21T03:25:04.747323+0000","last_clean":"2024-09-21T03:25:04.747323+0000","last_became_active":"2024-09-21T03:14:46.533891+0000","last_became_peered":"2024-09-21T03:14:46.533891+0000","last_unstale":"2024-09-21T03:25:04.747323+0000","last_undegraded":"2024-09-21T03:25:04.747323+0000","last_fullsized":"2024-09-21T03:25:04.747323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2024-09-21T03:25:04.747236+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2024-09-21T03:25:04.747236+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.747236+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:52.821848+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":8218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"27'3050","reported_seq":3079,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:23.713617+0000","last_change":"2024-09-21T03:25:23.713617+0000","last_active":"2024-09-21T03:25:23.713617+0000","last_peered":"2024-09-21T03:25:23.713617+0000","last_clean":"2024-09-21T03:25:23.713617+0000","last_became_active":"2024-09-21T03:14:47.551622+0000","last_became_peered":"2024-09-21T03:14:47.551622+0000","last_unstale":"2024-09-21T03:25:23.713617+0000","last_undegraded":"2024-09-21T03:25:23.713617+0000","last_fullsized":"2024-09-21T03:25:23.713617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3050","last_scrub_stamp":"2024-09-21T03:25:23.713489+0000","last_deep_scrub":"27'3050","last_deep_scrub_stamp":"2024-09-21T03:25:23.713489+0000","last_clean_scrub_stamp":"2024-09-21T03:25:23.713489+0000","objects_scrubbed":0,"log_size":3050,"log_dups_size":0,"ondisk_log_size":3050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:33.156471+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44676,"num_write_kb":453348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'2866","reported_seq":2903,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:59.502557+0000","last_change":"2024-09-21T03:24:59.502557+0000","last_active":"2024-09-21T03:24:59.502557+0000","last_peered":"2024-09-21T03:24:59.502557+0000","last_clean":"2024-09-21T03:24:59.502557+0000","last_became_active":"2024-09-21T03:14:38.483348+0000","last_became_peered":"2024-09-21T03:14:38.483348+0000","last_unstale":"2024-09-21T03:24:59.502557+0000","last_undegraded":"2024-09-21T03:24:59.502557+0000","last_fullsized":"2024-09-21T03:24:59.502557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2866","last_scrub_stamp":"2024-09-21T03:24:59.502442+0000","last_deep_scrub":"27'2866","last_deep_scrub_stamp":"2024-09-21T03:24:59.502442+0000","last_clean_scrub_stamp":"2024-09-21T03:24:59.502442+0000","objects_scrubbed":0,"log_size":2866,"log_dups_size":0,"ondisk_log_size":2866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:14.399805+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42315,"num_write_kb":514746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'15","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:52.319636+0000","last_change":"2024-09-21T03:24:52.319636+0000","last_active":"2024-09-21T03:24:52.319636+0000","last_peered":"2024-09-21T03:24:52.319636+0000","last_clean":"2024-09-21T03:24:52.319636+0000","last_became_active":"2024-09-21T03:14:37.478700+0000","last_became_peered":"2024-09-21T03:14:37.478700+0000","last_unstale":"2024-09-21T03:24:52.319636+0000","last_undegraded":"2024-09-21T03:24:52.319636+0000","last_fullsized":"2024-09-21T03:24:52.319636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-09-21T03:24:52.319558+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-09-21T03:24:52.319558+0000","last_clean_scrub_stamp":"2024-09-21T03:24:52.319558+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:27:43.884491+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'16","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:02.292183+0000","last_change":"2024-09-21T03:25:02.292183+0000","last_active":"2024-09-21T03:25:02.292183+0000","last_peered":"2024-09-21T03:25:02.292183+0000","last_clean":"2024-09-21T03:25:02.292183+0000","last_became_active":"2024-09-21T03:14:46.546867+0000","last_became_peered":"2024-09-21T03:14:46.546867+0000","last_unstale":"2024-09-21T03:25:02.292183+0000","last_undegraded":"2024-09-21T03:25:02.292183+0000","last_fullsized":"2024-09-21T03:25:02.292183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-09-21T03:25:02.292070+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-09-21T03:25:02.292070+0000","last_clean_scrub_stamp":"2024-09-21T03:25:02.292070+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:01.854203+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"27'3248","reported_seq":3277,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.688672+0000","last_change":"2024-09-21T03:25:05.688672+0000","last_active":"2024-09-21T03:25:05.688672+0000","last_peered":"2024-09-21T03:25:05.688672+0000","last_clean":"2024-09-21T03:25:05.688672+0000","last_became_active":"2024-09-21T03:14:47.558037+0000","last_became_peered":"2024-09-21T03:14:47.558037+0000","last_unstale":"2024-09-21T03:25:05.688672+0000","last_undegraded":"2024-09-21T03:25:05.688672+0000","last_fullsized":"2024-09-21T03:25:05.688672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3248","last_scrub_stamp":"2024-09-21T03:25:05.688592+0000","last_deep_scrub":"27'3248","last_deep_scrub_stamp":"2024-09-21T03:25:05.688592+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.688592+0000","objects_scrubbed":0,"log_size":3248,"log_dups_size":0,"ondisk_log_size":3248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:46.293035+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47392,"num_write_kb":480920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"27'3071","reported_seq":3108,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:52.705841+0000","last_change":"2024-09-21T03:24:52.705841+0000","last_active":"2024-09-21T03:24:52.705841+0000","last_peered":"2024-09-21T03:24:52.705841+0000","last_clean":"2024-09-21T03:24:52.705841+0000","last_became_active":"2024-09-21T03:14:38.482370+0000","last_became_peered":"2024-09-21T03:14:38.482370+0000","last_unstale":"2024-09-21T03:24:52.705841+0000","last_undegraded":"2024-09-21T03:24:52.705841+0000","last_fullsized":"2024-09-21T03:24:52.705841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3071","last_scrub_stamp":"2024-09-21T03:24:52.705738+0000","last_deep_scrub":"27'3071","last_deep_scrub_stamp":"2024-09-21T03:24:52.705738+0000","last_clean_scrub_stamp":"2024-09-21T03:24:52.705738+0000","objects_scrubbed":0,"log_size":3071,"log_dups_size":0,"ondisk_log_size":3071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:13.109136+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45203,"num_write_kb":570065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:51.637324+0000","last_change":"2024-09-21T03:24:51.637324+0000","last_active":"2024-09-21T03:24:51.637324+0000","last_peered":"2024-09-21T03:24:51.637324+0000","last_clean":"2024-09-21T03:24:51.637324+0000","last_became_active":"2024-09-21T03:14:37.471002+0000","last_became_peered":"2024-09-21T03:14:37.471002+0000","last_unstale":"2024-09-21T03:24:51.637324+0000","last_undegraded":"2024-09-21T03:24:51.637324+0000","last_fullsized":"2024-09-21T03:24:51.637324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-09-21T03:24:51.637239+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-09-21T03:24:51.637239+0000","last_clean_scrub_stamp":"2024-09-21T03:24:51.637239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:49.069586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.664314+0000","last_change":"2024-09-21T03:25:06.664314+0000","last_active":"2024-09-21T03:25:06.664314+0000","last_peered":"2024-09-21T03:25:06.664314+0000","last_clean":"2024-09-21T03:25:06.664314+0000","last_became_active":"2024-09-21T03:14:46.543647+0000","last_became_peered":"2024-09-21T03:14:46.543647+0000","last_unstale":"2024-09-21T03:25:06.664314+0000","last_undegraded":"2024-09-21T03:25:06.664314+0000","last_fullsized":"2024-09-21T03:25:06.664314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-09-21T03:25:06.664221+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-09-21T03:25:06.664221+0000","last_clean_scrub_stamp":"2024-09-21T03:25:06.664221+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:00.963769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"27'3498","reported_seq":3528,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:08.715245+0000","last_change":"2024-09-21T03:25:08.715181+0000","last_active":"2024-09-21T03:25:08.715245+0000","last_peered":"2024-09-21T03:25:08.715245+0000","last_clean":"2024-09-21T03:25:08.715245+0000","last_became_active":"2024-09-21T03:14:47.551563+0000","last_became_peered":"2024-09-21T03:14:47.551563+0000","last_unstale":"2024-09-21T03:25:08.715245+0000","last_undegraded":"2024-09-21T03:25:08.715245+0000","last_fullsized":"2024-09-21T03:25:08.715245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3498","last_scrub_stamp":"2024-09-21T03:25:08.715088+0000","last_deep_scrub":"27'3498","last_deep_scrub_stamp":"2024-09-21T03:25:08.715088+0000","last_clean_scrub_stamp":"2024-09-21T03:25:08.715088+0000","objects_scrubbed":0,"log_size":3498,"log_dups_size":0,"ondisk_log_size":3498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:52.596975+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50774,"num_write_kb":531933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"27'33","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:08.700265+0000","last_change":"2024-09-21T03:25:08.700265+0000","last_active":"2024-09-21T03:25:08.700265+0000","last_peered":"2024-09-21T03:25:08.700265+0000","last_clean":"2024-09-21T03:25:08.700265+0000","last_became_active":"2024-09-21T03:14:46.541771+0000","last_became_peered":"2024-09-21T03:14:46.541771+0000","last_unstale":"2024-09-21T03:25:08.700265+0000","last_undegraded":"2024-09-21T03:25:08.700265+0000","last_fullsized":"2024-09-21T03:25:08.700265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2024-09-21T03:25:08.700167+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2024-09-21T03:25:08.700167+0000","last_clean_scrub_stamp":"2024-09-21T03:25:08.700167+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:23:59.466680+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'3639","reported_seq":3676,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:02.663553+0000","last_change":"2024-09-21T03:25:02.663553+0000","last_active":"2024-09-21T03:25:02.663553+0000","last_peered":"2024-09-21T03:25:02.663553+0000","last_clean":"2024-09-21T03:25:02.663553+0000","last_became_active":"2024-09-21T03:14:38.478400+0000","last_became_peered":"2024-09-21T03:14:38.478400+0000","last_unstale":"2024-09-21T03:25:02.663553+0000","last_undegraded":"2024-09-21T03:25:02.663553+0000","last_fullsized":"2024-09-21T03:25:02.663553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3639","last_scrub_stamp":"2024-09-21T03:25:02.663449+0000","last_deep_scrub":"27'3639","last_deep_scrub_stamp":"2024-09-21T03:25:02.663449+0000","last_clean_scrub_stamp":"2024-09-21T03:25:02.663449+0000","objects_scrubbed":0,"log_size":3639,"log_dups_size":0,"ondisk_log_size":3639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:04.399421+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53758,"num_write_kb":679942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'31","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:00.722304+0000","last_change":"2024-09-21T03:25:00.722304+0000","last_active":"2024-09-21T03:25:00.722304+0000","last_peered":"2024-09-21T03:25:00.722304+0000","last_clean":"2024-09-21T03:25:00.722304+0000","last_became_active":"2024-09-21T03:14:37.458676+0000","last_became_peered":"2024-09-21T03:14:37.458676+0000","last_unstale":"2024-09-21T03:25:00.722304+0000","last_undegraded":"2024-09-21T03:25:00.722304+0000","last_fullsized":"2024-09-21T03:25:00.722304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-09-21T03:25:00.722199+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-09-21T03:25:00.722199+0000","last_clean_scrub_stamp":"2024-09-21T03:25:00.722199+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:00:43.809124+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"27'3281","reported_seq":3311,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:11.843385+0000","last_change":"2024-09-21T03:25:11.843385+0000","last_active":"2024-09-21T03:25:11.843385+0000","last_peered":"2024-09-21T03:25:11.843385+0000","last_clean":"2024-09-21T03:25:11.843385+0000","last_became_active":"2024-09-21T03:14:47.557224+0000","last_became_peered":"2024-09-21T03:14:47.557224+0000","last_unstale":"2024-09-21T03:25:11.843385+0000","last_undegraded":"2024-09-21T03:25:11.843385+0000","last_fullsized":"2024-09-21T03:25:11.843385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3281","last_scrub_stamp":"2024-09-21T03:25:11.843293+0000","last_deep_scrub":"27'3281","last_deep_scrub_stamp":"2024-09-21T03:25:11.843293+0000","last_clean_scrub_stamp":"2024-09-21T03:25:11.843293+0000","objects_scrubbed":0,"log_size":3281,"log_dups_size":0,"ondisk_log_size":3281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:25.461361+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47961,"num_write_kb":483752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"27'11","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:17.738707+0000","last_change":"2024-09-21T03:25:17.738707+0000","last_active":"2024-09-21T03:25:17.738707+0000","last_peered":"2024-09-21T03:25:17.738707+0000","last_clean":"2024-09-21T03:25:17.738707+0000","last_became_active":"2024-09-21T03:14:46.542746+0000","last_became_peered":"2024-09-21T03:14:46.542746+0000","last_unstale":"2024-09-21T03:25:17.738707+0000","last_undegraded":"2024-09-21T03:25:17.738707+0000","last_fullsized":"2024-09-21T03:25:17.738707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-09-21T03:25:17.738582+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-09-21T03:25:17.738582+0000","last_clean_scrub_stamp":"2024-09-21T03:25:17.738582+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:15.232834+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'3052","reported_seq":3089,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:00.494226+0000","last_change":"2024-09-21T03:25:00.494226+0000","last_active":"2024-09-21T03:25:00.494226+0000","last_peered":"2024-09-21T03:25:00.494226+0000","last_clean":"2024-09-21T03:25:00.494226+0000","last_became_active":"2024-09-21T03:14:38.472823+0000","last_became_peered":"2024-09-21T03:14:38.472823+0000","last_unstale":"2024-09-21T03:25:00.494226+0000","last_undegraded":"2024-09-21T03:25:00.494226+0000","last_fullsized":"2024-09-21T03:25:00.494226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3052","last_scrub_stamp":"2024-09-21T03:25:00.494132+0000","last_deep_scrub":"27'3052","last_deep_scrub_stamp":"2024-09-21T03:25:00.494132+0000","last_clean_scrub_stamp":"2024-09-21T03:25:00.494132+0000","objects_scrubbed":0,"log_size":3052,"log_dups_size":0,"ondisk_log_size":3052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:02.275963+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44791,"num_write_kb":578211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'18","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:56.843576+0000","last_change":"2024-09-21T03:24:56.843576+0000","last_active":"2024-09-21T03:24:56.843576+0000","last_peered":"2024-09-21T03:24:56.843576+0000","last_clean":"2024-09-21T03:24:56.843576+0000","last_became_active":"2024-09-21T03:14:37.471771+0000","last_became_peered":"2024-09-21T03:14:37.471771+0000","last_unstale":"2024-09-21T03:24:56.843576+0000","last_undegraded":"2024-09-21T03:24:56.843576+0000","last_fullsized":"2024-09-21T03:24:56.843576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-09-21T03:24:56.843462+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-09-21T03:24:56.843462+0000","last_clean_scrub_stamp":"2024-09-21T03:24:56.843462+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:47.003731+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1d","version":"27'3552","reported_seq":3581,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:16.758633+0000","last_change":"2024-09-21T03:25:16.758633+0000","last_active":"2024-09-21T03:25:16.758633+0000","last_peered":"2024-09-21T03:25:16.758633+0000","last_clean":"2024-09-21T03:25:16.758633+0000","last_became_active":"2024-09-21T03:14:47.568081+0000","last_became_peered":"2024-09-21T03:14:47.568081+0000","last_unstale":"2024-09-21T03:25:16.758633+0000","last_undegraded":"2024-09-21T03:25:16.758633+0000","last_fullsized":"2024-09-21T03:25:16.758633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3552","last_scrub_stamp":"2024-09-21T03:25:16.758512+0000","last_deep_scrub":"27'3552","last_deep_scrub_stamp":"2024-09-21T03:25:16.758512+0000","last_clean_scrub_stamp":"2024-09-21T03:25:16.758512+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:48.327469+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51450,"num_write_kb":532295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"27'36","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:59.753269+0000","last_change":"2024-09-21T03:24:59.753269+0000","last_active":"2024-09-21T03:24:59.753269+0000","last_peered":"2024-09-21T03:24:59.753269+0000","last_clean":"2024-09-21T03:24:59.753269+0000","last_became_active":"2024-09-21T03:14:37.474595+0000","last_became_peered":"2024-09-21T03:14:37.474595+0000","last_unstale":"2024-09-21T03:24:59.753269+0000","last_undegraded":"2024-09-21T03:24:59.753269+0000","last_fullsized":"2024-09-21T03:24:59.753269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-09-21T03:24:59.753174+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-09-21T03:24:59.753174+0000","last_clean_scrub_stamp":"2024-09-21T03:24:59.753174+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:11.825438+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2516","reported_seq":2553,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:03.658699+0000","last_change":"2024-09-21T03:25:03.658699+0000","last_active":"2024-09-21T03:25:03.658699+0000","last_peered":"2024-09-21T03:25:03.658699+0000","last_clean":"2024-09-21T03:25:03.658699+0000","last_became_active":"2024-09-21T03:14:38.482354+0000","last_became_peered":"2024-09-21T03:14:38.482354+0000","last_unstale":"2024-09-21T03:25:03.658699+0000","last_undegraded":"2024-09-21T03:25:03.658699+0000","last_fullsized":"2024-09-21T03:25:03.658699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2516","last_scrub_stamp":"2024-09-21T03:25:03.658584+0000","last_deep_scrub":"27'2516","last_deep_scrub_stamp":"2024-09-21T03:25:03.658584+0000","last_clean_scrub_stamp":"2024-09-21T03:25:03.658584+0000","objects_scrubbed":0,"log_size":2516,"log_dups_size":0,"ondisk_log_size":2516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:53.542866+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37096,"num_write_kb":460963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'36","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.743143+0000","last_change":"2024-09-21T03:25:09.743143+0000","last_active":"2024-09-21T03:25:09.743143+0000","last_peered":"2024-09-21T03:25:09.743143+0000","last_clean":"2024-09-21T03:25:09.743143+0000","last_became_active":"2024-09-21T03:14:46.550191+0000","last_became_peered":"2024-09-21T03:14:46.550191+0000","last_unstale":"2024-09-21T03:25:09.743143+0000","last_undegraded":"2024-09-21T03:25:09.743143+0000","last_fullsized":"2024-09-21T03:25:09.743143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-09-21T03:25:09.743050+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-09-21T03:25:09.743050+0000","last_clean_scrub_stamp":"2024-09-21T03:25:09.743050+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:36.573960+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"27'2120","reported_seq":2155,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.696039+0000","last_change":"2024-09-21T03:25:07.696039+0000","last_active":"2024-09-21T03:25:07.696039+0000","last_peered":"2024-09-21T03:25:07.696039+0000","last_clean":"2024-09-21T03:25:07.696039+0000","last_became_active":"2024-09-21T03:15:15.686063+0000","last_became_peered":"2024-09-21T03:15:15.686063+0000","last_unstale":"2024-09-21T03:25:07.696039+0000","last_undegraded":"2024-09-21T03:25:07.696039+0000","last_fullsized":"2024-09-21T03:25:07.696039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2120","last_scrub_stamp":"2024-09-21T03:25:07.695898+0000","last_deep_scrub":"27'2120","last_deep_scrub_stamp":"2024-09-21T03:25:07.695898+0000","last_clean_scrub_stamp":"2024-09-21T03:25:07.695898+0000","objects_scrubbed":0,"log_size":2120,"log_dups_size":0,"ondisk_log_size":2120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:35.021288+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30729,"num_write_kb":315555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1141","reported_seq":1180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:54.497821+0000","last_change":"2024-09-21T03:24:54.497821+0000","last_active":"2024-09-21T03:24:54.497821+0000","last_peered":"2024-09-21T03:24:54.497821+0000","last_clean":"2024-09-21T03:24:54.497821+0000","last_became_active":"2024-09-21T03:14:37.465240+0000","last_became_peered":"2024-09-21T03:14:37.465240+0000","last_unstale":"2024-09-21T03:24:54.497821+0000","last_undegraded":"2024-09-21T03:24:54.497821+0000","last_fullsized":"2024-09-21T03:24:54.497821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1141","last_scrub_stamp":"2024-09-21T03:24:54.497722+0000","last_deep_scrub":"27'1141","last_deep_scrub_stamp":"2024-09-21T03:24:54.497722+0000","last_clean_scrub_stamp":"2024-09-21T03:24:54.497722+0000","objects_scrubbed":1,"log_size":1141,"log_dups_size":0,"ondisk_log_size":1141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:31.119993+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1138,"num_write_kb":5114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'2730","reported_seq":2767,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:54.605635+0000","last_change":"2024-09-21T03:24:54.605635+0000","last_active":"2024-09-21T03:24:54.605635+0000","last_peered":"2024-09-21T03:24:54.605635+0000","last_clean":"2024-09-21T03:24:54.605635+0000","last_became_active":"2024-09-21T03:14:38.472225+0000","last_became_peered":"2024-09-21T03:14:38.472225+0000","last_unstale":"2024-09-21T03:24:54.605635+0000","last_undegraded":"2024-09-21T03:24:54.605635+0000","last_fullsized":"2024-09-21T03:24:54.605635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2730","last_scrub_stamp":"2024-09-21T03:24:54.605532+0000","last_deep_scrub":"27'2730","last_deep_scrub_stamp":"2024-09-21T03:24:54.605532+0000","last_clean_scrub_stamp":"2024-09-21T03:24:54.605532+0000","objects_scrubbed":0,"log_size":2730,"log_dups_size":0,"ondisk_log_size":2730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:57.251920+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40361,"num_write_kb":500658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'81","reported_seq":112,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.410108+0000","last_change":"2024-09-21T03:25:05.410108+0000","last_active":"2024-09-21T03:25:05.410108+0000","last_peered":"2024-09-21T03:25:05.410108+0000","last_clean":"2024-09-21T03:25:05.410108+0000","last_became_active":"2024-09-21T03:14:46.543729+0000","last_became_peered":"2024-09-21T03:14:46.543729+0000","last_unstale":"2024-09-21T03:25:05.410108+0000","last_undegraded":"2024-09-21T03:25:05.410108+0000","last_fullsized":"2024-09-21T03:25:05.410108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'81","last_scrub_stamp":"2024-09-21T03:25:05.409994+0000","last_deep_scrub":"27'81","last_deep_scrub_stamp":"2024-09-21T03:25:05.409994+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.409994+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:13.871092+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":12315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.26","version":"27'2742","reported_seq":2771,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:15.706487+0000","last_change":"2024-09-21T03:25:15.706487+0000","last_active":"2024-09-21T03:25:15.706487+0000","last_peered":"2024-09-21T03:25:15.706487+0000","last_clean":"2024-09-21T03:25:15.706487+0000","last_became_active":"2024-09-21T03:14:47.562943+0000","last_became_peered":"2024-09-21T03:14:47.562943+0000","last_unstale":"2024-09-21T03:25:15.706487+0000","last_undegraded":"2024-09-21T03:25:15.706487+0000","last_fullsized":"2024-09-21T03:25:15.706487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2742","last_scrub_stamp":"2024-09-21T03:25:15.706366+0000","last_deep_scrub":"27'2742","last_deep_scrub_stamp":"2024-09-21T03:25:15.706366+0000","last_clean_scrub_stamp":"2024-09-21T03:25:15.706366+0000","objects_scrubbed":0,"log_size":2742,"log_dups_size":0,"ondisk_log_size":2742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:53.530230+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39824,"num_write_kb":405293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"27'3827","reported_seq":3865,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:53.658701+0000","last_change":"2024-09-21T03:24:53.658648+0000","last_active":"2024-09-21T03:24:53.658701+0000","last_peered":"2024-09-21T03:24:53.658701+0000","last_clean":"2024-09-21T03:24:53.658701+0000","last_became_active":"2024-09-21T03:14:38.483975+0000","last_became_peered":"2024-09-21T03:14:38.483975+0000","last_unstale":"2024-09-21T03:24:53.658701+0000","last_undegraded":"2024-09-21T03:24:53.658701+0000","last_fullsized":"2024-09-21T03:24:53.658701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3827","last_scrub_stamp":"2024-09-21T03:24:53.658564+0000","last_deep_scrub":"27'3827","last_deep_scrub_stamp":"2024-09-21T03:24:53.658564+0000","last_clean_scrub_stamp":"2024-09-21T03:24:53.658564+0000","objects_scrubbed":0,"log_size":3827,"log_dups_size":0,"ondisk_log_size":3827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:36:02.242965+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56663,"num_write_kb":721573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"27'3391","reported_seq":3420,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:14.754373+0000","last_change":"2024-09-21T03:25:14.754373+0000","last_active":"2024-09-21T03:25:14.754373+0000","last_peered":"2024-09-21T03:25:14.754373+0000","last_clean":"2024-09-21T03:25:14.754373+0000","last_became_active":"2024-09-21T03:14:47.560282+0000","last_became_peered":"2024-09-21T03:14:47.560282+0000","last_unstale":"2024-09-21T03:25:14.754373+0000","last_undegraded":"2024-09-21T03:25:14.754373+0000","last_fullsized":"2024-09-21T03:25:14.754373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3391","last_scrub_stamp":"2024-09-21T03:25:14.754255+0000","last_deep_scrub":"27'3391","last_deep_scrub_stamp":"2024-09-21T03:25:14.754255+0000","last_clean_scrub_stamp":"2024-09-21T03:25:14.754255+0000","objects_scrubbed":0,"log_size":3391,"log_dups_size":0,"ondisk_log_size":3391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:59.507595+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49276,"num_write_kb":506666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.21","version":"27'3197","reported_seq":3235,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:59.310611+0000","last_change":"2024-09-21T03:24:59.310543+0000","last_active":"2024-09-21T03:24:59.310611+0000","last_peered":"2024-09-21T03:24:59.310611+0000","last_clean":"2024-09-21T03:24:59.310611+0000","last_became_active":"2024-09-21T03:14:38.476657+0000","last_became_peered":"2024-09-21T03:14:38.476657+0000","last_unstale":"2024-09-21T03:24:59.310611+0000","last_undegraded":"2024-09-21T03:24:59.310611+0000","last_fullsized":"2024-09-21T03:24:59.310611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3197","last_scrub_stamp":"2024-09-21T03:24:59.310435+0000","last_deep_scrub":"27'3197","last_deep_scrub_stamp":"2024-09-21T03:24:59.310435+0000","last_clean_scrub_stamp":"2024-09-21T03:24:59.310435+0000","objects_scrubbed":0,"log_size":3197,"log_dups_size":0,"ondisk_log_size":3197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:47.245423+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47236,"num_write_kb":609124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.24","version":"27'2689","reported_seq":2718,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.686271+0000","last_change":"2024-09-21T03:25:09.686271+0000","last_active":"2024-09-21T03:25:09.686271+0000","last_peered":"2024-09-21T03:25:09.686271+0000","last_clean":"2024-09-21T03:25:09.686271+0000","last_became_active":"2024-09-21T03:14:47.565732+0000","last_became_peered":"2024-09-21T03:14:47.565732+0000","last_unstale":"2024-09-21T03:25:09.686271+0000","last_undegraded":"2024-09-21T03:25:09.686271+0000","last_fullsized":"2024-09-21T03:25:09.686271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2689","last_scrub_stamp":"2024-09-21T03:25:09.686177+0000","last_deep_scrub":"27'2689","last_deep_scrub_stamp":"2024-09-21T03:25:09.686177+0000","last_clean_scrub_stamp":"2024-09-21T03:25:09.686177+0000","objects_scrubbed":0,"log_size":2689,"log_dups_size":0,"ondisk_log_size":2689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:17.135758+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39100,"num_write_kb":400538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'3540","reported_seq":3578,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:08.754779+0000","last_change":"2024-09-21T03:25:08.754717+0000","last_active":"2024-09-21T03:25:08.754779+0000","last_peered":"2024-09-21T03:25:08.754779+0000","last_clean":"2024-09-21T03:25:08.754779+0000","last_became_active":"2024-09-21T03:14:38.472548+0000","last_became_peered":"2024-09-21T03:14:38.472548+0000","last_unstale":"2024-09-21T03:25:08.754779+0000","last_undegraded":"2024-09-21T03:25:08.754779+0000","last_fullsized":"2024-09-21T03:25:08.754779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3540","last_scrub_stamp":"2024-09-21T03:25:08.754633+0000","last_deep_scrub":"27'3540","last_deep_scrub_stamp":"2024-09-21T03:25:08.754633+0000","last_clean_scrub_stamp":"2024-09-21T03:25:08.754633+0000","objects_scrubbed":0,"log_size":3540,"log_dups_size":0,"ondisk_log_size":3540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:48.025671+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52273,"num_write_kb":690147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"27'3152","reported_seq":3181,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:16.223893+0000","last_change":"2024-09-21T03:25:16.223893+0000","last_active":"2024-09-21T03:25:16.223893+0000","last_peered":"2024-09-21T03:25:16.223893+0000","last_clean":"2024-09-21T03:25:16.223893+0000","last_became_active":"2024-09-21T03:14:47.557047+0000","last_became_peered":"2024-09-21T03:14:47.557047+0000","last_unstale":"2024-09-21T03:25:16.223893+0000","last_undegraded":"2024-09-21T03:25:16.223893+0000","last_fullsized":"2024-09-21T03:25:16.223893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3152","last_scrub_stamp":"2024-09-21T03:25:16.223780+0000","last_deep_scrub":"27'3152","last_deep_scrub_stamp":"2024-09-21T03:25:16.223780+0000","last_clean_scrub_stamp":"2024-09-21T03:25:16.223780+0000","objects_scrubbed":0,"log_size":3152,"log_dups_size":0,"ondisk_log_size":3152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:53.887719+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46003,"num_write_kb":479339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'2575","reported_seq":2613,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:04.452851+0000","last_change":"2024-09-21T03:25:04.452786+0000","last_active":"2024-09-21T03:25:04.452851+0000","last_peered":"2024-09-21T03:25:04.452851+0000","last_clean":"2024-09-21T03:25:04.452851+0000","last_became_active":"2024-09-21T03:14:38.480686+0000","last_became_peered":"2024-09-21T03:14:38.480686+0000","last_unstale":"2024-09-21T03:25:04.452851+0000","last_undegraded":"2024-09-21T03:25:04.452851+0000","last_fullsized":"2024-09-21T03:25:04.452851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2575","last_scrub_stamp":"2024-09-21T03:25:04.452696+0000","last_deep_scrub":"27'2575","last_deep_scrub_stamp":"2024-09-21T03:25:04.452696+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.452696+0000","objects_scrubbed":0,"log_size":2575,"log_dups_size":0,"ondisk_log_size":2575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:10.179636+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37971,"num_write_kb":494263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.22","version":"27'3601","reported_seq":3631,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.472585+0000","last_change":"2024-09-21T03:25:09.472519+0000","last_active":"2024-09-21T03:25:09.472585+0000","last_peered":"2024-09-21T03:25:09.472585+0000","last_clean":"2024-09-21T03:25:09.472585+0000","last_became_active":"2024-09-21T03:14:47.565393+0000","last_became_peered":"2024-09-21T03:14:47.565393+0000","last_unstale":"2024-09-21T03:25:09.472585+0000","last_undegraded":"2024-09-21T03:25:09.472585+0000","last_fullsized":"2024-09-21T03:25:09.472585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3601","last_scrub_stamp":"2024-09-21T03:25:09.472408+0000","last_deep_scrub":"27'3601","last_deep_scrub_stamp":"2024-09-21T03:25:09.472408+0000","last_clean_scrub_stamp":"2024-09-21T03:25:09.472408+0000","objects_scrubbed":0,"log_size":3601,"log_dups_size":0,"ondisk_log_size":3601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:49:50.142358+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52343,"num_write_kb":533323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'2833","reported_seq":2871,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:00.850506+0000","last_change":"2024-09-21T03:25:00.850441+0000","last_active":"2024-09-21T03:25:00.850506+0000","last_peered":"2024-09-21T03:25:00.850506+0000","last_clean":"2024-09-21T03:25:00.850506+0000","last_became_active":"2024-09-21T03:14:38.471325+0000","last_became_peered":"2024-09-21T03:14:38.471325+0000","last_unstale":"2024-09-21T03:25:00.850506+0000","last_undegraded":"2024-09-21T03:25:00.850506+0000","last_fullsized":"2024-09-21T03:25:00.850506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2833","last_scrub_stamp":"2024-09-21T03:25:00.850341+0000","last_deep_scrub":"27'2833","last_deep_scrub_stamp":"2024-09-21T03:25:00.850341+0000","last_clean_scrub_stamp":"2024-09-21T03:25:00.850341+0000","objects_scrubbed":0,"log_size":2833,"log_dups_size":0,"ondisk_log_size":2833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:15.818345+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41957,"num_write_kb":531654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.23","version":"27'2584","reported_seq":2620,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:11.544726+0000","last_change":"2024-09-21T03:25:11.544662+0000","last_active":"2024-09-21T03:25:11.544726+0000","last_peered":"2024-09-21T03:25:11.544726+0000","last_clean":"2024-09-21T03:25:11.544726+0000","last_became_active":"2024-09-21T03:15:15.684633+0000","last_became_peered":"2024-09-21T03:15:15.684633+0000","last_unstale":"2024-09-21T03:25:11.544726+0000","last_undegraded":"2024-09-21T03:25:11.544726+0000","last_fullsized":"2024-09-21T03:25:11.544726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2584","last_scrub_stamp":"2024-09-21T03:25:11.544557+0000","last_deep_scrub":"27'2584","last_deep_scrub_stamp":"2024-09-21T03:25:11.544557+0000","last_clean_scrub_stamp":"2024-09-21T03:25:11.544557+0000","objects_scrubbed":0,"log_size":2584,"log_dups_size":0,"ondisk_log_size":2584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:16.900150+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37382,"num_write_kb":380663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"27'3218","reported_seq":3256,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:01.889337+0000","last_change":"2024-09-21T03:25:01.889279+0000","last_active":"2024-09-21T03:25:01.889337+0000","last_peered":"2024-09-21T03:25:01.889337+0000","last_clean":"2024-09-21T03:25:01.889337+0000","last_became_active":"2024-09-21T03:14:38.475894+0000","last_became_peered":"2024-09-21T03:14:38.475894+0000","last_unstale":"2024-09-21T03:25:01.889337+0000","last_undegraded":"2024-09-21T03:25:01.889337+0000","last_fullsized":"2024-09-21T03:25:01.889337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3218","last_scrub_stamp":"2024-09-21T03:25:01.889182+0000","last_deep_scrub":"27'3218","last_deep_scrub_stamp":"2024-09-21T03:25:01.889182+0000","last_clean_scrub_stamp":"2024-09-21T03:25:01.889182+0000","objects_scrubbed":0,"log_size":3218,"log_dups_size":0,"ondisk_log_size":3218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:00.016717+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47546,"num_write_kb":620007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"27'3720","reported_seq":3750,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:22.759329+0000","last_change":"2024-09-21T03:25:22.759329+0000","last_active":"2024-09-21T03:25:22.759329+0000","last_peered":"2024-09-21T03:25:22.759329+0000","last_clean":"2024-09-21T03:25:22.759329+0000","last_became_active":"2024-09-21T03:14:47.556615+0000","last_became_peered":"2024-09-21T03:14:47.556615+0000","last_unstale":"2024-09-21T03:25:22.759329+0000","last_undegraded":"2024-09-21T03:25:22.759329+0000","last_fullsized":"2024-09-21T03:25:22.759329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3720","last_scrub_stamp":"2024-09-21T03:25:22.759215+0000","last_deep_scrub":"27'3720","last_deep_scrub_stamp":"2024-09-21T03:25:22.759215+0000","last_clean_scrub_stamp":"2024-09-21T03:25:22.759215+0000","objects_scrubbed":0,"log_size":3720,"log_dups_size":0,"ondisk_log_size":3720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:36.248821+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54133,"num_write_kb":557757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"27'2798","reported_seq":2836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:56.730376+0000","last_change":"2024-09-21T03:24:56.730321+0000","last_active":"2024-09-21T03:24:56.730376+0000","last_peered":"2024-09-21T03:24:56.730376+0000","last_clean":"2024-09-21T03:24:56.730376+0000","last_became_active":"2024-09-21T03:14:38.483893+0000","last_became_peered":"2024-09-21T03:14:38.483893+0000","last_unstale":"2024-09-21T03:24:56.730376+0000","last_undegraded":"2024-09-21T03:24:56.730376+0000","last_fullsized":"2024-09-21T03:24:56.730376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2798","last_scrub_stamp":"2024-09-21T03:24:56.730241+0000","last_deep_scrub":"27'2798","last_deep_scrub_stamp":"2024-09-21T03:24:56.730241+0000","last_clean_scrub_stamp":"2024-09-21T03:24:56.730241+0000","objects_scrubbed":0,"log_size":2798,"log_dups_size":0,"ondisk_log_size":2798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:09.247648+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41301,"num_write_kb":515809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.21","version":"27'3224","reported_seq":3254,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:10.729957+0000","last_change":"2024-09-21T03:25:10.729883+0000","last_active":"2024-09-21T03:25:10.729957+0000","last_peered":"2024-09-21T03:25:10.729957+0000","last_clean":"2024-09-21T03:25:10.729957+0000","last_became_active":"2024-09-21T03:14:47.553144+0000","last_became_peered":"2024-09-21T03:14:47.553144+0000","last_unstale":"2024-09-21T03:25:10.729957+0000","last_undegraded":"2024-09-21T03:25:10.729957+0000","last_fullsized":"2024-09-21T03:25:10.729957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3224","last_scrub_stamp":"2024-09-21T03:25:10.729774+0000","last_deep_scrub":"27'3224","last_deep_scrub_stamp":"2024-09-21T03:25:10.729774+0000","last_clean_scrub_stamp":"2024-09-21T03:25:10.729774+0000","objects_scrubbed":0,"log_size":3224,"log_dups_size":0,"ondisk_log_size":3224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:22.461613+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46752,"num_write_kb":476180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'3507","reported_seq":3544,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:03.455993+0000","last_change":"2024-09-21T03:25:03.455993+0000","last_active":"2024-09-21T03:25:03.455993+0000","last_peered":"2024-09-21T03:25:03.455993+0000","last_clean":"2024-09-21T03:25:03.455993+0000","last_became_active":"2024-09-21T03:14:38.486204+0000","last_became_peered":"2024-09-21T03:14:38.486204+0000","last_unstale":"2024-09-21T03:25:03.455993+0000","last_undegraded":"2024-09-21T03:25:03.455993+0000","last_fullsized":"2024-09-21T03:25:03.455993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3507","last_scrub_stamp":"2024-09-21T03:25:03.455852+0000","last_deep_scrub":"27'3507","last_deep_scrub_stamp":"2024-09-21T03:25:03.455852+0000","last_clean_scrub_stamp":"2024-09-21T03:25:03.455852+0000","objects_scrubbed":0,"log_size":3507,"log_dups_size":0,"ondisk_log_size":3507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:19.386876+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51770,"num_write_kb":667306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"27'2354","reported_seq":2383,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:10.255588+0000","last_change":"2024-09-21T03:25:10.255588+0000","last_active":"2024-09-21T03:25:10.255588+0000","last_peered":"2024-09-21T03:25:10.255588+0000","last_clean":"2024-09-21T03:25:10.255588+0000","last_became_active":"2024-09-21T03:14:47.572717+0000","last_became_peered":"2024-09-21T03:14:47.572717+0000","last_unstale":"2024-09-21T03:25:10.255588+0000","last_undegraded":"2024-09-21T03:25:10.255588+0000","last_fullsized":"2024-09-21T03:25:10.255588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2354","last_scrub_stamp":"2024-09-21T03:25:10.255488+0000","last_deep_scrub":"27'2354","last_deep_scrub_stamp":"2024-09-21T03:25:10.255488+0000","last_clean_scrub_stamp":"2024-09-21T03:25:10.255488+0000","objects_scrubbed":0,"log_size":2354,"log_dups_size":0,"ondisk_log_size":2354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:59.844054+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33818,"num_write_kb":353403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"27'2611","reported_seq":2648,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.781862+0000","last_change":"2024-09-21T03:25:09.781862+0000","last_active":"2024-09-21T03:25:09.781862+0000","last_peered":"2024-09-21T03:25:09.781862+0000","last_clean":"2024-09-21T03:25:09.781862+0000","last_became_active":"2024-09-21T03:14:38.471625+0000","last_became_peered":"2024-09-21T03:14:38.471625+0000","last_unstale":"2024-09-21T03:25:09.781862+0000","last_undegraded":"2024-09-21T03:25:09.781862+0000","last_fullsized":"2024-09-21T03:25:09.781862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2611","last_scrub_stamp":"2024-09-21T03:25:09.781758+0000","last_deep_scrub":"27'2611","last_deep_scrub_stamp":"2024-09-21T03:25:09.781758+0000","last_clean_scrub_stamp":"2024-09-21T03:25:09.781758+0000","objects_scrubbed":0,"log_size":2611,"log_dups_size":0,"ondisk_log_size":2611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:45.660599+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38420,"num_write_kb":499975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2f","version":"27'3517","reported_seq":3546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:25.751054+0000","last_change":"2024-09-21T03:25:25.751054+0000","last_active":"2024-09-21T03:25:25.751054+0000","last_peered":"2024-09-21T03:25:25.751054+0000","last_clean":"2024-09-21T03:25:25.751054+0000","last_became_active":"2024-09-21T03:14:47.563816+0000","last_became_peered":"2024-09-21T03:14:47.563816+0000","last_unstale":"2024-09-21T03:25:25.751054+0000","last_undegraded":"2024-09-21T03:25:25.751054+0000","last_fullsized":"2024-09-21T03:25:25.751054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3517","last_scrub_stamp":"2024-09-21T03:25:25.750899+0000","last_deep_scrub":"27'3517","last_deep_scrub_stamp":"2024-09-21T03:25:25.750899+0000","last_clean_scrub_stamp":"2024-09-21T03:25:25.750899+0000","objects_scrubbed":0,"log_size":3517,"log_dups_size":0,"ondisk_log_size":3517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:51.950067+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50894,"num_write_kb":526303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'3043","reported_seq":3080,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.450492+0000","last_change":"2024-09-21T03:25:05.450492+0000","last_active":"2024-09-21T03:25:05.450492+0000","last_peered":"2024-09-21T03:25:05.450492+0000","last_clean":"2024-09-21T03:25:05.450492+0000","last_became_active":"2024-09-21T03:14:38.491510+0000","last_became_peered":"2024-09-21T03:14:38.491510+0000","last_unstale":"2024-09-21T03:25:05.450492+0000","last_undegraded":"2024-09-21T03:25:05.450492+0000","last_fullsized":"2024-09-21T03:25:05.450492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3043","last_scrub_stamp":"2024-09-21T03:25:05.450404+0000","last_deep_scrub":"27'3043","last_deep_scrub_stamp":"2024-09-21T03:25:05.450404+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.450404+0000","objects_scrubbed":0,"log_size":3043,"log_dups_size":0,"ondisk_log_size":3043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:05.540997+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44704,"num_write_kb":573613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2c","version":"27'2899","reported_seq":2928,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:14.791716+0000","last_change":"2024-09-21T03:25:14.791716+0000","last_active":"2024-09-21T03:25:14.791716+0000","last_peered":"2024-09-21T03:25:14.791716+0000","last_clean":"2024-09-21T03:25:14.791716+0000","last_became_active":"2024-09-21T03:14:47.564003+0000","last_became_peered":"2024-09-21T03:14:47.564003+0000","last_unstale":"2024-09-21T03:25:14.791716+0000","last_undegraded":"2024-09-21T03:25:14.791716+0000","last_fullsized":"2024-09-21T03:25:14.791716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2899","last_scrub_stamp":"2024-09-21T03:25:14.791608+0000","last_deep_scrub":"27'2899","last_deep_scrub_stamp":"2024-09-21T03:25:14.791608+0000","last_clean_scrub_stamp":"2024-09-21T03:25:14.791608+0000","objects_scrubbed":0,"log_size":2899,"log_dups_size":0,"ondisk_log_size":2899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:08.372287+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42050,"num_write_kb":436747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"27'3507","reported_seq":3544,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:56.604068+0000","last_change":"2024-09-21T03:24:56.604068+0000","last_active":"2024-09-21T03:24:56.604068+0000","last_peered":"2024-09-21T03:24:56.604068+0000","last_clean":"2024-09-21T03:24:56.604068+0000","last_became_active":"2024-09-21T03:14:38.470666+0000","last_became_peered":"2024-09-21T03:14:38.470666+0000","last_unstale":"2024-09-21T03:24:56.604068+0000","last_undegraded":"2024-09-21T03:24:56.604068+0000","last_fullsized":"2024-09-21T03:24:56.604068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3507","last_scrub_stamp":"2024-09-21T03:24:56.603974+0000","last_deep_scrub":"27'3507","last_deep_scrub_stamp":"2024-09-21T03:24:56.603974+0000","last_clean_scrub_stamp":"2024-09-21T03:24:56.603974+0000","objects_scrubbed":0,"log_size":3507,"log_dups_size":0,"ondisk_log_size":3507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:00.807277+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51813,"num_write_kb":639602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2d","version":"27'2979","reported_seq":3008,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.292278+0000","last_change":"2024-09-21T03:25:09.292278+0000","last_active":"2024-09-21T03:25:09.292278+0000","last_peered":"2024-09-21T03:25:09.292278+0000","last_clean":"2024-09-21T03:25:09.292278+0000","last_became_active":"2024-09-21T03:14:47.574895+0000","last_became_peered":"2024-09-21T03:14:47.574895+0000","last_unstale":"2024-09-21T03:25:09.292278+0000","last_undegraded":"2024-09-21T03:25:09.292278+0000","last_fullsized":"2024-09-21T03:25:09.292278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2979","last_scrub_stamp":"2024-09-21T03:25:09.292151+0000","last_deep_scrub":"27'2979","last_deep_scrub_stamp":"2024-09-21T03:25:09.292151+0000","last_clean_scrub_stamp":"2024-09-21T03:25:09.292151+0000","objects_scrubbed":0,"log_size":2979,"log_dups_size":0,"ondisk_log_size":2979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:51.462728+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43060,"num_write_kb":442689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"27'2924","reported_seq":2961,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:04.663220+0000","last_change":"2024-09-21T03:25:04.663220+0000","last_active":"2024-09-21T03:25:04.663220+0000","last_peered":"2024-09-21T03:25:04.663220+0000","last_clean":"2024-09-21T03:25:04.663220+0000","last_became_active":"2024-09-21T03:14:38.477816+0000","last_became_peered":"2024-09-21T03:14:38.477816+0000","last_unstale":"2024-09-21T03:25:04.663220+0000","last_undegraded":"2024-09-21T03:25:04.663220+0000","last_fullsized":"2024-09-21T03:25:04.663220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2924","last_scrub_stamp":"2024-09-21T03:25:04.663094+0000","last_deep_scrub":"27'2924","last_deep_scrub_stamp":"2024-09-21T03:25:04.663094+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.663094+0000","objects_scrubbed":0,"log_size":2924,"log_dups_size":0,"ondisk_log_size":2924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:30.900198+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42673,"num_write_kb":583298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"27'3308","reported_seq":3337,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:14.732034+0000","last_change":"2024-09-21T03:25:14.732034+0000","last_active":"2024-09-21T03:25:14.732034+0000","last_peered":"2024-09-21T03:25:14.732034+0000","last_clean":"2024-09-21T03:25:14.732034+0000","last_became_active":"2024-09-21T03:14:47.555033+0000","last_became_peered":"2024-09-21T03:14:47.555033+0000","last_unstale":"2024-09-21T03:25:14.732034+0000","last_undegraded":"2024-09-21T03:25:14.732034+0000","last_fullsized":"2024-09-21T03:25:14.732034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3308","last_scrub_stamp":"2024-09-21T03:25:14.731903+0000","last_deep_scrub":"27'3308","last_deep_scrub_stamp":"2024-09-21T03:25:14.731903+0000","last_clean_scrub_stamp":"2024-09-21T03:25:14.731903+0000","objects_scrubbed":0,"log_size":3308,"log_dups_size":0,"ondisk_log_size":3308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:21.440955+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48400,"num_write_kb":492898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"27'3018","reported_seq":3055,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:02.431446+0000","last_change":"2024-09-21T03:25:02.431446+0000","last_active":"2024-09-21T03:25:02.431446+0000","last_peered":"2024-09-21T03:25:02.431446+0000","last_clean":"2024-09-21T03:25:02.431446+0000","last_became_active":"2024-09-21T03:14:38.477739+0000","last_became_peered":"2024-09-21T03:14:38.477739+0000","last_unstale":"2024-09-21T03:25:02.431446+0000","last_undegraded":"2024-09-21T03:25:02.431446+0000","last_fullsized":"2024-09-21T03:25:02.431446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3018","last_scrub_stamp":"2024-09-21T03:25:02.431345+0000","last_deep_scrub":"27'3018","last_deep_scrub_stamp":"2024-09-21T03:25:02.431345+0000","last_clean_scrub_stamp":"2024-09-21T03:25:02.431345+0000","objects_scrubbed":0,"log_size":3018,"log_dups_size":0,"ondisk_log_size":3018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:07.844557+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44651,"num_write_kb":569943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"27'3055","reported_seq":3084,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:10.513015+0000","last_change":"2024-09-21T03:25:10.513015+0000","last_active":"2024-09-21T03:25:10.513015+0000","last_peered":"2024-09-21T03:25:10.513015+0000","last_clean":"2024-09-21T03:25:10.513015+0000","last_became_active":"2024-09-21T03:14:47.572756+0000","last_became_peered":"2024-09-21T03:14:47.572756+0000","last_unstale":"2024-09-21T03:25:10.513015+0000","last_undegraded":"2024-09-21T03:25:10.513015+0000","last_fullsized":"2024-09-21T03:25:10.513015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3055","last_scrub_stamp":"2024-09-21T03:25:10.512884+0000","last_deep_scrub":"27'3055","last_deep_scrub_stamp":"2024-09-21T03:25:10.512884+0000","last_clean_scrub_stamp":"2024-09-21T03:25:10.512884+0000","objects_scrubbed":0,"log_size":3055,"log_dups_size":0,"ondisk_log_size":3055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:07.864152+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44174,"num_write_kb":452226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'3124","reported_seq":3165,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:10.745108+0000","last_change":"2024-09-21T03:25:10.745108+0000","last_active":"2024-09-21T03:25:10.745108+0000","last_peered":"2024-09-21T03:25:10.745108+0000","last_clean":"2024-09-21T03:25:10.745108+0000","last_became_active":"2024-09-21T03:14:38.473843+0000","last_became_peered":"2024-09-21T03:14:38.473843+0000","last_unstale":"2024-09-21T03:25:10.745108+0000","last_undegraded":"2024-09-21T03:25:10.745108+0000","last_fullsized":"2024-09-21T03:25:10.745108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3124","last_scrub_stamp":"2024-09-21T03:25:10.745014+0000","last_deep_scrub":"27'3124","last_deep_scrub_stamp":"2024-09-21T03:25:10.745014+0000","last_clean_scrub_stamp":"2024-09-21T03:25:10.745014+0000","objects_scrubbed":0,"log_size":3124,"log_dups_size":0,"ondisk_log_size":3124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:05.856637+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46022,"num_write_kb":573473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.28","version":"27'2638","reported_seq":2667,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:12.722346+0000","last_change":"2024-09-21T03:25:12.722346+0000","last_active":"2024-09-21T03:25:12.722346+0000","last_peered":"2024-09-21T03:25:12.722346+0000","last_clean":"2024-09-21T03:25:12.722346+0000","last_became_active":"2024-09-21T03:14:47.554758+0000","last_became_peered":"2024-09-21T03:14:47.554758+0000","last_unstale":"2024-09-21T03:25:12.722346+0000","last_undegraded":"2024-09-21T03:25:12.722346+0000","last_fullsized":"2024-09-21T03:25:12.722346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2638","last_scrub_stamp":"2024-09-21T03:25:12.722219+0000","last_deep_scrub":"27'2638","last_deep_scrub_stamp":"2024-09-21T03:25:12.722219+0000","last_clean_scrub_stamp":"2024-09-21T03:25:12.722219+0000","objects_scrubbed":0,"log_size":2638,"log_dups_size":0,"ondisk_log_size":2638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:35.462927+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38196,"num_write_kb":393191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"27'2530","reported_seq":2567,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:00.281288+0000","last_change":"2024-09-21T03:25:00.281288+0000","last_active":"2024-09-21T03:25:00.281288+0000","last_peered":"2024-09-21T03:25:00.281288+0000","last_clean":"2024-09-21T03:25:00.281288+0000","last_became_active":"2024-09-21T03:14:38.492813+0000","last_became_peered":"2024-09-21T03:14:38.492813+0000","last_unstale":"2024-09-21T03:25:00.281288+0000","last_undegraded":"2024-09-21T03:25:00.281288+0000","last_fullsized":"2024-09-21T03:25:00.281288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2530","last_scrub_stamp":"2024-09-21T03:25:00.281167+0000","last_deep_scrub":"27'2530","last_deep_scrub_stamp":"2024-09-21T03:25:00.281167+0000","last_clean_scrub_stamp":"2024-09-21T03:25:00.281167+0000","objects_scrubbed":0,"log_size":2530,"log_dups_size":0,"ondisk_log_size":2530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:26.004120+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37062,"num_write_kb":456367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.29","version":"27'2967","reported_seq":2996,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:13.839367+0000","last_change":"2024-09-21T03:25:13.839367+0000","last_active":"2024-09-21T03:25:13.839367+0000","last_peered":"2024-09-21T03:25:13.839367+0000","last_clean":"2024-09-21T03:25:13.839367+0000","last_became_active":"2024-09-21T03:14:47.544431+0000","last_became_peered":"2024-09-21T03:14:47.544431+0000","last_unstale":"2024-09-21T03:25:13.839367+0000","last_undegraded":"2024-09-21T03:25:13.839367+0000","last_fullsized":"2024-09-21T03:25:13.839367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2967","last_scrub_stamp":"2024-09-21T03:25:13.839251+0000","last_deep_scrub":"27'2967","last_deep_scrub_stamp":"2024-09-21T03:25:13.839251+0000","last_clean_scrub_stamp":"2024-09-21T03:25:13.839251+0000","objects_scrubbed":0,"log_size":2967,"log_dups_size":0,"ondisk_log_size":2967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:50.378982+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43240,"num_write_kb":437209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2f","version":"27'3820","reported_seq":3857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:11.780973+0000","last_change":"2024-09-21T03:25:11.780973+0000","last_active":"2024-09-21T03:25:11.780973+0000","last_peered":"2024-09-21T03:25:11.780973+0000","last_clean":"2024-09-21T03:25:11.780973+0000","last_became_active":"2024-09-21T03:14:38.474156+0000","last_became_peered":"2024-09-21T03:14:38.474156+0000","last_unstale":"2024-09-21T03:25:11.780973+0000","last_undegraded":"2024-09-21T03:25:11.780973+0000","last_fullsized":"2024-09-21T03:25:11.780973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3820","last_scrub_stamp":"2024-09-21T03:25:11.780846+0000","last_deep_scrub":"27'3820","last_deep_scrub_stamp":"2024-09-21T03:25:11.780846+0000","last_clean_scrub_stamp":"2024-09-21T03:25:11.780846+0000","objects_scrubbed":0,"log_size":3820,"log_dups_size":0,"ondisk_log_size":3820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:09.849312+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56526,"num_write_kb":700246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.36","version":"27'3385","reported_seq":3414,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:18.724317+0000","last_change":"2024-09-21T03:25:18.724317+0000","last_active":"2024-09-21T03:25:18.724317+0000","last_peered":"2024-09-21T03:25:18.724317+0000","last_clean":"2024-09-21T03:25:18.724317+0000","last_became_active":"2024-09-21T03:14:47.562519+0000","last_became_peered":"2024-09-21T03:14:47.562519+0000","last_unstale":"2024-09-21T03:25:18.724317+0000","last_undegraded":"2024-09-21T03:25:18.724317+0000","last_fullsized":"2024-09-21T03:25:18.724317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3385","last_scrub_stamp":"2024-09-21T03:25:18.724208+0000","last_deep_scrub":"27'3385","last_deep_scrub_stamp":"2024-09-21T03:25:18.724208+0000","last_clean_scrub_stamp":"2024-09-21T03:25:18.724208+0000","objects_scrubbed":0,"log_size":3385,"log_dups_size":0,"ondisk_log_size":3385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:32.628446+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49240,"num_write_kb":516390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"27'2621","reported_seq":2658,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:12.826205+0000","last_change":"2024-09-21T03:25:12.826205+0000","last_active":"2024-09-21T03:25:12.826205+0000","last_peered":"2024-09-21T03:25:12.826205+0000","last_clean":"2024-09-21T03:25:12.826205+0000","last_became_active":"2024-09-21T03:14:38.473856+0000","last_became_peered":"2024-09-21T03:14:38.473856+0000","last_unstale":"2024-09-21T03:25:12.826205+0000","last_undegraded":"2024-09-21T03:25:12.826205+0000","last_fullsized":"2024-09-21T03:25:12.826205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2621","last_scrub_stamp":"2024-09-21T03:25:12.826100+0000","last_deep_scrub":"27'2621","last_deep_scrub_stamp":"2024-09-21T03:25:12.826100+0000","last_clean_scrub_stamp":"2024-09-21T03:25:12.826100+0000","objects_scrubbed":0,"log_size":2621,"log_dups_size":0,"ondisk_log_size":2621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:52.102331+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38668,"num_write_kb":516995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.37","version":"27'3697","reported_seq":3726,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:04.563251+0000","last_change":"2024-09-21T03:25:04.563251+0000","last_active":"2024-09-21T03:25:04.563251+0000","last_peered":"2024-09-21T03:25:04.563251+0000","last_clean":"2024-09-21T03:25:04.563251+0000","last_became_active":"2024-09-21T03:14:47.558403+0000","last_became_peered":"2024-09-21T03:14:47.558403+0000","last_unstale":"2024-09-21T03:25:04.563251+0000","last_undegraded":"2024-09-21T03:25:04.563251+0000","last_fullsized":"2024-09-21T03:25:04.563251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3697","last_scrub_stamp":"2024-09-21T03:25:04.563147+0000","last_deep_scrub":"27'3697","last_deep_scrub_stamp":"2024-09-21T03:25:04.563147+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.563147+0000","objects_scrubbed":0,"log_size":3697,"log_dups_size":0,"ondisk_log_size":3697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:45.910137+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53973,"num_write_kb":552799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"27'3262","reported_seq":3299,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.436068+0000","last_change":"2024-09-21T03:25:07.436068+0000","last_active":"2024-09-21T03:25:07.436068+0000","last_peered":"2024-09-21T03:25:07.436068+0000","last_clean":"2024-09-21T03:25:07.436068+0000","last_became_active":"2024-09-21T03:14:38.469240+0000","last_became_peered":"2024-09-21T03:14:38.469240+0000","last_unstale":"2024-09-21T03:25:07.436068+0000","last_undegraded":"2024-09-21T03:25:07.436068+0000","last_fullsized":"2024-09-21T03:25:07.436068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3262","last_scrub_stamp":"2024-09-21T03:25:07.435932+0000","last_deep_scrub":"27'3262","last_deep_scrub_stamp":"2024-09-21T03:25:07.435932+0000","last_clean_scrub_stamp":"2024-09-21T03:25:07.435932+0000","objects_scrubbed":0,"log_size":3262,"log_dups_size":0,"ondisk_log_size":3262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:31.079457+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48009,"num_write_kb":600153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.34","version":"27'2369","reported_seq":2398,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:01.479271+0000","last_change":"2024-09-21T03:25:01.479271+0000","last_active":"2024-09-21T03:25:01.479271+0000","last_peered":"2024-09-21T03:25:01.479271+0000","last_clean":"2024-09-21T03:25:01.479271+0000","last_became_active":"2024-09-21T03:14:47.550375+0000","last_became_peered":"2024-09-21T03:14:47.550375+0000","last_unstale":"2024-09-21T03:25:01.479271+0000","last_undegraded":"2024-09-21T03:25:01.479271+0000","last_fullsized":"2024-09-21T03:25:01.479271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2369","last_scrub_stamp":"2024-09-21T03:25:01.479179+0000","last_deep_scrub":"27'2369","last_deep_scrub_stamp":"2024-09-21T03:25:01.479179+0000","last_clean_scrub_stamp":"2024-09-21T03:25:01.479179+0000","objects_scrubbed":0,"log_size":2369,"log_dups_size":0,"ondisk_log_size":2369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:33:06.745584+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34335,"num_write_kb":360179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'3448","reported_seq":3485,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:02.850247+0000","last_change":"2024-09-21T03:25:02.850247+0000","last_active":"2024-09-21T03:25:02.850247+0000","last_peered":"2024-09-21T03:25:02.850247+0000","last_clean":"2024-09-21T03:25:02.850247+0000","last_became_active":"2024-09-21T03:14:38.487676+0000","last_became_peered":"2024-09-21T03:14:38.487676+0000","last_unstale":"2024-09-21T03:25:02.850247+0000","last_undegraded":"2024-09-21T03:25:02.850247+0000","last_fullsized":"2024-09-21T03:25:02.850247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3448","last_scrub_stamp":"2024-09-21T03:25:02.850139+0000","last_deep_scrub":"27'3448","last_deep_scrub_stamp":"2024-09-21T03:25:02.850139+0000","last_clean_scrub_stamp":"2024-09-21T03:25:02.850139+0000","objects_scrubbed":0,"log_size":3448,"log_dups_size":0,"ondisk_log_size":3448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:39.355086+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50832,"num_write_kb":624952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.35","version":"27'2810","reported_seq":2845,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:26.762877+0000","last_change":"2024-09-21T03:25:26.762877+0000","last_active":"2024-09-21T03:25:26.762877+0000","last_peered":"2024-09-21T03:25:26.762877+0000","last_clean":"2024-09-21T03:25:26.762877+0000","last_became_active":"2024-09-21T03:14:47.561229+0000","last_became_peered":"2024-09-21T03:14:47.561229+0000","last_unstale":"2024-09-21T03:25:26.762877+0000","last_undegraded":"2024-09-21T03:25:26.762877+0000","last_fullsized":"2024-09-21T03:25:26.762877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2810","last_scrub_stamp":"2024-09-21T03:25:26.762758+0000","last_deep_scrub":"27'2810","last_deep_scrub_stamp":"2024-09-21T03:25:26.762758+0000","last_clean_scrub_stamp":"2024-09-21T03:25:26.762758+0000","objects_scrubbed":0,"log_size":2810,"log_dups_size":0,"ondisk_log_size":2810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:55.902956+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40720,"num_write_kb":419729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.33","version":"27'2665","reported_seq":2702,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:03.805838+0000","last_change":"2024-09-21T03:25:03.805838+0000","last_active":"2024-09-21T03:25:03.805838+0000","last_peered":"2024-09-21T03:25:03.805838+0000","last_clean":"2024-09-21T03:25:03.805838+0000","last_became_active":"2024-09-21T03:14:38.478502+0000","last_became_peered":"2024-09-21T03:14:38.478502+0000","last_unstale":"2024-09-21T03:25:03.805838+0000","last_undegraded":"2024-09-21T03:25:03.805838+0000","last_fullsized":"2024-09-21T03:25:03.805838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2665","last_scrub_stamp":"2024-09-21T03:25:03.805748+0000","last_deep_scrub":"27'2665","last_deep_scrub_stamp":"2024-09-21T03:25:03.805748+0000","last_clean_scrub_stamp":"2024-09-21T03:25:03.805748+0000","objects_scrubbed":0,"log_size":2665,"log_dups_size":0,"ondisk_log_size":2665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:36.641806+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39018,"num_write_kb":519966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"27'3118","reported_seq":3141,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:27.812477+0000","last_change":"2024-09-21T03:25:27.812477+0000","last_active":"2024-09-21T03:25:27.812477+0000","last_peered":"2024-09-21T03:25:27.812477+0000","last_clean":"2024-09-21T03:25:27.812477+0000","last_became_active":"2024-09-21T03:15:15.686514+0000","last_became_peered":"2024-09-21T03:15:15.686514+0000","last_unstale":"2024-09-21T03:25:27.812477+0000","last_undegraded":"2024-09-21T03:25:27.812477+0000","last_fullsized":"2024-09-21T03:25:27.812477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3118","last_scrub_stamp":"2024-09-21T03:25:27.812339+0000","last_deep_scrub":"27'3118","last_deep_scrub_stamp":"2024-09-21T03:25:27.812339+0000","last_clean_scrub_stamp":"2024-09-21T03:25:27.812339+0000","objects_scrubbed":0,"log_size":3118,"log_dups_size":0,"ondisk_log_size":3118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:32.203988+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45367,"num_write_kb":462728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'2758","reported_seq":2795,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:03.437074+0000","last_change":"2024-09-21T03:25:03.437074+0000","last_active":"2024-09-21T03:25:03.437074+0000","last_peered":"2024-09-21T03:25:03.437074+0000","last_clean":"2024-09-21T03:25:03.437074+0000","last_became_active":"2024-09-21T03:14:38.480923+0000","last_became_peered":"2024-09-21T03:14:38.480923+0000","last_unstale":"2024-09-21T03:25:03.437074+0000","last_undegraded":"2024-09-21T03:25:03.437074+0000","last_fullsized":"2024-09-21T03:25:03.437074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2758","last_scrub_stamp":"2024-09-21T03:25:03.436948+0000","last_deep_scrub":"27'2758","last_deep_scrub_stamp":"2024-09-21T03:25:03.436948+0000","last_clean_scrub_stamp":"2024-09-21T03:25:03.436948+0000","objects_scrubbed":0,"log_size":2758,"log_dups_size":0,"ondisk_log_size":2758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:48.067323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40836,"num_write_kb":498819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.33","version":"27'2757","reported_seq":2786,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:15.841183+0000","last_change":"2024-09-21T03:25:15.841183+0000","last_active":"2024-09-21T03:25:15.841183+0000","last_peered":"2024-09-21T03:25:15.841183+0000","last_clean":"2024-09-21T03:25:15.841183+0000","last_became_active":"2024-09-21T03:14:47.561645+0000","last_became_peered":"2024-09-21T03:14:47.561645+0000","last_unstale":"2024-09-21T03:25:15.841183+0000","last_undegraded":"2024-09-21T03:25:15.841183+0000","last_fullsized":"2024-09-21T03:25:15.841183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2757","last_scrub_stamp":"2024-09-21T03:25:15.841036+0000","last_deep_scrub":"27'2757","last_deep_scrub_stamp":"2024-09-21T03:25:15.841036+0000","last_clean_scrub_stamp":"2024-09-21T03:25:15.841036+0000","objects_scrubbed":0,"log_size":2757,"log_dups_size":0,"ondisk_log_size":2757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:47.670215+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40136,"num_write_kb":410250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"27'2791","reported_seq":2828,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:59.329137+0000","last_change":"2024-09-21T03:24:59.329137+0000","last_active":"2024-09-21T03:24:59.329137+0000","last_peered":"2024-09-21T03:24:59.329137+0000","last_clean":"2024-09-21T03:24:59.329137+0000","last_became_active":"2024-09-21T03:14:38.473579+0000","last_became_peered":"2024-09-21T03:14:38.473579+0000","last_unstale":"2024-09-21T03:24:59.329137+0000","last_undegraded":"2024-09-21T03:24:59.329137+0000","last_fullsized":"2024-09-21T03:24:59.329137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2791","last_scrub_stamp":"2024-09-21T03:24:59.329022+0000","last_deep_scrub":"27'2791","last_deep_scrub_stamp":"2024-09-21T03:24:59.329022+0000","last_clean_scrub_stamp":"2024-09-21T03:24:59.329022+0000","objects_scrubbed":0,"log_size":2791,"log_dups_size":0,"ondisk_log_size":2791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:58.789696+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41232,"num_write_kb":540257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"27'2621","reported_seq":2650,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:12.588441+0000","last_change":"2024-09-21T03:25:12.588441+0000","last_active":"2024-09-21T03:25:12.588441+0000","last_peered":"2024-09-21T03:25:12.588441+0000","last_clean":"2024-09-21T03:25:12.588441+0000","last_became_active":"2024-09-21T03:14:47.565681+0000","last_became_peered":"2024-09-21T03:14:47.565681+0000","last_unstale":"2024-09-21T03:25:12.588441+0000","last_undegraded":"2024-09-21T03:25:12.588441+0000","last_fullsized":"2024-09-21T03:25:12.588441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2621","last_scrub_stamp":"2024-09-21T03:25:12.588338+0000","last_deep_scrub":"27'2621","last_deep_scrub_stamp":"2024-09-21T03:25:12.588338+0000","last_clean_scrub_stamp":"2024-09-21T03:25:12.588338+0000","objects_scrubbed":0,"log_size":2621,"log_dups_size":0,"ondisk_log_size":2621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:13.798050+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37892,"num_write_kb":397863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'3465","reported_seq":3502,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:01.427195+0000","last_change":"2024-09-21T03:25:01.427195+0000","last_active":"2024-09-21T03:25:01.427195+0000","last_peered":"2024-09-21T03:25:01.427195+0000","last_clean":"2024-09-21T03:25:01.427195+0000","last_became_active":"2024-09-21T03:14:38.470430+0000","last_became_peered":"2024-09-21T03:14:38.470430+0000","last_unstale":"2024-09-21T03:25:01.427195+0000","last_undegraded":"2024-09-21T03:25:01.427195+0000","last_fullsized":"2024-09-21T03:25:01.427195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3465","last_scrub_stamp":"2024-09-21T03:25:01.426921+0000","last_deep_scrub":"27'3465","last_deep_scrub_stamp":"2024-09-21T03:25:01.426921+0000","last_clean_scrub_stamp":"2024-09-21T03:25:01.426921+0000","objects_scrubbed":0,"log_size":3465,"log_dups_size":0,"ondisk_log_size":3465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:08.804731+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51200,"num_write_kb":673726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"27'2995","reported_seq":3024,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:13.556916+0000","last_change":"2024-09-21T03:25:13.556916+0000","last_active":"2024-09-21T03:25:13.556916+0000","last_peered":"2024-09-21T03:25:13.556916+0000","last_clean":"2024-09-21T03:25:13.556916+0000","last_became_active":"2024-09-21T03:14:47.571126+0000","last_became_peered":"2024-09-21T03:14:47.571126+0000","last_unstale":"2024-09-21T03:25:13.556916+0000","last_undegraded":"2024-09-21T03:25:13.556916+0000","last_fullsized":"2024-09-21T03:25:13.556916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2995","last_scrub_stamp":"2024-09-21T03:25:13.556807+0000","last_deep_scrub":"27'2995","last_deep_scrub_stamp":"2024-09-21T03:25:13.556807+0000","last_clean_scrub_stamp":"2024-09-21T03:25:13.556807+0000","objects_scrubbed":0,"log_size":2995,"log_dups_size":0,"ondisk_log_size":2995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:29.430518+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43649,"num_write_kb":455041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'4015","reported_seq":4052,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:57.579909+0000","last_change":"2024-09-21T03:24:57.579909+0000","last_active":"2024-09-21T03:24:57.579909+0000","last_peered":"2024-09-21T03:24:57.579909+0000","last_clean":"2024-09-21T03:24:57.579909+0000","last_became_active":"2024-09-21T03:14:38.483019+0000","last_became_peered":"2024-09-21T03:14:38.483019+0000","last_unstale":"2024-09-21T03:24:57.579909+0000","last_undegraded":"2024-09-21T03:24:57.579909+0000","last_fullsized":"2024-09-21T03:24:57.579909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4015","last_scrub_stamp":"2024-09-21T03:24:57.579800+0000","last_deep_scrub":"27'4015","last_deep_scrub_stamp":"2024-09-21T03:24:57.579800+0000","last_clean_scrub_stamp":"2024-09-21T03:24:57.579800+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:39.078319+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59359,"num_write_kb":743455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3e","version":"27'3951","reported_seq":3981,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:19.207488+0000","last_change":"2024-09-21T03:25:19.207488+0000","last_active":"2024-09-21T03:25:19.207488+0000","last_peered":"2024-09-21T03:25:19.207488+0000","last_clean":"2024-09-21T03:25:19.207488+0000","last_became_active":"2024-09-21T03:14:47.555465+0000","last_became_peered":"2024-09-21T03:14:47.555465+0000","last_unstale":"2024-09-21T03:25:19.207488+0000","last_undegraded":"2024-09-21T03:25:19.207488+0000","last_fullsized":"2024-09-21T03:25:19.207488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3951","last_scrub_stamp":"2024-09-21T03:25:19.207373+0000","last_deep_scrub":"27'3951","last_deep_scrub_stamp":"2024-09-21T03:25:19.207373+0000","last_clean_scrub_stamp":"2024-09-21T03:25:19.207373+0000","objects_scrubbed":0,"log_size":3951,"log_dups_size":0,"ondisk_log_size":3951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:46:54.727726+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57951,"num_write_kb":584164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"27'3369","reported_seq":3406,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.483009+0000","last_change":"2024-09-21T03:25:06.483009+0000","last_active":"2024-09-21T03:25:06.483009+0000","last_peered":"2024-09-21T03:25:06.483009+0000","last_clean":"2024-09-21T03:25:06.483009+0000","last_became_active":"2024-09-21T03:14:38.465479+0000","last_became_peered":"2024-09-21T03:14:38.465479+0000","last_unstale":"2024-09-21T03:25:06.483009+0000","last_undegraded":"2024-09-21T03:25:06.483009+0000","last_fullsized":"2024-09-21T03:25:06.483009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3369","last_scrub_stamp":"2024-09-21T03:25:06.482906+0000","last_deep_scrub":"27'3369","last_deep_scrub_stamp":"2024-09-21T03:25:06.482906+0000","last_clean_scrub_stamp":"2024-09-21T03:25:06.482906+0000","objects_scrubbed":0,"log_size":3369,"log_dups_size":0,"ondisk_log_size":3369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:35.528096+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50038,"num_write_kb":621750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3f","version":"27'2525","reported_seq":2555,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:16.770856+0000","last_change":"2024-09-21T03:25:16.770799+0000","last_active":"2024-09-21T03:25:16.770856+0000","last_peered":"2024-09-21T03:25:16.770856+0000","last_clean":"2024-09-21T03:25:16.770856+0000","last_became_active":"2024-09-21T03:14:47.566936+0000","last_became_peered":"2024-09-21T03:14:47.566936+0000","last_unstale":"2024-09-21T03:25:16.770856+0000","last_undegraded":"2024-09-21T03:25:16.770856+0000","last_fullsized":"2024-09-21T03:25:16.770856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2525","last_scrub_stamp":"2024-09-21T03:25:16.770717+0000","last_deep_scrub":"27'2525","last_deep_scrub_stamp":"2024-09-21T03:25:16.770717+0000","last_clean_scrub_stamp":"2024-09-21T03:25:16.770717+0000","objects_scrubbed":0,"log_size":2525,"log_dups_size":0,"ondisk_log_size":2525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:01.276013+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36538,"num_write_kb":381931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"27'2958","reported_seq":2981,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:01.256000+0000","last_change":"2024-09-21T03:25:01.255928+0000","last_active":"2024-09-21T03:25:01.256000+0000","last_peered":"2024-09-21T03:25:01.256000+0000","last_clean":"2024-09-21T03:25:01.256000+0000","last_became_active":"2024-09-21T03:15:15.806775+0000","last_became_peered":"2024-09-21T03:15:15.806775+0000","last_unstale":"2024-09-21T03:25:01.256000+0000","last_undegraded":"2024-09-21T03:25:01.256000+0000","last_fullsized":"2024-09-21T03:25:01.256000+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2958","last_scrub_stamp":"2024-09-21T03:25:01.255834+0000","last_deep_scrub":"27'2958","last_deep_scrub_stamp":"2024-09-21T03:25:01.255834+0000","last_clean_scrub_stamp":"2024-09-21T03:25:01.255834+0000","objects_scrubbed":0,"log_size":2958,"log_dups_size":0,"ondisk_log_size":2958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:00.119549+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43828,"num_write_kb":561683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"27'2681","reported_seq":2711,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:19.759070+0000","last_change":"2024-09-21T03:25:19.759070+0000","last_active":"2024-09-21T03:25:19.759070+0000","last_peered":"2024-09-21T03:25:19.759070+0000","last_clean":"2024-09-21T03:25:19.759070+0000","last_became_active":"2024-09-21T03:14:47.576499+0000","last_became_peered":"2024-09-21T03:14:47.576499+0000","last_unstale":"2024-09-21T03:25:19.759070+0000","last_undegraded":"2024-09-21T03:25:19.759070+0000","last_fullsized":"2024-09-21T03:25:19.759070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2681","last_scrub_stamp":"2024-09-21T03:25:19.758970+0000","last_deep_scrub":"27'2681","last_deep_scrub_stamp":"2024-09-21T03:25:19.758970+0000","last_clean_scrub_stamp":"2024-09-21T03:25:19.758970+0000","objects_scrubbed":0,"log_size":2681,"log_dups_size":0,"ondisk_log_size":2681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:50.709416+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39028,"num_write_kb":398421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2546","reported_seq":2585,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:57.732333+0000","last_change":"2024-09-21T03:24:57.732333+0000","last_active":"2024-09-21T03:24:57.732333+0000","last_peered":"2024-09-21T03:24:57.732333+0000","last_clean":"2024-09-21T03:24:57.732333+0000","last_became_active":"2024-09-21T03:14:38.470708+0000","last_became_peered":"2024-09-21T03:14:38.470708+0000","last_unstale":"2024-09-21T03:24:57.732333+0000","last_undegraded":"2024-09-21T03:24:57.732333+0000","last_fullsized":"2024-09-21T03:24:57.732333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2546","last_scrub_stamp":"2024-09-21T03:24:57.732250+0000","last_deep_scrub":"27'2546","last_deep_scrub_stamp":"2024-09-21T03:24:57.732250+0000","last_clean_scrub_stamp":"2024-09-21T03:24:57.732250+0000","objects_scrubbed":0,"log_size":2546,"log_dups_size":0,"ondisk_log_size":2546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:06.929563+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37433,"num_write_kb":500133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3d","version":"27'3017","reported_seq":3047,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.565306+0000","last_change":"2024-09-21T03:25:05.565240+0000","last_active":"2024-09-21T03:25:05.565306+0000","last_peered":"2024-09-21T03:25:05.565306+0000","last_clean":"2024-09-21T03:25:05.565306+0000","last_became_active":"2024-09-21T03:14:47.552808+0000","last_became_peered":"2024-09-21T03:14:47.552808+0000","last_unstale":"2024-09-21T03:25:05.565306+0000","last_undegraded":"2024-09-21T03:25:05.565306+0000","last_fullsized":"2024-09-21T03:25:05.565306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3017","last_scrub_stamp":"2024-09-21T03:25:05.565160+0000","last_deep_scrub":"27'3017","last_deep_scrub_stamp":"2024-09-21T03:25:05.565160+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.565160+0000","objects_scrubbed":0,"log_size":3017,"log_dups_size":0,"ondisk_log_size":3017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:08.203176+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43808,"num_write_kb":448579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"27'3592","reported_seq":3629,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:04.451823+0000","last_change":"2024-09-21T03:25:04.451823+0000","last_active":"2024-09-21T03:25:04.451823+0000","last_peered":"2024-09-21T03:25:04.451823+0000","last_clean":"2024-09-21T03:25:04.451823+0000","last_became_active":"2024-09-21T03:14:38.465818+0000","last_became_peered":"2024-09-21T03:14:38.465818+0000","last_unstale":"2024-09-21T03:25:04.451823+0000","last_undegraded":"2024-09-21T03:25:04.451823+0000","last_fullsized":"2024-09-21T03:25:04.451823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3592","last_scrub_stamp":"2024-09-21T03:25:04.451721+0000","last_deep_scrub":"27'3592","last_deep_scrub_stamp":"2024-09-21T03:25:04.451721+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.451721+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:35.358061+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52996,"num_write_kb":671880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"27'2563","reported_seq":2592,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:11.289790+0000","last_change":"2024-09-21T03:25:11.289790+0000","last_active":"2024-09-21T03:25:11.289790+0000","last_peered":"2024-09-21T03:25:11.289790+0000","last_clean":"2024-09-21T03:25:11.289790+0000","last_became_active":"2024-09-21T03:14:47.576843+0000","last_became_peered":"2024-09-21T03:14:47.576843+0000","last_unstale":"2024-09-21T03:25:11.289790+0000","last_undegraded":"2024-09-21T03:25:11.289790+0000","last_fullsized":"2024-09-21T03:25:11.289790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2563","last_scrub_stamp":"2024-09-21T03:25:11.289634+0000","last_deep_scrub":"27'2563","last_deep_scrub_stamp":"2024-09-21T03:25:11.289634+0000","last_clean_scrub_stamp":"2024-09-21T03:25:11.289634+0000","objects_scrubbed":0,"log_size":2563,"log_dups_size":0,"ondisk_log_size":2563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:48.123663+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37386,"num_write_kb":384305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'2860","reported_seq":2898,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:24:58.694372+0000","last_change":"2024-09-21T03:24:58.694372+0000","last_active":"2024-09-21T03:24:58.694372+0000","last_peered":"2024-09-21T03:24:58.694372+0000","last_clean":"2024-09-21T03:24:58.694372+0000","last_became_active":"2024-09-21T03:14:38.470907+0000","last_became_peered":"2024-09-21T03:14:38.470907+0000","last_unstale":"2024-09-21T03:24:58.694372+0000","last_undegraded":"2024-09-21T03:24:58.694372+0000","last_fullsized":"2024-09-21T03:24:58.694372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2860","last_scrub_stamp":"2024-09-21T03:24:58.694251+0000","last_deep_scrub":"27'2860","last_deep_scrub_stamp":"2024-09-21T03:24:58.694251+0000","last_clean_scrub_stamp":"2024-09-21T03:24:58.694251+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:39.244244+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42241,"num_write_kb":536469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3b","version":"27'3455","reported_seq":3484,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:18.155369+0000","last_change":"2024-09-21T03:25:18.155369+0000","last_active":"2024-09-21T03:25:18.155369+0000","last_peered":"2024-09-21T03:25:18.155369+0000","last_clean":"2024-09-21T03:25:18.155369+0000","last_became_active":"2024-09-21T03:14:47.551420+0000","last_became_peered":"2024-09-21T03:14:47.551420+0000","last_unstale":"2024-09-21T03:25:18.155369+0000","last_undegraded":"2024-09-21T03:25:18.155369+0000","last_fullsized":"2024-09-21T03:25:18.155369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3455","last_scrub_stamp":"2024-09-21T03:25:18.155219+0000","last_deep_scrub":"27'3455","last_deep_scrub_stamp":"2024-09-21T03:25:18.155219+0000","last_clean_scrub_stamp":"2024-09-21T03:25:18.155219+0000","objects_scrubbed":0,"log_size":3455,"log_dups_size":0,"ondisk_log_size":3455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:17.587311+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50161,"num_write_kb":520876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'3215","reported_seq":3255,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.416550+0000","last_change":"2024-09-21T03:25:09.416476+0000","last_active":"2024-09-21T03:25:09.416550+0000","last_peered":"2024-09-21T03:25:09.416550+0000","last_clean":"2024-09-21T03:25:09.416550+0000","last_became_active":"2024-09-21T03:14:38.482306+0000","last_became_peered":"2024-09-21T03:14:38.482306+0000","last_unstale":"2024-09-21T03:25:09.416550+0000","last_undegraded":"2024-09-21T03:25:09.416550+0000","last_fullsized":"2024-09-21T03:25:09.416550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3215","last_scrub_stamp":"2024-09-21T03:25:09.416335+0000","last_deep_scrub":"27'3215","last_deep_scrub_stamp":"2024-09-21T03:25:09.416335+0000","last_clean_scrub_stamp":"2024-09-21T03:25:09.416335+0000","objects_scrubbed":0,"log_size":3215,"log_dups_size":0,"ondisk_log_size":3215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:52.859932+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47543,"num_write_kb":599147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.38","version":"27'3010","reported_seq":3039,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:13.743086+0000","last_change":"2024-09-21T03:25:13.743086+0000","last_active":"2024-09-21T03:25:13.743086+0000","last_peered":"2024-09-21T03:25:13.743086+0000","last_clean":"2024-09-21T03:25:13.743086+0000","last_became_active":"2024-09-21T03:14:47.554363+0000","last_became_peered":"2024-09-21T03:14:47.554363+0000","last_unstale":"2024-09-21T03:25:13.743086+0000","last_undegraded":"2024-09-21T03:25:13.743086+0000","last_fullsized":"2024-09-21T03:25:13.743086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3010","last_scrub_stamp":"2024-09-21T03:25:13.742994+0000","last_deep_scrub":"27'3010","last_deep_scrub_stamp":"2024-09-21T03:25:13.742994+0000","last_clean_scrub_stamp":"2024-09-21T03:25:13.742994+0000","objects_scrubbed":0,"log_size":3010,"log_dups_size":0,"ondisk_log_size":3010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:05.769807+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43824,"num_write_kb":461158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"27'3736","reported_seq":3774,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:08.394652+0000","last_change":"2024-09-21T03:25:08.394579+0000","last_active":"2024-09-21T03:25:08.394652+0000","last_peered":"2024-09-21T03:25:08.394652+0000","last_clean":"2024-09-21T03:25:08.394652+0000","last_became_active":"2024-09-21T03:14:38.488537+0000","last_became_peered":"2024-09-21T03:14:38.488537+0000","last_unstale":"2024-09-21T03:25:08.394652+0000","last_undegraded":"2024-09-21T03:25:08.394652+0000","last_fullsized":"2024-09-21T03:25:08.394652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3736","last_scrub_stamp":"2024-09-21T03:25:08.394438+0000","last_deep_scrub":"27'3736","last_deep_scrub_stamp":"2024-09-21T03:25:08.394438+0000","last_clean_scrub_stamp":"2024-09-21T03:25:08.394438+0000","objects_scrubbed":0,"log_size":3736,"log_dups_size":0,"ondisk_log_size":3736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:06.352296+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55343,"num_write_kb":720948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"27'2851","reported_seq":2880,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:15.764676+0000","last_change":"2024-09-21T03:25:15.764676+0000","last_active":"2024-09-21T03:25:15.764676+0000","last_peered":"2024-09-21T03:25:15.764676+0000","last_clean":"2024-09-21T03:25:15.764676+0000","last_became_active":"2024-09-21T03:14:47.563745+0000","last_became_peered":"2024-09-21T03:14:47.563745+0000","last_unstale":"2024-09-21T03:25:15.764676+0000","last_undegraded":"2024-09-21T03:25:15.764676+0000","last_fullsized":"2024-09-21T03:25:15.764676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2851","last_scrub_stamp":"2024-09-21T03:25:15.764578+0000","last_deep_scrub":"27'2851","last_deep_scrub_stamp":"2024-09-21T03:25:15.764578+0000","last_clean_scrub_stamp":"2024-09-21T03:25:15.764578+0000","objects_scrubbed":0,"log_size":2851,"log_dups_size":0,"ondisk_log_size":2851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:37.450737+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41602,"num_write_kb":429183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"27'2879","reported_seq":2917,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.411629+0000","last_change":"2024-09-21T03:25:06.411578+0000","last_active":"2024-09-21T03:25:06.411629+0000","last_peered":"2024-09-21T03:25:06.411629+0000","last_clean":"2024-09-21T03:25:06.411629+0000","last_became_active":"2024-09-21T03:14:38.489167+0000","last_became_peered":"2024-09-21T03:14:38.489167+0000","last_unstale":"2024-09-21T03:25:06.411629+0000","last_undegraded":"2024-09-21T03:25:06.411629+0000","last_fullsized":"2024-09-21T03:25:06.411629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2879","last_scrub_stamp":"2024-09-21T03:25:06.411489+0000","last_deep_scrub":"27'2879","last_deep_scrub_stamp":"2024-09-21T03:25:06.411489+0000","last_clean_scrub_stamp":"2024-09-21T03:25:06.411489+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:58.996378+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42623,"num_write_kb":515303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2771405,"num_write_kb":28539810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190768,"ondisk_log_size":190768,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":104689166,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":31,"num_read_kb":107,"num_write":3090,"num_write_kb":104327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":209436672,"data_stored":209378332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2798,"ondisk_log_size":2798,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2958225,"num_write_kb":37437445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200348,"ondisk_log_size":200348,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":158268058,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":29,"num_read_kb":105,"num_write":2795,"num_write_kb":156529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":316596224,"data_stored":316536116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2640,"ondisk_log_size":2640,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509576,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379144,"kb_used_data":41336,"kb_used_omap":1,"kb_used_meta":337790,"kb_avail":93992696,"statfs":{"total":96636764160,"available":96248520704,"internally_reserved":0,"allocated":42328064,"data_stored":42145705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":345897418},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509571,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":538640,"kb_used_data":66240,"kb_used_omap":1,"kb_used_meta":472382,"kb_avail":93833200,"statfs":{"total":96636764160,"available":96085196800,"internally_reserved":0,"allocated":67829760,"data_stored":67644340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":483719621},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509570,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":562860,"kb_used_data":84892,"kb_used_omap":1,"kb_used_meta":477950,"kb_avail":93808980,"statfs":{"total":96636764160,"available":96060395520,"internally_reserved":0,"allocated":86929408,"data_stored":86733732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":489421253},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509571,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":616200,"kb_used_data":61816,"kb_used_omap":1,"kb_used_meta":554366,"kb_avail":93755640,"statfs":{"total":96636764160,"available":96005775360,"internally_reserved":0,"allocated":63299584,"data_stored":63117886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":567671237},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509574,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":468272,"kb_used_data":54112,"kb_used_omap":1,"kb_used_meta":414142,"kb_avail":93903568,"statfs":{"total":96636764160,"available":96157253632,"internally_reserved":0,"allocated":55410688,"data_stored":55230899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":424081861},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509572,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":575792,"kb_used_data":61728,"kb_used_omap":1,"kb_used_meta":514046,"kb_avail":93796048,"statfs":{"total":96636764160,"available":96047153152,"internally_reserved":0,"allocated":63209472,"data_stored":63029145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":526383557},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542277,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":477548,"kb_used_data":45340,"kb_used_omap":1,"kb_used_meta":432190,"kb_avail":93894292,"statfs":{"total":96636764160,"available":96147755008,"internally_reserved":0,"allocated":46428160,"data_stored":46252455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":442563014},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542275,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":587960,"kb_used_data":101608,"kb_used_omap":1,"kb_used_meta":486334,"kb_avail":93783880,"statfs":{"total":96636764160,"available":96034693120,"internally_reserved":0,"allocated":104046592,"data_stored":103856534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":498006471},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":62922752,"data_stored":62914616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33558528,"data_stored":33554502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65908736,"data_stored":65904402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":44949504,"data_stored":44933644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":37847040,"data_stored":37836908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25264128,"data_stored":25254028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37842944,"data_stored":37836951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37855232,"data_stored":37837693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":41697280,"data_stored":41685649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29106176,"data_stored":29102625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":25174016,"data_stored":25166496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:25:36.812 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-21T03:25:37.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.058+0000 7f6c8d200640 1 -- 172.21.15.90:0/3517587805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c6c004d40 msgr2=0x7f6c6c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.058+0000 7f6c8d200640 1 --2- 172.21.15.90:0/3517587805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c6c004d40 0x7f6c6c005150 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6c80005fd0 tx=0x7f6c6c005830 comp rx=0 tx=0).stop 2024-09-21T03:25:37.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.058+0000 7f6c86800640 1 -- 172.21.15.90:0/3517587805 reap_dead start 2024-09-21T03:25:37.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.058+0000 7f6c8d200640 1 -- 172.21.15.90:0/3517587805 shutdown_connections 2024-09-21T03:25:37.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.058+0000 7f6c8d200640 1 -- 172.21.15.90:0/3517587805 >> 172.21.15.90:0/3517587805 conn(0x7f6c880c85a0 msgr2=0x7f6c880c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:37.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.058+0000 7f6c8d200640 1 -- 172.21.15.90:0/3517587805 shutdown_connections 2024-09-21T03:25:37.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.058+0000 7f6c8d200640 1 -- 172.21.15.90:0/3517587805 wait complete. 2024-09-21T03:25:37.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.060+0000 7f6c8d200640 1 Processor -- start 2024-09-21T03:25:37.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.060+0000 7f6c8d200640 1 -- start start 2024-09-21T03:25:37.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.062+0000 7f6c8d200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c6c004d40 0x7f6c88147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:37.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.062+0000 7f6c8d200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c88146800 0x7f6c881478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:37.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.062+0000 7f6c8d200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c8814c5e0 0x7f6c88149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:37.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.062+0000 7f6c8d200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6c88073080 con 0x7f6c88146800 2024-09-21T03:25:37.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.062+0000 7f6c8d200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6c880adf50 con 0x7f6c8814c5e0 2024-09-21T03:25:37.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.062+0000 7f6c8d200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6c8814cdc0 con 0x7f6c6c004d40 2024-09-21T03:25:37.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.062+0000 7f6c7fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c88146800 0x7f6c881478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:37.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.062+0000 7f6c7fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c88146800 0x7f6c881478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35814/0 (socket says 172.21.15.90:35814) 2024-09-21T03:25:37.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.062+0000 7f6c7fe00640 1 -- 172.21.15.90:0/2652430226 learned_addr learned my addr 172.21.15.90:0/2652430226 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:25:37.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.062+0000 7f6c85e00640 1 --2- 172.21.15.90:0/2652430226 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c6c004d40 0x7f6c88147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:37.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.062+0000 7f6c7fe00640 1 -- 172.21.15.90:0/2652430226 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c6c004d40 msgr2=0x7f6c88147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.062+0000 7f6c86800640 1 --2- 172.21.15.90:0/2652430226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c8814c5e0 0x7f6c88149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:37.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.062+0000 7f6c7fe00640 1 --2- 172.21.15.90:0/2652430226 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c6c004d40 0x7f6c88147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.063+0000 7f6c7fe00640 1 -- 172.21.15.90:0/2652430226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c8814c5e0 msgr2=0x7f6c88149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.063+0000 7f6c7fe00640 1 --2- 172.21.15.90:0/2652430226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c8814c5e0 0x7f6c88149e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.063+0000 7f6c7fe00640 1 -- 172.21.15.90:0/2652430226 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c88151a50 con 0x7f6c88146800 2024-09-21T03:25:37.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.063+0000 7f6c85e00640 1 --2- 172.21.15.90:0/2652430226 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c6c004d40 0x7f6c88147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:37.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.063+0000 7f6c86800640 1 --2- 172.21.15.90:0/2652430226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c8814c5e0 0x7f6c88149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:37.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.063+0000 7f6c7fe00640 1 --2- 172.21.15.90:0/2652430226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c88146800 0x7f6c881478c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6c700117b0 tx=0x7f6c70011c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:37.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.063+0000 7f6c7e000640 1 -- 172.21.15.90:0/2652430226 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c70004460 con 0x7f6c88146800 2024-09-21T03:25:37.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.063+0000 7f6c7e000640 1 -- 172.21.15.90:0/2652430226 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c70016070 con 0x7f6c88146800 2024-09-21T03:25:37.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.063+0000 7f6c8d200640 1 -- 172.21.15.90:0/2652430226 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c8814e0b0 con 0x7f6c88146800 2024-09-21T03:25:37.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.063+0000 7f6c7e000640 1 -- 172.21.15.90:0/2652430226 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7000fc90 con 0x7f6c88146800 2024-09-21T03:25:37.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.063+0000 7f6c8d200640 1 -- 172.21.15.90:0/2652430226 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c8814e350 con 0x7f6c88146800 2024-09-21T03:25:37.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.064+0000 7f6c8d200640 1 -- 172.21.15.90:0/2652430226 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c881540d0 con 0x7f6c88146800 2024-09-21T03:25:37.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.066+0000 7f6c7e000640 1 -- 172.21.15.90:0/2652430226 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6c70018030 con 0x7f6c88146800 2024-09-21T03:25:37.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.067+0000 7f6c7e000640 1 --2- 172.21.15.90:0/2652430226 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6c64078bc0 0x7f6c6407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:37.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.067+0000 7f6c7e000640 1 -- 172.21.15.90:0/2652430226 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f6c7009b860 con 0x7f6c88146800 2024-09-21T03:25:37.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.067+0000 7f6c85e00640 1 --2- 172.21.15.90:0/2652430226 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6c64078bc0 0x7f6c6407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:37.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.068+0000 7f6c85e00640 1 --2- 172.21.15.90:0/2652430226 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6c64078bc0 0x7f6c6407b0d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6c780018a0 tx=0x7f6c78000ed0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:37.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.071+0000 7f6c7e000640 1 -- 172.21.15.90:0/2652430226 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6c881540d0 con 0x7f6c88146800 2024-09-21T03:25:37.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.257+0000 7f6c8d200640 1 -- 172.21.15.90:0/2652430226 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f6c880ada10 con 0x7f6c88146800 2024-09-21T03:25:37.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.263+0000 7f6c7e000640 1 -- 172.21.15.90:0/2652430226 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v36)=0 v36) ==== 123+0+0 (secure 0 0 0) 0x7f6c70063960 con 0x7f6c88146800 2024-09-21T03:25:37.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.265+0000 7f6c7e000640 1 -- 172.21.15.90:0/2652430226 <== mon.0 v2:172.21.15.90:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f6c700a1080 con 0x7f6c88146800 2024-09-21T03:25:37.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.267+0000 7f6c8d200640 1 -- 172.21.15.90:0/2652430226 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6c64078bc0 msgr2=0x7f6c6407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.267+0000 7f6c8d200640 1 --2- 172.21.15.90:0/2652430226 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6c64078bc0 0x7f6c6407b0d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6c780018a0 tx=0x7f6c78000ed0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.267+0000 7f6c8d200640 1 -- 172.21.15.90:0/2652430226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c88146800 msgr2=0x7f6c881478c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.267+0000 7f6c8d200640 1 --2- 172.21.15.90:0/2652430226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c88146800 0x7f6c881478c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6c700117b0 tx=0x7f6c70011c70 comp rx=0 tx=0).stop 2024-09-21T03:25:37.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.267+0000 7f6c8d200640 1 -- 172.21.15.90:0/2652430226 shutdown_connections 2024-09-21T03:25:37.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.267+0000 7f6c8d200640 1 --2- 172.21.15.90:0/2652430226 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f6c64078bc0 0x7f6c6407b0d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.267+0000 7f6c8d200640 1 --2- 172.21.15.90:0/2652430226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c8814c5e0 0x7f6c88149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.267+0000 7f6c8d200640 1 --2- 172.21.15.90:0/2652430226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c88146800 0x7f6c881478c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.267+0000 7f6c8d200640 1 --2- 172.21.15.90:0/2652430226 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c6c004d40 0x7f6c88147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.267+0000 7f6c8d200640 1 -- 172.21.15.90:0/2652430226 >> 172.21.15.90:0/2652430226 conn(0x7f6c880c85a0 msgr2=0x7f6c880c2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:37.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.267+0000 7f6c8d200640 1 -- 172.21.15.90:0/2652430226 shutdown_connections 2024-09-21T03:25:37.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.267+0000 7f6c8d200640 1 -- 172.21.15.90:0/2652430226 wait complete. 2024-09-21T03:25:37.292 INFO:tasks.cephfs.filesystem:Destroying file system a and related pools 2024-09-21T03:25:37.292 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:25:37.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.511+0000 7fa6f9c00640 1 -- 172.21.15.90:0/1836717197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6f40ac950 msgr2=0x7fa6f4074b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.511+0000 7fa6f9c00640 1 --2- 172.21.15.90:0/1836717197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6f40ac950 0x7fa6f4074b80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4005fd0 tx=0x7fa6e402a620 comp rx=0 tx=0).stop 2024-09-21T03:25:37.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.511+0000 7fa6f9c00640 1 -- 172.21.15.90:0/1836717197 shutdown_connections 2024-09-21T03:25:37.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.511+0000 7fa6f9c00640 1 --2- 172.21.15.90:0/1836717197 >> v2:172.21.15.149:3300/0 conn(0x7fa6f406ede0 0x7fa6f41570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.511+0000 7fa6f9c00640 1 --2- 172.21.15.90:0/1836717197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6f40ac950 0x7fa6f4074b80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.511+0000 7fa6f9c00640 1 -- 172.21.15.90:0/1836717197 >> 172.21.15.90:0/1836717197 conn(0x7fa6f40c8ba0 msgr2=0x7fa6f406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:37.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.511+0000 7fa6f9c00640 1 -- 172.21.15.90:0/1836717197 shutdown_connections 2024-09-21T03:25:37.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.511+0000 7fa6f9c00640 1 -- 172.21.15.90:0/1836717197 wait complete. 2024-09-21T03:25:37.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.513+0000 7fa6f9c00640 1 Processor -- start 2024-09-21T03:25:37.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.513+0000 7fa6f9c00640 1 -- start start 2024-09-21T03:25:37.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.515+0000 7fa6f9c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6f406ede0 0x7fa6f414c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:37.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.515+0000 7fa6f9c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6f40c2d30 0x7fa6f4154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:37.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.515+0000 7fa6f9c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6f414cfa0 0x7fa6f414d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:37.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.515+0000 7fa6f9c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f4070a60 con 0x7fa6f406ede0 2024-09-21T03:25:37.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.515+0000 7fa6f9c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f40708e0 con 0x7fa6f414cfa0 2024-09-21T03:25:37.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.515+0000 7fa6f9c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa6f4157620 con 0x7fa6f40c2d30 2024-09-21T03:25:37.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.515+0000 7fa6f2a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6f406ede0 0x7fa6f414c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:37.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.515+0000 7fa6f2a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6f406ede0 0x7fa6f414c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35848/0 (socket says 172.21.15.90:35848) 2024-09-21T03:25:37.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.515+0000 7fa6f2a00640 1 -- 172.21.15.90:0/2787647238 learned_addr learned my addr 172.21.15.90:0/2787647238 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:25:37.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.515+0000 7fa6f3400640 1 --2- 172.21.15.90:0/2787647238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6f414cfa0 0x7fa6f414d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:37.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.515+0000 7fa6ebe00640 1 --2- 172.21.15.90:0/2787647238 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6f40c2d30 0x7fa6f4154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:37.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.515+0000 7fa6f2a00640 1 -- 172.21.15.90:0/2787647238 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6f40c2d30 msgr2=0x7fa6f4154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.515+0000 7fa6f2a00640 1 --2- 172.21.15.90:0/2787647238 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6f40c2d30 0x7fa6f4154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.515+0000 7fa6f2a00640 1 -- 172.21.15.90:0/2787647238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6f414cfa0 msgr2=0x7fa6f414d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.515+0000 7fa6f2a00640 1 --2- 172.21.15.90:0/2787647238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6f414cfa0 0x7fa6f414d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.515+0000 7fa6f2a00640 1 -- 172.21.15.90:0/2787647238 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f41485b0 con 0x7fa6f406ede0 2024-09-21T03:25:37.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.516+0000 7fa6f2a00640 1 --2- 172.21.15.90:0/2787647238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6f406ede0 0x7fa6f414c170 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa6e402ab40 tx=0x7fa6e40045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:37.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.516+0000 7fa6eaa00640 1 -- 172.21.15.90:0/2787647238 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e403e070 con 0x7fa6f406ede0 2024-09-21T03:25:37.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.516+0000 7fa6eaa00640 1 -- 172.21.15.90:0/2787647238 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fa6e4004dd0 con 0x7fa6f406ede0 2024-09-21T03:25:37.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.516+0000 7fa6f9c00640 1 -- 172.21.15.90:0/2787647238 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f414adb0 con 0x7fa6f406ede0 2024-09-21T03:25:37.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.516+0000 7fa6eaa00640 1 -- 172.21.15.90:0/2787647238 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4035040 con 0x7fa6f406ede0 2024-09-21T03:25:37.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.516+0000 7fa6f9c00640 1 -- 172.21.15.90:0/2787647238 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f414b370 con 0x7fa6f406ede0 2024-09-21T03:25:37.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.517+0000 7fa6f9c00640 1 -- 172.21.15.90:0/2787647238 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f4157b60 con 0x7fa6f406ede0 2024-09-21T03:25:37.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.518+0000 7fa6eaa00640 1 -- 172.21.15.90:0/2787647238 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa6e4041070 con 0x7fa6f406ede0 2024-09-21T03:25:37.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.519+0000 7fa6eaa00640 1 --2- 172.21.15.90:0/2787647238 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa6d0078b90 0x7fa6d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:37.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.519+0000 7fa6eaa00640 1 -- 172.21.15.90:0/2787647238 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fa6e40bb8b0 con 0x7fa6f406ede0 2024-09-21T03:25:37.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.520+0000 7fa6ebe00640 1 --2- 172.21.15.90:0/2787647238 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa6d0078b90 0x7fa6d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:37.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.520+0000 7fa6ebe00640 1 --2- 172.21.15.90:0/2787647238 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa6d0078b90 0x7fa6d007b0a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40ad180 tx=0x7fa6dc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:37.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.524+0000 7fa6eaa00640 1 -- 172.21.15.90:0/2787647238 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa6e4083920 con 0x7fa6f406ede0 2024-09-21T03:25:37.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.747+0000 7fa6f9c00640 1 -- 172.21.15.90:0/2787647238 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6f40c2b10 con 0x7fa6f406ede0 2024-09-21T03:25:37.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.747+0000 7fa6eaa00640 1 -- 172.21.15.90:0/2787647238 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6530 (secure 0 0 0) 0x7fa6e4083220 con 0x7fa6f406ede0 2024-09-21T03:25:37.749 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:25:37.749 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"btime":"2024-09-21T03:14:51:570098+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3707484056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3707484056},{"type":"v1","addr":"172.21.15.90:6835","nonce":3707484056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1650707992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1650707992},{"type":"v1","addr":"172.21.15.149:6837","nonce":1650707992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:37.954868+0000","modified":"2024-09-21T03:14:41.971257+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/2166962836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2166962836},{"type":"v1","addr":"172.21.15.149:6836","nonce":2166962836}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:47.021969+0000","modified":"2024-09-21T03:14:51.055397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4395},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4395":{"gid":4395,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6833/1105275899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1105275899},{"type":"v1","addr":"172.21.15.90:6833","nonce":1105275899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4395,"qdb_cluster":[4395]},"id":2}]} 2024-09-21T03:25:37.750 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2024-09-21T03:25:37.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.750+0000 7fa6f9c00640 1 -- 172.21.15.90:0/2787647238 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa6d0078b90 msgr2=0x7fa6d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.750+0000 7fa6f9c00640 1 --2- 172.21.15.90:0/2787647238 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa6d0078b90 0x7fa6d007b0a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40ad180 tx=0x7fa6dc009040 comp rx=0 tx=0).stop 2024-09-21T03:25:37.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.750+0000 7fa6f9c00640 1 -- 172.21.15.90:0/2787647238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6f406ede0 msgr2=0x7fa6f414c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.750+0000 7fa6f9c00640 1 --2- 172.21.15.90:0/2787647238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6f406ede0 0x7fa6f414c170 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa6e402ab40 tx=0x7fa6e40045f0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.750+0000 7fa6f9c00640 1 -- 172.21.15.90:0/2787647238 shutdown_connections 2024-09-21T03:25:37.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.750+0000 7fa6f9c00640 1 --2- 172.21.15.90:0/2787647238 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fa6d0078b90 0x7fa6d007b0a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.750+0000 7fa6f9c00640 1 --2- 172.21.15.90:0/2787647238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6f414cfa0 0x7fa6f414d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.750+0000 7fa6f9c00640 1 --2- 172.21.15.90:0/2787647238 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6f40c2d30 0x7fa6f4154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.750+0000 7fa6f9c00640 1 --2- 172.21.15.90:0/2787647238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6f406ede0 0x7fa6f414c170 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.750+0000 7fa6f9c00640 1 -- 172.21.15.90:0/2787647238 >> 172.21.15.90:0/2787647238 conn(0x7fa6f40c8ba0 msgr2=0x7fa6f40ab1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:37.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.750+0000 7fa6f9c00640 1 -- 172.21.15.90:0/2787647238 shutdown_connections 2024-09-21T03:25:37.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.750+0000 7fa6f9c00640 1 -- 172.21.15.90:0/2787647238 wait complete. 2024-09-21T03:25:37.774 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:25:37.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.994+0000 7feba6600640 1 -- 172.21.15.90:0/3443400460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feba00c5630 msgr2=0x7feba0156110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.994+0000 7feba6600640 1 --2- 172.21.15.90:0/3443400460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feba00c5630 0x7feba0156110 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7feba014d160 tx=0x7feb9802a8f0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.994+0000 7feba6600640 1 -- 172.21.15.90:0/3443400460 shutdown_connections 2024-09-21T03:25:37.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.994+0000 7feba6600640 1 --2- 172.21.15.90:0/3443400460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feba00c5630 0x7feba0156110 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.994+0000 7feba6600640 1 --2- 172.21.15.90:0/3443400460 >> v2:172.21.15.149:3300/0 conn(0x7feba00ab410 0x7feba00c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.994+0000 7feba6600640 1 -- 172.21.15.90:0/3443400460 >> 172.21.15.90:0/3443400460 conn(0x7feba00c84c0 msgr2=0x7feba00c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:37.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.994+0000 7feba6600640 1 -- 172.21.15.90:0/3443400460 shutdown_connections 2024-09-21T03:25:37.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.994+0000 7feba6600640 1 -- 172.21.15.90:0/3443400460 wait complete. 2024-09-21T03:25:37.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.996+0000 7feba6600640 1 Processor -- start 2024-09-21T03:25:37.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.996+0000 7feba6600640 1 -- start start 2024-09-21T03:25:38.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.997+0000 7feba6600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feba00ab410 0x7feba01492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.997+0000 7feba6600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feba00c4720 0x7feba0141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.997+0000 7feba6600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feba00c5630 0x7feba014e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.997+0000 7feba6600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feba0074d40 con 0x7feba00ab410 2024-09-21T03:25:38.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.997+0000 7feba6600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7feba0074bc0 con 0x7feba00c4720 2024-09-21T03:25:38.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.997+0000 7feba6600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7feba0070db0 con 0x7feba00c5630 2024-09-21T03:25:38.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.998+0000 7feba5200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feba00ab410 0x7feba01492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.998+0000 7feba5200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feba00ab410 0x7feba01492b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35878/0 (socket says 172.21.15.90:35878) 2024-09-21T03:25:38.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.998+0000 7feba5200640 1 -- 172.21.15.90:0/1531514645 learned_addr learned my addr 172.21.15.90:0/1531514645 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:25:38.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.998+0000 7feba5200640 1 -- 172.21.15.90:0/1531514645 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feba00c5630 msgr2=0x7feba014e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.998+0000 7feb97e00640 1 --2- 172.21.15.90:0/1531514645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feba00c4720 0x7feba0141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.998+0000 7feba5c00640 1 --2- 172.21.15.90:0/1531514645 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feba00c5630 0x7feba014e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.998+0000 7feba5200640 1 --2- 172.21.15.90:0/1531514645 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feba00c5630 0x7feba014e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.998+0000 7feba5200640 1 -- 172.21.15.90:0/1531514645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feba00c4720 msgr2=0x7feba0141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.998+0000 7feba5200640 1 --2- 172.21.15.90:0/1531514645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feba00c4720 0x7feba0141300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.998+0000 7feba5200640 1 -- 172.21.15.90:0/1531514645 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba01497f0 con 0x7feba00ab410 2024-09-21T03:25:38.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.998+0000 7feb97e00640 1 --2- 172.21.15.90:0/1531514645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feba00c4720 0x7feba0141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:38.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.998+0000 7feba5c00640 1 --2- 172.21.15.90:0/1531514645 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feba00c5630 0x7feba014e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:38.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.998+0000 7feba5200640 1 --2- 172.21.15.90:0/1531514645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feba00ab410 0x7feba01492b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7feb9000b420 tx=0x7feb9000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:38.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.999+0000 7feb9d600640 1 -- 172.21.15.90:0/1531514645 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90011830 con 0x7feba00ab410 2024-09-21T03:25:38.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.999+0000 7feb9d600640 1 -- 172.21.15.90:0/1531514645 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7feb90016070 con 0x7feba00ab410 2024-09-21T03:25:38.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.999+0000 7feb9d600640 1 -- 172.21.15.90:0/1531514645 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90011c90 con 0x7feba00ab410 2024-09-21T03:25:38.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.999+0000 7feba6600640 1 -- 172.21.15.90:0/1531514645 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba0147350 con 0x7feba00ab410 2024-09-21T03:25:38.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:37.999+0000 7feba6600640 1 -- 172.21.15.90:0/1531514645 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba0147910 con 0x7feba00ab410 2024-09-21T03:25:38.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.000+0000 7feba6600640 1 -- 172.21.15.90:0/1531514645 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba00c50f0 con 0x7feba00ab410 2024-09-21T03:25:38.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.001+0000 7feb9d600640 1 -- 172.21.15.90:0/1531514645 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feb9001b460 con 0x7feba00ab410 2024-09-21T03:25:38.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.002+0000 7feb9d600640 1 --2- 172.21.15.90:0/1531514645 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7feb7c078b90 0x7feb7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.002+0000 7feb9d600640 1 -- 172.21.15.90:0/1531514645 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7feb9009ac00 con 0x7feba00ab410 2024-09-21T03:25:38.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.002+0000 7feb97e00640 1 --2- 172.21.15.90:0/1531514645 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7feb7c078b90 0x7feb7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.003+0000 7feb97e00640 1 --2- 172.21.15.90:0/1531514645 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7feb7c078b90 0x7feb7c07b0a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feba0142150 tx=0x7feb88005dd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:38.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.006+0000 7feb9d600640 1 -- 172.21.15.90:0/1531514645 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7feb90020020 con 0x7feba00ab410 2024-09-21T03:25:38.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.231+0000 7feba6600640 1 -- 172.21.15.90:0/1531514645 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feba00c24d0 con 0x7feba00ab410 2024-09-21T03:25:38.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.231+0000 7feb9d600640 1 -- 172.21.15.90:0/1531514645 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6530 (secure 0 0 0) 0x7feb90062c70 con 0x7feba00ab410 2024-09-21T03:25:38.234 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:25:38.234 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"btime":"2024-09-21T03:14:51:570098+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3707484056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3707484056},{"type":"v1","addr":"172.21.15.90:6835","nonce":3707484056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1650707992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1650707992},{"type":"v1","addr":"172.21.15.149:6837","nonce":1650707992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:37.954868+0000","modified":"2024-09-21T03:14:41.971257+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/2166962836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2166962836},{"type":"v1","addr":"172.21.15.149:6836","nonce":2166962836}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:47.021969+0000","modified":"2024-09-21T03:14:51.055397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4395},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4395":{"gid":4395,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6833/1105275899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1105275899},{"type":"v1","addr":"172.21.15.90:6833","nonce":1105275899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4395,"qdb_cluster":[4395]},"id":2}]} 2024-09-21T03:25:38.234 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2024-09-21T03:25:38.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.234+0000 7feba6600640 1 -- 172.21.15.90:0/1531514645 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7feb7c078b90 msgr2=0x7feb7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.234+0000 7feba6600640 1 --2- 172.21.15.90:0/1531514645 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7feb7c078b90 0x7feb7c07b0a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feba0142150 tx=0x7feb88005dd0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.234+0000 7feba6600640 1 -- 172.21.15.90:0/1531514645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feba00ab410 msgr2=0x7feba01492b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.234+0000 7feba6600640 1 --2- 172.21.15.90:0/1531514645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feba00ab410 0x7feba01492b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7feb9000b420 tx=0x7feb9000b8e0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.234+0000 7feba6600640 1 -- 172.21.15.90:0/1531514645 shutdown_connections 2024-09-21T03:25:38.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.234+0000 7feba6600640 1 --2- 172.21.15.90:0/1531514645 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7feb7c078b90 0x7feb7c07b0a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.234+0000 7feba6600640 1 --2- 172.21.15.90:0/1531514645 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feba00c5630 0x7feba014e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.234+0000 7feba6600640 1 --2- 172.21.15.90:0/1531514645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feba00c4720 0x7feba0141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.234+0000 7feba6600640 1 --2- 172.21.15.90:0/1531514645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feba00ab410 0x7feba01492b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.234+0000 7feba6600640 1 -- 172.21.15.90:0/1531514645 >> 172.21.15.90:0/1531514645 conn(0x7feba00c84c0 msgr2=0x7feba006f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:38.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.234+0000 7feba6600640 1 -- 172.21.15.90:0/1531514645 shutdown_connections 2024-09-21T03:25:38.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.234+0000 7feba6600640 1 -- 172.21.15.90:0/1531514645 wait complete. 2024-09-21T03:25:38.259 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:25:38.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.477+0000 7fbe81800640 1 -- 172.21.15.90:0/213853043 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe7c06e630 msgr2=0x7fbe7c154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.477+0000 7fbe81800640 1 --2- 172.21.15.90:0/213853043 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe7c06e630 0x7fbe7c154530 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c005fd0 tx=0x7fbe6c02a540 comp rx=0 tx=0).stop 2024-09-21T03:25:38.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.478+0000 7fbe81800640 1 -- 172.21.15.90:0/213853043 shutdown_connections 2024-09-21T03:25:38.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.478+0000 7fbe81800640 1 --2- 172.21.15.90:0/213853043 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe7c0cb140 0x7fbe7c0cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.478+0000 7fbe81800640 1 --2- 172.21.15.90:0/213853043 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe7c06e630 0x7fbe7c154530 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.478+0000 7fbe81800640 1 -- 172.21.15.90:0/213853043 >> 172.21.15.90:0/213853043 conn(0x7fbe7c0c8d60 msgr2=0x7fbe7c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:38.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.478+0000 7fbe81800640 1 -- 172.21.15.90:0/213853043 shutdown_connections 2024-09-21T03:25:38.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.478+0000 7fbe81800640 1 -- 172.21.15.90:0/213853043 wait complete. 2024-09-21T03:25:38.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.480+0000 7fbe81800640 1 Processor -- start 2024-09-21T03:25:38.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.480+0000 7fbe81800640 1 -- start start 2024-09-21T03:25:38.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.481+0000 7fbe81800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe7c06e630 0x7fbe7c156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.481+0000 7fbe81800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe7c0c7460 0x7fbe7c0c0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.481+0000 7fbe81800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe7c0cb140 0x7fbe7c1452f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.481+0000 7fbe81800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7c0cba90 con 0x7fbe7c0c7460 2024-09-21T03:25:38.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.481+0000 7fbe81800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7c0ca940 con 0x7fbe7c0cb140 2024-09-21T03:25:38.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.481+0000 7fbe81800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbe7c1582a0 con 0x7fbe7c06e630 2024-09-21T03:25:38.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.481+0000 7fbe73400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe7c0c7460 0x7fbe7c0c0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.481+0000 7fbe73400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe7c0c7460 0x7fbe7c0c0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35894/0 (socket says 172.21.15.90:35894) 2024-09-21T03:25:38.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.481+0000 7fbe73400640 1 -- 172.21.15.90:0/2299646227 learned_addr learned my addr 172.21.15.90:0/2299646227 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:25:38.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.482+0000 7fbe80e00640 1 --2- 172.21.15.90:0/2299646227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe7c0cb140 0x7fbe7c1452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.482+0000 7fbe7be00640 1 --2- 172.21.15.90:0/2299646227 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe7c06e630 0x7fbe7c156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.482+0000 7fbe73400640 1 -- 172.21.15.90:0/2299646227 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe7c06e630 msgr2=0x7fbe7c156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.482+0000 7fbe73400640 1 --2- 172.21.15.90:0/2299646227 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe7c06e630 0x7fbe7c156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.482+0000 7fbe73400640 1 -- 172.21.15.90:0/2299646227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe7c0cb140 msgr2=0x7fbe7c1452f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.482+0000 7fbe73400640 1 --2- 172.21.15.90:0/2299646227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe7c0cb140 0x7fbe7c1452f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.482+0000 7fbe73400640 1 -- 172.21.15.90:0/2299646227 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe7c156a40 con 0x7fbe7c0c7460 2024-09-21T03:25:38.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.482+0000 7fbe7be00640 1 --2- 172.21.15.90:0/2299646227 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe7c06e630 0x7fbe7c156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:38.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.482+0000 7fbe80e00640 1 --2- 172.21.15.90:0/2299646227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe7c0cb140 0x7fbe7c1452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:38.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.482+0000 7fbe73400640 1 --2- 172.21.15.90:0/2299646227 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe7c0c7460 0x7fbe7c0c0aa0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400d700 tx=0x7fbe6400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:38.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.482+0000 7fbe78c00640 1 -- 172.21.15.90:0/2299646227 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe64017070 con 0x7fbe7c0c7460 2024-09-21T03:25:38.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.482+0000 7fbe78c00640 1 -- 172.21.15.90:0/2299646227 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fbe64004330 con 0x7fbe7c0c7460 2024-09-21T03:25:38.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.482+0000 7fbe78c00640 1 -- 172.21.15.90:0/2299646227 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe64009a80 con 0x7fbe7c0c7460 2024-09-21T03:25:38.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.482+0000 7fbe81800640 1 -- 172.21.15.90:0/2299646227 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe7c0c58f0 con 0x7fbe7c0c7460 2024-09-21T03:25:38.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.482+0000 7fbe81800640 1 -- 172.21.15.90:0/2299646227 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe7c0c52c0 con 0x7fbe7c0c7460 2024-09-21T03:25:38.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.484+0000 7fbe81800640 1 -- 172.21.15.90:0/2299646227 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe7c06d7f0 con 0x7fbe7c0c7460 2024-09-21T03:25:38.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.485+0000 7fbe78c00640 1 -- 172.21.15.90:0/2299646227 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbe64009c20 con 0x7fbe7c0c7460 2024-09-21T03:25:38.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.486+0000 7fbe78c00640 1 --2- 172.21.15.90:0/2299646227 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbe58078bc0 0x7fbe5807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.486+0000 7fbe78c00640 1 -- 172.21.15.90:0/2299646227 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7fbe6409b1c0 con 0x7fbe7c0c7460 2024-09-21T03:25:38.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.487+0000 7fbe7be00640 1 --2- 172.21.15.90:0/2299646227 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbe58078bc0 0x7fbe5807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.487+0000 7fbe7be00640 1 --2- 172.21.15.90:0/2299646227 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbe58078bc0 0x7fbe5807b0d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c033000 tx=0x7fbe6c0046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:38.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.491+0000 7fbe78c00640 1 -- 172.21.15.90:0/2299646227 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbe64063240 con 0x7fbe7c0c7460 2024-09-21T03:25:38.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.678+0000 7fbe81800640 1 -- 172.21.15.90:0/2299646227 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe7c0c7100 con 0x7fbe7c0c7460 2024-09-21T03:25:38.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.679+0000 7fbe78c00640 1 -- 172.21.15.90:0/2299646227 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+20704 (secure 0 0 0) 0x7fbe64062b40 con 0x7fbe7c0c7460 2024-09-21T03:25:38.682 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:25:38.682 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":27,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","created":"2024-09-21T03:14:09.323302+0000","modified":"2024-09-21T03:15:15.672593+0000","last_up_change":"2024-09-21T03:14:25.329650+0000","last_in_change":"2024-09-21T03:14:15.386953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:14:24.511246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-21T03:14:35.815250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-21T03:14:36.914615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-21T03:14:45.298287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-21T03:14:45.977111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ceaacfab-e71c-45e2-ac50-4597dfd460bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6809","nonce":3187794863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6811","nonce":3187794863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6815","nonce":3187794863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6813","nonce":3187794863}]},"public_addr":"172.21.15.90:6809/3187794863","cluster_addr":"172.21.15.90:6811/3187794863","heartbeat_back_addr":"172.21.15.90:6815/3187794863","heartbeat_front_addr":"172.21.15.90:6813/3187794863","state":["exists","up"]},{"osd":1,"uuid":"86f91523-232b-4e80-ada7-d9e12770adb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6801","nonce":3769758484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6803","nonce":3769758484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6807","nonce":3769758484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6805","nonce":3769758484}]},"public_addr":"172.21.15.90:6801/3769758484","cluster_addr":"172.21.15.90:6803/3769758484","heartbeat_back_addr":"172.21.15.90:6807/3769758484","heartbeat_front_addr":"172.21.15.90:6805/3769758484","state":["exists","up"]},{"osd":2,"uuid":"6eb0f47b-e767-49c0-8d72-07f71b9c2e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6825","nonce":1025535744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6827","nonce":1025535744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6831","nonce":1025535744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6829","nonce":1025535744}]},"public_addr":"172.21.15.90:6825/1025535744","cluster_addr":"172.21.15.90:6827/1025535744","heartbeat_back_addr":"172.21.15.90:6831/1025535744","heartbeat_front_addr":"172.21.15.90:6829/1025535744","state":["exists","up"]},{"osd":3,"uuid":"64418862-beef-479c-be11-dfe0e515e09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6817","nonce":1515884437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6819","nonce":1515884437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6823","nonce":1515884437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6821","nonce":1515884437}]},"public_addr":"172.21.15.90:6817/1515884437","cluster_addr":"172.21.15.90:6819/1515884437","heartbeat_back_addr":"172.21.15.90:6823/1515884437","heartbeat_front_addr":"172.21.15.90:6821/1515884437","state":["exists","up"]},{"osd":4,"uuid":"a05b63f4-ec0a-426c-9d60-285e2680a897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6816","nonce":4278726553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6820","nonce":4278726553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6825","nonce":4278726553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6823","nonce":4278726553}]},"public_addr":"172.21.15.149:6816/4278726553","cluster_addr":"172.21.15.149:6820/4278726553","heartbeat_back_addr":"172.21.15.149:6825/4278726553","heartbeat_front_addr":"172.21.15.149:6823/4278726553","state":["exists","up"]},{"osd":5,"uuid":"3a1bab89-963c-4fe7-b14f-3080c5cf7830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6827","nonce":1341677333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6829","nonce":1341677333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6833","nonce":1341677333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6831","nonce":1341677333}]},"public_addr":"172.21.15.149:6827/1341677333","cluster_addr":"172.21.15.149:6829/1341677333","heartbeat_back_addr":"172.21.15.149:6833/1341677333","heartbeat_front_addr":"172.21.15.149:6831/1341677333","state":["exists","up"]},{"osd":6,"uuid":"bfcd1596-2688-4deb-be2e-55f305a5b4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6811","nonce":821196931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6813","nonce":821196931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6821","nonce":821196931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6817","nonce":821196931}]},"public_addr":"172.21.15.149:6811/821196931","cluster_addr":"172.21.15.149:6813/821196931","heartbeat_back_addr":"172.21.15.149:6821/821196931","heartbeat_front_addr":"172.21.15.149:6817/821196931","state":["exists","up"]},{"osd":7,"uuid":"58b19790-4006-4f07-966c-911b938cc1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6803","nonce":1657326880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6805","nonce":1657326880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6809","nonce":1657326880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6807","nonce":1657326880}]},"public_addr":"172.21.15.149:6803/1657326880","cluster_addr":"172.21.15.149:6805/1657326880","heartbeat_back_addr":"172.21.15.149:6809/1657326880","heartbeat_front_addr":"172.21.15.149:6807/1657326880","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.399701+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.051745+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.190159+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:23.240143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.446570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.259974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:21.990407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.459259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"5.14","mappings":[{"from":4,"to":5}]},{"pgid":"5.1c","mappings":[{"from":4,"to":5}]},{"pgid":"5.23","mappings":[{"from":4,"to":5}]},{"pgid":"5.32","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:25:38.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.682+0000 7fbe81800640 1 -- 172.21.15.90:0/2299646227 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbe58078bc0 msgr2=0x7fbe5807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.682+0000 7fbe81800640 1 --2- 172.21.15.90:0/2299646227 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbe58078bc0 0x7fbe5807b0d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c033000 tx=0x7fbe6c0046c0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.682+0000 7fbe81800640 1 -- 172.21.15.90:0/2299646227 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe7c0c7460 msgr2=0x7fbe7c0c0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.682+0000 7fbe81800640 1 --2- 172.21.15.90:0/2299646227 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe7c0c7460 0x7fbe7c0c0aa0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400d700 tx=0x7fbe6400dbc0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.682+0000 7fbe81800640 1 -- 172.21.15.90:0/2299646227 shutdown_connections 2024-09-21T03:25:38.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.682+0000 7fbe81800640 1 --2- 172.21.15.90:0/2299646227 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbe58078bc0 0x7fbe5807b0d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.682+0000 7fbe81800640 1 --2- 172.21.15.90:0/2299646227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe7c0cb140 0x7fbe7c1452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.682+0000 7fbe81800640 1 --2- 172.21.15.90:0/2299646227 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe7c0c7460 0x7fbe7c0c0aa0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.682+0000 7fbe81800640 1 --2- 172.21.15.90:0/2299646227 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe7c06e630 0x7fbe7c156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.682+0000 7fbe81800640 1 -- 172.21.15.90:0/2299646227 >> 172.21.15.90:0/2299646227 conn(0x7fbe7c0c8d60 msgr2=0x7fbe7c154c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:38.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.682+0000 7fbe81800640 1 -- 172.21.15.90:0/2299646227 shutdown_connections 2024-09-21T03:25:38.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.682+0000 7fbe81800640 1 -- 172.21.15.90:0/2299646227 wait complete. 2024-09-21T03:25:38.710 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail a 2024-09-21T03:25:38.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.930+0000 7f7a5fe00640 1 -- 172.21.15.90:0/980620755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a600c4260 msgr2=0x7f7a600728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.930+0000 7f7a5fe00640 1 --2- 172.21.15.90:0/980620755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a600c4260 0x7f7a600728e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7a50005fd0 tx=0x7f7a5002a980 comp rx=0 tx=0).stop 2024-09-21T03:25:38.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.930+0000 7f7a5fe00640 1 -- 172.21.15.90:0/980620755 shutdown_connections 2024-09-21T03:25:38.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.930+0000 7f7a5fe00640 1 --2- 172.21.15.90:0/980620755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a600c4670 0x7f7a60150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.930+0000 7f7a5fe00640 1 --2- 172.21.15.90:0/980620755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a600c4260 0x7f7a600728e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.930+0000 7f7a5fe00640 1 -- 172.21.15.90:0/980620755 >> 172.21.15.90:0/980620755 conn(0x7f7a6006d200 msgr2=0x7f7a6006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:38.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.930+0000 7f7a5fe00640 1 -- 172.21.15.90:0/980620755 shutdown_connections 2024-09-21T03:25:38.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.930+0000 7f7a5fe00640 1 -- 172.21.15.90:0/980620755 wait complete. 2024-09-21T03:25:38.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.932+0000 7f7a5fe00640 1 Processor -- start 2024-09-21T03:25:38.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.932+0000 7f7a5fe00640 1 -- start start 2024-09-21T03:25:38.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.933+0000 7f7a5fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a600c4260 0x7f7a60147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.933+0000 7f7a5fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a600c4670 0x7f7a601eb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.934+0000 7f7a5fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a601511f0 0x7f7a60145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.934+0000 7f7a5fe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7a60153a90 con 0x7f7a600c4260 2024-09-21T03:25:38.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.934+0000 7f7a5fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7a60153910 con 0x7f7a600c4670 2024-09-21T03:25:38.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.934+0000 7f7a5fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7a60072e20 con 0x7f7a601511f0 2024-09-21T03:25:38.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.934+0000 7f7a5ea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a600c4260 0x7f7a60147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.934+0000 7f7a5ea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a600c4260 0x7f7a60147700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35910/0 (socket says 172.21.15.90:35910) 2024-09-21T03:25:38.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.934+0000 7f7a5ea00640 1 -- 172.21.15.90:0/2145937052 learned_addr learned my addr 172.21.15.90:0/2145937052 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:25:38.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.934+0000 7f7a56000640 1 --2- 172.21.15.90:0/2145937052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a600c4670 0x7f7a601eb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.934+0000 7f7a5f400640 1 --2- 172.21.15.90:0/2145937052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a601511f0 0x7f7a60145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.934+0000 7f7a5ea00640 1 -- 172.21.15.90:0/2145937052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a601511f0 msgr2=0x7f7a60145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.934+0000 7f7a5ea00640 1 --2- 172.21.15.90:0/2145937052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a601511f0 0x7f7a60145a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.934+0000 7f7a5ea00640 1 -- 172.21.15.90:0/2145937052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a600c4670 msgr2=0x7f7a601eb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.934+0000 7f7a5ea00640 1 --2- 172.21.15.90:0/2145937052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a600c4670 0x7f7a601eb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.934+0000 7f7a5ea00640 1 -- 172.21.15.90:0/2145937052 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a60146de0 con 0x7f7a600c4260 2024-09-21T03:25:38.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.934+0000 7f7a56000640 1 --2- 172.21.15.90:0/2145937052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a600c4670 0x7f7a601eb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:38.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.935+0000 7f7a5ea00640 1 --2- 172.21.15.90:0/2145937052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a600c4260 0x7f7a60147700 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7a50006010 tx=0x7f7a50003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:38.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.935+0000 7f7a57400640 1 -- 172.21.15.90:0/2145937052 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a50034040 con 0x7f7a600c4260 2024-09-21T03:25:38.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.935+0000 7f7a57400640 1 -- 172.21.15.90:0/2145937052 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f7a50004550 con 0x7f7a600c4260 2024-09-21T03:25:38.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.935+0000 7f7a5fe00640 1 -- 172.21.15.90:0/2145937052 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a60146b00 con 0x7f7a600c4260 2024-09-21T03:25:38.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.935+0000 7f7a57400640 1 -- 172.21.15.90:0/2145937052 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a50045480 con 0x7f7a600c4260 2024-09-21T03:25:38.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.935+0000 7f7a5fe00640 1 -- 172.21.15.90:0/2145937052 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a601494f0 con 0x7f7a600c4260 2024-09-21T03:25:38.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.936+0000 7f7a5fe00640 1 -- 172.21.15.90:0/2145937052 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a600aa550 con 0x7f7a600c4260 2024-09-21T03:25:38.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.937+0000 7f7a57400640 1 -- 172.21.15.90:0/2145937052 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7a50037020 con 0x7f7a600c4260 2024-09-21T03:25:38.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.938+0000 7f7a57400640 1 --2- 172.21.15.90:0/2145937052 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7a3c078bc0 0x7f7a3c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.938+0000 7f7a57400640 1 -- 172.21.15.90:0/2145937052 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6666+0+0 (secure 0 0 0) 0x7f7a500bcaa0 con 0x7f7a600c4260 2024-09-21T03:25:38.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.939+0000 7f7a56000640 1 --2- 172.21.15.90:0/2145937052 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7a3c078bc0 0x7f7a3c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.940+0000 7f7a56000640 1 --2- 172.21.15.90:0/2145937052 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7a3c078bc0 0x7f7a3c07b0d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7a600c3290 tx=0x7f7a48005d10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:38.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:38.943+0000 7f7a57400640 1 -- 172.21.15.90:0/2145937052 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7a600aa550 con 0x7f7a600c4260 2024-09-21T03:25:39.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.167+0000 7f7a5fe00640 1 -- 172.21.15.90:0/2145937052 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "a"} v 0) -- 0x7f7a600728e0 con 0x7f7a600c4260 2024-09-21T03:25:39.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.188+0000 7f7a57400640 1 -- 172.21.15.90:0/2145937052 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "a"}]=0 a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) ==== 151+0+0 (secure 0 0 0) 0x7f7a50084ba0 con 0x7f7a600c4260 2024-09-21T03:25:39.190 INFO:teuthology.orchestra.run.smithi090.stderr:a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T03:25:39.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.191+0000 7f7a5fe00640 1 -- 172.21.15.90:0/2145937052 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7a3c078bc0 msgr2=0x7f7a3c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:39.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.191+0000 7f7a5fe00640 1 --2- 172.21.15.90:0/2145937052 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7a3c078bc0 0x7f7a3c07b0d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7a600c3290 tx=0x7f7a48005d10 comp rx=0 tx=0).stop 2024-09-21T03:25:39.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.191+0000 7f7a5fe00640 1 -- 172.21.15.90:0/2145937052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a600c4260 msgr2=0x7f7a60147700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:39.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.191+0000 7f7a5fe00640 1 --2- 172.21.15.90:0/2145937052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a600c4260 0x7f7a60147700 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7a50006010 tx=0x7f7a50003f90 comp rx=0 tx=0).stop 2024-09-21T03:25:39.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.191+0000 7f7a5fe00640 1 -- 172.21.15.90:0/2145937052 shutdown_connections 2024-09-21T03:25:39.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.191+0000 7f7a5fe00640 1 --2- 172.21.15.90:0/2145937052 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f7a3c078bc0 0x7f7a3c07b0d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:39.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.191+0000 7f7a5fe00640 1 --2- 172.21.15.90:0/2145937052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a601511f0 0x7f7a60145a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:39.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.191+0000 7f7a5fe00640 1 --2- 172.21.15.90:0/2145937052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a600c4670 0x7f7a601eb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:39.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.191+0000 7f7a5fe00640 1 --2- 172.21.15.90:0/2145937052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a600c4260 0x7f7a60147700 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:39.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.191+0000 7f7a5fe00640 1 -- 172.21.15.90:0/2145937052 >> 172.21.15.90:0/2145937052 conn(0x7f7a6006d200 msgr2=0x7f7a6014b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:39.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.191+0000 7f7a5fe00640 1 -- 172.21.15.90:0/2145937052 shutdown_connections 2024-09-21T03:25:39.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.191+0000 7f7a5fe00640 1 -- 172.21.15.90:0/2145937052 wait complete. 2024-09-21T03:25:39.220 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm a --yes-i-really-mean-it 2024-09-21T03:25:39.348 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-21T03:25:39.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.442+0000 7fb0bea00640 1 -- 172.21.15.90:0/3051830373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0b806efe0 msgr2=0x7fb0b8073b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:39.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.442+0000 7fb0bea00640 1 --2- 172.21.15.90:0/3051830373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0b806efe0 0x7fb0b8073b20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0005fd0 tx=0x7fb0b002aa10 comp rx=0 tx=0).stop 2024-09-21T03:25:39.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.442+0000 7fb0bea00640 1 -- 172.21.15.90:0/3051830373 shutdown_connections 2024-09-21T03:25:39.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.442+0000 7fb0bea00640 1 --2- 172.21.15.90:0/3051830373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0b806efe0 0x7fb0b8073b20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:39.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.442+0000 7fb0bea00640 1 --2- 172.21.15.90:0/3051830373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b806ebd0 0x7fb0b80c3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:39.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.442+0000 7fb0bea00640 1 -- 172.21.15.90:0/3051830373 >> 172.21.15.90:0/3051830373 conn(0x7fb0b80c8490 msgr2=0x7fb0b80c88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:39.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.442+0000 7fb0bea00640 1 -- 172.21.15.90:0/3051830373 shutdown_connections 2024-09-21T03:25:39.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.442+0000 7fb0bea00640 1 -- 172.21.15.90:0/3051830373 wait complete. 2024-09-21T03:25:39.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.444+0000 7fb0bea00640 1 Processor -- start 2024-09-21T03:25:39.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.444+0000 7fb0bea00640 1 -- start start 2024-09-21T03:25:39.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.445+0000 7fb0bea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b806ebd0 0x7fb0b80abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:39.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.445+0000 7fb0bea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b813aa30 0x7fb0b8155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:39.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.445+0000 7fb0bea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0b813ae40 0x7fb0b8157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:39.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.445+0000 7fb0bea00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b80c4650 con 0x7fb0b813ae40 2024-09-21T03:25:39.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.445+0000 7fb0bea00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b80c44d0 con 0x7fb0b813aa30 2024-09-21T03:25:39.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.445+0000 7fb0bea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b80c47d0 con 0x7fb0b806ebd0 2024-09-21T03:25:39.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.446+0000 7fb0be000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0b813ae40 0x7fb0b8157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:39.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.446+0000 7fb0be000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0b813ae40 0x7fb0b8157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35934/0 (socket says 172.21.15.90:35934) 2024-09-21T03:25:39.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.446+0000 7fb0be000640 1 -- 172.21.15.90:0/2594137850 learned_addr learned my addr 172.21.15.90:0/2594137850 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:25:39.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.446+0000 7fb0bcc00640 1 --2- 172.21.15.90:0/2594137850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b813aa30 0x7fb0b8155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:39.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.446+0000 7fb0bd600640 1 --2- 172.21.15.90:0/2594137850 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b806ebd0 0x7fb0b80abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:39.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.446+0000 7fb0be000640 1 -- 172.21.15.90:0/2594137850 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b806ebd0 msgr2=0x7fb0b80abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:39.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.446+0000 7fb0be000640 1 --2- 172.21.15.90:0/2594137850 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b806ebd0 0x7fb0b80abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:39.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.446+0000 7fb0be000640 1 -- 172.21.15.90:0/2594137850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b813aa30 msgr2=0x7fb0b8155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:39.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.446+0000 7fb0be000640 1 --2- 172.21.15.90:0/2594137850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b813aa30 0x7fb0b8155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:39.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.446+0000 7fb0be000640 1 -- 172.21.15.90:0/2594137850 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b8159cf0 con 0x7fb0b813ae40 2024-09-21T03:25:39.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.446+0000 7fb0be000640 1 --2- 172.21.15.90:0/2594137850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0b813ae40 0x7fb0b8157da0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009d90 tx=0x7fb0b0003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:39.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.447+0000 7fb0b5600640 1 -- 172.21.15.90:0/2594137850 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0033050 con 0x7fb0b813ae40 2024-09-21T03:25:39.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.447+0000 7fb0b5600640 1 -- 172.21.15.90:0/2594137850 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fb0b0004560 con 0x7fb0b813ae40 2024-09-21T03:25:39.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.447+0000 7fb0bea00640 1 -- 172.21.15.90:0/2594137850 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0b813b3d0 con 0x7fb0b813ae40 2024-09-21T03:25:39.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.447+0000 7fb0b5600640 1 -- 172.21.15.90:0/2594137850 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0038450 con 0x7fb0b813ae40 2024-09-21T03:25:39.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.447+0000 7fb0bea00640 1 -- 172.21.15.90:0/2594137850 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0b80ac3f0 con 0x7fb0b813ae40 2024-09-21T03:25:39.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.448+0000 7fb0bea00640 1 -- 172.21.15.90:0/2594137850 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0b80ac650 con 0x7fb0b813ae40 2024-09-21T03:25:39.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.449+0000 7fb0b5600640 1 -- 172.21.15.90:0/2594137850 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb0b0036070 con 0x7fb0b813ae40 2024-09-21T03:25:39.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.450+0000 7fb0b5600640 1 --2- 172.21.15.90:0/2594137850 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb098078b90 0x7fb09807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:39.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.450+0000 7fb0b5600640 1 -- 172.21.15.90:0/2594137850 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6752+0+0 (secure 0 0 0) 0x7fb0b00bc320 con 0x7fb0b813ae40 2024-09-21T03:25:39.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.451+0000 7fb0bd600640 1 --2- 172.21.15.90:0/2594137850 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb098078b90 0x7fb09807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:39.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.451+0000 7fb0bd600640 1 --2- 172.21.15.90:0/2594137850 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb098078b90 0x7fb09807b0a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac007fd0 tx=0x7fb0ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:39.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.455+0000 7fb0b5600640 1 -- 172.21.15.90:0/2594137850 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb0b0083d10 con 0x7fb0b813ae40 2024-09-21T03:25:39.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:39.675+0000 7fb0bea00640 1 -- 172.21.15.90:0/2594137850 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true} v 0) -- 0x7fb0b813b880 con 0x7fb0b813ae40 2024-09-21T03:25:40.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.190+0000 7fb0b5600640 1 -- 172.21.15.90:0/2594137850 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true}]=0 v16) ==== 99+0+0 (secure 0 0 0) 0x7fb0b0088740 con 0x7fb0b813ae40 2024-09-21T03:25:40.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.193+0000 7fb0bea00640 1 -- 172.21.15.90:0/2594137850 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb098078b90 msgr2=0x7fb09807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:40.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.193+0000 7fb0bea00640 1 --2- 172.21.15.90:0/2594137850 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb098078b90 0x7fb09807b0a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac007fd0 tx=0x7fb0ac009040 comp rx=0 tx=0).stop 2024-09-21T03:25:40.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.193+0000 7fb0bea00640 1 -- 172.21.15.90:0/2594137850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0b813ae40 msgr2=0x7fb0b8157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:40.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.193+0000 7fb0bea00640 1 --2- 172.21.15.90:0/2594137850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0b813ae40 0x7fb0b8157da0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009d90 tx=0x7fb0b0003f20 comp rx=0 tx=0).stop 2024-09-21T03:25:40.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.193+0000 7fb0bea00640 1 -- 172.21.15.90:0/2594137850 shutdown_connections 2024-09-21T03:25:40.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.193+0000 7fb0bea00640 1 --2- 172.21.15.90:0/2594137850 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fb098078b90 0x7fb09807b0a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.193+0000 7fb0bea00640 1 --2- 172.21.15.90:0/2594137850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0b813ae40 0x7fb0b8157da0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.193+0000 7fb0bea00640 1 --2- 172.21.15.90:0/2594137850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b813aa30 0x7fb0b8155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.193+0000 7fb0bea00640 1 --2- 172.21.15.90:0/2594137850 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b806ebd0 0x7fb0b80abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.193+0000 7fb0bea00640 1 -- 172.21.15.90:0/2594137850 >> 172.21.15.90:0/2594137850 conn(0x7fb0b80c8490 msgr2=0x7fb0b815a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:40.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.193+0000 7fb0bea00640 1 -- 172.21.15.90:0/2594137850 shutdown_connections 2024-09-21T03:25:40.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.193+0000 7fb0bea00640 1 -- 172.21.15.90:0/2594137850 wait complete. 2024-09-21T03:25:40.218 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_metadata a_metadata --yes-i-really-really-mean-it 2024-09-21T03:25:40.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.440+0000 7fd501600640 1 -- 172.21.15.90:0/4022377473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc13fe80 msgr2=0x7fd4fc13f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:40.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.440+0000 7fd501600640 1 --2- 172.21.15.90:0/4022377473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc13fe80 0x7fd4fc13f3b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec005fd0 tx=0x7fd4ec02a5f0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.440+0000 7fd501600640 1 -- 172.21.15.90:0/4022377473 shutdown_connections 2024-09-21T03:25:40.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.440+0000 7fd501600640 1 --2- 172.21.15.90:0/4022377473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc13fe80 0x7fd4fc13f3b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.440+0000 7fd501600640 1 -- 172.21.15.90:0/4022377473 >> 172.21.15.90:0/4022377473 conn(0x7fd4fc0c85a0 msgr2=0x7fd4fc0c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:40.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.440+0000 7fd501600640 1 -- 172.21.15.90:0/4022377473 shutdown_connections 2024-09-21T03:25:40.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.440+0000 7fd501600640 1 -- 172.21.15.90:0/4022377473 wait complete. 2024-09-21T03:25:40.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.442+0000 7fd501600640 1 Processor -- start 2024-09-21T03:25:40.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.442+0000 7fd501600640 1 -- start start 2024-09-21T03:25:40.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.443+0000 7fd501600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4fc13f930 0x7fd4fc0ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:40.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.443+0000 7fd501600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc13fe80 0x7fd4fc153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:40.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.443+0000 7fd501600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4fc156ca0 0x7fd4fc0c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:40.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.443+0000 7fd501600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd4fc0c1e70 con 0x7fd4fc13fe80 2024-09-21T03:25:40.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.443+0000 7fd501600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd4fc0c1cf0 con 0x7fd4fc13f930 2024-09-21T03:25:40.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.443+0000 7fd501600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd4fc1577c0 con 0x7fd4fc156ca0 2024-09-21T03:25:40.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.444+0000 7fd4f2000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc13fe80 0x7fd4fc153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:40.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.444+0000 7fd4f2000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc13fe80 0x7fd4fc153c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35954/0 (socket says 172.21.15.90:35954) 2024-09-21T03:25:40.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.444+0000 7fd4f2000640 1 -- 172.21.15.90:0/305219142 learned_addr learned my addr 172.21.15.90:0/305219142 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:25:40.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.444+0000 7fd4faa00640 1 --2- 172.21.15.90:0/305219142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4fc13f930 0x7fd4fc0ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:40.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.444+0000 7fd4fb400640 1 --2- 172.21.15.90:0/305219142 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4fc156ca0 0x7fd4fc0c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:40.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.444+0000 7fd4f2000640 1 -- 172.21.15.90:0/305219142 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4fc156ca0 msgr2=0x7fd4fc0c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:40.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.444+0000 7fd4f2000640 1 --2- 172.21.15.90:0/305219142 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4fc156ca0 0x7fd4fc0c6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.444+0000 7fd4f2000640 1 -- 172.21.15.90:0/305219142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4fc13f930 msgr2=0x7fd4fc0ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:40.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.444+0000 7fd4f2000640 1 --2- 172.21.15.90:0/305219142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4fc13f930 0x7fd4fc0ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.444+0000 7fd4f2000640 1 -- 172.21.15.90:0/305219142 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4fc0ab590 con 0x7fd4fc13fe80 2024-09-21T03:25:40.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.444+0000 7fd4f2000640 1 --2- 172.21.15.90:0/305219142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc13fe80 0x7fd4fc153c80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd4e400c3d0 tx=0x7fd4e400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:40.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.445+0000 7fd4f3400640 1 -- 172.21.15.90:0/305219142 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4017070 con 0x7fd4fc13fe80 2024-09-21T03:25:40.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.445+0000 7fd4f3400640 1 -- 172.21.15.90:0/305219142 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fd4e40052d0 con 0x7fd4fc13fe80 2024-09-21T03:25:40.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.445+0000 7fd4f3400640 1 -- 172.21.15.90:0/305219142 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4003850 con 0x7fd4fc13fe80 2024-09-21T03:25:40.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.445+0000 7fd501600640 1 -- 172.21.15.90:0/305219142 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4fc13cf70 con 0x7fd4fc13fe80 2024-09-21T03:25:40.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.445+0000 7fd501600640 1 -- 172.21.15.90:0/305219142 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4fc13d530 con 0x7fd4fc13fe80 2024-09-21T03:25:40.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.446+0000 7fd501600640 1 -- 172.21.15.90:0/305219142 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4fc13d730 con 0x7fd4fc13fe80 2024-09-21T03:25:40.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.447+0000 7fd4f3400640 1 -- 172.21.15.90:0/305219142 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd4e401a070 con 0x7fd4fc13fe80 2024-09-21T03:25:40.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.449+0000 7fd4f3400640 1 --2- 172.21.15.90:0/305219142 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd4d8078bc0 0x7fd4d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:40.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.449+0000 7fd4f3400640 1 -- 172.21.15.90:0/305219142 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6752+0+0 (secure 0 0 0) 0x7fd4e409a370 con 0x7fd4fc13fe80 2024-09-21T03:25:40.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.449+0000 7fd4faa00640 1 --2- 172.21.15.90:0/305219142 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd4d8078bc0 0x7fd4d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:40.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.450+0000 7fd4faa00640 1 --2- 172.21.15.90:0/305219142 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd4d8078bc0 0x7fd4d807b0d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec033000 tx=0x7fd4ec0046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:40.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.453+0000 7fd4f3400640 1 -- 172.21.15.90:0/305219142 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd4e4061de0 con 0x7fd4fc13fe80 2024-09-21T03:25:40.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:40.640+0000 7fd501600640 1 -- 172.21.15.90:0/305219142 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd4fc13f3b0 con 0x7fd4fc13fe80 2024-09-21T03:25:41.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.198+0000 7fd4f3400640 1 -- 172.21.15.90:0/305219142 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'a_metadata' removed v29) ==== 166+0+0 (secure 0 0 0) 0x7fd4e4066810 con 0x7fd4fc13fe80 2024-09-21T03:25:41.201 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'a_metadata' removed 2024-09-21T03:25:41.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.201+0000 7fd501600640 1 -- 172.21.15.90:0/305219142 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd4d8078bc0 msgr2=0x7fd4d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:41.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.201+0000 7fd501600640 1 --2- 172.21.15.90:0/305219142 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd4d8078bc0 0x7fd4d807b0d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec033000 tx=0x7fd4ec0046c0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.201+0000 7fd501600640 1 -- 172.21.15.90:0/305219142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc13fe80 msgr2=0x7fd4fc153c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:41.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.201+0000 7fd501600640 1 --2- 172.21.15.90:0/305219142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc13fe80 0x7fd4fc153c80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd4e400c3d0 tx=0x7fd4e400c890 comp rx=0 tx=0).stop 2024-09-21T03:25:41.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.201+0000 7fd501600640 1 -- 172.21.15.90:0/305219142 shutdown_connections 2024-09-21T03:25:41.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.201+0000 7fd501600640 1 --2- 172.21.15.90:0/305219142 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fd4d8078bc0 0x7fd4d807b0d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.201+0000 7fd501600640 1 --2- 172.21.15.90:0/305219142 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4fc156ca0 0x7fd4fc0c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.201+0000 7fd501600640 1 --2- 172.21.15.90:0/305219142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4fc13fe80 0x7fd4fc153c80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.201+0000 7fd501600640 1 --2- 172.21.15.90:0/305219142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4fc13f930 0x7fd4fc0ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.201+0000 7fd501600640 1 -- 172.21.15.90:0/305219142 >> 172.21.15.90:0/305219142 conn(0x7fd4fc0c85a0 msgr2=0x7fd4fc154e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:41.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.202+0000 7fd501600640 1 -- 172.21.15.90:0/305219142 shutdown_connections 2024-09-21T03:25:41.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.202+0000 7fd501600640 1 -- 172.21.15.90:0/305219142 wait complete. 2024-09-21T03:25:41.238 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_data a_data --yes-i-really-really-mean-it 2024-09-21T03:25:41.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.462+0000 7fcd54c00640 1 -- 172.21.15.90:0/2737744876 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd500ad600 msgr2=0x7fcd500ada10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:41.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.462+0000 7fcd54c00640 1 --2- 172.21.15.90:0/2737744876 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd500ad600 0x7fcd500ada10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcd500ac780 tx=0x7fcd4802aac0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.462+0000 7fcd54c00640 1 -- 172.21.15.90:0/2737744876 shutdown_connections 2024-09-21T03:25:41.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.462+0000 7fcd54c00640 1 --2- 172.21.15.90:0/2737744876 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd500ad600 0x7fcd500ada10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.462+0000 7fcd54c00640 1 --2- 172.21.15.90:0/2737744876 >> v2:172.21.15.149:3300/0 conn(0x7fcd501522b0 0x7fcd50073af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.462+0000 7fcd54c00640 1 -- 172.21.15.90:0/2737744876 >> 172.21.15.90:0/2737744876 conn(0x7fcd500c85a0 msgr2=0x7fcd500c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:41.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.462+0000 7fcd54c00640 1 -- 172.21.15.90:0/2737744876 shutdown_connections 2024-09-21T03:25:41.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.463+0000 7fcd54c00640 1 -- 172.21.15.90:0/2737744876 wait complete. 2024-09-21T03:25:41.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.464+0000 7fcd54c00640 1 Processor -- start 2024-09-21T03:25:41.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.465+0000 7fcd54c00640 1 -- start start 2024-09-21T03:25:41.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.466+0000 7fcd54c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd500abde0 0x7fcd5014b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:41.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.466+0000 7fcd54c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd500ad600 0x7fcd5006ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:41.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.466+0000 7fcd54c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd501522b0 0x7fcd501479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:41.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.466+0000 7fcd54c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcd50073080 con 0x7fcd501522b0 2024-09-21T03:25:41.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.466+0000 7fcd54c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcd50074030 con 0x7fcd500abde0 2024-09-21T03:25:41.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.466+0000 7fcd54c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcd5006fa50 con 0x7fcd500ad600 2024-09-21T03:25:41.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.466+0000 7fcd4e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd501522b0 0x7fcd501479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:41.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.466+0000 7fcd4e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd501522b0 0x7fcd501479e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35966/0 (socket says 172.21.15.90:35966) 2024-09-21T03:25:41.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.466+0000 7fcd4e800640 1 -- 172.21.15.90:0/2304118355 learned_addr learned my addr 172.21.15.90:0/2304118355 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:25:41.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.466+0000 7fcd4de00640 1 --2- 172.21.15.90:0/2304118355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd500abde0 0x7fcd5014b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:41.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.466+0000 7fcd4d400640 1 --2- 172.21.15.90:0/2304118355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd500ad600 0x7fcd5006ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:41.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.467+0000 7fcd4e800640 1 -- 172.21.15.90:0/2304118355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd500ad600 msgr2=0x7fcd5006ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:41.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.467+0000 7fcd4e800640 1 --2- 172.21.15.90:0/2304118355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd500ad600 0x7fcd5006ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.467+0000 7fcd4e800640 1 -- 172.21.15.90:0/2304118355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd500abde0 msgr2=0x7fcd5014b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:41.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.467+0000 7fcd4e800640 1 --2- 172.21.15.90:0/2304118355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd500abde0 0x7fcd5014b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.467+0000 7fcd4e800640 1 -- 172.21.15.90:0/2304118355 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd50158800 con 0x7fcd501522b0 2024-09-21T03:25:41.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.467+0000 7fcd4e800640 1 --2- 172.21.15.90:0/2304118355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd501522b0 0x7fcd501479e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009bf0 tx=0x7fcd48003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:41.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.467+0000 7fcd46000640 1 -- 172.21.15.90:0/2304118355 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd48044070 con 0x7fcd501522b0 2024-09-21T03:25:41.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.467+0000 7fcd46000640 1 -- 172.21.15.90:0/2304118355 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fcd48004250 con 0x7fcd501522b0 2024-09-21T03:25:41.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.467+0000 7fcd54c00640 1 -- 172.21.15.90:0/2304118355 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd50154eb0 con 0x7fcd501522b0 2024-09-21T03:25:41.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.467+0000 7fcd46000640 1 -- 172.21.15.90:0/2304118355 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd48004660 con 0x7fcd501522b0 2024-09-21T03:25:41.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.468+0000 7fcd54c00640 1 -- 172.21.15.90:0/2304118355 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd501f4c60 con 0x7fcd501522b0 2024-09-21T03:25:41.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.469+0000 7fcd54c00640 1 -- 172.21.15.90:0/2304118355 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd500adfa0 con 0x7fcd501522b0 2024-09-21T03:25:41.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.470+0000 7fcd46000640 1 -- 172.21.15.90:0/2304118355 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcd4802c990 con 0x7fcd501522b0 2024-09-21T03:25:41.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.471+0000 7fcd46000640 1 --2- 172.21.15.90:0/2304118355 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcd30078b90 0x7fcd3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:41.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.471+0000 7fcd46000640 1 -- 172.21.15.90:0/2304118355 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6324+0+0 (secure 0 0 0) 0x7fcd480bb760 con 0x7fcd501522b0 2024-09-21T03:25:41.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.471+0000 7fcd4de00640 1 --2- 172.21.15.90:0/2304118355 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcd30078b90 0x7fcd3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:41.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.472+0000 7fcd4de00640 1 --2- 172.21.15.90:0/2304118355 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcd30078b90 0x7fcd3007b0a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcd40001720 tx=0x7fcd40009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:41.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.476+0000 7fcd46000640 1 -- 172.21.15.90:0/2304118355 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcd50158800 con 0x7fcd501522b0 2024-09-21T03:25:41.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:41.664+0000 7fcd54c00640 1 -- 172.21.15.90:0/2304118355 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcd500adb30 con 0x7fcd501522b0 2024-09-21T03:25:42.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.201+0000 7fcd46000640 1 -- 172.21.15.90:0/2304118355 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true}]=0 pool 'a_data' removed v30) ==== 154+0+0 (secure 0 0 0) 0x7fcd48032030 con 0x7fcd501522b0 2024-09-21T03:25:42.203 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'a_data' removed 2024-09-21T03:25:42.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.205+0000 7fcd54c00640 1 -- 172.21.15.90:0/2304118355 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcd30078b90 msgr2=0x7fcd3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:42.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.205+0000 7fcd54c00640 1 --2- 172.21.15.90:0/2304118355 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcd30078b90 0x7fcd3007b0a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcd40001720 tx=0x7fcd40009040 comp rx=0 tx=0).stop 2024-09-21T03:25:42.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.205+0000 7fcd54c00640 1 -- 172.21.15.90:0/2304118355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd501522b0 msgr2=0x7fcd501479e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:42.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.205+0000 7fcd54c00640 1 --2- 172.21.15.90:0/2304118355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd501522b0 0x7fcd501479e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009bf0 tx=0x7fcd48003ce0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.205+0000 7fcd54c00640 1 -- 172.21.15.90:0/2304118355 shutdown_connections 2024-09-21T03:25:42.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.205+0000 7fcd54c00640 1 --2- 172.21.15.90:0/2304118355 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fcd30078b90 0x7fcd3007b0a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.205+0000 7fcd54c00640 1 --2- 172.21.15.90:0/2304118355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd501522b0 0x7fcd501479e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.205+0000 7fcd54c00640 1 --2- 172.21.15.90:0/2304118355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd500ad600 0x7fcd5006ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.205+0000 7fcd54c00640 1 --2- 172.21.15.90:0/2304118355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd500abde0 0x7fcd5014b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.206+0000 7fcd54c00640 1 -- 172.21.15.90:0/2304118355 >> 172.21.15.90:0/2304118355 conn(0x7fcd500c85a0 msgr2=0x7fcd5014da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:42.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.207+0000 7fcd54c00640 1 -- 172.21.15.90:0/2304118355 shutdown_connections 2024-09-21T03:25:42.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.207+0000 7fcd54c00640 1 -- 172.21.15.90:0/2304118355 wait complete. 2024-09-21T03:25:42.255 INFO:tasks.cephfs.filesystem:Destroying file system b and related pools 2024-09-21T03:25:42.255 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:25:42.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.532+0000 7f9fb8c00640 1 -- 172.21.15.90:0/2702055175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fb4074220 msgr2=0x7f9fb4074630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:42.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.532+0000 7f9fb8c00640 1 --2- 172.21.15.90:0/2702055175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fb4074220 0x7f9fb4074630 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9fac005fd0 tx=0x7f9fac02aa10 comp rx=0 tx=0).stop 2024-09-21T03:25:42.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.532+0000 7f9fb8c00640 1 -- 172.21.15.90:0/2702055175 shutdown_connections 2024-09-21T03:25:42.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.532+0000 7f9fb8c00640 1 --2- 172.21.15.90:0/2702055175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fb4074220 0x7f9fb4074630 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.532+0000 7f9fb8c00640 1 --2- 172.21.15.90:0/2702055175 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb406d960 0x7f9fb413dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.532+0000 7f9fb8c00640 1 -- 172.21.15.90:0/2702055175 >> 172.21.15.90:0/2702055175 conn(0x7f9fb40c8ba0 msgr2=0x7f9fb406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:42.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.532+0000 7f9fb8c00640 1 -- 172.21.15.90:0/2702055175 shutdown_connections 2024-09-21T03:25:42.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.532+0000 7f9fb8c00640 1 -- 172.21.15.90:0/2702055175 wait complete. 2024-09-21T03:25:42.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.534+0000 7f9fb8c00640 1 Processor -- start 2024-09-21T03:25:42.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.534+0000 7f9fb8c00640 1 -- start start 2024-09-21T03:25:42.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.536+0000 7f9fb8c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb406d960 0x7f9fb40c0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:42.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.536+0000 7f9fb8c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fb4074220 0x7f9fb40c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:42.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.536+0000 7f9fb8c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb40ac350 0x7f9fb41571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:42.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.536+0000 7f9fb8c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb40ab640 con 0x7f9fb4074220 2024-09-21T03:25:42.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.536+0000 7f9fb8c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb40ab360 con 0x7f9fb406d960 2024-09-21T03:25:42.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.536+0000 7f9fb8c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb40ace70 con 0x7f9fb40ac350 2024-09-21T03:25:42.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.536+0000 7f9fabe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fb4074220 0x7f9fb40c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:42.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.536+0000 7f9fabe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fb4074220 0x7f9fb40c10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35984/0 (socket says 172.21.15.90:35984) 2024-09-21T03:25:42.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.536+0000 7f9fabe00640 1 -- 172.21.15.90:0/1681422461 learned_addr learned my addr 172.21.15.90:0/1681422461 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:25:42.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.536+0000 7f9fb2800640 1 --2- 172.21.15.90:0/1681422461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb40ac350 0x7f9fb41571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:42.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.536+0000 7f9fb1e00640 1 --2- 172.21.15.90:0/1681422461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb406d960 0x7f9fb40c0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:42.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.536+0000 7f9fabe00640 1 -- 172.21.15.90:0/1681422461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb40ac350 msgr2=0x7f9fb41571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:42.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.536+0000 7f9fabe00640 1 --2- 172.21.15.90:0/1681422461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb40ac350 0x7f9fb41571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.536+0000 7f9fabe00640 1 -- 172.21.15.90:0/1681422461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb406d960 msgr2=0x7f9fb40c0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:42.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.536+0000 7f9fabe00640 1 --2- 172.21.15.90:0/1681422461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb406d960 0x7f9fb40c0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.536+0000 7f9fabe00640 1 -- 172.21.15.90:0/1681422461 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb40c1be0 con 0x7f9fb4074220 2024-09-21T03:25:42.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.537+0000 7f9fabe00640 1 --2- 172.21.15.90:0/1681422461 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fb4074220 0x7f9fb40c10d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00c460 tx=0x7f9f9c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:42.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.537+0000 7f9faa000640 1 -- 172.21.15.90:0/1681422461 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c017070 con 0x7f9fb4074220 2024-09-21T03:25:42.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.537+0000 7f9faa000640 1 -- 172.21.15.90:0/1681422461 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f9f9c0052d0 con 0x7f9fb4074220 2024-09-21T03:25:42.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.537+0000 7f9fb8c00640 1 -- 172.21.15.90:0/1681422461 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb41ebaf0 con 0x7f9fb4074220 2024-09-21T03:25:42.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.537+0000 7f9faa000640 1 -- 172.21.15.90:0/1681422461 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c003850 con 0x7f9fb4074220 2024-09-21T03:25:42.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.537+0000 7f9fb8c00640 1 -- 172.21.15.90:0/1681422461 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb41eb810 con 0x7f9fb4074220 2024-09-21T03:25:42.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.538+0000 7f9fb8c00640 1 -- 172.21.15.90:0/1681422461 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fb41eb630 con 0x7f9fb4074220 2024-09-21T03:25:42.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.539+0000 7f9faa000640 1 -- 172.21.15.90:0/1681422461 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9f9c01a070 con 0x7f9fb4074220 2024-09-21T03:25:42.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.540+0000 7f9faa000640 1 --2- 172.21.15.90:0/1681422461 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9f90078b90 0x7f9f9007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:42.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.540+0000 7f9faa000640 1 -- 172.21.15.90:0/1681422461 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5891+0+0 (secure 0 0 0) 0x7f9f9c09a0e0 con 0x7f9fb4074220 2024-09-21T03:25:42.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.541+0000 7f9fb1e00640 1 --2- 172.21.15.90:0/1681422461 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9f90078b90 0x7f9f9007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:42.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.541+0000 7f9fb1e00640 1 --2- 172.21.15.90:0/1681422461 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9f90078b90 0x7f9f9007b0a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4005fd0 tx=0x7f9fa400b4f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:42.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.545+0000 7f9faa000640 1 -- 172.21.15.90:0/1681422461 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9fb41eb630 con 0x7f9fb4074220 2024-09-21T03:25:42.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.778+0000 7f9fb8c00640 1 -- 172.21.15.90:0/1681422461 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fb4074d30 con 0x7f9fb4074220 2024-09-21T03:25:42.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.779+0000 7f9faa000640 1 -- 172.21.15.90:0/1681422461 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5224 (secure 0 0 0) 0x7f9fb40c1be0 con 0x7f9fb4074220 2024-09-21T03:25:42.781 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:25:42.781 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":16,"btime":"2024-09-21T03:25:40:189389+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3707484056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3707484056},{"type":"v1","addr":"172.21.15.90:6835","nonce":3707484056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1650707992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1650707992},{"type":"v1","addr":"172.21.15.149:6837","nonce":1650707992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":94273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2050311761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2050311761},{"type":"v1","addr":"172.21.15.149:6836","nonce":2050311761}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:47.021969+0000","modified":"2024-09-21T03:14:51.055397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4395},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4395":{"gid":4395,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6833/1105275899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1105275899},{"type":"v1","addr":"172.21.15.90:6833","nonce":1105275899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4395,"qdb_cluster":[4395]},"id":2}]} 2024-09-21T03:25:42.782 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 16 2024-09-21T03:25:42.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.783+0000 7f9fb8c00640 1 -- 172.21.15.90:0/1681422461 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9f90078b90 msgr2=0x7f9f9007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:42.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.783+0000 7f9fb8c00640 1 --2- 172.21.15.90:0/1681422461 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9f90078b90 0x7f9f9007b0a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4005fd0 tx=0x7f9fa400b4f0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.783+0000 7f9fb8c00640 1 -- 172.21.15.90:0/1681422461 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fb4074220 msgr2=0x7f9fb40c10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:42.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.783+0000 7f9fb8c00640 1 --2- 172.21.15.90:0/1681422461 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fb4074220 0x7f9fb40c10d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00c460 tx=0x7f9f9c00c920 comp rx=0 tx=0).stop 2024-09-21T03:25:42.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.783+0000 7f9fb8c00640 1 -- 172.21.15.90:0/1681422461 shutdown_connections 2024-09-21T03:25:42.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.783+0000 7f9fb8c00640 1 --2- 172.21.15.90:0/1681422461 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9f90078b90 0x7f9f9007b0a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.783+0000 7f9fb8c00640 1 --2- 172.21.15.90:0/1681422461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb40ac350 0x7f9fb41571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.783+0000 7f9fb8c00640 1 --2- 172.21.15.90:0/1681422461 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fb4074220 0x7f9fb40c10d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.783+0000 7f9fb8c00640 1 --2- 172.21.15.90:0/1681422461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb406d960 0x7f9fb40c0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.783+0000 7f9fb8c00640 1 -- 172.21.15.90:0/1681422461 >> 172.21.15.90:0/1681422461 conn(0x7f9fb40c8ba0 msgr2=0x7f9fb40c4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:42.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.785+0000 7f9fb8c00640 1 -- 172.21.15.90:0/1681422461 shutdown_connections 2024-09-21T03:25:42.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:42.785+0000 7f9fb8c00640 1 -- 172.21.15.90:0/1681422461 wait complete. 2024-09-21T03:25:42.822 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:25:43.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.052+0000 7f9e68800640 1 -- 172.21.15.90:0/2443589479 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e600ac350 msgr2=0x7f9e600ac760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:43.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.052+0000 7f9e68800640 1 --2- 172.21.15.90:0/2443589479 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e600ac350 0x7f9e600ac760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009860 tx=0x7f9e5002a510 comp rx=0 tx=0).stop 2024-09-21T03:25:43.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.052+0000 7f9e68800640 1 -- 172.21.15.90:0/2443589479 shutdown_connections 2024-09-21T03:25:43.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.052+0000 7f9e68800640 1 --2- 172.21.15.90:0/2443589479 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e600ac350 0x7f9e600ac760 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.052+0000 7f9e68800640 1 -- 172.21.15.90:0/2443589479 >> 172.21.15.90:0/2443589479 conn(0x7f9e600c8ba0 msgr2=0x7f9e6006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:43.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.052+0000 7f9e68800640 1 -- 172.21.15.90:0/2443589479 shutdown_connections 2024-09-21T03:25:43.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.052+0000 7f9e68800640 1 -- 172.21.15.90:0/2443589479 wait complete. 2024-09-21T03:25:43.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.054+0000 7f9e68800640 1 Processor -- start 2024-09-21T03:25:43.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.054+0000 7f9e68800640 1 -- start start 2024-09-21T03:25:43.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.056+0000 7f9e68800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e6006d960 0x7f9e600c1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:43.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.056+0000 7f9e68800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e600ac350 0x7f9e60157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:43.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.056+0000 7f9e68800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e600acca0 0x7f9e60139b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:43.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.056+0000 7f9e68800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9e60074930 con 0x7f9e600acca0 2024-09-21T03:25:43.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.056+0000 7f9e68800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9e600abec0 con 0x7f9e6006d960 2024-09-21T03:25:43.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.056+0000 7f9e68800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9e60074ab0 con 0x7f9e600ac350 2024-09-21T03:25:43.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.056+0000 7f9e66800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e600acca0 0x7f9e60139b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:43.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.056+0000 7f9e66800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e600acca0 0x7f9e60139b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36000/0 (socket says 172.21.15.90:36000) 2024-09-21T03:25:43.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.056+0000 7f9e66800640 1 -- 172.21.15.90:0/125749026 learned_addr learned my addr 172.21.15.90:0/125749026 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:25:43.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.056+0000 7f9e65400640 1 --2- 172.21.15.90:0/125749026 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e600ac350 0x7f9e60157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:43.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.056+0000 7f9e65e00640 1 --2- 172.21.15.90:0/125749026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e6006d960 0x7f9e600c1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:43.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.057+0000 7f9e66800640 1 -- 172.21.15.90:0/125749026 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e600ac350 msgr2=0x7f9e60157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:43.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.057+0000 7f9e66800640 1 --2- 172.21.15.90:0/125749026 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e600ac350 0x7f9e60157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.057+0000 7f9e66800640 1 -- 172.21.15.90:0/125749026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e6006d960 msgr2=0x7f9e600c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:43.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.057+0000 7f9e66800640 1 --2- 172.21.15.90:0/125749026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e6006d960 0x7f9e600c1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.057+0000 7f9e66800640 1 -- 172.21.15.90:0/125749026 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6014d9b0 con 0x7f9e600acca0 2024-09-21T03:25:43.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.057+0000 7f9e65400640 1 --2- 172.21.15.90:0/125749026 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e600ac350 0x7f9e60157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:43.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.057+0000 7f9e66800640 1 --2- 172.21.15.90:0/125749026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e600acca0 0x7f9e60139b20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c00c730 tx=0x7f9e5c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:43.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.057+0000 7f9e5a000640 1 -- 172.21.15.90:0/125749026 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c003b70 con 0x7f9e600acca0 2024-09-21T03:25:43.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.057+0000 7f9e68800640 1 -- 172.21.15.90:0/125749026 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e601edd90 con 0x7f9e600acca0 2024-09-21T03:25:43.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.057+0000 7f9e5a000640 1 -- 172.21.15.90:0/125749026 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f9e5c003d10 con 0x7f9e600acca0 2024-09-21T03:25:43.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.057+0000 7f9e5a000640 1 -- 172.21.15.90:0/125749026 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c00aab0 con 0x7f9e600acca0 2024-09-21T03:25:43.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.057+0000 7f9e68800640 1 -- 172.21.15.90:0/125749026 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e60070400 con 0x7f9e600acca0 2024-09-21T03:25:43.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.058+0000 7f9e68800640 1 -- 172.21.15.90:0/125749026 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e600ac760 con 0x7f9e600acca0 2024-09-21T03:25:43.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.060+0000 7f9e5a000640 1 -- 172.21.15.90:0/125749026 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e5c00ac50 con 0x7f9e600acca0 2024-09-21T03:25:43.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.061+0000 7f9e5a000640 1 --2- 172.21.15.90:0/125749026 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9e44078b90 0x7f9e4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:43.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.061+0000 7f9e5a000640 1 -- 172.21.15.90:0/125749026 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5891+0+0 (secure 0 0 0) 0x7f9e5c09ad80 con 0x7f9e600acca0 2024-09-21T03:25:43.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.061+0000 7f9e65e00640 1 --2- 172.21.15.90:0/125749026 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9e44078b90 0x7f9e4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:43.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.062+0000 7f9e65e00640 1 --2- 172.21.15.90:0/125749026 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9e44078b90 0x7f9e4407b0a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9e600c5ca0 tx=0x7f9e54009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:43.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.065+0000 7f9e5a000640 1 -- 172.21.15.90:0/125749026 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9e5c063070 con 0x7f9e600acca0 2024-09-21T03:25:43.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.288+0000 7f9e68800640 1 -- 172.21.15.90:0/125749026 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e60154150 con 0x7f9e600acca0 2024-09-21T03:25:43.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.289+0000 7f9e5a000640 1 -- 172.21.15.90:0/125749026 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5224 (secure 0 0 0) 0x7f9e5c062970 con 0x7f9e600acca0 2024-09-21T03:25:43.291 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:25:43.291 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":16,"btime":"2024-09-21T03:25:40:189389+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3707484056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3707484056},{"type":"v1","addr":"172.21.15.90:6835","nonce":3707484056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4319,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1650707992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1650707992},{"type":"v1","addr":"172.21.15.149:6837","nonce":1650707992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":94273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2050311761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2050311761},{"type":"v1","addr":"172.21.15.149:6836","nonce":2050311761}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:14:47.021969+0000","modified":"2024-09-21T03:14:51.055397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4395},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4395":{"gid":4395,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6833/1105275899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1105275899},{"type":"v1","addr":"172.21.15.90:6833","nonce":1105275899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4395,"qdb_cluster":[4395]},"id":2}]} 2024-09-21T03:25:43.291 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 16 2024-09-21T03:25:43.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.291+0000 7f9e68800640 1 -- 172.21.15.90:0/125749026 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9e44078b90 msgr2=0x7f9e4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:43.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.291+0000 7f9e68800640 1 --2- 172.21.15.90:0/125749026 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9e44078b90 0x7f9e4407b0a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9e600c5ca0 tx=0x7f9e54009040 comp rx=0 tx=0).stop 2024-09-21T03:25:43.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.291+0000 7f9e68800640 1 -- 172.21.15.90:0/125749026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e600acca0 msgr2=0x7f9e60139b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:43.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.291+0000 7f9e68800640 1 --2- 172.21.15.90:0/125749026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e600acca0 0x7f9e60139b20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c00c730 tx=0x7f9e5c00cbf0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.291+0000 7f9e68800640 1 -- 172.21.15.90:0/125749026 shutdown_connections 2024-09-21T03:25:43.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.291+0000 7f9e68800640 1 --2- 172.21.15.90:0/125749026 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f9e44078b90 0x7f9e4407b0a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.291+0000 7f9e68800640 1 --2- 172.21.15.90:0/125749026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e600acca0 0x7f9e60139b20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.291+0000 7f9e68800640 1 --2- 172.21.15.90:0/125749026 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e600ac350 0x7f9e60157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.291+0000 7f9e68800640 1 --2- 172.21.15.90:0/125749026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e6006d960 0x7f9e600c1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.291+0000 7f9e68800640 1 -- 172.21.15.90:0/125749026 >> 172.21.15.90:0/125749026 conn(0x7f9e600c8ba0 msgr2=0x7f9e6013b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:43.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.291+0000 7f9e68800640 1 -- 172.21.15.90:0/125749026 shutdown_connections 2024-09-21T03:25:43.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.291+0000 7f9e68800640 1 -- 172.21.15.90:0/125749026 wait complete. 2024-09-21T03:25:43.319 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:25:43.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.539+0000 7f8b5fe00640 1 -- 172.21.15.90:0/3458657204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b580c4210 msgr2=0x7f8b580749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:43.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.539+0000 7f8b5fe00640 1 --2- 172.21.15.90:0/3458657204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b580c4210 0x7f8b580749a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8b44009900 tx=0x7f8b4402a580 comp rx=0 tx=0).stop 2024-09-21T03:25:43.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.539+0000 7f8b5fe00640 1 -- 172.21.15.90:0/3458657204 shutdown_connections 2024-09-21T03:25:43.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.539+0000 7f8b5fe00640 1 --2- 172.21.15.90:0/3458657204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8b580ac200 0x7f8b580ac610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.539+0000 7f8b5fe00640 1 --2- 172.21.15.90:0/3458657204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b580c4210 0x7f8b580749a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.539+0000 7f8b5fe00640 1 -- 172.21.15.90:0/3458657204 >> 172.21.15.90:0/3458657204 conn(0x7f8b580c8ba0 msgr2=0x7f8b5806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:43.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.539+0000 7f8b5fe00640 1 -- 172.21.15.90:0/3458657204 shutdown_connections 2024-09-21T03:25:43.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.539+0000 7f8b5fe00640 1 -- 172.21.15.90:0/3458657204 wait complete. 2024-09-21T03:25:43.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.541+0000 7f8b5fe00640 1 Processor -- start 2024-09-21T03:25:43.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.541+0000 7f8b5fe00640 1 -- start start 2024-09-21T03:25:43.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.542+0000 7f8b5fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b58072a70 0x7f8b5814faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:43.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.542+0000 7f8b5fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8b580ac200 0x7f8b581514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:43.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.542+0000 7f8b5fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b580c4210 0x7f8b580c1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:43.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.542+0000 7f8b5fe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8b58073c70 con 0x7f8b58072a70 2024-09-21T03:25:43.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.542+0000 7f8b5fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8b581556a0 con 0x7f8b580c4210 2024-09-21T03:25:43.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.542+0000 7f8b5fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8b58073df0 con 0x7f8b580ac200 2024-09-21T03:25:43.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.543+0000 7f8b5d400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b58072a70 0x7f8b5814faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:43.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.543+0000 7f8b5d400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b58072a70 0x7f8b5814faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36006/0 (socket says 172.21.15.90:36006) 2024-09-21T03:25:43.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.543+0000 7f8b5d400640 1 -- 172.21.15.90:0/1982833723 learned_addr learned my addr 172.21.15.90:0/1982833723 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:25:43.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.543+0000 7f8b5de00640 1 --2- 172.21.15.90:0/1982833723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b580c4210 0x7f8b580c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:43.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.543+0000 7f8b5ca00640 1 --2- 172.21.15.90:0/1982833723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8b580ac200 0x7f8b581514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:43.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.543+0000 7f8b5d400640 1 -- 172.21.15.90:0/1982833723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8b580ac200 msgr2=0x7f8b581514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:43.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.543+0000 7f8b5d400640 1 --2- 172.21.15.90:0/1982833723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8b580ac200 0x7f8b581514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.543+0000 7f8b5d400640 1 -- 172.21.15.90:0/1982833723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b580c4210 msgr2=0x7f8b580c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:43.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.543+0000 7f8b5d400640 1 --2- 172.21.15.90:0/1982833723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b580c4210 0x7f8b580c1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.543+0000 7f8b5d400640 1 -- 172.21.15.90:0/1982833723 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b581eb2b0 con 0x7f8b58072a70 2024-09-21T03:25:43.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.543+0000 7f8b5d400640 1 --2- 172.21.15.90:0/1982833723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b58072a70 0x7f8b5814faa0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00c3d0 tx=0x7f8b4c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:43.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.544+0000 7f8b55600640 1 -- 172.21.15.90:0/1982833723 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c017070 con 0x7f8b58072a70 2024-09-21T03:25:43.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.544+0000 7f8b55600640 1 -- 172.21.15.90:0/1982833723 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f8b4c0052d0 con 0x7f8b58072a70 2024-09-21T03:25:43.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.544+0000 7f8b55600640 1 -- 172.21.15.90:0/1982833723 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c003850 con 0x7f8b58072a70 2024-09-21T03:25:43.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.544+0000 7f8b5fe00640 1 -- 172.21.15.90:0/1982833723 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b58154150 con 0x7f8b58072a70 2024-09-21T03:25:43.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.544+0000 7f8b5fe00640 1 -- 172.21.15.90:0/1982833723 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b5814f580 con 0x7f8b58072a70 2024-09-21T03:25:43.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.545+0000 7f8b5fe00640 1 -- 172.21.15.90:0/1982833723 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b5814f090 con 0x7f8b58072a70 2024-09-21T03:25:43.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.546+0000 7f8b55600640 1 -- 172.21.15.90:0/1982833723 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b4c01a070 con 0x7f8b58072a70 2024-09-21T03:25:43.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.547+0000 7f8b55600640 1 --2- 172.21.15.90:0/1982833723 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8b38078bc0 0x7f8b3807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:43.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.547+0000 7f8b55600640 1 -- 172.21.15.90:0/1982833723 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5891+0+0 (secure 0 0 0) 0x7f8b4c09a130 con 0x7f8b58072a70 2024-09-21T03:25:43.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.547+0000 7f8b5ca00640 1 --2- 172.21.15.90:0/1982833723 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8b38078bc0 0x7f8b3807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:43.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.548+0000 7f8b5ca00640 1 --2- 172.21.15.90:0/1982833723 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8b38078bc0 0x7f8b3807b0d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8b44033000 tx=0x7f8b440046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:43.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.551+0000 7f8b55600640 1 -- 172.21.15.90:0/1982833723 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8b4c061e60 con 0x7f8b58072a70 2024-09-21T03:25:43.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.786+0000 7f8b5fe00640 1 -- 172.21.15.90:0/1982833723 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b580acc80 con 0x7f8b58072a70 2024-09-21T03:25:43.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.787+0000 7f8b55600640 1 -- 172.21.15.90:0/1982833723 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+17042 (secure 0 0 0) 0x7f8b4c066890 con 0x7f8b58072a70 2024-09-21T03:25:43.789 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T03:25:43.789 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":30,"fsid":"03c7e55f-7aae-4606-9d16-02ae95467377","created":"2024-09-21T03:14:09.323302+0000","modified":"2024-09-21T03:25:42.199702+0000","last_up_change":"2024-09-21T03:14:25.329650+0000","last_in_change":"2024-09-21T03:14:15.386953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:14:24.511246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-21T03:14:45.298287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-21T03:14:45.977111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ceaacfab-e71c-45e2-ac50-4597dfd460bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6809","nonce":3187794863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6811","nonce":3187794863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6815","nonce":3187794863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3187794863},{"type":"v1","addr":"172.21.15.90:6813","nonce":3187794863}]},"public_addr":"172.21.15.90:6809/3187794863","cluster_addr":"172.21.15.90:6811/3187794863","heartbeat_back_addr":"172.21.15.90:6815/3187794863","heartbeat_front_addr":"172.21.15.90:6813/3187794863","state":["exists","up"]},{"osd":1,"uuid":"86f91523-232b-4e80-ada7-d9e12770adb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6801","nonce":3769758484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6803","nonce":3769758484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6807","nonce":3769758484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3769758484},{"type":"v1","addr":"172.21.15.90:6805","nonce":3769758484}]},"public_addr":"172.21.15.90:6801/3769758484","cluster_addr":"172.21.15.90:6803/3769758484","heartbeat_back_addr":"172.21.15.90:6807/3769758484","heartbeat_front_addr":"172.21.15.90:6805/3769758484","state":["exists","up"]},{"osd":2,"uuid":"6eb0f47b-e767-49c0-8d72-07f71b9c2e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6825","nonce":1025535744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6827","nonce":1025535744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6831","nonce":1025535744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1025535744},{"type":"v1","addr":"172.21.15.90:6829","nonce":1025535744}]},"public_addr":"172.21.15.90:6825/1025535744","cluster_addr":"172.21.15.90:6827/1025535744","heartbeat_back_addr":"172.21.15.90:6831/1025535744","heartbeat_front_addr":"172.21.15.90:6829/1025535744","state":["exists","up"]},{"osd":3,"uuid":"64418862-beef-479c-be11-dfe0e515e09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6817","nonce":1515884437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6819","nonce":1515884437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6823","nonce":1515884437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":1515884437},{"type":"v1","addr":"172.21.15.90:6821","nonce":1515884437}]},"public_addr":"172.21.15.90:6817/1515884437","cluster_addr":"172.21.15.90:6819/1515884437","heartbeat_back_addr":"172.21.15.90:6823/1515884437","heartbeat_front_addr":"172.21.15.90:6821/1515884437","state":["exists","up"]},{"osd":4,"uuid":"a05b63f4-ec0a-426c-9d60-285e2680a897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6816","nonce":4278726553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6820","nonce":4278726553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6825","nonce":4278726553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":4278726553},{"type":"v1","addr":"172.21.15.149:6823","nonce":4278726553}]},"public_addr":"172.21.15.149:6816/4278726553","cluster_addr":"172.21.15.149:6820/4278726553","heartbeat_back_addr":"172.21.15.149:6825/4278726553","heartbeat_front_addr":"172.21.15.149:6823/4278726553","state":["exists","up"]},{"osd":5,"uuid":"3a1bab89-963c-4fe7-b14f-3080c5cf7830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6827","nonce":1341677333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6829","nonce":1341677333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6833","nonce":1341677333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1341677333},{"type":"v1","addr":"172.21.15.149:6831","nonce":1341677333}]},"public_addr":"172.21.15.149:6827/1341677333","cluster_addr":"172.21.15.149:6829/1341677333","heartbeat_back_addr":"172.21.15.149:6833/1341677333","heartbeat_front_addr":"172.21.15.149:6831/1341677333","state":["exists","up"]},{"osd":6,"uuid":"bfcd1596-2688-4deb-be2e-55f305a5b4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6811","nonce":821196931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6813","nonce":821196931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6821","nonce":821196931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":821196931},{"type":"v1","addr":"172.21.15.149:6817","nonce":821196931}]},"public_addr":"172.21.15.149:6811/821196931","cluster_addr":"172.21.15.149:6813/821196931","heartbeat_back_addr":"172.21.15.149:6821/821196931","heartbeat_front_addr":"172.21.15.149:6817/821196931","state":["exists","up"]},{"osd":7,"uuid":"58b19790-4006-4f07-966c-911b938cc1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6803","nonce":1657326880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6805","nonce":1657326880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6809","nonce":1657326880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1657326880},{"type":"v1","addr":"172.21.15.149:6807","nonce":1657326880}]},"public_addr":"172.21.15.149:6803/1657326880","cluster_addr":"172.21.15.149:6805/1657326880","heartbeat_back_addr":"172.21.15.149:6809/1657326880","heartbeat_front_addr":"172.21.15.149:6807/1657326880","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.399701+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.051745+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.190159+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:23.240143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.446570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.259974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:21.990407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:14:22.459259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.14","mappings":[{"from":4,"to":5}]},{"pgid":"5.1c","mappings":[{"from":4,"to":5}]},{"pgid":"5.23","mappings":[{"from":4,"to":5}]},{"pgid":"5.32","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.149:6836/2166962836":"2024-09-22T03:25:39.169069+0000","172.21.15.149:6834/2166962836":"2024-09-22T03:25:39.169069+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:25:43.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.789+0000 7f8b5fe00640 1 -- 172.21.15.90:0/1982833723 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8b38078bc0 msgr2=0x7f8b3807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:43.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.789+0000 7f8b5fe00640 1 --2- 172.21.15.90:0/1982833723 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8b38078bc0 0x7f8b3807b0d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8b44033000 tx=0x7f8b440046c0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.789+0000 7f8b5fe00640 1 -- 172.21.15.90:0/1982833723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b58072a70 msgr2=0x7f8b5814faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:43.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.789+0000 7f8b5fe00640 1 --2- 172.21.15.90:0/1982833723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b58072a70 0x7f8b5814faa0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00c3d0 tx=0x7f8b4c00c890 comp rx=0 tx=0).stop 2024-09-21T03:25:43.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.790+0000 7f8b5fe00640 1 -- 172.21.15.90:0/1982833723 shutdown_connections 2024-09-21T03:25:43.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.790+0000 7f8b5fe00640 1 --2- 172.21.15.90:0/1982833723 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f8b38078bc0 0x7f8b3807b0d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.790+0000 7f8b5fe00640 1 --2- 172.21.15.90:0/1982833723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b580c4210 0x7f8b580c1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.790+0000 7f8b5fe00640 1 --2- 172.21.15.90:0/1982833723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8b580ac200 0x7f8b581514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.790+0000 7f8b5fe00640 1 --2- 172.21.15.90:0/1982833723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b58072a70 0x7f8b5814faa0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.790+0000 7f8b5fe00640 1 -- 172.21.15.90:0/1982833723 >> 172.21.15.90:0/1982833723 conn(0x7f8b580c8ba0 msgr2=0x7f8b58154960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:43.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.790+0000 7f8b5fe00640 1 -- 172.21.15.90:0/1982833723 shutdown_connections 2024-09-21T03:25:43.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:43.790+0000 7f8b5fe00640 1 -- 172.21.15.90:0/1982833723 wait complete. 2024-09-21T03:25:43.815 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail b 2024-09-21T03:25:44.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.038+0000 7f238aa00640 1 -- 172.21.15.90:0/2962709669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f238414b5a0 msgr2=0x7f23840c4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:44.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.038+0000 7f238aa00640 1 --2- 172.21.15.90:0/2962709669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f238414b5a0 0x7f23840c4f20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2370005fd0 tx=0x7f237002a4b0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.038+0000 7f238aa00640 1 -- 172.21.15.90:0/2962709669 shutdown_connections 2024-09-21T03:25:44.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.038+0000 7f238aa00640 1 --2- 172.21.15.90:0/2962709669 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23840c5460 0x7f238406f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.038+0000 7f238aa00640 1 --2- 172.21.15.90:0/2962709669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f238414b5a0 0x7f23840c4f20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.038+0000 7f238aa00640 1 -- 172.21.15.90:0/2962709669 >> 172.21.15.90:0/2962709669 conn(0x7f238406d200 msgr2=0x7f238406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:44.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.038+0000 7f238aa00640 1 -- 172.21.15.90:0/2962709669 shutdown_connections 2024-09-21T03:25:44.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.038+0000 7f238aa00640 1 -- 172.21.15.90:0/2962709669 wait complete. 2024-09-21T03:25:44.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.040+0000 7f238aa00640 1 Processor -- start 2024-09-21T03:25:44.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.040+0000 7f238aa00640 1 -- start start 2024-09-21T03:25:44.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.042+0000 7f238aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23840ad310 0x7f23841ee040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:44.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.042+0000 7f238aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23840c5460 0x7f23840c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:44.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.042+0000 7f238aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f238414b5a0 0x7f23841532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:44.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.042+0000 7f238aa00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f238406fe60 con 0x7f23840ad310 2024-09-21T03:25:44.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.042+0000 7f238aa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f23840ab0f0 con 0x7f23840c5460 2024-09-21T03:25:44.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.042+0000 7f238aa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f238406ffe0 con 0x7f238414b5a0 2024-09-21T03:25:44.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.042+0000 7f2389600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23840ad310 0x7f23841ee040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:44.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.042+0000 7f2389600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23840ad310 0x7f23841ee040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36034/0 (socket says 172.21.15.90:36034) 2024-09-21T03:25:44.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.042+0000 7f2389600640 1 -- 172.21.15.90:0/3754379696 learned_addr learned my addr 172.21.15.90:0/3754379696 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:25:44.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.042+0000 7f238a000640 1 --2- 172.21.15.90:0/3754379696 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f238414b5a0 0x7f23841532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:44.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.042+0000 7f2388c00640 1 --2- 172.21.15.90:0/3754379696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23840c5460 0x7f23840c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:44.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.042+0000 7f2389600640 1 -- 172.21.15.90:0/3754379696 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f238414b5a0 msgr2=0x7f23841532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:44.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.042+0000 7f2389600640 1 --2- 172.21.15.90:0/3754379696 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f238414b5a0 0x7f23841532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.042+0000 7f2389600640 1 -- 172.21.15.90:0/3754379696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23840c5460 msgr2=0x7f23840c14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:44.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.042+0000 7f2389600640 1 --2- 172.21.15.90:0/3754379696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23840c5460 0x7f23840c14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.042+0000 7f2389600640 1 -- 172.21.15.90:0/3754379696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23841de650 con 0x7f23840ad310 2024-09-21T03:25:44.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.043+0000 7f2389600640 1 --2- 172.21.15.90:0/3754379696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23840ad310 0x7f23841ee040 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f237800c3a0 tx=0x7f237800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:44.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.043+0000 7f2381600640 1 -- 172.21.15.90:0/3754379696 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378017070 con 0x7f23840ad310 2024-09-21T03:25:44.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.043+0000 7f2381600640 1 -- 172.21.15.90:0/3754379696 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f23780052d0 con 0x7f23840ad310 2024-09-21T03:25:44.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.043+0000 7f2381600640 1 -- 172.21.15.90:0/3754379696 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378003850 con 0x7f23840ad310 2024-09-21T03:25:44.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.043+0000 7f238aa00640 1 -- 172.21.15.90:0/3754379696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2384153d90 con 0x7f23840ad310 2024-09-21T03:25:44.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.043+0000 7f238aa00640 1 -- 172.21.15.90:0/3754379696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23841edb20 con 0x7f23840ad310 2024-09-21T03:25:44.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.044+0000 7f238aa00640 1 -- 172.21.15.90:0/3754379696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23840c8e70 con 0x7f23840ad310 2024-09-21T03:25:44.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.045+0000 7f2381600640 1 -- 172.21.15.90:0/3754379696 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f237801a070 con 0x7f23840ad310 2024-09-21T03:25:44.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.047+0000 7f2381600640 1 --2- 172.21.15.90:0/3754379696 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2364078b90 0x7f236407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:44.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.047+0000 7f2381600640 1 -- 172.21.15.90:0/3754379696 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5891+0+0 (secure 0 0 0) 0x7f237809a1d0 con 0x7f23840ad310 2024-09-21T03:25:44.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.047+0000 7f2388c00640 1 --2- 172.21.15.90:0/3754379696 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2364078b90 0x7f236407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:44.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.048+0000 7f2388c00640 1 --2- 172.21.15.90:0/3754379696 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2364078b90 0x7f236407b0a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2370033000 tx=0x7f23700046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:44.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.051+0000 7f2381600640 1 -- 172.21.15.90:0/3754379696 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f23840ab480 con 0x7f23840ad310 2024-09-21T03:25:44.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.284+0000 7f238aa00640 1 -- 172.21.15.90:0/3754379696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "b"} v 0) -- 0x7f23840c4810 con 0x7f23840ad310 2024-09-21T03:25:44.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.288+0000 7f2381600640 1 -- 172.21.15.90:0/3754379696 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "b"}]=0 b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 151+0+0 (secure 0 0 0) 0x7f2378061e60 con 0x7f23840ad310 2024-09-21T03:25:44.290 INFO:teuthology.orchestra.run.smithi090.stderr:b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T03:25:44.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.291+0000 7f238aa00640 1 -- 172.21.15.90:0/3754379696 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2364078b90 msgr2=0x7f236407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:44.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.291+0000 7f238aa00640 1 --2- 172.21.15.90:0/3754379696 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2364078b90 0x7f236407b0a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2370033000 tx=0x7f23700046c0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.291+0000 7f238aa00640 1 -- 172.21.15.90:0/3754379696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23840ad310 msgr2=0x7f23841ee040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:44.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.291+0000 7f238aa00640 1 --2- 172.21.15.90:0/3754379696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23840ad310 0x7f23841ee040 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f237800c3a0 tx=0x7f237800c860 comp rx=0 tx=0).stop 2024-09-21T03:25:44.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.293+0000 7f238aa00640 1 -- 172.21.15.90:0/3754379696 shutdown_connections 2024-09-21T03:25:44.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.293+0000 7f238aa00640 1 --2- 172.21.15.90:0/3754379696 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f2364078b90 0x7f236407b0a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.293+0000 7f238aa00640 1 --2- 172.21.15.90:0/3754379696 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f238414b5a0 0x7f23841532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.293+0000 7f238aa00640 1 --2- 172.21.15.90:0/3754379696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23840c5460 0x7f23840c14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.293+0000 7f238aa00640 1 --2- 172.21.15.90:0/3754379696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23840ad310 0x7f23841ee040 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.294+0000 7f238aa00640 1 -- 172.21.15.90:0/3754379696 >> 172.21.15.90:0/3754379696 conn(0x7f238406d200 msgr2=0x7f2384143d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:44.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.294+0000 7f238aa00640 1 -- 172.21.15.90:0/3754379696 shutdown_connections 2024-09-21T03:25:44.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.295+0000 7f238aa00640 1 -- 172.21.15.90:0/3754379696 wait complete. 2024-09-21T03:25:44.323 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm b --yes-i-really-mean-it 2024-09-21T03:25:44.477 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-09-21T03:25:44.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.552+0000 7fe911200640 1 -- 172.21.15.90:0/4100479581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c1553b0 msgr2=0x7fe90c1548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:44.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.552+0000 7fe911200640 1 --2- 172.21.15.90:0/4100479581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c1553b0 0x7fe90c1548d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe90c06f760 tx=0x7fe8f402a560 comp rx=0 tx=0).stop 2024-09-21T03:25:44.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.553+0000 7fe911200640 1 -- 172.21.15.90:0/4100479581 shutdown_connections 2024-09-21T03:25:44.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.553+0000 7fe911200640 1 --2- 172.21.15.90:0/4100479581 >> v2:172.21.15.149:3300/0 conn(0x7fe90c0ad480 0x7fe90c0ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.553+0000 7fe911200640 1 --2- 172.21.15.90:0/4100479581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c1553b0 0x7fe90c1548d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.553+0000 7fe911200640 1 -- 172.21.15.90:0/4100479581 >> 172.21.15.90:0/4100479581 conn(0x7fe90c0c8490 msgr2=0x7fe90c0c88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:44.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.553+0000 7fe911200640 1 -- 172.21.15.90:0/4100479581 shutdown_connections 2024-09-21T03:25:44.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.553+0000 7fe911200640 1 -- 172.21.15.90:0/4100479581 wait complete. 2024-09-21T03:25:44.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.555+0000 7fe911200640 1 Processor -- start 2024-09-21T03:25:44.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.555+0000 7fe911200640 1 -- start start 2024-09-21T03:25:44.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.556+0000 7fe911200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c06f320 0x7fe90c144c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:44.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.556+0000 7fe911200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe90c0ad480 0x7fe90c1eb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:44.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.556+0000 7fe911200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe90c1553b0 0x7fe90c13f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:44.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.556+0000 7fe911200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe90c0ab1c0 con 0x7fe90c06f320 2024-09-21T03:25:44.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.556+0000 7fe911200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe90c157e70 con 0x7fe90c0ad480 2024-09-21T03:25:44.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.556+0000 7fe911200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe90c0ab340 con 0x7fe90c1553b0 2024-09-21T03:25:44.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.556+0000 7fe90b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c06f320 0x7fe90c144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:44.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.557+0000 7fe90b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c06f320 0x7fe90c144c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36084/0 (socket says 172.21.15.90:36084) 2024-09-21T03:25:44.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.557+0000 7fe90b400640 1 -- 172.21.15.90:0/1479280972 learned_addr learned my addr 172.21.15.90:0/1479280972 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:25:44.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.557+0000 7fe90be00640 1 --2- 172.21.15.90:0/1479280972 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe90c1553b0 0x7fe90c13f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:44.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.557+0000 7fe902a00640 1 --2- 172.21.15.90:0/1479280972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe90c0ad480 0x7fe90c1eb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:44.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.557+0000 7fe90b400640 1 -- 172.21.15.90:0/1479280972 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe90c1553b0 msgr2=0x7fe90c13f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:44.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.557+0000 7fe90b400640 1 --2- 172.21.15.90:0/1479280972 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe90c1553b0 0x7fe90c13f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.557+0000 7fe90b400640 1 -- 172.21.15.90:0/1479280972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe90c0ad480 msgr2=0x7fe90c1eb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:44.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.557+0000 7fe90b400640 1 --2- 172.21.15.90:0/1479280972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe90c0ad480 0x7fe90c1eb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.557+0000 7fe90b400640 1 -- 172.21.15.90:0/1479280972 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90c0c6dc0 con 0x7fe90c06f320 2024-09-21T03:25:44.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.557+0000 7fe90b400640 1 --2- 172.21.15.90:0/1479280972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c06f320 0x7fe90c144c80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00c760 tx=0x7fe8fc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:44.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.558+0000 7fe903e00640 1 -- 172.21.15.90:0/1479280972 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc003b70 con 0x7fe90c06f320 2024-09-21T03:25:44.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.558+0000 7fe903e00640 1 -- 172.21.15.90:0/1479280972 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fe8fc003d10 con 0x7fe90c06f320 2024-09-21T03:25:44.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.558+0000 7fe911200640 1 -- 172.21.15.90:0/1479280972 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe90c0c70a0 con 0x7fe90c06f320 2024-09-21T03:25:44.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.558+0000 7fe903e00640 1 -- 172.21.15.90:0/1479280972 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc00aab0 con 0x7fe90c06f320 2024-09-21T03:25:44.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.558+0000 7fe911200640 1 -- 172.21.15.90:0/1479280972 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe90c1eb2c0 con 0x7fe90c06f320 2024-09-21T03:25:44.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.559+0000 7fe911200640 1 -- 172.21.15.90:0/1479280972 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe90c0adf20 con 0x7fe90c06f320 2024-09-21T03:25:44.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.560+0000 7fe903e00640 1 -- 172.21.15.90:0/1479280972 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe8fc00ac50 con 0x7fe90c06f320 2024-09-21T03:25:44.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.561+0000 7fe903e00640 1 --2- 172.21.15.90:0/1479280972 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe8e8078bc0 0x7fe8e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:44.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.561+0000 7fe903e00640 1 -- 172.21.15.90:0/1479280972 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5977+0+0 (secure 0 0 0) 0x7fe8fc09ab50 con 0x7fe90c06f320 2024-09-21T03:25:44.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.562+0000 7fe902a00640 1 --2- 172.21.15.90:0/1479280972 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe8e8078bc0 0x7fe8e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:44.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.562+0000 7fe902a00640 1 --2- 172.21.15.90:0/1479280972 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe8e8078bc0 0x7fe8e807b0d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4033000 tx=0x7fe8f40046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:44.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.566+0000 7fe903e00640 1 -- 172.21.15.90:0/1479280972 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe8fc0628c0 con 0x7fe90c06f320 2024-09-21T03:25:44.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:44.789+0000 7fe911200640 1 -- 172.21.15.90:0/1479280972 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true} v 0) -- 0x7fe90c0c35c0 con 0x7fe90c06f320 2024-09-21T03:25:45.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.297+0000 7fe903e00640 1 -- 172.21.15.90:0/1479280972 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true}]=0 v18) ==== 99+0+0 (secure 0 0 0) 0x7fe8fc0672f0 con 0x7fe90c06f320 2024-09-21T03:25:45.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.300+0000 7fe911200640 1 -- 172.21.15.90:0/1479280972 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe8e8078bc0 msgr2=0x7fe8e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:45.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.300+0000 7fe911200640 1 --2- 172.21.15.90:0/1479280972 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe8e8078bc0 0x7fe8e807b0d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4033000 tx=0x7fe8f40046c0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.300+0000 7fe911200640 1 -- 172.21.15.90:0/1479280972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c06f320 msgr2=0x7fe90c144c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:45.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.300+0000 7fe911200640 1 --2- 172.21.15.90:0/1479280972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c06f320 0x7fe90c144c80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00c760 tx=0x7fe8fc00cc20 comp rx=0 tx=0).stop 2024-09-21T03:25:45.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.300+0000 7fe911200640 1 -- 172.21.15.90:0/1479280972 shutdown_connections 2024-09-21T03:25:45.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.300+0000 7fe911200640 1 --2- 172.21.15.90:0/1479280972 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fe8e8078bc0 0x7fe8e807b0d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.300+0000 7fe911200640 1 --2- 172.21.15.90:0/1479280972 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe90c1553b0 0x7fe90c13f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.300+0000 7fe911200640 1 --2- 172.21.15.90:0/1479280972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe90c0ad480 0x7fe90c1eb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.300+0000 7fe911200640 1 --2- 172.21.15.90:0/1479280972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c06f320 0x7fe90c144c80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.300+0000 7fe911200640 1 -- 172.21.15.90:0/1479280972 >> 172.21.15.90:0/1479280972 conn(0x7fe90c0c8490 msgr2=0x7fe90c0763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:45.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.300+0000 7fe911200640 1 -- 172.21.15.90:0/1479280972 shutdown_connections 2024-09-21T03:25:45.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.300+0000 7fe911200640 1 -- 172.21.15.90:0/1479280972 wait complete. 2024-09-21T03:25:45.328 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_metadata b_metadata --yes-i-really-really-mean-it 2024-09-21T03:25:45.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.552+0000 7fbd91600640 1 -- 172.21.15.90:0/2636189443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd8c0abde0 msgr2=0x7fbd8c1522b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:45.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.552+0000 7fbd91600640 1 --2- 172.21.15.90:0/2636189443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd8c0abde0 0x7fbd8c1522b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0ac780 tx=0x7fbd7c02a560 comp rx=0 tx=0).stop 2024-09-21T03:25:45.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.552+0000 7fbd91600640 1 -- 172.21.15.90:0/2636189443 shutdown_connections 2024-09-21T03:25:45.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.552+0000 7fbd91600640 1 --2- 172.21.15.90:0/2636189443 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd8c073d30 0x7fbd8c0ad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.552+0000 7fbd91600640 1 --2- 172.21.15.90:0/2636189443 >> v2:172.21.15.149:3300/0 conn(0x7fbd8c0733e0 0x7fbd8c0737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.552+0000 7fbd91600640 1 --2- 172.21.15.90:0/2636189443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd8c0abde0 0x7fbd8c1522b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.552+0000 7fbd91600640 1 -- 172.21.15.90:0/2636189443 >> 172.21.15.90:0/2636189443 conn(0x7fbd8c0c85a0 msgr2=0x7fbd8c0c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:45.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.552+0000 7fbd91600640 1 -- 172.21.15.90:0/2636189443 shutdown_connections 2024-09-21T03:25:45.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.552+0000 7fbd91600640 1 -- 172.21.15.90:0/2636189443 wait complete. 2024-09-21T03:25:45.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.554+0000 7fbd91600640 1 Processor -- start 2024-09-21T03:25:45.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.554+0000 7fbd91600640 1 -- start start 2024-09-21T03:25:45.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.556+0000 7fbd91600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd8c0733e0 0x7fbd8c150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:45.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.556+0000 7fbd91600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd8c073d30 0x7fbd8c0c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:45.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.556+0000 7fbd91600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd8c0abde0 0x7fbd8c151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:45.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.556+0000 7fbd91600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c0adcc0 con 0x7fbd8c073d30 2024-09-21T03:25:45.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.556+0000 7fbd91600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c0adb40 con 0x7fbd8c0abde0 2024-09-21T03:25:45.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.556+0000 7fbd91600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbd8c0ade40 con 0x7fbd8c0733e0 2024-09-21T03:25:45.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.556+0000 7fbd8a000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd8c073d30 0x7fbd8c0c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:45.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.556+0000 7fbd8a000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd8c073d30 0x7fbd8c0c5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57842/0 (socket says 172.21.15.90:57842) 2024-09-21T03:25:45.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.556+0000 7fbd8a000640 1 -- 172.21.15.90:0/2530474945 learned_addr learned my addr 172.21.15.90:0/2530474945 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:25:45.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.556+0000 7fbd8aa00640 1 --2- 172.21.15.90:0/2530474945 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd8c0733e0 0x7fbd8c150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:45.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.556+0000 7fbd8b400640 1 --2- 172.21.15.90:0/2530474945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd8c0abde0 0x7fbd8c151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:45.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.556+0000 7fbd8a000640 1 -- 172.21.15.90:0/2530474945 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd8c0733e0 msgr2=0x7fbd8c150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:45.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.556+0000 7fbd8a000640 1 --2- 172.21.15.90:0/2530474945 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd8c0733e0 0x7fbd8c150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.556+0000 7fbd8a000640 1 -- 172.21.15.90:0/2530474945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd8c0abde0 msgr2=0x7fbd8c151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:45.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.556+0000 7fbd8a000640 1 --2- 172.21.15.90:0/2530474945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd8c0abde0 0x7fbd8c151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.556+0000 7fbd8a000640 1 -- 172.21.15.90:0/2530474945 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c0c59b0 con 0x7fbd8c073d30 2024-09-21T03:25:45.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.557+0000 7fbd8a000640 1 --2- 172.21.15.90:0/2530474945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd8c073d30 0x7fbd8c0c5db0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800d750 tx=0x7fbd7800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:45.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.557+0000 7fbd82a00640 1 -- 172.21.15.90:0/2530474945 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd78017070 con 0x7fbd8c073d30 2024-09-21T03:25:45.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.557+0000 7fbd82a00640 1 -- 172.21.15.90:0/2530474945 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fbd78009ce0 con 0x7fbd8c073d30 2024-09-21T03:25:45.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.557+0000 7fbd82a00640 1 -- 172.21.15.90:0/2530474945 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd780106c0 con 0x7fbd8c073d30 2024-09-21T03:25:45.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.557+0000 7fbd91600640 1 -- 172.21.15.90:0/2530474945 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd8c0c5260 con 0x7fbd8c073d30 2024-09-21T03:25:45.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.557+0000 7fbd91600640 1 -- 172.21.15.90:0/2530474945 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd8c0c7ef0 con 0x7fbd8c073d30 2024-09-21T03:25:45.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.558+0000 7fbd91600640 1 -- 172.21.15.90:0/2530474945 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd8c0ab1c0 con 0x7fbd8c073d30 2024-09-21T03:25:45.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.559+0000 7fbd82a00640 1 -- 172.21.15.90:0/2530474945 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbd7801a070 con 0x7fbd8c073d30 2024-09-21T03:25:45.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.560+0000 7fbd82a00640 1 --2- 172.21.15.90:0/2530474945 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbd6c078bc0 0x7fbd6c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:45.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.561+0000 7fbd82a00640 1 -- 172.21.15.90:0/2530474945 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5977+0+0 (secure 0 0 0) 0x7fbd7809ad50 con 0x7fbd8c073d30 2024-09-21T03:25:45.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.561+0000 7fbd8aa00640 1 --2- 172.21.15.90:0/2530474945 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbd6c078bc0 0x7fbd6c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:45.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.562+0000 7fbd8aa00640 1 --2- 172.21.15.90:0/2530474945 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbd6c078bc0 0x7fbd6c07b0d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c033000 tx=0x7fbd7c0046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:45.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.565+0000 7fbd82a00640 1 -- 172.21.15.90:0/2530474945 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbd8c0ab1c0 con 0x7fbd8c073d30 2024-09-21T03:25:45.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:45.751+0000 7fbd91600640 1 -- 172.21.15.90:0/2530474945 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbd8c0ad600 con 0x7fbd8c073d30 2024-09-21T03:25:46.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.299+0000 7fbd82a00640 1 -- 172.21.15.90:0/2530474945 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'b_metadata' removed v32) ==== 166+0+0 (secure 0 0 0) 0x7fbd7809e030 con 0x7fbd8c073d30 2024-09-21T03:25:46.301 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'b_metadata' removed 2024-09-21T03:25:46.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.302+0000 7fbd91600640 1 -- 172.21.15.90:0/2530474945 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbd6c078bc0 msgr2=0x7fbd6c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:46.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.302+0000 7fbd91600640 1 --2- 172.21.15.90:0/2530474945 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbd6c078bc0 0x7fbd6c07b0d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c033000 tx=0x7fbd7c0046c0 comp rx=0 tx=0).stop 2024-09-21T03:25:46.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.302+0000 7fbd91600640 1 -- 172.21.15.90:0/2530474945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd8c073d30 msgr2=0x7fbd8c0c5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:46.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.302+0000 7fbd91600640 1 --2- 172.21.15.90:0/2530474945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd8c073d30 0x7fbd8c0c5db0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800d750 tx=0x7fbd7800dc10 comp rx=0 tx=0).stop 2024-09-21T03:25:46.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.302+0000 7fbd91600640 1 -- 172.21.15.90:0/2530474945 shutdown_connections 2024-09-21T03:25:46.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.302+0000 7fbd91600640 1 --2- 172.21.15.90:0/2530474945 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7fbd6c078bc0 0x7fbd6c07b0d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:46.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.302+0000 7fbd91600640 1 --2- 172.21.15.90:0/2530474945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd8c0abde0 0x7fbd8c151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:46.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.302+0000 7fbd91600640 1 --2- 172.21.15.90:0/2530474945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd8c073d30 0x7fbd8c0c5db0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:46.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.302+0000 7fbd91600640 1 --2- 172.21.15.90:0/2530474945 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd8c0733e0 0x7fbd8c150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:46.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.302+0000 7fbd91600640 1 -- 172.21.15.90:0/2530474945 >> 172.21.15.90:0/2530474945 conn(0x7fbd8c0c85a0 msgr2=0x7fbd8c146ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:46.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.303+0000 7fbd91600640 1 -- 172.21.15.90:0/2530474945 shutdown_connections 2024-09-21T03:25:46.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.303+0000 7fbd91600640 1 -- 172.21.15.90:0/2530474945 wait complete. 2024-09-21T03:25:46.336 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_data b_data --yes-i-really-really-mean-it 2024-09-21T03:25:46.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.561+0000 7f1fb6200640 1 -- 172.21.15.90:0/3869626468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fb013f3b0 msgr2=0x7f1fb01573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:46.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.561+0000 7f1fb6200640 1 --2- 172.21.15.90:0/3869626468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fb013f3b0 0x7f1fb01573b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8005fd0 tx=0x7f1fa802aa10 comp rx=0 tx=0).stop 2024-09-21T03:25:46.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.561+0000 7f1fb6200640 1 -- 172.21.15.90:0/3869626468 shutdown_connections 2024-09-21T03:25:46.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.561+0000 7f1fb6200640 1 --2- 172.21.15.90:0/3869626468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fb013f3b0 0x7f1fb01573b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:46.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.562+0000 7f1fb6200640 1 -- 172.21.15.90:0/3869626468 >> 172.21.15.90:0/3869626468 conn(0x7f1fb00c85a0 msgr2=0x7f1fb00c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:46.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.562+0000 7f1fb6200640 1 -- 172.21.15.90:0/3869626468 shutdown_connections 2024-09-21T03:25:46.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.562+0000 7f1fb6200640 1 -- 172.21.15.90:0/3869626468 wait complete. 2024-09-21T03:25:46.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.564+0000 7f1fb6200640 1 Processor -- start 2024-09-21T03:25:46.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.564+0000 7f1fb6200640 1 -- start start 2024-09-21T03:25:46.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.565+0000 7f1fb6200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb013f3b0 0x7f1fb0136de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:46.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.565+0000 7f1fb6200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fb013f930 0x7f1fb0156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:46.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.565+0000 7f1fb6200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fb013fe80 0x7f1fb00c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:46.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.565+0000 7f1fb6200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb00c1cf0 con 0x7f1fb013fe80 2024-09-21T03:25:46.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.565+0000 7f1fb6200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb00c4a30 con 0x7f1fb013f3b0 2024-09-21T03:25:46.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.565+0000 7f1fb6200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb00c1e70 con 0x7f1fb013f930 2024-09-21T03:25:46.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.565+0000 7f1fafe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fb013fe80 0x7f1fb00c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:46.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.565+0000 7f1fafe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fb013fe80 0x7f1fb00c5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57858/0 (socket says 172.21.15.90:57858) 2024-09-21T03:25:46.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.565+0000 7f1fafe00640 1 -- 172.21.15.90:0/3899636808 learned_addr learned my addr 172.21.15.90:0/3899636808 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T03:25:46.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.565+0000 7f1faea00640 1 --2- 172.21.15.90:0/3899636808 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fb013f930 0x7f1fb0156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:46.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.566+0000 7f1faf400640 1 --2- 172.21.15.90:0/3899636808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb013f3b0 0x7f1fb0136de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:46.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.566+0000 7f1fafe00640 1 -- 172.21.15.90:0/3899636808 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fb013f930 msgr2=0x7f1fb0156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:46.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.566+0000 7f1fafe00640 1 --2- 172.21.15.90:0/3899636808 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fb013f930 0x7f1fb0156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:46.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.566+0000 7f1fafe00640 1 -- 172.21.15.90:0/3899636808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb013f3b0 msgr2=0x7f1fb0136de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:46.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.566+0000 7f1fafe00640 1 --2- 172.21.15.90:0/3899636808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb013f3b0 0x7f1fb0136de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:46.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.566+0000 7f1fafe00640 1 -- 172.21.15.90:0/3899636808 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb0074e90 con 0x7f1fb013fe80 2024-09-21T03:25:46.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.566+0000 7f1faea00640 1 --2- 172.21.15.90:0/3899636808 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fb013f930 0x7f1fb0156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:46.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.566+0000 7f1fafe00640 1 --2- 172.21.15.90:0/3899636808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fb013fe80 0x7f1fb00c5ff0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8009d90 tx=0x7f1fa8003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:46.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.566+0000 7f1fa7400640 1 -- 172.21.15.90:0/3899636808 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8033050 con 0x7f1fb013fe80 2024-09-21T03:25:46.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.566+0000 7f1fa7400640 1 -- 172.21.15.90:0/3899636808 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f1fa8004660 con 0x7f1fb013fe80 2024-09-21T03:25:46.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.566+0000 7f1fa7400640 1 -- 172.21.15.90:0/3899636808 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa80386b0 con 0x7f1fb013fe80 2024-09-21T03:25:46.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.566+0000 7f1fb6200640 1 -- 172.21.15.90:0/3899636808 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb00abe20 con 0x7f1fb013fe80 2024-09-21T03:25:46.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.567+0000 7f1fb6200640 1 -- 172.21.15.90:0/3899636808 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb00c78f0 con 0x7f1fb013fe80 2024-09-21T03:25:46.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.568+0000 7f1fb6200640 1 -- 172.21.15.90:0/3899636808 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fb00c15e0 con 0x7f1fb013fe80 2024-09-21T03:25:46.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.569+0000 7f1fa7400640 1 -- 172.21.15.90:0/3899636808 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1fa8036070 con 0x7f1fb013fe80 2024-09-21T03:25:46.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.570+0000 7f1fa7400640 1 --2- 172.21.15.90:0/3899636808 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1f90078bc0 0x7f1f9007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:46.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.570+0000 7f1fa7400640 1 -- 172.21.15.90:0/3899636808 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5549+0+0 (secure 0 0 0) 0x7f1fa80bc1f0 con 0x7f1fb013fe80 2024-09-21T03:25:46.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.570+0000 7f1faf400640 1 --2- 172.21.15.90:0/3899636808 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1f90078bc0 0x7f1f9007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:46.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.571+0000 7f1faf400640 1 --2- 172.21.15.90:0/3899636808 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1f90078bc0 0x7f1f9007b0d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1fb015af10 tx=0x7f1fa0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:46.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.574+0000 7f1fa7400640 1 -- 172.21.15.90:0/3899636808 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1fa8084750 con 0x7f1fb013fe80 2024-09-21T03:25:46.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:46.759+0000 7f1fb6200640 1 -- 172.21.15.90:0/3899636808 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1fb00c42d0 con 0x7f1fb013fe80 2024-09-21T03:25:47.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:47.341+0000 7f1fa7400640 1 -- 172.21.15.90:0/3899636808 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true}]=0 pool 'b_data' removed v33) ==== 154+0+0 (secure 0 0 0) 0x7f1fa808be20 con 0x7f1fb013fe80 2024-09-21T03:25:47.343 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'b_data' removed 2024-09-21T03:25:47.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:47.343+0000 7f1fb6200640 1 -- 172.21.15.90:0/3899636808 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1f90078bc0 msgr2=0x7f1f9007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:47.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:47.343+0000 7f1fb6200640 1 --2- 172.21.15.90:0/3899636808 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1f90078bc0 0x7f1f9007b0d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1fb015af10 tx=0x7f1fa0009040 comp rx=0 tx=0).stop 2024-09-21T03:25:47.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:47.343+0000 7f1fb6200640 1 -- 172.21.15.90:0/3899636808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fb013fe80 msgr2=0x7f1fb00c5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:47.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:47.343+0000 7f1fb6200640 1 --2- 172.21.15.90:0/3899636808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fb013fe80 0x7f1fb00c5ff0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8009d90 tx=0x7f1fa8003f90 comp rx=0 tx=0).stop 2024-09-21T03:25:47.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:47.344+0000 7f1fb6200640 1 -- 172.21.15.90:0/3899636808 shutdown_connections 2024-09-21T03:25:47.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:47.344+0000 7f1fb6200640 1 --2- 172.21.15.90:0/3899636808 >> [v2:172.21.15.149:6800/1230645092,v1:172.21.15.149:6801/1230645092] conn(0x7f1f90078bc0 0x7f1f9007b0d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:47.344+0000 7f1fb6200640 1 --2- 172.21.15.90:0/3899636808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fb013fe80 0x7f1fb00c5ff0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:47.344+0000 7f1fb6200640 1 --2- 172.21.15.90:0/3899636808 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fb013f930 0x7f1fb0156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:47.344+0000 7f1fb6200640 1 --2- 172.21.15.90:0/3899636808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb013f3b0 0x7f1fb0136de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:47.344+0000 7f1fb6200640 1 -- 172.21.15.90:0/3899636808 >> 172.21.15.90:0/3899636808 conn(0x7f1fb00c85a0 msgr2=0x7f1fb013cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:47.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:47.344+0000 7f1fb6200640 1 -- 172.21.15.90:0/3899636808 shutdown_connections 2024-09-21T03:25:47.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T03:25:47.344+0000 7f1fb6200640 1 -- 172.21.15.90:0/3899636808 wait complete. 2024-09-21T03:25:47.383 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-21T03:25:47.383 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T03:25:47.383 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:25:47.405 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T03:25:47.405 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T03:25:47.405 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:25:47.473 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T03:25:47.473 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T03:25:47.473 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:25:47.496 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T03:25:47.497 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T03:25:47.497 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:25:47.559 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T03:25:47.559 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-21T03:25:47.559 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-21T03:25:47.559 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:25:53.661 INFO:tasks.ceph.osd.0:Stopped 2024-09-21T03:25:53.662 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-21T03:25:53.662 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:25:54.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-21T03:25:59.764 INFO:tasks.ceph.osd.1:Stopped 2024-09-21T03:25:59.764 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-21T03:25:59.764 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:26:00.113 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-21T03:26:00.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-21T03:26:03.241 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:26:03.246 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:26:05.866 INFO:tasks.ceph.osd.2:Stopped 2024-09-21T03:26:05.867 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-21T03:26:05.867 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:26:06.122 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-21T03:26:06.122 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-21T03:26:11.968 INFO:tasks.ceph.osd.3:Stopped 2024-09-21T03:26:11.969 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-21T03:26:11.969 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:26:12.029 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-21T03:26:12.029 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-21T03:26:17.835 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-21T03:26:17.835 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-21T03:26:18.071 INFO:tasks.ceph.osd.4:Stopped 2024-09-21T03:26:18.071 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-21T03:26:18.071 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:26:23.541 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-21T03:26:23.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-21T03:26:24.173 INFO:tasks.ceph.osd.5:Stopped 2024-09-21T03:26:24.174 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-21T03:26:24.174 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:26:29.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-21T03:26:29.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-21T03:26:30.275 INFO:tasks.ceph.osd.6:Stopped 2024-09-21T03:26:30.276 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-21T03:26:30.276 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:26:33.342 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:26:33.346 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:26:34.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-21T03:26:34.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-21T03:26:36.377 INFO:tasks.ceph.osd.7:Stopped 2024-09-21T03:26:36.378 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-21T03:26:36.378 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-21T03:26:36.378 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:26:36.455 INFO:tasks.ceph.mgr.y:Stopped 2024-09-21T03:26:36.456 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-21T03:26:36.456 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:26:36.537 INFO:tasks.ceph.mgr.x:Stopped 2024-09-21T03:26:36.538 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-21T03:26:36.538 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-21T03:26:36.538 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:26:36.567 INFO:tasks.ceph.mon.a:Stopped 2024-09-21T03:26:36.567 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-21T03:26:36.567 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:26:36.597 INFO:tasks.ceph.mon.b:Stopped 2024-09-21T03:26:36.597 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-21T03:26:36.597 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:26:36.667 INFO:tasks.ceph.mon.c:Stopped 2024-09-21T03:26:36.667 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-21T03:26:36.668 DEBUG:teuthology.orchestra.run.smithi090:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-21T03:26:36.799 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T03:26:36.799 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-21T03:26:37.142 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T03:26:37.143 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-21T03:26:37.286 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T03:26:37.286 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-21T03:26:37.449 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T03:26:37.450 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-21T03:26:37.623 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T03:26:37.623 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-21T03:26:37.868 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T03:26:37.868 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-21T03:26:38.007 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T03:26:38.007 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-21T03:26:38.147 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T03:26:38.147 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-21T03:26:38.291 INFO:tasks.ceph:Archiving mon data... 2024-09-21T03:26:38.293 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913454/data/mon.a.tgz 2024-09-21T03:26:38.293 DEBUG:teuthology.orchestra.run.smithi090:> mktemp 2024-09-21T03:26:38.342 INFO:teuthology.orchestra.run.smithi090.stdout:/tmp/tmp.zGbKIIiaOn 2024-09-21T03:26:38.342 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.zGbKIIiaOn 2024-09-21T03:26:38.479 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0666 /tmp/tmp.zGbKIIiaOn 2024-09-21T03:26:38.593 DEBUG:teuthology.orchestra.remote:smithi090:/tmp/tmp.zGbKIIiaOn is 371KB 2024-09-21T03:26:38.682 DEBUG:teuthology.orchestra.run.smithi090:> rm -fr /tmp/tmp.zGbKIIiaOn 2024-09-21T03:26:38.717 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913454/data/mon.b.tgz 2024-09-21T03:26:38.717 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-09-21T03:26:38.769 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.RI9OFsZSsx 2024-09-21T03:26:38.769 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.RI9OFsZSsx 2024-09-21T03:26:38.915 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.RI9OFsZSsx 2024-09-21T03:26:39.029 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.RI9OFsZSsx is 374KB 2024-09-21T03:26:39.117 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.RI9OFsZSsx 2024-09-21T03:26:39.152 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913454/data/mon.c.tgz 2024-09-21T03:26:39.152 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-09-21T03:26:39.227 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.X18zPTCXQf 2024-09-21T03:26:39.227 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.X18zPTCXQf 2024-09-21T03:26:39.392 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.X18zPTCXQf 2024-09-21T03:26:39.487 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.X18zPTCXQf is 374KB 2024-09-21T03:26:39.575 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.X18zPTCXQf 2024-09-21T03:26:39.610 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-21T03:26:39.610 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T03:26:39.614 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T03:26:39.652 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-21T03:26:39.741 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T03:26:39.787 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T03:26:39.787 INFO:tasks.ceph:Archiving crash dumps... 2024-09-21T03:26:39.788 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913454/remote/smithi090/crash 2024-09-21T03:26:39.789 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T03:26:39.844 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913454/remote/smithi149/crash 2024-09-21T03:26:39.845 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T03:26:39.899 INFO:tasks.ceph:Shutting down logrotate 2024-09-21T03:26:39.899 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:26:39.903 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:26:40.020 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-21T03:26:40.075 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-21T03:26:40.131 INFO:tasks.ceph:Compressing logs... 2024-09-21T03:26:40.131 DEBUG:teuthology.orchestra.run.smithi090:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T03:26:40.136 DEBUG:teuthology.orchestra.run.smithi149:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T03:26:40.193 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-21T03:26:40.194 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46207.log 2024-09-21T03:26:40.195 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51484.log 2024-09-21T03:26:40.196 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52777.log 2024-09-21T03:26:40.196 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42723.log 2024-09-21T03:26:40.197 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51484.log.gz 2024-09-21T03:26:40.197 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36069.log 2024-09-21T03:26:40.197 INFO:teuthology.orchestra.run.smithi090.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52777.log.gz 2024-09-21T03:26:40.198 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36266.log 2024-09-21T03:26:40.199 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44746.log 2024-09-21T03:26:40.200 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53485.log 2024-09-21T03:26:40.200 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.44746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44746.log.gz 2024-09-21T03:26:40.200 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51586.log 2024-09-21T03:26:40.201 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36486.log 2024-09-21T03:26:40.201 INFO:teuthology.orchestra.run.smithi090.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53485.log.gz 2024-09-21T03:26:40.202 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51628.log 2024-09-21T03:26:40.202 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51586.log.gz 2024-09-21T03:26:40.203 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53131.log 2024-09-21T03:26:40.204 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42765.log 2024-09-21T03:26:40.204 INFO:teuthology.orchestra.run.smithi090.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51628.log.gz 2024-09-21T03:26:40.204 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52465.log 2024-09-21T03:26:40.204 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53131.log.gz 2024-09-21T03:26:40.205 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46417.log 2024-09-21T03:26:40.206 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44379.log 2024-09-21T03:26:40.207 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52465.log.gz 2024-09-21T03:26:40.207 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53527.log 2024-09-21T03:26:40.207 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41950.log 2024-09-21T03:26:40.208 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36377.log 2024-09-21T03:26:40.208 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42076.log 2024-09-21T03:26:40.208 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53527.log.gz 2024-09-21T03:26:40.210 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54416.log 2024-09-21T03:26:40.210 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45848.log 2024-09-21T03:26:40.211 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-21T03:26:40.211 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.36377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36097.log 2024-09-21T03:26:40.211 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-21T03:26:40.212 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.36097.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-21T03:26:40.212 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T03:26:40.213 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54416.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46207.log.gz 2024-09-21T03:26:40.213 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51297.log 2024-09-21T03:26:40.213 INFO:teuthology.orchestra.run.smithi090.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54416.log.gz 2024-09-21T03:26:40.213 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36735.log 2024-09-21T03:26:40.213 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51171.log 2024-09-21T03:26:40.213 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51297.log.gz 2024-09-21T03:26:40.214 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56122.log 2024-09-21T03:26:40.219 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36017.log 2024-09-21T03:26:40.219 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36057.log 2024-09-21T03:26:40.219 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.36017.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-21T03:26:40.219 INFO:teuthology.orchestra.run.smithi149.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36377.log.gz 2024-09-21T03:26:40.219 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.36057.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-21T03:26:40.219 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-21T03:26:40.219 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T03:26:40.220 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36231.log 2024-09-21T03:26:40.220 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-21T03:26:40.220 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.36231.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-21T03:26:40.221 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50919.log 2024-09-21T03:26:40.221 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42723.log.gz 2024-09-21T03:26:40.221 INFO:teuthology.orchestra.run.smithi090.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51171.log.gz 2024-09-21T03:26:40.222 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42765.log.gz 2024-09-21T03:26:40.222 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56122.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45848.log.gz 2024-09-21T03:26:40.222 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.56122.log.gz -5 2024-09-21T03:26:40.222 INFO:teuthology.orchestra.run.smithi090.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52717.log 2024-09-21T03:26:40.222 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43233.log 2024-09-21T03:26:40.222 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50919.log.gz 2024-09-21T03:26:40.222 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55912.log 2024-09-21T03:26:40.222 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52717.log.gz 2024-09-21T03:26:40.222 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50344.log 2024-09-21T03:26:40.222 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55912.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36486.log.gz 2024-09-21T03:26:40.222 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54942.log 2024-09-21T03:26:40.222 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55912.log.gz 2024-09-21T03:26:40.222 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54518.log 2024-09-21T03:26:40.222 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50344.log.gz 2024-09-21T03:26:40.223 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46039.log 2024-09-21T03:26:40.223 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54942.log.gz 2024-09-21T03:26:40.223 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45501.log 2024-09-21T03:26:40.223 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54518.log.gz 2024-09-21T03:26:40.223 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53341.log 2024-09-21T03:26:40.227 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36337.log 2024-09-21T03:26:40.227 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-21T03:26:40.227 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.36337.log: 94.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T03:26:40.227 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36137.log 2024-09-21T03:26:40.227 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36177.log 2024-09-21T03:26:40.228 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.36137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41546.log 2024-09-21T03:26:40.228 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.36177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41565.log 2024-09-21T03:26:40.228 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.41546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41546.log.gz 2024-09-21T03:26:40.228 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.41565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41565.log.gz 2024-09-21T03:26:40.228 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50531.log 2024-09-21T03:26:40.228 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53341.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-21T03:26:40.228 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53341.log.gz 2024-09-21T03:26:40.228 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42593.log 2024-09-21T03:26:40.228 INFO:teuthology.orchestra.run.smithi090.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50531.log.gz 2024-09-21T03:26:40.228 INFO:teuthology.orchestra.run.smithi090.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46039.log.gz/var/log/ceph/ceph-osd.1.log: 2024-09-21T03:26:40.228 INFO:teuthology.orchestra.run.smithi090.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36735.log.gz 2024-09-21T03:26:40.228 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44879.log 2024-09-21T03:26:40.228 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42593.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42076.log.gz 2024-09-21T03:26:40.228 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54816.log 2024-09-21T03:26:40.229 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50302.log 2024-09-21T03:26:40.229 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50082.log 2024-09-21T03:26:40.230 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54816.log.gz 2024-09-21T03:26:40.230 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45608.log 2024-09-21T03:26:40.230 INFO:teuthology.orchestra.run.smithi090.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50302.log.gz 2024-09-21T03:26:40.230 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42034.log 2024-09-21T03:26:40.230 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50082.log.gz 2024-09-21T03:26:40.230 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46417.log.gz/var/log/ceph/ceph-client.admin.45608.log: 2024-09-21T03:26:40.230 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41501.log 2024-09-21T03:26:40.231 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36033.log 2024-09-21T03:26:40.231 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54858.log 2024-09-21T03:26:40.232 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45441.log 2024-09-21T03:26:40.232 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36033.log.gz 2024-09-21T03:26:40.233 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56393.log 2024-09-21T03:26:40.233 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54858.log.gz 2024-09-21T03:26:40.234 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45441.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44379.log.gz 2024-09-21T03:26:40.234 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54194.log 2024-09-21T03:26:40.235 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52423.log 2024-09-21T03:26:40.235 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56393.log.gz 2024-09-21T03:26:40.235 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43234.log 2024-09-21T03:26:40.236 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54194.log.gz 2024-09-21T03:26:40.236 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50022.log 2024-09-21T03:26:40.236 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52423.log.gz 2024-09-21T03:26:40.237 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51442.log 2024-09-21T03:26:40.237 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45608.log.gz 2024-09-21T03:26:40.237 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42034.log.gz 2024-09-21T03:26:40.238 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45441.log.gz 2024-09-21T03:26:40.238 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42593.log.gz 2024-09-21T03:26:40.238 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50022.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44879.log.gz 2024-09-21T03:26:40.238 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45501.log.gz 2024-09-21T03:26:40.239 INFO:teuthology.orchestra.run.smithi090.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50022.log.gz 2024-09-21T03:26:40.239 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54984.log 2024-09-21T03:26:40.239 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36734.log 2024-09-21T03:26:40.239 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51442.log.gz 2024-09-21T03:26:40.240 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43225.log 2024-09-21T03:26:40.240 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54984.log.gz 2024-09-21T03:26:40.241 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53839.log 2024-09-21T03:26:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36695.log 2024-09-21T03:26:40.242 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41950.log.gz 2024-09-21T03:26:40.242 INFO:teuthology.orchestra.run.smithi090.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36734.log.gz 2024-09-21T03:26:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43230.log 2024-09-21T03:26:40.242 INFO:teuthology.orchestra.run.smithi090.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53839.log.gz 2024-09-21T03:26:40.243 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41906.log 2024-09-21T03:26:40.244 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51003.log 2024-09-21T03:26:40.244 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45955.log 2024-09-21T03:26:40.245 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52024.log 2024-09-21T03:26:40.245 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51003.log.gz 2024-09-21T03:26:40.246 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53089.log 2024-09-21T03:26:40.247 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52255.log 2024-09-21T03:26:40.247 INFO:teuthology.orchestra.run.smithi090.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.52024.log.gz 2024-09-21T03:26:40.248 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53089.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53089.log.gz 2024-09-21T03:26:40.248 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37153.log 2024-09-21T03:26:40.249 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56436.log 2024-09-21T03:26:40.249 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52255.log.gz 2024-09-21T03:26:40.249 INFO:teuthology.orchestra.run.smithi090.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.36695.log.gz 2024-09-21T03:26:40.250 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37153.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.41906.log.gz 2024-09-21T03:26:40.250 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45955.log.gz 2024-09-21T03:26:40.250 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45383.log 2024-09-21T03:26:40.251 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52507.log 2024-09-21T03:26:40.251 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56436.log.gz 2024-09-21T03:26:40.252 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44151.log 2024-09-21T03:26:40.253 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51670.log 2024-09-21T03:26:40.253 INFO:teuthology.orchestra.run.smithi090.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52507.log.gz 2024-09-21T03:26:40.253 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53299.log 2024-09-21T03:26:40.254 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54332.log 2024-09-21T03:26:40.255 INFO:teuthology.orchestra.run.smithi090.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51670.log.gz 2024-09-21T03:26:40.255 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53299.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.53299.log.gz 2024-09-21T03:26:40.255 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55488.log 2024-09-21T03:26:40.257 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45650.log 2024-09-21T03:26:40.257 INFO:teuthology.orchestra.run.smithi090.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54332.log.gz 2024-09-21T03:26:40.257 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49812.log 2024-09-21T03:26:40.257 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.55488.log.gz 2024-09-21T03:26:40.258 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43234.log.gz 2024-09-21T03:26:40.258 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42160.log 2024-09-21T03:26:40.259 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45650.log: /var/log/ceph/ceph-client.admin.49812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43236.log 2024-09-21T03:26:40.259 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.45383.log.gz 2024-09-21T03:26:40.259 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44151.log.gz 2024-09-21T03:26:40.259 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42160.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45650.log.gz 2024-09-21T03:26:40.260 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56206.log 2024-09-21T03:26:40.260 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42681.log 2024-09-21T03:26:40.261 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51339.log 2024-09-21T03:26:40.261 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56206.log.gz 2024-09-21T03:26:40.262 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43059.log 2024-09-21T03:26:40.263 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51339.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.37153.log.gz 2024-09-21T03:26:40.263 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53923.log 2024-09-21T03:26:40.263 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43236.log.gz 2024-09-21T03:26:40.264 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51339.log.gz 2024-09-21T03:26:40.264 INFO:teuthology.orchestra.run.smithi090.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42681.log.gz 2024-09-21T03:26:40.264 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46249.log 2024-09-21T03:26:40.265 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37445.log 2024-09-21T03:26:40.265 INFO:teuthology.orchestra.run.smithi090.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53923.log.gz 2024-09-21T03:26:40.266 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51712.log 2024-09-21T03:26:40.266 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53257.log 2024-09-21T03:26:40.267 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54151.log 2024-09-21T03:26:40.267 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51712.log.gz 2024-09-21T03:26:40.268 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51964.log 2024-09-21T03:26:40.268 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53257.log.gz 2024-09-21T03:26:40.269 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43547.log 2024-09-21T03:26:40.269 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54151.log.gz 2024-09-21T03:26:40.270 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43059.log.gz 2024-09-21T03:26:40.270 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51964.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46249.log.gz 2024-09-21T03:26:40.270 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51964.log.gz 2024-09-21T03:26:40.270 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45173.log 2024-09-21T03:26:40.271 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.43225.log.gz 2024-09-21T03:26:40.271 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43233.log.gz 2024-09-21T03:26:40.272 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43547.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43230.log.gz 2024-09-21T03:26:40.272 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54007.log 2024-09-21T03:26:40.272 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55614.log 2024-09-21T03:26:40.273 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46333.log 2024-09-21T03:26:40.273 INFO:teuthology.orchestra.run.smithi090.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.54007.log.gz 2024-09-21T03:26:40.273 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51796.log 2024-09-21T03:26:40.274 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55614.log.gz 2024-09-21T03:26:40.274 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50259.log 2024-09-21T03:26:40.275 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54458.log 2024-09-21T03:26:40.275 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51796.log.gz 2024-09-21T03:26:40.276 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43017.log 2024-09-21T03:26:40.276 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50259.log.gz 2024-09-21T03:26:40.276 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44727.log 2024-09-21T03:26:40.277 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54458.log.gz 2024-09-21T03:26:40.277 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52339.log 2024-09-21T03:26:40.278 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.44727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44727.log.gz 2024-09-21T03:26:40.278 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54374.log 2024-09-21T03:26:40.279 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54712.log 2024-09-21T03:26:40.279 INFO:teuthology.orchestra.run.smithi090.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52339.log.gz 2024-09-21T03:26:40.280 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43553.log 2024-09-21T03:26:40.280 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54374.log.gz 2024-09-21T03:26:40.280 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55026.log 2024-09-21T03:26:40.280 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54712.log.gz 2024-09-21T03:26:40.281 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42160.log.gz 2024-09-21T03:26:40.281 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43547.log.gz 2024-09-21T03:26:40.281 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43553.log: 86.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.45173.log.gz 2024-09-21T03:26:40.281 INFO:teuthology.orchestra.run.smithi090.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44277.log 2024-09-21T03:26:40.282 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43017.log.gz 2024-09-21T03:26:40.283 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51213.log 2024-09-21T03:26:40.283 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55026.log.gz 2024-09-21T03:26:40.283 INFO:teuthology.orchestra.run.smithi090.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49812.log.gz 2024-09-21T03:26:40.283 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43553.log.gz 2024-09-21T03:26:40.283 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55572.log 2024-09-21T03:26:40.284 INFO:teuthology.orchestra.run.smithi149.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36017.log.gz 2024-09-21T03:26:40.284 INFO:teuthology.orchestra.run.smithi149.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36057.log.gz 2024-09-21T03:26:40.285 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55068.log 2024-09-21T03:26:40.285 INFO:teuthology.orchestra.run.smithi090.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51213.log.gz 2024-09-21T03:26:40.285 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50961.log 2024-09-21T03:26:40.285 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55572.log.gz 2024-09-21T03:26:40.286 INFO:teuthology.orchestra.run.smithi149.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36097.log.gz 2024-09-21T03:26:40.286 INFO:teuthology.orchestra.run.smithi149.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36137.log.gz 2024-09-21T03:26:40.287 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42500.log 2024-09-21T03:26:40.287 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55068.log.gz 2024-09-21T03:26:40.287 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55656.log 2024-09-21T03:26:40.287 INFO:teuthology.orchestra.run.smithi090.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50961.log.gz 2024-09-21T03:26:40.287 INFO:teuthology.orchestra.run.smithi090.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44277.log.gz/var/log/ceph/ceph-client.admin.42500.log: 2024-09-21T03:26:40.287 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T03:26:40.288 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45131.log 2024-09-21T03:26:40.288 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.55656.log.gz 2024-09-21T03:26:40.289 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43240.log 2024-09-21T03:26:40.289 INFO:teuthology.orchestra.run.smithi149.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36177.log.gz 2024-09-21T03:26:40.289 INFO:teuthology.orchestra.run.smithi149.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36231.log.gz 2024-09-21T03:26:40.290 INFO:teuthology.orchestra.run.smithi149.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36337.log.gz 2024-09-21T03:26:40.290 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45806.log 2024-09-21T03:26:40.291 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56080.log 2024-09-21T03:26:40.291 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42500.log.gz 2024-09-21T03:26:40.292 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36491.log 2024-09-21T03:26:40.292 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45131.log.gz 2024-09-21T03:26:40.292 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42891.log 2024-09-21T03:26:40.293 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56080.log.gz 2024-09-21T03:26:40.293 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1%/var/log/ceph/ceph-client.admin.36491.log: -- replaced with /var/log/ceph/ceph-client.admin.43240.log.gz 2024-09-21T03:26:40.293 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43875.log 2024-09-21T03:26:40.294 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45806.log.gz 2024-09-21T03:26:40.294 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36716.log 2024-09-21T03:26:40.295 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44085.log 2024-09-21T03:26:40.295 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42975.log 2024-09-21T03:26:40.296 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50657.log 2024-09-21T03:26:40.297 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53047.log 2024-09-21T03:26:40.298 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52819.log 2024-09-21T03:26:40.298 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50657.log.gz 2024-09-21T03:26:40.299 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45565.log 2024-09-21T03:26:40.299 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53047.log.gz 2024-09-21T03:26:40.300 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43571.log 2024-09-21T03:26:40.300 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52819.log.gz 2024-09-21T03:26:40.300 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51754.log 2024-09-21T03:26:40.301 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52195.log 2024-09-21T03:26:40.302 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46123.log 2024-09-21T03:26:40.302 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51754.log.gz 2024-09-21T03:26:40.303 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36436.log 2024-09-21T03:26:40.303 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52195.log.gz 2024-09-21T03:26:40.303 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36051.log 2024-09-21T03:26:40.304 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36197.log 2024-09-21T03:26:40.305 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36051.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.42891.log.gz 2024-09-21T03:26:40.305 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54900.log 2024-09-21T03:26:40.306 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56248.log 2024-09-21T03:26:40.307 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54900.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36716.log.gz 2024-09-21T03:26:40.307 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45734.log 2024-09-21T03:26:40.307 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54900.log.gz 2024-09-21T03:26:40.308 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42975.log.gz 2024-09-21T03:26:40.308 INFO:teuthology.orchestra.run.smithi090.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45565.log.gz 2024-09-21T03:26:40.308 INFO:teuthology.orchestra.run.smithi090.stderr: 91.0%/var/log/ceph/ceph-client.admin.56248.log: -- replaced with /var/log/ceph/ceph-client.admin.44085.log.gz 2024-09-21T03:26:40.308 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46123.log.gz 2024-09-21T03:26:40.308 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55996.log 2024-09-21T03:26:40.308 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56248.log.gz 2024-09-21T03:26:40.309 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50741.log 2024-09-21T03:26:40.309 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44963.log 2024-09-21T03:26:40.310 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55996.log.gz 2024-09-21T03:26:40.310 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50428.log 2024-09-21T03:26:40.310 INFO:teuthology.orchestra.run.smithi090.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50741.log.gz 2024-09-21T03:26:40.311 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36131.log 2024-09-21T03:26:40.312 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51838.log 2024-09-21T03:26:40.312 INFO:teuthology.orchestra.run.smithi090.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.50428.log.gz 2024-09-21T03:26:40.313 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41600.log 2024-09-21T03:26:40.314 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36347.log 2024-09-21T03:26:40.314 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51838.log.gz 2024-09-21T03:26:40.314 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37113.log 2024-09-21T03:26:40.315 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50166.log 2024-09-21T03:26:40.316 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52591.log 2024-09-21T03:26:40.317 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42412.log 2024-09-21T03:26:40.317 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50166.log.gz 2024-09-21T03:26:40.317 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52963.log 2024-09-21T03:26:40.318 INFO:teuthology.orchestra.run.smithi090.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52591.log.gz 2024-09-21T03:26:40.318 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43540.log 2024-09-21T03:26:40.319 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52963.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-21T03:26:40.320 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52963.log.gz 2024-09-21T03:26:40.320 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49728.log 2024-09-21T03:26:40.321 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36567.log 2024-09-21T03:26:40.322 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53215.log 2024-09-21T03:26:40.322 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55728.log 2024-09-21T03:26:40.323 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55446.log 2024-09-21T03:26:40.324 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53215.log.gz 2024-09-21T03:26:40.324 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44043.log 2024-09-21T03:26:40.324 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.55728.log.gz 2024-09-21T03:26:40.325 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51087.log 2024-09-21T03:26:40.325 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55446.log.gz 2024-09-21T03:26:40.326 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43238.log 2024-09-21T03:26:40.326 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51880.log 2024-09-21T03:26:40.326 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51087.log.gz 2024-09-21T03:26:40.327 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56038.log 2024-09-21T03:26:40.328 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52675.log 2024-09-21T03:26:40.328 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51880.log.gz 2024-09-21T03:26:40.329 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50573.log 2024-09-21T03:26:40.329 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56038.log.gz 2024-09-21T03:26:40.330 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52150.log 2024-09-21T03:26:40.330 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.52675.log.gz 2024-09-21T03:26:40.330 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42456.log 2024-09-21T03:26:40.331 INFO:teuthology.orchestra.run.smithi090.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50573.log.gz 2024-09-21T03:26:40.331 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51129.log 2024-09-21T03:26:40.331 INFO:teuthology.orchestra.run.smithi090.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52150.log.gz 2024-09-21T03:26:40.332 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42286.log 2024-09-21T03:26:40.333 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51129.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37445.log.gz 2024-09-21T03:26:40.333 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.41501.log.gz 2024-09-21T03:26:40.333 INFO:teuthology.orchestra.run.smithi090.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41862.log 2024-09-21T03:26:40.333 INFO:teuthology.orchestra.run.smithi090.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51129.log.gz 2024-09-21T03:26:40.333 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46519.log 2024-09-21T03:26:40.334 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53443.log 2024-09-21T03:26:40.335 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52633.log 2024-09-21T03:26:40.336 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42202.log 2024-09-21T03:26:40.336 INFO:teuthology.orchestra.run.smithi090.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53443.log.gz 2024-09-21T03:26:40.337 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53881.log 2024-09-21T03:26:40.337 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52633.log.gz 2024-09-21T03:26:40.337 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45215.log 2024-09-21T03:26:40.338 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45692.log 2024-09-21T03:26:40.338 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53881.log.gz 2024-09-21T03:26:40.339 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45215.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-21T03:26:40.340 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53797.log 2024-09-21T03:26:40.340 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36709.log 2024-09-21T03:26:40.341 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41820.log 2024-09-21T03:26:40.342 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53797.log.gz 2024-09-21T03:26:40.342 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45047.log 2024-09-21T03:26:40.343 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42244.log 2024-09-21T03:26:40.343 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56290.log 2024-09-21T03:26:40.344 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46333.log.gz 2024-09-21T03:26:40.344 INFO:teuthology.orchestra.run.smithi090.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49728.log.gz 2024-09-21T03:26:40.345 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45005.log 2024-09-21T03:26:40.345 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54290.log 2024-09-21T03:26:40.346 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56290.log: /var/log/ceph/ceph-client.admin.45005.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43540.log.gz 2024-09-21T03:26:40.346 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.56290.log.gz 2024-09-21T03:26:40.346 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54634.log 2024-09-21T03:26:40.346 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.43238.log.gz 2024-09-21T03:26:40.347 INFO:teuthology.orchestra.run.smithi090.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.37113.log.gz 2024-09-21T03:26:40.347 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41820.log.gz 2024-09-21T03:26:40.348 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54290.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41862.log.gz 2024-09-21T03:26:40.348 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42286.log.gz 2024-09-21T03:26:40.348 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54049.log 2024-09-21T03:26:40.348 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54290.log.gz 2024-09-21T03:26:40.348 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45734.log.gz 2024-09-21T03:26:40.348 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49854.log 2024-09-21T03:26:40.349 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54634.log.gz 2024-09-21T03:26:40.349 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42635.log 2024-09-21T03:26:40.349 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54049.log.gz 2024-09-21T03:26:40.350 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45299.log 2024-09-21T03:26:40.351 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50699.log 2024-09-21T03:26:40.351 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43569.log 2024-09-21T03:26:40.352 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51400.log 2024-09-21T03:26:40.353 INFO:teuthology.orchestra.run.smithi090.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50699.log.gz 2024-09-21T03:26:40.353 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36739.log 2024-09-21T03:26:40.354 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51400.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-21T03:26:40.354 INFO:teuthology.orchestra.run.smithi090.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51400.log.gz 2024-09-21T03:26:40.355 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42933.log 2024-09-21T03:26:40.355 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36675.log 2024-09-21T03:26:40.356 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55110.log 2024-09-21T03:26:40.357 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50124.log 2024-09-21T03:26:40.358 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50386.log 2024-09-21T03:26:40.358 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55110.log.gz 2024-09-21T03:26:40.359 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52066.log 2024-09-21T03:26:40.359 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46519.log.gz 2024-09-21T03:26:40.360 INFO:teuthology.orchestra.run.smithi090.stderr: 89.0% 85.5% -- replaced with /var/log/ceph/ceph-client.admin.36709.log.gz 2024-09-21T03:26:40.360 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50124.log.gz 2024-09-21T03:26:40.360 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42202.log.gz 2024-09-21T03:26:40.360 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50386.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42244.log.gz 2024-09-21T03:26:40.360 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44963.log.gz 2024-09-21T03:26:40.360 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46165.log 2024-09-21T03:26:40.361 INFO:teuthology.orchestra.run.smithi090.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50386.log.gz 2024-09-21T03:26:40.361 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45005.log.gz 2024-09-21T03:26:40.361 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45692.log.gz 2024-09-21T03:26:40.361 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42412.log.gz 2024-09-21T03:26:40.362 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52066.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42456.log.gz 2024-09-21T03:26:40.362 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45047.log.gz 2024-09-21T03:26:40.362 INFO:teuthology.orchestra.run.smithi090.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41600.log.gz 2024-09-21T03:26:40.362 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55362.log 2024-09-21T03:26:40.362 INFO:teuthology.orchestra.run.smithi090.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.52066.log.gz 2024-09-21T03:26:40.362 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.45215.log.gz 2024-09-21T03:26:40.363 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46165.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-21T03:26:40.364 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55828.log 2024-09-21T03:26:40.364 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55362.log.gz 2024-09-21T03:26:40.364 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43577.log 2024-09-21T03:26:40.364 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43773.log 2024-09-21T03:26:40.364 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55828.log.gz 2024-09-21T03:26:40.365 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42118.log 2024-09-21T03:26:40.366 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43959.log 2024-09-21T03:26:40.367 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42118.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T03:26:40.367 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49980.log 2024-09-21T03:26:40.368 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42807.log 2024-09-21T03:26:40.369 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45341.log 2024-09-21T03:26:40.369 INFO:teuthology.orchestra.run.smithi090.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49980.log.gz 2024-09-21T03:26:40.370 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42328.log 2024-09-21T03:26:40.371 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45997.log 2024-09-21T03:26:40.371 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T03:26:40.372 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41992.log 2024-09-21T03:26:40.372 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42328.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49854.log.gz 2024-09-21T03:26:40.373 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42933.log.gz 2024-09-21T03:26:40.373 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4%/var/log/ceph/ceph-client.admin.45997.log: -- replaced with /var/log/ceph/ceph-client.admin.46165.log.gz 2024-09-21T03:26:40.373 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43543.log 2024-09-21T03:26:40.373 INFO:teuthology.orchestra.run.smithi090.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36739.log.gz 2024-09-21T03:26:40.373 INFO:teuthology.orchestra.run.smithi090.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36675.log.gz 2024-09-21T03:26:40.373 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42635.log.gz 2024-09-21T03:26:40.373 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45299.log.gz 2024-09-21T03:26:40.374 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44001.log 2024-09-21T03:26:40.375 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42118.log.gz 2024-09-21T03:26:40.375 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43543.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42807.log.gz 2024-09-21T03:26:40.375 INFO:teuthology.orchestra.run.smithi090.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45341.log.gz 2024-09-21T03:26:40.375 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55236.log 2024-09-21T03:26:40.375 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42328.log.gz 2024-09-21T03:26:40.376 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41778.log 2024-09-21T03:26:40.376 INFO:teuthology.orchestra.run.smithi090.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45997.log.gz 2024-09-21T03:26:40.377 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55236.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55236.log.gz 2024-09-21T03:26:40.377 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41992.log.gz 2024-09-21T03:26:40.377 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53005.log 2024-09-21T03:26:40.377 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52861.log 2024-09-21T03:26:40.378 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55278.log 2024-09-21T03:26:40.378 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53005.log.gz 2024-09-21T03:26:40.379 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50877.log 2024-09-21T03:26:40.379 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.52861.log.gz 2024-09-21T03:26:40.380 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36379.log 2024-09-21T03:26:40.380 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55278.log.gz 2024-09-21T03:26:40.381 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51045.log 2024-09-21T03:26:40.381 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50877.log.gz 2024-09-21T03:26:40.381 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42849.log 2024-09-21T03:26:40.382 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37355.log 2024-09-21T03:26:40.382 INFO:teuthology.orchestra.run.smithi090.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.51045.log.gz 2024-09-21T03:26:40.383 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36168.log 2024-09-21T03:26:40.384 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36737.log 2024-09-21T03:26:40.385 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42370.log 2024-09-21T03:26:40.385 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43560.log 2024-09-21T03:26:40.386 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52381.log 2024-09-21T03:26:40.387 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44921.log 2024-09-21T03:26:40.387 INFO:teuthology.orchestra.run.smithi090.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43543.log.gz 2024-09-21T03:26:40.388 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45089.log 2024-09-21T03:26:40.388 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41778.log.gz 2024-09-21T03:26:40.388 INFO:teuthology.orchestra.run.smithi090.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52381.log.gz 2024-09-21T03:26:40.389 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55530.log 2024-09-21T03:26:40.389 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42849.log.gz 2024-09-21T03:26:40.390 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42370.log.gz 2024-09-21T03:26:40.390 INFO:teuthology.orchestra.run.smithi090.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36737.log.gz 2024-09-21T03:26:40.390 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52297.log 2024-09-21T03:26:40.390 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45089.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44921.log.gz 2024-09-21T03:26:40.391 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53173.log 2024-09-21T03:26:40.391 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55530.log.gz 2024-09-21T03:26:40.391 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53671.log 2024-09-21T03:26:40.392 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52297.log.gz 2024-09-21T03:26:40.393 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43241.log 2024-09-21T03:26:40.393 INFO:teuthology.orchestra.run.smithi090.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53173.log.gz 2024-09-21T03:26:40.393 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51255.log 2024-09-21T03:26:40.393 INFO:teuthology.orchestra.run.smithi090.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53671.log.gz 2024-09-21T03:26:40.394 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49663.log 2024-09-21T03:26:40.395 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43917.log 2024-09-21T03:26:40.395 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51255.log.gz 2024-09-21T03:26:40.395 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50489.log 2024-09-21T03:26:40.396 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43815.log 2024-09-21T03:26:40.397 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55152.log 2024-09-21T03:26:40.397 INFO:teuthology.orchestra.run.smithi090.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50489.log.gz 2024-09-21T03:26:40.398 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45257.log 2024-09-21T03:26:40.398 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48666.log 2024-09-21T03:26:40.399 INFO:teuthology.orchestra.run.smithi090.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.55152.log.gz 2024-09-21T03:26:40.399 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55954.log 2024-09-21T03:26:40.400 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46291.log 2024-09-21T03:26:40.400 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45089.log.gz 2024-09-21T03:26:40.401 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55954.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55954.log.gz 2024-09-21T03:26:40.401 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44193.log 2024-09-21T03:26:40.401 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43241.log.gz 2024-09-21T03:26:40.402 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49663.log.gz 2024-09-21T03:26:40.402 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49938.log 2024-09-21T03:26:40.403 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46291.log: /var/log/ceph/ceph-client.admin.44193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46375.log 2024-09-21T03:26:40.404 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52921.log 2024-09-21T03:26:40.404 INFO:teuthology.orchestra.run.smithi090.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49938.log.gz 2024-09-21T03:26:40.404 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36648.log 2024-09-21T03:26:40.405 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48666.log.gz 2024-09-21T03:26:40.405 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51526.log 2024-09-21T03:26:40.406 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.52921.log.gz 2024-09-21T03:26:40.406 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44235.log 2024-09-21T03:26:40.407 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46477.log 2024-09-21T03:26:40.408 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51526.log.gz 2024-09-21T03:26:40.408 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56332.log 2024-09-21T03:26:40.409 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54109.log 2024-09-21T03:26:40.410 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36226.log 2024-09-21T03:26:40.410 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56332.log.gz 2024-09-21T03:26:40.411 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45890.log 2024-09-21T03:26:40.411 INFO:teuthology.orchestra.run.smithi090.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54109.log.gz 2024-09-21T03:26:40.411 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41696.log 2024-09-21T03:26:40.412 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46375.log.gz 2024-09-21T03:26:40.413 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52108.log 2024-09-21T03:26:40.413 INFO:teuthology.orchestra.run.smithi090.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46291.log.gz 2024-09-21T03:26:40.413 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55320.log 2024-09-21T03:26:40.414 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53755.log 2024-09-21T03:26:40.414 INFO:teuthology.orchestra.run.smithi090.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52108.log.gz 2024-09-21T03:26:40.415 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46562.log 2024-09-21T03:26:40.415 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55320.log.gz 2024-09-21T03:26:40.416 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55870.log 2024-09-21T03:26:40.416 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53755.log.gz 2024-09-21T03:26:40.417 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46562.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46477.log.gz 2024-09-21T03:26:40.417 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52549.log 2024-09-21T03:26:40.418 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53629.log 2024-09-21T03:26:40.418 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55870.log.gz 2024-09-21T03:26:40.418 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41696.log.gz 2024-09-21T03:26:40.418 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45257.log.gz 2024-09-21T03:26:40.419 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52549.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-21T03:26:40.419 INFO:teuthology.orchestra.run.smithi090.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52549.log.gz 2024-09-21T03:26:40.420 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53569.log 2024-09-21T03:26:40.420 INFO:teuthology.orchestra.run.smithi090.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53629.log.gz 2024-09-21T03:26:40.421 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55788.log 2024-09-21T03:26:40.422 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55194.log 2024-09-21T03:26:40.422 INFO:teuthology.orchestra.run.smithi090.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.53569.log.gz 2024-09-21T03:26:40.423 INFO:teuthology.orchestra.run.smithi090.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36648.log.gz 2024-09-21T03:26:40.423 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55788.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45890.log.gz 2024-09-21T03:26:40.423 INFO:teuthology.orchestra.run.smithi090.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46562.log.gz 2024-09-21T03:26:40.423 INFO:teuthology.orchestra.run.smithi090.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.55788.log.gz 2024-09-21T03:26:40.424 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-21T03:26:40.424 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44235.log.gz 2024-09-21T03:26:40.424 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44193.log.gz 2024-09-21T03:26:40.424 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55194.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30059.log 2024-09-21T03:26:40.425 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mds.c.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55194.log.gz 2024-09-21T03:26:40.425 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53383.log 2024-09-21T03:26:40.425 INFO:teuthology.orchestra.run.smithi090.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-21T03:26:40.426 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph.tmp-client.admin.30059.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30059.log.gz 2024-09-21T03:26:40.426 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53713.log 2024-09-21T03:26:40.427 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36012.log 2024-09-21T03:26:40.427 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.53383.log.gz 2024-09-21T03:26:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51922.log 2024-09-21T03:26:40.428 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53713.log.gz 2024-09-21T03:26:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46081.log 2024-09-21T03:26:40.429 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49770.log 2024-09-21T03:26:40.430 INFO:teuthology.orchestra.run.smithi090.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.51922.log.gz 2024-09-21T03:26:40.430 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50615.log 2024-09-21T03:26:40.431 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53965.log 2024-09-21T03:26:40.432 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55404.log 2024-09-21T03:26:40.432 INFO:teuthology.orchestra.run.smithi090.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50615.log.gz 2024-09-21T03:26:40.433 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56164.log 2024-09-21T03:26:40.433 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53965.log.gz 2024-09-21T03:26:40.434 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54560.log 2024-09-21T03:26:40.434 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.55404.log.gz 2024-09-21T03:26:40.434 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42551.log 2024-09-21T03:26:40.434 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56164.log.gz 2024-09-21T03:26:40.435 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49896.log 2024-09-21T03:26:40.435 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54560.log.gz 2024-09-21T03:26:40.436 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36727.log 2024-09-21T03:26:40.437 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36726.log 2024-09-21T03:26:40.437 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49896.log.gz 2024-09-21T03:26:40.441 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36727.log: /var/log/ceph/ceph-client.admin.36726.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42551.log.gz 2024-09-21T03:26:40.441 INFO:teuthology.orchestra.run.smithi090.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.36726.log.gz 2024-09-21T03:26:40.441 INFO:teuthology.orchestra.run.smithi090.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.36727.log.gz 2024-09-21T03:26:40.446 INFO:teuthology.orchestra.run.smithi090.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.46081.log.gz 2024-09-21T03:26:40.446 INFO:teuthology.orchestra.run.smithi090.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49770.log.gz 2024-09-21T03:26:40.451 INFO:teuthology.orchestra.run.smithi090.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-21T03:26:40.461 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43560.log.gz 2024-09-21T03:26:40.462 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43569.log.gz 2024-09-21T03:26:40.462 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43571.log.gz 2024-09-21T03:26:40.462 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43577.log.gz 2024-09-21T03:26:40.463 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43773.log.gz 2024-09-21T03:26:40.464 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43815.log.gz 2024-09-21T03:26:40.464 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43875.log.gz 2024-09-21T03:26:40.464 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43917.log.gz 2024-09-21T03:26:40.464 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44001.log.gz 2024-09-21T03:26:40.464 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43959.log.gz 2024-09-21T03:26:40.464 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44043.log.gz 2024-09-21T03:26:40.506 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37355.log.gz 2024-09-21T03:26:40.569 INFO:teuthology.orchestra.run.smithi090.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.36197.log.gz 2024-09-21T03:26:40.569 INFO:teuthology.orchestra.run.smithi090.stderr: 74.2% -- replaced with /var/log/ceph/ceph-client.admin.36051.log.gz 2024-09-21T03:26:40.569 INFO:teuthology.orchestra.run.smithi090.stderr: 76.6% -- replaced with /var/log/ceph/ceph-client.admin.36069.log.gz 2024-09-21T03:26:40.569 INFO:teuthology.orchestra.run.smithi090.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.36168.log.gz 2024-09-21T03:26:40.569 INFO:teuthology.orchestra.run.smithi090.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.36131.log.gz 2024-09-21T03:26:40.569 INFO:teuthology.orchestra.run.smithi090.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.36012.log.gz 2024-09-21T03:26:40.698 INFO:teuthology.orchestra.run.smithi149.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-21T03:26:40.702 INFO:teuthology.orchestra.run.smithi090.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36226.log.gz 2024-09-21T03:26:40.722 INFO:teuthology.orchestra.run.smithi090.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36379.log.gz 2024-09-21T03:26:40.723 INFO:teuthology.orchestra.run.smithi090.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36436.log.gz 2024-09-21T03:26:40.723 INFO:teuthology.orchestra.run.smithi090.stderr: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T03:26:40.724 INFO:teuthology.orchestra.run.smithi090.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36491.log.gz 2024-09-21T03:26:40.724 INFO:teuthology.orchestra.run.smithi090.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36567.log.gz 2024-09-21T03:26:40.780 INFO:teuthology.orchestra.run.smithi090.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.36266.log.gz 2024-09-21T03:26:40.840 INFO:teuthology.orchestra.run.smithi090.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36347.log.gz 2024-09-21T03:26:41.260 INFO:teuthology.orchestra.run.smithi149.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T03:26:41.367 INFO:teuthology.orchestra.run.smithi149.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-21T03:26:41.743 INFO:teuthology.orchestra.run.smithi090.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-21T03:26:42.190 INFO:teuthology.orchestra.run.smithi149.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-21T03:26:42.647 INFO:teuthology.orchestra.run.smithi149.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-21T03:26:59.022 INFO:teuthology.orchestra.run.smithi090.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-21T03:26:59.828 INFO:teuthology.orchestra.run.smithi090.stderr: 95.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-21T03:27:07.314 INFO:teuthology.orchestra.run.smithi090.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-21T03:27:14.025 INFO:teuthology.orchestra.run.smithi090.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-21T03:27:18.521 INFO:teuthology.orchestra.run.smithi090.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-21T03:27:18.524 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-21T03:27:18.524 INFO:teuthology.orchestra.run.smithi090.stderr:real 0m38.360s 2024-09-21T03:27:18.524 INFO:teuthology.orchestra.run.smithi090.stderr:user 1m59.058s 2024-09-21T03:27:18.524 INFO:teuthology.orchestra.run.smithi090.stderr:sys 0m10.607s 2024-09-21T03:28:41.593 INFO:teuthology.orchestra.run.smithi149.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-21T03:28:55.030 INFO:teuthology.orchestra.run.smithi149.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-21T03:29:04.957 INFO:teuthology.orchestra.run.smithi149.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-21T03:29:23.026 INFO:teuthology.orchestra.run.smithi149.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-21T03:29:33.973 INFO:teuthology.orchestra.run.smithi149.stderr: 95.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-21T03:29:33.976 INFO:teuthology.orchestra.run.smithi149.stderr: 2024-09-21T03:29:33.976 INFO:teuthology.orchestra.run.smithi149.stderr:real 2m53.808s 2024-09-21T03:29:33.976 INFO:teuthology.orchestra.run.smithi149.stderr:user 1m42.007s 2024-09-21T03:29:33.976 INFO:teuthology.orchestra.run.smithi149.stderr:sys 0m13.727s 2024-09-21T03:29:33.977 INFO:tasks.ceph:Archiving logs... 2024-09-21T03:29:33.977 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913454/remote/smithi090/log 2024-09-21T03:29:33.978 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T03:29:49.926 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913454/remote/smithi149/log 2024-09-21T03:29:49.927 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T03:30:03.748 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T03:30:03.756 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T03:30:03.756 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T03:30:03.761 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T03:30:03.901 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T03:30:03.909 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T03:30:03.910 DEBUG:teuthology.orchestra.run.smithi090:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:30:03.914 DEBUG:teuthology.orchestra.run.smithi149:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:30:03.945 INFO:teuthology.orchestra.run.smithi090.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:30:03.947 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:30:03.964 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:30:03.964 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-09-21T03:30:03.964 INFO:teuthology.orchestra.run.smithi149.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 -226us[ -213us] +/- 45ms 2024-09-21T03:30:03.964 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 64 +411us[ +422us] +/- 70ms 2024-09-21T03:30:03.965 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 -24us[ -24us] +/- 76ms 2024-09-21T03:30:03.965 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:30:03.968 INFO:teuthology.orchestra.run.smithi090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:30:03.968 INFO:teuthology.orchestra.run.smithi090.stdout:=============================================================================== 2024-09-21T03:30:03.968 INFO:teuthology.orchestra.run.smithi090.stdout:^* hv01.front.sepia.ceph.com 3 6 377 0 -209us[ -195us] +/- 45ms 2024-09-21T03:30:03.968 INFO:teuthology.orchestra.run.smithi090.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 +447us[ +461us] +/- 70ms 2024-09-21T03:30:03.968 INFO:teuthology.orchestra.run.smithi090.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 0 +20us[ +20us] +/- 76ms 2024-09-21T03:30:03.968 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:30:03.969 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T03:30:03.979 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T03:30:03.979 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T03:30:04.010 DEBUG:teuthology.orchestra.run.smithi090:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T03:30:04.138 DEBUG:teuthology.orchestra.run.smithi149:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T03:30:04.289 DEBUG:teuthology.orchestra.run.smithi090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T03:30:04.349 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:30:04.350 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T03:30:04.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:30:04.409 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T03:30:04.423 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T03:30:04.483 INFO:teuthology.task.internal:Duration was 1401.434740 seconds 2024-09-21T03:30:04.484 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T03:30:04.517 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T03:30:04.517 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T03:30:04.521 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T03:30:04.623 INFO:teuthology.orchestra.run.smithi090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:30:04.647 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:30:05.108 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T03:30:05.108 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T03:30:05.109 DEBUG:teuthology.orchestra.run.smithi090:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T03:30:05.158 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T03:30:05.158 DEBUG:teuthology.orchestra.run.smithi149:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T03:30:05.211 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T03:30:05.211 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T03:30:05.215 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T03:30:05.274 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T03:30:05.274 DEBUG:teuthology.orchestra.run.smithi090:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T03:30:05.278 DEBUG:teuthology.orchestra.run.smithi149:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T03:30:05.444 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T03:30:05.453 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T03:30:05.454 DEBUG:teuthology.orchestra.run.smithi090:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T03:30:05.520 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T03:30:05.585 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T03:30:05.594 DEBUG:teuthology.orchestra.run.smithi090:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:30:05.600 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:30:05.680 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = core 2024-09-21T03:30:05.688 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = core 2024-09-21T03:30:05.718 DEBUG:teuthology.orchestra.run.smithi090:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:30:05.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:30:05.751 DEBUG:teuthology.orchestra.run.smithi149:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:30:05.785 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:30:05.785 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T03:30:05.795 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T03:30:05.796 DEBUG:teuthology.misc:Transferring archived files from smithi090:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913454/remote/smithi090 2024-09-21T03:30:05.796 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T03:30:05.864 DEBUG:teuthology.misc:Transferring archived files from smithi149:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913454/remote/smithi149 2024-09-21T03:30:05.864 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T03:30:05.928 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T03:30:05.929 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T03:30:05.933 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T03:30:05.968 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T03:30:05.979 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T03:30:05.979 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T03:30:06.000 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T03:30:06.001 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T03:30:06.008 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T03:30:06.038 INFO:teuthology.orchestra.run.smithi090.stdout: 393689 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 03:30 /home/ubuntu/cephtest 2024-09-21T03:30:06.043 INFO:teuthology.orchestra.run.smithi149.stdout: 393262 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 03:30 /home/ubuntu/cephtest 2024-09-21T03:30:06.046 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T03:30:06.055 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T03:30:06.112 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} duration: 1401.4347400665283 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T03:30:06.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T03:30:06.215 INFO:teuthology.run:pass